An accurate model of gas emissions is of high importance in several real-world applications related to monitoring and surveillance. Gas tomography is a non-intrusive optical method to estimate the spatial distribution of gas concentrations using remote sensors. The choice of sensing geometry, which is the arrangement of sensing positions to perform gas tomography, directly affects the reconstruction quality of the obtained gas distribution maps. In this paper, we present an investigation of criteria that allow to determine suitable sensing geometries for gas tomography. We consider an actuated remote gas sensor installed on a mobile robot, and evaluated a large number of sensing configurations. Experiments in complex settings were conducted using a state-of-the-art CFD-based filament gas dispersal simulator. Our quantitative comparison yields preferred sensing geometries for sensor planning, which allows to better reconstruct gas distributions.
Artificial olfaction can help to address pressing environmental problems due to unwanted gas emissions. Sensor networks and mobile robots equipped with gas sensors can be used for e.g. air pollution monitoring. Key in this context is the ability to derive truthful models of gas distribution from a set of sparse measurements. Most statistical gas distribution modelling methods assume that gas dispersion is a time constant random process. While this assumption approximately holds in some situations, it is necessary to model variations over time in order to enable applications of gas distribution modelling in a wider range of realistic scenarios. Time-invariant approaches cannot model well evolving gas plumes, for example, or major changes in gas dispersion due to a sudden change of the environmental conditions. This paper presents two approaches to gas distribution modelling, which introduce a time-dependency and a relation to a time-scale in generating the gas distribution model either by sub-sampling or by introducing a recency weight that relates measurement and prediction time. We evaluated these approaches in experiments performed in two real environments as well as on several simulated experiments. As expected, the comparison of different sub-sampling strategies revealed that more recent measurements are more informative to derive an estimate of the current gas distribution as long as a sufficient spatial coverage is given. Next, we compared a time-dependent gas distribution modelling approach (TD Kernel DM+V), which includes a recency weight, to the state-of-the-art gas distribution modelling approach (Kernel DM+V), which does not consider sampling times. The results indicate a consistent improvement in the prediction of unseen measurements, particularly in dynamic scenarios. Furthermore, this paper discusses the impact of meta-parameters in model selection and compares the performance of time-dependent GDM in different plume conditions. Finally, we investigated how to set the target time for which the model is created. The results indicate that TD Kernel DM+V performs best when the target time is set to the maximum sampling time in the test set.
Emergency response personnel can be exposed to various extreme hazards during the response to natural and human-made disasters. In many of the scenarios, one of the risk factors is the presence of hazardous airborne chemicals. Addressing this risk factor requires typical tiring, taxing and toxic operations that are suitable to be aided by Mobile Robot Olfaction (MRO) techniques. MRO is the research domain combining intelligent mobile robots with an artificial sense of smell. It presents the prospect of practical applications for emergency response as it allows to convey useful information on-site and online without risking the safety of human responders. However, standard gas sampling procedures for laboratory use are not directly applicable to MRO due to the complexity of uncontrolled environments and the need for fast deployment and analysis. Besides, state-of-the-art gas sensing approaches have difficulties handling A Priori Unknown Gases (APUG). In APUG situations, the number or/and identities of the present chemicals are unknown, posing challenges in recognizing the underlying risks with conventional solutions such as supervised learning-based electronic noses or dedicated gas sensors targeting known analytes.
This dissertation focuses on contributions toward real-world applications of robot-aided gas sensing with an APUG problem setup. The dissertation starts with a requirement analysis of Gas Sensing for Emergency Response (GSER) to identify the key tasks in ad hoc applications. Considering that not all analytes of interest in a field application may be known in advance, a pipeline incorporating non-supervised detection and discrimination of multiple chemicals and consequent distribution modelling is found to be important for GSER. The remainder of the thesis fills this pipeline with three steps: 1) An ensemble learning-based gas detection approach is proposed to recognize significant changes from sensor signals as well as model the baseline response pattern. 2) A clustering analysis-based gas discrimination approach is developed to perform online analysis that automatically learns the number of different chemical compounds from the acquired measurements and provides a probabilistic representation of their class labels. 3) The integration of the proposed non-supervised gas detection and gas discrimination approaches with gas distribution modelling allows prototyping of a GSER system, which can enhance emergency responders’ situational awareness in the target environment. This GSER system demonstrates the concept of discriminating and mapping multiple unknown chemical compounds in uncontrolled environments with validation and evaluation using real-world data sets.
During the research on the GSER system, gas dispersal simulation is also investigated to facilitate MRO algorithm development and validation in general. In-field experiments of MRO algorithms are often time-consuming, expensive, cumber some, and lack repeatability, while most of the available simulation tools are limited to insitu gas sensors and simple environments. These issues were addressed by improving a simulation framework to replicate geometrical representations of actual real-world environments and support a variety of gas sensor models. The potential applicability of the resulting work is demonstrated by simulating a gas emission monitoring task and facilitating the development process of a state-of-the-art time-dependent gas distribution modelling algorithm.
Mobile robot platforms equipped with olfaction systems have been used in many gas sensing applications. However, in-field validation of mobile robot olfaction systems is time consuming, expensive, cumbersome and lacks repeatability. In order to address these issues, simulation tools are used. However, the available mobile robot olfaction simulations lack models for remote gas sensors, and the possibility to import geometrical representations of actual real-world environments in a convenient way. In this paper, we describe extensions to an open-source CFD-based filament gas dispersal simulator. These improvements arrow to use robot-created occupancy maps and offer remote sensing capabilities in the simulation loop. We demonstrate the novel features in an example application: we created a 3D map a complex indoor environment, and performed a gas emission monitoring task with a Tunable Diode Laser Absorption Spectroscopy based remote gas sensor in a simulated version of the environment.
Gas discrimination in open and uncontrolled environments based on smart low-cost electro-chemical sensor arrays (e-noses) is of great interest in several applications, such as exploration of hazardous areas, environmental monitoring, and industrial surveillance. Gas discrimination for e-noses is usually based on supervised pattern recognition techniques. However, the difficulty and high cost of obtaining extensive and representative labeled training data limits the applicability of supervised learning. Thus, to deal with the lack of information regarding target substances and unknown interferents, unsupervised gas discrimination is an advantageous solution. In this work, we present a cluster-based approach that can infer the number of different chemical compounds, and provide a probabilistic representation of the class labels for the acquired measurements in a given environment. Our approach is validated with the samples collected in indoor and outdoor environments using a mobile robot equipped with an array of commercial metal oxide sensors. Additional validation is carried out using a multi-compound data set collected with stationary sensor arrays inside a wind tunnel under various airflow conditions. The results show that accurate class separation can be achieved with a low sensitivity to the selection of the only free parameter, namely the neighborhood size, which is used for density estimation in the clustering process.
Detecting chemical compounds using electronic noses is important in many gas sensing related applications. Existing gas detection methods typically use prior knowledge of the target analytes. However, in some scenarios, the analytes to be detected are not fully known in advance, and preparing a dedicated model is not possible. To address this issue, we propose a gas detection approach using an ensemble of one-class classifiers. The proposed approach is initialized by learning a Mahalanobis-based and a Gaussian based model using clean air only. During the sampling process, the presence of chemicals is detected by the initialized system, which allows to learn a one-class nearest neighbourhood model without supervision. From then on the gas detection considers the predictions of the three one-class models. The proposed approach is validated with real-world experiments, in which a mobile robot equipped with an e-nose was remotely controlled to interact with different chemical analytes in an open environment.
Emergency personnel, such as firefighters, bomb technicians, and urban search and rescue specialists, can be exposed to a variety of extreme hazards during the response to natural and human-made disasters. In many of these scenarios, a risk factor is the presence of hazardous airborne chemicals. The recent and rapid advances in robotics and sensor technologies allow emergency responders to deal with such hazards from relatively safe distances. Mobile robots with gas-sensing capabilities allow to convey useful information such as the possible source positions of different chemicals in the emergency area. However, common gas sampling procedures for laboratory use are not applicable due to the complexity of the environment and the need for fast deployment and analysis. In addition, conventional gas identification approaches, based on supervised learning, cannot handle situations when the number and identities of the present chemicals are unknown. For the purpose of emergency response, all the information concluded from the gas detection events during the robot exploration should be delivered in real time. To address these challenges, we developed an online gas-sensing system using an electronic nose. Our system can automatically perform unsupervised learning and update the discrimination model as the robot is exploring a given environment. The online gas discrimination results are further integrated with geometrical information to derive a multi-compound gas spatial distribution map. The proposed system is deployed on a robot built to operate in harsh environments for supporting fire brigades, and is validated in several different real-world experiments of discriminating and mapping multiple chemical compounds in an indoor open environment. Our results show that the proposed system achieves high accuracy in gas discrimination in an online, unsupervised, and computationally efficient manner. The subsequently created gas distribution maps accurately indicate the presence of different chemicals in the environment, which is of practical significance for emergency response.
Gas discrimination with Open Sampling Systems based on low-cost electro-chemical sensor arrays is of great interest in several applications, such as exploration of hazardous areas and environmental monitoring. Due to the lack of labeled training data or the high costs of obtaining them, as well as the presence of unknown interferents in the target environments, supervised learning is often not applicable and thus, unsupervised learning is an interesting alternative. In this work, we present a cluster analysis approach that can infer the number of different chemical compounds and label the measurements in a given uncontrolled environment without relying on previously acquired training data. Our approach is validated with data collected in indoor and outdoor environments by a mobile robot equipped with an array of metal oxide sensors. The results show that high classification accuracy can be achieved with a rather low sensitivity to the selection of the only functional parameter of our proposed algorithm.
Gas identification using an electronic nose (e-nose) typically relies on a multi-class classifier trained with extensive data of a limited set of target analytes. Usually, classification performance degrades in the presence of mixtures that include interferents not represented in the training data. This issue limits the applicability of e-noses in real-world scenarios where interferents are a priori unknown. This paper investigates the feasibility of tackling this particular gas identification problem using one-class learning. We propose several training strategies for a one-class support vector machine to deal with gas mixtures composed of a target analyte and an interferent at different concentration levels. Our evaluation indicates that accurate identification of the presence of a target analyte is achievable if it is dominant in a mixture. For interferent-dominant mixtures, extensive training is required, which implies that an improvement in the generalization ability of the one-class model is needed.
Detecting chemical compounds using electronic noses is important in many gas sensing related applications. A gas detection system is supposed to indicate a significant event, such as the presence of new chemical compounds or a noteworthy change of concentration levels. Existing gas detection methods typically rely on prior knowledge of target analytes to prepare a dedicated, supervised learning model. However, in some scenarios, such as emergency response, not all the analytes of concern are a priori known and their presence are unlikely to be controlled. In this paper, we take a step towards addressing this issue by proposing an ensemble learning-based approach (ELBA) that integrates several one-class classifiers and learns online. The proposed approach is initialized by training several one-class models using clean air only. During the sampling process, the initialized system detects the presence of chemicals, allowing to learn another one-class model and update existing models with self-labelled data. We validated the proposed approach with real-world experiments, in which a mobile robot equipped with an e-nose was remotely controlled to interact with different chemical analytes in an uncontrolled environment. We demonstrated that the ELBA algorithm not only can detect gas exposures but also recognize baseline responses under a suspect short-term sensor drift condition. Depending on the problem setups in practical applications, the present work can be easily hybridized to integrate other supervised learning models when the prior knowledge of target analytes is partially available.
In real-world scenarios, gas sensor responses to mixtures of different compositions can be costly to determine a-priori, posing difficulties in identifying the presence of target analytes. In this paper, we propose the use of graph convolutional networks (GCN) to handle gas mixtures with few labelled data. We transform sensor responses into a graph structure using manifold learning and clustering, and then apply GCN for semisupervised node classification. Our approach does not require extensive training data of gas mixtures like many competing approaches, but it outperforms classical semi-supervised learning methods and achieves classification accuracy exceeding 88.5% and over 0.85 Cohen's kappa score given only 5% labelled data for training. This result demonstrates the potential towards realistic gas identification when varied mixtures are present.
For mobile robots that operate in complex, uncontrolled environments, estimating air flow models can be of great importance. Aerial robots use air flow models to plan optimal navigation paths and to avoid turbulence-ridden areas. Search and rescue platforms use air flow models to infer the location of gas leaks. Environmental monitoring robots enrich pollution distribution maps by integrating the information conveyed by an air flow model. In this paper, we present an air flow modelling<?brk?> algorithm that uses wind data collected at a sparse number of locations to estimate joint probability distributions over wind speed and direction at given query locations. The algorithm uses a novel extrapolation approach that models the air flow as a linear combination of laminar and turbulent components. We evaluated the prediction capabilities of our algorithm with data collected with an aerial robot during several exploration runs. The results show that our algorithm has a high degree of stability with respect to parameter selection while outperforming conventional extrapolation approaches. In addition, we applied our proposed approach in an industrial application, where the characterization of a ventilation system is supported by a ground mobile robot. We compared multiple air flow maps recorded over several months by estimating stability maps using the Kullback–Leibler divergence between the distributions. The results show that, despite local differences, similar air flow patterns prevail over time. Moreover, we corroborated the validity of our results with knowledge from human experts.
In industrial environments, such as metallurgic facilities, human operators are exposed to harsh conditions where ambient air is often polluted with quartz, dust, lead debris and toxic fumes. Constant exposure to respirable particles can cause irreversible health damages and thus it is of high interest for occupational health experts to monitor the air quality on a regular basis. However, current monitoring procedures are carried out sparsely, with data collected in single day campaigns limited to few measurement locations. In this paper we explore the use and present first experimental results of a novel heterogeneous approach that uses a mobile robot and a network of low cost sensing nodes. The proposed system aims to address the spatial and temporal limitations of current monitoring techniques. The mobile robot, along with standard localization and mapping algorithms, allows to produce short term, spatially dense representations of the environment where dust, gas, ambient temperature and airflow information can be modelled. The sensing nodes on the other hand, can collect temporally dense (and usually spatially sparse) information during long periods of time, allowing in this way to register for example, daily variations in the pollution levels. Using data collected with the proposed system in an steel foundry, we show that a heterogeneous approach provides dense spatio-temporal information that can be used to improve the working conditions in industrial facilities.
This work presents a simulation framework developed under the widely used Robot Operating System (ROS) to enable the validation of robotics systems and gas sensing algorithms under realistic environments. The framework is rooted in the principles of computational fluid dynamics and filament dispersion theory, modeling wind flow and gas dispersion in 3D real-world scenarios (i.e., accounting for walls, furniture, etc.). Moreover, it integrates the simulation of different environmental sensors, such as metal oxide gas sensors, photo ionization detectors, or anemometers. We illustrate the potential and applicability of the proposed tool by presenting a simulation case in a complex and realistic office-like environment where gas leaks of different chemicals occur simultaneously. Furthermore, we accomplish quantitative and qualitative validation by comparing our simulated results against real-world data recorded inside a wind tunnel where methane was released under different wind flow profiles. Based on these results, we conclude that our simulation framework can provide a good approximation to real world measurements when advective airflows are present in the environment.
To better understand the dynamics in hazardous environments, gas distribution mapping aims to map the gas concentration levels of a specified area precisely. Sampling is typically carried out in a spatially sparse manner, either with a mobile robot or a sensor network and concentration values between known data points have to be interpolated. In this paper, we investigate sequential deep learning models that are able to map the gas distribution based on a multiple time step input from a sensor network. We propose a novel hybrid convolutional LSTM - transpose convolutional structure that we train with synthetic gas distribution data. Our results show that learning the spatial and temporal correlation of gas plume patterns outperforms a non-sequential neural network model.
In this work we present a novel multi-sensor unit to detect and discriminate unknown gases in uncontrolled environments. The unit includes three metal oxide (MOX) sensors with CMOS micro heaters, a plasmonic enhanced non-dispersive infra-red (NDIR) sensor, a commercial temperature humidity sensor, and a flow sensor. The proposed sensing unit was evaluated with plumes of gases (propanol, ethanol and acetone) in both, a laboratory setup on a gas testing bench and on-board a mobile robot operating in an indoor workshop. It offers significantly improved performance compared to commercial systems, in terms of power consumption, response time and physical size. We verified the ability to discriminate gases in an unsupervised manner, with data collected on the robot and high accuracy was obtained in the classification of propanol versus acetone (96%), and ethanol versus acetone (90%).
In this work we present a novel multi-sensor unit, a.k.a. FireNose, to detect and discriminate both known and unknown gases in uncontrolled conditions to aid firefighters under harsh conditions. The unit includes three metal oxide (MOX) gas sensors with CMOS micro heaters, a plasmonic enhanced non-dispersive infrared (NDIR) sensor optimized for the detection of CO2, a commercial temperature humidity sensor, and a flow sensor. We developed custom film coatings for the MOX sensors (SnO2, WO3 and NiO) which greatly improved the gas sensitivity, response time and lifetime of the miniature devices. Our proposed system exhibits promising performance for gas sensing in harsh environments, in terms of power consumption (∼ 35 mW at 350°C per MOX sensor), response time (<10 s), robustness and physical size. The sensing unit was evaluated with plumes of gases in both, a laboratory setup on a gas testing rig and on-board a mobile robot operating indoors. These high sensitivity, high-bandwidth sensors, together with online unsupervised gas discrimination algorithms, are able to detect and generate their spatial distribution maps accordingly. In the robotic experiments, the resulting gas distribution maps corresponded well to the actual location of the sources. Therefore, we verified its ability to differentiate gases and generate gas maps in real-world experiments.