An approach to activity recognition using multiple sensors

Abstract

Building smart home environments which automatically or semi-automatically assist and comfort occupants is an important topic in the pervasive computing field, especially with the coming of cheap, easy-to-install sensors. This has given rise to the indispensable need for human activity recognition from ubiquitous sensors whose purpose is to observe and understand what occupants are trying to do from sensory data. The main approach to the problem of human activity recognition is a probabilistic one so as to handle the complication of uncertainty, the overlapping of human behaviours and environmental noise. This thesis develops a probabilistic model as a framework for human activity recognition using multiple multi-modal sensors in complex pervasive environments. The probabilistic model to be developed is adapted and based on the abstract hidden Markov model (AHMM) with one layer to fuse multiple sensors. The concept of factored state representation is employed in the model to parsimoniously represent the state transitions for reducing the number of required parameters. The exact method is used in learning the model’s parameters and performing inference. To be able to incorporate a large number of sensors, several more parsimonious representations including the mixtures of smaller multinomials and sigmoid functions are investigated to model the state transitions, resulting in a reduction of the number of parameters and time required for training.We examine the approximate variational method to significantly reduce the time required for training the model instead of using the exact method. A system of fixed point equations is derived to iteratively update the free variational parameters. We also present the factored model in the case where all variables are continuous with the use of the conditional Gaussian distribution to model state transitions. The variational method is still employed in this case to speed up the model’s training process. The developed model is implemented and applied in recognizing daily activity in our smart home and the Nokia lab from multiple sensors. The experimental results show that the model is appropriate for fusing multiple sensors in activity recognition with a reasonable recognition performance.