FP7-ICT-2007-C, FET open
Goals: The project aims at developing mobile systems to recognize human activity with dynamically varying sensor setups. We refer to such systems as opportunistic, since they take advantage of sensing modalities that just happen to be available, rather than forcing to deploy specific, application dependent sensor systems.
Summary: We envision opportunistic activity recognition systems. They are goal-oriented sensor assemblies that spontaneously arise and self-organize to achieve a common goal, here activity and context recognition.
The objective of OPPORTUNITY is to develop generic principles, algorithms and system architectures to reliably recognize complex activities and contexts despite the absence of static assumptions about sensor availability and characteristics in opportunistic systems.
OPPORTUNITY picks up on the very essential methodological underpinnings of any Ambient Intelligence (AmI) scenario: recognizing (and understanding) context and activity.
Methodologies are missing to design context-aware systems that
- work over long periods of time despite changes in sensing infrastructure (sensor failures, degradation);
- provide the freedom to users to change wearable device placement;
- can be deployed without user-specific training.
This limits the real-world deployment of AmI systems.
We develop opportunistic systems that recognize complex activities/contexts despite the absence of static assumptions about sensor availability and characteristics. They are based on goal-oriented sensor assemblies spontaneously arising and self-organizing to achieve a common activity/context recognition goal. They are embodied and situated, relying on self-supervised learning to achieve autonomous operation. They make best use of the available resources, and keep working despite-or improves thanks to-changes in the sensing environment. Changes include e.g. placement, modality, sensor parameters and can occur at runtime.
Four groups contribute to this goal. We develop:
- intermediate features that reduce the impact of sensor parameter variability and isolate the recognition chain from sensor specificities;
- classifier and classifier fusion methods suited for opportunistic systems, capable of incorporating new knowledge online, monitoring their own performance, and dynamically selecting most appropriate information sources;
- unsupervised dynamic adaptation and autonomous evolution principles to cope with short term changes and long term trends in sensor infrastructure,
- goal-oriented cooperative sensor ensembles to opportunistically collect data about the user and his environment in a scalable way.
The methods are demonstrated in complex opportunistic activity recognition scenarios, and on robust opportunistic EEG-based BCI systems.
Partners: ETH Zurich, UoPassau, IDIAP
Status: started February 1st, 2009
Funding: EU FP7 ICT, FET open
Duration: 2009 - 2012
Enabling Dynamic Sensor Configuration and Cooperation in Opportunistic Activity Recognition Systems
International Journal of Distributed Sensor Networks, Vol. 2013, 13 pages, June 2013.
Locomotion@Location: When the Rubber hits the Road
The 9th International Conference on Autonomic Computing (ICAC2012), 5 pages, September 2012.
Goal-Oriented Opportunistic Sensor Clouds
The 2nd International Symposium on Secure Virtual Infrastructures (DOA-SVI'12), 10-14 Sept 2012, Roma, Italy, Springer Verlag, September 2012.
Goal Oriented Opportunistic Recognition of High-Level Composed Activities using Dynamically Configured Hidden Markov Models
The 3rd International Conference on Ambient Systems, Networks and Technologies (ANT2012), August 2012.
Dynamic Adaptation of Opportunistic Sensor Configurations for Continuous and Accurate Activity Recognition
Fourth International Conference on Adaptive and Self-Adaptive Systems and Applications (ADAPTIVE2012), July 22-27, Nice, France, ISBN: 978-1-61208-219-6, July 2012.
Best Paper Award
The OPPORTUNITY Framework and Data Processing Ecosystem for Opportunistic Activity and Context Recognition
International Journal of Sensors, Wireless Communications and Control, Special Issue on Autonomic and Opportunistic Communications, Bentham Science Publishers, ISSN: 2210-3279, December 2011.
Real-Time Transfer and Evaluation of Activity Recognition Capabilities in an Opportunistic System
Third International Conference on Adaptive and Self-Adaptive Systems and Applications (ADAPTIVE2011), September 25-30, Rome, Italy, pp. 73-78, ISBN: 978-1-61208-156-4, September 2011.
A Framework for Opportunistic Context and Activity Recognition
9th International Conference on Pervasive Computing (Pervasive2011), June 12-15, San Francisco, CA, USA, June 2011.
Goal Oriented Opportunistic Sensing
9th International Conference on Pervasive Computing (Pervasive2011), Doctoral Consortium, June 12-15, San Francisco, CA, USA, June 2011.
Dynamic Quantification of Activity Recognition Capabilities in Opportunistic Systems
Fourth Conference on Context Awareness for Proactive Systems: CAPS2011, 15-16 May 2011, Budapest, Hungary, May 2011.
Activity recognition in opportunistic sensor environments
The European Future Technologies Conference and Exhibition (FET11), 4-6 May, Budapest, Hungary, 2 pages, May 2011.
Robust activity recognition for assistive technologies: Benchmarking ML techniques
Workshop on Machine Learning for Assistive Technologies at the Twenty-Fourth Annual Conference on Neural Information Processing Systems (NIPS-2010), December 2010.
Sensor Abstractions for Opportunistic Activity and Context Recognition Systems
5th European Conference on Smart Sensing and Context (EuroSSC 2010), November 14-16, Passau Germany, Editors: Lukowicz, Paul; Kunze, Kai; Kortuem, Gerd, Springer LNCS, Berlin-Heidelberg, pp. 135-149, ISBN: 978-3-642-16981-6, November 2010.
DarSens: A Framework for Distributed Activity Recognition from Body-Worn Sensors
Proceedings of the Fifth International Conference on Body Area Networks (BodyNets'10), Corfu Island, Greece, September 2010.
Goal-Driven opportunistic Sensing
12th ACM International Conference on Ubiquitous Computing (Ubicomp 2010), Doctoral Colloquium, Copenhagen, Denmark, September 26 - 29, 2010, Adjunct Proceedings, September 2010.
Towards a Framework for opportunistic Activity and Context Recognition
12th ACM International Conference on Ubiquitous Computing (Ubicomp 2010), Workshop on Context awareness and information processing in opportunistic ubiquitous systems, Copenhagen, Denmark, September 26 - 29, 2010, September 2010.
Collecting complex activity data sets in highly rich networked sensor environments
Proceedings of the Seventh International Conference on Networked Sensing Systems (INSS), Kassel, Germany, IEEE Computer Society Press, June 2010.
Walk-through the OPPORTUNITY dataset for activity recognition in sensor rich environments
Adjunct Proceedings of the Eighth International Conference on Pervasive Computing, Helsinki, Finland, May 2010.
A Framework for Utilizing Qualitative Spatial Relations between Networked Embedded Systems
Pervasive and Mobile Computing, Elsevier B.V., Vol. 6, No. 3, pp. 362-381, March 2010.
Recording a Complex, Multi Modal Activity Data Set for Context Recognition
Proceedings of the 1st Workshop on Context-Systems Design, Evaluation and Optimisation (CosDEO 2010), VDE Publishing House, Hannover, Germany, February 2010.
A Self-Organizing Approach to Activity Recognition with Wireless Sensors
Proceedings of the 4th International Workshop on Self-Organizing Systems (IWSOS 2009), Springer LNCS, ETH Zurich, Switzerland, December 2009.
Variability in foot-worn sensor placement for activity recognition
Proceedings of the 13th International Symposium on Wearable Computers (ISWC'09), Sept 4-7 2009, Linz, Austria, IEEE Computer Society Press, September 2009.
OPPORTUNITY: Towards opportunistic activity and context recognition systems
Proceedings of the 3rd IEEE WoWMoM Workshop on Autonomic and Opportunistic Communications (AOC 2009), IEEE CS Press, Kos, Greece, June 2009.
OPPORTUNITY: activity and context awareness in opportunistic open-ended sensor environments
Poster at the 1st European Future Emerging Technologies Conference (FET 2009), Prague, Czech Republic, April 2009.
Pervasive Adaptation in Car Crowds
First International Workshop on User-Centric Pervasive Adaptation (UCPA) at MOBILWARE 2009, Berlin, Germany, Lecture Notes of the Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering (LNICST), Springer Berlin, Heidelberg, 6 pages, April 2009.