Projektnummer: 033279	Projekttitel: SENSE
Smart Embedded Network of Sensing Entities
Projektleiter	Dietmar Bruckner
Adresse	Gusshausstrasse 27/384, 1040 Wien
Universität / Forschungsstätte	Technische Universität Wien Institut für Computertechnik
Bewilligungsdatum	Bewilligungsdatum (13.12.2005)
Beginn	Projektbeginn (01.09.2006) Projektende (31.05.2010)
Gebiet(e)	IST 2.5.3. Embedded Systems
Keywords	Embedded Systems, Self-learning, Wireless Sensor Networks, easy Installation, Machine Perception, Neighborhood Creation

The SENSE project (Smart Embedded Network of Sensing Entities) will develop methods, tools and a test platform for the design, implementation and operation of smart adaptive wireless networks of embedded sensing components. The network is an ambient intelligent system which adapts to its environment, creates ad-hoc networks of heterogeneous components, and delivers reliable information to its component sensors and the user. The sensors cooperate to build and maintain a coherent global view from local information. Newly added nodes automatically calibrate themselves to the environment, and share knowledge with neighbors. The network is scalable due to local information processing and sharing, and self-organizes based on the physical placement of nodes.

A test platform for a civil security monitoring system will be developed as a test application, composed of video cameras and microphones. The test platform will be installed in an airport, to yield real data and performance goals from a realistic test environment. Each sensor is a stand-alone system consisting of multiple embedded components: video system, audio system, central processor, power source and wireless networking. The security application will implement object/scenario recognition (e.g. baggage left unattended, people “lurking” in an area). Nodes will recognize local objects, using a combination of video and audio information, and neighboring nodes will exchange information about objects in a self-organizing network. The result is a global overview of current objects and events observed by the network.

The key innovative aspects are the methods by which the network perceives its environment, fuses these perceptions using local message passing to achieve local and global object recognition, and calibrates itself based on its environment. Challenges include perception, adaptation, and learning, as well as tools to diagnose and maintain a self-adapting distributed network of embedded components.

Dietmar Bruckner
Martin Hausner
Edgar Holleis
Josef Mitterbauer
Roland Oberhammer
GuoQing Yin
Gerhard Zucker

[1]   Gerhard Zucker (formerly Pratl), Laurentiu Frangu, “Smart Nodes for Semantic Analysis of Visual and Aural Data”, Proceedings of the 5th International Conference on Industrial Informatics (INDIN 2007), p. 1027 – 1032, Vienna, 2007.

[2]   Dietmar Bruckner, Jamal Kasbi, Rosemarie Velik, Wolfgang Herzner, “High-level Hierarchical Semantic Processing Framework for Smart Sensor Networks”, Human System Interaction Conference, Krakow, 25 – 27 May, 2008, Krakow, Poland.

[3]   Dietmar Bruckner, Brian Sallans, Gerhard Russ, “Hidden Markov Models for Traffic Observation”, Proceedings of the 5th International Conference on Industrial Informatics (INDIN 2007), p. 1015 – 1020, Vienna, 2007.

[4]   Dietmar Bruckner, Brian Sallans, Roland Lang, “Behavior Learning via State Chains from Motion Detector Sensors”, Proceedings of the 2nd International Conference on Bio-Inspired Models of Network, Information, and Computing Systems (BIONETICS 2007), p. 8, Budapest, 2007.

[5]   Dietmar Bruckner, “Projektbericht – Home-Monitoring: Aktuelle Ergebnisse mit statistischen Methoden” (project report home monitoring: recent results with probabilistic methods”, presented at the symposium “Gesünder Länger Leben” (“living longer and healthier”), Krems, Austria.

[6]   J. Rosell-Ortega, G. Andreu-García, A. Rodas-Jordà, V. Atienza-Vanacloig, J. Valiente-González, “Feature sets for people, and luggage recognition in airport surveillance under real-time constraints”, International Joint Conference on Computer Vision and Computer Graphics Theory and Applications. 22-25 January 2008, Funchal, Madeira – Portugal.

[7]   Simo J., Benet G., Andreu G., “Embedded Video Processing for Distributed Intelligent Sensor Networks”, Proceedings of the 3rd International Conference “from Scientific Computing to Computational Engineering” (3rd IC-SCCE), 9 – 12 July 2008, Athens, Greece.

[8]   Picus C., Cambrini L., Bruckner D., Zucker G., Herzner W., “A Distributed Approach to Global Semantic Learning over a Large Sensor Network” , Proceedings of the 3rd International Conference “from Scientific Computing to Computational Engineering” (3rd IC-SCCE), 9 – 12 July 2008, Athens, Greece.

[9]   Bruckner D., Zucker G., Simo J., Herzner W., Mahlknecht S., “Semantic Neighborhood Sensor Network for Smart Surveillance Applications ”, Proceedings of the 3rd International Conference “from Scientific Computing to Computational Engineering” (3rd IC-SCCE), 9 – 12 July 2008, Athens, Greece.

[10] Frangu L., Mazarel M., Chiculita C., Epure S., “An Embedded Platform for Smart Multiple Sensor Network”, Proceedings of the 3rd International Conference “from Scientific Computing to Computational Engineering” (3rd IC-SCCE), 9 – 12 July 2008, Athens, Greece.

[11] G. Sîrbu, I. Bogdan, L. Frangu, N. Jalbă: “Channel Allocation Scheme Using Agents Technology” , Proceedings of the 3rd International Conference “from Scientific Computing to Computational Engineering” (3rd IC-SCCE), 9 – 12 July 2008, Athens, Greece.

[12] Tsahalis D., Nokas G., Tsokas K., Photeinos D., “The Use of Decision Tree Classifiers for the Detection of Sound Objects Using Microphone Array Filtered Data – Part I: Theoretical Background” , Proceedings of the 3rd International Conference “from Scientific Computing to Computational Engineering” (3rd IC-SCCE), 9 – 12 July 2008, Athens, Greece.

[13] Tsahalis D., Nokas G., Tsokas K., Photeinos D., “The Use of Decision Tree Classifiers for the Detection of Sound Objects Using Microphone Array Filtered Data – Part II Applications” , Proceedings of the 3rd International Conference “from Scientific Computing to Computational Engineering” (3rd IC-SCCE), 9 – 12 July 2008, Athens, Greece.

[14] D. Bruckner, R. Velik, and G. Zucker, “Network of Cooperating Smart Sensors for Global-View Generation in Surveillance Applications” 6th IEEE INDIN, 2008.

[15] J. Rosell-Ortega G. Andreu-García A. Rodas-Jordá V. Atienza-Vanacloig, “Background Modelling in Demanding Situations with Confidence Measure” Submitted at ICPR2008.

[16] V. Atienza-Vanacloig , J. Rosell-Ortega , G. Andreu-Garcia , J. M. Valiente-González, “People and Luggage Recognition in Airport Surveillance Under Real-Time Constraints“ Submitted at ICPR2008.

[17] L. Frangu, S. Epure, M. Măzărel, C. Chiculiţă: An Embedded Platform for Video and Audio Signal Processing, IEEE Intl. Symposium for Design and Technology of Electronic Packages 2008, Sept. 18-21, Predeal, Romania (CD proceedings, paper 84)

[18] C. Picus, L. Cambrini, W. Herzner, Boltzmann Machine Topology Learning for Distributed Sensor Networks Using Loopy Belief Propagation Inference, International Conference on Machine Learning and Applications, 11 – 13 December 2008.

[19] J. Rosell-Ortega and G. Andreu-Garcia. Background modelling with associated confidence, Pattern Recognition, Peng-Yeng Yin (Ed.), ISBN: 978-953-307-014-8, INTECH 2009, Available from: http://sciyo.com/articles/show/title/background-modelling-with-associated-confidence?PHPSESSID=rciui516hu439pe5l83gmmb991.

[20] D. Bruckner, C. Picus, R. Velik, W. Herzner, and G. Zucker: “High-level Hierarchical Semantic Processing Framework for Smart Sensor Networks”, in: Z. S. Hippe and J. L. Kulikowski (Editors): “Human-Computer Systems Interaction: Backgrounds and Applications”, Springer Berlin/Heidelberg, ISBN: 978-3-642-03201-1, p. 347-358, 2009.

[21] G.Q. Yin, and D. Bruckner: “Gaussian Models and Fast Learning Algorithm for Persistence Analysis of Tracked Video Objects”, Proceedings of the 2nd IEEE HSI 2009, 21 – 23 May 2009, Catania, Italy.

[22] G.Q. Yin, and D. Bruckner: “Fast Learning Algorithm for Gaussian Models to Analyze Video Objects with Parameter Size”, Proceedings of the 14th IEEE ETFA’09, 22 – 26 September 2009, Mallorca, Spain.

[23] G.Q. Yin, D. Bruckner, and G. Zucker: “Statistical Modeling of Video Object’s Behavior for Improved Object Tracking in Visual Surveillance”, Proceedings of the 9th IEEE AFRICON’09, 23 – 25 September 2009, Nairobi, Kenya.

[24] G.Q. Yin and D. Bruckner: “Gaussian Mixture Models and Split-Merge Algorithm for Parameter Analysis of Tracked Video Objects”, Proceedings of the 35th IEEE IECON’09, 3 – 5 November 2009, Porto, Portugal.

[25] Ginés Benet, José E. Simó, Gabriela Andreu-García, Juan Rosell and Jordi Sánchez, Embedded Low-Level Video Processing for Surveillance Purposes, Proceedings of the 3rd International Conference on Human System Interaction HSI 2010, Rzeszow, Poland, May 13-15, 2010.

[26] Roland Lang, Stefan Kohlhauser, Gerhard Zucker and Tobias Deutsch, “Integrating Internal Performance Measures into the Decision Making Process of Autonomous Agents”, Proceedings of the 3rd International Conference on Human System Interaction HSI 2010, Rzeszow, Poland, May 13-15, 2010.

[27] Dietmar Dietrich, Roland Lang, Dietmar Bruckner, Georg Fodor and Brit Muller, Limitations, Possibilities and Implications of Brain-Computer Interfaces , Proceedings of the 3rd International Conference on Human System Interaction HSI 2010, Rzeszow, Poland, May 13-15, 2010.

[28] Juan Rosell-Ortega;Gabriela Andreu;Vicente Atienza;Fernando López-García, Background modeling with motion criterion and multi-modal support, Proceedings of the international Conference on Computer Vision Theory and Applications (VISAPP-2010) May 2010.

[29] G. Wrobel, M. Jachimski, Z. Mikos, G. Hayduk, P. Kwasnowski, SENSE – Smart Embedded Network of Sensing Entities, Proceeding of the International Carpathian Control Conference (ICCC 2010) 26 – 28 May 2010

[30] Laurentiu Frangu, Marius Mazarel, Claudiu Chiculita, “Audio Source Localization, using a Network of Embedded Devices”, Proceeding of the International Conference on Development and Application Systems (DAS 2010), 27-29 May 2010, Suceava, Romania.

[31] Vicente Atienza-Vanacloig, Juan Rosell Ortega, Gabriela Andreu-Garcia, Jose Miguel Valiente, Locating People in Images by Optimal Cue Integration, Proceedings of the 20th international Conference on Pattern Recognition of IEEE (August-2010)

[32] Juan Rosell Ortega, Gabriela Andreu-Garcia, Angel Rodas-Jordà, Vicente Atienza-Vanacloig, A combined self-configuring method for object tracking in colour video, , Proceedings of the 20th international Conference on Pattern Recognition of IEEE (August-2010)

[33] G.Q. Yin and D. Bruckner: “Split-Merge Algorithm and Gaussian Mixture Models for AAL”, to be presented at the IEEE ISIE, 2010.

[34] D. Bruckner C. Picus, R. Velik, W. Herzner, and J. Kasbi: “Hierarchical Semantic Processing Architecture for Smart Sensors in Surveillance Networks”, submitted to the Transactions on Industrial Electronics, 2010.

[35] Juan Rosell-Ortega, Gabriela Andreu-García, Gines Benet, Jose Simo, Jordi Sanchez, Evaluation of an embedded low-level video processing approach for object recognition and automatic surveillance, to be published at EURASIP Journal on Image and Video Processing.

[36] Jordi Sánchez, Ginés Benet, José Enrique Simó, A Constant-Time Region-Based Memory Allocator for Embedded Systems with Unpredictable Length Array Generation, to be presented at TT Real-Time and (Networked) Embedded Systems (ETFA 2010, Sep. 2010 Bilbao (Spain)).