Smart Room Design

Introduction:

Monitoring human physiology and emotions non-intrusively using contactless passive sensors would offer a new preventive, early-warning technique for ill health and emotional states, ensuring the well-being of the human subject and those around the subject.

Based on recent studies, continuous monitoring of human emotions is of a great importance [1-7], and a practical working prototype is highly desired in a variety of working and operational environments.

As it was recently proven, emotions drastically influence many aspects of human activity such as: perception, intention, communication, organization of memory, learning, attention, performance, goal generation, evaluation and decision making.

Most of the current research is based on contact operation of the sensors measuring the human physiology. This is one of the main drawbacks preventing their usage in many of the practical physiology monitoring and emotion recognition applications, such as the monitoring of learning comprehension and Homeland Security as well as other policing concerns.

Recognition approaches based on video alone could fail due to inherent limitation of discriminative information contained in facial expression and data captured by the video camera.  Another limitation or disadvantage of facial expression cues is that humans can fake them in order to mask true stressed physiological state.

Goal:

The goal of this research topic is to provide an application that is able to detect Typical  Vital Signs from Thermal Imaging.

Methods:

The solution proposed by our team is to make use of the informational physiology extracted from facial expressions captured in both visual and thermal IR bands as well vital signs extracted from visual and thermal information.  We propose to employ these two imaging modalities by designing a sensor suite for the extraction of facial and physiological parameters that can be used for smart surveillance systems in the practical security, learning, and medical applications mentioned above.

Illustration:

The Proposed Solution

Making use of the informational physiology extracted from facial expressions captured in both visual and thermal IR bands as well vital signs extracted from visual and thermal information.

Research Team:

Publications:

[1]        A. Amsel, Frustration Theory: An Analysis of Dispositional Learning and Memory, Cambridge University Press, New York, NY, USA, 1992.

[2]        G. Bower. Mood and Memory. American Psychologist, 36(2). 1981

[3]        R. Zajonc. On the Primacy of Affect. American Psychologist, 39: 117-124. 1984

[4]        J. Ledoux. Brain Mechanisms of Emotion and Emotional Learning. Current Opinion in  Neurobiology, 2: 191-197. 1992

[5]        D. Derryberry, and D. Tucker.  Neural Mechanisms of Emotion. Journal of Consulting and Clinical Psychology, 60(3): 329-337. 1992

[6]        R. Birdwhistle. Kinesics and Context: Essays on Body Motion and Communication. University of Pennsylvania Press. 1970

[7]        S. Makeig and M. Inlow, M., Lapses in alertness: coherence of fluctuations in performance and EEG      spectrum. Electroencephalog. clin. Neurophysiolog., 86: 23-35. 1993.

 


News