23-03-2011, 10:27 AM
[attachment=10793]
ABSTRACT:
Imagine yourself in a world where humans interact with computers. You are sitting in front of your PC that can listen, talk or even scream aloud. It has the ability to gather information about you and interact with you through special techniques like facial recognition, speech recognition, etc. It can even understand your emotions at the touch of the mouse. It verifies your identity, feels your presence and starts interacting with you. You ask the computer to dial to your friend at his office. It realizes the urgency of the situation through the mouse, dials your friend at his office, and establishes a connection.
BLUE EYES is the name of a human recognition venture initiated by IBM to allow people to interact with computers in a more natural manner. The technology aims to enable devices to recognize and use natural input, such as facial expressions. The initial developments of this project include scroll mice and other input devices that sense the user's pulse, monitor his or her facial expressions, and the movement of his or her eyelids.
INTRODUCTION:
The BlueEyes technology aims at creating computational machines that have perceptual and sensory ability like those of human beings. It uses non-obtrusive sensing method, employing most modern video cameras in microphones to identify the user’s actions through the use of imparted sensory abilities.
BlueEyes uses sensing technology to identify a user's actions and to extract key information. This information is then analyzed to determine the user's physical, emotional, or informational state, which in turn can be used to help make the user more productive by performing expected actions or by providing expected information. For example, a BlueEyes-enabled television could become active when the user makes eye contact, at which point the user could then tell the television to "turn on".
WHY IT’S NAMED ‘BLUE EYES’ : Blue Eyes emphasizes – Bluetooth technology and the movements of the eyes. Bluetooth provides reliable wireless communication whereas the eye movements enable us to obtain a lot of interesting and important information.
KEY FEATURES OF THE SYSTEM:
1. Visual attention monitoring (eye motility analysis).
2. Physiological condition monitoring (pulse rate, blood oxygenation).
3. Operator’s position detection (standing, lying).
4. Wireless data acquisition using Bluetooth technology.
5. Real-time user-defined alarm triggering.
6. Physiological data, operator’s voice and overall view of the control room recording recorder data playback.
WORKING:
The major parts in the Blue eye system are Data Acquisition Unit and Central System Unit. The tasks of the mobile Data Acquisition Unit are to maintain Bluetooth connections, to get information from the sensor and sending it over the wireless connection, to deliver the alarm messages sent from the Central System Unit to the operator and handle personalized ID cards. Central System Unit maintains the other side of Bluetooth connection, buffers incoming sensor data, performs on-line data analysis, records the conclusions for further exploration and provides visualization interface.
EMOTION MOUSE:
One goal of human computer interaction (HCI) is to make an adaptive, smart computer system. This type of project could possibly include gesture recognition, facial recognition, eye tracking, speech recognition, etc. Another non-invasive way to obtain information about a person is through touch. People use their computers to obtain, store and manipulate data using their computer. In order to start creating smart computers, the computer must start gaining information about the user. Our proposed method for gaining user information through touch is via a computer input device, the mouse. From the physiological data obtained from the user, an emotional state may be determined which would then be related to the task the user is currently doing on the computer. 1. What is emotional mouse?
The mouse developed in order to evaluate the users¡¯ emotion such as anger, fear, sadness, disgust, happiness, surprise, etc when we use a computer.
OBJECT:
• Measure the physical and physiological data without user¡¯s perception or obstruction as much as possible
• Data acquisition system to get the analog data from several sensors.
WHAT KINDS OF INFORMATION CAN WE GET FROM EMOTIONAL MOUSE?
1. Behavior
o Mouse movements
o Button click frequency
o Finger pressure when a user presses his/her button
2. Physiological information
o Heart rate ( Electrocardiogram(ECG/EKG), Photoplethysmogram(PPG) )
o Skin temperature (Thermester)
o Skin electricity (Galvanic skin response, GSR)
o Electromyographic activity (Electromyogram, MG)
MANUAL AND GAZE INPUT CASCADED POINTING:
This work explores a new direction in utilizing eye gaze for computer input. Gaze tracking has long been considered as an alternative or potentially superior pointing method for computer input. We believe that many fundamental limitations exist with traditional gaze pointing. In particular, it is unnatural to overload a perceptual channel such as vision with a motor control task. We therefore propose an alternative approach, dubbed MAGIC (Manual And Gaze Input Cascaded) pointing. With such an approach, pointing appears to the user to be a manual task, used for fine manipulation and selection. However, a large portion of the cursor movement is eliminated by warping the cursor to the eye gaze area, which encompasses the target.
ARTIFICIAL INTELLIGENT SPEECH RECOGNITION: It is important to consider the environment in which the speech recognition system has to work. The grammar used by the speaker and accepted by the system, noise level, noise type, position of the microphone, and speed and manner of the user’s speech are some factors that may affect the quality of speech recognition .When you dial the telephone number of a big company, you are likely to hear the sonorous voice of a cultured lady who responds to your call with great courtesy saying “Welcome to company X. Please give me the extension number you want”. You pronounce the extension number, your name, and the name of person you want to contact. If the called person accepts the call, the connection is given quickly. This is artificial intelligence where an automatic call-handling system is used without employing any telephone operator.
One of the main benefits of speech recognition system is that it lets user do other works simultaneously. The user can concentrate on observation and manual operations, and still control the machinery by voice input commands. Another major application of speech processing is in military operations. Voice control of weapons is an example. With reliable speech recognition equipment, pilots can give commands and information to the computers by simply speaking into their microphones—they don’t have to use their hands for this purpose. Another good example is a radiologist scanning hundreds of X-rays, ultrasonograms, CT scans and simultaneously dictating conclusions to a speech recognition system connected to word processors. The radiologist can focus his attention on the images rather than writing the text. Voice recognition could also be used on computers for making airline and hotel reservations. A user requires simply to state his needs, to make reservation, cancel a reservation, or make enquiries about schedule.
THE SIMPLE USER INTERFACE TRACKER:
Computers would have been much more powerful, had they gained perceptual and sensory abilities of the living beings on the earth. What needs to be developed is an intimate relationship between the computer and the humans. And the Simple User Interest Tracker (SUITOR) is a revolutionary approach in this direction.
By observing the Webpage a netizen is browsing, the SUITOR can help by fetching more information at his desktop. By simply noticing where the user’s eyes focus
ABSTRACT:
Imagine yourself in a world where humans interact with computers. You are sitting in front of your PC that can listen, talk or even scream aloud. It has the ability to gather information about you and interact with you through special techniques like facial recognition, speech recognition, etc. It can even understand your emotions at the touch of the mouse. It verifies your identity, feels your presence and starts interacting with you. You ask the computer to dial to your friend at his office. It realizes the urgency of the situation through the mouse, dials your friend at his office, and establishes a connection.
BLUE EYES is the name of a human recognition venture initiated by IBM to allow people to interact with computers in a more natural manner. The technology aims to enable devices to recognize and use natural input, such as facial expressions. The initial developments of this project include scroll mice and other input devices that sense the user's pulse, monitor his or her facial expressions, and the movement of his or her eyelids.
INTRODUCTION:
The BlueEyes technology aims at creating computational machines that have perceptual and sensory ability like those of human beings. It uses non-obtrusive sensing method, employing most modern video cameras in microphones to identify the user’s actions through the use of imparted sensory abilities.
BlueEyes uses sensing technology to identify a user's actions and to extract key information. This information is then analyzed to determine the user's physical, emotional, or informational state, which in turn can be used to help make the user more productive by performing expected actions or by providing expected information. For example, a BlueEyes-enabled television could become active when the user makes eye contact, at which point the user could then tell the television to "turn on".
WHY IT’S NAMED ‘BLUE EYES’ : Blue Eyes emphasizes – Bluetooth technology and the movements of the eyes. Bluetooth provides reliable wireless communication whereas the eye movements enable us to obtain a lot of interesting and important information.
KEY FEATURES OF THE SYSTEM:
1. Visual attention monitoring (eye motility analysis).
2. Physiological condition monitoring (pulse rate, blood oxygenation).
3. Operator’s position detection (standing, lying).
4. Wireless data acquisition using Bluetooth technology.
5. Real-time user-defined alarm triggering.
6. Physiological data, operator’s voice and overall view of the control room recording recorder data playback.
WORKING:
The major parts in the Blue eye system are Data Acquisition Unit and Central System Unit. The tasks of the mobile Data Acquisition Unit are to maintain Bluetooth connections, to get information from the sensor and sending it over the wireless connection, to deliver the alarm messages sent from the Central System Unit to the operator and handle personalized ID cards. Central System Unit maintains the other side of Bluetooth connection, buffers incoming sensor data, performs on-line data analysis, records the conclusions for further exploration and provides visualization interface.
EMOTION MOUSE:
One goal of human computer interaction (HCI) is to make an adaptive, smart computer system. This type of project could possibly include gesture recognition, facial recognition, eye tracking, speech recognition, etc. Another non-invasive way to obtain information about a person is through touch. People use their computers to obtain, store and manipulate data using their computer. In order to start creating smart computers, the computer must start gaining information about the user. Our proposed method for gaining user information through touch is via a computer input device, the mouse. From the physiological data obtained from the user, an emotional state may be determined which would then be related to the task the user is currently doing on the computer. 1. What is emotional mouse?
The mouse developed in order to evaluate the users¡¯ emotion such as anger, fear, sadness, disgust, happiness, surprise, etc when we use a computer.
OBJECT:
• Measure the physical and physiological data without user¡¯s perception or obstruction as much as possible
• Data acquisition system to get the analog data from several sensors.
WHAT KINDS OF INFORMATION CAN WE GET FROM EMOTIONAL MOUSE?
1. Behavior
o Mouse movements
o Button click frequency
o Finger pressure when a user presses his/her button
2. Physiological information
o Heart rate ( Electrocardiogram(ECG/EKG), Photoplethysmogram(PPG) )
o Skin temperature (Thermester)
o Skin electricity (Galvanic skin response, GSR)
o Electromyographic activity (Electromyogram, MG)
MANUAL AND GAZE INPUT CASCADED POINTING:
This work explores a new direction in utilizing eye gaze for computer input. Gaze tracking has long been considered as an alternative or potentially superior pointing method for computer input. We believe that many fundamental limitations exist with traditional gaze pointing. In particular, it is unnatural to overload a perceptual channel such as vision with a motor control task. We therefore propose an alternative approach, dubbed MAGIC (Manual And Gaze Input Cascaded) pointing. With such an approach, pointing appears to the user to be a manual task, used for fine manipulation and selection. However, a large portion of the cursor movement is eliminated by warping the cursor to the eye gaze area, which encompasses the target.
ARTIFICIAL INTELLIGENT SPEECH RECOGNITION: It is important to consider the environment in which the speech recognition system has to work. The grammar used by the speaker and accepted by the system, noise level, noise type, position of the microphone, and speed and manner of the user’s speech are some factors that may affect the quality of speech recognition .When you dial the telephone number of a big company, you are likely to hear the sonorous voice of a cultured lady who responds to your call with great courtesy saying “Welcome to company X. Please give me the extension number you want”. You pronounce the extension number, your name, and the name of person you want to contact. If the called person accepts the call, the connection is given quickly. This is artificial intelligence where an automatic call-handling system is used without employing any telephone operator.
One of the main benefits of speech recognition system is that it lets user do other works simultaneously. The user can concentrate on observation and manual operations, and still control the machinery by voice input commands. Another major application of speech processing is in military operations. Voice control of weapons is an example. With reliable speech recognition equipment, pilots can give commands and information to the computers by simply speaking into their microphones—they don’t have to use their hands for this purpose. Another good example is a radiologist scanning hundreds of X-rays, ultrasonograms, CT scans and simultaneously dictating conclusions to a speech recognition system connected to word processors. The radiologist can focus his attention on the images rather than writing the text. Voice recognition could also be used on computers for making airline and hotel reservations. A user requires simply to state his needs, to make reservation, cancel a reservation, or make enquiries about schedule.
THE SIMPLE USER INTERFACE TRACKER:
Computers would have been much more powerful, had they gained perceptual and sensory abilities of the living beings on the earth. What needs to be developed is an intimate relationship between the computer and the humans. And the Simple User Interest Tracker (SUITOR) is a revolutionary approach in this direction.
By observing the Webpage a netizen is browsing, the SUITOR can help by fetching more information at his desktop. By simply noticing where the user’s eyes focus
