28-04-2011, 11:05 AM
Presented by
PRAJNA KARKAL
[attachment=12987]
ARTIFICIAL PASSENGER
INTRODUCTION
What is Artificial intelligence ?
Artificial intelligence is the science of making intelligent machines.
The branches of AI are:
Search
Pattern recognition
Natural language processing
Perception
BRIEF HISTORY
According to a national survey in UK and USA, it is observed that the driver fatigue annually causes
100000 crashes
15000 deaths
71000 injuries
In order to overcome the sleepiness the driver could have taken one of the following
Use of simulation drinks (e.g.: coffee and tea)
Some tablets to prevent sleeping.
Miniature system installed in driver’s hat.
ARTIFICIAL PASSENGER
Artificial passenger was developed by Dimitry Kanevsky and Wlodek Zadrozny.
EXISTING SYSTEM
What is an artificial passenger?
The AP is an artificial intelligence–based companion that will be resident in software and chips embedded in the automobile dashboard.
Sleep preventive device in cars to overcome drowsiness
What does it do?
A microphone picks up answer and breaks it down into separate words .
A camera tracks your lip movements to improve the accuracy of the speech recognition.
A voice analyzer then looks for signs of tiredness.
Slow responses and a lack of interaction are signs of fatigue.
artificial passenger opens all the windows, sound a buzzer, increase background music volume, or even spray the driver with ice water.
ARCHITECTURAL DESIGN
WORKING COMPONENTS
The components which support for the working of the system:
Automatic Speech Recognizer (ASR)
Natural Language Processor (NLP)
Driver analyzer
Conversational planner (CP)
Alarm
External service provider
Microphone
Camera
CAMERA
TECHNOLOGY DETAILS
VOICE CONTROL INTERFACE
voice is used instead of hands to control Telematics devices in the car.
e.g. when playing voice games, issuing commands via voice.
"What is the distance to JFK?" or "Or how far is JFK?" or "How long to drive to JFK?" etc.
The commands can be given in the natural language. Hence the difficulty in remembering the commands can be reduced by using NLU.
NLU components should be located on a server that is accessed by cars remotely or it can be embedded on chip.
When the system gets a voice response, it searches through files .
Executes the appropriate command.
Otherwise the system executes other options that are defined by a Dialog Manager (DM).
Example..
1. Ask questions (via a text to speech module) to
resolve ambiguities:
- (Driver) Please, plot a course to Yorktown
- (DM) Within Massachusetts?
- (Driver) No, in New York
2. Fill in missing information and remove
ambiguous references from context:
- (Driver) What is the weather forecast for today?
- (DM) Partly cloudy, 50% chance of rain
- (Driver) What about Ossining?
- (DM) Partly sunny, 10% chance of rain
3. Manage failure and provide contextual,
failure- dependent help and actions
- (Driver) When will we get there?
- (DM) Sorry, what did you say?
- (Driver) I asked when will we get there?
The instantaneous data collection could be dealt s by creating a learning transformation system (LT)
Examples
Monitor driver and passenger actions in the car’s internal and external environment across a network.
Extract and record the Driver Safety Manager relevant data in databases.
EMBEDDED SPEECH RECOGNITION
The front-end computes standard mel-frequency cepstral coefficients (MFCC).
The mel-filters are placed in the frequency range [200Hz – 5500 Hz].
The labeler then computes the log likelihood of each feature vector according to observation.
HMM-Hidden Markov Model.
The decoder implements a synchronous search over its active vocabulary.
Cont…
TOUCH SENSORS
WORKLOAD MANAGER
An object of the workload manager is to determine a moment-to-moment analysis of the user's cognitive workload.
Collects data about user conditions, monitoring local and remote events, and prioritizing message delivery.
Sensors provide information about local events e.g. heavy rain.
Provide information about driver characteristics
e.g. speaking speed, eyelid status.
PRIVACY AND SOCIAL ASPECTS
Privacy aspects:
The speech messages must be encrypted.
Social aspects:
Users must clearly understand
what the system is?,
what the system can and cannot do, and
what they need to do to maximize its performance to suit their unique needs.
ADVANTAGES
Artificial Passenger is broadly used to prevent accident.
Prevents the driver, falling asleep during long trip.
If the driver gets a heart attack or he is drunk it will send signals to vehicles nearby about this so drivers of the other vehicles become alert.
Opens and closes the doors and windows of the car automatically.
It is also used for the entertainment.
It provides a natural dialog car system that understands content of tapes, books and radio programs.
The system may also detect whether a driver is affected by alcohol or drugs.
DISADVANTAGES
Car computers are usually not very powerful due to cost considerations.
Natural Language Processor (NLP) is usually controlled by the remote server.
APPLICATIONS
Cabins in airplanes
Water craft such as boats
Trains
CONCLUSION
Successful implementation AP would allow use of various services in car (like readinge-mail, navigation, voice games etc) without compromising driver safety.
A primary objective of the invention is to provide a system and method for monitoring driver alertness with a single camera focused on the face of the driver to monitor for conditions of driver fatigue and lack of sleep.
PRAJNA KARKAL
[attachment=12987]
ARTIFICIAL PASSENGER
INTRODUCTION
What is Artificial intelligence ?
Artificial intelligence is the science of making intelligent machines.
The branches of AI are:
Search
Pattern recognition
Natural language processing
Perception
BRIEF HISTORY
According to a national survey in UK and USA, it is observed that the driver fatigue annually causes
100000 crashes
15000 deaths
71000 injuries
In order to overcome the sleepiness the driver could have taken one of the following
Use of simulation drinks (e.g.: coffee and tea)
Some tablets to prevent sleeping.
Miniature system installed in driver’s hat.
ARTIFICIAL PASSENGER
Artificial passenger was developed by Dimitry Kanevsky and Wlodek Zadrozny.
EXISTING SYSTEM
What is an artificial passenger?
The AP is an artificial intelligence–based companion that will be resident in software and chips embedded in the automobile dashboard.
Sleep preventive device in cars to overcome drowsiness
What does it do?
A microphone picks up answer and breaks it down into separate words .
A camera tracks your lip movements to improve the accuracy of the speech recognition.
A voice analyzer then looks for signs of tiredness.
Slow responses and a lack of interaction are signs of fatigue.
artificial passenger opens all the windows, sound a buzzer, increase background music volume, or even spray the driver with ice water.
ARCHITECTURAL DESIGN
WORKING COMPONENTS
The components which support for the working of the system:
Automatic Speech Recognizer (ASR)
Natural Language Processor (NLP)
Driver analyzer
Conversational planner (CP)
Alarm
External service provider
Microphone
Camera
CAMERA
TECHNOLOGY DETAILS
VOICE CONTROL INTERFACE
voice is used instead of hands to control Telematics devices in the car.
e.g. when playing voice games, issuing commands via voice.
"What is the distance to JFK?" or "Or how far is JFK?" or "How long to drive to JFK?" etc.
The commands can be given in the natural language. Hence the difficulty in remembering the commands can be reduced by using NLU.
NLU components should be located on a server that is accessed by cars remotely or it can be embedded on chip.
When the system gets a voice response, it searches through files .
Executes the appropriate command.
Otherwise the system executes other options that are defined by a Dialog Manager (DM).
Example..
1. Ask questions (via a text to speech module) to
resolve ambiguities:
- (Driver) Please, plot a course to Yorktown
- (DM) Within Massachusetts?
- (Driver) No, in New York
2. Fill in missing information and remove
ambiguous references from context:
- (Driver) What is the weather forecast for today?
- (DM) Partly cloudy, 50% chance of rain
- (Driver) What about Ossining?
- (DM) Partly sunny, 10% chance of rain
3. Manage failure and provide contextual,
failure- dependent help and actions
- (Driver) When will we get there?
- (DM) Sorry, what did you say?
- (Driver) I asked when will we get there?
The instantaneous data collection could be dealt s by creating a learning transformation system (LT)
Examples
Monitor driver and passenger actions in the car’s internal and external environment across a network.
Extract and record the Driver Safety Manager relevant data in databases.
EMBEDDED SPEECH RECOGNITION
The front-end computes standard mel-frequency cepstral coefficients (MFCC).
The mel-filters are placed in the frequency range [200Hz – 5500 Hz].
The labeler then computes the log likelihood of each feature vector according to observation.
HMM-Hidden Markov Model.
The decoder implements a synchronous search over its active vocabulary.
Cont…
TOUCH SENSORS
WORKLOAD MANAGER
An object of the workload manager is to determine a moment-to-moment analysis of the user's cognitive workload.
Collects data about user conditions, monitoring local and remote events, and prioritizing message delivery.
Sensors provide information about local events e.g. heavy rain.
Provide information about driver characteristics
e.g. speaking speed, eyelid status.
PRIVACY AND SOCIAL ASPECTS
Privacy aspects:
The speech messages must be encrypted.
Social aspects:
Users must clearly understand
what the system is?,
what the system can and cannot do, and
what they need to do to maximize its performance to suit their unique needs.
ADVANTAGES
Artificial Passenger is broadly used to prevent accident.
Prevents the driver, falling asleep during long trip.
If the driver gets a heart attack or he is drunk it will send signals to vehicles nearby about this so drivers of the other vehicles become alert.
Opens and closes the doors and windows of the car automatically.
It is also used for the entertainment.
It provides a natural dialog car system that understands content of tapes, books and radio programs.
The system may also detect whether a driver is affected by alcohol or drugs.
DISADVANTAGES
Car computers are usually not very powerful due to cost considerations.
Natural Language Processor (NLP) is usually controlled by the remote server.
APPLICATIONS
Cabins in airplanes
Water craft such as boats
Trains
CONCLUSION
Successful implementation AP would allow use of various services in car (like readinge-mail, navigation, voice games etc) without compromising driver safety.
A primary objective of the invention is to provide a system and method for monitoring driver alertness with a single camera focused on the face of the driver to monitor for conditions of driver fatigue and lack of sleep.
