Gesture Recognition System FOR DUMBS



  GESTUREPPT.ppt (Size: 734 KB / Downloads: 0)

Introduction


Interaction with computers are not comfortable experience
Computers should communicate with people with body language.
Hand gesture recognition becomes important
Interactive human-machine interface and virtual environment


Two common technologies for hand gesture recognition
glove-based method
Using special glove-based device to extract hand posture
Annoying
vision-based method
3D hand/arm modeling
Appearance modeling


CSL and Pre-processing


Sign Language
Rely on the hearing society
Two main elements:
Low and simple level signed alphabet, mimics the letters of the native spoken language
Higher level signed language, using actions to mimic the meaning or description of the sign


Pre-processing of Hand Gesture Recognition


Detection of Hand Gesture Regions
Aim to fix on the valid frames and locate the hand region from the rest of the image.
Low time consuming fast processing rate real time speed


Locally Linear Embedding


Sparse data vs. High dimensional space
30 different gestures, 120 samples/gesture
36*36 pixels
3600 training samples vs. d = 1296
Difficult to describe the data distribution
Reduce the dimensionality of hand gesture images


Conclusion


Robust against similar postures in different light conditions and backgrounds
Fast detection process, allows the real time video application with low cost sensors, such as PC and USB camera