[attachment=13649]
WEARABLE GESTURAL INTERFACE DEVICE-SIXTH SENSE TECHNOLOGY
Abstract:
All of us are aware of the five basic senses – seeing, feeling, smelling, tasting and hearing. But there is also another sense called the sixth sense. It is basically a connection to something greater than what their physical senses are able to perceive. It would be something super natural. Some might just consider it to be a superstition or something psychological. But the invention of sixth sense technology has completely shocked the world. Although it is not widely known as of now but the time is not far when this technology will change our perception of the world.
History:
Steve Mann is the father of sixth sense who made a wearable computer in 1990. The Sixth Sense technology was first implemented as the neck worn projector+ camera system. He was a media lab student at that time. There after it was used and implemented by an Indian who is the man has become very famous in the recent pranav mistry. There will be a long future rather than the short period of history for the sixth sense technology.
Introduction: Sixth sense is a wearable gestural interface device that augments the physical world with digital information & lets people use natural hand gestures to interact with that information. it was developed by pranav mistry.
Components:
 A pocket projector,
 A mirror,
 A camera.
 Mobile component
 Colored marker
The hardware components are coupled in a pendant-like mobile wearable device.
Both the projector and the camera are connected to the mobile computing device in the user’s pocket.
The Projector: Projects visual information, enabling surfaces, walls and physical objects around the wearer to be used as interfaces. Mobile component sends information for displaying on surface.
The Camera And Hands: Recognizes and tracks the user's hand gestures and physical objects using computer-vision based techniques.
The Software Program: Processes the video stream data took by the camera and tracks the locations of the colored markers at the tip of the user’s fingers using simple computer-vision techniques. The maximum number of tracked fingers is only constrained by the number of unique fiducials, thus Sixth Sense also supports multi-touch and multi-user interaction.
Technology behind sixth sense:
Hardware Setup:
Projector: Here pocket projector Pocket projector Pk101 from Optoma is used to project the information on surfaces. It augments nearby surfaces around us. It is a LED based projector. It is a micro projector. This projector is more suitable for mobile usage.
Software setup: the device applications are implemented using JAVA 2 MICRO edition software. Computer vision library is written in symbian c++ used for gesture tracking of colored markers. The software for the sixth sense prototype is developed on a Microsoft Windows platform using C#, WPF and open CV. The software works on the basis of computer vision. A small camera acting as an eye, connecting us to the world of digital information. Processing is happening in the mobile phone, and basically works on computer vision algorithms. The software has approx 50,000 lines of code are used for performing operations.
KINDS OF GESTURES:.
Multi touch gestures: These gestures are like the ones we see in the iphone – where we touch the screen and make the map move by pinching and dragging.
Free hand gestures: These are like when you take a picture or a namaste gesture to start the projection on the wall.
Iconic gestures: Drawing an icon in the air. Like, Whenever we draw a star, show us the weather details. When we draw a magnifying glass, show us the map. This system is very customizable. We can make our own gesture which our sixth sense device can understand. We can change the Sixth Sense to our need. Events & Gestures are detected using colored markers attached to fingers. The user can zoom in or out by moving his hands/fingers farther or nearer to each other, respectively. The user can draw on any surfaces using the movement of the index finger used as a pen. System also supports freehand gestures (postures). one example is to touch both the index fingers with the opposing thumbs, forming a rectangle or framing gesture. This gesture activates the photo taking application.
HOW IT WORKS: It has a camera, a mirror and a projector and is connected wirelessly to a Bluetooth smart phone that can slip comfortably into one’s pocket. The camera recognizes individuals, images, pictures, gestures one makes with their hands. Information is sent to the Smartphone for processing. The downward-facing projector projects the output image on to the mirror. Mirror reflects image on to the desired surface. Thus, digital information is freed from its confines and placed in the physical world