Hi... i would like to get details on matlab code of virtual mouse through hand gesture . I'm studing in the Mandalay Technological University in Myanmar.
Now i am doing project. So i need help on [b]matlab code of virtual mouse through hand gesture[/b].
Posts: 14,118
Threads: 61
Joined: Oct 2014
In today's technological age, many technologies are evolving day by day. One of these promising concepts is the human-machine interface. For example, in a wired mouse there is no provision for extending the limit. In the wireless mouse, one must have installed the Bluetooth hardware in the computer and Bluetooth dongle attached. The proposed technology will not have such limitations and instead will depend on the recognition of the gestures. Three technologies are used in this project: object detection, image processing and color recognition using Sixth Sense technology. Sixth sense technology is a set of usable devices that acts as a gestural interface between the physical and digital worlds. The goal is to move the mouse cursor on the screen without using hardware like a mouse and only moving the cursor through the movements of the fingers, that is, the gesture recognition process.
The movement of a user's hand is assigned to the mouse inputs. A webcam is configured to take the live video continuously and then from this video are being captured several images using MATLAB. The user must have a color marker or a pointer in his or her hand so that when the webcam takes an image it should be visible on it. This color is detected from the image pixel in MATLAB and the object detection is used to assign the position of the pixels to the mouse input. Taking into account image size and resolution, scaling techniques should be used as image processing or segmentation. Sixth sense technology can be further developed to include multimedia services such as videos or save pictures using hand gestures.
The user uses colored gloves, whose information is processed by the system. Individual video frames are processed separately. Processing techniques involve an image subtraction algorithm in MATLAB to detect colors. Once the colors are detected, the system performs several operations to trace the cursor and performs control actions that are explained in other sections. The system does not require additional hardware other than the standard webcam provided on each laptop or computer.
In digital information time, everyday life is inseparable from the human-computer interface (HCI). Human interaction in the computer has a long history to be more intuitive. For human, hand gesture of different kind is one of the most intuitive and most common communication. However, vision based on the recognition of hand gestures remains a difficult problem. In this article, we propose a virtual mouse system incorporated through the recognition of hand gestures. There are several techniques involved in the proposed system. Skin detection and motion detection method are used to capture the region of interest and distinguish the foreground / background area. The tagging algorithm for connected components is used to identify the centroid of an object. Removal on the arm and the convex hull algorithm are used to recognize the area of the hand as well as the related gesture. The result shows that our system can work well, even in a difficult environment.
It can be understood in the following video:
