Controlling Mouse Cursor Using Hand Gesture Recognition in MATLAB

Abstract

Abundant amount of input devices are used to interact with the computer world or more precisely saying to digital world and very less through gestures made by body movements. Concepts of assistive technology are one of them used for controlling the input from mouse movements, like by detecting the eye movements of a user with the help of eye tracking system, hand gestures, etc. In our work, we have tried to control mouse cursor movement and click events using a camera based on colour detection technique. Here real time video has been captured using a Web-Camera. The user wears coloured tapes to provide information to the system. Individual frames of the video are separately processed. The processing techniques involve an image subtraction algorithm to detect colours. Once the colours are detected the system performs various operations to track the cursor and performs control actions, the details of which are provided below. No additional hardware is required by the system other than the standard webcam which is provided in every laptop computer. The sections below will present the project in greater detail.