A MULTIMODAL GAZE-CONTROLLED VIRTUAL KEYBOARD AND MOUSE CURSOR USING OPEN CV

Electronics and Communication Engineering

The aim of this paper is to present a system for controlling the cursor position in a computer by human eye movements. Many modules have been developed to help the physical world interact with the digital world. Here we present a novel approach for Human Computer Interaction (HCI) where, we control cursor movement using a real time camera. Some people cannot operate computers because of some illness. The idea of eye controls is of great use to not only for the future of natural input but more importantly to the handicapped and disabled. Moreover implementing a controlling system in it enables them to operate computer without the help of another person. This gadget is most useful for person who can operate cursor by movement of eye. In this project, Camera is used for capturing the image of eye movement. It first detect pupil centre position. Then the different variation on pupil position get different movement of cursor. The Implementation process for Pupil detection is done using Raspberry pi .The Raspberry Pi is a credit card sized single computer or SoC uses ARM1176JZF-S core. SoC, or System on a Chip, is a method of placing all necessary electronics for running a computer on a single chip. Raspberry Pi needs an Operating system to start up. In the aim of cost reduction, the Raspberry Pi omits any on-board non-volatile memory used to store the boot loaders, Linux Kernels and file systems as seen in more traditional embedded systems.

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.