A Survey on Gesture Controlled Virtual Mouse and Voice Assistant in the field of AI and ML

Computer Engineering

The Gesture and Voice Controlled Virtual Mouse revolutionizes the way users interact with computers by seamlessly integrating voice commands and hand gestures, reducing the reliance on direct physical contact. Through the application of machine learning techniques, this system digitally manages input and output processes, enabling users to navigate and execute actions like left- and right-clicking using dynamic hand motions in lieu of a traditional physical mouse. This innovative implementation leverages machine learning for precise hand identification and integrates Python modules for effective voice assistance. By adopting this approach, the project not only simplifies fundamental mouse operations but also extends its capabilities to include tasks such as adjusting brightness, controlling volume, and managing applications, all while accommodating variations in ambient noise. Notably, the project boasts a voice assistant feature, providing an additional layer of convenience. Users can communicate with the virtual assistant through verbal or text instructions. In summary, the Gesture and Voice Controlled Virtual Mouse represents a sophisticated fusion of Computer Vision, Human Computer Interaction, Speech Recognition, and Hand Gesture Recognition.

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.