AI Virtual Painting on Video Call

Computer Science Engineering

The use of videoconferencing technology has increased as an alternative communication method for people to retain social and clinical contact during Covid-19 restrictions. In order to keep in contact with each other, many have taken to using video meeting software and apps, a significant amount of people experiencing videoconferencing for the very first time, and some of the stories have been incredibly heartwarming. With a huge portion of the population now finally discovering the true potential and practicality of video technology, we thought it would be a fitting time to look a little further into what current platforms offer and what to consider in the future. Our project aims to improve the existing video meeting platforms by integrating Artificial Intelligence powered hand gesture recognition and motion capture to give a virtual painting ability for the users in Real-Time. The proposed system is a A Peer-to-Peer video conferencing platform as a progressive web application[1] that recognize hand gestures and also tracks the motion of the hands that lets you virtually draw on top of the video. The proposed project enables the users to use the system as a virtual JamBoard that can be directly used on top of the video feed itself without having to open any other external links. Our proposed project idea is a novelty among other video conferencing platforms. In this post pandemic world, our idea when implemented would make life easy for everyone who wants to create or participate in online meetings.

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.