SignWaver - HackTCNJ 2024

In February 2024, together with a friend, I joined a Hackathon hosted by TCNJ. Together, we worked on an accessibility-focused application to leverage hand-gestures and voice commands to perform various actions on a computer. Fully developed in Python, we utilized various Google APIs and libraries to make our program work. In order to track hand gestures, we trained a model using Google’s Mediapipe to recognize specific gestures through the computer’s webcam. In addition, voice commands were implemented through Google’s Transcription API after performing sentiment analysis through its NLP API. We also incorporated its latest version of Gemini for image recognition for adaptive user-assistance.

Our project was awarded first in the category: Best Implementation of Google Cloud Services and you can view our DevPost below.

Software used