Nov 2023-Dec 2024
Color changing RGB light bulbs are a popular way to customize one’s living space. Chromabulb is a script which uses Google’s MediaPipe library to recognize hand gestures to automatically control the color and brightness of a RGB LED bulb.
This project aims to allow the user to control a color changing light bulb using only hand gestures in a quick, intuitive way.
The Chromabulb control scheme uses two gestures: pinching and twisting. Pinching controls the brightness of the light while twisting changes the color.
MediaPipe is able to track hand landmarks and their coordinates in real time.
For this project we focused on the landmarks at the tips of the middle finger, index finger, and thumb.
We circumscribe a circle about the these three points and use the radius of this circle to measure pinching. We calculate the angle of the line formed between the middle finger and thumb to measure twisting.
In order to communicate when to start and stop the tracking, we used the landmarks of the pinky and ring fingers. If the pinky and ring finger tips are closed to the wrist, then the algorithm begins tracking and updating the light bulb. However if the pinky and ring fingers are open then the tracking stops.
This means you can adjust the light when your hand is in its natural pinching position but when your hand opens, the tracking stops automatically.
