Touchless Display Control

Gesture Brightness Control

Control brightness with a simple pinch gesture using MediaPipe hand tracking and a local system brightness bridge.

Launch Application

Welcome to the Gesture Brightness Control web application!

This project uses OpenCV and MediaPipe machine learning models to track your hand gestures in real-time through your webcam.

✨ Key Features

🛠️ How it works

By pinching your index finger and thumb, the application calculates the distance between them. This distance is smoothly mapped to your computer's screen brightness percentage using the screen_brightness_control Python library.

⚠️ Important Note

Please ensure you grant your browser permission to access your webcam. The application requires an active camera feed to detect your hand gestures.

🏗️ Deployment Architecture

This application uses a split architecture for maximum flexibility:

Component Runs On Purpose
Web UI Netlify (Cloud) Camera feed + hand gesture detection
Local Agent Your Desktop/Laptop Receives brightness values + controls OS brightness

📱 For Desktop Users (System Brightness Control)

To control your actual system brightness, you must also run the local brightness agent on your computer:

  1. Download or clone this project to your local machine.
  2. Install Python dependencies: pip install -r requirements.txt
  3. Start the local brightness agent: python local_agent.py
  4. The agent will run on https://screen-brightness-control.netlify.app/app or http://127.0.0.1:5055 and accept brightness commands from this web app.
  5. Open this site in your browser and grant camera permission. Your gestures will now control your system brightness!

📱 For Mobile Users

Mobile browsers cannot directly control system brightness due to browser security restrictions. Your gesture controls will adjust the page brightness visually for demonstration purposes.

💡 Why This Architecture?

📌 Quick Setup for First-Time Users: If running locally on http://127.0.0.1:5000, just run the app without needing the cloud—everything works on your machine!

Click the button below to launch the camera interface and start controlling your brightness hands-free!

Launch Application