This repository contains the code and resources for the Vision-Controlled Bionic Arm project, an innovative system that uses real-time hand gesture recognition to control a robotic arm. The project leverages Python for gesture recognition through MediaPipe and controls servo motors via Arduino to mimic these gestures physically.
- Real-time hand gesture tracking using MediaPipe
- Servo control through Arduino for precise arm movements
- Integration of Exponential Moving Average (EMA) filter to refine servo movements
- Python 3.8+
- Arduino IDE
- MediaPipe
- OpenCV for Python
- Adafruit LSM9DS1 library
- Adafruit Servo Driver library
- Clone the repository:
git clone https://github.com/yourusername/vision-controlled-bionic-arm.git
- Install the required Python libraries:
pip install opencv-python mediapipe numpy
- Set up the Arduino environment:
- Install the Adafruit Servo Driver and LSM9DS1 libraries through the Arduino Library Manager.
- Connect the LSM9DS1 sensor and servo drivers to your Arduino according to the circuit diagrams provided in the
hardware
directory.
- Launch the Python script to begin gesture tracking:
python app.py
- Upload the Arduino sketch to the microcontroller.
- Perform hand gestures in front of the camera to control the bionic arm.
This project is licensed under the MIT License - see the LICENSE.md file for details.