Skip to content

jineshrs2398/Vision-controlled-Bionic-Arm

Repository files navigation

Vision-Controlled Bionic Arm

Project Overview

This repository contains the code and resources for the Vision-Controlled Bionic Arm project, an innovative system that uses real-time hand gesture recognition to control a robotic arm. The project leverages Python for gesture recognition through MediaPipe and controls servo motors via Arduino to mimic these gestures physically.

Vision GIF

Features

  • Real-time hand gesture tracking using MediaPipe
  • Servo control through Arduino for precise arm movements
  • Integration of Exponential Moving Average (EMA) filter to refine servo movements

Getting Started

Prerequisites

  • Python 3.8+
  • Arduino IDE
  • MediaPipe
  • OpenCV for Python
  • Adafruit LSM9DS1 library
  • Adafruit Servo Driver library

Installation

  1. Clone the repository:
git clone https://github.com/yourusername/vision-controlled-bionic-arm.git
  1. Install the required Python libraries:
pip install opencv-python mediapipe numpy
  1. Set up the Arduino environment:
  • Install the Adafruit Servo Driver and LSM9DS1 libraries through the Arduino Library Manager.

Hardware Setup

  • Connect the LSM9DS1 sensor and servo drivers to your Arduino according to the circuit diagrams provided in the hardware directory.

Running the Project

  1. Launch the Python script to begin gesture tracking:
python app.py
  1. Upload the Arduino sketch to the microcontroller.
  2. Perform hand gestures in front of the camera to control the bionic arm.

License

This project is licensed under the MIT License - see the LICENSE.md file for details.

About

No description, website, or topics provided.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Contributors 4

  •  
  •  
  •  
  •