UltiVision is a revolutionary leap forward in visual navigation for the visually impaired, making the world accessible for all. Powered by advanced Machine Learning algorithms, it uses computer vision to detect everyday objects like people, doors, vehicles, and animals.
By converting this visual information, such as distance and position information, into carefully tailored sounds, UltiVision enables users to quickly and efficiently visualise their surroundings. UltiVision bridges the gap between visual and auditory perception, and represents progress towards a more inclusive society.
- Install HomeBrew :
/bin/bash -c "$(curl -fsSL https://raw.githubusercontent.com/Homebrew/install/HEAD/install.sh)"
- Install protobuf with
brew install protobuf
- Install portaudio with
brew install portaudio
- Python Version :
3.10.9
- macOS Version
> 12.6.0
(Tested on macOS but may work on other platforms too) - Use a x64 computer!
⚠️ You need to use a virtual environment to run this project.
-
Create a virtual environment called
coursework-venv
:python3 -m venv coursework-venv
-
Activate the environment using:
source coursework-venv/bin/activate
-
Install dependencies using
pip3 install -q -r requirements.txt
-
Run the app using:
python3 main.py
- If you get an error saying
portaudio.h
not found, try runningbrew install portaudio
and then run the app again. - If you get an error saying
libportaudio.2.dylib
not found or something simliar, try runningbrew install portaudio
and then run the app again.
The model training code can be found in the model_training
folder.
UltiVision was created by Tan Yu Zhe Richard (leader), Tan Xuan Han and Daksh Thapar and used for the 2022-2023 SST Computing+ Coursework.