Skip to content

UR5-Robotic-Intelligence/butler_brain

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

39 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

ButlerBrain

Combining Knowledge Base Reasoning Systems like Knowrob with Deeplearning for improving Robot Cognition, Learning and Human-Robot Interaction.

Demonstration Video

Dependencies

openai (GPT-3) -> pip install openai
fuzzywuzzy (string similarity) -> pip install fuzzywuzzy
pip install torch torchvision
pip install transformers
pip install -U sentence-transformers
gTTs (google text to speech) -> pip install gTTS
pyyaml -> pip install pyyaml
rospkg -> pip install rospkg
pyaudio -> sudo apt-get install portaudio19-dev && pip install pyaudio
pip install --upgrade google-cloud-speech
pip install SpeechRecognition
pip install google-cloud-texttospeech
pip install torchtext
rosprolog
knowrob
mpg321 -> sudo apt install mpg321

Google Cloud API

https://cloud.google.com/docs/authentication/provide-credentials-adc

get sevice account key json file and add its path to bashrc:

export GOOGLE_APPLICATION_CREDENTIALS="path/to/json"

Usage

Replace knowrob.owl in the knowrob package with the knowrob.owl found in this package's owl folder

sudo systemctl start mongodb.service
roslaunch rosprolog rosprolog.launch initial_package=knowrob

In a new terminal:

rosrun butler_brain butler_brain.py

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published