A Nvidia and LlamaIndex project on multi-agent reasoning with knowledge graph, focusing on human nutrition.
- Local web ui
- Local llm instance
- Semantic cache
- Natural language QA with knowledge graph(3100 nodes, 2792 relations)
- Translation between natural language and Cypher statements
- Prebuilt Cypher statements in vectorstore
- Conditional branching in LlamaIndex workflow
Run following commands from project root directory.
-
Requires at least:
- 16 CPU cores
- 32GB RAM
- 1x Nvidia GPU with 24GB VRAM
-
Recommended:
- 24 CPU cores
- 64GB RAM
- 1x Nvidia GPU with 40GB VRAM
-
Supports Ubuntu LTS(2204/2404) host only.
-
Ensure Docker is installed on host machine.
-
Ensure Compose Plugin is installed on host machine.
-
Install python dependencies.
pip install -r requirements.txt
- Set API keys in '.env' file.
Initialize local instances.
docker compose \
--env-file=.env \
--profile redis-stack \
--profile pg16age \
--profile nim up -d
Takes around >5mins to build model workspace in nim container.
docker exec -it contest-pg16age \
psql -U postgres \
-d postgres \
-f /tmp/load_kg.sql \
-f /tmp/who_healthy_diet.sql \
-f /tmp/un_who_healthy_diets.sql \
-f /tmp/who_food_safety.sql \
-f /tmp/who_factsheets_part1of4.sql \
-f /tmp/who_factsheets_part2of4.sql \
-f /tmp/who_factsheets_part3of4.sql \
-f /tmp/who_factsheets_part4of4.sql \
-f /tmp/postprocess_kg.sql
Meanwhile wait for 'contest-pg16age' to initialize before importing graph data from CSV files by running mounted SQL script.
bash scripts/run_vllm
Wait for backend instances to be initialized before running next command.
Initialize UI.
streamlit run main.py
- Initial inference requires building of finite state machine(FSM) for structured output.
- Lacks data persistence on host filesystem.
- Knowledge graph data modeling is unoptimized
- Cypher queries are unoptimized
Information sourced from:
- Academy of Nutrition and Dietetics
- American Cancer Society - Nutrition and Physical Activity
- American Diabetes Association (ADA) - Nutrition and Recipes
- American Gastroenterological Association (AGA) - Nutrition and Healthy Living
- American Heart Association (AHA) - Nutrition Center
- American Journal of Clinical Nutrition
- Centers for Disease Control and Prevention (CDC) - Nutrition
- European Food Safety Authority (EFSA) - Nutrition
- Harvard School of Public Health - Nutrition Source
- Journal of the Academy of Nutrition and Dietetics
- National Academy of Sciences - Institute of Medicine (IOM) - Food and Nutrition Board
- National Institute of Diabetes and Digestive and Kidney Diseases (NIDDK) - Nutrition and Diet
- National Institute on Aging (NIA) - Nutrition and Aging
- National Institutes of Health (NIH) - Office of Dietary Supplements
- The Lancet - Nutrition, Health and Medicine
- United States Department of Agriculture (USDA) - ChooseMyPlate
- World Health Organization (WHO) - Nutrition