Data-Chat

Chat over Custom Data

LangChain | LlamaIndex | PandasAI | HayStack

---

Tools to chat with our Data

• LLamaIndex

  • With OpenAI ✔️
  • With Groq ✔️
  • With Anthropic ✔️
  • With LangChain ✔️
  • With Mem0 ✔️
    • With OpenAI and Anthropic API
    • HF Embedding Model - https://huggingface.co/BAAI/bge-base-en-v1.5
    • Takes context from a .md file at ./datamd

• LangChain

  • Groq ✔️
  • OpenAI ✔️
  • Anthropic ✔️
  • qdrant - https://fossengineer.com/selfhosting-vector-admin-docker/
  • ChromaDB - https://fossengineer.com/selfhosting-chromadb-docker/
    • in-memory - in a python script or jupyter notebook
    • in-memory with persistance - in a script or notebook and save/load to disk
    • in a docker container - as a server running your local machine or in the cloud
  • ChatWithPDF Repo and Blog Post
  • ChatWithCSV Repo and Blog Post
  • ChatWithDB - Blog Post - ./LangChain/ChatWithDB
  • Chat with Pandas DF - Blog Post ./LangChain/ChatWithPandas

• PandasAI with

  • GroqAPI
  • OpenAI ✔️
  • SQLite DB

• EmbedChain/Mem0

• HayStack

Quick Venv Setup

python3 -m venv datachat_venv #create the venv Linux
#python -m venv datachat_venv #create the venv W

#datachat_venv\Scripts\activate #activate venv (windows)
source datachat_venv/bin/activate #(linux)

Set API credentials:

export GROQ_API_KEY=YOUR_API_KEY
$env:GROQ_API_KEY="YOUR_API_KEY"
set GROQ_API_KEY=YOUR_API_KEY

export OPENAI_API_KEY=YOUR_API_KEY
$env:OPENAI_API_KEY="YOUR_API_KEY"
set OPENAI_API_KEY=YOUR_API_KEY

export ANTHROPIC_API_KEY=YOUR_API_KEY
$env:ANTHROPIC_API_KEY="YOUR_API_KEY"
set ANTHROPIC_API_KEY=YOUR_API_KEY