Ollama Tools AI is a work-in-progress project focused on implementing advanced AI functionalities, including function calling and tool usage. This project aims to provide a robust and flexible framework for AI-driven tasks and interactions.
- Function Calling: Seamlessly integrate and call various functions to perform tasks.
- Tool Usage: Utilize different tools for enhanced AI capabilities.
- Web Search: Use searXNG or Tavily for web searches
- Create: The AI will create folders and files, read files, list files, delete files, web search and more..
- DB Similarity: Every chat and tool use is saved in DB for future context aware AI responses.
# API Keys
TAVILY_API_KEY=tvly-
# Models
OLLAMA_MODEL=llama3-groq-tool-use
EMBED_MODEL=nomic-embed-text
# Search Configuration
SEARCH_PROVIDER=SEARXNG
SEARCH_RESULTS_LIMIT=5
# URLs
OLLAMA_URL=http://127.0.0.1:11434
SEARXNG_URL=http://192.168.70.48:4000
# Database Configuration
DB_DIR=./chromadb # database location realitive to current directory
N_CONTEXTS=3 # Number of contexts to retrieve from DB - you can adjust this for testing
SIMILARITY_THRESHOLD=0.7 # Adjust this value to control context relevance (lower is more strict)
# Debug print statements in terminal False or True
DEBUG_MODE=False
Install dependencies
pip install -r requirements.txt
python ol.py
Use multiple tools at once
<tool_call>
{"name": "search", "arguments": {"query": "latest ollama tools"}}
</tool_call>
<tool_call>
{"name": "create_file", "arguments": {"path": "./web_search.txt"}}
</tool_call>
<tool_call>
{"name": "write_to_file", "arguments": {"path": "./web_search.txt", "content": "[Insert Search
Data Here]"}}
</tool_call>INFO: Tool executed successfully.