Deploy Llama Models Using LitServe in OpenAI-Compatible API Format with Comprehensive Tool Support.
This studio also includes a sample Streamlit app demonstrating the tool-calling feature with the Llama 3.1 8B Instruct model.
bhimrazy/tool-calling-with-meta-llama-3.1-8B-Instruct
Folders and files
| Name | Name | Last commit date | ||
|---|---|---|---|---|
Repository files navigation