Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Binary] Mistral model not configured properly #401

Closed
Janaka-Steph opened this issue Oct 25, 2023 · 3 comments · Fixed by premAI-io/prem-services#124
Closed

[Binary] Mistral model not configured properly #401

Janaka-Steph opened this issue Oct 25, 2023 · 3 comments · Fixed by premAI-io/prem-services#124
Assignees
@biswaroop1547
Labels
bug Something isn't working

Comments

@Janaka-Steph
Copy link
Contributor

Screenshot 2023-10-24 at 23 31 41
@filopedraz
Copy link
Contributor

It's about the prompt template you are using. @biswaroop1547 @nsosio @casperdcl should we have a prompt_template field in the manifest?

@casperdcl
Copy link
Contributor

I think @biswaroop1547 is going to hardcode a fixed template for OpenOrca.

in future maybe having a configurable prompt might be part of this manifest.json proposal

@casperdcl casperdcl added the bug Something isn't working label Oct 25, 2023
@biswaroop1547
Copy link
Contributor

added a solution for current chat services (only implemented and working for Mistral models) - premAI-io/prem-services#124
Requesting reviews 🙏🏻

@casperdcl casperdcl mentioned this issue Oct 25, 2023
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@biswaroop1547 biswaroop1547

Labels
bug Something isn't working
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

adds chatml prompt template as string to maintain configurability biswaroop1547/prem-services
4 participants
@Janaka-Steph @casperdcl @filopedraz @biswaroop1547