Skip to content

Mixtral 8x7B support? #85

Answered by erfanzar
clintg6 asked this question in Q&A
Discussion options

You must be logged in to vote

Hello due to not being able to evaluate the model params mixtral model can not be traced and that's a jax issue but if you load the model from torch or easy state you can ignore that cause model is loaded and you can use that.

Replies: 1 comment

Comment options

You must be logged in to vote
0 replies
Answer selected by clintg6
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Category
Q&A
Labels
None yet
2 participants
Converted from issue

This discussion was converted from issue #81 on January 19, 2024 12:57.