Replies: 5 comments 4 replies
-
I was wondering the same! |
Beta Was this translation helpful? Give feedback.
-
any way to get embeddings would be cool |
Beta Was this translation helpful? Give feedback.
-
Can you clarify which specific information you are looking for? |
Beta Was this translation helpful? Give feedback.
-
It seems my misunderstanding, gen ai models are different from embeddings model. Phi3 is gen ai model. In demos I noticed Microsoft is using "smart components" local embedding model |
Beta Was this translation helpful? Give feedback.
-
Personally I would like to get the output vectors for a given token position. So I can examine all the probabilities and make my own choice of which token to pick or even display the probabilites. So I can design a custom function in order to have more control over which token it pick. I would like to get the probability vectors for then entire output. In the vision model, I would also like to be able to examine the input generated after feeding in the images and modify it if I so please. |
Beta Was this translation helpful? Give feedback.
-
How to generate embeddings using Microsoft.ML.OnnxRuntimeGenAI with phi-3 c#
Beta Was this translation helpful? Give feedback.
All reactions