You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I get the same error when running evaluate with context_precision and context_recall : "Prompt fix_output_format failed to parse output" and "Prompt context_recall_classification_prompt failed to parse output". The response given by the LLM is quite unstable because with the same input data and script, this won't always occur: on rare occasions, the evaluation goes through the entire dataset without raising any error. Maybe increasing the number of retries could help solve the problem
[ ] I checked the documentation and related resources and couldn't find an answer to my question.
Your Question
what is unclear to you? What would you like to know?
When I perform Rag evaluation, I have the following issues:
May I ask how to solve this
Code Examples
This community speaks code. Share your code snippets to help us understand your question better.
Additional context
Anything else you want to share with us?
The text was updated successfully, but these errors were encountered: