You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
[*] I checked the documentation and related resources and couldn't find an answer to my question.
Your Question
To evaluate the hallucination of a LLM, we would like to generate several out of context questions using Ragas. I checked the doc and wonder if I could use the persona concept as follows.
Code Examples
fromragas.testset.personaimportPersonapersona_external=Persona(
name="External",
role_description="Don't know much about the company and ask a lot of unrelated questions.",
)
The text was updated successfully, but these errors were encountered:
parkerzf
changed the title
How to generate out of context questions to evaluate if LLM is
How to generate out of context questions to evaluate the hallucination of a LLM
Dec 23, 2024
[*] I checked the documentation and related resources and couldn't find an answer to my question.
Your Question
To evaluate the hallucination of a LLM, we would like to generate several out of context questions using Ragas. I checked the doc and wonder if I could use the persona concept as follows.
Code Examples
The text was updated successfully, but these errors were encountered: