-
Notifications
You must be signed in to change notification settings - Fork 2k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
AraDICE task config file #2507
AraDICE task config file #2507
Conversation
@baberabb @lintangsutawika, Thanks |
@firojalam LGTM! One last thing: could you add an entry to |
@baberabb, thanks. |
For multiple-choice tasks the default prompt format is |
@baberabb , We did have a fix. Can you please check? Thanks |
Hi @baberabb , sorry that this is taking time. |
@baberabb , can you please advise whether we need to do anything? Looks like it is still failing. We do not find any issue on the local test. |
Sorry, the failing test is unreleated. Looks good to merge! Thanks for the PR. |
The AraDICE task and associated config files are based on the following paper.
https://arxiv.org/abs/2409.11404