Code

Add MMLU-ru based on MERA#12

Code

Merged

Mogreine merged 4 commits intomaindeepvk/lm-evaluation-harness:mainfrom mmlu_ru_meradeepvk/lm-evaluation-harness:mmlu_ru_meraCopy head branch name to clipboardJun 26, 2024

+138-114

Commits

Commits on Jun 25, 2024

• Add MMLU-ru based on MERA

  SpirinEgor

  committed
  fec89c0

• Set acc_norm as metric for continuation task

  SpirinEgor

  committed
  bbbf0d7

• Continuation now similar to other mmlu datasets

  SpirinEgor

  committed
  9033253

Commits on Jun 26, 2024

• Update prompts for continuation tasks

  SpirinEgor

  committed
  ffca2a5