| 数据集 | LLAMA 7B | finetune 7B |
|---|---|---|
| BUSTM | 59.53 | 52.2 |
| AFQMC | 61.54 | 62.97 |
| OCNLI | 31.5 | 45.5 |
| OCNLI_FC | 33.29 | 48.96 |
| CMNLI | 34.72 | 42.71 |
| CSL | 60.11 | 63.00 |
| CLUEWSC | 53.27 | 56.65 |
| CHID | 25.87 | 71.47 |
| TNEWS | 8.70 | 26.78 |
| EPRSTMT | 70.49 | 59.18 |
| C3 | 41.31 | 48.16 |
| CMRC | 11.89 | 34.48 |
| DRCD | 2.86 | 38.39 |
| LCSTS | 4.08 | 7.20 |
| acerage | 35.65 | 46.97 |
| 数据集 | LLAMA 7B | finetune 7B |
|---|---|---|
| TriviaQA | 50.0 | 34.13 |
| NQ | 16.8 | 9.94 |
| Flores EN-DE | 5.15 | 8.25 |
| Flores DE-EN | 9.40 | 12.2 |
| Flores EN-ZH | 5.27 | 23.71 |
| Flores ZH-EN | 6.69 | 13.85 |
| PIQA | 79.8 | 77.31 |
| GSM8K | 11.0 | 10.91 |
| CommensenseQA | 67.40 | 66.91 |
| average | 27.94 | 28.57 |
| 数据集 | LLAMA 7B | finetune 7B |
|---|---|---|
| HumanEval | 10.5 | 14.63 |
| MBPP | 17.7 | 17.2 |
| average | 14.1 | 15.92 |
| 数据集 | LLAMA 7B | finetune 7B |
|---|---|---|
| college biology | 37.5 | 22.22 |
| college chemistry | 32.0 | 24.24 |
| college computer science | 29.0 | 27.27 |
| college mathematics | 33.0 | 25.74 |
| college physics | 26.5 | 33.33 |
| electrical engineering | 26.9 | 27.15 |
| astronomy | 33.6 | 41.04 |
| anatomy | 37.0 | 28.28 |
| abstract algebra | 29.0 | 36.03 |
| machine learning | 23.2 | 32.95 |
| clinical knowledge | 35.1 | 41.41 |
| global facts | 29.0 | 47.05 |
| management | 35.0 | 42.29 |
| nutrition | 37.6 | 44.63 |
| marketing | 46.6 | 29.18 |
| professional accounting | 25.9 | 35.02 |
| high school geography | 34.3 | 48.33 |
| international law | 51.2 | 23.82 |
| moral scenarios | 24.3 | 37.37 |
| computer security | 45.0 | 27.84 |
| high school microeconomics | 31.9 | 27.72 |
| professional law | 30.2 | 42.42 |
| medical genetics | 43.0 | 33.38 |
| professional psychology | 35.1 | 41.12 |
| jurisprudence | 38.9 | 53.52 |
| world religions | 50.9 | 31.61 |
| philosophy | 39.9 | 36.96 |
| virology | 30.1 | 23.76 |
| high school chemistry | 28.1 | 33.02 |
| public relations | 40.9 | 31.87 |
| high school macroeconomics | 35.4 | 34.61 |
| human sexuality | 36.6 | 24.13 |
| elementary mathematics | 24.3 | 20.66 |
| high school physics | 26.5 | 34.34 |
| high school computer science | 31.0 | 32.31 |
| high school european history | 44.2 | 44.44 |
| business ethics | 40.0 | 35.65 |
| moral disputes | 40.2 | 21.86 |
| high school statistics | 35.2 | 48.84 |
| miscellaneous | 42.4 | 25.6 |
| formal logic | 27.0 | 38.02 |
| high school government and politics | 44.6 | 40.24 |
| prehistory | 36.1 | 31.14 |
| security studies | 31.8 | 33.65 |
| high school biology | 34.5 | 41.97 |
| logical fallacies | 39.3 | 34.74 |
| high school world history | 40.9 | 22.87 |
| professional medicine | 44.5 | 24.16 |
| high school mathematics | 24.8 | 30.23 |
| college medicine | 30.6 | 36.94 |
| high school us history | 39.7 | 54 |
| sociology | 46.8 | 28.31 |
| econometrics | 23.7 | 43.93 |
| high school psychology | 47.3 | 45.49 |
| human aging | 40.8 | 54.54 |
| us foreign policy | 46.0 | 38.88 |
| conceptual physics | 36.6 | 22.22 |
| average | 35.64 | 34.92 |
总平均值：
- LLAMA 7B: 34.777
- finetune7B: 36.115