数据集 | LLAMA 7B | finetune 7B |
---|---|---|
BUSTM | 59.53 | 52.2 |
AFQMC | 61.54 | 62.97 |
OCNLI | 31.5 | 45.5 |
OCNLI_FC | 33.29 | 48.96 |
CMNLI | 34.72 | 42.71 |
CSL | 60.11 | 63.00 |
CLUEWSC | 53.27 | 56.65 |
CHID | 25.87 | 71.47 |
TNEWS | 8.70 | 26.78 |
EPRSTMT | 70.49 | 59.18 |
C3 | 41.31 | 48.16 |
CMRC | 11.89 | 34.48 |
DRCD | 2.86 | 38.39 |
LCSTS | 4.08 | 7.20 |
acerage | 35.65 | 46.97 |
数据集 | LLAMA 7B | finetune 7B |
---|---|---|
TriviaQA | 50.0 | 34.13 |
NQ | 16.8 | 9.94 |
Flores EN-DE | 5.15 | 8.25 |
Flores DE-EN | 9.40 | 12.2 |
Flores EN-ZH | 5.27 | 23.71 |
Flores ZH-EN | 6.69 | 13.85 |
PIQA | 79.8 | 77.31 |
GSM8K | 11.0 | 10.91 |
CommensenseQA | 67.40 | 66.91 |
average | 27.94 | 28.57 |
数据集 | LLAMA 7B | finetune 7B |
---|---|---|
HumanEval | 10.5 | 14.63 |
MBPP | 17.7 | 17.2 |
average | 14.1 | 15.92 |
数据集 | LLAMA 7B | finetune 7B |
---|---|---|
college biology | 37.5 | 22.22 |
college chemistry | 32.0 | 24.24 |
college computer science | 29.0 | 27.27 |
college mathematics | 33.0 | 25.74 |
college physics | 26.5 | 33.33 |
electrical engineering | 26.9 | 27.15 |
astronomy | 33.6 | 41.04 |
anatomy | 37.0 | 28.28 |
abstract algebra | 29.0 | 36.03 |
machine learning | 23.2 | 32.95 |
clinical knowledge | 35.1 | 41.41 |
global facts | 29.0 | 47.05 |
management | 35.0 | 42.29 |
nutrition | 37.6 | 44.63 |
marketing | 46.6 | 29.18 |
professional accounting | 25.9 | 35.02 |
high school geography | 34.3 | 48.33 |
international law | 51.2 | 23.82 |
moral scenarios | 24.3 | 37.37 |
computer security | 45.0 | 27.84 |
high school microeconomics | 31.9 | 27.72 |
professional law | 30.2 | 42.42 |
medical genetics | 43.0 | 33.38 |
professional psychology | 35.1 | 41.12 |
jurisprudence | 38.9 | 53.52 |
world religions | 50.9 | 31.61 |
philosophy | 39.9 | 36.96 |
virology | 30.1 | 23.76 |
high school chemistry | 28.1 | 33.02 |
public relations | 40.9 | 31.87 |
high school macroeconomics | 35.4 | 34.61 |
human sexuality | 36.6 | 24.13 |
elementary mathematics | 24.3 | 20.66 |
high school physics | 26.5 | 34.34 |
high school computer science | 31.0 | 32.31 |
high school european history | 44.2 | 44.44 |
business ethics | 40.0 | 35.65 |
moral disputes | 40.2 | 21.86 |
high school statistics | 35.2 | 48.84 |
miscellaneous | 42.4 | 25.6 |
formal logic | 27.0 | 38.02 |
high school government and politics | 44.6 | 40.24 |
prehistory | 36.1 | 31.14 |
security studies | 31.8 | 33.65 |
high school biology | 34.5 | 41.97 |
logical fallacies | 39.3 | 34.74 |
high school world history | 40.9 | 22.87 |
professional medicine | 44.5 | 24.16 |
high school mathematics | 24.8 | 30.23 |
college medicine | 30.6 | 36.94 |
high school us history | 39.7 | 54 |
sociology | 46.8 | 28.31 |
econometrics | 23.7 | 43.93 |
high school psychology | 47.3 | 45.49 |
human aging | 40.8 | 54.54 |
us foreign policy | 46.0 | 38.88 |
conceptual physics | 36.6 | 22.22 |
average | 35.64 | 34.92 |
总平均值:
- LLAMA 7B: 34.777
- finetune7B: 36.115