-
Notifications
You must be signed in to change notification settings - Fork 0
/
rep-multi_aso-2023-05-12-17h24m14s.txt
48 lines (46 loc) · 14.2 KB
/
rep-multi_aso-2023-05-12-17h24m14s.txt
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
======= 7-roles dataset =======
Bonferroni correction: True
confidence_level: 0.95
SingleSC InCaseLaw SingleSC RoBERTa Cohan InCaseLaw Cohan RoBERTa Cohan Longformer Mixup InCaseLaw Mixup RoBERTa Mixup 2 InCaseLaw Mixup2 RoBERTa PE-S InCaseLaw PE-S RoBERTa PE-C InCaseLaw PE-C RoBERTa DFCSC-CLS InCaseLaw DFCSC-CLS RoBERTa DFCSC-CLS Longformer DFCSC-SEP InCaseLaw DFCSC-SEP RoBERTa DFCSC-SEP Longformer
SingleSC InCaseLaw 1.000000 0.000000 0.998092 0.996629 0.996831 0.595728 0.000000 0.860998 0.000000 0.406224 0.000000 1.000000 0.022117 0.996715 0.995934 0.995640 0.995218 0.995590 0.994718
SingleSC RoBERTa 1.000000 1.000000 0.997262 0.996448 0.996788 0.998009 0.484467 0.998909 0.936422 0.996326 0.033046 0.997493 0.770914 0.996550 0.996101 0.995821 0.995602 0.995805 0.995025
Cohan InCaseLaw 0.008868 0.005319 1.000000 0.842190 0.999604 0.000000 0.000000 0.000000 0.000000 0.000000 0.000000 0.000545 0.000000 1.000000 0.996660 0.996014 0.997144 0.996090 0.994756
Cohan RoBERTa 0.010469 0.005884 1.000000 1.000000 0.999800 0.000000 0.000000 0.000000 0.000000 0.000000 0.000000 0.000000 0.000000 1.000000 0.996965 0.996277 0.997216 0.996387 0.994982
Cohan Longformer 0.007241 0.005450 0.009112 0.006878 1.000000 0.000000 0.000000 0.000000 0.000000 0.000000 0.000000 0.000000 0.000000 0.198216 0.998246 0.996735 0.364459 0.997189 0.994726
Mixup InCaseLaw 1.000000 0.007674 1.000000 1.000000 1.000000 1.000000 0.000000 1.000000 0.000000 0.523457 0.000000 1.000000 0.014212 0.997245 0.996337 0.995970 0.995808 0.995971 0.995013
Mixup RoBERTa 1.000000 1.000000 1.000000 1.000000 1.000000 1.000000 1.000000 0.998028 1.000000 0.995460 0.261199 0.996965 1.000000 0.996326 0.995959 0.995714 0.995440 0.995684 0.994955
Mixup 2 InCaseLaw 1.000000 0.006587 1.000000 1.000000 1.000000 0.624125 0.007148 1.000000 0.000000 0.425471 0.000000 1.000000 0.014647 0.997146 0.996214 0.995859 0.995709 0.995860 0.994943
Mixup2 RoBERTa 1.000000 1.000000 1.000000 1.000000 1.000000 1.000000 0.426319 1.000000 1.000000 0.996809 0.004709 0.997865 0.714759 0.996795 0.996249 0.995948 0.995813 0.995951 0.995148
PE-S InCaseLaw 1.000000 0.010608 1.000000 1.000000 1.000000 1.000000 0.010505 1.000000 0.008808 1.000000 0.000000 1.000000 0.016234 0.997630 0.996641 0.996221 0.996293 0.996272 0.995278
PE-S RoBERTa 1.000000 1.000000 1.000000 1.000000 1.000000 1.000000 1.000000 1.000000 1.000000 1.000000 1.000000 0.996065 1.000000 0.995871 0.995646 0.995482 0.995121 0.995428 0.994811
PE-C InCaseLaw 0.282756 0.006461 1.000000 1.000000 1.000000 0.022293 0.006859 0.238018 0.005590 0.007684 0.009752 1.000000 0.000000 0.997976 0.996478 0.996035 0.996081 0.996066 0.995022
PE-C RoBERTa 1.000000 1.000000 1.000000 1.000000 1.000000 1.000000 1.000000 1.000000 1.000000 1.000000 0.486554 1.000000 1.000000 0.995714 0.995483 0.995312 0.994932 0.995255 0.994644
DFCSC-CLS InCaseLaw 0.008179 0.005560 0.137075 0.064531 1.000000 0.005767 0.005798 0.006776 0.005147 0.004674 0.007453 0.006814 0.008262 1.000000 0.997639 0.996511 1.000000 0.996844 0.995017
DFCSC-CLS RoBERTa 0.006501 0.005311 0.006978 0.005932 0.009014 0.005399 0.005456 0.005805 0.005063 0.004838 0.006549 0.005748 0.006883 0.006996 1.000000 0.999260 0.000000 1.000000 0.994476
DFCSC-CLS Longformer 0.006246 0.005264 0.006494 0.005709 0.007415 0.005327 0.005397 0.005680 0.005053 0.004852 0.006353 0.005615 0.006649 0.006388 0.009715 1.000000 0.000000 0.004214 1.000000
DFCSC-SEP InCaseLaw 0.008612 0.005923 0.013985 0.009912 1.000000 0.006326 0.006132 0.007246 0.005526 0.005238 0.007763 0.007458 0.008484 0.415838 1.000000 1.000000 1.000000 0.997456 0.995221
DFCSC-SEP RoBERTa 0.006586 0.005366 0.007088 0.006037 0.009007 0.005465 0.005513 0.005890 0.005119 0.004894 0.006612 0.005842 0.006963 0.007113 0.571260 1.000000 0.005623 1.000000 0.995183
DFCSC-SEP Longformer 0.006816 0.005694 0.007277 0.006456 0.008629 0.005834 0.005820 0.006234 0.005470 0.005325 0.006809 0.006217 0.007123 0.007366 0.012084 0.445349 0.006291 0.011753 1.000000
======= 4-roles dataset =======
Bonferroni correction: True
confidence_level: 0.95
SingleSC InCaseLaw SingleSC RoBERTa Mixup InCaseLaw Mixup RoBERTa Mixup2 InCaseLaw Mixup2 RoBERTa PE-S InCaseLaw PE-S RoBERTa PE-C InCaseLaw PE-C RoBERTa Cohan InCaseLaw Cohan RoBERTa Cohan Longformer DFCSC-CLS InCaseLaw DFCSC-CLS RoBERTa DFCSC-CLS Longformer DFCSC-SEP InCaseLaw DFCSC-SEP RoBERTa DFCSC-SEP Longformer
SingleSC InCaseLaw 1.000000 0.080163 1.000000 0.000000 1.000000 0.093142 1.000000 0.661730 1.000000 0.783571 0.997351 1.000000 0.999504 1.000000 0.998378 0.998502 1.000000 0.997660 0.995947
SingleSC RoBERTa 1.000000 1.000000 0.996002 0.489126 0.996862 0.849102 1.000000 1.000000 1.000000 1.000000 0.996675 1.000000 0.997943 0.998315 0.997699 0.997996 1.000000 0.997143 0.995701
Mixup InCaseLaw 0.623318 0.018765 1.000000 0.000000 1.000000 0.031621 1.000000 0.508233 1.000000 0.638634 0.997869 1.000000 1.000000 1.000000 0.998869 0.998841 1.000000 0.998088 0.996267
Mixup RoBERTa 1.000000 1.000000 1.000000 1.000000 0.997557 1.000000 1.000000 1.000000 1.000000 1.000000 0.997031 1.000000 0.998287 0.998471 0.997997 0.998198 1.000000 0.997436 0.995979
Mixup2 InCaseLaw 0.351537 0.015288 0.538189 0.007522 1.000000 0.016616 0.743785 0.333015 1.000000 0.496753 0.998038 1.000000 1.000000 1.000000 0.998995 0.998907 1.000000 0.998148 0.996257
Mixup2 RoBERTa 1.000000 1.000000 1.000000 0.588854 1.000000 1.000000 1.000000 1.000000 1.000000 1.000000 0.997196 1.000000 0.998695 0.999034 0.998106 0.998282 1.000000 0.997539 0.996091
PE-S InCaseLaw 0.643626 0.090966 1.000000 0.008265 1.000000 0.076382 1.000000 0.446720 1.000000 0.567200 0.996798 1.000000 0.998896 1.000000 0.997951 0.998214 1.000000 0.997227 0.995519
PE-S RoBERTa 1.000000 0.406640 1.000000 0.149205 1.000000 0.273544 1.000000 1.000000 1.000000 0.926344 0.996771 1.000000 0.998578 1.000000 0.997811 0.998102 1.000000 0.997206 0.995675
PE-C InCaseLaw 0.476652 0.140718 0.642113 0.070120 0.868894 0.112886 0.630327 0.393995 1.000000 0.427977 0.995746 1.000000 1.000000 1.000000 0.997309 0.997743 1.000000 0.996581 0.994892
PE-C RoBERTa 1.000000 0.665132 1.000000 0.393835 1.000000 0.576217 1.000000 1.000000 1.000000 1.000000 0.996465 1.000000 1.000000 1.000000 0.997442 0.997720 1.000000 0.996865 0.995455
Cohan InCaseLaw 0.006631 0.007070 0.005227 0.005404 0.005624 0.005778 0.009493 0.008554 0.015254 0.010702 1.000000 0.036628 0.000902 0.000011 1.000000 1.000000 0.226195 1.000000 0.997436
Cohan RoBERTa 0.049991 0.006127 0.080533 0.003948 0.142748 0.004381 0.133481 0.048838 0.423694 0.140015 1.000000 1.000000 1.000000 1.000000 0.999607 0.998985 1.000000 0.998180 0.995855
Cohan Longformer 0.006901 0.007485 0.004700 0.005119 0.005282 0.005468 0.012252 0.009819 0.185620 0.026711 1.000000 0.653489 1.000000 0.578178 1.000000 0.999534 1.000000 0.998667 0.996000
DFCSC-CLS InCaseLaw 0.007146 0.007833 0.005911 0.004958 0.029540 0.005473 0.049050 0.013669 0.383153 0.096832 1.000000 1.000000 1.000000 1.000000 0.999695 0.999244 1.000000 0.998386 0.996012
DFCSC-CLS RoBERTa 0.005501 0.005934 0.004623 0.004846 0.004808 0.005018 0.007202 0.006744 0.010487 0.008087 0.232845 0.009382 0.006967 0.006724 1.000000 1.000000 0.018932 1.000000 0.997371
DFCSC-CLS Longformer 0.004469 0.004899 0.003853 0.004165 0.003969 0.004240 0.005564 0.005347 0.007596 0.006336 0.028916 0.006356 0.004868 0.004886 0.163053 1.000000 0.000000 0.445477 1.000000
DFCSC-SEP InCaseLaw 0.004679 0.005037 0.007507 0.003608 0.035599 0.003754 0.040146 0.011550 0.178775 0.036412 1.000000 0.532627 0.640174 0.423307 1.000000 1.000000 1.000000 0.997827 0.995161
DFCSC-SEP RoBERTa 0.005380 0.005788 0.004592 0.004803 0.004761 0.004951 0.006864 0.006479 0.009573 0.007651 0.054272 0.008398 0.006533 0.006330 0.396615 1.000000 0.010936 1.000000 1.000000
DFCSC-SEP Longformer 0.005904 0.006225 0.005164 0.005257 0.005348 0.005451 0.007246 0.006898 0.009475 0.007901 0.007694 0.008560 0.007114 0.006858 0.014400 0.608637 0.010416 0.065392 1.000000