Important

Model files are available in Google Drive
After cloning this repository download these folders and files from the above link: best-84.11, checkpoint-600, checkpoint-7776, final-roberta-classifier, and RoBERTa-base-PM-M3-Voc-distill-align-hf

Model files explanation

best-84.11 / final-roberta-classifier: Best RoBERTa with classification head checkpoint
checkpoint-600: Best BART checkpoint trained with attempt to add length as a loss
checkpoint-7776: Best BART checkpoint trained
RoBERTa-base-PM-M3-Voc-distill-align-hf: From bio-lm