New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[FEAT] Curriculum Learning #8

Open

2 tasks

ohbigkite opened this issue Feb 15, 2024 · 0 comments

Assignees

Labels

Contributor

ohbigkite commented Feb 15, 2024

🏞️ Background

Reader 모델 학습 과정에서 쉬운 것부터 학습하고, 차츰 어려운 것까지 학습시키는 Curriculum Learning 방식을 도입하고자 합니다.

📝 To do

trainer_qa.py 파일에서 Trainer 부분의 Loss function을 custom loss로 바꿔줌
기존 Cross-entropy loss function => SPL(self-paced learning) loss function으로!

ohbigkite added the enhancement label

ohbigkite self-assigned this

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment