ALBERT4Rec

https://etheses.lib.ntust.edu.tw/cgi-bin/gs32/gsweb.cgi/ccd=c9vs7L/

Usage

1. python main.py --template train_albert
2. tensorboad --logdir=experiments

Reference

• Paper
  • ALBERT: A Lite BERT for Self-supervised Learning of Language Representations https://arxiv.org/abs/1909.11942
  • BERT4Rec: BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformer https://arxiv.org/abs/1904.06690
• Implement
  • ALBERT-Pytorch https://github.com/graykode/ALBERT-Pytorch
  • BERT4Rec-VAE-Pytorch https://github.com/jaywonchung/BERT4Rec-VAE-Pytorch

Requirement

• Environment
  • Python 3.7
  • Pytorch 1.14
  • CUDA 10.1
• Hardware
  • i7-7700
  • GTX 1060 6GB
  • 16GB RAM