bert

https://ai.googleblog.com/2018/11/open-sourcing-bert-state-of-art-pre.html
https://arxiv.org/abs/1810.04805
https://github.com/google-research/bert
https://en.wikipedia.org/wiki/BERT_(language_model)

albert

https://ai.googleblog.com/2019/12/albert-lite-bert-for-self-supervised.html
https://arxiv.org/abs/1909.11942
https://github.com/google-research/ALBERT

knowbert

https://github.com/allenai/kb

roberta

https://arxiv.org/abs/1907.11692

t5

https://github.com/google-research/text-to-text-transfer-transformer

t5x

https://github.com/google-research/t5x

exbert (for visual analysis)

https://arxiv.org/abs/1910.05276
http://exbert.net/

previous

https://github.com/google-research/language

on pytorch

https://pytorch.org/tutorials/intermediate/dynamic_quantization_bert_tutorial.html
https://github.com/codertimo/BERT-pytorch

transformer

https://ai.googleblog.com/2017/08/transformer-novel-neural-network.html
https://ai.googleblog.com/2020/01/encode-tag-and-realize-controllable-and.html

reformer

https://ai.googleblog.com/2020/01/reformer-efficient-transformer.html

bertology

grover

https://grover.allenai.org/