DLB-Pytorch

A minimalist unofficial implementation of "Self-Distillation from the Last Mini-Batch for Consistency Regularization"

reference: https://arxiv.org/pdf/2203.16172.pdf

Prerequisites

• PyTorch
• PyTorch Lightning
• timm
• torchmetrics
• torchvision
• python3
• CUDA

Citations

@misc{https://doi.org/10.48550/arxiv.2203.16172,
  doi = {10.48550/ARXIV.2203.16172},
  url = {https://arxiv.org/abs/2203.16172},
  author = {Shen, Yiqing and Xu, Liwu and Yang, Yuzhe and Li, Yaqian and Guo, Yandong},
  keywords = {Computer Vision and Pattern Recognition (cs.CV), FOS: Computer and information sciences, FOS: Computer and information sciences},
  title = {Self-Distillation from the Last Mini-Batch for Consistency Regularization},
  publisher = {arXiv},
  year = {2022},
  copyright = {Creative Commons Attribution 4.0 International}
}