week04_seq2seq

Materials

• Lecture slides
• Our videos (russian): lecture, seminar
• Stanford lecture on seq2seq and MT (english) - video
• Alternative CMU lectures - seq2seq and attention

Practice

This time we're gonna use a shared practice_and_homework_pytorch.ipynb for both seminar and homework.

Seminar .

Lecture-blog, research thinking exercises, related papers and fun:

NLP Course For You

More on RNN

• Distill.pub post on attention and augmentations for RNN - post
• Seq2seq lecture - video
• BLEU and CIDEr articles.
• Image captioning
  • MSCOCO captioning challenge
  • Captioning baseline notebook

More on Transformer

• Illustrated transformer post