In this notebook we:
- Train sentence representations for a classification task,
- Probe these representations for analysis, and
- Perform analysis on trained models.
We will use:
- A Deep Averaging Network (DAN) model, implemented from scratch,
- PyTorch's implementation of a GRU based model, and
- Linear probing models, classifiers that help assess what kinds of information are captured in the sentence representations.