Representation 1 - Pre-training Methods (9/23/2021)

Content:

  • Simple overview of multi-task learning
  • Sentence embeddings
  • BERT and variants
  • Other language modeling objectives

Reading Material

Slides: Pre-training Slides
Sample Code: Pre-training Code Examples

<-- Back To Schedule