Course Schedule

Introduction

8/29 Class Introduction

Content:

  • Introduction to Neural Networks
  • Example Tasks and Their Difficulties
  • What Neural Nets can Do To Help

Reading Material

  • Highly Recommended: Goldberg Book Chapters 1-5 (this is a lot to read, but covers basic concepts in neural networks that many people in the class may have covered already. If you're already familiar with neural nets, skim it. If not, please read carefully and ask lots of questions to the TAs/instructor.)
  • Reference: Deep Unordered Composition. (Iyyer et al.)

Slides: Class Intro Slides
Sample Code: Class Intro Code Examples
Lecture Video: Class Intro Lecture Video

8/31 A Simple (?) Exercise: Predicting the Next Word in a Sentence

Content:

  • Computational Graphs
  • Feed-forward Neural Network Language Models
  • Measuring Model Performance: Likelihood and Perplexity

Reading Material

Slides: LM Slides
Sample Code: LM Code Examples
Lecture Video: LM Lecture Video

Section 1: Models of Words

9/5 Distributional Semantics and Word Vectors

Content:

  • Describing a word by the company that it keeps
  • Counting and predicting
  • Skip-grams and CBOW
  • Evaluating/Visualizing Word Vectors
  • Advanced Methods for Word Vectors

Reading Material