Introduction, Bag-of-words, and Multi-layer Perceptron (1/14/2020)
Content:
- Introduction to Neural Networks
- Class Outline
- Acceptability Judgements, Text Classification, and Their Difficulties (task-textclass)
- What Neural Nets can Do To Help
- Bag-of-words, Continuous Bag-of-words, and Deep Continuous Bag-of-words Models (arch-bow)
Reading Material
- Highly Recommended: Goldberg Book Chapters 1-5 (this is a lot to read, but covers basic concepts in neural networks that many people in the class may have covered already. If you're already familiar with neural nets, skim it. If not, please read carefully and ask lots of questions to the TAs/instructor.)
- Reference: Deep Unordered Composition. (Iyyer et al.)
Slides: Class Intro Slides
Sample Code: Class Intro Code Examples
Neural Net Concepts: NN4NLP Concepts