Convolutional Neural Nets for Text (1/21/2020)
Content:
- Bag of Words, Bag of n-grams, and Convolution
- Applications of Convolution: Context Windows and Sentence Modeling
- Stacked and Dilated Convolutions
- Structured Convolution
- Convolutional Models of Sentence Pairs
- Visualization for CNNs
Reading Material
- Required Reading (for quiz): Goldberg Book Chapter 13
- Reference: Time Delay Neural Networks (Waibel et al. 1989)
- Reference: Convolutional Neural Networks (LeCun et al. 1998)
- Reference: CNNs for Text (Collobert and Weston 2011)
- Reference: CNN for Modeling Sentences (Kalchbrenner et al. 2014)
- Reference: CNNs for Sentence Classification (Kim 2014)
- Reference: Dilated CNNs for Language Modeling (Kalchbrenner et al. 2016)
- Reference: Empirical Evaluation of Activation Functions (Eger et al. 2018)
- Reference: Tree Convolution (Ma et al. 2015)
- Reference: Graph Convolution for Text (Marcheggiani and Titov 2017)
- Reference: Siamese Networks (Bromley et al. 1993)
- Reference: Convolutional Matching Model (Hu et al. 2014)
- Reference: Convolution + Sentence Pair Pooling (Yin and Schutze 2015)
- Reference: Convolutional Networks for Sentence Classification (Kim 2014)
Slides: CNN Slides
Sample Code: CNN Code Examples