Advanced Search Algorithms (4/6/2021)
- Search errors and model errors
- Beam Search and variants
- Minimum Bayes risk
- Heuristics modification to search
- Sampling-based search
- Reference: Search Errors and Model Errors (Neubig 2015)
- Reference: Machine Translation: Decoding (Koehn 2010)
- Reference: Learning to Decode for Future Success (Li et al. 2017)
- Reference: Pruning Criteria (Steinbiss et al. 1994)
- Reference: Google’s Neural Machine Translation System (Wu et al. 2016)
- Reference: Multinomial Length Normalization (Eriguchi et al. 2016)
- Reference: Average Length Normalization (Cho et al. 2014)
- Reference: Mutual Information and Diverse Decoding (Li et al., 2016)
- Reference: Generating High-Quality and Informative Conversation Responses (Shao et al., 2017)
- Reference: Effective Inference for Generative Neural Parsing (Stern et al., 2017)
- Reference: Beam-Search Optimization (Wiseman et al., 2016)
- Reference: Continuous Beam Search (Goyal et al. 2017)
- Reference: Learning to Decode for Future Success (Li et al., 2017)
- Reference: Nucleus Sampling (Holtzman et al. 2020)
- Reference: Actor-Critic for Sequence Prediction (Bahdanau et al. 2017)
- Reference: Sampling without replacement for Stochastic Beam Search (Kool et al. 2019)
- Reference: An explanation of the Gumbel-max trick (Adams, 2013)
Slides: Search Slides
Video: Search Video