Graham Neubig
Assistant Professor, Language Technology Institute, Carnegie Mellon University
Affiliated Faculty, Machine Learning Department, Carnegie Mellon University
Affiliated Faculty, School of Informatics, Nara Institute of Science and Technology
Director of Deep Learning Research, Petuum Inc.
My research is concerned with language and its role in human communication. In particular, my long-term research goal is to break down barriers in human-human or human-machine communication through the development of natural language processing (NLP) technologies. This includes the development of technology for machine translation, which helps break down barriers in communication for people who speak different languages, and natural language understanding, which helps computers understand and respond to human language. Within this overall goal of breaking down barriers to human communication, I have focused on several aspects of language that both make it interesting as a scientific subject, and hold potential for the construction of practical systems. Specific areas of interest include:
- Machine Translation
- Natural Language Processing (Text Analysis, Language Modeling, Parsing)
- Machine Learning (Neural Networks, Un- and Semi-supervised Learning, Bayesian Methods)
- Spoken Language Processing (Spoken Language Analysis, Spoken Dialog)
- Software Language Processing (Conversion/Alignment between Code and Language)
Academic/Career History
- 9/2016-onward Carnegie Mellon University (CMU): Assistant Professor
- 4/2012-8/2016 Nara Institute of Science and Technology (NAIST): Assistant Professor
- 4/2010-3/2012 Kyoto University: Doctoral course in Intelligent Information Systems
- 4/2008-3/2010 Kyoto University: Master's course in Intelligent Information Systems
- 8/2006-3/2008 Hyogo Prefectural Government: Coordinator for International Relations
- 9/2005-7/2006 Tajima Agricultural High School: Assistant Language Teacher
- 8/2001-5/2005 University of Illinois, Urbana-Champaign: B.S. Computer Science
Awards
- 2017: 1st Workshop on Neural Machine Translation: Best Paper Award
- 2017: 2017 Meeting of the European Chapter of the Association for Computational Linguistics: Outstanding Paper Award
- 2016: 2016 Conference on Empirical Methods in Natural Language Processing (EMNLP): Best Short Paper Award
- 2015: 2015 Meeting of the Association for Natural Language Processing: Outstanding Paper Award
- 2013: Journal of Information Processing Outstanding Paper Award
- 2012: Oriental COCOSDA Best Student Paper Award (Co-author)
- 2012: IPSJ SIG Recommended PhD Thesis
- 2012: Yamashita SIG Research Award
- 2012: JSAI Field Innovation Prize (as a member of the ANPI_NLP project)
- 2012: 2011 Meeting of the Association for Natural Language Processing: Outstanding Paper Award
- 2010: JSPS Research Fellowship for Young Scientists (DC1)
Visiting Researcher Experience
- 2015-2016 (Oct.-Jan.): CMU, Pittsburgh, USA. Focus on neural networks and natural language+code tasks. Host: Chris Dyer
- 2010-2012: NICT, Japan. Focus on unsupervised learning for machine translation. Host: Taro Watanabe
- 2011 (Jul.-Sep.): Google, Mountain View, USA. Research on machine translation. Host: David Talbot
- 2008 (Aug./Sep.): ATR, Japan. Researched language models for machine translation. Host: Andrew Finch
Activities
- 2016: Coling 2016, Machine Translation Area Chair
- 2016: ACL 2016, Machine Translation Area Chair
- 2015: Workshop on Asian Translation 2015, Organizer
- 2014, 2015: Kansai Machine Translation Study Group, Organizer
- 2013: Workshop on Language Processing and Crisis Information 2013, Organizer
- 2013, 2014: NLP2013 NLP2014, Tutorial Chair
- 2012, 2013: NLP2012 NLP2013, Organizer for the Theme Session on Language Information Processing in Times of Crisis
- 2011: NLP2011, Program Committee for the Workshop on the Relationship between Business, Universities, and Students in Natural Language Processing
- Reviewer/PC: ACL, EACL, EMNLP, InterSpeech, ICASSP, JNLP (I will be happy to review for Open Access publications).
Presentations
Papers
Here is a list of a few of my current favorite papers:
- Jacob Buckman, Graham Neubig.
Neural Lattice Language Models (BibTex, Code/Data)
Transactions of the Association for Computational Linguistics (TACL). 2018 (To Appear). - Aakanksha Naik, Abhilasha Ravichander, Norman Sadeh, Carolyn Rose, Graham Neubig.
Stress Test Evaluation for Natural Language Inference (BibTex, Code/Data)
The 27th International Conference on Computational Linguistics (COLING). Santa Fe, New Mexico, USA. August 2018 (To Appear). Area Chair Favorite Paper. - Pengcheng Yin, Chunting Zhou, Junxian He, Graham Neubig.
StructVAE: Tree-structured Latent Variable Models for Semi-supervised Semantic Parsing (BibTex)
The 56th Annual Meeting of the Association for Computational Linguistics (ACL). Melbourne, Australia. July 2018 (To Appear). - Paul Michel, Graham Neubig.
Extreme Adaptation for Personalized Neural Machine Translation (BibTex, Code/Data)
The 56th Annual Meeting of the Association for Computational Linguistics (ACL). Melbourne, Australia. July 2018 (To Appear). - Harsh Jhamtani, Varun Gangal, Eduard Hovy, Graham Neubig, Taylor Berg-Kirkpatrick.
Learning to Generate Move-by-Move Commentary for Chess Games from Large-Scale Social Forum Data (BibTex)
The 56th Annual Meeting of the Association for Computational Linguistics (ACL). Melbourne, Australia. July 2018 (To Appear).
My most highly cited papers can be found on Google Scholar, and all of my publications can be found on my publications page.
Talks, etc.
Some others can be found on the tutorials page.
- 2015/09 Kyoto University Media Center Seminar: Machine Translation with Neural Nets (in Japanese)
- 2014/03 Kansai MT Study Group @ Hokkaido: I struggled all year to get an increase in human evaluation (in Japanese)
- 2014/03 ALAGIN Seminar @ Tokyo: 4 day machine translation tutorial (in Japanese), with Taro Watanabe, Katsuhito Sudoh, Akihiro Tamura, and Katsuhiko Hayashi. Slides about: Language Model, Translation Model, Alignment, Syntax-based Models, Data, Speech.
- 2013/01 ALAGIN Seminar @ Tokyo: 2 day machine translation tutorial (in Japanese).
- 2012/10 Kansai MT Study Group @ Kyoto: Experiments in English<->Japanese Tree-to-String Translation
- 2011/06 Microsoft Research Redmond: An unsupervised model for joint phrase alignment and extraction.
- 2011/05 Keihanna Speech Seminar @ NAIST: Non-parametric Bayesian methods (in Japanese)
- 2010/09 National Institute for the Japanese Language and Linguistics: Efficient corpus construction with active learning and pointwise prediction (in Japanese)
- 2010/08 NTT Communication Science Research Lab: Learning a language model from continuous speech
Other Links
- Slides for tutorials and classes can be found on my teaching page
- Software and resources that I've developed can be found on my software page.
- Tools for Natural Language Processing
- The Kyoto Free Translation Task: A task that can be used for evaluation of English-Japanese translation systems
- Japanese Parallel Data: A list of various data that can be used to create machine translation systms to/from Japanese