Topics more than two weeks ahead are PRELIMINARY. Details will change
Note that links for slides for future classes go to a placeholder (or may go to a previous semester). If I haven’t put up the slides for a class we’ve had, remind me.
Jurafsky & Martin= J&M If there’s no link, the chapter is available on Latte
| Dates | Topic | Reading | Assignments |
01/14 |
Overview of Speech and the Industry | NLP Commercialization in the past 25 years | Read and annotate Makhoul and Schwartz paper |
01/17 |
Speech Recognizer Architecture | Kaldi Tutorial (will be assigning specific sections later) | |
01/21 |
Kaldi Tutorial
|
PA1: Kaldi Y/N tutorial, due 1/28 | |
01/24 |
Phonetics and Front End Feature Extraction | J&M Phonetics, J&M Ch. 9.1, 9.3 CMU Spectograms, Cepstrum, etc |
Kaldi compiled |
01/28 |
WFSTs; OpenFST QuickTour | Speech Recognition with WFST, Mohri Weighted AutomataOpen FST Tutorial; WFSTs in Speech Recognition, Hannemann |
Kaldi Y/N tutorial due |
01/31 |
Language Modeling; Perplexity | J&M Language Modeling | PA2: Statistic Language Model, due 2/11 |
02/04 |
More Perplexity, Bash | SRILM site; SRILM 2001; SRILM at 16 | |
02/07 |
HMMs and Viterbi | J&M HMMs, Andrew Moore, CMU, HMM Tutorial,Eisner paper, Eisner spreadsheet, | |
02/11 |
More Kaldi, bash, … | SLM due | |
02/14 |
GMMs & OUCH; Pronunciation modeling | Kaldi RM Quiz (due 2/25) & PA3 (due 2/28) | |
02/17 |
Winter Break | ||
02/21 |
Winter Break | ||
02/25 |
Evaluating Speech Reco; Jurafsky: Chatbots | Jurafsky, Dialog and Chatbots | Kaldi RM quiz due |
02/28 |
“Advanced” Dialog; Dialog Toolkits Comparison | AT&T Spoken Dialog | Kaldi RM programming due |
03/03 |
Building with DialogFlow; MultiWoz data set | DialogFlow NLP Tool | |
03/06 |
Working with the data. | Speech Final Quiz due | |
03/10 |
|||
03/13 |
Programming DF back-end | PA4: Dialog application | |
03/17 |
Discourse and Dialog | Dialog application first check-in | |
03/20 |
|||
03/24 |
No class | ||
03/27 |
Dialogflow application presentations |
Dialog application due | |
03/31 |
Sounding Board: A Socialbot | Alexa Prize Winner University of Washington; AlexaPrize 2017 & 2018; | AlexaPrize paper assigned |
04/03 |
AlexaPrize paper discussions; | Final project selection | |
04/07 |
No class | ||
04/10 |
No class | ||
04/14 |
Finish AlexaPrize paper discussions; Dialog State Tracking | ||
04/17 |
Class presentations | ||
04/21 |
Dialog State Trackign | ||
04/24 |
Error Correction and Evaluation | ||
04/28 |
Dialog research | Group presentations of Research | |
| 5/12 | Final Project Presentation | Group Reflections |