Deep Latent-Variable Models
for Natural Language
Yoon Kim, Sam Wiseman, Alexander Rush
Live Questions: Anonymous | Tweet
Tutorial Code (Pytorch, Pyro): Notebook
This tutorial covers deep latent variable models both in the case where exact inference over the latent variables is tractable and when it is not. The former case includes neural extensions of unsupervised tagging and parsing models. Our discussion of the latter case, where inference cannot be performed tractably, will restrict itself to continuous latent variables. In particular, we will discuss recent developments both in neural variational inference (e.g., relating to Variational Auto-encoders). We will highlight the challenges of applying these families of methods to NLP problems, and discuss recent successes and best practices.