Discriminative Training of Mixed Membership Models

Authored by: Edoardo M. Airoldi , David M. Blei , Elena A. Erosheva , Stephen E. Fienberg , Jun Zhu , Eric P. Xing

Handbook of Mixed Membership Models and Their Applications

Print publication date:  November  2014
Online publication date:  November  2014

Print ISBN: 9781466504080
eBook ISBN: 9781466504097
Adobe ISBN:

10.1201/b17520-23

 Download Chapter

 

Abstract

Mixed membership models have shown great promise in analyzing genetics, text documents, and social network data. Unlike most existing likelihood-based approaches to learning mixed membership models, we present a discriminative training method based on the maximum margin principle to utilize supervising side information such as ratings or labels associated with documents to discover more predictive low-dimensional representations of the data. By using the linear expectation operator, we can derive efficient variational methods for posterior inference and parameter estimation. Empirical studies on the 20 Newsgroup dataset are provided. Our experimental results demonstrate qualitatively and quantitatively that the max-margin-based mixed membership model (topic model in particular for modeling text): 1) discovers sparse and highly discriminative topical representations; 2) achieves state-of-the-art prediction performance; and 3) is more efficient than existing supervised topic models.

 Cite
Search for more...
Back to top

Use of cookies on this website

We are using cookies to provide statistics that help us give you the best experience of our site. You can find out more in our Privacy Policy. By continuing to use the site you are agreeing to our use of cookies.