[Interests] [Experiences] [Publications] [Professional Activities]


My core research interest is in machine learning for interactive systems that maximizes a utility function by taking actions, which is in contrast to prediction-oriented machine learning like supervised learning. My area of focus is reinforcement learning, including the important subclass known as contextual bandits; I am also interested in related areas such as large-scale online learning with big data, active learning, and planning. In the past, I have applied my work to recommendation, Web search, advertising, and conversational systems.

Most of my work can be grouped into several clusters:

More information can be found in Google Scholar, DBLP, LinkedIn.

Somewhat up-to-date CV, and short bio.

I am also on Twitter as @LihongLi20.


  • 2020 - present: Senior Principal Scientist, Amazon
  • 2017 - 2020: Research Scientist, Google Research
  • 2012 - 2017: Senior, Principal, Sr Principal Researcher, Microsoft Research
  • 2009 - 2012: Research Scientist, Yahoo! Research
  • 2009: PhD in Computer Science, Rutgers University
  • 2004: MSc in Computing Science, University of Alberta
  • 2002: BE in Computer Science and Technology, Tsinghua University

Professional Activities