Faster and Stronger: from Transformers to GPTs



Irene Li (University of Tokyo)

Irene Li is now a project assistant professor at the University of Tokyo. She obtained her PhD degree in natural language processing at Yale University advised by Prof. Dragomir Radev. Her main research focus is language modeling, transfer learning and NLP applications in healthcare and education.



Short Abstract: In this talk, we will explore the evolution of natural language processing models from Transformers to Generative Pretrained Transformers (GPTs). We will cover three interesting subtopics: efficiency, explainability and early observation on GPT-3. Through this discussion, we aim to provide insights into the latest developments in NLP research and the potential impact of these advancements on various industries.