Date & Time:
February 20, 2023 3:00 pm – 4:00 pm
Crerar 390, 5730 S. Ellis Ave., Chicago, IL,
02/20/2023 03:00 PM 02/20/2023 04:00 PM America/Chicago Mina Lee (Stanford) – Designing and Evaluating Language Models for Human Interaction Crerar 390, 5730 S. Ellis Ave., Chicago, IL,

In this talk, I will present my research on designing and evaluating language models (LMs) for human-LM interaction. Despite the recent advancements in LMs, most LMs are not optimized for, nor are they evaluated on, real-world usage with human interaction. To address this, I will first describe how we can support human editing needs by enabling any LM to perform text infilling at any position in a document (i.e., “fill in the blanks”). I will then introduce CoAuthor, a platform for capturing human-LM interaction in collaborative writing as rich, replayable, keystroke-level interaction traces. With the platform, I demonstrate how collecting a large interaction dataset and analyzing the traces provide unique insights into LM capabilities regarding language, ideation, and collaboration. Lastly, I will propose a new framework, HALIE (Human-AI Language-based Interaction Evaluation), that defines the components of interactive systems and evaluation metrics for human-LM interaction beyond writing. I will conclude by discussing open challenges and future directions in this field.


Mina Lee

Ph.D. candidate in Computer Science, Stanford University

Mina Lee is a final-year Ph.D. candidate at Stanford University, advised by Professor Percy Liang. Her research goal is to leverage language models to enhance our productivity and creativity and understand how these models change the way we write. She has built various writing assistants, including an autocomplete system, a contextual thesaurus system, and a creative story writing system, as well as evaluated language models based on their ability to interact with humans and augment human capabilities. She was named one of MIT Technology Review’s Korean Innovators under 35 in 2022, and her work has been published in top-tier venues in natural language processing (e.g., ACL and NAACL), machine learning (e.g., NeurIPS), and human-computer interaction (e.g., CHI). Her recent work on human-AI collaborative writing received an Honorable Mention Award at CHI 2022 and was featured in various media outlets including The Economist.

Related News & Events

UChicago CS News

Postdoc Alum John Paparrizos Named ICDE Rising Star

Mar 15, 2023
UChicago CS News

New EAGER Grant to Asst. Prof. Eric Jonas Will Explore ML for Quantum Spectrometry

Mar 03, 2023
UChicago CS News

Asst. Prof. Rana Hanocka Receives NSF Grant to Develop New AI-Driven 3D Modeling Tools

Feb 28, 2023
Young students on computers
UChicago CS News

UChicago and NYU Research Team Finds Edtech Tools Could Pose Privacy Risks For Students

Feb 21, 2023
UChicago CS News

Assistant Professor Chenhao Tan Receives Sloan Research Fellowship

Feb 15, 2023
UChicago CS News

UChicago Scientists Develop New Tool to Protect Artists from AI Mimicry

Feb 13, 2023
In the News

Professors Rebecca Willett and Ben Zhao Discuss the Future of AI on Public Radio

Jan 26, 2023
UChicago CS News

UChicago Launches Transform Accelerator for Data Science & Emerging AI Startups

Jan 19, 2023
Two students looking at a wearable device
UChicago CS News

High School Students Find Their Place in Computing Through Wearables Workshop

Jan 13, 2023
UChicago CS News

UChicago CS Researchers Create Living Smartwatch to Explore Human-Device Relations

Dec 12, 2022
In the News

UChicago CS Researchers Share in Special Prize on COVID-19 Research

Dec 01, 2022
UChicago CS News

The Computing Pipeline: A Foundation for Diversifying Computer Science

Nov 28, 2022
arrow-down-largearrow-left-largearrow-right-large-greyarrow-right-large-yellowarrow-right-largearrow-right-smallbutton-arrowclosedocumentfacebookfacet-arrow-down-whitefacet-arrow-downPage 1CheckedCheckedicon-apple-t5backgroundLayer 1icon-google-t5icon-office365-t5icon-outlook-t5backgroundLayer 1icon-outlookcom-t5backgroundLayer 1icon-yahoo-t5backgroundLayer 1internal-yellowinternalintranetlinkedinlinkoutpauseplaypresentationsearch-bluesearchshareslider-arrow-nextslider-arrow-prevtwittervideoyoutube