Date & Time:
November 11, 2022 12:00 pm – 1:30 pm
Location:
Crerar 390, 5730 S. Ellis Ave., Chicago, IL,
Register
11/11/2022 12:00 PM 11/11/2022 01:30 PM America/Chicago Jordan Boyd-Graber (Maryland) – If We Want AI to be Interpretable, We Need to Define and Measure It CS/Stats/Data Science Institute Distinguished Speaker Series Crerar 390, 5730 S. Ellis Ave., Chicago, IL,

Part of the Autumn 2022 Distinguished Speaker Series.

AI tools are ubiquitous, but most users treat it as a black box: a handy tool that suggests purchases, flags spam, or autocompletes text. While researchers have presented explanations for making AI less of a black box, a lack of metrics make it hard to optimize explicitly for interpretability. Thus, I propose two metrics for interpretability suitable for unsupervised and supervised AI methods. For unsupervised topic models, I discuss our proposed “intruder” interpretability metric, how it contradicts the previous evaluation metric for topic models (perplexity), and discuss its uptake in the community over the last decade. For supervised question answering approaches, I show how human-computer cooperation can be measured and directly optimized by a multi-armed bandit approach to learn what kinds of explanations help specific users. I will then briefly discuss how similar setups can help users navigate information-rich domains like fact checking, translation, and web search.

This talk will also be broadcast via Zoom. Please register to receive viewing information.

Speakers

Jordan Boyd-Graber

Associate Professor, Computer Science, University of Maryland

Jordan Boyd-Graber’s research focus is in applying machine learning to problems that help computers better work with or understand humans. His research applies statistical models to natural language problems in ways that interact with humans, learn from humans, or help researchers understand humans. Jordan is an expert in the application of topic models, automatic tools that discover structure and meaning in large, multilingual datasets. His work has been supported by NSF, DARPA, IARPA, and ARL. Three of his students have gone on to tenure track positions at NYU, U Mass Amherst, and Ursinus. His awards include a 2017 NSF CAREER, the Karen Spärk Jones prize; “best of” awards at NIPS, CoNLL, and NAACL; and a Computing Innovation Fellowship (declined). His Erdös number is 2 (via Maria Klawe), and his Bacon number is 3 (by embarassing himself on Jeopardy!).

Agenda

Friday, November 11, 2022
12:00–12:30

Lunch & Socializing

12:30–1:30

Talk + Q&A

Registration

Register
11/11/2022 12:00 PM 11/11/2022 01:30 PM America/Chicago Jordan Boyd-Graber (Maryland) – If We Want AI to be Interpretable, We Need to Define and Measure It CS/Stats/Data Science Institute Distinguished Speaker Series Crerar 390, 5730 S. Ellis Ave., Chicago, IL,

Related News & Events

NeurIPS 2023 Award-winning paper by DSI Faculty Bo Li, DecodingTrust, provides a comprehensive framework for assessing trustworthiness of GPT models

Feb 01, 2024
Video

“Machine Learning Foundations Accelerate Innovation and Promote Trustworthiness” by Rebecca Willett

Jan 26, 2024
Video

Nightshade: Data Poisoning to Fight Generative AI with Ben Zhao

Jan 23, 2024

UChicago Undergrad Analyzes Machine Learning Models Used By CPD, Uncovers Lack of Transparency About Data Usage

Oct 31, 2023

In The News: U.N. Officials Urge Regulation of Artificial Intelligence

"Security Council members said they feared that a new technology might prove a major threat to world peace."
Jul 27, 2023

UChicago Computer Scientists Bring in Generative Neural Networks to Stop Real-Time Video From Lagging

Jun 29, 2023

UChicago Assistant Professor Raul Castro Fernandez Receives 2023 ACM SIGMOD Test-of-Time Award

Jun 27, 2023
Michael Franklin

Mike Franklin, Dan Nicolae Receive 2023 Arthur L. Kelly Faculty Prize

Jun 02, 2023

PhD Student Kevin Bryson Receives NSF Graduate Research Fellowship to Create Equitable Algorithmic Data Tools

Apr 14, 2023

Computer Science Displays Catch Attention at MSI’s Annual Robot Block Party

Apr 07, 2023

UChicago, Stanford Researchers Explore How Robots and Computers Can Help Strangers Have Meaningful In-Person Conversations

Mar 29, 2023

Postdoc Alum John Paparrizos Named ICDE Rising Star

Mar 15, 2023
arrow-down-largearrow-left-largearrow-right-large-greyarrow-right-large-yellowarrow-right-largearrow-right-smallbutton-arrowclosedocumentfacebookfacet-arrow-down-whitefacet-arrow-downPage 1CheckedCheckedicon-apple-t5backgroundLayer 1icon-google-t5icon-office365-t5icon-outlook-t5backgroundLayer 1icon-outlookcom-t5backgroundLayer 1icon-yahoo-t5backgroundLayer 1internal-yellowinternalintranetlinkedinlinkoutpauseplaypresentationsearch-bluesearchshareslider-arrow-nextslider-arrow-prevtwittervideoyoutube