Date & Time:
October 30, 2023 11:00 am – 12:00 pm
10/30/2023 11:00 AM 10/30/2023 12:00 PM America/Chicago Amuyla Yadav (Penn State)-Sidestepping the Black-Box: A New Paradigm for Explainable AI

Existing work in Explainable Artificial Intelligence (XAI) has been focused on developing techniques to interpret decisions made by pre-trained & black-box machine learning (ML) models. This black-box assumption is reasonable in a lot of settings, e.g., explaining Amazon’s recommender systems requires assuming a black-box model because it is infeasible to assume glass-box access to Amazon’s proprietary models, etc. However, I argue that in many real-world settings (especially those that pertain to low-resource domains), the black-box assumption is unnecessary, undesirable, and often, overly limiting. In this talk, I motivate the need to move away from the black-box assumption of XAI by discussing two deployed use cases of responsible AI research: (i) automated tele-triage for poor pregnant women in Kenya, and (ii) raising awareness of HIV among homeless youth in Los Angeles. Through my experiences with the deployment of AI in these domains, we will argue the need for a new paradigm in explainable AI. Next, I will discuss two new frameworks: (i) CounterNet, a novel end-to-end learning framework which integrates Machine Learning (ML) model training and the generation of corresponding counterfactual (CF) explanations into a single end-to-end pipeline; and (ii) RoCourseNet, a training framework that jointly optimizes predictions and recourses that are robust to future data shifts.


Amuyla Yadav

Assistant Professor

Amulya Yadav is the PNC Technologies Career Development Assistant Professor in the College of Information Sciences and Technology at Penn State University, where he serves as Director of the RAISE Research Lab. He is also the Associate Director (Programs) at the Center for Socially Responsible AI @ Penn State. Amulya’s research work in the field of Responsible AI and Artificial Intelligence for Social Good focuses on developing theoretically grounded approaches to real-world problems that can have an impact in the field. His algorithms have been deployed in the real-world, particularly in the field of public health and wildlife protection. Amulya is a recipient of the AAMAS 2016 Best Student Paper Award, the AAAI 2017 Best Video and Best Student Video Award, the IDEAS 2016 Most Visionary Paper Award, and the AAMAS 2017 Best Paper Award nomination. His work has also been highlighted by as one of 26 incredible innovations that improved the world in 2015.

Related News & Events


“Machine Learning Foundations Accelerate Innovation and Promote Trustworthiness” by Rebecca Willett

Jan 26, 2024

Nightshade: Data Poisoning to Fight Generative AI with Ben Zhao

Jan 23, 2024
In the News

In The News: U.N. Officials Urge Regulation of Artificial Intelligence

"Security Council members said they feared that a new technology might prove a major threat to world peace."
Jul 27, 2023
UChicago CS News

UChicago Computer Scientists Bring in Generative Neural Networks to Stop Real-Time Video From Lagging

Jun 29, 2023
UChicago CS News

Computer Science Displays Catch Attention at MSI’s Annual Robot Block Party

Apr 07, 2023
UChicago CS News

UChicago, Stanford Researchers Explore How Robots and Computers Can Help Strangers Have Meaningful In-Person Conversations

Mar 29, 2023
UChicago CS News

Postdoc Alum John Paparrizos Named ICDE Rising Star

Mar 15, 2023
UChicago CS News

New EAGER Grant to Asst. Prof. Eric Jonas Will Explore ML for Quantum Spectrometry

Mar 03, 2023
UChicago CS News

Assistant Professor Chenhao Tan Receives Sloan Research Fellowship

Feb 15, 2023
UChicago CS News

UChicago Scientists Develop New Tool to Protect Artists from AI Mimicry

Feb 13, 2023
In the News

Professors Rebecca Willett and Ben Zhao Discuss the Future of AI on Public Radio

Jan 26, 2023
UChicago CS News

UChicago Launches Transform Accelerator for Data Science & Emerging AI Startups

Jan 19, 2023
arrow-down-largearrow-left-largearrow-right-large-greyarrow-right-large-yellowarrow-right-largearrow-right-smallbutton-arrowclosedocumentfacebookfacet-arrow-down-whitefacet-arrow-downPage 1CheckedCheckedicon-apple-t5backgroundLayer 1icon-google-t5icon-office365-t5icon-outlook-t5backgroundLayer 1icon-outlookcom-t5backgroundLayer 1icon-yahoo-t5backgroundLayer 1internal-yellowinternalintranetlinkedinlinkoutpauseplaypresentationsearch-bluesearchshareslider-arrow-nextslider-arrow-prevtwittervideoyoutube