Date & Time:
March 11, 2020 10:30 am – 11:30 am
Crerar 390, 5730 S. Ellis Ave., Chicago, IL,
03/11/2020 10:30 AM 03/11/2020 11:30 AM America/Chicago Subhransu Maji (UMass) – Task-Specific Recognition by Modeling Visual Tasks Crerar 390, 5730 S. Ellis Ave., Chicago, IL,

Task-Specific Recognition by Modeling Visual Tasks

The AI revolution powered in part by advances in deep learning has led to many successes in the last decade. I’ll describe some of our work in this vein that has enabled us to infer detailed properties of objects in images such as their 3D structure or fine-grained category within a taxonomy, as well as study ecological phenomena at an unprecedented scale using data collected from RADAR networks.

Despite these successes the vast majority of important applications remain beyond the scope of current AI systems. One barrier is that existing algorithms lack the ability to learn from limited data. This is a fundamental challenge because real-world data is dynamic, heavy-tailed, where supervision can be hard to acquire. I argue that a principled framework for reasoning about AI problems can enable modular and data-efficient solutions. Towards this end I’ll describe our framework for embedding computer vision tasks into a vector space that allows us to learn and reason about their properties. Our approach represents a task as the Fisher information of the parameters of a generic “probe” network. We show that the distance between these vectors correlates with natural metrics over tasks. It is also predictive of transfer, i.e., how much does training a deep network on one task benefit another, and can be used for model recommendation. On a portfolio of hundreds of vision tasks the recommended network using our approach outperforms the current gold standard of fine-tuning an ImageNet pre-trained network, especially when training data is limited. I’ll conclude with some of the life-cycle challenges that we need to address to make AI systems widely applicable.

Host: Michael Maire

Subhransu Maji

Assistant Professor, University of Massachusetts Amherst

Subhransu Maji is an Assistant Professor in the College of Information and Computer Sciences at the University of Massachusetts Amherst where he co-directs the Computer Vision Lab. He is also affiliated with the Center of Data Science and AWS AI. Prior to this he was a Research Assistant Professor at TTI Chicago, a philanthropically endowed academic institute in the University of Chicago campus. He obtained his Ph.D. in Computer Science from the University of California at Berkeley in 2011 and B.Tech. in Computer Science and Engineering from IIT Kanpur in 2006. For his work, he has received a Google graduate fellowship, NSF CAREER Award (2018), and a best paper honorable mention at CVPR 2018. He also serves on the editorial board of the International Journal of Computer Vision (IJCV). 

Related News & Events


“Machine Learning Foundations Accelerate Innovation and Promote Trustworthiness” by Rebecca Willett

Jan 26, 2024

Nightshade: Data Poisoning to Fight Generative AI with Ben Zhao

Jan 23, 2024
UChicago CS News

Five UChicago CS students named to Siebel Scholars Class of 2024

Oct 02, 2023
In the News

In The News: U.N. Officials Urge Regulation of Artificial Intelligence

"Security Council members said they feared that a new technology might prove a major threat to world peace."
Jul 27, 2023
UChicago CS News

UChicago Computer Scientists Bring in Generative Neural Networks to Stop Real-Time Video From Lagging

Jun 29, 2023
UChicago CS News

UChicago Team Wins The NIH Long COVID Computational Challenge

Jun 28, 2023
UChicago CS News

UChicago Assistant Professor Raul Castro Fernandez Receives 2023 ACM SIGMOD Test-of-Time Award

Jun 27, 2023
UChicago CS News

Computer Science Displays Catch Attention at MSI’s Annual Robot Block Party

Apr 07, 2023
UChicago CS News

UChicago, Stanford Researchers Explore How Robots and Computers Can Help Strangers Have Meaningful In-Person Conversations

Mar 29, 2023
Students posing at competition
UChicago CS News

UChicago Undergrad Team Places Second Overall In Regionals For World’s Largest Programming Competition

Mar 17, 2023
UChicago CS News

Postdoc Alum John Paparrizos Named ICDE Rising Star

Mar 15, 2023
UChicago CS News

New EAGER Grant to Asst. Prof. Eric Jonas Will Explore ML for Quantum Spectrometry

Mar 03, 2023
arrow-down-largearrow-left-largearrow-right-large-greyarrow-right-large-yellowarrow-right-largearrow-right-smallbutton-arrowclosedocumentfacebookfacet-arrow-down-whitefacet-arrow-downPage 1CheckedCheckedicon-apple-t5backgroundLayer 1icon-google-t5icon-office365-t5icon-outlook-t5backgroundLayer 1icon-outlookcom-t5backgroundLayer 1icon-yahoo-t5backgroundLayer 1internal-yellowinternalintranetlinkedinlinkoutpauseplaypresentationsearch-bluesearchshareslider-arrow-nextslider-arrow-prevtwittervideoyoutube