Date & Time:
January 31, 2020 10:30 am – 11:30 am
Location:
Crerar 390, 5730 S. Ellis Ave., Chicago, IL,
01/31/2020 10:30 AM 01/31/2020 11:30 AM America/Chicago Tengyu Ma (Stanford) – Designing Explicit Regularizers for Deep Models Crerar 390, 5730 S. Ellis Ave., Chicago, IL,

Designing Explicit Regularizers for Deep Models

I will discuss some recent results on designing explicit regularizers to improve the generalization performances of deep neural networks. We derive data-dependent generalization bounds for deep neural networks. We empirically regularize the bounds and obtain improved generalization performance (in terms of the standard accuracy or the robust accuracy). I will also touch on recent results on applying these techniques to imbalanced datasets. 

Based on joint work with Colin Wei, Kaidi Cao, Adrien Gaidon, and Nikos Arechiga

Host: Nati Srebro

Tengyu Ma

Assistant Professor, Stanford University

Tengyu Ma is an assistant professor of Computer Science and Statistics at Stanford University. He received his Ph.D. from Princeton University and B.E. from Tsinghua University. His research interests include topics in machine learning and algorithms, such as deep learning and its theory, non-convex optimization, deep reinforcement learning, representation learning, and high-dimensional statistics. He is a recipient of NIPS’16 best student paper award, COLT’18 best paper award, and ACM Doctoral Dissertation Award Honorable Mention.

Related News & Events

Four Students Receive Honorable Mention in CRA Undergraduate Research Awards

Mar 25, 2024

Navigating the Intersection of Technology and Public Policy: The Journey of Ranya Sharma at UChicago

Mar 21, 2024

Assistant Professor Aloni Cohen Receives Prestigious Award for Groundbreaking Research in Machine Learning Complexity

Mar 20, 2024

Haifeng Xu named a AI2050 Early Career Fellow

Mar 11, 2024

FabRobotics: The Fusion of 3D Printing and Mobile Robots

Feb 27, 2024

Professor Andrew A. Chien on the Environmental Impacts of Technology

Feb 26, 2024

Assistant Professor Yanjing Li Awarded NSF CAREER Grant for Innovative Computer Architecture and Deep Learning Research

Feb 26, 2024

Prof. Rebecca Willett awarded the SIAG DATA Career prize

Feb 21, 2024

Argonne scientists use AI to identify new materials for carbon capture

Feb 19, 2024

Alumni Spotlight: Dixin Tang, Assistant Professor of Computer Science at UT Austin

Feb 05, 2024

NetMicroscope Uses AI to Improve Network Monitoring for a Better Internet Experience

Feb 01, 2024

NeurIPS 2023 Award-winning paper by DSI Faculty Bo Li, DecodingTrust, provides a comprehensive framework for assessing trustworthiness of GPT models

Feb 01, 2024
arrow-down-largearrow-left-largearrow-right-large-greyarrow-right-large-yellowarrow-right-largearrow-right-smallbutton-arrowclosedocumentfacebookfacet-arrow-down-whitefacet-arrow-downPage 1CheckedCheckedicon-apple-t5backgroundLayer 1icon-google-t5icon-office365-t5icon-outlook-t5backgroundLayer 1icon-outlookcom-t5backgroundLayer 1icon-yahoo-t5backgroundLayer 1internal-yellowinternalintranetlinkedinlinkoutpauseplaypresentationsearch-bluesearchshareslider-arrow-nextslider-arrow-prevtwittervideoyoutube