Lecture

Provable Benefits of Overparameterization in Model Compression

Graph Chat

Chat with Graph Search

Ask any question about EPFL courses, lectures, exercises, research, news, etc. or try the example questions below.

DISCLAIMER: The Graph Chatbot is not programmed to provide explicit or categorical answers to your questions. Rather, it transforms your questions into API requests that are distributed across the various IT services officially administered by EPFL. Its purpose is solely to collect and recommend relevant references to content that you can explore to help you answer your questions.

Related lectures (64)

Deep Learning: Data Representations and Neural Networks

Explores data representations, histograms, neural networks, and deep learning concepts.

Regression Diagnostics

Covers regression diagnostics for linear models, emphasizing the importance of checking assumptions and identifying outliers and influential observations.

Linear Models: Introduction

Introduces linear models, regression, Gaussian distribution, linearity, and model generalization.

Linear Models: Basics

Introduces linear models in machine learning, covering basics, parametric models, multi-output regression, and evaluation metrics.

Second-Order Model Compression

Explores second-order model compression for massive deep neural networks, showcasing compression techniques and their impact on model accuracy.

Regression: Linear Models

Introduces linear regression, generalized linear models, and mixed-effect models for regression analysis.

Introduction to Machine Learning: Supervised Learning

Introduces supervised learning, covering classification, regression, model optimization, overfitting, and kernel methods.

Multilayer Neural Networks: Deep Learning

Covers the fundamentals of multilayer neural networks and deep learning.

Machine Learning Review

Covers a review of machine learning concepts, including supervised learning, classification vs regression, linear models, kernel functions, support vector machines, dimensionality reduction, deep generative models, and cross-validation.

Machine Learning Fundamentals

Introduces fundamental machine learning concepts, covering regression, classification, dimensionality reduction, and deep generative models.

Introduction to Machine Learning: Linear Models

Introduces linear models for supervised learning, covering overfitting, regularization, and kernels, with applications in machine learning tasks.

Linear Models for Classification

Explores linear models for classification, including parametric models, regression, and logistic regression, along with model evaluation metrics and maximum margin classifiers.

Deep Learning: Data Representations and Neural Networks

Covers data representations, Bag of Words, histograms, data pre-processing, and neural networks.

Model Checking and Residuals

Explores model checking and residuals in regression analysis, emphasizing the importance of diagnostics for ensuring model validity.

Convolutional Neural Networks

Covers Convolutional Neural Networks, including layers, training strategies, standard architectures, tasks like semantic segmentation, and deep learning tricks.

Deep Learning for Autonomous Vehicles: Learning

Explores learning in deep learning for autonomous vehicles, covering predictive models, RNN, ImageNet, and transfer learning.

Neural Tangent Kernel: Generalization in Deep Learning

Explores the neural tangent kernel in deep learning, analyzing generalization and network behavior.

Linear Models: LASSO and AMP

Covers linear problems, LASSO, and AMP in supervised learning, including Generalized Linear Models and N-dimensional models.

Deep Learning: Multilayer Perceptron and Training

Covers deep learning fundamentals, focusing on multilayer perceptrons and their training processes.

Splines and Machine Learning

Explores supervised learning as an ill-posed problem and the integration of sparse adaptive splines into neural architectures.