Lecture

The Problem of Overfitting

Graph Chat

Chat with Graph Search

Ask any question about EPFL courses, lectures, exercises, research, news, etc. or try the example questions below.

DISCLAIMER: The Graph Chatbot is not programmed to provide explicit or categorical answers to your questions. Rather, it transforms your questions into API requests that are distributed across the various IT services officially administered by EPFL. Its purpose is solely to collect and recommend relevant references to content that you can explore to help you answer your questions.

Related lectures (64)

Neural Networks: Multi-layers

Explains the learning process in multi-layer neural networks, including back-propagation, activation functions, weights update, and error backpropagation.

Deep Learning Fundamentals

Introduces deep learning, from logistic regression to neural networks, emphasizing the need for handling non-linearly separable data.

Landscape and Generalisation in Deep Learning

Explores the challenges and insights of deep learning, focusing on loss landscape, generalization, and feature learning.

Introduction to Machine Learning: Supervised Learning

Introduces supervised learning, covering classification, regression, model optimization, overfitting, and kernel methods.

Understanding Deep Learning

Explores deep learning fundamentals, including image classification, neural network working principles, and machine learning challenges.

Neural Networks: Perceptron Model and Backpropagation Algorithm

Covers the perceptron model and backpropagation algorithm in neural networks.

Machine Learning Fundamentals: Regularization and Cross-validation

Explores overfitting, regularization, and cross-validation in machine learning, emphasizing the importance of feature expansion and kernel methods.

Optimization in Machine Learning

Explores optimization techniques, word embeddings, and recommendation systems in machine learning.

Generalization in Deep Learning

Delves into the trade-off between model complexity and risk, generalization bounds, and the dangers of overfitting complex function classes.

Linear Regression and Logistic Regression

Covers linear and logistic regression for regression and classification tasks, focusing on loss functions and model training.

Automatic Differentiation: BackProp revisited

Discusses automatic differentiation, emphasizing reverse mode differentiation for optimizing convolutional layer filters by gradient descent.

Regularization by Early Stopping

Explores regularization by early stopping in deep neural networks to control flexibility and avoid overfitting.

Comparing L1 and L0 + Greedy algorithms

Compares L1 and L0 penalization in linear regression with orthogonal designs using greedy algorithms and empirical comparisons.

Deep Learning Building Blocks

Covers tensors, loss functions, autograd, and convolutional layers in deep learning.

Regularization in Machine Learning

Explores Ridge and Lasso Regression for regularization in machine learning models, emphasizing hyperparameter tuning and visualization of parameter coefficients.

Neural Networks: Multilayer Learning

Covers the fundamentals of multilayer neural networks and deep learning, including back-propagation and network architectures like LeNet, AlexNet, and VGG-16.

Bayesian Statistics: Regularization and Divergence

Covers Kullback-Leibler divergence, regularization, and Bayesian statistics to combat overfitting in machine learning models.

Deep Learning: Convolutional Networks

Explores convolutional neural networks, backpropagation, and stochastic gradient descent in deep learning.

Logistic Regression: Probability Modeling and Optimization

Explores logistic regression for binary classification, covering probability modeling, optimization methods, and regularization techniques.

Introduction to Machine Learning: Linear Models

Introduces linear models for supervised learning, covering overfitting, regularization, and kernels, with applications in machine learning tasks.