Mediaspace scheduled maintenance: Aug 25, 2026 07:00 - 12:00 AM. During this time, videos will be temporarily unavailable. Check status updates.

Lecture

Learning Sparse Features: Overfitting in Neural Networks

Related lectures (39)

Neural Networks

Explores neural networks, hidden layers, weight adjustments, activation functions, and the universal approximation theorem.

Neural Networks: Training and Activation

Explores neural networks, activation functions, backpropagation, and PyTorch implementation.

Perception: Data-Driven Approaches

Explores perception in deep learning for autonomous vehicles, covering image classification, optimization methods, and the role of representation in machine learning.

Landscape and Generalisation in Deep Learning

Explores the challenges and insights of deep learning, focusing on loss landscape, generalization, and feature learning.

Gradient-Based Algorithms in High-Dimensional Learning

Provides insights on gradient-based algorithms, deep learning mysteries, and the challenges of non-convex problems.

Deep Learning: Overparameterization and Generalization

Explores overparameterization, generalization, overfitting, underfitting, and implicit regularization in deep learning models.

Convolutional Neural Networks

Covers Convolutional Neural Networks, including layers, training strategies, standard architectures, tasks like semantic segmentation, and deep learning tricks.

Nonlinear Supervised Learning

Explores the inductive bias of different nonlinear supervised learning methods and the challenges of hyper-parameter tuning.

Dimensionality Reduction: PCA and Autoencoders

Introduces artificial neural networks, CNNs, and dimensionality reduction using PCA and autoencoders.

Evaluating Machine Accuracy and Robustness on ImageNet

Explores the evaluation of machine and human accuracy and robustness on ImageNet, highlighting progress, challenges, and the need for improvement.

Neural Networks: Two Layers Neural Network

Covers the basics of neural networks, focusing on the development from two layers neural networks to deep neural networks.

Learning with Deep Neural Networks

Explores the success and challenges of deep learning, including overfitting, generalization, and the impact on various domains.

Machine Learning Fundamentals

Introduces the basics of machine learning, covering supervised classification, logistic regression, and maximizing the margin.

Understanding Deep Learning

Explores deep learning fundamentals, including image classification, neural network working principles, and machine learning challenges.

Deep Splines: Unifying Framework for Deep Neural Networks

Introduces a functional framework for deep neural networks with adaptive piecewise-linear splines, focusing on biomedical image reconstruction and the challenges of deep splines.

Optimization in Machine Learning: Gradient Descent

Covers optimization in machine learning, focusing on gradient descent for linear and logistic regression, stochastic gradient descent, and practical considerations.

Statistical Physics of Learning

Offers insights into the statistical physics of learning, exploring the relationship between neural network structure and disordered systems.

Deep Neural Networks: Training and Optimization

Explores deep neural network training, optimization, preventing overfitting, and different network architectures.

Statistical Learning: Fundamentals Log in to Mediaspace to watch this video

Introduces the fundamentals of statistical learning, covering supervised learning, decision theory, risk minimization, and overfitting.

Machine Learning for Feature Extraction Log in to Mediaspace to watch this video

Explores machine learning for feature extraction, 3D vision, and neural networks in mobile robotics.