Mediaspace scheduled maintenance: Aug 25, 2026 07:00 - 12:00 AM. During this time, videos will be temporarily unavailable. Check status updates.

Lecture

Generalization in Deep Learning

Related lectures (59)

Explores generalization in deep learning, covering model complexity, implicit bias, and the double descent phenomenon.

Double Descent Curves: Overparametrization

Explores double descent curves and overparametrization in machine learning models, highlighting the risks and benefits.

Neural Networks: Training and Activation

Explores neural networks, activation functions, backpropagation, and PyTorch implementation.

Complexity: Approximation-Estimation Trade-off

Explores the control of complexity in hypothesis spaces and the trade-off between approximation and estimation in risk decomposition.

Multilayer Neural Networks: Deep Learning

Covers the fundamentals of multilayer neural networks and deep learning.

Neural Networks Optimization

Explores neural networks optimization, including backpropagation, batch normalization, weight initialization, and hyperparameter search strategies.

Gradient-Based Algorithms in High-Dimensional Learning

Provides insights on gradient-based algorithms, deep learning mysteries, and the challenges of non-convex problems.

Adaptive Gradient Methods: Theory and Applications

Explores adaptive gradient methods, their properties, convergence, and comparison with traditional optimization algorithms.

Nonlinear ML Algorithms

Introduces nonlinear ML algorithms, covering nearest neighbor, k-NN, polynomial curve fitting, model complexity, overfitting, and regularization.

Deep Learning Paradigm

Explores the deep learning paradigm, including challenges, neural networks, robustness, fairness, interpretability, and energy efficiency.

Deep Learning: Theory and Practice

By Prof. Volkan Cevher delves into the mathematics of deep learning, exploring model complexity, risk trade-offs, and the generalization mystery.

Conclusions on Statistical Learning Theory

Explores conclusions from statistical learning theory, emphasizing function complexity, generalization, and the bias-variance trade-off.

Convolutional Neural Networks

Introduces Convolutional Neural Networks (CNNs) for autonomous vehicles, covering architecture, applications, and regularization techniques.

No Free Lunch Theorem: Deep Learning

Explores the No Free Lunch Theorem and how deep networks match real-world problem structures.

Perception: Data-Driven Approaches

Explores perception in deep learning for autonomous vehicles, covering image classification, optimization methods, and the role of representation in machine learning.

Structures in Non-Convex Optimization

Covers non-convex optimization, deep learning training problems, stochastic gradient descent, adaptive methods, and neural network architectures.

Deep Neural Networks: Training and Optimization

Explores deep neural network training, optimization, preventing overfitting, and different network architectures.

Deep Learning: Theory and Applications

Explores the mathematics of deep learning, neural networks, and their applications in computer vision tasks, addressing challenges and the need for robustness.

Deep Learning: Overparameterization and Generalization

Explores overparameterization, generalization, overfitting, underfitting, and implicit regularization in deep learning models.

Generalization Theory

Explores generalization theory in machine learning, addressing challenges in higher-dimensional spaces and the bias-variance tradeoff.