Mediaspace scheduled maintenance: Aug 25, 2026 07:00 - 12:00 AM. During this time, videos will be temporarily unavailable. Check status updates.

Concept

Learning rate

Related lectures (31)

Adaptive Gradient Methods: Part 1

Explores adaptive gradient methods and their impact on optimization scenarios, including AdaGrad, ADAM, and RMSprop.

Neural Networks: Training and Activation

Explores neural networks, activation functions, backpropagation, and PyTorch implementation.

Deep Learning for Autonomous Vehicles: Learning

Explores learning in deep learning for autonomous vehicles, covering predictive models, RNN, ImageNet, and transfer learning.

Bimanual Coordination and Hand Dexterity

Explores bimanual coordination, hand dexterity, and learning rates in novel tasks.

Multilayer Perceptron: Training and Optimization

Explores the multilayer perceptron model, training, optimization, data preprocessing, activation functions, backpropagation, and regularization.

Generative Models: Trajectory Forecasting

Explores generative models for trajectory forecasting in autonomous vehicles, including discriminative vs generative models, VAES, GANS, and case studies.

Optimizing Adaptive Gradient Methods

Explores advanced optimization techniques for machine learning models, focusing on adaptive gradient methods and their applications in non-convex optimization problems.

Neural Networks Optimization

Explores neural networks optimization, including backpropagation, batch normalization, weight initialization, and hyperparameter search strategies.

Deep Learning for Autonomous Vehicles: Predictive Models

Explores predictive models and trackers for autonomous vehicles, covering object detection, tracking challenges, neural network-based tracking, and 3D pedestrian localization.

Gradient Descent

Covers the concept of gradient descent in scalar cases, focusing on finding the minimum of a function by iteratively moving in the direction of the negative gradient.

Gradient Descent

Covers the algorithm of gradient descent, aiming to minimize a function by iteratively moving in the direction of the steepest decrease.

Adaptive Optimization Methods: Theory and Applications

Explores adaptive optimization methods that adapt locally and converge without knowing the smoothness constant.

Neural Networks: Regularization & Optimization

Explores neural network regularization, optimization, and practical implementation tips.

Gradient Descent and Linear Regression

Covers stochastic gradient descent, linear regression, regularization, supervised learning, and the iterative nature of gradient descent.

Adaptive Gradient Methods

Explores adaptive gradient methods like AdaGrad, AcceleGrad, and UniXGrad, focusing on their local adaptation and convergence rates.

Threat Modeling: Adversarial Examples and Backdoors

Covers threat modeling in deep learning for autonomous vehicles, focusing on defending against adversarial examples and backdoors.

Relation of SARSA and Bellman equation

Explores the relation between fluctuating Q-values in SARSA and the Bellman equation through expectations and policy constancy.

Convolutional Neural Networks

Introduces Convolutional Neural Networks (CNNs) for autonomous vehicles, covering architecture, applications, and regularization techniques.

Structures in Non-Convex Optimization

Explores non-convex optimization in deep learning, covering critical points, SGD convergence, saddle points, and adaptive gradient methods.

Gradient Descent: Principles and Applications

Covers gradient descent, its principles, applications, and convergence rates in optimization for machine learning.