Mediaspace scheduled maintenance: Aug 25, 2026 07:00 - 12:00 AM. During this time, videos will be temporarily unavailable. Check status updates.

Home

Lecture

Adaptive Gradient Methods: Theory and Applications

About
Privacy
Disclaimer

Graph Chatbot

Related lectures (40)

Understanding Generalization: Implicit Bias & Optimization

Explores the trade-off between complexity and risk in machine learning models, the benefits of overparametrization, and the implicit bias of optimization algorithms.

Feed-forward Networks Log in to Mediaspace to watch this video

Introduces feed-forward networks, covering neural network structure, training, activation functions, and optimization, with applications in forecasting and finance.

Neural Networks: Training and Optimization Log in to Mediaspace to watch this video

Explores the training and optimization of neural networks, addressing challenges like non-convex loss functions and local minima.

Neural Networks: Regression and Classification Log in to Mediaspace to watch this video

Explores neural networks for regression and classification tasks, covering training, regularization, and practical examples.

Convolutional Neural Networks: Fundamentals Log in to Mediaspace to watch this video

Covers the basics of Convolutional Neural Networks, including training optimization, layer structure, and potential pitfalls of summary statistics.

Gradient Descent: Optimization Techniques Log in to Mediaspace to watch this video

Explores gradient descent, loss functions, and optimization techniques in neural network training.

Deep Learning Log in to Mediaspace to watch this video

Covers the fundamentals of deep learning, including data representations, bag of words, data pre-processing, artificial neural networks, and convolutional neural networks.

Deep Learning Fundamentals Log in to Mediaspace to watch this video

Introduces deep learning fundamentals, covering data representations, neural networks, and convolutional neural networks.

Neural Networks: Basics and Applications Log in to Mediaspace to watch this video

Explores neural networks basics, XOR problem, classification, and practical applications like weather data prediction.

SGD and Mean Field Analysis Log in to Mediaspace to watch this video

Explores Stochastic Gradient Descent and Mean Field Analysis in two-layer neural networks, emphasizing their iterative processes and mathematical foundations.

Deep Learning: Data Representations and Neural Networks Log in to Mediaspace to watch this video

Covers data representations, Bag of Words, histograms, data pre-processing, and neural networks.

Resource-Efficient DBMS: Incremental Query Processing Log in to Mediaspace to watch this video

Explores challenges in data growth for advertisers and introduces Crocodile DB for resource-efficient query processing.

Optimization Algorithms Log in to Mediaspace to watch this video

Covers optimization algorithms, convergence properties, and time complexity of sequences and functions.

Optical Computing: All-Analog Photoelectronic Chip for Vision Tasks Log in to Mediaspace to watch this video

Presents an all-analog photoelectronic chip for high-speed vision tasks, addressing challenges in classical computation and proposing a hybrid optical-electrical framework.

Neural System Organization Log in to Mediaspace to watch this video

Explores the organization of the nervous system, including neuron structure, synapses, neurotransmitters, and neural circuits.

Feedback Mechanisms in Visual Intelligence and Adaptation Log in to Mediaspace to watch this video

Explores the significance of feedback mechanisms in visual intelligence and adaptation processes.

Model Complexity and Overfitting in Machine Learning Log in to Mediaspace to watch this video

Covers model complexity, overfitting, and strategies to select appropriate machine learning models.

Conjugate Functions: Dual Programs Log in to Mediaspace to watch this video

Explores conjugate functions, dual programs, rescaling, convex programs, and optimization domains.

Kernel Methods: SVM and Regression Log in to Mediaspace to watch this video

Introduces kernel methods like SVM and regression, covering concepts such as margin, support vector machine, curse of dimensionality, and Gaussian process regression.

Pre-Training: BiLSTM and Transformer Log in to Mediaspace to watch this video

Delves into pre-training BiLSTM and Transformer models for NLP tasks, showcasing their effectiveness and applications.

Page 2 of 2