Lecture

Structures in Non-Convex Optimization

Graph Chat

Chat with Graph Search

Ask any question about EPFL courses, lectures, exercises, research, news, etc. or try the example questions below.

DISCLAIMER: The Graph Chatbot is not programmed to provide explicit or categorical answers to your questions. Rather, it transforms your questions into API requests that are distributed across the various IT services officially administered by EPFL. Its purpose is solely to collect and recommend relevant references to content that you can explore to help you answer your questions.

Related lectures (64)

Deep and Convolutional Networks: Generalization and Optimization

Explores deep and convolutional networks, covering generalization, optimization, and practical applications in machine learning.

Introduction to Proximal Operators

Introduces proximal operators and conditional gradient methods for composite convex minimization problems in data optimization.

Deep Learning

Covers the fundamentals of deep learning, including data representations, bag of words, data pre-processing, artificial neural networks, and convolutional neural networks.

Optimization Methods: RMSprop and ADAM

Explores RMSprop and ADAM optimization methods in Artificial Neural Networks, focusing on error functions, momentum, and signal-to-noise ratio.

Stochastic Gradient Descent: Non-convex Optimization Techniques

Discusses Stochastic Gradient Descent and its application in non-convex optimization, focusing on convergence rates and challenges in machine learning.

Subgradients and Convex Functions

Explores subgradients in convex functions, emphasizing non-differentiable yet convex scenarios and properties of subdifferentials.

Deep Learning: Data Representations and Neural Networks

Covers data representations, Bag of Words, histograms, data pre-processing, and neural networks.

Primal-dual Optimization: Extra-Gradient Method

Explores the Extra-Gradient Method for primal-dual optimization in min-max problems and its convergence properties.

Deep Learning: Convolutional Neural Networks

Introduces Convolutional Neural Networks, explaining their architecture, training process, and applications in semantic segmentation tasks.

Convolutional Neural Networks

Covers convolutional neural networks, filter operations, and their applications in signal processing and image analysis.

Adaptive Gradient Methods: Theory and Applications

Explores adaptive gradient methods, their properties, convergence, and comparison with traditional optimization algorithms.

Deep Knowledge Tracing

Explores Deep Knowledge Tracing and its application in predicting student learning outcomes using neural networks and loss functions.

Deep Learning III

Delves into deep learning optimization, challenges, SGD variants, critical points, overparametrized networks, and adaptive methods.

Trust Region Methods: Why, with an Example

Introduces trust region methods and presents an example of Max-Cut Burer-Monteiro rank 2 optimization.

Deep Learning Fundamentals

Introduces deep learning fundamentals, covering data representations, neural networks, and convolutional neural networks.

Introduction to Reinforcement Learning: Key Concepts and Applications

Introduces reinforcement learning, covering its definitions, applications, and theoretical foundations, while outlining the course structure and objectives.

Neural Networks: Training and Activation

Explores neural networks, activation functions, backpropagation, and PyTorch implementation.

Nonlinear Programming: Part I

Covers the fundamentals of Nonlinear Programming and its applications in Optimal Control, exploring techniques, examples, optimality definitions, and necessary conditions.

Deep Learning Building Blocks

Covers tensors, loss functions, autograd, and convolutional layers in deep learning.

Language Models: From Theory to Computation

Explores the mathematics of language models, covering architecture design, pre-training, and fine-tuning, emphasizing the importance of pre-training and fine-tuning for various tasks.