Lecture

Neural Networks: Regularization & Optimization

Graph Chat

Chat with Graph Search

Ask any question about EPFL courses, lectures, exercises, research, news, etc. or try the example questions below.

DISCLAIMER: The Graph Chatbot is not programmed to provide explicit or categorical answers to your questions. Rather, it transforms your questions into API requests that are distributed across the various IT services officially administered by EPFL. Its purpose is solely to collect and recommend relevant references to content that you can explore to help you answer your questions.

Related lectures (64)

Regularization by Early Stopping

Explores regularization by early stopping in deep neural networks to control flexibility and avoid overfitting.

Logistic Regression: Vegetation Prediction

Explores logistic regression for predicting vegetation proportions in the Amazon region through remote sensing data analysis.

Deep Learning Fundamentals

Introduces deep learning, from logistic regression to neural networks, emphasizing the need for handling non-linearly separable data.

Non conceptual knowledge systems

Explores the impact of Deep learning on Digital Humanities, focusing on non conceptual knowledge systems and recent advancements in AI.

Neural Networks Recap: Activation Functions

Covers the basics of neural networks, activation functions, training, image processing, CNNs, regularization, and dimensionality reduction methods.

Machine Learning: Features and Model Selection

Delves into the significance of features, model evolution, labeling challenges, and model selection in machine learning.

Generalized Linear Regression

Explores generalized linear regression, logistic regression, and multiclass classification in machine learning.

Neural Networks: Perceptron

Covers the main concepts of neural networks, including the Perceptron model and training algorithms.

Neural Networks: Multilayer Learning

Covers the fundamentals of multilayer neural networks and deep learning, including back-propagation and network architectures like LeNet, AlexNet, and VGG-16.

Deep Knowledge Tracing

Explores Deep Knowledge Tracing and its application in predicting student learning outcomes using neural networks and loss functions.

Nonlinear ML Algorithms

Introduces nonlinear ML algorithms, covering nearest neighbor, k-NN, polynomial curve fitting, model complexity, overfitting, and regularization.

Unsupervised Learning: Clustering & Dimensionality Reduction

Introduces unsupervised learning through clustering with K-means and dimensionality reduction using PCA, along with practical examples.

Overfitting, Cross-validation & Regularization

Explores model complexity, overfitting, and the role of cross-validation and regularization in machine learning.

Deep and Robust Reinforcement Learning Techniques

Discusses advanced reinforcement learning techniques, focusing on deep and robust methods, including actor-critic frameworks and adversarial learning strategies.

Adaptive Gradient Methods: Theory and Applications

Explores adaptive gradient methods, their properties, convergence, and comparison with traditional optimization algorithms.

Optimization Methods: RMSprop and ADAM

Explores RMSprop and ADAM optimization methods in Artificial Neural Networks, focusing on error functions, momentum, and signal-to-noise ratio.

Convolutional Neural Networks: Structure & Regularization

Explores Convolutional Neural Networks, data augmentation, weight decay, and dropout for enhancing model performance.

Medical Image Reconstruction: From Model-Based to Data-Driven

Explores the evolution of medical image reconstruction techniques, from classical methods to data-driven approaches using deep neural networks.

Convolutional Neural Networks

Covers Convolutional Neural Networks, including layers, training strategies, standard architectures, tasks like semantic segmentation, and deep learning tricks.

Batch Normalization: Why It Works

Explores the aim and process of batch normalization in deep neural networks, emphasizing its importance in stabilizing mean input and solving the vanishing gradient problem.