Lecture

Gradient Descent: MNIST Dataset and Logistic Loss

Graph Chat

Chat with Graph Search

Ask any question about EPFL courses, lectures, exercises, research, news, etc. or try the example questions below.

DISCLAIMER: The Graph Chatbot is not programmed to provide explicit or categorical answers to your questions. Rather, it transforms your questions into API requests that are distributed across the various IT services officially administered by EPFL. Its purpose is solely to collect and recommend relevant references to content that you can explore to help you answer your questions.

Related lectures (64)

Stochastic Gradient Descent: Non-convex Optimization Techniques

Discusses Stochastic Gradient Descent and its application in non-convex optimization, focusing on convergence rates and challenges in machine learning.

Logistic Regression: Interpretation & Feature Engineering

Covers logistic regression, probabilistic interpretation, and feature engineering techniques.

Linear Regression: Basics

Covers the basics of linear regression, binary and multi-class classification, and evaluation metrics.

Regularized Cross-Entropy Risk

Explores the regularized cross-entropy risk in neural networks, covering training processes and challenges in deep networks.

Linear Models for Classification: Part 3

Explores linear models for classification, including binary classification, logistic regression, decision boundaries, and support vector machines.

Machine Learning Review

Covers a review of machine learning concepts, including supervised learning, classification vs regression, linear models, kernel functions, support vector machines, dimensionality reduction, deep generative models, and cross-validation.

Generalized Linear Regression: Classification

Explores Generalized Linear Regression, Classification, confusion matrices, ROC curves, and noise in data.

Machine Learning Fundamentals

Introduces machine learning basics, performance metrics, optimization techniques, and model evaluation.

Deep Learning Fundamentals

Introduces deep learning fundamentals, covering data representations, neural networks, and convolutional neural networks.

Linear Regression: Basics and Applications

Covers the basics of linear regression, including 1D regression, derivatives, gradients, and applications in machine learning.

Link Prediction: Missing Edges and Probabilistic Methods

Explores link prediction in networks, covering missing edges, probabilistic methods, and causal inference challenges.

Optimality of Convergence Rates: Accelerated/Stochastic Gradient Descent

Covers the optimality of convergence rates in accelerated and stochastic gradient descent methods for non-convex optimization problems.

Linear Classification Models: From Binary to Multiclass

Explores the extension of linear classifiers to handle multiclass problems and compares their performance on various datasets.

Nearest Neighbor Rules: Part 2

Explores the Nearest Neighbor Rules, k-NN algorithm challenges, Bayes classifier, and k-means algorithm for clustering.

Deep Learning: Convolutional Networks

Explores convolutional neural networks, backpropagation, and stochastic gradient descent in deep learning.

Machine Learning Fundamentals

Introduces the basics of machine learning, covering supervised classification, logistic regression, and maximizing the margin.

Linear Binary Classification

Covers the extension of the 0-1 loss to real-valued score functions and logistic regression.

Linear Models for Classification

Explores linear models for classification, including parametric models, regression, and logistic regression, along with model evaluation metrics and maximum margin classifiers.

Decision and regression trees

Explores decision and regression trees, impurity measures, learning algorithms, and implementations, including conditional inference trees and tree pruning.

Gaussian Naive Bayes & K-NN

Covers Gaussian Naive Bayes, K-nearest neighbors, and hyperparameter tuning in machine learning.