Lecture

Machine Learning Applications: Regression and Classification

Graph Chat

Chat with Graph Search

Ask any question about EPFL courses, lectures, exercises, research, news, etc. or try the example questions below.

DISCLAIMER: The Graph Chatbot is not programmed to provide explicit or categorical answers to your questions. Rather, it transforms your questions into API requests that are distributed across the various IT services officially administered by EPFL. Its purpose is solely to collect and recommend relevant references to content that you can explore to help you answer your questions.

In course

PHYS-754: Lecture series on scientific machine learning

This lecture presents ongoing work on how scientific questions can be tackled using machine learning. Machine learning enables extracting knowledge from data computationally and in an automatized way. We will learn on examples how this is influencing the v ...

Description

This lecture delves into machine learning applications in the modeling of materials and molecules, focusing on regression and classification tasks. The instructor discusses predicting atomization energies based on geometry, using large datasets and advanced theories like couple cluster theory. The lecture also covers the application of SVM for classifying molecules as active or inactive based on their proximity to receptors, showcasing the importance of feature selection and symmetry adaptation in building accurate models.

Instructors (10)

Anne-Clémence Corminboeuf

Teaching & PhD PhD Students Liam Oliver Marsh, Pratham Pushparaj Deshmukh, Roel Christiaan M Raike, Thanapat Worakul, Osvaldo Hernandez Cuellar, Juliette Veronique Schleicher, Yannick Calvino Alonso, Sara Bassetta, Yuri Cho, Kelian Dietmar Marc Gaedecke, Guoyuan Liu Past EPFL PhD Students Fabrice Avaltroni, Daniel Filipe Jana, Stephan Niklaus Steinmann, Jérôme Florian Gonthier, Riccardo Petraglia, Antonio Prlj, Laurent Alexis Clément Vannay, Alberto Fabrizio, Kun-Han Lin, Boodsarin Sawatlon, Raimon Fabreg

Philippe Schwaller

Michele Ceriotti

Michele Ceriotti received his Ph.D. in Physics from ETH Zürich in 2010. He spent three years in Oxford as a Junior Research Fellow at Merton College. Since 2013 he leads the laboratory for Computational Science and Modeling in the Institute of Materials at EPFL. His research revolves around the atomic-scale modelling of materials, based on the sampling of quantum and thermal fluctuations and on the use of machine learning to predict and rationalize structure-property relations. He has been awarded the IBM Research Forschungspreis in 2010, the Volker Heine Young Investigator Award in 2013, an ERC Starting Grant in 2016, and the IUPAP C10 Young Scientist Prize in 2018.

David Richard Harvey

Expertise CosmologyDark MatterGalaxy ClustersStrong Gravitational LensingWeak Gravitational Lensing I am an observational and theoretical astrophysicist at EPFL. My main area of research is dark matter and trying to understand its properties and dynamics. I love to use deep learning in my work and understand how fondation models and generative AI can help us understand the Universe. I am a member of Euclid and ARRAKIHS and the lead of the self interacting dark matter Key Project in Euclid. Outside of my r

Matthieu Wyart

Teaching & PhD Past EPFL PhD Students Riccardo Ravasio, Mario Geiger, Wencheng Ji, Leonardo Petrini, Umberto Maria Tomasini, Alessandro Favero Courses Systèmes complexes PHYS-343 This courses show how known (entropy, phase transitions) and new (glasses, percolation, avalanche-type response) physical concepts can be used in various fields (including Computer science, neuroscience, social sciences).

Official source

Related concepts (18)

Linear regression

In statistics, linear regression is a linear approach for modelling the relationship between a scalar response and one or more explanatory variables (also known as dependent and independent variables). The case of one explanatory variable is called simple linear regression; for more than one, the process is called multiple linear regression. This term is distinct from multivariate linear regression, where multiple correlated dependent variables are predicted, rather than a single scalar variable.

Segmented regression

Segmented regression, also known as piecewise regression or broken-stick regression, is a method in regression analysis in which the independent variable is partitioned into intervals and a separate line segment is fit to each interval. Segmented regression analysis can also be performed on multivariate data by partitioning the various independent variables. Segmented regression is useful when the independent variables, clustered into different groups, exhibit different relationships between the variables in these regions.

Regression analysis

In statistical modeling, regression analysis is a set of statistical processes for estimating the relationships between a dependent variable (often called the 'outcome' or 'response' variable, or a 'label' in machine learning parlance) and one or more independent variables (often called 'predictors', 'covariates', 'explanatory variables' or 'features'). The most common form of regression analysis is linear regression, in which one finds the line (or a more complex linear combination) that most closely fits the data according to a specific mathematical criterion.

Nonlinear regression

In statistics, nonlinear regression is a form of regression analysis in which observational data are modeled by a function which is a nonlinear combination of the model parameters and depends on one or more independent variables. The data are fitted by a method of successive approximations. In nonlinear regression, a statistical model of the form, relates a vector of independent variables, , and its associated observed dependent variables, . The function is nonlinear in the components of the vector of parameters , but otherwise arbitrary.

Deming regression

In statistics, Deming regression, named after W. Edwards Deming, is an errors-in-variables model which tries to find the line of best fit for a two-dimensional dataset. It differs from the simple linear regression in that it accounts for errors in observations on both the x- and the y- axis. It is a special case of total least squares, which allows for any number of predictors and a more complicated error structure.

Related lectures (42)

Decision Trees and Random Forests: Concepts and Applications

Discusses decision trees and random forests, focusing on their structure, optimization, and application in regression and classification tasks.

Nonlinear Machine Learning: k-Nearest Neighbors and Feature Expansion

Covers the transition from linear to nonlinear models, focusing on k-NN and feature expansion techniques.

Machine Learning Fundamentals: Structure Discovery, Classification, Regression

Covers fundamental machine learning concepts including Structure Discovery, Classification, and Regression.

Landscape and Generalisation in Deep Learning

Explores the challenges and insights of deep learning, focusing on loss landscape, generalization, and feature learning.

Linear Regression: Statistical Inference and Regularization