Concept

AdaBoost

AdaBoost, short for Adaptive Boosting, is a statistical classification meta-algorithm formulated by Yoav Freund and Robert Schapire in 1995, who won the 2003 Gödel Prize for their work. It can be used in conjunction with many other types of learning algorithms to improve performance. The output of the other learning algorithms ('weak learners') is combined into a weighted sum that represents the final output of the boosted classifier. Usually, AdaBoost is presented for binary classification, although it can be generalized to multiple classes or bounded intervals on the real line. AdaBoost is adaptive in the sense that subsequent weak learners are tweaked in favor of those instances misclassified by previous classifiers. In some problems it can be less susceptible to the overfitting problem than other learning algorithms. The individual learners can be weak, but as long as the performance of each one is slightly better than random guessing, the final model can be proven to converge to a strong learner. Although AdaBoost is typically used to combine weak base learners (such as decision stumps), it has been shown that it can also effectively combine strong base learners (such as deep decision trees), producing an even more accurate model. Every learning algorithm tends to suit some problem types better than others, and typically has many different parameters and configurations to adjust before it achieves optimal performance on a dataset. AdaBoost (with decision trees as the weak learners) is often referred to as the best out-of-the-box classifier. When used with decision tree learning, information gathered at each stage of the AdaBoost algorithm about the relative 'hardness' of each training sample is fed into the tree growing algorithm such that later trees tend to focus on harder-to-classify examples. AdaBoost refers to a particular method of training a boosted classifier. A boosted classifier is a classifier of the form where each is a weak learner that takes an object as input and returns a value indicating the class of the object.

Official source

https://en.wikipedia.org/wiki/AdaBoost

About this result

This page is automatically generated and may contain information that is not correct, complete, up-to-date, or relevant to your search query. The same applies to every other page on this website. Please make sure to verify the information with EPFL's official sources.

Related courses (14)

CS-401: Applied data analysis

This course teaches the basic techniques, methodologies, and practical skills required to draw meaningful insights from a variety of data, with the help of the most acclaimed software tools in the data science world (pandas, scikit-learn, Spark, etc.) ...

MICRO-455: Machine learning I

Real-world engineering applications must cope with a large dataset of dynamic variables, which cannot be well approximated by classical or deterministic models. This course gives an overview of methods from Machine Learning for the analysis of non-linear, highly noisy and multi dimensional data

ENG-209: Data science for engineers with Python

Ce cours propose une immersion progressive et complète dans le domaine de la Data Science à travers le langage Python. Il guide les étudiants depuis la manipulation de données brutes jusqu'à la modélisation et l'extraction de connaissances utiles à partir ...

Related lectures (30)

Adaboost: Boosting Methods

Explains Adaboost algorithm for building strong classifiers from weak ones, with a focus on boosting methods and face detection.

Structured Classifications: Decision Trees and Boosting

Explores decision trees, overfitting elimination, boosting techniques, and their practical applications in predictive modeling.

Decision Trees and Boosting

Explores decision trees in machine learning, their flexibility, impurity criteria, and introduces boosting methods like Adaboost.

Related units (8)

IEL - Administration

Computer Vision Laboratory

Signal Processing Laboratory 5

Graph Chat

Chat with Graph Search

Ask any question about EPFL courses, lectures, exercises, research, news, etc. or try the example questions below.

DISCLAIMER: The Graph Chatbot is not programmed to provide explicit or categorical answers to your questions. Rather, it transforms your questions into API requests that are distributed across the various IT services officially administered by EPFL. Its purpose is solely to collect and recommend relevant references to content that you can explore to help you answer your questions.

Official source

https://en.wikipedia.org/wiki/AdaBoost

About this result

Related courses (14)

CS-401: Applied data analysis

MICRO-455: Machine learning I

ENG-209: Data science for engineers with Python

Related lectures (30)

Adaboost: Boosting Methods

Explains Adaboost algorithm for building strong classifiers from weak ones, with a focus on boosting methods and face detection.

Structured Classifications: Decision Trees and Boosting

Explores decision trees, overfitting elimination, boosting techniques, and their practical applications in predictive modeling.

Decision Trees and Boosting

Explores decision trees in machine learning, their flexibility, impurity criteria, and introduces boosting methods like Adaboost.

Related publications (25)

A Data-Driven Approach to Modelling a Global Distribution of Ice Nucleating Particles

Abstract. Ice nucleating particles (INPs) are rare aerosols essential for cloud ice formation in the mixed-phase temperature range between -38 °C and 0 °C. Due to measurement challenges and limitations in instrument capabilities, the availability of atmospheric observations of INPs remains scarce in time and space. Consequently, no observation-based global distribution of INPs exists so far. This study applies a machine learning (gradient boosting) algorithm to predict the INP concentration over the mixed-p

Copernicus GmbH2026

Hyperlocal Weather Forecasting by Machine Learning: Findings, Results and Conclusions of the IEEE Region 8 Competition

Motivated by the need for climate-change resilience, this paper summarizes the results of an international hackathonstyle competition aimed at improving local weather forecasts using machine-learning post-processing of multiple forecast sources and historical data. The approaches and results of the top teams are presented and compared, including support vector regression (SVR), gradient boosting, k-nearest neighbors (KNN), long short-term memory (LSTM) networks, and transformerbased architectures. Each appr

Institute of Electrical and Electronics Engineers (IEEE)2026

Incremental update framework for multi-source low-carbon concrete prediction based on conditional tabular generative adversarial network, adaptive weighting, and experience replay

The introduction of new experimental data causes computational loss and reduces robustness of the concrete performance prediction model. To solve the mentioned problems caused by repeatedly tuning parameters and model retraining, this paper proposed an incremental update framework for multi-source low-carbon concrete datasets, integrating a Bayesian-optimization-based conditional tabular generative adversarial network (BO-CTGAN), a stacking ensemble model, adaptive weighting, and an experience replay mechan

Elsevier2026

Related people (32)

Touradj Ebrahimi

Touradj EBRAHIMI received his M.Sc. and Ph.D., both in Electrical Engineering, from the Swiss Federal Institute of Technology (EPFL), Lausanne, Switzerland, in 1989 and 1992 respectively. In 1993, he was a research engineer at the Corporate Research Laboratories of Sony Corporation in Tokyo, where he conducted research on advanced video compression techniques for storage applications. In 1994, he served as a research consultant at AT&T Bell Laboratories working on very low bitrate video coding. He is currently Professor at EPFL heading its Multimedia Signal Processing Group. He is also the Convenor of JPEG standardization Committee. He was also adjunct Professor with the Center of Quantifiable Quality of Service at Norwegian University of Science and Technology (NTNU)from 2008 to 2012. Prof. Ebrahimi has been the recipient of various distinctions and awards, such as the IEEE and Swiss national ASE award, the SNF-PROFILE grant for advanced researchers, Four ISO-Certificates for key contributions to MPEG-4 and JPEG 2000, and the best paper award of IEEE Trans. on Consumer Electronics . He became a Fellow of the international society for optical engineering (SPIE) in 2003. Prof. Ebrahimi has initiated more than two dozen National, European and International cooperation projects with leading companies and research institutes around the world. He is a co-founder of Genista SA, a high-tech start-up company in the field of multimedia quality metrics. In 2002, he founded Emitall SA, start-up active in the area of media security and surveillance. In 2005, he founded EMITALL Surveillance SA, a start-up active in the field of privacy and protection. He is or has been associate Editor with various IEEE, SPIE, and EURASIP journals, such as IEEE Signal Processing Magazine, IEEE Trans. on Image Processing, IEEE Trans. on Multimedia, EURASIP Image Communication Journal, EURASIP Journal of Applied Signal Processing, SPIE Optical Engineering Magazine. Prof. Ebrahimi is a member of Scientific Advisory Board of various start-up and established companies in the general field of Information Technology. He has served as Scientific Expert and Evaluator for Research Funding Agencies such as those of European Commission, The Greek Ministry of Development, The Austrian National Foundation for Scientific Research, The Portuguese Science Foundation, as well as a number of Venture Capital Companies active in the field of Information Technologies and Communication Systems. His research interests include still, moving, and 3D image processing and coding, visual information security (rights protection, watermarking, authentication, data integrity, steganography), new media, and human computer interfaces (smart vision, brain computer interface). He is the author or the co-author of more than 200 research publications, and holds 14 patents. Prof. Ebrahimi is a member of IEEE, SPIE, ACM and IS&T. See the URL below for more details: http://mmspl.epfl.ch

Sébastien Marcel

Expertise image processing, pattern recognition, machine learning, biometrics Current work Face recognitionSpeaker recognitionMobile biometrics ( http://www.mobioproject.org )Spoofing ( http://www.tabularasa-euproject.org )Biometrics evaluation and testing ( http://www.beat-eu.org ) Sébastien Marcel is the head of the Biometrics group and senior research scientist at the Idiap Research Institute (CH), where he leads a research team and conducts research on biometrics and more particularly face recognition,

François Fleuret

Nikolaos Stergiopoulos

Education MTE, Managing the Technology Enterprise Program (2000), IMD, Lausanne Ph.D. in Biomedical Engineering & Engineering Mechanics (1990) Iowa State University, Ames, Iowa. MS in Biomedical Engineering (1987) Iowa State University, Ames, Iowa. Diploma in Mechanical Engineering (1985) National Technical University of Athens. Professional Activities 2002 - present: Professor and director of LHTC 2010 - present: Founder and director of Rheon Medical SA, Préverenges, Switzerland 2008 - present: Founder and director of Antlia S.A., PSE-C, EPFL campus, Switzerland 1998 - 2007: Founder and Scientific Director of EndoArt S.A., Lausanne, Switzerland 1996 - 2002: Assistant professor at the Biomedical Engineering Laboratory, Swiss Federal Institute of Technology, Lausanne, Switzerland. 1991 - 1996: Research Associate at Swiss Federal Institute of Technology - Lausanne 1990 - 1991: Lecturer, Iowa State University

Ali Saeidi

Mihai Adrian Ionescu

Adrian M. Ionescu is Full Professor at the Swiss Federal Institute of Technology, Lausanne, Switzerland. He received the B.S./M.S. and Ph.D. degrees from the Polytechnic Institute of Bucharest, Romania and the National Polytechnic Institute of Grenoble, France, in 1989 and 1997, respectively. He has held staff and/or visiting positions at LETI-CEA, Grenoble, France and INP Grenoble, France and Stanford University, USA, in 1998 and 1999. Dr. Ionescu has published more than 600 articles in international journals and conferences. He received many Best Paper Awards in international conferences, the Annual Award of the Technical Section of the Romanian Academy of Sciences in 1994 and the Blondel Medal in 2009 for contributions to the progress in engineering sciences in the domain of electronics. He is the 2013 recipient of the IBM Faculty Award in Engineering. He served the IEDM and VLSI conference technical committees and was the Technical Program Committee (Co)Chair of ESSDERC in 2006 and 2013. He is a member of the SATW. He is director of the Laboratory of Micro/Nanoelectronic Devices (NANOLAB).

Samy Bengio

Expertise Large Language ModelsReasoningStatistical machine learningSpeech processingPerson authenticationMultimodal processingSequence processingArtificial neural networks, support vector machinesHidden markov models, gaussian mixture modelsetc Expertise Large Language ModelsReasoningStatistical machine learningSpeech processingPerson authenticationMultimodal processingSequence processingArtificial neural networks, support vector machinesHidden markov models, gaussian mixture modelsetc Mission Samy Bengio

Jérôme Chenal

Expertise Urban DesignUrban PlanningUrban ManagementPublic SpaceHousingDevelopment StudiesVisual Anthropology Mission Director of CEAT Director of Excellence in Africa Center Affiliate professor at UM6P Teaching & PhD Past EPFL PhD Students Stéphanie Hasler, Rémi Jaligot, Armel Firmin Kemajou Mbianda, Martí Bosch Padrós, Andrea Salmi, Vitor Pessoa Colombo, Akuto Akpedze Konou, Rim Mrani Past EPFL PhD Students as codirector Marc Antoine Messer, Alexandre Rigal Courses Urban planning in the South PE

Denis Gillet

Denis Gillet received the Diploma in Electrical Engineering from the Swiss Federal Institute of Technology in Lausanne (EPFL) in 1988, and the Ph.D. degree in Information Systems also from the EPFL in 1995. During 1992 he was appointed as Research Fellow at the Information Systems Laboratory of Stanford University in the United States. He is currently Maître d'enseignement et de recherche at the EPFL School of Engineering, where he leads the React research group. His current research interests include Technologies Enhanced Learning (TEL), Human Computer Interaction (HCI), Human Devices Interaction (HDI) and Optimal Coordination of Complex and Distributed Systems. Denis Gillet is affiliated at EPFL with the Center for Intelligent Systems and the Center for Digital Education.

Pascal Fua

Pascal Fua received an engineering degree from Ecole Polytechnique, Paris, in 1984 and the Ph.D. degree in Computer Science from the University of Orsay in 1989. He then worked at SRI International and INRIA Sophia-Antipolis as a Computer Scientist. He joined EPFL in 1996 where he is now a Professor in the School of Computer and Communication Science and heads the Computer Vision Laboratory. His research interests include shape modeling and motion recovery from images, analysis of microscopy images, and Augmented Reality. His research interests include shape modeling and motion recovery from images, analysis of microscopy images, and machine learning. He has (co)authored over 300 publications in refereed journals and conferences. He is an IEEE Fellow and has been an Associate Editor of IEEE journal Transactions for Pattern Analysis and Machine Intelligence. He often serves as program committee member, area chair, and program chair of major vision conferences and has cofounded three spinoff companies (Pix4D, PlayfulVision, and NeuralConcept).

Related units (8)

IEL - Administration

Computer Vision Laboratory

Signal Processing Laboratory 5

Related concepts (4)

Ensemble learning

In statistics and machine learning, ensemble methods use multiple learning algorithms to obtain better predictive performance than could be obtained from any of the constituent learning algorithms alone. Unlike a statistical ensemble in statistical mechanics, which is usually infinite, a machine learning ensemble consists of only a concrete finite set of alternative models, but typically allows for much more flexible structure to exist among those alternatives.

Gradient boosting

Gradient boosting is a machine learning technique used in regression and classification tasks, among others. It gives a prediction model in the form of an ensemble of weak prediction models, i.e., models that make very few assumptions about the data, which are typically simple decision trees. When a decision tree is the weak learner, the resulting algorithm is called gradient-boosted trees; it usually outperforms random forest.

Boosting (machine learning)

In machine learning, boosting is an ensemble meta-algorithm for primarily reducing bias, and also variance in supervised learning, and a family of machine learning algorithms that convert weak learners to strong ones. Boosting is based on the question posed by Kearns and Valiant (1988, 1989): "Can a set of weak learners create a single strong learner?" A weak learner is defined to be a classifier that is only slightly correlated with the true classification (it can label examples better than random guessing).

Related publications (25)