Publication

Multi-layer Boosting for Pattern Recognition

2008
Reports

Abstract

We extend the standard boosting procedure to train a two-layer classifier dedicated to handwritten character recognition. The scheme we propose relies on a hidden layer which extracts feature vectors on a fixed number of points of interest, and an output layer which combines those feature vectors and the point of interest locations into a final classification decision. Our main contribution is to show that the classical AdaBoost procedure can be extended to train such a multi-layered structure by propagating the error through the output layer. Such an extension allows for the selection of optimal weak learners by minimizing a weighted error, in both the output layer and the hidden layer. We provide experimental results on the MNIST database and compare to a classical unsupervised EM-based feature extraction.

Official source

https://infoscience.epfl.ch/entities/publication/f1e8e04b-2cc0-49a7-a6c5-7d523a3dee9f

About this result

This page is automatically generated and may contain information that is not correct, complete, up-to-date, or relevant to your search query. The same applies to every other page on this website. Please make sure to verify the information with EPFL's official sources.

Graph Chat

Chat with Graph Search

Ask any question about EPFL courses, lectures, exercises, research, news, etc. or try the example questions below.

DISCLAIMER: The Graph Chatbot is not programmed to provide explicit or categorical answers to your questions. Rather, it transforms your questions into API requests that are distributed across the various IT services officially administered by EPFL. Its purpose is solely to collect and recommend relevant references to content that you can explore to help you answer your questions.

2008
Reports

Abstract

Official source

https://infoscience.epfl.ch/entities/publication/f1e8e04b-2cc0-49a7-a6c5-7d523a3dee9f

About this result

Related concepts (32)

Feature learning

In machine learning, feature learning or representation learning is a set of techniques that allows a system to automatically discover the representations needed for feature detection or classification from raw data. This replaces manual feature engineering and allows a machine to both learn the features and use them to perform a specific task. Feature learning is motivated by the fact that machine learning tasks such as classification often require input that is mathematically and computationally convenient to process.

Feature (machine learning)

In machine learning and pattern recognition, a feature is an individual measurable property or characteristic of a phenomenon. Choosing informative, discriminating and independent features is a crucial element of effective algorithms in pattern recognition, classification and regression. Features are usually numeric, but structural features such as strings and graphs are used in syntactic pattern recognition. The concept of "feature" is related to that of explanatory variable used in statistical techniques such as linear regression.

Feature engineering

Feature engineering or feature extraction or feature discovery is the process of extracting features (characteristics, properties, attributes) from raw data. Due to deep learning networks, such as convolutional neural networks, that are able to learn it by itself, domain-specific- based feature engineering has become obsolete for vision and speech processing.

Related publications (26)

Multi-layer Boosting for Pattern Recognition

Chat with Graph Search

Benchmarking physics-inspired machine learning models for transition metal complexes with diverse charge and spin states

Heterogeneous Treatment Effect for Targeted Temperature Management After Cardiac Arrest: A Causal Machine Learning Analysis

Leveraging Sparsity for Sample-Efficient Preference Learning: A Theoretical Perspective