Concept

Overfitting

Related publications (30)

Last iterate convergence of SGD for Least-Squares in the Interpolation regime

Nicolas Henri Bernard Flammarion, Loucas Pillaud-Vivien, Aditya Vardhan Varre

Motivated by the recent successes of neural networks that have the ability to fit the data perfectly \emph{and} generalize well, we study the noiseless model in the fundamental least-squares setup. We assume that an optimum predictor fits perfectly inputs ...

Advances in Neural Information Processing Systems 20212021

Efficient Depth-based Deep Learning Methods for Multi-Party Pose Estimation

Angel Noe Martinez Gonzalez

Human detection and pose estimation are essential components for any artificial system responsive to the presence of humans and that react according to human-centered tasks. Robotic systems are typical examples, for which the body pose represents fine grai ...

EPFL2021

Practical issues with modeling extreme Brazilian rainfall

Anthony Christopher Davison

Accurately quantifying extreme rainfall is important for the design of hydraulic structures, for flood mapping and zoning and for disaster management. In order to produce maps of estimates of 25-year rainfall return levels in Brazil, we selected 893 shorte ...

BRAZILIAN STATISTICAL ASSOCIATION2021

CAFS: Cost-Aware Features Selection Method for Multimodal Stress Monitoring on Wearable Devices

David Atienza Alonso, Maria del Carmen Sandi Perez, Adriana Arza Valdes, João Pedro de Matos Rodrigues, Niloofar Momeni

Objective: Today, stress monitoring on wearable devices is challenged by the tension between high-detection accuracy and battery lifetime driven by multimodal data acquisition and processing. Limited research has addressed the classification cost on multim ...

2022

What can linearized neural networks actually say about generalization?

Pascal Frossard, Seyed Mohsen Moosavi Dezfooli, Guillermo Ortiz Jimenez

For certain infinitely-wide neural networks, the neural tangent kernel (NTK) theory fully characterizes generalization, but for the networks used in practice, the empirical NTK only provides a rough first-order approximation. Still, a growing body of work ...

2021

Real-Time EEG-Based Cognitive Workload Monitoring on Wearable Devices

David Atienza Alonso, Amir Aminifar, Adriana Arza Valdes, Renato Zanetti

Objective: Cognitive workload monitoring (CWM) can enhance human-machine interaction by supporting task execution assistance considering the operator’s cognitive state. Therefore, we propose a machine learning design methodology and a data processing strat ...

2022

AL2: Progressive Activation Loss for Learning General Representations in Classification Neural Networks

Sabine Süsstrunk, Majed El Helou, Frederike Dümbgen

The large capacity of neural networks enables them to learn complex functions. To avoid overfitting, networks however require a lot of training data that can be expensive and time-consuming to collect. A common practical approach to attenuate overfitting i ...

IEEE2020

Weight Erosion: An Update Aggregation Scheme for Personalized Collaborative Machine Learning

Martin Jaggi, Sai Praneeth Reddy Karimireddy, Mary-Anne Hartley, Felix Hans Michel Grimberg

Background. In medicine and other applications, the copying and sharing of data is impractical for a range of well-considered reasons. With federated learning (FL) techniques, machine learning models can be trained on data spread across several locations w ...

Springer, Cham2020

Constrained expectation-maximization algorithm for stochastic inertial error modeling: study of feasibility

Jan Skaloud, Stéphane Guerrier, Yannick Stebler

Stochastic modeling is a challenging task for low-cost sensors whose errors can have complex spectral structures. This makes the tuning process of the INS/GNSS Kalman filter often sensitive and difficult. For example, first-order Gauss–Markov processes are ...

IOP Publishing2011

An objective comparison of detection and segmentation algorithms for artefacts in clinical endoscopy

Georges Wagnières

We present a comprehensive analysis of the submissions to the first edition of the Endoscopy Artefact Detection challenge (EAD). Using crowd-sourcing, this initiative is a step towards understanding the limitations of existing state-of-the-art computer vis ...

Nature Research2020