Publications associées à NSM Converges to a k-NN Regressor Under Loose Lipschitz Estimates

Publications associées (30)

Overcoming Distribution Shifts and Imbalance Challenges in Representation Learning for Deep Regression Models

Deep learning has shown remarkable potential for industrial applications, particularly in predictive maintenance and condition monitoring. A key challenge in this domain is prognostics, specifically predicting the Remaining Useful Life (RUL) of assets - a ...

EPFL2025

Scalable kernel logistic regression with Nyström approximation: Theoretical analysis and application to discrete choice modelling

Michel Bierlaire

The application of kernel-based Machine Learning (ML) techniques to discrete choice modelling using large datasets often faces challenges due to memory requirements and the considerable number of parameters involved in these models. This complexity hampers ...

2025

Bayes-optimal Learning of Deep Random Networks of Extensive-width

Lenka Zdeborová, Florent Gérard Krzakala, Hugo Chao Cui

We consider the problem of learning a target function corresponding to a deep, extensive-width, non-linear neural network with random Gaussian weights. We consider the asymptotic limit where the number of samples, the input dimension and the network width ...

2023

Classification of fall directions via wearable motion sensors

Mustafa Sahin Turan

Effective fall-detection and classification systems are vital in mitigating severe medical and economical consequences of falls to people in the fall risk groups. One class of such systems is based on wearable sensors. While there is a vast amount of acade ...

ACADEMIC PRESS INC ELSEVIER SCIENCE2022

Weighting Pseudo-labels via High-Activation Feature Index Similarity and Object Detection for Semi-supervised Segmentation

Minh Hieu Lê

Semi-supervised semantic segmentation methods leverage unlabeled data by pseudo-labeling them. Thus the success of these methods hinges on the reliability of the pseudo-labels. Existing methods mostly choose high-confidence pixels in an effort to avoid err ...

Springer Science and Business Media Deutschland GmbH2025

Exploiting Representation Similarities in Self-Supervised Learning for Vision Tasks

Thomas Grégoire Stegmüller

Recent progress in computer vision has been driven by a simple yet transformative observation: the potential of 30-year-old neural networks can be unlocked by massively scaling their parameters and the amount of human-labeled training data. This breakthrou ...

EPFL2025

On Generalizations of Some Distance Based Classifiers for HDLSS Data

Soham Sarkar

In high dimension, low sample size (HDLSS) settings, classifiers based on Euclidean distances like the nearest neighbor classifier and the average distance classifier perform quite poorly if differences between locations of the underlying populations get m ...

Microtome Publishing2022

Boosting Resource-Constrained Federated Learning Systems with Guessed Updates

Mohamed Yassine Boukhari, Anne-Marie Kermarrec, Rafael Pereira Pires, Rishi Sharma, Akash Balasaheb Dhasade

Federated learning (FL) enables a set of client devices to collaboratively train a model without sharing raw data. This process, though, operates under the constrained computation and communication resources of edge devices. These constraints combined with ...

Institute of Electrical and Electronics Engineers (IEEE)2025

Landscape and training regimes in deep learning

Matthieu Wyart, Mario Geiger, Leonardo Petrini

Deep learning algorithms are responsible for a technological revolution in a variety oftasks including image recognition or Go playing. Yet, why they work is not understood.Ultimately, they manage to classify data lying in high dimension – a feat generical ...

Elsevier2021

A comparative analysis of gene expression profiling by statistical and machine learning approaches

Anaïs Betsabeh Haget, Maria Boulougouri

Motivation Many machine learning (ML) models developed to classify phenotype from gene expression data provide interpretations for their decisions, with the aim of understanding biological processes. For many models, including neural networks, interpretati ...

OXFORD UNIV PRESS2025

Cognitive workload monitoring in virtual reality based rescue missions with drones

David Atienza Alonso, Adriana Arza Valdes, Fabio Isidoro Tiberio Dell'Agnola, Niloofar Momeni

The use of drones in search and rescue (SAR) missions can be very cognitively demanding. Since high levels of cognitive workload can negatively affect human performance, there is a risk of compromising the mission and leading to failure with catastrophic o ...

2020

Learning to Reason with Neural Networks: Principles and Methods

Aryo Lotfi Jandaghi

This thesis focuses on understanding and improving the reasoning capabilities of neural networks. It develops theoretical results and empirical analyses to uncover reasoning potential and limitations, leveraging these insights to guide the design of improv ...

EPFL2025

A multidomain approach to neighbourhood typology for urban environmental studies

Jan Wienold, Dolaana Khovalyg, Dusan Licina, Kun Lyu, Hanieh Khodaei Tehrani

Cities are facing unprecedented challenges to their environments and residents due to continuous growth, including urban overheating, daylight accessibility, noise, and air pollution. This requires a holistic approach to the research and implementation of ...

2025

Model order reduction for large-scale structures with local nonlinearities

Jan Sickmann Hesthaven, Zhenying Zhang, Mengwu Guo

In solid mechanics, linear structures often exhibit (local) nonlinear behavior when close to failure. For instance, the elastic deformation of a structure becomes plastic after being deformed beyond recovery. To properly assess such problems in a real-life ...

ELSEVIER SCIENCE SA2019

Graph-based Methods for Visualization and Clustering

Johann Paratte

The amount of data that we produce and consume is larger than it has been at any point in the history of mankind, and it keeps growing exponentially. All this information, gathered in overwhelming volumes, often comes with two problematic characteristics: ...

EPFL2017

K-space physics-informed neural network (k-PINN) for compressed spectral mapping and efficient inversion of vibrations in thin composite laminates

Olga Fink

The vibrational response of structural components carries valuable information about their underlying mechanical properties, health status and operational conditions. This underscores the need for the development of efficient physics-based inversion algori ...

Elsevier BV2025

Distributed processing of continuous sliding-window k-NN queries for data stream filtering

Karl Aberer

A sliding-window k-NN query (k-NN/w query) continuously monitors incoming data stream objects within a sliding window to identify k closest objects to a query. It enables effective filtering of data objects streaming in at high rates from potentially distr ...

Springer Verlag2011

3D Face Recognition with Sparse Spherical Representations

Pascal Frossard, Effrosyni Kokiopoulou, Ivana Tosic

This paper addresses the problem of 3D face recognition using simultaneous sparse approximations on the sphere. The 3D face point clouds are first aligned with a novel and fully automated registration process. They are then represented as signals on the 2D ...

2010

Semantic coding by supervised dimensionality reduction

Pascal Frossard, Effrosyni Kokiopoulou

This paper addresses the problem of representing multimedia information under a compressed form that permits efficient classification. The semantic coding problem starts from a subspace method where dimensionality reduction is formulated as a matrix factor ...

2008

On the estimation of geodesic paths on sampled manifolds under random projections

Pierre Vandergheynst, Matteo Sorci

In this paper, we focus on the use of random projections as a dimensionality reduction tool for sampled manifolds in high-dimensional Euclidean spaces. We show that geodesic paths approximations from nearest neighbors Euclidean distances are well-preserved ...

2008