Publications related to Adaptive Similarity Bootstrapping for Self-Distillation based Representation Learning

Related publications (26)

Overcoming Distribution Shifts and Imbalance Challenges in Representation Learning for Deep Regression Models

Deep learning has shown remarkable potential for industrial applications, particularly in predictive maintenance and condition monitoring. A key challenge in this domain is prognostics, specifically predicting the Remaining Useful Life (RUL) of assets - a ...

EPFL2025

Exploiting Representation Similarities in Self-Supervised Learning for Vision Tasks

Thomas Grégoire Stegmüller

Recent progress in computer vision has been driven by a simple yet transformative observation: the potential of 30-year-old neural networks can be unlocked by massively scaling their parameters and the amount of human-labeled training data. This breakthrou ...

EPFL2025

Dark Noise Diffusion: Noise Synthesis for Low-Light Image Denoising

Liying Lu, Raphaël Wan-Li Marc Achddou, Sabine Süsstrunk

Low-light photography produces images with low signal-to-noise ratios due to limited photons. In such conditions, common approximations like the Gaussian noise model fall short, and many denoising techniques fail to remove noise effectively. Although deep- ...

2025

Fair Decentralized Learning

Anne-Marie Kermarrec, Rishi Sharma, Marinus Abraham de Vos, Sayan Biswas

Decentralized learning (DL) is an emerging approach that enables nodes to collaboratively train a machine learning model without sharing raw data. In many application domains, such as healthcare, this approach faces challenges due to the high level of hete ...

IEEE2025

Classifier-free diffusion-based weakly-supervised approach for health indicator derivation in rotating machines: Advancing early fault detection and condition monitoring

Olga Fink, Gaëtan Michel Frusque

Deriving health indicators of rotating machines is crucial for their maintenance. However, this process is challenging for the prevalent adopted intelligent methods since they may take the whole data distributions, not only introducing noise interference b ...

2025

K-space physics-informed neural network (k-PINN) for compressed spectral mapping and efficient inversion of vibrations in thin composite laminates

Olga Fink

The vibrational response of structural components carries valuable information about their underlying mechanical properties, health status and operational conditions. This underscores the need for the development of efficient physics-based inversion algori ...

Elsevier BV2025

Computational design of complex protein folds and soluble analogs of membrane proteins

Casper Alexander Goverde

Proteins are the molecular machines of life, driving essential biological processes such as enzymatic catalysis, cellular signaling, and immune responses. The ability to design entirely new proteins with desired structures and functions has immense implica ...

EPFL2025

Weighting Pseudo-labels via High-Activation Feature Index Similarity and Object Detection for Semi-supervised Segmentation

Minh Hieu Lê

Semi-supervised semantic segmentation methods leverage unlabeled data by pseudo-labeling them. Thus the success of these methods hinges on the reliability of the pseudo-labels. Existing methods mostly choose high-confidence pixels in an effort to avoid err ...

Springer Science and Business Media Deutschland GmbH2025

Plasma state monitoring and disruption characterization using multimodal VAEs

Giulio Romanelli, Olivier Sauter, Alessandro Pau, Yoeri Renier Johannes Poels, Cristina Venturini

When a plasma disrupts in a tokamak, significant heat and electromagnetic loads are deposited onto the surrounding device components. These forces scale with plasma current and magnetic field strength, making disruptions one of the key challenges for futur ...

IOP Publishing Ltd2025

Explainable modeling for wind power forecasting: A Glass-Box model with high accuracy

Fernando Porté Agel, Jiannong Fang, Wenlong Liao

Machine learning models (e.g., neural networks) achieve high accuracy in wind power forecasting, but they are usually regarded as black boxes that lack interpretability. To address this issue, the paper proposes a glass-box model that combines high accurac ...

2025

Sequential Reasoning with Socially Caused Beliefs

Mert Kayaalp

Machine learning and artificial intelligence methods have achieved remarkable success, matching and even surpassing human capabilities in various complex tasks. However, many demonstrations have generally neglected a critical part of the intelligence that ...

EPFL2025

Boosting Resource-Constrained Federated Learning Systems with Guessed Updates

Mohamed Yassine Boukhari, Anne-Marie Kermarrec, Rafael Pereira Pires, Rishi Sharma, Akash Balasaheb Dhasade

Federated learning (FL) enables a set of client devices to collaboratively train a model without sharing raw data. This process, though, operates under the constrained computation and communication resources of edge devices. These constraints combined with ...

Institute of Electrical and Electronics Engineers (IEEE)2025

Scalable kernel logistic regression with Nyström approximation: Theoretical analysis and application to discrete choice modelling

Michel Bierlaire

The application of kernel-based Machine Learning (ML) techniques to discrete choice modelling using large datasets often faces challenges due to memory requirements and the considerable number of parameters involved in these models. This complexity hampers ...

2025

Learning to Reason with Neural Networks: Principles and Methods

Aryo Lotfi Jandaghi

This thesis focuses on understanding and improving the reasoning capabilities of neural networks. It develops theoretical results and empirical analyses to uncover reasoning potential and limitations, leveraging these insights to guide the design of improv ...

EPFL2025

A comparative analysis of gene expression profiling by statistical and machine learning approaches

Anaïs Betsabeh Haget, Maria Boulougouri

Motivation Many machine learning (ML) models developed to classify phenotype from gene expression data provide interpretations for their decisions, with the aim of understanding biological processes. For many models, including neural networks, interpretati ...

OXFORD UNIV PRESS2025

On the Perspectives of Image-to-Lidar Constraints in Dynamic Network Optimisation

Thibaut Stoltz, Jan Skaloud, Davide Antonio Cucci, Laurent Valentin Jospin, Kyriaki Mouzakidou

The evolution of airborne mapping witnesses the introduction of hybrid lidar-camera systems to enhance data collection, i.e. to obtain simultaneously high-density point-cloud and texture. Yet, the common adjustment of both optical data streams is a nontriv ...

International Society for Photogrammetry and Remote Sensing2025

A two-phase approach for leak detection and localization in water distribution systems using wavelet decomposition and machine learning

Jérôme Chenal

Water is a crucial resource for all forms of life, yet it is becoming increasingly scarce. A significant portion of water loss in urban and industrial areas is attributed to leaks. Addressing this issue is critical for enhancing efficiency, sustainability, ...

Elsevier BV2024

Investigating the Effect of Misalignment on Membership Privacy in the White-box Setting

Ana-Maria Cretu

Machine learning models have been shown to leak sensitive information about their training datasets. Models are increasingly deployed on devices, raising concerns that white-box access to the model parameters increases the attack surface compared to black- ...

Privacy Enhancing Technologies Symposium Advisory Board2024

Asymptotics of feature learning in two-layer networks after one gradient-step

Lenka Zdeborová, Florent Gérard Krzakala, Bruno Loureiro, Hugo Chao Cui, Yatin Dandi, Luca Pesce, Yue Lu

In this manuscript, we investigate the problem of how two-layer neural networks learn features from data, and improve over the kernel regime, after being trained with a single gradient descent step. Leveraging the insight from (Ba et al., 2022), we model t ...

2024

Towards the Detection of AI-Synthesized Human Face Images

Touradj Ebrahimi, Yuhang Lu

Over the past years, image generation and manipulation have achieved remarkable progress due to the rapid development of generative AI based on deep learning. Recent studies have devoted significant efforts to address the problem of face image manipulation ...

2024