Publications associées à The dynamics of representation learning in shallow, non-linear autoencoders

Publications associées (17)

Function-Space Optimality of Neural Architectures with Multivariate Nonlinearities

We investigate the function-space optimality (specifically, the Banach-space optimality) of a large class of shallow neural architectures with multivariate nonlinearities/activation functions. To that end, we construct a new family of Banach spaces defined ...

SIAM PUBLICATIONS2025

Combinatorial Aspects of Continuous Optimization: Graph Polynomials and Neural Networks

Amire Bendjeddou

In this thesis, we study how combinatorial structures and symmetries emerge from analytic properties of graph polynomials and neural networks. Graph polynomials encode combinatorial aspects of the underlying graph in their coefficients and are remarkably u ...

EPFL2025

Surface distributions and vertical profiles of trace gases (CO, O3, NO, NO2) in the Arctic wintertime boundary layer using low-cost sensors during ALPACA-2022

Julia Schmale, Andrea Baccarini, Roman Pohorsky

Electrochemical gas sensors (EGSs) have been used to measure the surface distributions and vertical profiles of trace gases in the wintertime Arctic boundary layer during the Alaskan Layered Pollution and Chemical Analysis (ALPACA) field experiment in Fair ...

COPERNICUS GESELLSCHAFT MBH2025

Masked Diffusion Strategy for Privacy-Preserving Distributed Learning

Ali H. Sayed

To protect both local gradients and estimated parameters in distributed learning, this paper introduces a masked diffusion (MD) strategy, leading to two algorithms: the MD stochastic gradient (MD-SG) and the MD primal-dual stochastic gradient (MPD-SG). The ...

2025

Ion Sieving in Two-Dimensional Membranes from First Principles

Nicola Marzari, Nicéphore Arthur François Bonnet

A first-principles approach for calculating ion separation in solution through two-dimensional (2D) membranes is proposed and applied. Ionic energy profiles across the membrane are obtained first, where solvation effects are simulated explicitly with machi ...

2025

Learning Hand State Estimation for a Light Exoskeleton

Luca Randazzo

We propose a machine learning-based estimator of the hand state for rehabilitation purposes, using light exoskeletons. These devices are easy to use and useful for delivering domestic and frequent therapies. We build a supervised approach using information ...

Springer Nature2025

Optimization frameworks for bespoke sensory encoding in neuroprosthetics

Silvestro Micera, Solaiman Shokur, Franklin Leong

Restoring natural sensation via neuroprosthetics relies on the possibility of encoding complex and nuanced information. For example, an ideal brain–machine interface with sensory feedback would provide the user with sensation about movement, pressure, curv ...

AIP Publishing2025

Euclid: Searches for strong gravitational lenses using convolutional neural nets in Early Release Observations of the Perseus field

Georges Meylan, Benjamin Yvan Alexandre Clement, Olivia Mueller

The Euclid Wide Survey (EWS) is predicted to find approximately 170 000 galaxy-galaxy strong lenses from its lifetime observation of 14 000 deg2 of the sky. Detecting this many lenses by visual inspection with professional astronomers and citizen scientist ...

2025

A deep learning pipeline for three-dimensional brain-wide mapping of local neuronal ensembles in teravoxel light-sheet microscopy

Grégoire Courtine, Jordan Squair, Newton Cho

Teravoxel-scale, cellular-resolution images of cleared rodent brains acquired with light-sheet fluorescence microscopy have transformed the way we study the brain. Realizing the potential of this technology requires computational pipelines that generalize ...

Nature Publishing Group2025

Walking on the Edge: Brain Connectivity Changes in Response to Virtual Height Challenges

Mohamed Bouri

Virtual reality (VR) environments simulating height offer a unique platform to investigate neural adaptations to emotionally salient contexts during locomotion. These simulations allow for controlled analysis of motor‐cognitive interactions under perceived ...

Wiley2025

How Two-Layer Neural Networks Learn, One (Giant) Step at a Time

Florent Gérard Krzakala, Bruno Loureiro, Ludovic Théo Stephan, Yatin Dandi, Luca Pesce

For high-dimensional Gaussian data, we investigate theoretically how the features of a two-layer neural network adapt to the structure of the target function through a few large batch gradient descent steps, leading to an improvement in the approximation c ...

2024

Rehabilitation exoskeleton system with bidirectional virtual reality feedback training strategy

Rui Wu

Virtual reality (VR) technology revitalises rehabilitation training by creating rich, interactive virtual rehabilitation scenes and tasks that deeply engage patients. Robotics with immersive VR environments have the potential to significantly enhance the s ...

2024

Euclid preparation XXXIII. Characterization of convolutional neural networks for the identification of galaxy-galaxy strong-lensing events

Frédéric Courbin, Georges Meylan, Georgios Vernardos, Benjamin Yvan Alexandre Clement

Forthcoming imaging surveys will increase the number of known galaxy-scale strong lenses by several orders of magnitude. For this to happen, images of billions of galaxies will have to be inspected to identify potential candidates. In this context, deep-le ...

Edp Sciences S A2024

Simultaneous Quantification of Multiple Drugs by Machine Learning on Electrochemical Sensors

Sandro Carrara, Lin Du, Tatsunori Matsumoto

Electrochemical devices and systems are significant for the development of therapeutic drug monitoring (TDM) and personalized therapy. However, electrochemical sensors are usually not that much selective. Therefore, innovative machine learning (ML) approac ...

Institute of Electrical and Electronics Engineers Inc.2024

Aircraft Trajectory Planning for Climate Hotspot Avoidance Considering Air Traffic Complexity: A Constrained Multi-Agent Reinforcement Learning Approach

Maryam Kamgarpour, Tingting Ni

Planning aircraft trajectories to avoid climate-sensitive areas poses operational challenges, including increased traffic complexity and potential safety risks. This study presents a framework designed to plan operationally feasible climate-friendly routes ...

2024

A PAC-Bayesian Framework for Optimal Control with Stability Guarantees

Mahrokh Ghoddousiboroujeni, Giancarlo Ferrari Trecate, Clara Lucía Galimberti

Stochastic Nonlinear Optimal Control (SNOC) involves minimizing a cost function that averages out the random uncertainties affecting the dynamics of nonlinear systems. For tractability reasons, this problem is typically addressed by minimizing an empirical ...

IEEE2024

Inverse Graph Learning from Social Interactions

Valentina Shumovskaia

The social learning paradigm for distributed hypothesis testing involves a collection of agents interacting over a graph, each observing streaming data that provide evidence about the state of the environment. These agents perform a series of local Bayesia ...

EPFL2024