Publications associées à ExpandNets: Linear Over-parameterization to Train Compact Convolutional Networks

Publications associées (22)

Machine learning enhanced atom probe tomography analysis

Atom probe tomography (APT) is a burgeoning characterization technique that provides compositional mapping of materials in three-dimensions at near-atomic scale. Since its significant expansion in the past 30 years, we estimate that one million APT dataset ...

2026

Neural networks trained with SGD learn distributions of increasing complexity

Maria Refinetti

The uncanny ability of over-parameterised neural networks to generalise well has been explained using various ‘simplicity biases’. These theories postulate that neural networks avoid overfitting by first fitting simple, linear classifiers before learning m ...

2025

Enhancing Lift and Dynamic Stability Through Morphological Optimization of Wings for Tailless Flapping-Wing Robots

Josephine Anna Eleanor Hughes

The design of wings is crucial for tailless Flapping-wing robots (FWRs), as these robots rely exclusively on their wings for lift generation and body control. However, the current methodology for wing design primarily depends on the experience and heuristi ...

2025

Hadamard product in deep learning: Introduction, Advances and Challenges

Volkan Cevher, Yongtao Wu

While convolution and self-attention mechanisms have dominated architectural design in deep learning, this survey examines a fundamental yet understudied primitive: the Hadamard product. Despite its widespread implementation across various applications, th ...

2025

Robustly Learning Regions of Attraction From Fixed Data

Colin Neil Jones

While stability analysis is a mainstay for control science, especially computing regions of attraction of equilibrium points, until recently most stability analysis tools always required explicit knowledge of the model or a high-fidelity simulator represen ...

2025

Monitoring of water volume in a porous reservoir using seismic data: A 3D simulation study

Jan Sickmann Hesthaven

A potential framework to estimate the volume of water stored in a porous storage reservoir from seismic data is neural networks. In this study, the man-made groundwater reservoir is modeled as a coupled poroviscoelastic–viscoelastic medium, and the underly ...

2024

LiDAR-NeRF: Novel LiDAR View Synthesis via Neural Radiance Fields

Mathieu Salzmann

We introduce a new task, novel view synthesis for LiDAR sensors. While traditional model-based LiDAR simulators with style-transfer neural networks can be applied to render novel views, they fall short of producing accurate and realistic LiDAR patterns bec ...

Association for Computing Machinery, Inc2024

Higher-order knowledge-enhanced recommendation with heterogeneous hypergraph multi-attention

Thanh Trung Huynh

Recent advancements in recommender systems have focused on integrating knowledge graphs (KGs) to leverage their auxiliary information. The core idea of KG-enhanced recommenders is to incorporate rich semantic information for more accurate recommendations. ...

2024

Function Learning with Financial Applications

Paolo Colusso

This thesis sets itself the goal of investigating function learning approaches. The topic is extremely relevant today, since the abundance of data, jointly with the technological progress which has enhanced computing power, now allow to represent functions ...

EPFL2024

Unsupervised quality monitoring of metal additive manufacturing using Bayesian adaptive resonance

Patrik Willi Hoffmann

Metal additive manufacturing is a recent breakthrough technology that promises automated production of complex geometric shapes at low operating costs. However, its potential is not yet fully exploited due to the low reproducibility of quality in mass prod ...

CELL PRESS2024

Positive-Unlabeled Constraint Learning for Inferring Nonlinear Continuous Constraints Functions From Expert Demonstrations

Baiyu Peng, Aude Billard

Planning for diverse real-world robotic tasks necessitates to know and write all constraints. However, instances exist where these constraints are either unknown or challenging to specify accurately. A possible solution is to infer the unknown constraints ...

2024

Rigorous Dynamical Mean-Field Theory for Stochastic Gradient Descent Methods

Lenka Zdeborová, Florent Gérard Krzakala, Emanuele Troiani

We prove closed-form equations for the exact high-dimensional asymptotics of a family of first-order gradient-based methods, learning an estimator (e.g., M-estimator, shallow neural network) from observations on Gaussian data with empirical risk minimizati ...

Society for Industrial & Applied Mathematics (SIAM)2024

Fast dynamic 1D simulation of divertor plasmas with neural PDE surrogates

Yoeri Renier Johannes Poels

Managing divertor plasmas is crucial for operating reactor scale tokamak devices due to heat and particle flux constraints on the divertor target. Simulation is an important tool to understand and control these plasmas, however, for real-time applications ...

IOP Publishing Ltd2023

The automated collapse data constructor technique and the data-driven methodology for seismic collapse risk assessment

Dimitrios Lignos, Alexandre Massoud Alahi, Nenad Bijelic

Majority of the past research on application of machine learning (ML) in earthquake engineering focused on contrasting the predictive performance of different ML algorithms. In contrast, the emphasis of this paper is on the use of data to boost the predict ...

WILEY2023

From tensor-network quantum states to tensorial recurrent neural networks

Giuseppe Carleo, Filippo Vicentini, Riccardo Rossi, Dian Wu

We show that any matrix product state (MPS) can be exactly represented by a recurrent neural network (RNN) with a linear memory update. We generalize this RNN architecture to two-dimensional lattices using a multilinear memory update. It supports perfect s ...

AMER PHYSICAL SOC2023

AMAE: Adaptation of Pre-trained Masked Autoencoder for Dual-Distribution Anomaly Detection in Chest X-Rays

Jean-Philippe Thiran, Seyedbehzad Bozorgtabar

Unsupervised anomaly detection in medical images such as chest radiographs is stepping into the spotlight as it mitigates the scarcity of the labor-intensive and costly expert annotation of anomaly data. However, nearly all existing methods are formulated ...

Springer International Publishing Ag2023

Measuring Complexity of Learning Schemes Using Hessian-Schatten Total Variation

Michaël Unser, Shayan Aziznejad, Joaquim Gonçalves Garcia Barreto Campos

2023

ESLAM: Efficient Dense SLAM System Based on Hybrid Representation of Signed Distance Fields

François Fleuret, Seyed Mohammad Mahdi Johari

We present ESLAM, an efficient implicit neural representation method for Simultaneous Localization and Mapping (SLAM). ESLAM reads RGB-D frames with unknown camera poses in a sequential manner and incrementally reconstructs the scene representation while e ...

Los Alamitos2023

Synthesis and Analysis of 3D shapes with Geometric Deep Learning in Computer-Aided Engineering

Edoardo Remelli

In this thesis, we advocate that Computer-Aided Engineering could benefit from a Geometric Deep Learning revolution, similarly to the way that Deep Learning revolutionized Computer Vision. To do so, we consider a variety of Computer-Aided Engineering pr ...

EPFL2022

A Compressor Off-Line Washing Schedule Optimization Method With a LSTM Deep Learning Model Predicting the Fouling Trend

Jinwei Chen

Compressor fouling is one of the most prevalent fault modes that contribute to the performance degradation of a gas turbine power plant. Off-line washing is a standard maintenance procedure to recover the fouling degradation, but with washing cost. In this ...

2022