Publications related to Teaching optics to a machine learning network

Related publications (42)

Machine learning enhanced atom probe tomography analysis

Atom probe tomography (APT) is a burgeoning characterization technique that provides compositional mapping of materials in three-dimensions at near-atomic scale. Since its significant expansion in the past 30 years, we estimate that one million APT dataset ...

2026

Neural networks trained with SGD learn distributions of increasing complexity

Maria Refinetti

The uncanny ability of over-parameterised neural networks to generalise well has been explained using various ‘simplicity biases’. These theories postulate that neural networks avoid overfitting by first fitting simple, linear classifiers before learning m ...

2025

Hadamard product in deep learning: Introduction, Advances and Challenges

Volkan Cevher, Yongtao Wu

While convolution and self-attention mechanisms have dominated architectural design in deep learning, this survey examines a fundamental yet understudied primitive: the Hadamard product. Despite its widespread implementation across various applications, th ...

2025

Enhancing Lift and Dynamic Stability Through Morphological Optimization of Wings for Tailless Flapping-Wing Robots

Josephine Anna Eleanor Hughes

The design of wings is crucial for tailless Flapping-wing robots (FWRs), as these robots rely exclusively on their wings for lift generation and body control. However, the current methodology for wing design primarily depends on the experience and heuristi ...

2025

Robustly Learning Regions of Attraction From Fixed Data

Colin Neil Jones

While stability analysis is a mainstay for control science, especially computing regions of attraction of equilibrium points, until recently most stability analysis tools always required explicit knowledge of the model or a high-fidelity simulator represen ...

2025

Representing and machine learning complex electronic-structure properties of materials

Austin Jacob Zadoks

The rise of high-throughput first-principles calculations of materials since the turn of the millennium has gifted the fields of physics, quantum chemistry, and materials science with a mountainous and ever-growing pile of data ready to be mined for hidden ...

EPFL2025

A High Dimensional Statistical Model for Adversarial Training: Geometry and Trade-Offs

Florent Gérard Krzakala, Bruno Loureiro, Matteo Vilucchio

This work investigates adversarial training in the context of margin-based linear classifiers in the high-dimensional regime where the dimension d and the number of data points n diverge with a fixed ratio α = n/d. We introduce a tractable mathematical mod ...

2025

The Galaxy Activity, Torus, and Outflow Survey (GATOS) VI. Black hole mass estimation using machine learning

Rémi Henri Philippe Poitevineau

The detailed feeding and feedback mechanisms of active galactic nuclei (AGNs) are not yet well known. For low-luminosity AGNs, obscured AGNs, and late-type galaxies, the masses of their central black holes (BH) are difficult to determine precisely. Our goa ...

EDP SCIENCES S A2025

Identifying storytelling in job interviews using deep learning

Mutian He

Structured interviews often include past-behavior questions inviting applicants to recount a past work experience. While optimal responses to these questions should take the form of a story, applicants struggle to produce them extemporaneously. Asynchronou ...

2025

Songdo Vision: Vehicle Annotations from High-Altitude BeV Drone Imagery in a Smart City

Nikolaos Geroliminis, Robert Fonod

The Songdo Vision dataset provides high-resolution (4K, 3840×2160 pixels) RGB images annotated with categorized axis-aligned bounding boxes (BBs) for vehicle detection from a high-altitude bird’s-eye view (BeV) perspective. Captured over Songdo Internation ...

Zenodo2025

Task-driven neural network models predict neural dynamics of proprioception: Neural network model weights

Alexander Mathis, Alberto Silvio Chiappa, Alessandro Marin Vargas, Axel Bisi

Proprioception tells the brain the state of the body based on distributed sensors in the body. However, the principles that govern proprioceptive processing from those distributed sensors are poorly understood. Here, we employ a task-driven neural network ...

Zenodo2024

On the number of regions of piecewise linear neural networks

Michaël Unser, Alexis Marie Frederic Goujon

Many feedforward neural networks (NNs) generate continuous and piecewise-linear (CPWL) mappings. Specifically, they partition the input domain into regions on which the mapping is affine. The number of these so-called linear regions offers a natural metric ...

2024

Task-driven neural network models predict neural dynamics of proprioception: Experimental data, activations and predictions of neural network models

Alexander Mathis, Alberto Silvio Chiappa, Alessandro Marin Vargas, Axel Bisi

Here we provide the neural data, activation and predictions for the best models and result dataframes of our article "Task-driven neural network models predict neural dynamics of proprioception". It contains the behavioral and neural experimental data (cu ...

EPFL Infoscience2024

Performing and Detecting Backdoor Attacks on Face Recognition Algorithms

Alexander Carl Unnervik

The field of biometrics, and especially face recognition, has seen a wide-spread adoption the last few years, from access control on personal devices such as phones and laptops, to automated border controls such as in airports. The stakes are increasingly ...

EPFL2024

Topics in statistical physics of high-dimensional machine learning

Hugo Chao Cui

In the past few years, Machine Learning (ML) techniques have ushered in a paradigm shift, allowing the harnessing of ever more abundant sources of data to automate complex tasks. The technical workhorse behind these important breakthroughs arguably lies in ...

EPFL2024

Gibbs sampling the posterior of neural networks

Lenka Zdeborová, Emanuele Troiani, Giovanni Piccioli

In this paper, we study sampling from a posterior derived from a neural network. We propose a new probabilistic model consisting of adding noise at every pre- and post-activation in the network, arguing that the resulting posterior can be sampled using an ...

Iop Publishing Ltd2024

Monitoring of water volume in a porous reservoir using seismic data: A 3D simulation study

Jan Sickmann Hesthaven

A potential framework to estimate the volume of water stored in a porous storage reservoir from seismic data is neural networks. In this study, the man-made groundwater reservoir is modeled as a coupled poroviscoelastic–viscoelastic medium, and the underly ...

2024

Robust machine learning for neuroscientific inference

Steffen Schneider

Modern neuroscience research is generating increasingly large datasets, from recording thousands of neurons over long timescales to behavioral recordings of animals spanning weeks, months, or even years. Despite a great variety in recording setups and expe ...

EPFL2024

Deep Learning Theory Through the Lens of Diagonal Linear Networks

Scott William Pesme

In this PhD manuscript, we explore optimisation phenomena which occur in complex neural networks through the lens of

2

-layer diagonal linear networks. This rudimentary architecture, which consists of a two layer feedforward linear network with a diagonal ...

EPFL2024

Error assessment of an adaptive finite elements-neural networks method for an elliptic parametric PDE

Maude Girardin, Marco Picasso, Alexandre Caboussat

We present a finite elements-neural network approach for the numerical approximation of parametric partial differential equations. The algorithm generates training data from finite element simulations, and uses a data -driven (supervised) feedforward neura ...

Elsevier Science Sa2024