Publications associées à Testing for Equivalence of Network Distribution Using Subgraph Counts

Gibbs sampling the posterior of neural networks

Giovanni Piccioli, Lenka Zdeborová, Emanuele Troiani

In this paper, we study sampling from a posterior derived from a neural network. We propose a new probabilistic model consisting of adding noise at every pre- and post-activation in the network, arguing that the resulting posterior can be sampled using an ...

Iop Publishing Ltd2024

Driving and suppressing the human language network using large language models

Martin Schrimpf

Transformer models such as GPT generate human-like language and are predictive of human brain responses to language. Here, using functional-MRI-measured brain responses to 1,000 diverse sentences, we first show that a GPT-based encoding model can predict t ...

Nature Portfolio2024

Statistical Inference for Inverse Problems: From Sparsity-Based Methods to Neural Networks

Pakshal Narendra Bohra

In inverse problems, the task is to reconstruct an unknown signal from its possibly noise-corrupted measurements. Penalized-likelihood-based estimation and Bayesian estimation are two powerful statistical paradigms for the resolution of such problems. They ...

EPFL2024

Task-driven neural network models predict neural dynamics of proprioception: Neural network model weights

Axel Bisi, Alberto Silvio Chiappa, Alexander Mathis, Alessandro Marin Vargas

Proprioception tells the brain the state of the body based on distributed sensors in the body. However, the principles that govern proprioceptive processing from those distributed sensors are poorly understood. Here, we employ a task-driven neural network ...

Zenodo2024

The Strong Integral Input-to-State Stability Property in Dynamical Flow Networks

Nils Gustav Nilsson

Dynamical flow networks serve as macroscopic models for, e.g., transportation networks, queuing networks, and distribution networks. While the flow dynamics in such networks follow the conservation of mass on the links, the outflow from each link is often ...

Ieee-Inst Electrical Electronics Engineers Inc2024

Generalization of Scaled Deep ResNets in the Mean-Field Regime

Volkan Cevher, Grigorios Chrysos, Fanghui Liu

Despite the widespread empirical success of ResNet, the generalization properties of deep ResNet are rarely explored beyond the lazy training regime. In this work, we investigate scaled ResNet in the limit of infinitely deep and wide neural networks, of wh ...

2024

Deep Learning Generalization with Limited and Noisy Labels

Mahsa Forouzesh

Deep neural networks have become ubiquitous in today's technological landscape, finding their way in a vast array of applications. Deep supervised learning, which relies on large labeled datasets, has been particularly successful in areas such as image cla ...

EPFL2023

Online interoperable resources for building hippocampal neuron models via the Hippocampus Hub

Felix Schürmann, Armando Romani, Michele Migliore, Luca Leonardo Bologna

To build biophysically detailed models of brain cells, circuits, and regions, a data-driven approach is increasingly being adopted. This helps to obtain a simulated activity that reproduces the experimentally recorded neural dynamics as faithfully as possi ...

2023

Differential Impact of Brain Network Efficiency on Poststroke Motor and Attentional Deficits

Dimitri Nestor Alice Van De Ville, Philip Egger, Nathalie Heidi Meyer, Elena Beanato, Gabriel Girard, Julia Brügger, Friedhelm Christoph Hummel, Takuya Morishita, Maximilian Jonas Wessel, Philipp Johannes Koch, Giorgia Giulia Evangelista, Andéol Geoffroy Cadic-Melchior, Lisa Aïcha Mireille Julie Fleury

Background:Most studies on stroke have been designed to examine one deficit in isolation; yet, survivors often have multiple deficits in different domains. While the mechanisms underlying multiple-domain deficits remain poorly understood, network-theoretic ...

2023

Scalable maximal subgraph mining with backbone-preserving graph convolutions

Karl Aberer, Quoc Viet Hung Nguyen, Thành Tâm Nguyên, Thanh Trung Huynh

Maximal subgraph mining is increasingly important in various domains, including bioinformatics, genomics, and chemistry, as it helps identify common characteristics among a set of graphs and enables their classification into different categories. Existing ...

ELSEVIER SCIENCE INC2023

Fundamental Limits in Statistical Learning Problems: Block Models and Neural Networks

Elisabetta Cornacchia

This thesis focuses on two selected learning problems: 1) statistical inference on graphs models, and, 2) gradient descent on neural networks, with the common objective of defining and analysing the measures that characterize the fundamental limits. In th ...

EPFL2023

Artificial Neural Network Training on an Optical Processor via Direct Feedback Alignment

Florent Gérard Krzakala, Julien Marcel Daniel Emmanuel Launay

Artificial Neural Networks (ANN) are habitually trained via the back-propagation (BP) algorithm. This approach has been extremely successful: Current models like GPT-3 have O(10 11 ) parameters, are trained on O(10 11 ) words and produce awe-inspiring resu ...

IEEE2023

Bayesian reconstruction of memories stored in neural networks from their connectivity

Florent Gérard Krzakala, Lenka Zdeborová

The advent of comprehensive synaptic wiring diagrams of large neural circuits has created the field of connectomics and given rise to a number of open research questions. One such question is whether it is possible to reconstruct the information stored in ...

2023

Modeling and simulation of neocortical micro- and mesocircuitry. Part II: Physiology and experimentation

Henry Markram, Felix Schürmann, James Gonzalo King, Rajnish Ranjan, Srikanth Ramaswamy, Alexis Arnaudon, Eilif Benjamin Muller, Daniel Keller, Michael Reimann, Vishal Sood, Jean-Denis Georges Emile Courcol, Werner Alfons Hilda Van Geit, Giuseppe Chindemi, Michael Emiel Gevaert, Pramod Shivaji Kumbhar, Armando Romani, Christian Andreas Rössert, Judit Planas Carbonell, Genrich Ivaska, András Ecker, Daniela Egas Santander, Natali Barros Zulaica, Alexander Dietz, Omar Awile, Samuel Lieven D. Lapere, Matthias Wolf, Sirio Bolaños Puchet, Thomas Brice Delemontex, Jorge Blanco Alonso, Mustafa Anil Tuncel, Tanguy Pierre Louis Damart, Maria Reva, James Bryden Isbister, Darshan Mandge, Weina Ji, Aleksandra Zuzanna Teska, Polina Litvak, Gianluca Ficarelli, Joni Henrikki Herttuainen, ,

Bed Topography Inference from Velocity Field Using Deep Learning

Christophe Ancey, Mehrdad Kiani Oshtorjani

Measuring bathymetry has always been a major scientific and technological challenge. In this work, we used a deep learning technique for inferring bathymetry from the depth-averaged velocity field. The training of the neural network is based on 5742 labora ...

2023

Predicting nonlinear optical scattering with physics-driven neural networks

Demetri Psaltis, Ahmed Ayoub, Carlo Gigli

Deep neural networks trained on physical losses are emerging as promising surrogates for nonlinear numerical solvers. These tools can predict solutions to Maxwell's equations and compute gradients of output fields with respect to the material and geometric ...

AIP Publishing2023

Estimating and Improving the Robustness of Attributions in Text

Ádám Dániel Ivánkay

End-to-end learning methods like deep neural networks have been the driving force in the remarkable progress of machine learning in recent years. However, despite their success, the deployment process of such networks in safety-critical use cases, such as ...

EPFL2023

Topologically Better Delineation of Curvilinear Structures

Doruk Oner

Curvilinear structures are frequently observed in a variety of domains and are essential for comprehending neural circuits, detecting fractures in materials, and determining road and irrigation canal networks. It can be costly and time-consuming to manuall ...

EPFL2023

Power Transformer Fault Diagnosis Using Neural Network Optimization Techniques

Dimitrios Kaminaris

Artificial Intelligence (AI) techniques are considered the most advanced approaches for diagnosing faults in power transformers. Dissolved Gas Analysis (DGA) is the conventional approach widely adopted for diagnosing incipient faults in power transformers. ...

MDPI2023

Supervised learning and inference of spiking neural networks with temporal coding

Ana Stanojevic

The way biological brains carry out advanced yet extremely energy efficient signal processing remains both fascinating and unintelligible. It is known however that at least some areas of the brain perform fast and low-cost processing relying only on a smal ...

EPFL2023