Recherche

Afficher tous les résultats pour

Accueil

Publication

Coupled neural associative memories

À propos
Confidentialité
Mentions légales

Graph Chatbot

Publications associées (44)

Page 2 sur 3

Generalization of Scaled Deep ResNets in the Mean-Field Regime

Volkan Cevher, Grigorios Chrysos, Fanghui Liu

Despite the widespread empirical success of ResNet, the generalization properties of deep ResNet are rarely explored beyond the lazy training regime. In this work, we investigate scaled ResNet in the limit of infinitely deep and wide neural networks, of wh ...

2024

Driving and suppressing the human language network using large language models

Martin Schrimpf

Transformer models such as GPT generate human-like language and are predictive of human brain responses to language. Here, using functional-MRI-measured brain responses to 1,000 diverse sentences, we first show that a GPT-based encoding model can predict t ...

Nature Portfolio2024

Infinite-width limit of deep linear neural networks

Maria Colombo, Xavier Fernandez-Real Girona, Lénaïc Chizat

This paper studies the infinite-width limit of deep linear neural networks (NNs) initialized with random parameters. We obtain that, when the number of parameters diverges, the training dynamics converge (in a precise sense) to the dynamics obtained from a ...

Hoboken2024

Gibbs sampling the posterior of neural networks

Lenka Zdeborová, Emanuele Troiani, Giovanni Piccioli

In this paper, we study sampling from a posterior derived from a neural network. We propose a new probabilistic model consisting of adding noise at every pre- and post-activation in the network, arguing that the resulting posterior can be sampled using an ...

Iop Publishing Ltd2024

Mitigating Object Dependencies: Improving Point Cloud Self-Supervised Learning through Object Exchange

Sabine Süsstrunk, Mathieu Salzmann, Tong Zhang

In the realm of point cloud scene understanding, particularly in indoor scenes, objects are arranged following human habits, resulting in objects of certain semantics being closely positioned and displaying notable inter-object correlations. This can creat ...

2024

Navigating the Loop: From Control Systems to Neural Networks and Back

Clara Lucía Galimberti

The work presented in this thesis lies at the intersection of Machine Learning (ML) and control theory. The first part is dedicated to the design of Deep Neural Network (DNN) architectures with specific numerical properties, inspired by dynamical systems m ...

EPFL2024

Incorporating Projective Geometry into Deep Learning

Michal Jan Tyszkiewicz

In this thesis we explore the applications of projective geometry, a mathematical theory of the relation between 3D scenes and their 2D images, in modern learning-based computer vision systems. This is an interesting research question which contradicts the ...

EPFL2024

Probing and modulating inter-areal coupling in the cortical visual motion processing pathway with non-invasive brain stimulation

Michele Bevilacqua

In the last few years, stroke ranked as the second most common cause of death and is the third most significant condition affecting disability-adjusted life years (DALYs) worldwide. Being the most prevalent and quality of life impacting post-stroke symptom ...

EPFL2024

Serial Dependence in Human Visual Perception and Decision-Making

Gizay Ceylan

Decisions about a current visual stimulus are systematically biased by recently encountered stimuli, a phenomenon known as serial dependence. In human vision, for instance, we tend to report the features of current images as more similar â i.e., an attra ...

EPFL2024

The neural correlates of topographical disorientation-a lesion analysis study

Olaf Blanke, Lukas Heydrich, Eva Blondiaux

Topographical disorientation refers to the selective inability to orient oneself in familiar surroundings. However, to date its neural correlates remain poorly understood. Here we use quantitative lesion analysis and a lesion network mapping approach in or ...

Wiley2024

A graph convolutional autoencoder approach to model order reduction for parametrized PDEs

Jan Sickmann Hesthaven, Federico Pichi

The present work proposes a framework for nonlinear model order reduction based on a Graph Convolutional Autoencoder (GCA-ROM). In the reduced order modeling (ROM) context, one is interested in obtaining real -time and many-query evaluations of parametric ...

Academic Press Inc Elsevier Science2024

Unraveling behavior and cortical signals to guide the development of soft neuroprostheses for auditory restoration and spreading depolarization

Emilie Cornelia Maria Revol

Neuroprostheses have been used clinically for decades, to help restore or preserve brain functions, when pharmaceutical treatments are inefficient. Although great progress in the field has been made over the years to interface with the nervous system, surf ...

EPFL2024

Decoding electroencephalographic responses to visual stimuli compatible with electrical stimulation

Silvestro Micera, Laura Toni, Fiorenzo Artoni, Simone Romeni

Electrical stimulation of the visual nervous system could improve the quality of life of patients affected by acquired blindness by restoring some visual sensations, but requires careful optimization of stimulation parameters to produce useful perceptions. ...

Aip Publishing2024

Safe Deep Neural Networks

Kyle Michael Matoba

The capabilities of deep learning systems have advanced much faster than our ability to understand them. Whilst the gains from deep neural networks (DNNs) are significant, they are accompanied by a growing risk and gravity of a bad outcome. This is troubli ...

EPFL2024

Network time series forecasting in photovoltaics power production

Jelena Simeunovic

Accurate forecasting of photovoltaic (PV) power production is crucial for the integration of more renewable energy sources into the power grid. PV power production is highly intermittent, due to the stochastic cloud behaviour and cloud dynamics. Previous w ...

EPFL2024

On the number of regions of piecewise linear neural networks

Michaël Unser, Alexis Marie Frederic Goujon

Many feedforward neural networks (NNs) generate continuous and piecewise-linear (CPWL) mappings. Specifically, they partition the input domain into regions on which the mapping is affine. The number of these so-called linear regions offers a natural metric ...

2024

Weak correlations between visual abilities in healthy older adults, despite long-term performance stability

Michael Herzog, Simona Adele Garobbio

Using batteries of visual tests, most studies have found that there are only weak correlations between the performance levels of the tests. Factor analysis has confirmed these results. This means that a participant excelling in one test may rank low in ano ...

2024

Digital Twin Generalization with Meta and Geometric Deep Learning

Olga Fink, Raffael Pascal Theiler

Deep digital twins (DDTs) are deep neural networks that encode the behavior of complex physical systems. DDTs are excellent system representations due to their ability to continuously adapt to operational changes and their capability to capture complex rel ...

Prognostics and Health Management Society2024

Aggregating Spatial and Photometric Context for Photometric Stereo

David Honzátko

Photometric stereo, a computer vision technique for estimating the 3D shape of objects through images captured under varying illumination conditions, has been a topic of research for nearly four decades. In its general formulation, photometric stereo is an ...

EPFL2024

Infusing structured knowledge priors in neural models for sample-efficient symbolic reasoning

Mattia Atzeni

The ability to reason, plan and solve highly abstract problems is a hallmark of human intelligence. Recent advancements in artificial intelligence, propelled by deep neural networks, have revolutionized disciplines like computer vision and natural language ...

EPFL2024