Mediaspace scheduled maintenance: Aug 25, 2026 07:00 - 12:00 AM. During this time, videos will be temporarily unavailable. Check status updates.

Home

Publication

Large-scale neural networks implemented with nonvolatile memory as the synaptic weight element: comparative performance analysis (accuracy, speed, and power)

About
Privacy
Disclaimer

Graph Chatbot

Related publications (47)

Page 2 of 3

Supervised learning and inference of spiking neural networks with temporal coding

Ana Stanojevic

The way biological brains carry out advanced yet extremely energy efficient signal processing remains both fascinating and unintelligible. It is known however that at least some areas of the brain perform fast and low-cost processing relying only on a smal ...

EPFL2023

Towards Scalable Electronics: Synthetic 2D Materials for Large-Area 2D Circuit Integration

Zhenyu Wang

In the past decades, a significant increase of the transistor density on a chip has led to exponential growth in computational power driven by Moore's law. To overcome the bottleneck of traditional von-Neumann architecture in computational efficiency, effo ...

EPFL2024

Rebooting Virtual Memory with Midgard

Siddharth Gupta

Virtual Memory (VM) is a critical programming abstraction that is widely used in various modern computing platforms. With the rise of datacenter computing and birth of planet-scale online services, the semantic and capacity requirements from memory have ev ...

EPFL2023

Beyond Essentials: Nuanced and Diverse Text-to-video Retrieval

Yuchen Yang

The field of text-to-video retrieval has advanced significantly with the evolution of language models and large-scale pre-training on generated caption-video pairs. Current methods predominantly focus on visual and event-based details, making retrieval lar ...

Institute of Electrical and Electronics Engineers Inc.2024

Exploring neural networks and their potential for species distribution modeling

Devis Tuia, Benjamin Alexander Kellenberger, Nina Marion Aurélia Van Tiel, Lloyd Haydn Hughes, Robin Adrien Zbinden

Species distribution models (SDMs) relate species occurrence data with environmental variables and are used to understand and predict species distributions across landscapes. While some machine learning models have been adopted by the SDM community, recent ...

2023

Deep Learning Theory Through the Lens of Diagonal Linear Networks

Scott William Pesme

In this PhD manuscript, we explore optimisation phenomena which occur in complex neural networks through the lens of

2

-layer diagonal linear networks. This rudimentary architecture, which consists of a two layer feedforward linear network with a diagonal ...

EPFL2024

A theory of memory consolidation and synaptic pruning in cortical circuits

Georgios Iatropoulos

Over the course of a lifetime, the human brain acquires an astonishing amount of semantic knowledge and autobiographical memories, often with an imprinting strong enough to allow detailed information to be recalled many years after the initial learning exp ...

EPFL2023

Surface segregation in high-entropy alloys from alchemical machine learning

Michele Ceriotti, Sandip De, Guillaume André Jean Fraux, Arslan Mazitov, Nataliya Lopanitsyna

High-entropy alloys (HEAs), containing several metallic elements in near-equimolar proportions, have long been of interest for their unique mechanical properties. More recently, they have emerged as a promising platform for the development of novel heterog ...

Iop Publishing Ltd2024

How deep convolutional neural networks lose spatial information with training

Matthieu Wyart, Leonardo Petrini, Francesco Cagnetta, Umberto Maria Tomasini

A central question of machine learning is how deep nets manage to learn tasks in high dimensions. An appealing hypothesis is that they achieve this feat by building a representation of the data where information irrelevant to the task is lost. For image da ...

Iop Publishing Ltd2023

Learning to Boost the Performance of Stable Nonlinear Systems

Giancarlo Ferrari Trecate, Luca Furieri, Clara Lucía Galimberti

The growing scale and complexity of safety-critical control systems underscore the need to evolve current control architectures aiming for the unparalleled performances achievable through state-of-the-art optimization and machine learning algorithms. Howev ...

2024

Task-driven neural network models predict neural dynamics of proprioception: Neural network model weights

Alexander Mathis, Alberto Silvio Chiappa, Alessandro Marin Vargas, Axel Bisi

Proprioception tells the brain the state of the body based on distributed sensors in the body. However, the principles that govern proprioceptive processing from those distributed sensors are poorly understood. Here, we employ a task-driven neural network ...

Zenodo2024

Scale-Aware Test-Time Click Adaptation for Pulmonary Nodule and Mass Segmentation

Li Zhang, Jiancheng Yang

Pulmonary nodules and masses are crucial imaging features in lung cancer screening that require careful management in clinical diagnosis. Despite the success of deep learning-based medical image segmentation, the robust performance on various sizes of lesi ...

Springer International Publishing Ag2023

Modeling and simulation of neocortical micro- and mesocircuitry. Part II: Physiology and experimentation

Weina Ji, Henry Markram, Felix Schürmann, Daniel Keller, Eilif Benjamin Muller, Michael Reimann, Werner Alfons Hilda Van Geit, Srikanth Ramaswamy, Matthias Wolf, James Gonzalo King, Alexis Arnaudon, András Ecker, Rajnish Ranjan, Jean-Denis Georges Emile Courcol, Armando Romani, Pramod Shivaji Kumbhar, Judit Planas Carbonell, Giuseppe Chindemi, Michael Emiel Gevaert, Christian Andreas Rössert, Fernando Joaquim Leite Pereira, Omar Awile, Mustafa Anil Tuncel, Daniela Egas Santander, James Bryden Isbister, Natali Barros Zulaica, Samuel Lieven D. Lapere, Sirio Bolaños Puchet, Maria Reva, Genrich Ivaska, Tanguy Pierre Louis Damart, Darshan Mandge, Joni Henrikki Herttuainen, Christoph Pokorny, Elvis Boci, Vishal Sood, Thomas Brice Delemontex, Aleksandra Zuzanna Teska, Polina Litvak, Alexander Dietz, Jorge Blanco Alonso, Gianluca Ficarelli

Cortical dynamics underlie many cognitive processes and emerge from complex multi-scale interactions, which are challenging to study in vivo. Large-scale, biophysically detailed models offer a tool which can complement laboratory approaches. We present a m ...

2024

Generalization of Scaled Deep ResNets in the Mean-Field Regime

Volkan Cevher, Grigorios Chrysos, Fanghui Liu

Despite the widespread empirical success of ResNet, the generalization properties of deep ResNet are rarely explored beyond the lazy training regime. In this work, we investigate scaled ResNet in the limit of infinitely deep and wide neural networks, of wh ...

2024

Live-cell imaging powered by computation

Suliana Manley

The proliferation of microscopy methods for live-cell imaging offers many new possibilities for users but can also be challenging to navigate. The prevailing challenge in live-cell fluorescence microscopy is capturing intra-cellular dynamics while preservi ...

Nature Portfolio2024

Hardware-Software co-design Methodologies for Edge AI Optimization

Flavio Ponzina

ML-based edge devices may face memory and computational errors that affect applications' reliability and performance. These errors can be the result of particular working conditions (e.g., radiation areas in physical experiments or avionics) or could be th ...

EPFL2023

Towards Stable and Efficient Adversarial Training against $l_1$ Bounded Adversarial Attacks

Sabine Süsstrunk, Mathieu Salzmann, Chen Liu, Yulun Jiang

We address the problem of stably and efficiently training a deep neural network robust to adversarial perturbations bounded by an

l_1

norm. We demonstrate that achieving robustness against

l_1

-bounded perturbations is more challenging than in the

l_2

...

2023

Bayesian reconstruction of memories stored in neural networks from their connectivity

Lenka Zdeborová, Florent Gérard Krzakala

The advent of comprehensive synaptic wiring diagrams of large neural circuits has created the field of connectomics and given rise to a number of open research questions. One such question is whether it is possible to reconstruct the information stored in ...

2023

2D Nanosystems: Applications of 2D Semiconductors for In-Memory Computing

Guilherme Migliato Marega

Machine learning and data processing algorithms have been thriving in finding ways of processing and classifying information by exploiting the hidden trends of large datasets. Although these emerging computational methods have become successful in today's ...

EPFL2023

An exact mapping from ReLU networks to spiking neural networks

Wulfram Gerstner, Stanislaw Andrzej Wozniak, Angeliki Pantazi, Guillaume Emmanuel Fernand Bellec, Ana Stanojevic

Deep spiking neural networks (SNNs) offer the promise of low-power artificial intelligence. However, training deep SNNs from scratch or converting deep artificial neural networks to SNNs without loss of performance has been a challenge. Here we propose an ...

2023