Large-scale neural networks implemented with nonvolatile memory as the synaptic weight element: comparative performance analysis (accuracy, speed, and power)

À propos
Confidentialité
Mentions légales

Graph Chatbot

Publications associées (30)

An exact mapping from ReLU networks to spiking neural networks

Wulfram Gerstner, Stanislaw Andrzej Wozniak, Angeliki Pantazi, Ana Stanojevic, Giovanni Cherubini

Deep spiking neural networks (SNNs) offer the promise of low-power artificial intelligence. However, training deep SNNs from scratch or converting deep artificial neural networks to SNNs without loss of performance has been a challenge. Here we propose an ...

2023

Scale-Aware Test-Time Click Adaptation for Pulmonary Nodule and Mass Segmentation

Bo Du, Li Zhang, Zhigang Li, Jiancheng Yang

Pulmonary nodules and masses are crucial imaging features in lung cancer screening that require careful management in clinical diagnosis. Despite the success of deep learning-based medical image segmentation, the robust performance on various sizes of lesi ...

Springer International Publishing Ag2023

Modeling and simulation of neocortical micro- and mesocircuitry. Part II: Physiology and experimentation

Henry Markram, Felix Schürmann, James Gonzalo King, Rajnish Ranjan, Srikanth Ramaswamy, Alexis Arnaudon, Eilif Benjamin Muller, Daniel Keller, Michael Reimann, Vishal Sood, Jean-Denis Georges Emile Courcol, Werner Alfons Hilda Van Geit, Giuseppe Chindemi, Michael Emiel Gevaert, Pramod Shivaji Kumbhar, Armando Romani, Christian Andreas Rössert, Judit Planas Carbonell, Genrich Ivaska, András Ecker, Daniela Egas Santander, Natali Barros Zulaica, Alexander Dietz, Omar Awile, Samuel Lieven D. Lapere, Matthias Wolf, Sirio Bolaños Puchet, Thomas Brice Delemontex, Jorge Blanco Alonso, Mustafa Anil Tuncel, Tanguy Pierre Louis Damart, Maria Reva, James Bryden Isbister, Darshan Mandge, Weina Ji, Aleksandra Zuzanna Teska, Polina Litvak, Gianluca Ficarelli, Joni Henrikki Herttuainen, ,

Hardware-Software co-design Methodologies for Edge AI Optimization

Flavio Ponzina

ML-based edge devices may face memory and computational errors that affect applications' reliability and performance. These errors can be the result of particular working conditions (e.g., radiation areas in physical experiments or avionics) or could be th ...

EPFL2023

Towards Stable and Efficient Adversarial Training against $l_1$ Bounded Adversarial Attacks

Mathieu Salzmann, Sabine Süsstrunk, Chen Liu, Zhuoyi Huang, Yulun Jiang

We address the problem of stably and efficiently training a deep neural network robust to adversarial perturbations bounded by an

l_1

norm. We demonstrate that achieving robustness against

l_1

-bounded perturbations is more challenging than in the

l_2

...

2023

Bayesian reconstruction of memories stored in neural networks from their connectivity

Florent Gérard Krzakala, Lenka Zdeborová

The advent of comprehensive synaptic wiring diagrams of large neural circuits has created the field of connectomics and given rise to a number of open research questions. One such question is whether it is possible to reconstruct the information stored in ...

2023

On double-descent in uncertainty quantification in overparametrized models

Florent Gérard Krzakala, Lenka Zdeborová, Bruno Loureiro, Lucas Andry Clarte, Bruno Loureiro

Uncertainty quantification is a central challenge in reliable and trustworthy machine learning. Naive measures such as last-layer scores are well-known to yield overconfident estimates in the context of overparametrized neural networks. Several methods, ra ...

PMLR Proceedings of Machine Learning Research2023

Acceleration of Control Intensive Applications on Coarse-Grained Reconfigurable Arrays for Embedded Systems

David Atienza Alonso, Benoît Walter Denkinger, Miguel Peon Quiros

Embedded systems confront two opposite goals: low-power operation and high performance. The current trend to reach these goals is toward heterogeneous platforms, including multi-core architectures with heterogeneous cores and hardware accelerators. The lat ...

2023

From event-based surprise to lifelong learning. A journey in the timescales of adaptation

Martin Louis Lucien Rémy Barry

Humans and animals constantly adapt to their environment over the course of their life. This thesis seeks to integrate various timescales of adaptation, ranging from the adaptation of synaptic connections between spiking neurons (milliseconds), rapid behav ...

EPFL2023

Layer-Wise Learning Framework for Efficient DNN Deployment in Biomedical Wearable Systems

David Atienza Alonso, Amir Aminifar, Saleh Baghersalimi, Tomas Teijeiro Campo, Alireza Amirshahi

The development of low-power wearable systems requires specialized techniques to accommodate their unique requirements and constraints. While significant advancements have been made in the inference phase of artificial intelligence, the training phase rema ...

2023

Page 2 sur 2

Christoph Pokorny

Elvis Boci

Cortical dynamics underlie many cognitive processes and emerge from complex multi-scale interactions, which are challenging to study in vivo. Large-scale, biophysically detailed models offer a tool which can complement laboratory approaches. We present a m ...

2024