Phase diagram of stochastic gradient descent in high-dimensional two-layer neural networks

About
Privacy
Disclaimer

Graph Chatbot

Related publications (27)

Page 2 of 2

EdgeFace: Efficient Face Recognition Model for Edge Devices

Hatef Otroshi Shahreza

In this paper, we present EdgeFace - a lightweight and efficient face recognition network inspired by the hybrid architecture of EdgeNeXt. By effectively combining the strengths of both CNN and Transformer models, and a low rank linear layer, EdgeFace achi ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2024

Fast learning without synaptic plasticity in spiking neural networks

Guillaume Emmanuel Fernand Bellec

Spiking neural networks are of high current interest, both from the perspective of modelling neural networks of the brain and for porting their fast learning capability and energy efficiency into neuromorphic hardware. But so far we have not been able to r ...

Nature Portfolio2024

A journey toward generalizable trajectory forecasting models

Mohammadhossein Bahari

Autonomous driving is a revolutionary technology that has seen considerable advancements through the adoption of deep learning solutions. One of the major challenges in this field is the interaction with other road users. This interaction necessitates a "t ...

EPFL2024

Normal Contact Force Estimation Using Deep Learning

Yves Perriard, Paolo Germano, Xinxin Liao, Marc Michel Charles Favier

Small scale ultrasonic piezoelectric actuators performance strongly depends on not well-known contact dynamics. Deep Neural Network (DNN) sees their use in physic simulation growing as their flexibility allows better performance especially when dynamics la ...

Institute of Electrical and Electronics Engineers Inc.2024

Machine Learning for Screening Small Molecules as Passivation Materials for Enhanced Perovskite Solar Cells

Mohammad Khaja Nazeeruddin, Bin Ding, Xianfu Zhang

Utilization of small molecules as passivation materials for perovskite solar cells (PSCs) has gained significant attention recently, with hundreds of small molecules demonstrating passivation effects. In this study, a high-accuracy machine learning model i ...

Wiley-VCH Verlag Gmbh2024

An exact mapping from ReLU networks to spiking neural networks

Wulfram Gerstner, Stanislaw Andrzej Wozniak, Angeliki Pantazi, Guillaume Emmanuel Fernand Bellec, Ana Stanojevic

Deep spiking neural networks (SNNs) offer the promise of low-power artificial intelligence. However, training deep SNNs from scratch or converting deep artificial neural networks to SNNs without loss of performance has been a challenge. Here we propose an ...

2023

Leveraging Unlabeled Data to Track Memorization

Patrick Thiran, Mahsa Forouzesh

Deep neural networks may easily memorize noisy labels present in real-world data, which degrades their ability to generalize. It is therefore important to track and evaluate the robustness of models against noisy label memorization. We propose a metric, ca ...

2023