Publications associées à The Benefits of Reusing Batches for Gradient Descent in Two-Layer Networks: Breaking the Curse of Information and Leap Exponents

Publications associées (23)

Stop Wasting your Cache! Bringing Machine Learning into Cache Computing

The rapid evolution of Machine Learning (ML) workloads, particularly Deep Neural Networks (DNNs) and Transformer-based models, has intensified demands on computing architectures, highlighting the limitations of traditional von Neumann systems due to the me ...

ACM2025

Behaviorally Relevant Information Content in Interneuron Activity

Mahsa Barzegarkeshteli

The nematode Caenorhabditis elegans offers a uniquely tractable model for studying the relationships between neuronal activity, connectivity, and behavior. Despite its simplicity, key questions remain about how information flows through its nervous system ...

EPFL2025

Speech Data Selection for Efficient ASR Fine-Tuning using Domain Classifier and Pseudo-Label Filtering

Juan Pablo Zuluaga Gomez

In real-world speech data processing, the scarcity of annotated data and the abundance of unlabelled speech data present a significant challenge. To address this, we propose an efficient data selection pipeline for fine-tuning ASR models by generating pseu ...

Institute of Electrical and Electronics Engineers Inc.2025

Global Group Fairness in Federated Learning via Function Tracking

Daniel Kuhn, Yves Rychener, Yifan Hu

We investigate group fairness regularizers in federated learning, aiming to train a globally fair model in a distributed setting. Ensuring global fairness in distributed training presents unique challenges, as fairness regularizers typically involve probab ...

2025

Engineering of stable and functional metalloproteins using evolutionary computation, deep learning and simulation

Simon Leonard Dürr

Metal ions are indispensable cofactors for many proteins and play crucial roles in numerous biological processes, yet the computational design of metalloproteins and the optimization of metal coordination sites poses significant challenges due to the comp ...

EPFL2025

Gaussian universality of perceptrons with random labels

Lenka Zdeborová, Florent Gérard Krzakala, Bruno Loureiro, Ludovic Théo Stephan, Federica Gerace

While classical in many theoretical settings-and in particular in statistical physics-inspired works-the assumption of Gaussian i.i.d. input data is often perceived as a strong limitation in the context of statistics and machine learning. In this study, we ...

Amer Physical Soc2024

Euclid: Testing photometric selection of emission-line galaxy targets?

Frédéric Courbin, Georges Meylan

Multi-object spectroscopic galaxy surveys typically make use of photometric and colour criteria to select their targets. That is not the case of Euclid, which will use the NISP slitless spectrograph to record spectra for every source over its field of view ...

2024

Brief Announcement: A Case for Byzantine Machine Learning

Rachid Guerraoui, Nirupam Gupta, Rafaël Benjamin Pinot, Sadegh Farhadkhani

The success of machine learning (ML) has been intimately linked with the availability of large amounts of data, typically collected from heterogeneous sources and processed on vast networks of computing devices (also called workers). Beyond accuracy, the u ...

ACM2024

Nissl_5, Raw images for Machine learning for histological annotation and quantification of cortical layers

Julie Meystre

This dataset contains images (TIFF image data) of brain juvenile rats Wistar Han (P14) scanned immunostained slides by using an automated slide scanner (Olympus, VS120-L100, GER) equipped with a UPLSAPO 20x/0.75 air objective (Olympus, GER) and a Pike F5 ...

Zenodo2024

Ethological computational psychiatry: Challenges and opportunities

Mackenzie Mathis

Studying the intricacies of individual subjects' moods and cognitive processing over extended periods of time presents a formidable challenge in medicine. While much of systems neuroscience appropriately focuses on the link between neural circuit functions ...

Current Biology Ltd2024

Calibrated Adaptive Teacher for Domain Adaptive Intelligent Fault Diagnosis

Olga Fink, Florent Evariste Forest

Intelligent Fault Diagnosis (IFD) based on deep learning has proven to be an effective and flexible solution, attracting extensive research. Deep neural networks can learn rich representations from vast amounts of representative labeled data for various ap ...

2023

Miniaturised, Wireless and Distributed Neural Interface Toward Cortical Visual Prosthesis

Gian Luca Barbruni

Over the last decades, implantable neural interfaces have been extensively explored and effectively deployed to address neurological and mental health disorders. The existing solutions present several limitations. Firstly, the physical size of the implanta ...

EPFL2023

Saliency prediction in 360° architectural scenes: Performance and impact of daylight variations

Marilyne Andersen, Sabine Süsstrunk, Caroline Karmann, Kynthia Chamilothori, Seungryong Kim, Bahar Aydemir

Saliency models are image-based prediction models that estimate human visual attention. Such models, when applied to architectural spaces, could pave the way for design decisions where visual attention is taken into account. In this study, we tested the pe ...

2023

Deep learning-based galaxy image deconvolution

Frédéric Courbin, Pascale Jablonka, Utsav Akhaury

With the onset of large-scale astronomical surveys capturing millions of images, there is an increasing need to develop fast and accurate deconvolution algorithms that generalize well to different images. A powerful and accessible deconvolution method woul ...

FRONTIERS MEDIA SA2022

Offshore wind farm wake modelling using deep feed forward neural networks for active yaw control and layout optimisation

Sokratis Anagnostopoulos

Offshore wind farm modelling has been an area of rapidly increasing interest over the last two decades, with numerous analytical as well as computational-based approaches developed, in an attempt to produce designs that improve wind farm efficiency in powe ...

IOP PUBLISHING LTD2022

Differentiation of materials and laser powder bed fusion processing regimes from airborne acoustic emission combined with machine learning

Roland Logé, Hossein Ghasemi Tabasi, Rita Drissi Daoudi

This study investigates the use of a low cost microphone combined with state-of-the-art machine learning (ML) algorithms as online process monitoring to differentiate various materials and process regimes of Laser-Powder Bed Fusion (LPBF). Three processing ...

TAYLOR & FRANCIS LTD2022

Discovery of Slow Variables in a Class Of Multiscale Stochastic Systems Via Neural Networks

Przemyslaw Zielinski, Jan Sickmann Hesthaven

Finding a reduction of complex, high-dimensional dynamics to its essential, low-dimensional "heart" remains a challenging yet necessary prerequisite for designing efficient numerical approaches. Machine learning methods have the potential to provide a gene ...

2022

Non-Structured DNN Weight Pruning--Is It Beneficial in Any Platform?

Shaokai Ye

Large deep neural network (DNN) models pose the key challenge to energy efficiency due to the significantly higher energy consumption of off-chip DRAM accesses than arithmetic or SRAM operations. It motivates the intensive research on model compression wit ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2022

PlaceNet: A multi-scale semantic-aware model for visual loop closure detection

Hussein Fadl Hassan Hassan Osman

Loop closure detection helps simultaneous localization and mapping systems reduce map and state uncertainty via recognizing previously visited places along the path of a mobile robot. However, visual loop closure detection is susceptible to scenes with dyn ...

PERGAMON-ELSEVIER SCIENCE LTD2022

3D reconstruction of curvilinear structures with stereo matching deep convolutional neural networks

Pascal Fua, Cécile Hébert, Emad Oveisi, Anastasiia Mishchuk, Okan Altingövde, Gulnaz Ganeeva

Curvilinear structures frequently appear in microscopy imaging as the object of interest. Crystallographic defects, i.e dislocations, are one of the curvilinear structures that have been repeatedly investigated under transmission electron microscopy (TEM) ...

ELSEVIER2022