Publications related to Gaussian universality of perceptrons with random labels

Related publications (19)

Stop Wasting your Cache! Bringing Machine Learning into Cache Computing

The rapid evolution of Machine Learning (ML) workloads, particularly Deep Neural Networks (DNNs) and Transformer-based models, has intensified demands on computing architectures, highlighting the limitations of traditional von Neumann systems due to the me ...

ACM2025

Speech Data Selection for Efficient ASR Fine-Tuning using Domain Classifier and Pseudo-Label Filtering

Juan Pablo Zuluaga Gomez

In real-world speech data processing, the scarcity of annotated data and the abundance of unlabelled speech data present a significant challenge. To address this, we propose an efficient data selection pipeline for fine-tuning ASR models by generating pseu ...

Institute of Electrical and Electronics Engineers Inc.2025

Global Group Fairness in Federated Learning via Function Tracking

Daniel Kuhn, Yves Rychener, Yifan Hu

We investigate group fairness regularizers in federated learning, aiming to train a globally fair model in a distributed setting. Ensuring global fairness in distributed training presents unique challenges, as fairness regularizers typically involve probab ...

2025

Behaviorally Relevant Information Content in Interneuron Activity

Mahsa Barzegarkeshteli

The nematode Caenorhabditis elegans offers a uniquely tractable model for studying the relationships between neuronal activity, connectivity, and behavior. Despite its simplicity, key questions remain about how information flows through its nervous system ...

EPFL2025

Engineering of stable and functional metalloproteins using evolutionary computation, deep learning and simulation

Simon Leonard Dürr

Metal ions are indispensable cofactors for many proteins and play crucial roles in numerous biological processes, yet the computational design of metalloproteins and the optimization of metal coordination sites poses significant challenges due to the comp ...

EPFL2025

Integrating Socioeconomic and Community-Based Strategies for Drought Resilience in West Pokot, Kenya

Jérôme Chenal, Baraka Jean-Claude Munyaka

This paper examines how demographic characteristics, institutional structures, and livelihood strategies shape household resilience to climate variability and drought in West Pokot County, one of Kenya's most climate-vulnerable arid and semi-arid lands (AS ...

MDPI AG2025

Brief Announcement: A Case for Byzantine Machine Learning

Rachid Guerraoui, Nirupam Gupta, Rafaël Benjamin Pinot, Sadegh Farhadkhani

The success of machine learning (ML) has been intimately linked with the availability of large amounts of data, typically collected from heterogeneous sources and processed on vast networks of computing devices (also called workers). Beyond accuracy, the u ...

ACM2024

The Benefits of Reusing Batches for Gradient Descent in Two-Layer Networks: Breaking the Curse of Information and Leap Exponents

Lenka Zdeborová, Florent Gérard Krzakala, Yatin Dandi, Emanuele Troiani, Luca Pesce, Luca Arnaboldi

We investigate the training dynamics of two-layer neural networks when learning multi-index target functions. We focus on multi-pass gradient descent (GD) that reuses the batches multiple times and show that it significantly changes the conclusion about wh ...

JMLR2024

Nissl_5, Raw images for Machine learning for histological annotation and quantification of cortical layers

Julie Meystre

This dataset contains images (TIFF image data) of brain juvenile rats Wistar Han (P14) scanned immunostained slides by using an automated slide scanner (Olympus, VS120-L100, GER) equipped with a UPLSAPO 20x/0.75 air objective (Olympus, GER) and a Pike F5 ...

Zenodo2024

Euclid: Testing photometric selection of emission-line galaxy targets?

Frédéric Courbin, Georges Meylan

Multi-object spectroscopic galaxy surveys typically make use of photometric and colour criteria to select their targets. That is not the case of Euclid, which will use the NISP slitless spectrograph to record spectra for every source over its field of view ...

2024

SPOC: Imitating Shortest Paths in Simulation Enables Effective Navigation and Manipulation in the Real World

Kunal Pratap Singh

Reinforcement learning (RL) with dense rewards and imitation learning (IL) with human-generated trajectories are the most widely used approaches for training modern embodied agents. RL requires extensive reward shaping and auxiliary losses and is often too ...

IEEE2024

LF-ViT: Reducing Spatial Redundancy in Vision Transformer for Efficient Image Recognition

Yung-Cheng Chiang

The Vision Transformer (ViT) excels in accuracy when handling high-resolution images, yet it confronts the challenge of significant spatial redundancy, leading to increased computational and memory requirements. To address this, we present the Localization ...

Association for the Advancement of Artificial Intelligence2024

Neural-network quantum states for ultra-cold Fermi gases

Giuseppe Carleo, Jannes Willy E. Nys, Gabriel Maria Pescia

Ultra-cold Fermi gases exhibit a rich array of quantum mechanical properties, including the transition from a fermionic superfluid Bardeen-Cooper-Schrieffer (BCS) state to a bosonic superfluid Bose-Einstein condensate (BEC). While these properties can be p ...

Berlin2024

Ethological computational psychiatry: Challenges and opportunities

Mackenzie Mathis

Studying the intricacies of individual subjects' moods and cognitive processing over extended periods of time presents a formidable challenge in medicine. While much of systems neuroscience appropriately focuses on the link between neural circuit functions ...

Current Biology Ltd2024

Calibrated Adaptive Teacher for Domain Adaptive Intelligent Fault Diagnosis

Olga Fink, Florent Evariste Forest

Intelligent Fault Diagnosis (IFD) based on deep learning has proven to be an effective and flexible solution, attracting extensive research. Deep neural networks can learn rich representations from vast amounts of representative labeled data for various ap ...

2023

Saliency prediction in 360° architectural scenes: Performance and impact of daylight variations

Marilyne Andersen, Sabine Süsstrunk, Caroline Karmann, Kynthia Chamilothori, Seungryong Kim, Bahar Aydemir

Saliency models are image-based prediction models that estimate human visual attention. Such models, when applied to architectural spaces, could pave the way for design decisions where visual attention is taken into account. In this study, we tested the pe ...

2023

Disagreement and fragmentation in growing groups

Jiyong Zhang, Yubo Xie

The arise of disagreement is an emergent phenomenon that can be observed within a growing social group and, beyond a certain threshold, can lead to group fragmentation. To better understand how disagreement emerges, we introduce an analytically tractable m ...

PERGAMON-ELSEVIER SCIENCE LTD2023

Miniaturised, Wireless and Distributed Neural Interface Toward Cortical Visual Prosthesis

Gian Luca Barbruni

Over the last decades, implantable neural interfaces have been extensively explored and effectively deployed to address neurological and mental health disorders. The existing solutions present several limitations. Firstly, the physical size of the implanta ...

EPFL2023

Optimal Convex Lifted Sparse Phase Retrieval and PCA With an Atomic Matrix Norm Regularizer

Andrew Duncan Mc Rae

We present novel analysis and algorithms for solving sparse phase retrieval and sparse principal component analysis (PCA) with convex lifted matrix formulations. The key innovation is a new mixed atomic matrix norm that, when used as regularization, promot ...

2023