Publications associées à A Johnson-Lindenstrauss Framework for Randomly Initialized CNNs

Publications associées (19)

Advancing understanding and practical performance of machine learning interatomic potentials

Atomistic machine learning has revolutionized atomistic modeling. Traditionally, molecular dynamics simulations relied on classical force fields or electronic structure calculations like Density Functional Theory. Classical force fields are fast but less p ...

EPFL2025

Practical Federated Learning without a Server

Anne-Marie Kermarrec, Rishi Sharma, Marinus Abraham de Vos, Akash Balasaheb Dhasade, Erick Lavoie

Federated Learning (FL) enables end-user devices to collaboratively train ML models without sharing raw data, thereby preserving data privacy. In FL, a central parameter server coordinates the learning process by iteratively aggregating the trained models ...

ACM2025

Deep neural networks for choice analysis: Enhancing behavioral regularity with gradient regularization

Rui Yao

Deep neural networks (DNNs) have been increasingly applied in travel demand modeling because of their automatic feature learning, high predictive performance, and economic interpretability. Nevertheless, DNNs frequently present behaviorally irregular patte ...

PERGAMON-ELSEVIER SCIENCE LTD2024

Land Cover Mapping From Multiple Complementary Experts Under Heavy Class Imbalance

Devis Tuia, Valérie Zermatten, Javiera Francisca Castillo Navarro

Deep learning has emerged as a promising avenue for automatic mapping, demonstrating high efficacy in land cover categorization through various semantic segmentation models. Nonetheless, the practical deployment of these models encounters important challen ...

Ieee-Inst Electrical Electronics Engineers Inc2024

CARER - ClinicAl Reasoning-Enhanced Representation for Temporal Health Risk Prediction

Thanh Trung Huynh

The increasing availability of multimodal data from electronic health records (EHR) has paved the way for deep learning methods to improve diagnosis accuracy. However, deep learning models are data-driven, requiring large-scale datasets to achieve high gen ...

Association for Computational Linguistics (ACL)2024

Feature Representations for Automatic Meerkat Vocalization Classification

Mathew Magimai Doss, Eklavya Sarkar

Understanding evolution of vocal communication in social animals is an important research problem. In that context, beyond humans, there is an interest in analyzing vocalizations of other social animals such as, meerkats, marmosets, apes. While existing ap ...

2024

Optimization Algorithms for Decentralized, Distributed and Collaborative Machine Learning

Anastasiia Koloskova

Distributed learning is the key for enabling training of modern large-scale machine learning models, through parallelising the learning process. Collaborative learning is essential for learning from privacy-sensitive data that is distributed across various ...

EPFL2024

GELEX: Generative AI-Hybrid System for Example-Based Learning

Aybars Yazici, Tanja Christina Käser Jacober, Paola Mejia Domenzain, Jibril Albachir Frej

Traditional example-based learning methods are often limited by static, expert-created content. Hence, they face challenges in scalability, engagement, and effectiveness, as some learners might struggle to relate to the examples or find them relevant. To a ...

Association for Computing Machinery2024

High-dimensional Asymptotics of Denoising Autoencoders

Lenka Zdeborová, Hugo Chao Cui

We address the problem of denoising data from a Gaussian mixture using a twolayer non-linear autoencoder with tied weights and a skip connection. We consider the high-dimensional limit where the number of training samples and the input dimension jointly te ...

2023

Overflow-free Compute Memories for Edge AI Acceleration

David Atienza Alonso, Giovanni Ansaloni, Alexandre Sébastien Julien Levisse, Flavio Ponzina, Marco Antonio Rios

Compute memories are memory arrays augmented with dedicated logic to support arithmetic. They support the efficient execution of data-centric computing patterns, such as those characterizing Artificial Intelligence (AI) algorithms. These architectures can ...

Assoc Computing Machinery2023

Search for narrow resonances in the b-tagged dijet mass spectrum in proton-proton collisions at √s=13 TeV

Jian Wang, Matthias Finger, Qian Wang, Yiming Li, João Miguel das Neves Duarte, Matthias Wolf, Varun Sharma, Yi Zhang, Lei Zhang, Tian Cheng, Yixing Chen, Alexis Kalogeropoulos, Ioannis Papadopoulos, Hua Zhang, Siyuan Wang, Jessica Prisciandaro, Xin Chen, Michele Bianco, Sebastiana Gianì, Sun Hee Kim, Davide Di Croce, Guido Andreassi, Arvind Shah, Jian Zhao, Rakesh Chawla, Jan Steggemann, Konstantin Androsov, Anna Mascellani, Federica Legger, Gabriele Grosso

A search is performed for narrow resonances decaying to final states of two jets, with at least one jet ffiffioriginating from a b quark, in proton-proton collisions at p s = 13 TeV. The data set corresponds to an integrated luminosity of 138 fb-1 collecte ...

American Physical Society2023

Binary Perceptron: Efficient Algorithms Can Find Solutions in a RareWell-Connected Cluster

Emmanuel Abbé

It was recently shown that almost all solutions in the symmetric binary perceptron are isolated, even at low constraint densities, suggesting that finding typical solutions is hard. In contrast, some algorithms have been shown empirically to succeed in fin ...

ASSOC COMPUTING MACHINERY2022

GarNet++: Improving Fast and Accurate Static 3D Cloth Draping by Curvature Loss

Pascal Fua, Mathieu Salzmann, Shaifali Parashar, Victor Constantin, Erhan Gündogdu

In this paper, we tackle the problem of static 3D cloth draping on virtual human bodies. We introduce a two-stream deep network model that produces a visually plausible draping of a template cloth on virtual 3D bodies by extracting features from both the b ...

2022

Neural System Level Synthesis: Learning over All Stabilizing Policies for Nonlinear Systems

Giancarlo Ferrari Trecate, Luca Furieri, Clara Lucía Galimberti

We address the problem of designing stabilizing control policies for nonlinear systems in discrete-time, while minimizing an arbitrary cost function. When the system is linear and the cost is convex, the System Level Synthesis (SLS) approach offers an effe ...

IEEE2022

Byzantine Machine Learning Made Easy By Resilient Averaging of Momentums

Rachid Guerraoui, Nirupam Gupta, Rafaël Benjamin Pinot, Sadegh Farhadkhani, John Stephan

Byzantine resilience emerged as a prominent topic within the distributed machine learning community. Essentially, the goal is to enhance distributed optimization algorithms, such as distributed SGD, in a way that guarantees convergence despite the presence ...

PMLR2022

A unified framework for Hamiltonian deep neural networks

Giancarlo Ferrari Trecate, Liang Xu, Clara Lucía Galimberti

Training deep neural networks (DNNs) can be difficult due to the occurrence of vanishing/explod- ing gradients during weight optimization. To avoid this problem, we propose a class of DNNs stemming from the time discretization of Hamiltonian systems. The t ...

2021

Contextual Semi-Supervised Learning: An Approach To Leverage Air-Surveillance and Untranscribed ATC Data in ASR Systems

Petr Motlicek, Juan Pablo Zuluaga Gomez

Air traffic management and specifically air-traffic control (ATC) rely mostly on voice communications between Air Traffic Controllers (ATCos) and pilots. In most cases, these voice communications follow a well-defined grammar that could be leveraged in Aut ...

ISCA-INT SPEECH COMMUNICATION ASSOC2021

Utterance Verification-Based Dysarthric Speech Intelligibility Assessment Using Phonetic Posterior Features

Mathew Magimai Doss, Julian David Fritsch

In the literature, the task of dysarthric speech intelligibility assessment has been approached through development of different low-level feature representations, subspace modeling, phone confidence estimation or measurement of automatic speech recognitio ...

IEEE Institute of Electrical and Electronics Engineers2021

Long term effects of peripubertal stress on excitatory and inhibitory circuits in the prefrontal cortex of male and female mice

Maria del Carmen Sandi Perez

The impact of stressful events is especially important during early life, because certain cortical regions, especially the prefrontal cortex (PFC), are still developing. Consequently, aversive experiences that occur during the peripubertal period can cause ...

2021