Publications related to Deep Neural Networks: Large-Width Behavior and Generalization Bounds

Related publications (17)

Source-Free Domain-Invariant Performance Prediction

Accurately estimating model performance poses a significant challenge, particularly in scenarios where the source and target domains follow different data distributions. Most existing performance prediction methods heavily rely on the source data in their ...

Springer Nature2025

Reweighting simulated events using machine-learning techniques in the CMS experiment

Jan Steggemann, Konstantin Androsov, Anna Mascellani, Joanna Malgorzata Wanczyk, Paul Théodore Gabriel Pablo De Bryas Dexmiers d'Archiac

Data analyses in particle physics rely on an accurate simulation of particle collisions and a detailed simulation of detector effects to extract physics knowledge from the recorded data. Event generators together with a geant-based simulation of the detect ...

2025

Metacognition meets AI: Empowering reflective writing with large language models

Tanja Christina Käser Jacober, Paola Mejia Domenzain, Seyed Parsa Neshaei

Reflective writing is known as a useful method in learning sciences to improve the metacognitive skills of students. However, students struggle to structure their reflections properly, limiting the possible learning gains. Previous works in educational tec ...

Wiley2025

Technology Legalization and Optimization for Adiabatic Quantum-Flux Parametron

Giovanni De Micheli, Alessandro Tempia Calvino

Adiabatic quantum-flux parametron (AQFP) is an energy-efficient superconducting technology. Before physical design can be performed, AQFP technology mapping involves not only mapping logic into supported gate types but also legalizing the circuit to fulfil ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2025

Targeting protein-ligand neosurfaces with a generalizable deep learning tool

Bruno Emanuel Ferreira De Sousa Correia, Sebastian Maerkl, Luc Reymond, Philippe Schwaller, Pablo Gainza Cirauqui, Sandrine Madeleine Suzanne Georgeon, Leo Scheller, Anthony Marchand, Martin Pacesa, Arne Schneuing, Stephen Michael Buckley, Rebecca Manuela Neeser, Joseph Giuseppe Schmidt, Maddalena Elia, Yangyang Miao, Evgenia Elizarova

Molecular recognition events between proteins drive biological processes in living systems1. However, higher levels of mechanistic regulation have emerged, in which protein-protein interactions are conditioned to small molecules2, 3, 4-5. Despite recent ad ...

NATURE PORTFOLIO2025

Multi-temporal forest monitoring in the Swiss Alps with knowledge-guided deep learning

Devis Tuia, Marc Conrad Russwurm, Thiên-Anh Claris Nguyen, Gaston Jean Lenczner

Monitoring forests, in particular their response to climate and land use change, requires studying long time scales. While efficient deep learning methods have been developed to process short time series of satellite imagery, leveraging long time series of ...

Elsevier Science Inc2024

Adversarial Training for Jamming-Robust Channel Estimation in OFDM Systems

Pascal Frossard, Javier Alejandro Maroto Morales

Orthogonal frequency-division multiplexing (OFDM) is widely used to mitigate inter-symbol interference (ISI) from multipath fading. However, the open nature of wireless OFDM systems makes them vulnerable to jamming attacks. In this context, pilot jamming i ...

2024

Federated learning with uncertainty-based client clustering for fleet-wide fault diagnosis

Olga Fink, Hao Lu

Operators from various industries have been pushing the adoption of wireless sensing nodes for industrial monitoring, and such efforts have produced sizeable condition monitoring datasets that can be used to build diagnosis algorithms capable of warning ma ...

2024

AdaNCA: Neural Cellular Automata as Adaptors for More Robust Vision Transformer

Sabine Süsstrunk, Tong Zhang, Yitao Xu

Vision Transformers (ViTs) demonstrate remarkable performance in image classification through visual-token interaction learning, particularly when equipped with local information via region attention or convolutions. Although such architectures improve the ...

2024

One-Bit Byzantine-Tolerant Distributed Learning via Over-The-Air Computation

Yuning Jiang

Distributed learning has become a promising computational parallelism paradigm that enables a wide scope of intelligent applications from the Internet of Things (IoT) to autonomous driving and the healthcare industry. This paper studies distributed learnin ...

2024

Real-time quantum dynamics of thermal states with neural thermofields

Giuseppe Carleo, Jannes Willy E. Nys, Zakari Denis

Solving the time-dependent quantum many-body Schrödinger equation is a challenging task, especially for states at a finite temperature, where the environment affects the dynamics. Most existing approximating methods are designed to represent static thermal ...

2024

An Investigation of Manifold-Based Direct Control for a Brain-to-Body Neural Bypass

Silvestro Micera, Solaiman Shokur, Evgenia Vladimirova Roussinova

Objective: Brain-body interfaces (BBIs) have emerged as a very promising solution for restoring voluntary hand control in people with upper-limb paralysis. The BBI module decoding motor commands from brain signals should provide the user with intuitive, ac ...

Ieee-Inst Electrical Electronics Engineers Inc2024

Designed Semiconductor Network Random Lasers

Kirsten Emilie Moselund, Alexis Arnaudon

Conventional lasers typically support a well‐defined comb of modes. Coupling many resonators together to form larger complex cavities enables the design of the spatial and spectral distribution of modes, for sensitive and controllable on‐chip light sources ...

Wiley2024

Statistical mechanics of the maximum-average submatrix problem

Lenka Zdeborová, Florent Gérard Krzakala, Vittorio Erba, Rodrigo Emilio Pérez Ortiz

We study the maximum-average submatrix problem, wherein given an N x N matrix J, one needs to find the k x k submatrix with the largest average number of entries. We investigate the problem for random matrices J, whose entries are i.i.d. random variables, ...

Iop Publishing Ltd2024

Bayes-optimal Learning of Deep Random Networks of Extensive-width

Lenka Zdeborová, Florent Gérard Krzakala, Hugo Chao Cui

We consider the problem of learning a target function corresponding to a deep, extensive-width, non-linear neural network with random Gaussian weights. We consider the asymptotic limit where the number of samples, the input dimension and the network width ...

2023

Physics-Informed Machine Learning for Modeling and Control of Dynamical Systems

Colin Neil Jones, Melanie Nicole Zeilinger, Roland Schwan, Xuan Truong Nghiem

Physics-informed machine learning (PIML) is a set of methods and tools that systematically integrate machine learning (ML) algorithms with physical constraints and abstract mathematical models developed in scientific and engineering domains. As opposed to ...

IEEE2023

Forest Drought Impact Prediction based on Spatio-temporal Satellite Imagery and Weather Forecasts -- A Spatio-Temporal Approach using Convolutional LSTM Models

Devis Tuia

2023