Home

Publication

Towards Verifiable, Generalizable and Efficient Robust Deep Neural Networks

About
Privacy
Disclaimer

Graph Chatbot

Related publications (60)

Page 3 of 3

Robust NAS under adversarial training: benchmark, theory, and beyond

Volkan Cevher, Grigorios Chrysos, Fanghui Liu, Yongtao Wu

Recent developments in neural architecture search (NAS) emphasize the significance of considering robust architectures against malicious data. However, there is a notable absence of benchmark evaluations and theoretical guarantees for searching these robus ...

2024

A learning-based approach to stochastic optimal control under reach-avoid constraint

Maryam Kamgarpour, Tingting Ni

We develop a model-free approach to optimally control stochastic, Markovian systems subject to a reach-avoid constraint. Specifically, the state trajectory must remain within a safe set while reaching a target set within a finite time horizon. Due to the t ...

Association for Computing Machinery2025

Residual-based attention in physics-informed neural networks

Nikolaos Stergiopoulos, Sokratis Anagnostopoulos

Driven by the need for more efficient and seamless integration of physical models and data, physics -informed neural networks (PINNs) have seen a surge of interest in recent years. However, ensuring the reliability of their convergence and accuracy remains ...

Elsevier Science Sa2024

Classifier-free diffusion-based weakly-supervised approach for health indicator derivation in rotating machines: Advancing early fault detection and condition monitoring

Olga Fink, Gaëtan Michel Frusque

Deriving health indicators of rotating machines is crucial for their maintenance. However, this process is challenging for the prevalent adopted intelligent methods since they may take the whole data distributions, not only introducing noise interference b ...

2025

Search for Pair Production of Heavy Particles Decaying to a Top Quark and a Gluon in the Lepton Plus Jets Final State in Proton-proton Collisions at √s=13 Tev

Jan Steggemann, Anna Mascellani, Joanna Malgorzata Wanczyk

A search is presented for the pair production of new heavy resonances, each decaying into a top quark (t) or antiquark and a gluon (g). The analysis uses data recorded with the CMS detector from proton-proton collisions at a center-of-mass energy of 13 TeV ...

SPRINGER2025

Gibbs sampling the posterior of neural networks

Lenka Zdeborová, Emanuele Troiani, Giovanni Piccioli

In this paper, we study sampling from a posterior derived from a neural network. We propose a new probabilistic model consisting of adding noise at every pre- and post-activation in the network, arguing that the resulting posterior can be sampled using an ...

Iop Publishing Ltd2024

Segmenting Object Affordances: Reproducibility and Sensitivity to Scale

Andrea Cavallaro

Visual affordance segmentation identifies image regions of an object an agent can interact with. Existing methods re-use and adapt learning-based architectures for semantic segmentation to the affordance segmentation task and evaluate on small-size dataset ...

Springer Science and Business Media Deutschland GmbH2025

Harnessing Increased Client Participation with Cohort-Parallel Federated Learning

Anne-Marie Kermarrec, Rafael Pereira Pires, Marinus Abraham de Vos, Akash Balasaheb Dhasade, Tuan Anh Nguyen

Federated learning (FL) is a machine learning approach where nodes collaboratively train a global model. As more nodes participate in a round of FL, the effectiveness of individual model updates by nodes also diminishes. In this study, we increase the effe ...

ACM2025

Reliable data-driven decision-making through optimal transport

Bahar Taskesen

Decision-making permeates every aspect of human and societal development, from individuals' daily choices to the complex decisions made by communities and institutions. Central to effective decision-making is the discipline of optimization, which seeks th ...

EPFL2024

CHAMELEON: A Flexible Data-mixing Framework for Language Model Pretraining and Finetuning

Volkan Cevher, Wanyun Xie

Training data mixtures greatly impact the generalization performance of large language models. Existing domain reweighting methods often rely on costly weight computations and require retraining when new data is introduced. To this end, we introduce a flex ...

2025

Scalable Multi-agent Reinforcement Learning for Residential Load Scheduling Under Data Governance

Zhaoming Qin

As a data-driven approach, multi-agent reinforcement learning (MARL) has made remarkable advances in solving cooperative residential load scheduling problems. However, centralized training, the most common paradigm for MARL, limits large-scale deployment i ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2025

Driving and suppressing the human language network using large language models

Martin Schrimpf

Transformer models such as GPT generate human-like language and are predictive of human brain responses to language. Here, using functional-MRI-measured brain responses to 1,000 diverse sentences, we first show that a GPT-based encoding model can predict t ...

Nature Portfolio2024

A phase transition in diffusion models reveals the hierarchical nature of data

Matthieu Wyart, Alessandro Favero, Antonio Sclocchi

Understanding the structure of real data is paramount in advancing modern deep-learning methodologies. Natural data such as images are believed to be composed of features organized in a hierarchical and combinatorial manner, which neural networks capture d ...

National Academy of Sciences2025

Exploring High-Performance and Energy-Efficient Architectures for Edge AI-Enabled Applications

Joshua Alexander Harrison Klein

The desire and ability to place AI-enabled applications on the edge has grown significantly in recent years. However, the compute-, area-, and power-constrained nature of edge devices are stressed by the needs of the AI-enabled applications, due to a gener ...

EPFL2024

Self-driving microscopy detects the onset of protein aggregation and enables intelligent Brillouin imaging

Camille Valentine Cathala, Hilal Lashuel, Aleksandra Radenovic, Lely Feletti, Khalid Ashraf Mohie Ibrahim

The process of protein aggregation, central to neurodegenerative diseases like Huntington’s, is challenging to study due to its unpredictable nature and relatively rapid kinetics. Understanding its biomechanics is crucial for unraveling its role in disease ...

Springer Science and Business Media LLC2025

Incorporating Projective Geometry into Deep Learning

Michal Jan Tyszkiewicz

In this thesis we explore the applications of projective geometry, a mathematical theory of the relation between 3D scenes and their 2D images, in modern learning-based computer vision systems. This is an interesting research question which contradicts the ...

EPFL2024

A multidomain approach to neighbourhood typology for urban environmental studies

Jan Wienold, Dolaana Khovalyg, Dusan Licina, Kun Lyu, Hanieh Khodaei Tehrani

Cities are facing unprecedented challenges to their environments and residents due to continuous growth, including urban overheating, daylight accessibility, noise, and air pollution. This requires a holistic approach to the research and implementation of ...

2025

Optimizing Dynamic Aperture Studies with Active Learning

Tatiana Pieloni, Mike Seidel, Davide Di Croce, Ekaterina Krymova

Dynamic aperture is an important concept for the study of non-linear beam dynamics in circular accelerators. It describes the extent of the phase-space region where a particle's motion remains bounded over a given number of turns. Understanding the feature ...

Iop Publishing Ltd2024

On the number of regions of piecewise linear neural networks

Michaël Unser, Alexis Marie Frederic Goujon

Many feedforward neural networks (NNs) generate continuous and piecewise-linear (CPWL) mappings. Specifically, they partition the input domain into regions on which the mapping is affine. The number of these so-called linear regions offers a natural metric ...

2024

Generalization of Noisy SGD in Unbounded Non-convex Settings

Volkan Cevher, Leello Tadesse Dadi

We study the generalization of iterative noisy gradient schemes on smooth non-convex losses. Formally, we establish time-independent information theoretic generalization bounds for Stochastic Gradient Langevin Dynamics (SGLD) that do not diverge as the ite ...

2025