Publications associées à Over-the-Air Federated Learning via Second-Order Optimization

Publications associées (19)

Mspo: a Machine Learning Hyperparameter Optimization Method for Enhanced Breast Cancer Image Classification

As one of the major threats to women's health worldwide, breast cancer requires early diagnosis and accurate classification, since they are key to optimizing therapeutic interventions and ensuring precise prognosis. Recently, deep learning has demonstrated ...

SAGE PUBLICATIONS LTD2025

How Gradient Descent Balances Features: A Dynamical Analysis For Two-Layer Neural Networks

Volkan Cevher, Fanghui Liu, Zhenyu Zhu

This paper investigates the fundamental regression task of learning k neurons (a.k.a. teachers) from Gaussian input, using two-layer ReLU neural networks with width m (a.k.a. students) and m, k = O(1), trained via gradient descent under proper initializati ...

2025

Data-driven control in atomic force microscopy using a genetic algorithm

Alireza Karimi, Georg Fantner

Increasing the scanning speed in Atomic Force Microscopy (AFM) relies on improving the tracking performance in the vertical direction of motion. The lightly damped resonances of piezo-actuators utilized in AFM nano-positioning stages hinder the maximum ach ...

2025

Convergence analysis of the discretization of continuous-domain inverse problems

Vincent Patrick Lawrence Guillemet, Michaël Unser, Julien René Fageot

We study continuous-domain linear inverse problems that involve a general data-fidelity term and a regularisation term. We consider a regularisation that is formed by the sparsity-promoting total-variation norm, pre-composed with a differential operator th ...

2025

Deep Learning Theory Through the Lens of Diagonal Linear Networks

Scott William Pesme

In this PhD manuscript, we explore optimisation phenomena which occur in complex neural networks through the lens of

2

-layer diagonal linear networks. This rudimentary architecture, which consists of a two layer feedforward linear network with a diagonal ...

EPFL2024

WILD SOLUTIONS TO SCALAR EULER-LAGRANGE EQUATIONS

Carl Johan Peter Johansson

. We study very weak solutions to scalar Euler-Lagrange equations associated with quadratic convex functionals. We investigate whether W1,1 solutions are necessarily W 1,2 Nash and Schauder applicable. We answer this question positively for a suitable clas ...

Amer Mathematical Soc2024

Analysis of Bootstrap and Subsampling in High-dimensional Regularized Regression

Lenka Zdeborová, Florent Gérard Krzakala, Bruno Loureiro, Adrien Vandenbroucque, Lucas Andry Clarte, Guillaume Cyprien Dalle

We investigate popular resampling methods for estimating the uncertainty of statistical models, such as subsampling, bootstrap and the jackknife, and their performance in high-dimensional supervised regression tasks. We provide a tight asymptotic descripti ...

ACM2024

CONFIG: Constrained Efficient Global Optimization for Closed-Loop Control System Optimization with Unmodeled Constraints

Colin Neil Jones, Yuning Jiang, Wenjie Xu

In this paper, the CONFIG algorithm, a simple and provably efficient constrained global optimization algorithm, is applied to optimize the closed-loop control performance of an unknown system with unmodeled constraints. Existing Gaussian process based clos ...

Elsevier2023

Multi-Level Monte Carlo Methods for Uncertainty Quantification and Risk-Averse Optimisation

Sundar Subramaniam Ganesh

This work aims to study the effects of wind uncertainties in civil engineering structural design. Optimising the design of a structure for safety or operability without factoring in these uncertainties can result in a design that is not robust to these per ...

EPFL2022

Improving the Training of Compact Neural Networks for Visual Recognition

Shuxuan Guo

During the Artificial Intelligence (AI) revolution of the past decades, deep neural networks have been widely used and have achieved tremendous success in visual recognition. Unfortunately, deploying deep models is challenging because of their huge model s ...

EPFL2022

An Accelerated First-Order Method for Non-convex Optimization on Manifolds

Christopher Arnold Criscitiello, Nicolas Boumal

We describe the first gradient methods on Riemannian manifolds to achieve accelerated rates in the non-convex case. Under Lipschitz assumptions on the Riemannian gradient and Hessian of the cost function, these methods find approximate first-order critical ...

SPRINGER2022

On improving the efficiency of modifier adaptation via directional information

Dominique Bonvin

In real-time optimization, the solution quality depends on the model ability to predict the plant KarushKuhn-Tucker (KKT) conditions. In the case of non-parametric plant-model mismatch, one can add input-affine modifiers to the model cost and constraints a ...

PERGAMON-ELSEVIER SCIENCE LTD2022

Structure-preserving approaches and data-driven closure modeling for model order reduction

Nicolò Ripamonti

In this thesis, we propose model order reduction techniques for high-dimensional PDEs that preserve structures of the original problems and develop a closure modeling framework leveraging the Mori-Zwanzig formalism and recurrent neural networks. Since high ...

EPFL2022

Parallel MPC for Linear Systems With State and Input Constraints

Yuning Jiang

This letter proposes a parallelizable algorithm for linear-quadratic model predictive control (MPC) problems with state and input constraints. The algorithm itself is based on a parallel MPC scheme that has originally been designed for systems with input c ...

2022

Second International Workshop on Algorithmic Bias in Search and Recommendation (bias@ecir2021)

Mirko Marras

Providing efficient and effective search and recommendation algorithms has been traditionally the main objective for the industrial and academic research communities. However, recent studies have shown that optimizing models through these algorithms may re ...

Springer Nature2021

PDE-Constrained Optimal Control Problems with Uncertain Parameters using SAGA

Fabio Nobile, Matthieu Claude Martin

We consider an optimal control problem (OCP) for a partial differential equation (PDE) with random coefficients. The optimal control function is a deterministic, distributed forcing term that minimizes an expected quadratic regularized loss functional. For ...

2021

A new wake model and comparison of eight algorithms for layout optimization of wind farms in complex terrain

Fernando Porté Agel

Layout optimization of wind farms constitutes an important and challenging task in complex terrain. This is especially due to the complex interactions of the boundary layer flows in complex terrain and wind turbine wakes, which renders wake modelling in co ...

ELSEVIER SCI LTD2020

A Multi-Agent Primal-Dual Strategy for Composite Optimization over Distributed Features

Ali H. Sayed, Sulaiman A S A E Alghunaim

This work studies multi-agent sharing optimization problems with the objective function being the sum of smooth local functions plus a convex (possibly non-smooth) function coupling all agents. This scenario arises in many machine learning and engineering ...

IEEE2020

Efficient Proximal Mapping of the 1-path-norm of Shallow Networks

Volkan Cevher, Fabian Ricardo Latorre Gomez, Paul Thierry Yves Rolland, Shaul Nadav Hallak

We demonstrate two new important properties of the 1-path-norm of shallow neural networks. First, despite its non-smoothness and non-convexity it allows a closed form proximal operator which can be efficiently computed, allowing the use of stochastic proxi ...

JMLR-JOURNAL MACHINE LEARNING RESEARCH2020