Over-the-Air Federated Learning via Second-Order Optimization

Chat with Graph Search

Ask any question about EPFL courses, lectures, exercises, research, news, etc. or try the example questions below.

DISCLAIMER: The Graph Chatbot is not programmed to provide explicit or categorical answers to your questions. Rather, it transforms your questions into API requests that are distributed across the various IT services officially administered by EPFL. Its purpose is solely to collect and recommend relevant references to content that you can explore to help you answer your questions.

As one of the major threats to women's health worldwide, breast cancer requires early diagnosis and accurate classification, since they are key to optimizing therapeutic interventions and ensuring precise prognosis. Recently, deep learning has demonstrated ...

This paper investigates the fundamental regression task of learning k neurons (a.k.a. teachers) from Gaussian input, using two-layer ReLU neural networks with width m (a.k.a. students) and m, k = O(1), trained via gradient descent under proper initializati ...

Increasing the scanning speed in Atomic Force Microscopy (AFM) relies on improving the tracking performance in the vertical direction of motion. The lightly damped resonances of piezo-actuators utilized in AFM nano-positioning stages hinder the maximum ach ...

We study continuous-domain linear inverse problems that involve a general data-fidelity term and a regularisation term. We consider a regularisation that is formed by the sparsity-promoting total-variation norm, pre-composed with a differential operator th ...

In this PhD manuscript, we explore optimisation phenomena which occur in complex neural networks through the lens of

2

-layer diagonal linear networks. This rudimentary architecture, which consists of a two layer feedforward linear network with a diagonal ...

. We study very weak solutions to scalar Euler-Lagrange equations associated with quadratic convex functionals. We investigate whether W1,1 solutions are necessarily W 1,2 Nash and Schauder applicable. We answer this question positively for a suitable clas ...

We investigate popular resampling methods for estimating the uncertainty of statistical models, such as subsampling, bootstrap and the jackknife, and their performance in high-dimensional supervised regression tasks. We provide a tight asymptotic descripti ...

In this paper, the CONFIG algorithm, a simple and provably efficient constrained global optimization algorithm, is applied to optimize the closed-loop control performance of an unknown system with unmodeled constraints. Existing Gaussian process based clos ...

This work aims to study the effects of wind uncertainties in civil engineering structural design. Optimising the design of a structure for safety or operability without factoring in these uncertainties can result in a design that is not robust to these per ...

During the Artificial Intelligence (AI) revolution of the past decades, deep neural networks have been widely used and have achieved tremendous success in visual recognition. Unfortunately, deploying deep models is challenging because of their huge model s ...

We describe the first gradient methods on Riemannian manifolds to achieve accelerated rates in the non-convex case. Under Lipschitz assumptions on the Riemannian gradient and Hessian of the cost function, these methods find approximate first-order critical ...

In real-time optimization, the solution quality depends on the model ability to predict the plant KarushKuhn-Tucker (KKT) conditions. In the case of non-parametric plant-model mismatch, one can add input-affine modifiers to the model cost and constraints a ...

In this thesis, we propose model order reduction techniques for high-dimensional PDEs that preserve structures of the original problems and develop a closure modeling framework leveraging the Mori-Zwanzig formalism and recurrent neural networks. Since high ...

This letter proposes a parallelizable algorithm for linear-quadratic model predictive control (MPC) problems with state and input constraints. The algorithm itself is based on a parallel MPC scheme that has originally been designed for systems with input c ...

Providing efficient and effective search and recommendation algorithms has been traditionally the main objective for the industrial and academic research communities. However, recent studies have shown that optimizing models through these algorithms may re ...

We consider an optimal control problem (OCP) for a partial differential equation (PDE) with random coefficients. The optimal control function is a deterministic, distributed forcing term that minimizes an expected quadratic regularized loss functional. For ...

This work studies multi-agent sharing optimization problems with the objective function being the sum of smooth local functions plus a convex (possibly non-smooth) function coupling all agents. This scenario arises in many machine learning and engineering ...

We demonstrate two new important properties of the 1-path-norm of shallow neural networks. First, despite its non-smoothness and non-convexity it allows a closed form proximal operator which can be efficiently computed, allowing the use of stochastic proxi ...

Over-the-Air Federated Learning via Second-Order Optimization

Chat with Graph Search

Mspo: a Machine Learning Hyperparameter Optimization Method for Enhanced Breast Cancer Image Classification

How Gradient Descent Balances Features: A Dynamical Analysis For Two-Layer Neural Networks

Data-driven control in atomic force microscopy using a genetic algorithm

Convergence analysis of the discretization of continuous-domain inverse problems

Deep Learning Theory Through the Lens of Diagonal Linear Networks

WILD SOLUTIONS TO SCALAR EULER-LAGRANGE EQUATIONS

Analysis of Bootstrap and Subsampling in High-dimensional Regularized Regression

CONFIG: Constrained Efficient Global Optimization for Closed-Loop Control System Optimization with Unmodeled Constraints

Multi-Level Monte Carlo Methods for Uncertainty Quantification and Risk-Averse Optimisation

Improving the Training of Compact Neural Networks for Visual Recognition

An Accelerated First-Order Method for Non-convex Optimization on Manifolds

On improving the efficiency of modifier adaptation via directional information

Structure-preserving approaches and data-driven closure modeling for model order reduction

Parallel MPC for Linear Systems With State and Input Constraints

Second International Workshop on Algorithmic Bias in Search and Recommendation (bias@ecir2021)

PDE-Constrained Optimal Control Problems with Uncertain Parameters using SAGA

A Multi-Agent Primal-Dual Strategy for Composite Optimization over Distributed Features

Efficient Proximal Mapping of the 1-path-norm of Shallow Networks