Sparsistency of $\ell_1$-Regularized $M$-Estimators

À propos
Confidentialité
Mentions légales

Graph Chatbot

Publications associées (31)

Fundamental Limits in Statistical Learning Problems: Block Models and Neural Networks

Elisabetta Cornacchia

This thesis focuses on two selected learning problems: 1) statistical inference on graphs models, and, 2) gradient descent on neural networks, with the common objective of defining and analysing the measures that characterize the fundamental limits. In th ...

EPFL2023

(S)GD over Diagonal Linear Networks: Implicit Regularisation, Large Stepsizes and Edge of Stability

Scott William Pesme, Nicolas Henri Bernard Flammarion, Mathieu Even

In this paper, we investigate the impact of stochasticity and large stepsizes on the implicit regularisation of gradient descent (GD) and stochastic gradient descent (SGD) over diagonal linear networks. We prove the convergence of GD and SGD with macroscop ...

2023

Quantification of the Phenomena Affecting Reflective Arterial Photoplethysmography

Nikolaos Stergiopoulos, Vasiliki Bikia, Georgios Rovas

Photoplethysmography (PPG) is a widely emerging method to assess vascular health in humans. The origins of the signal of reflective PPG on peripheral arteries have not been thoroughly investigated. We aimed to identify and quantify the optical and biomecha ...

MDPI2023

Comparing transferability in neural network approaches and linear models for machine-learning interaction potentials

Kevin Rossi

Atomic simulations using machine learning interatomic potential (MLIP) have gained a lot of popularity owing to their accuracy in comparison to conventional empirical potentials. However, the transferability of MLIP to systems outside the training set pose ...

AMER PHYSICAL SOC2023

Testing and nonlinear modelling of industrialized light-frame wooden diaphragms including optimized nailing and nonstructural sheathing

Edisson Xavier Estrella Arcos

This article presents the outcomes of a large project towards the investigation of the lateral performance of full-scale industrialized light-frame wooden diaphragms. 10 full-scale diaphragms of 3.6 m by 2.4 m were tested under in-plane lateral loading (mo ...

Elsevier Sci Ltd2023

Higher Order Asymptotics: Applications to Satellite Conjunction and Boundary Problems

Soumaya Elkantassi

Higher-order asymptotics provide accurate approximations for use in parametric statistical modelling. In this thesis, we investigate using higher-order approximations in two-specific settings, with a particular emphasis on the tangent exponential model. ...

EPFL2023

Dynamical Low-Rank Approximation for Stochastic Differential Equations

Fabio Nobile, Yoshihito Kazashi, Fabio Zoccolan

In this paper, we set the mathematical foundations of the Dynamical Low-Rank Approximation (DLRA) method for stochastic differential equations (SDEs). DLRA aims at approximating the solution as a linear combination of a small number of basis vectors with r ...

American Mathematical Society (AMS)2024

The hunt for the Karman 'constant' revisited

Peter Monkewitz

The log law of the wall, joining the inner, near-wall mean velocity profile (MVP) in wall-bounded turbulent flows to the outer region, has been a permanent fixture of turbulence research for over hundred years, but there is still no general agreement on th ...

Cambridge University Press2023

Robust Collaborative Learning with Linear Gradient Overhead

Rachid Guerraoui, Le Nguyen Hoang, John Stephan, Sadegh Farhadkhani, Nirupam Gupta, Rafaël Benjamin Pinot

Collaborative learning algorithms, such as distributed SGD (or D-SGD), are prone to faulty machines that may deviate from their prescribed algorithm because of software or hardware bugs, poisoned data or malicious behaviors. While many solutions have been ...

PLMR2023

Regularization of polynomial networks for image recognition

Volkan Cevher, Bohan Wang, Grigorios Chrysos

Deep Neural Networks (DNNs) have obtained impressive performance across tasks, however they still remain as black boxes, e.g., hard to theoretically analyze. At the same time, Polynomial Networks (PNs) have emerged as an alternative method with a promising ...

2023

The statistical complexity of early-stopped mirror descent

Varun Kanade, Tomas Vaskevicius

Recently there has been a surge of interest in understanding implicit regularization properties of iterative gradient-based optimization algorithms. In this paper, we study the statistical guarantees on the excess risk achieved by early-stopped unconstrain ...

Oxford Univ Press2023

Page 2 sur 2