On L2-Regularization for Virtual Reference Feedback Tuning

Chat with Graph Search

Ask any question about EPFL courses, lectures, exercises, research, news, etc. or try the example questions below.

DISCLAIMER: The Graph Chatbot is not programmed to provide explicit or categorical answers to your questions. Rather, it transforms your questions into API requests that are distributed across the various IT services officially administered by EPFL. Its purpose is solely to collect and recommend relevant references to content that you can explore to help you answer your questions.

Catastrophic overfitting (CO) in single-step adversarial training (AT) results in abrupt drops in the adversarial test accuracy (even down to 0%). For models trained with multi-step AT, it has been observed that the loss function behaves locally linearly w ...

This paper studies kernel ridge regression in high dimensions under covariate shifts and analyzes the role of importance re-weighting. We first derive the asymptotic expansion of high dimensional kernels under covariate shifts. By a bias-variance decomposi ...

Orthogonal group synchronization is the problem of estimating n elements Z(1),& mldr;,Z(n) from the rxr orthogonal group given some relative measurements R-ij approximate to Z(i)Z(j)(-1). The least-squares formulation is nonconvex. To avoid its local minim ...

The work presented in this thesis lies at the intersection of Machine Learning (ML) and control theory. The first part is dedicated to the design of Deep Neural Network (DNN) architectures with specific numerical properties, inspired by dynamical systems m ...

We present a combination technique based on mixed differences of both spatial approximations and quadrature formulae for the stochastic variables to solve efficiently a class of optimal control problems (OCPs) constrained by random partial differential equ ...

We investigate popular resampling methods for estimating the uncertainty of statistical models, such as subsampling, bootstrap and the jackknife, and their performance in high-dimensional supervised regression tasks. We provide a tight asymptotic descripti ...

The European Union's Green Deal aims for a 55% reduction in greenhouse gas emissions by 2030. To reach this goal, a massive integration of Renewable Energy Sources (RES) into the power grid is necessary. As RES become a large part of the electricity genera ...

In this PhD manuscript, we explore optimisation phenomena which occur in complex neural networks through the lens of

2

-layer diagonal linear networks. This rudimentary architecture, which consists of a two layer feedforward linear network with a diagonal ...

In light of the challenges posed by climate change and the goals of the Paris Agreement, electricity generation is shifting to a more renewable and decentralized pattern, while the operation of systems like buildings is increasingly electrified. This calls ...

In this thesis we study stability from several viewpoints. After covering the practical importance, the rich history and the ever-growing list of manifestations of stability, we study the following. (i) (Statistical identification of stable dynamical syste ...

We develop new tools to study landscapes in nonconvex optimization. Given one optimization problem, we pair it with another by smoothly parametrizing the domain. This is either for practical purposes (e.g., to use smooth optimization algorithms with good g ...

Reinforcement learning (RL) is inherently rife with non-stationarity since the states and rewards the agent observes during training depend on its changing policy. Therefore, networks in deep RL must be capable of adapting to new observations and fitting n ...

A method for optimizing at least one of a geometry, an implantation procedure, and/or stimulation protocol of one or more electrodes for an electrical stimulation of a target structure in a nervous system of a living being by a computer device, the method ...

Battery health prediction is significant while challenging for intelligent battery management. This article proposes a general framework for both short-term and long-term predictions of battery health under unseen dynamic loading and temperature conditions ...

Drones hold promise to assist in civilian tasks. To realize this application, future drones must operate within large cities, covering large distances while navigating within cluttered urban landscapes. The increased efficiency of winged drones over rotary ...

Modern optimization is tasked with handling applications of increasingly large scale, chiefly due to the massive amounts of widely available data and the ever-growing reach of Machine Learning. Consequently, this area of research is under steady pressure t ...

This thesis presents the development, construction, and benchmark of an experimental platform that combines cold fermionic 6Li atoms with locally controllable light-matter interactions. To enable local control, a new device, the cavity-microscope, was crea ...

Linear-Quadratic-Gaussian (LQG) control is a fundamental control paradigm that is studied in various fields such as engineering, computer science, economics, and neuroscience. It involves controlling a system with linear dynamics and imperfect observations ...

In this paper, we present a new parameterization and optimization procedure for minimizing the weight of ribbed plates. The primary goal is to reduce embodied CO2 in concrete floors as part of the effort to diminish the carbon footprint of the construction ...

Distributed learning is the key for enabling training of modern large-scale machine learning models, through parallelising the learning process. Collaborative learning is essential for learning from privacy-sensitive data that is distributed across various ...

On L2-Regularization for Virtual Reference Feedback Tuning

Chat with Graph Search

Efficient local linearity regularization to overcome catastrophic overfitting

High-Dimensional Kernel Methods under Covariate Shift: Data-Dependent Implicit Regularization

BENIGN LANDSCAPES OF LOW-DIMENSIONAL RELAXATIONS FOR ORTHOGONAL SYNCHRONIZATION ON GENERAL GRAPHS

Navigating the Loop: From Control Systems to Neural Networks and Back

A Combination Technique for Optimal Control Problems Constrained by Random PDEs

Analysis of Bootstrap and Subsampling in High-dimensional Regularized Regression

Advanced control strategies to exploit the hydropower potential enhancing ancillary services provision to the power system

Deep Learning Theory Through the Lens of Diagonal Linear Networks

Quantifying the Unknown: Data-Driven Approaches and Applications in Energy Systems

Stability: a search for structure

The effect of smooth parametrizations on nonconvex optimization landscapes

No Representation, No Trust: Connecting Representation, Collapse, and Trust Issues in PPO

A method and system for optimizing design, implantation, and stimulation protocols of electrodes stimulating the nervous system

Health Prediction for Lithium-Ion Batteries Under Unseen Working Conditions

Accurate and agile flight with winged drones

Scalable constrained optimization

A Cavity-Microscope for Quantum Simulations with Locally-Controllable All-to-All Interactions

Distributionally Robust Linear Quadratic Control

Mesh-based topology, shape and sizing optimization of ribbed plates

Optimization Algorithms for Decentralized, Distributed and Collaborative Machine Learning