Publications related to A gentle introduction to gradient-based optimization and variational inequalities for machine learning

Related publications (24)

Preface: Advancing deep learning for remote sensing time series data analysis

This special issue explores the burgeoning field of deep learning for remote sensing time series analysis. The 20 contributed papers showcase diverse applications, including land cover mapping, change detection, atmospheric and biophysical/biochemical para ...

2025

Split weight distribution learning for binary neural networks exploiting nano-memristive graphene/sumanene/graphene devices

Alexandre Schmid

Research in artificial intelligence (AI) and neural network (NN) technologies has been boosted by recent hardware advances, while the emergence of self-synthesized materials such as nanocarbons has attracted much attention to overcome the limitations of Si ...

IOP Publishing Ltd2025

Scalable constrained optimization

Maria-Luiza Vladarean

Modern optimization is tasked with handling applications of increasingly large scale, chiefly due to the massive amounts of widely available data and the ever-growing reach of Machine Learning. Consequently, this area of research is under steady pressure t ...

EPFL2024

What can be learnt with wide convolutional neural networks?

Matthieu Wyart, Alessandro Favero, Francesco Cagnetta

Understanding how convolutional neural networks (CNNs) can efficiently learn high-dimensional functions remains a fundamental challenge. A popular belief is that these models harness the local and hierarchical structure of natural data such as images. Yet, ...

2024

Payoff-Based Learning of Nash Equilibria in Merely Monotone Games

Maryam Kamgarpour

We address learning Nash equilibria in convex games under the payoff information setting. We consider the case in which the game pseudo- gradient is monotone but not necessarily strictly monotone. This relaxation of strict monotonicity enables application ...

Institute of Electrical and Electronics Engineers (IEEE)2024

Intelligent RF System for Ultra Low Power Spectrum Sensing with Machine Learning

Naci Pekçokgüler

The crowdedness of the RF spectrum constitutes problems in communication, however it also accommodates large amount of useful information. This information can be used to determine existing signals and operating contexts. However, spectrum condition varies ...

EPFL2024

A graph convolutional autoencoder approach to model order reduction for parametrized PDEs

Jan Sickmann Hesthaven, Federico Pichi

The present work proposes a framework for nonlinear model order reduction based on a Graph Convolutional Autoencoder (GCA-ROM). In the reduced order modeling (ROM) context, one is interested in obtaining real -time and many-query evaluations of parametric ...

Academic Press Inc Elsevier Science2024

SzCORE: Seizure Community Open-Source Research Evaluation framework for the validation of electroencephalography-based automated seizure detection algorithms

David Atienza Alonso, Una Pale, Alireza Amirshahi, Jonathan Dan, William Cappelletti

The need for high-quality automated seizure detection algorithms based on electroencephalography (EEG) becomes ever more pressing with the increasing use of ambulatory and long-term EEG monitoring. Heterogeneity in validation methods of these algorithms in ...

2024

Collective relational inference for learning heterogeneous interactions

Olga Fink

Interacting systems are ubiquitous in nature and engineering, ranging from particle dynamics in physics to functionally connected brain regions. Revealing interaction laws is of fundamental importance but also particularly challenging due to underlying con ...

Nature Portfolio2024

Training Efficient Controllers via Analytic Policy Gradient

Dario Floreano, Davide Scaramuzza, Valentin Wüest

Control design for robotic systems is complex and often requires solving an optimization to follow a trajectory accurately. Online optimization approaches like Model Predictive Control (MPC) have been shown to achieve great tracking performance, but requir ...

New York2023

Contextual Stochastic Bilevel Optimization

Daniel Kuhn, Andreas Krause, Yifan Hu

We introduce contextual stochastic bilevel optimization (CSBO) -- a stochastic bilevel optimization framework with the lower-level problem minimizing an expectation conditioned on some contextual information and the upper-level decision variable. This fram ...

2023

Polynomial-time universality and limitations of deep learning

Emmanuel Abbé

The goal of this paper is to characterize function distributions that general neural networks trained by descent algorithms (GD/SGD), can or cannot learn in polytime. The results are: (1) The paradigm of general neural networks trained by SGD is poly-time ...

WILEY2023

Fast and robust parameter estimation with uncertainty quantification for the cardiac function

Alfio Quarteroni

Background and objectives: Parameter estimation and uncertainty quantification are crucial in computa-tional cardiology, as they enable the construction of digital twins that faithfully replicate the behavior of physical patients. Many model parameters reg ...

ELSEVIER IRELAND LTD2023

Accelerated chemical science with AI

Michele Ceriotti, Philippe Schwaller

In light of the pressing need for practical materials and molecular solutions to renewable energy and health problems, to name just two examples, one wonders how to accelerate research and development in the chemical sciences, so as to address the time it ...

Royal Soc Chemistry2023

Comparison of regression techniques for generating surrogate models to predict the thermodynamic behavior of biomass gasification systems

François Maréchal, Daniel Alexander Florez Orrego, Julia Granacher, Meire Ellen Gorete Ribeiro Domingos, Marie Jane Francine Jones

Biomass resources can play an important role in the energy transition, being a dynamic feedstock that can be transformed either into solid, liquid or gaseous fuels. The biomass gasification is a versatile way to convert wastes into energy. In this work, th ...

Elsevier2023

Preliminary design of the cold mass supports for the EU DEMO feeders

Kamil Sedlák, Roberto Guarino

The Cold Mass Support (CMS) is a basic structural component of the feeder system of the EU DEMO tokamak. The function of this structural element is not only to provide support to the containment duct - wiring the cryogenic lines, electrical bus bars and in ...

2023

Convolutional neural network classifies visual stimuli from cortical response recorded with wide-field imaging in mice

Silvestro Micera

Objective. The optic nerve is a good location for a visual neuroprosthesis. It can be targeted when a subject cannot receive a retinal prosthesis and it is less invasive than a cortical implant. The effectiveness of an electrical neuroprosthesis depends on ...

IOP Publishing Ltd2023

Decentralized Gan Training Through Diffusion Learning

Ali H. Sayed, Noé Stauffer

Most available studies on distributed GAN architectures focus on implementations with a fusion center. In this work, we propose a fully decentralized scheme by employing a diffusion strategy to train a network of GANs. We interpret the training procedure a ...

IEEE2022

Adversarial training with informed data selection

Pascal Frossard, Javier Alejandro Maroto Morales

With the increasing amount of available data and advances in computing capabilities, deep neural networks (DNNs) have been successfully employed to solve challenging tasks in various areas, including healthcare, climate, and finance. Nevertheless, state-of ...

IEEE2022

DIVIDE-AND-CONQUER METHODS FOR FUNCTIONS OF MATRICES WITH BANDED OR HIERARCHICAL LOW-RANK STRUCTURE\ast

Daniel Kressner, Stefano Massei, Alice Cortinovis

This work is concerned with approximating matrix functions for banded matrices, hierarchically semiseparable matrices, and related structures. We develop a new divide-and-conquer method based on (rational) Krylov subspace methods for performing low-rank up ...

SIAM PUBLICATIONS2022