Optimal Convergence for Distributed Learning with Stochastic Gradient Methods and Spectral Algorithms

Chat with Graph Search

Ask any question about EPFL courses, lectures, exercises, research, news, etc. or try the example questions below.

DISCLAIMER: The Graph Chatbot is not programmed to provide explicit or categorical answers to your questions. Rather, it transforms your questions into API requests that are distributed across the various IT services officially administered by EPFL. Its purpose is solely to collect and recommend relevant references to content that you can explore to help you answer your questions.

Fuel performance codes are essential for predicting fuel rod behavior in nuclear reactors. These codes comprise a complex system of models with empirical constants that require calibration against experimental data. To support this calibration, this study ...

In light of the challenges posed by climate change and the goals of the Paris Agreement, electricity generation is shifting to a more renewable and decentralized pattern, while the operation of systems like buildings is increasingly electrified. This calls ...

The optimistic gradient method is useful in addressing minimax optimization problems. Motivated by the observation that the conventional stochastic version suffers from the need for a large batch size on the order of O(ϵ-2) to achieve an ϵ-stationary solut ...

In the rapidly evolving landscape of machine learning research, neural networks stand out with their ever-expanding number of parameters and reliance on increasingly large datasets. The financial cost and computational resources required for the training p ...

In this work, we develop first-order (Hessian-free) and zeroth-order (derivative-free) implementations of the Cubically Regularized Newton Method for solving general non-convex optimization problems. For that, we employ finite difference approximations of ...

In this thesis, we study two closely related directions: robustness and generalization in modern deep learning. Deep learning models based on empirical risk minimization are known to be often non-robust to small, worst-case perturbations known as adversari ...

For robots to operate in unstructured environments, they are required to interact with objects through contact. Those contacts may be used to push objects to the side, deform objects, or manipulate objects in-hand. This thesis addresses the problem of cont ...

Modern integrated circuits are tiny yet incredibly complex technological artifacts, composed of millions and billions of individual structures working in unison. Managing their complexity and facilitating their design drove part of the co-evolution of mode ...

Adversarial examples crafted in black-box scenarios are affected by unrealistic colors or spatial artifacts. To prevent these shortcomings, we propose a novel strategy that generates adversarial images with low detectability and high transferability. The p ...

Modern neuroscience research is generating increasingly large datasets, from recording thousands of neurons over long timescales to behavioral recordings of animals spanning weeks, months, or even years. Despite a great variety in recording setups and expe ...

Integer linear programming (ILP) is an elegant approach to solve linear optimization problems, naturally described using integer decision variables. Within the context of physics-inspired machine learning (ML) applied to chemistry, we demonstrate the relev ...

While momentum-based accelerated variants of stochastic gradient descent (SGD) are widely used when training machine learning models, there is little theoretical understanding on the generalization error of such methods. In this work, we first show that th ...

The upcoming Square Kilometre Array Observatory will produce images of neutral hydrogen distribution during the epoch of reionization by observing the corresponding 21-cm signal. However, the 21-cm signal will be subject to instrumental limitations such as ...

Object detection, a fundamental task in computer vision, is crucial for various intelligent edge computing applications. However, object detection algorithms are usually heavy in computation, hindering their deployments on resource-constrained edge devices ...

In the past few years, Machine Learning (ML) techniques have ushered in a paradigm shift, allowing the harnessing of ever more abundant sources of data to automate complex tasks. The technical workhorse behind these important breakthroughs arguably lies in ...

Cluster expansions are commonly employed as surrogate models to link the electronic structure of an alloy to its finite-temperature properties. Using cluster expansions to model materials with several alloying elements is challenging due to a rapid increas ...

Herein, machine learning (ML) models using multiple linear regression (MLR), support vector regression (SVR), random forest (RF) and artificial neural network (ANN) are developed and compared to predict the output features viz. specific capacitance (Csp), ...

Monitoring of cardiac output (CO) is a mainstay of hemodynamic management in the acutely or critically ill patient. Invasive determination of CO using thermodilution, albeit regarded as the gold standard, is cumbersome and bears risks inherent to catheteri ...

Distributed learning is the key for enabling training of modern large-scale machine learning models, through parallelising the learning process. Collaborative learning is essential for learning from privacy-sensitive data that is distributed across various ...

This paper introduces a novel architecture for Quantum Graph Neural Networks, which is significantly different from previous approaches found in the literature. The proposed approach produces similar outcomes with respect to previous models but with fewer ...

Optimal Convergence for Distributed Learning with Stochastic Gradient Methods and Spectral Algorithms

Chat with Graph Search

Preliminary Sensitivity Analysis of Time-Dependent Code Outputs in Fuel Performance Models Using OFFBEAT for Future Calibration

Quantifying the Unknown: Data-Driven Approaches and Applications in Energy Systems

Diffusion Stochastic Optimization for Min-Max Problems

Random matrix methods for high-dimensional machine learning models

First and Zeroth-Order Implementations of the Regularized Newton Method with Lazy Approximated Hessians

Understanding generalization and robustness in modern deep learning

A Stochastic Approach to Contact-rich Manipulation

Graph generative deep learning models with an application to circuit topologies

GLoFool: Global Enhancements and Local Perturbations to Craft Adversarial Images

Robust machine learning for neuroscientific inference

Integer Linear Programming for Unsupervised Training Set Selection in Molecular Machine Learning

On the Generalization of Stochastic Gradient Descent with Momentum

Deep learning approach for identification of H II regions during reionization in 21-cm observations - II. Foreground contamination

Edge-Cloud Collaborated Object Detection via Bandwidth Adaptive Difficult-Case Discriminator

Topics in statistical physics of high-dimensional machine learning

Constructing multicomponent cluster expansions with machine-learning and chemical embedding

Machine learning models for prediction of electrochemical properties in supercapacitor electrodes using MXene and graphene nanoplatelets

Machine learning-enabled estimation of cardiac output from peripheral waveforms is independent of blood pressure measurement location in an in silico population

Optimization Algorithms for Decentralized, Distributed and Collaborative Machine Learning

A Study on Quantum Graph Neural Networks Applied to Molecular Physics