On the different regimes of stochastic gradient descent

Chat with Graph Search

Ask any question about EPFL courses, lectures, exercises, research, news, etc. or try the example questions below.

DISCLAIMER: The Graph Chatbot is not programmed to provide explicit or categorical answers to your questions. Rather, it transforms your questions into API requests that are distributed across the various IT services officially administered by EPFL. Its purpose is solely to collect and recommend relevant references to content that you can explore to help you answer your questions.

More attention has been paid to integrating existing knowledge with data to understand the complex mechanical behaviour of geomaterials, but it incurs scepticism and criticism on its generalizability and robustness. Moreover, a common mistake in current da ...

The first two chapters develop ML-based models that generate conditional SDF estimates efficiently using conditioning information sets, resulting in minimal pricing errors and superior Sharpe ratios compared to traditional conditional asset pricing models. ...

Monitoring of cardiac output (CO) is a mainstay of hemodynamic management in the acutely or critically ill patient. Invasive determination of CO using thermodilution, albeit regarded as the gold standard, is cumbersome and bears risks inherent to catheteri ...

BackgroundBronchiolitis Obliterans Syndrome (BOS), a fibrotic airway disease that may develop after lung transplantation, conventionally relies on pulmonary function tests (PFTs) for diagnosis due to limitations of CT imaging. Deep neural networks (DNNs) h ...

Magnons are the quanta of spin waves and transport angular momenta through magnetically ordered materials. They can be used to distribute and control on-chip GHz signals without charge flow, thereby avoiding Joule heating. Beyond multiplexed signal process ...

Object detection, a fundamental task in computer vision, is crucial for various intelligent edge computing applications. However, object detection algorithms are usually heavy in computation, hindering their deployments on resource-constrained edge devices ...

The optimistic gradient method is useful in addressing minimax optimization problems. Motivated by the observation that the conventional stochastic version suffers from the need for a large batch size on the order of O(ϵ-2) to achieve an ϵ-stationary solut ...

Noise in the data is one of the main cause of model performance drop. Denoising is therefore a critical step in most data pipelines. In this paper we propose to fuse the learning abilities of Neural Network with the well-proven efficiency of the wavelet pa ...

A data-driven inverse design method based on neural networks is proposed for turbomachinery. In the devised methodology, design parameters are provided as input to the neural network, and performance attributes, e.g. efficiency, as output. Once trained, th ...

This paper proposes a novel learning-based approach for achieving exponential stabilization of nonlinear control-affine systems. We leverage the Control Contraction Metrics (CCMs) framework to co-synthesize Neural Contraction Metrics (NCMs) and Neural Netw ...

Integrating low-power wearable systems into routine health monitoring is an ongoing challenge. Recent advances in the computation capabilities of wearables make it possible to target complex scenarios by exploiting multiple biosignals and using high-perfor ...

Smart meters, devices measuring the electricity and gas consumption of a household, are currently being deployed at a fast rate throughout the world. The data they collect are extremely useful, including in the fight against climate change. However, these ...

Face recognition systems tend toward ubiquity and are commonly utilized for security purposes. These systems operate based on facial representations, called templates, extracted by a deep neural network from each face image. However, it has been shown that ...

Small scale ultrasonic piezoelectric actuators performance strongly depends on not well-known contact dynamics. Deep Neural Network (DNN) sees their use in physic simulation growing as their flexibility allows better performance especially when dynamics la ...

Spiking neural networks are of high current interest, both from the perspective of modelling neural networks of the brain and for porting their fast learning capability and energy efficiency into neuromorphic hardware. But so far we have not been able to r ...

Computational chemistry techniques offer tremendous potential for accelerating the discovery of sustainable chemical processes and reactions. However, the environmental impacts of the substantial computing power required for these digital methods are often ...

We consider a network of agents that must solve an online optimization problem from continual observation of streaming data. To this end, the agents implement a distributed cooperative strategy where each agent is allowed to perform local exchange of infor ...

Proprioception tells the brain the state of the body based on distributed sensory neurons. Yet, the principles that govern proprioceptive processing are poorly understood. Here, we employ a task -driven modeling approach to investigate the neural code of p ...

Adversarial Training using a strong first-order adversary (PGD) is the gold standard for training Deep Neural Networks that are robust to adversarial examples. We show that, contrary to the general understanding of the method, the gradient at an optimal ad ...

Deep spiking neural networks (SNNs) offer the promise of low-power artificial intelligence. However, training deep SNNs from scratch or converting deep artificial neural networks to SNNs without loss of performance has been a challenge. Here we propose an ...

On the different regimes of stochastic gradient descent

Chat with Graph Search

t-PiNet: A thermodynamics-informed hierarchical learning for discovering constitutive relations of geomaterials

Machine Learning Applications to Conditional Asset Pricing: Attention, CNNs, and Neural Tangent Kernels

Machine learning-enabled estimation of cardiac output from peripheral waveforms is independent of blood pressure measurement location in an in silico population

Harnessing deep learning to detect bronchiolitis obliterans syndrome from chest CT

Perspective on nonvolatile magnon-signal storage and in-memory computation for low-power consuming magnonics

Edge-Cloud Collaborated Object Detection via Bandwidth Adaptive Difficult-Case Discriminator

Diffusion Stochastic Optimization for Min-Max Problems

Robust time series denoising with learnable wavelet packet transform

DATA-DRIVEN INVERSE DESIGN METHOD FOR TURBOMACHINERY

Neural Exponential Stabilization of Control-affine Nonlinear Systems

M2SKD: Multi-to-Single Knowledge Distillation of Real-Time Epileptic Seizure Detection for Low-Power Wearable Systems

Re-pseudonymization Strategies for Smart Meter Data Are Not Robust to Deep Learning Profiling Attacks

Breaking Template Protection: Reconstruction of Face Images from Protected Facial Templates

Normal Contact Force Estimation Using Deep Learning

Fast learning without synaptic plasticity in spiking neural networks

Balancing computational chemistry's potential with its environmental impact

Distributed Adaptive Learning Under Communication Constraints

Task-driven neural network models predict neural dynamics of proprioception

Finding Actual Descent Directions For Adversarial Training

An exact mapping from ReLU networks to spiking neural networks