Publications related to On the different regimes of stochastic gradient descent

Related publications (32)

t-PiNet: A thermodynamics-informed hierarchical learning for discovering constitutive relations of geomaterials

More attention has been paid to integrating existing knowledge with data to understand the complex mechanical behaviour of geomaterials, but it incurs scepticism and criticism on its generalizability and robustness. Moreover, a common mistake in current da ...

2025

Machine Learning Applications to Conditional Asset Pricing: Attention, CNNs, and Neural Tangent Kernels

Boris Kuznetsov

The first two chapters develop ML-based models that generate conditional SDF estimates efficiently using conditioning information sets, resulting in minimal pricing errors and superior Sharpe ratios compared to traditional conditional asset pricing models. ...

EPFL2025

Machine learning-enabled estimation of cardiac output from peripheral waveforms is independent of blood pressure measurement location in an in silico population

Ramin Mohammadi, Nikolaos Stergiopoulos, Georgios Rovas, Lydia Aslanidou, Sokratis Anagnostopoulos

Monitoring of cardiac output (CO) is a mainstay of hemodynamic management in the acutely or critically ill patient. Invasive determination of CO using thermodilution, albeit regarded as the gold standard, is cumbersome and bears risks inherent to catheteri ...

2025

Harnessing deep learning to detect bronchiolitis obliterans syndrome from chest CT

Pascal Fua, Michele De Palma, Nahal Mansouri, Jakub Jan Gwizdala

BackgroundBronchiolitis Obliterans Syndrome (BOS), a fibrotic airway disease that may develop after lung transplantation, conventionally relies on pulmonary function tests (PFTs) for diagnosis due to limitations of CT imaging. Deep neural networks (DNNs) h ...

SPRINGERNATURE2025

Perspective on nonvolatile magnon-signal storage and in-memory computation for low-power consuming magnonics

Arnaud Emile S. Nizet, Dirk Grundler, Andrea Mucchietto, Mingran Xu, Shreyas Sanjay Joglekar

Magnons are the quanta of spin waves and transport angular momenta through magnetically ordered materials. They can be used to distribute and control on-chip GHz signals without charge flow, thereby avoiding Joule heating. Beyond multiplexed signal process ...

AIP Publishing2025

Edge-Cloud Collaborated Object Detection via Bandwidth Adaptive Difficult-Case Discriminator

Yung-Cheng Chiang

Object detection, a fundamental task in computer vision, is crucial for various intelligent edge computing applications. However, object detection algorithms are usually heavy in computation, hindering their deployments on resource-constrained edge devices ...

2025

TimEHR: Image-based Time Series Generation for Electronic Health Records

David Atienza Alonso, Anisoara Ionescu, Hojjat Karami

Time series in Electronic Health Records (EHRs) present unique challenges for generative models, such as irregular sampling, missing values, and high dimensionality. In this paper, we propose a novel generative adversarial network (GAN) model, TimEHR, to g ...

Institute of Electrical and Electronics Engineers (IEEE)2025

Diffusion Stochastic Optimization for Min-Max Problems

Ali H. Sayed, Haoyuan Cai

The optimistic gradient method is useful in addressing minimax optimization problems. Motivated by the observation that the conventional stochastic version suffers from the need for a large batch size on the order of O(ϵ-2) to achieve an ϵ-stationary solut ...

2025

Robust time series denoising with learnable wavelet packet transform

Olga Fink, Gaëtan Michel Frusque

Noise in the data is one of the main cause of model performance drop. Denoising is therefore a critical step in most data pipelines. In this paper we propose to fuse the learning abilities of Neural Network with the well-proven efficiency of the wavelet pa ...

2024

DATA-DRIVEN INVERSE DESIGN METHOD FOR TURBOMACHINERY

Fernando Perez Cruz, Luis Salamanca Miño, Firat Ozdemir

A data-driven inverse design method based on neural networks is proposed for turbomachinery. In the devised methodology, design parameters are provided as input to the neural network, and performance attributes, e.g. efficiency, as output. Once trained, th ...

American Society of Mechanical Engineers (ASME)2024

Neural Exponential Stabilization of Control-affine Nonlinear Systems

Giancarlo Ferrari Trecate, Muhammad Zakwan

This paper proposes a novel learning-based approach for achieving exponential stabilization of nonlinear control-affine systems. We leverage the Control Contraction Metrics (CCMs) framework to co-synthesize Neural Contraction Metrics (NCMs) and Neural Netw ...

Institute of Electrical and Electronics Engineers Inc.2024

M2SKD: Multi-to-Single Knowledge Distillation of Real-Time Epileptic Seizure Detection for Low-Power Wearable Systems

David Atienza Alonso, Amir Aminifar, Tomas Teijeiro Campo, Alireza Amirshahi, Saleh Baghersalimi, Farnaz Forooghifar

Integrating low-power wearable systems into routine health monitoring is an ongoing challenge. Recent advances in the computation capabilities of wearables make it possible to target complex scenarios by exploiting multiple biosignals and using high-perfor ...

2024

Re-pseudonymization Strategies for Smart Meter Data Are Not Robust to Deep Learning Profiling Attacks

Ana-Maria Cretu

Smart meters, devices measuring the electricity and gas consumption of a household, are currently being deployed at a fast rate throughout the world. The data they collect are extremely useful, including in the fight against climate change. However, these ...

Association for Computing Machinery, Inc2024

Scalable semantic 3D mapping of coral reefs with deep learning

Anders Meibom, Devis Tuia, Guilhem Maurice Louis Banc-Prandi, Jonathan Paul Sauder

Coral reefs are among the most diverse ecosystems on our planet, and essential to the livelihood of hundreds of millions of people who depend on them for food security, income from tourism and coastal protection. Unfortunately, most coral reefs are existen ...

2024

Breaking Template Protection: Reconstruction of Face Images from Protected Facial Templates

Hatef Otroshi Shahreza

Face recognition systems tend toward ubiquity and are commonly utilized for security purposes. These systems operate based on facial representations, called templates, extracted by a deep neural network from each face image. However, it has been shown that ...

IEEE2024

Normal Contact Force Estimation Using Deep Learning

Yves Perriard, Paolo Germano, Xinxin Liao, Marc Michel Charles Favier

Small scale ultrasonic piezoelectric actuators performance strongly depends on not well-known contact dynamics. Deep Neural Network (DNN) sees their use in physic simulation growing as their flexibility allows better performance especially when dynamics la ...

Institute of Electrical and Electronics Engineers Inc.2024

Fast learning without synaptic plasticity in spiking neural networks

Guillaume Emmanuel Fernand Bellec

Spiking neural networks are of high current interest, both from the perspective of modelling neural networks of the brain and for porting their fast learning capability and energy efficiency into neuromorphic hardware. But so far we have not been able to r ...

Nature Portfolio2024

Balancing computational chemistry's potential with its environmental impact

Philippe Schwaller, Oliver Tobias Schilter

Computational chemistry techniques offer tremendous potential for accelerating the discovery of sustainable chemical processes and reactions. However, the environmental impacts of the substantial computing power required for these digital methods are often ...

ROYAL SOC CHEMISTRY2024

Distributed Adaptive Learning Under Communication Constraints

Ali H. Sayed

We consider a network of agents that must solve an online optimization problem from continual observation of streaming data. To this end, the agents implement a distributed cooperative strategy where each agent is allowed to perform local exchange of infor ...

Ieee-Inst Electrical Electronics Engineers Inc2024

Task-driven neural network models predict neural dynamics of proprioception

Alexander Mathis, Alberto Silvio Chiappa, Alessandro Marin Vargas, Axel Bisi

Proprioception tells the brain the state of the body based on distributed sensory neurons. Yet, the principles that govern proprioceptive processing are poorly understood. Here, we employ a task -driven modeling approach to investigate the neural code of p ...

Cell Press2024