Publications related to Autonomous reinforcement learning with experience replay

Related publications (40)

X-ray Micro-CT based characterization of rock cuttings with deep learning

Nils Frédérik Heiden Olsen, Alexandre Massoud Alahi, Pascal Turberg

Rock cuttings from destructive boreholes are a common and cheaper source of drilling materials that can be used to determine underground geology compared to rock core samples. Classifying manually the series of cuttings can be a long and tedious process an ...

2025

Comparison of Reservoir Computing topologies using the Recurrent Kernel approach

Jonathan Yuelin Dong

Reservoir Computing (RC) has become popular in recent years thanks to its fast and efficient computational capabilities. Standard RC has been shown to be equivalent in the asymptotic limit to Recurrent Kernels, which helps in analyzing its expressive power ...

2025

Robust semantic learning for precise medical image segmentation

Seyedbehzad Bozorgtabar

Precisely localizing anomalies in medical images remains a significant challenge due to their heterogeneous nature across modalities and organs. While initial efforts excelled in identifying prominent anomalies, detecting minute target lesions posed signif ...

2025

Enhancing wearable sensor data analysis for patient health monitoring using allied data disparity technique and multi instance ensemble perceptron learning

Zaffar Ahmed Shaikh

Wearable Sensor (WS)-based monitoring systems detect minute patient movements/ demands and abnormalities through periodic sensing and imaging. Sensor data observed over different intervals is not constant or available based on operating sequences. Due to v ...

Springer Science and Business Media LLC2025

A coordinate transformation-based physics-informed neural networks for hyperbolic conservation laws

Jan Sickmann Hesthaven

Hyperbolic conservation laws play a critical role in various fields, including aerodynamics, physics, and oceanography. However, traditional physics-informed neural networks (PINNs), despite their remarkable capabilities in solving partial differential equ ...

2025

Galerkin neural network-POD for acoustic and electromagnetic wave propagation in parametric domains

Jan Sickmann Hesthaven, Mariella Kast, Philipp Christoph Weder

We investigate reduced order models for acoustic and electromagnetic wave problems in parametrically defined domains. The parameter-to-solution maps are approximated following the so-called Galerkin POD-NN method, which combines the construction of a reduc ...

2025

Few-shot Learning for Efficient and Effective Machine Learning Model Adaptation

Arnout Jan J Devos

Machine learning (ML) enables artificial intelligent (AI) agents to learn autonomously from data obtained from their environment to perform tasks. Modern ML systems have proven to be extremely effective, reaching or even exceeding human intelligence. Altho ...

EPFL2024

Understanding generalization and robustness in modern deep learning

Maksym Andriushchenko

In this thesis, we study two closely related directions: robustness and generalization in modern deep learning. Deep learning models based on empirical risk minimization are known to be often non-robust to small, worst-case perturbations known as adversari ...

EPFL2024

Meta-learning to address diverse Earth observation problems across resolutions

Devis Tuia, Marc Conrad Russwurm, Benjamin Alexander Kellenberger

Earth scientists study a variety of problems with remote sensing data, but they most often consider them in isolation from each other, which limits information flows across disciplines. In this work, we present METEOR, a meta-learning methodology for Earth ...

Springernature2024

Topics in statistical physics of high-dimensional machine learning

Hugo Chao Cui

In the past few years, Machine Learning (ML) techniques have ushered in a paradigm shift, allowing the harnessing of ever more abundant sources of data to automate complex tasks. The technical workhorse behind these important breakthroughs arguably lies in ...

EPFL2024

IM-Context: In-Context Learning for Imbalanced Regression Tasks

Olga Fink, Ismail Nejjar

Regression models often fail to generalize effectively in regions characterized by highly imbalanced label distributions. Previous methods for deep imbalanced regression rely on gradient-based weight updates, which tend to overfit in underrepresented regio ...

Neural information processing systems foundation2024

Acquiring musculoskeletal skills with curriculum-based reinforcement learning - model weights

Abigaïl Rebecca Lise Ingster, Alexander Mathis, Alberto Silvio Chiappa

Here we provide the weights of the neural network policies used for the analysis presented in our article. The archives whose names start with a number (01 - 32) correspond to the 32 curriculum steps to train the Baoding Balls policy which ranked first at ...

Zenodo2024

Robust machine learning for neuroscientific inference

Steffen Schneider

Modern neuroscience research is generating increasingly large datasets, from recording thousands of neurons over long timescales to behavioral recordings of animals spanning weeks, months, or even years. Despite a great variety in recording setups and expe ...

EPFL2024

Incorporating Projective Geometry into Deep Learning

Michal Jan Tyszkiewicz

In this thesis we explore the applications of projective geometry, a mathematical theory of the relation between 3D scenes and their 2D images, in modern learning-based computer vision systems. This is an interesting research question which contradicts the ...

EPFL2024

Performing and Detecting Backdoor Attacks on Face Recognition Algorithms

Alexander Carl Unnervik

The field of biometrics, and especially face recognition, has seen a wide-spread adoption the last few years, from access control on personal devices such as phones and laptops, to automated border controls such as in airports. The stakes are increasingly ...

EPFL2024

Les Houches lectures on deep learning at large and infinite width

Vittorio Erba, Christian Keup

These lectures, presented at the 2022 Les Houches Summer School on Statistical Physics and Machine Learning, focus on the infinite-width limit and large-width regime of deep neural networks. Topics covered include the various statistical and dynamical prop ...

2024

Optimization Algorithms for Decentralized, Distributed and Collaborative Machine Learning

Anastasiia Koloskova

Distributed learning is the key for enabling training of modern large-scale machine learning models, through parallelising the learning process. Collaborative learning is essential for learning from privacy-sensitive data that is distributed across various ...

EPFL2024

Predicting the long-term collective behaviour of fish pairs with deep learning

Francesco Mondada, Alexandre Massoud Alahi, Vaios Papaspyros

Modern computing has enhanced our understanding of how social interactions shape collective behaviour in animal societies. Although analytical models dominate in studying collective behaviour, this study introduces a deep learning model to assess social in ...

2024

Partial discharge localization in power transformer tanks using machine learning methods

Farhad Rachidi-Haeri, Marcos Rubinstein, Hamidreza Karami

This paper presents a comparison of machine learning (ML) methods used for three-dimensional localization of partial discharges (PD) in a power transformer tank. The study examines ML and deep learning (DL) methods, ranging from support vector machines (SV ...

Nature Publishing Group2024

Generalization and Personalization of Machine Learning for Multimodal Mobile Sensing in Everyday Life

Lakmal Buddika Meegahapola

A range of behavioral and contextual factors, including eating and drinking behavior, mood, social context, and other daily activities, can significantly impact an individual's quality of life and overall well-being. Therefore, inferring everyday life aspe ...

EPFL2024