Home

Publication

Distributed Value-Function Learning with Linear Convergence Rates

About
Privacy
Disclaimer

Graph Chatbot

Related publications (44)

Page 2 of 3

Quantifying the Unknown: Data-Driven Approaches and Applications in Energy Systems

Paul Scharnhorst

In light of the challenges posed by climate change and the goals of the Paris Agreement, electricity generation is shifting to a more renewable and decentralized pattern, while the operation of systems like buildings is increasingly electrified. This calls ...

EPFL2024

Frihet, sikkerhet, forstaden: Brev fra Amerika

Nagy Makhlouf

Why have countries formerly leading public policies of housing – Norway, the U.K., France, etc. – shifted towards privatizing accommodation from the late 1970s? Have these States merely let go of housing and handed it over to private interests in the name ...

2024

Spatial Modeling for Building Design Evaluation: from Visual Landscape Quality Assessment to Devaluation Risk Estimation

Adam Robert Swietek

Zoning reform is a crucial tool for cities to adapt to contemporary challenges. However, its implementation remains challenging. Property owners, with a vested interest in the value of their neighborhoods, are sensitive to local developments and the potent ...

EPFL2024

Reinforcement learning approach to control an inverted pendulum: A general framework for educational purposes

Jesus Sanchez Rodriguez

Machine learning is often cited as a new paradigm in control theory, but is also often viewed as empirical and less intuitive for students than classical model-based methods. This is particularly the case for reinforcement learning, an approach that does n ...

PUBLIC LIBRARY SCIENCE2023

Asymptotics of feature learning in two-layer networks after one gradient-step

Lenka Zdeborová, Florent Gérard Krzakala, Bruno Loureiro, Hugo Chao Cui, Yatin Dandi, Luca Pesce, Yue Lu

In this manuscript, we investigate the problem of how two-layer neural networks learn features from data, and improve over the kernel regime, after being trained with a single gradient descent step. Leveraging the insight from (Ba et al., 2022), we model t ...

2024

Evaluation and digitalization: what are the key challenges for evaluation processes and evaluators?

Omar Ballester Gonzalez

Public policy evaluation has traditionally been conducted in a context constrained by legal, institutional and political red tape. The arrival of digitalisation adds a new layer to public policy evaluation processes. Assessing the quality of technologies, ...

Edward Elgar Publishing2023

Convergence of a model-free entropy-regularized inverse reinforcement learning algorithm

Andreas Schlaginhaufen, Maryam Kamgarpour, Tingting Ni

Given a dataset of expert demonstrations, inverse reinforcement learning (IRL) aims to recover a reward for which the expert is optimal. This work proposes a model-free algorithm to solve the entropy-regularized IRL problem. In particular, we employ a stoc ...

Institute of Electrical and Electronics Engineers Inc.2024

Multi-agent actor-critic with time dynamical opponent model

Olga Fink

In multi-agent reinforcement learning, multiple agents learn simultaneously while interacting with a common environment and each other. Since the agents adapt their policies during learning, not only the behavior of a single agent becomes non-stationary, b ...

2023

Bed Topography Inference from Velocity Field Using Deep Learning

Christophe Ancey, Mehrdad Kiani Oshtorjani

Measuring bathymetry has always been a major scientific and technological challenge. In this work, we used a deep learning technique for inferring bathymetry from the depth-averaged velocity field. The training of the neural network is based on 5742 labora ...

2023

Topics in statistical physics of high-dimensional machine learning

Hugo Chao Cui

In the past few years, Machine Learning (ML) techniques have ushered in a paradigm shift, allowing the harnessing of ever more abundant sources of data to automate complex tasks. The technical workhorse behind these important breakthroughs arguably lies in ...

EPFL2024

Predicting the long-term collective behaviour of fish pairs with deep learning

Francesco Mondada, Alexandre Massoud Alahi, Vaios Papaspyros

Modern computing has enhanced our understanding of how social interactions shape collective behaviour in animal societies. Although analytical models dominate in studying collective behaviour, this study introduces a deep learning model to assess social in ...

2024

Diffusion of connected and autonomous vehicles concerning mode choice, policy interventions and sustainability impacts: A system dynamics modelling study

Evangelos Paschalidis

Connected and autonomous vehicles (CAV) have seen a rapid development over the past decade. However, wide diffusion of high level CAVs is still decades to come, and will depend on many technological, policy and public acceptance factors. Merging a traditio ...

ELSEVIER SCI LTD2023

Teacher-Mediated and Student-Led Interaction with a Physics Simulation: Effects on the Learning Experience

Denis Gillet, Juan Carlos Farah, Jérémy Alain La Scala-Jayet

Computer simulations are often used as support material for science education, as they can engage students through inquiry-based learning, promote their active interaction in the experimentation phase, and help them visualize abstract concepts. For instanc ...

2024

Breaking the Curse of Dimensionality in Deep Neural Networks by Learning Invariant Representations

Leonardo Petrini

Artificial intelligence, particularly the subfield of machine learning, has seen a paradigm shift towards data-driven models that learn from and adapt to data. This has resulted in unprecedented advancements in various domains such as natural language proc ...

EPFL2023

Multi-temporal forest monitoring in the Swiss Alps with knowledge-guided deep learning

Devis Tuia, Marc Conrad Russwurm, Thiên-Anh Claris Nguyen, Gaston Jean Lenczner

Monitoring forests, in particular their response to climate and land use change, requires studying long time scales. While efficient deep learning methods have been developed to process short time series of satellite imagery, leveraging long time series of ...

Elsevier Science Inc2024

DIET Controller: Dynamic Indoor Environment using Deep Reinforcement Learning

Arnab Chatterjee

Heating, Ventilation, and Air Conditioning (HVAC) Systems utilize much energy, accounting for 40% of total building energy use. The temperatures in buildings are commonly held within narrow limits, leading to higher energy use. Measurements from office bui ...

EPFL2023

Environmental and geographical factors influencing the spread of SARS-CoV-2 over 2 years: a fine-scale spatiotemporal analysis

Stéphane Joost, Anaïs Laurence Ladoy, David Nicolas De Ridder

Introduction Since its emergence in late 2019, the SARS-CoV-2 virus has led to a global health crisis, affecting millions and reshaping societies and economies worldwide. Investigating the determinants of SARS-CoV-2 diffusion and their spatiotemporal dynam ...

FRONTIERS MEDIA SA2024

Multienzyme deep learning models improve peptide de novo sequencing by mass spectrometry proteomics

Hamed Khakzad

Author summaryIn recent years, the application of deep learning represented a breakthrough in the mass spectrometry (MS) field by improving the assignment of the correct sequence of amino acids from observable MS spectra without prior knowledge, also known ...

PUBLIC LIBRARY SCIENCE2023

Simulated Learners in Educational Technology: A Systematic Literature Review and a Turing-like Test

Tanja Christina Käser Jacober

Simulation is a powerful approach that plays a significant role in science and technology. Computational models that simulate learner interactions and data hold great promise for educational technology as well. Amongst others, simulated learners can be use ...

SPRINGER2023

Optimization Algorithms for Decentralized, Distributed and Collaborative Machine Learning

Anastasiia Koloskova

Distributed learning is the key for enabling training of modern large-scale machine learning models, through parallelising the learning process. Collaborative learning is essential for learning from privacy-sensitive data that is distributed across various ...

EPFL2024