Publication

Learning Control

Sylvain Calinon
2018
Book Chapters

Abstract

This chapter presents an overview of learning approaches for the acquisition of controllers and movement skills in humanoid robots. The term learning control refers to the process of acquiring a control strategy to achieve a task. While the definition is in some cases restrained to trial-and-error learning, we present here learning control in a broader perspective, with a focus on the representation of skills to be acquired, and on the different learning strategies that can contribute to the acquisition of robust and adaptive controllers for humanoids.

Official source

https://infoscience.epfl.ch/entities/publication/0fa5c9e2-474b-4f96-8797-67c6be14108f

About this result

This page is automatically generated and may contain information that is not correct, complete, up-to-date, or relevant to your search query. The same applies to every other page on this website. Please make sure to verify the information with EPFL's official sources.

Graph Chat

Chat with Graph Search

Ask any question about EPFL courses, lectures, exercises, research, news, etc. or try the example questions below.

DISCLAIMER: The Graph Chatbot is not programmed to provide explicit or categorical answers to your questions. Rather, it transforms your questions into API requests that are distributed across the various IT services officially administered by EPFL. Its purpose is solely to collect and recommend relevant references to content that you can explore to help you answer your questions.

Sylvain Calinon
2018
Book Chapters

Abstract

Official source

https://infoscience.epfl.ch/entities/publication/0fa5c9e2-474b-4f96-8797-67c6be14108f

About this result

Related concepts (32)

Reinforcement learning

Reinforcement learning (RL) is an area of machine learning concerned with how intelligent agents ought to take actions in an environment in order to maximize the notion of cumulative reward. Reinforcement learning is one of three basic machine learning paradigms, alongside supervised learning and unsupervised learning. Reinforcement learning differs from supervised learning in not needing labelled input/output pairs to be presented, and in not needing sub-optimal actions to be explicitly corrected.

Learning

Learning is the process of acquiring new understanding, knowledge, behaviors, skills, values, attitudes, and preferences. The ability to learn is possessed by humans, animals, and some machines; there is also evidence for some kind of learning in certain plants. Some learning is immediate, induced by a single event (e.g. being burned by a hot stove), but much skill and knowledge accumulate from repeated experiences. The changes induced by learning often last a lifetime, and it is hard to distinguish learned material that seems to be "lost" from that which cannot be retrieved.

Q-learning

Q-learning is a model-free reinforcement learning algorithm to learn the value of an action in a particular state. It does not require a model of the environment (hence "model-free"), and it can handle problems with stochastic transitions and rewards without requiring adaptations. For any finite Markov decision process (FMDP), Q-learning finds an optimal policy in the sense of maximizing the expected value of the total reward over any and all successive steps, starting from the current state.

Related publications (32)

Learning Control

Chat with Graph Search

Learning environments are associated with developmental trajectories of thalamocortical attention circuits in childhood

Enhancing E-health system accuracy using Rendezvous Data Processing Model (RDPM) with IoT-cloud integration

Sequence models for continuous cell cycle stage prediction from brightfield images