Publication

Brief Announcement: Byzantine-Tolerant Machine Learning

Publications associées (31)

Biologically plausible unsupervised learning in shallow and deep neural networks

The way our brain learns to disentangle complex signals into unambiguous concepts is fascinating but remains largely unknown. There is evidence, however, that hierarchical neural representations play a key role in the cortex. This thesis investigates biolo ...

EPFL2021

Learning in Volatile Environments With the Bayes Factor Surprise

Wulfram Gerstner, Vasiliki Liakoni, Johanni Michael Brea, Alireza Modirshanechi

Surprise-based learning allows agents to rapidly adapt to nonstationary stochastic environments characterized by sudden changes. We show that exact Bayesian inference in a hierarchical model gives rise to a surprise-modulated trade-off between forgetting o ...

MIT PRESS2021

Byzantine Fault-Tolerant Distributed Machine Learning with Norm-Based Comparative Gradient Elimination

Shuo Liu, Nirupam Gupta

This paper considers the Byzantine fault-tolerance problem in distributed stochastic gradient descent (D-SGD) method - a popular algorithm for distributed multi-agent machine learning. In this problem, each agent samples data points independently from a ce ...

IEEE COMPUTER SOC2021

Surprise-based model estimation in reinforcement learning: algorithms and brain signatures

Vasiliki Liakoni

Learning how to act and adapting to unexpected changes are remarkable capabilities of humans and other animals. In the absence of a direct recipe to follow in life, behaviour is often guided by rewarding and by surprising events. A positive or a negative o ...

EPFL2021

Robust Distributed Learning

El Mahdi El Mhamdi

Whether it occurs in artificial or biological substrates, {\it learning} is a {distributed} phenomenon in at least two aspects. First, meaningful data and experiences are rarely found in one location, hence {\it learners} have a strong incentive to work t ...

EPFL2020

Learning and leveraging shared domain semantics to counteract visual domain shifts

Róger Bermúdez Chacón

One of the main limitations of artificial intelligence today is its inability to adapt to unforeseen circumstances. Machine Learning (ML), due to its data-driven nature, is particularly susceptible to this. ML relies on observations in order to learn impli ...

EPFL2020

Generative adversarial training of product of policies for robust and adaptive movement primitives

Sylvain Calinon, Emmanuel Pignat, Hakan Girgin

In learning from demonstrations, many generative models of trajectories make simplifying assumptions of independence. Correctness is sacrificed in the name of tractability and speed of the learning phase. The ignored dependencies, which are often the kinem ...

2020

Deep Neural Networks With Trainable Activations and Controlled Lipschitz Constant

Michaël Unser, Harshit Gupta, Joaquim Gonçalves Garcia Barreto Campos, Shayan Aziznejad

We introduce a variational framework to learn the activation functions of deep neural networks. Our aim is to increase the capacity of the network while controlling an upper-bound of the actual Lipschitz constant of the input-output relation. To that end, ...

2020

Interactive Teaching Algorithms for Inverse Reinforcement Learning

Volkan Cevher, Kamalaruban Parameswaran

We study the problem of inverse reinforcement learning (IRL) with the added twist that the learner is assisted by a helpful teacher. More formally, we tackle the following algorithmic question: How could a teacher provide an informative sequence of demonst ...

2019

Interactive Teaching Algorithms for Inverse Reinforcement Learning

Volkan Cevher, Kamalaruban Parameswaran

2019

AdaptHD: Adaptive Efficient Training for Brain-Inspired Hyperdimensional Computing

Giovanni De Micheli, Mohsen Imani, Samuel Bosch

Brain-inspired Hyperdimensional (HD) computing is a promising solution for energy-efficient classification. However, the existing HD computing algorithms have a lack of controllability on the training iterations which often results in slow training or dive ...

2019