Mediaspace scheduled maintenance: Aug 25, 2026 07:00 - 12:00 AM. During this time, videos will be temporarily unavailable. Check status updates.

Concept

Fonction softmax

Publications associées (30)

Adaptive Social Learning

Ali H. Sayed, Virginia Bordignon

This work proposes a novel strategy for social learning by introducing the critical feature of adaptation. In social learning, several distributed agents update continually their belief about a phenomenon of interest through: i) direct observation of strea ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2021

Multi-ion-sensing emulator and multivariate calibration optimization by machine learning models

Giovanni De Micheli, Sandro Carrara, Francesca Criscuolo, Mandresy Ivan Ny Hanitra

One paramount challenge in multi-ion-sensing arises from ion interference that degrades the accuracy of sensor calibration. Machine learning models are here proposed to optimize such multivariate calibration. However, the acquisition of big experimental da ...

2021

Hardware and Software Interfaces Design for Multi-Panel Electrochemical Sensors

Mandresy Ivan Ny Hanitra

The exponential growth of wearable healthcare devices market is fostered by the internetof- things (IoT) era. Connected smart biosensors enable a decentralized healthcare that does not constrain the user to be in a medical facility to get a real-time insig ...

EPFL2021

Deep Neural Networks With Trainable Activations and Controlled Lipschitz Constant

Michaël Unser, Shayan Aziznejad, Harshit Gupta, Joaquim Gonçalves Garcia Barreto Campos

We introduce a variational framework to learn the activation functions of deep neural networks. Our aim is to increase the capacity of the network while controlling an upper-bound of the actual Lipschitz constant of the input-output relation. To that end, ...

2020

Learning Activation Functions in Deep (Spline) Neural Networks

Michaël Unser, Shayan Aziznejad, Pakshal Narendra Bohra, Harshit Gupta, Joaquim Gonçalves Garcia Barreto Campos

We develop an efficient computational solution to train deep neural networks (DNN) with free-form activation functions. To make the problem well-posed, we augment the cost functional of the DNN by adding an appropriate shape regularization: the sum of the ...

2020

A t-distribution based operator for enhancing out of distribution robustness of neural network classifiers

Philip Neil Garner

Neural Network (NN) classifiers can assign extreme probabilities to samples that have not appeared during training (out-of-distribution samples) resulting in erroneous and unreliable predictions. One of the causes for this unwanted behaviour lies in the us ...

IEEE Institute of Electrical and Electronics Engineers2020

Max-infinitely divisible models and inference for spatial extremes

Raphaël Huser, Emeric Rolland Georges Thibaud

For many environmental processes, recent studies have shown that the dependence strength is decreasing when quantile levels increase. This implies that the popular max-stable models are inadequate to capture the rate of joint tail decay, and to estimate jo ...

WILEY2021

Disentangling feature and lazy training in deep neural networks

Matthieu Wyart, Mario Geiger, Stefano Spigler, Arthur Ulysse Jacot-Guillarmod

Two distinct limits for deep learning have been derived as the network width h -> infinity, depending on how the weights of the last layer scale with h. In the neural tangent Kernel (NTK) limit, the dynamics becomes linear in the weights and is described b ...

IOP PUBLISHING LTD2020

Efficient Proximal Mapping of the 1-path-norm of Shallow Networks

Volkan Cevher, Fabian Ricardo Latorre Gomez, Paul Thierry Yves Rolland, Shaul Nadav Hallak

We demonstrate two new important properties of the 1-path-norm of shallow neural networks. First, despite its non-smoothness and non-convexity it allows a closed form proximal operator which can be efficiently computed, allowing the use of stochastic proxi ...

JMLR-JOURNAL MACHINE LEARNING RESEARCH2020

Generalization error in high-dimensional perceptrons: Approaching Bayes error with convex optimization

Lenka Zdeborová, Florent Gérard Krzakala

We consider a commonly studied supervised classification of a synthetic dataset whose labels are generated by feeding a one-layer non-linear neural network with random iid inputs. We study the generalization performances of standard classifiers in the high ...

Curran Associates, Inc.2020