Publication

Information theoretic feature extraction for audio-visual speech recognition

Publications associées (31)

Improving Generalization of Pretrained Language Models

In this dissertation, we propose multiple methods to improve transfer learning for pretrained language models (PLMs). Broadly, transfer learning is a powerful technique in natural language processing, where a language model is first pre-trained on a data-r ...

EPFL2023

Dual-frequency spectral radar retrieval of snowfall microphysics: a physics-driven deep-learning approach

Alexis Berne, Gionata Ghiggi, Anne-Claire Marie Billault--Roux

The use of meteorological radars to study snowfall microphysical properties and processes is well established, in particular via a few distinct techniques: the use of radar polarimetry, of multi-frequency radar measurements, and of the radar Doppler spectr ...

COPERNICUS GESELLSCHAFT MBH2023

Impact of substrate clogging on vertical connectivity

Giovanni De Cesare, Romain Maxime Dubuis, Robin Schroff

Connectivity between the hyporheic zone and the flow is essential for the development of benthos and the reproductive success of spawning fish. The infiltration of fine sediment leads to clogging of the riverbed, reducing porosity and vertical water exchan ...

2023

Learning curves for the multi-class teacher-student perceptron

Elisabetta Cornacchia, Francesca Mignacco, Lenka Zdeborová, Bruno Loureiro, Bruno Loureiro

One of the most classical results in high-dimensional learning theory provides a closed-form expression for the generalisation error of binary classification with a single-layer teacher-student perceptron on i.i.d. Gaussian inputs. Both Bayes-optimal (BO) ...

IOP Publishing Ltd2023

Robust Outlier Rejection for 3D Registration with Variational Bayes

Mathieu Salzmann, Zheng Dang, Zhen Wei, Jiancheng Yang, Haobo Jiang

Learning-based outlier (mismatched correspondence) rejection for robust 3D registration generally formulates the outlier removal as an inlier/outlier classification problem. The core for this to be successful is to learn the discriminative inlier/outlier f ...

Ieee Computer Soc2023

On the symmetries in the dynamics of wide two-layer neural networks

Lénaïc Chizat

We consider the idealized setting of gradient flow on the population risk for infinitely wide two-layer ReLU neural networks (without bias), and study the effect of symmetries on the learned parameters and predictors. We first describe a general class of s ...

AMER INST MATHEMATICAL SCIENCES-AIMS2023

Reanalysis of mtDNA mutations of human primordial germ cells (PGCs) reveals NUMT contamination and suggests that selection in PGCs may be positive

Konstantin Popadin

The resilience of the mitochondrial genome (mtDNA) to a high mutational pressure depends, in part, on negative purifying selection in the germline. A paradigm in the field has been that such selection, at least in part, takes place in primordial germ cells ...

Elsevier Sci Ltd2023

Euclid preparation XXII. Selection of quiescent galaxies from mock photometry using machine learning

Georges Meylan, Frédéric Courbin, Fabio Finelli, Richard Massey, Maurizio Martinelli, Gianluca Castignani, Marcello Farina, Austin Chandler Peel, Yi Wang

The Euclid Space Telescope will provide deep imaging at optical and near-infrared wavelengths, along with slitless near-infrared spectroscopy, across similar to 15 000deg(2) of the sky. Euclid is expected to detect similar to 12 billion astronomical source ...

EDP SCIENCES S A2023

The Gray-Wyner Network and Wyner's Common Information for Gaussian Sources

Michael Christoph Gastpar, Erixhen Sula

This paper presents explicit solutions for two related non-convex information extremization problems due to Gray and Wyner in the Gaussian case. The first problem is the Gray-Wyner network subject to a sum-rate constraint on the two private links. Here, ou ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2022

A Functional Perspective on Information Measures

Amedeo Roberto Esposito

Since the birth of Information Theory, researchers have defined and exploited various information measures, as well as endowed them with operational meanings. Some were born as a "solution to a problem", like Shannon's Entropy and Mutual Information. Other ...

EPFL2022

Metric learning for kernel ridge regression: assessment of molecular similarity

Anne-Clémence Corminboeuf, Friedrich Eisenbrand, Puck Elisabeth van Gerwen, Raimon Fabregat I De Aguilar-Amat

Supervised and unsupervised kernel-based algorithms widely used in the physical sciences depend upon the notion of similarity. Their reliance on pre-defined distance metrics-e.g. the Euclidean or Manhattan distance-are problematic especially when used in c ...

IOP Publishing Ltd2022