High-dimensional Asymptotics of Denoising Autoencoders

Chat with Graph Search

Ask any question about EPFL courses, lectures, exercises, research, news, etc. or try the example questions below.

DISCLAIMER: The Graph Chatbot is not programmed to provide explicit or categorical answers to your questions. Rather, it transforms your questions into API requests that are distributed across the various IT services officially administered by EPFL. Its purpose is solely to collect and recommend relevant references to content that you can explore to help you answer your questions.

Self-supervised learning (SSL) has the potential to ben- efit many applications, particularly those where manually annotating data is cumbersome. One such situation is the semantic segmentation of point clouds. In this context, ex- isting methods employ co ...

Type C hepatic encephalopathy (HE) is a severe neuropsychiatric complication of chronic liver disease, for which the prognosis is poor in the absence of liver transplantation. Cirrhosis in type C HE leads to a toxic accumulation of ammonia in the blood, wh ...

Diffusion-weighted (DW) magnetic resonance spectroscopy (MRS) suffers from a lower signal to noise ratio (SNR) compared to conventional MRS owing to the addition of diffusion attenuation. This technique can therefore strongly benefit from noise reduction s ...

How does the geometric representation of a dataset change after the application of each randomly initialized layer of a neural network? The celebrated Johnson-Lindenstrauss lemma answers this question for linear fully-connected neural networks (FNNs), stat ...

Factorization of matrices where the rank of the two factors diverges linearly with their sizes has many applications in diverse areas such as unsupervised representation learning, dictionary learning or sparse coding. We consider a setting where the two fa ...

It was recently shown that almost all solutions in the symmetric binary perceptron are isolated, even at low constraint densities, suggesting that finding typical solutions is hard. In contrast, some algorithms have been shown empirically to succeed in fin ...

Air traffic management and specifically air-traffic control (ATC) rely mostly on voice communications between Air Traffic Controllers (ATCos) and pilots. In most cases, these voice communications follow a well-defined grammar that could be leveraged in Aut ...

Training deep neural networks (DNNs) can be difficult due to the occurrence of vanishing/explod- ing gradients during weight optimization. To avoid this problem, we propose a class of DNNs stemming from the time discretization of Hamiltonian systems. The t ...

Testing for equality of two high-dimensional distributions is a challenging problem, and this becomes even more challenging when the sample size is small. Over the last few decades, several graph-based two-sample tests have been proposed in the literature, ...

Detection of curvilinear structures in images has long been of interest. One of the most challenging aspects of this problem is inferring the graph representation of the curvilinear network. Most existing delineation approaches first perform binary segment ...

First-quantized deep neural network techniques are developed for analyzing strongly coupled fermionic systems on the lattice. Using a Slater-Jastrow-inspired ansatz which exploits deep residual networks with convolutional residual blocks, we approximately ...

We examine a class of stochastic deep learning models with a tractable method to compute information-theoretic quantities. Our contributions are three-fold: (i) we show how entropies and mutual informations can be derived from heuristic statistical physics ...

Standard automatic speech recognition (ASR) systems follow a divide and conquer approach to convert speech into text. Alternately, the end goal is achieved by a combination of sub-tasks, namely, feature extraction, acoustic modeling and sequence decoding, ...

In this work, we first revise some extensions of the standard Hopfield model in the low storage limit, namely the correlated attractor case and the multitasking case recently introduced by the authors. The former case is based on a modification of the Hebb ...

High-dimensional Asymptotics of Denoising Autoencoders

Chat with Graph Search

Spatiotemporal Self-supervised Learning for Point Clouds in the Wild

New insights into rodent brain microstructure and metabolism in hepatic encephalopathy

MP-PCA denoising for diffusion MRS data: promises and pitfalls

A Johnson-Lindenstrauss Framework for Randomly Initialized CNNs

Perturbative construction of mean-field equations in extensive-rank matrix factorization and denoising

Binary Perceptron: Efficient Algorithms Can Find Solutions in a RareWell-Connected Cluster

Contextual Semi-Supervised Learning: An Approach To Leverage Air-Surveillance and Untranscribed ATC Data in ASR Systems

A unified framework for Hamiltonian deep neural networks

On some graph-based two-sample tests for high dimension, low sample size data

Joint Segmentation and Path Classification of Curvilinear Structures

Phases of two-dimensional spinless lattice fermions with first-quantized deep neural-network quantum states

Entropy and mutual information in models of deep neural networks

Towards End-to-End Speech Recognition

Parallel retrieval of correlated patterns: From Hopfield networks to Boltzmann machines