Chaining Meets Chain Rule: Multilevel Entropic Regularization and Training of Neural Networks

Chat with Graph Search

Ask any question about EPFL courses, lectures, exercises, research, news, etc. or try the example questions below.

DISCLAIMER: The Graph Chatbot is not programmed to provide explicit or categorical answers to your questions. Rather, it transforms your questions into API requests that are distributed across the various IT services officially administered by EPFL. Its purpose is solely to collect and recommend relevant references to content that you can explore to help you answer your questions.

We present a finite elements-neural network approach for the numerical approximation of parametric partial differential equations. The algorithm generates training data from finite element simulations, and uses a data -driven (supervised) feedforward neura ...

Neurons in the human amygdala and hippocampus are classically thought to encode a person’s identity invariant to visual features. However, it remains largely unknown how visual information from higher visual cortical areas is translated into such a semanti ...

Proprioception tells the brain the state of the body based on distributed sensors in the body. However, the principles that govern proprioceptive processing from those distributed sensors are poorly understood. Here, we employ a task-driven neural network ...

Differences in acquisition protocols or hardware result in measurable changes in image characteristics. These differences affect distributional properties and can also affect the spatial and temporal characteristics of the images. Likewise, the distributio ...

Real-time bioaerosol monitoring is improving the quality of life for people affected by allergies, but it often relies on deep learning models which pose challenges for widespread adoption. These models are typically trained in a supervised fashion and req ...

Modern neuroscience research is generating increasingly large datasets, from recording thousands of neurons over long timescales to behavioral recordings of animals spanning weeks, months, or even years. Despite a great variety in recording setups and expe ...

Sign Language conveys information through multiple channels composed of manual (handshape, hand movement) and non-manual (facial expression, mouthing, body posture) components. Sign language assessment involves giving granular feedback to a learner, in ter ...

Dynamic aperture is an important concept for the study of non-linear beam dynamics in circular accelerators. It describes the extent of the phase-space region where a particle's motion remains bounded over a given number of turns. Understanding the feature ...

The present work proposes a framework for nonlinear model order reduction based on a Graph Convolutional Autoencoder (GCA-ROM). In the reduced order modeling (ROM) context, one is interested in obtaining real -time and many-query evaluations of parametric ...

Thermal scene reconstruction holds great potential for various applications, such as building energy analysis and non-destructive infrastructure testing. However, existing methods rely on dense scene measurements and use RGB images for 3D reconstruction, i ...

Efficient sampling and approximation of Boltzmann distributions involving large sets of binary variables, or spins, are pivotal in diverse scientific fields even beyond physics. Recent advances in generative neural networks have significantly impacted this ...

Facial paralysis is a highly burdening condition, resulting in a patient's inability to move his musculature on one or both sides of the mouth. The restoration of facial movement is crucial for enhancing the overall patients' quality of life. The use of DE ...

Recently, cutting-edge brain-machine interfaces (BMIs) have revealed the potential of decoders such as recurrent neural networks (RNNs) in predicting attempted handwriting [1] or speech [2], enabling rapid communication recovery after paralysis. However, c ...

High-dimensional data must be highly structured to be learnable. Although the compositional and hierarchical nature of data is often put forward to explain learnability, quantitative measurements establishing these properties are scarce. Likewise, accessin ...

Fluorescence lifetime imaging (FLI) has been receiving increased attention in recent years as a powerful diagnostic technique in biological and medical research. However, existing FLI systems often suffer from a tradeoff between processing speed, accuracy, ...

Multi-frequency and Doppler spectral radars are valuable tools for retrieving information on the microphysics of precipitation, particularly snowfall. However, estimating microphysical properties from radar measurements is an ill-posed problem, i.e., diffe ...

Turning pass-through network architectures into iterative ones, which use their own output as input, is a well-known approach for boosting performance. In this paper, we argue that such architectures offer an additional benefit: The convergence rate of the ...

FDTD/FEM simulations, strengthened by machine learning, achieve 95.44% optical absorption efficiency in TiO 2 /TiN plasmonic nanocavities for solar energy harvesting. ...

Photometric stereo, a computer vision technique for estimating the 3D shape of objects through images captured under varying illumination conditions, has been a topic of research for nearly four decades. In its general formulation, photometric stereo is an ...

“You never forget how to ride a bike”, – but how is that possible? The brain is able to learn complex skills, stop the practice for years, learn other skills in between, and still retrieve the original knowledge when necessary. The mechanisms of this capab ...

Chaining Meets Chain Rule: Multilevel Entropic Regularization and Training of Neural Networks

Chat with Graph Search

Error assessment of an adaptive finite elements-neural networks method for an elliptic parametric PDE

Feature-based encoding of face identity by single neurons in the human amygdala and hippocampus

Task-driven neural network models predict neural dynamics of proprioception: Neural network model weights

Domain shift, domain adaptation, and generalization: A focus on MRI

Self-supervised and few-shot learning for robust bioaerosol monitoring

Robust machine learning for neuroscientific inference

Posterior-Based Analysis of Spatio-Temporal Features for Sign Language Assessment

Optimizing Dynamic Aperture Studies with Active Learning

A graph convolutional autoencoder approach to model order reduction for parametrized PDEs

ThermoNeRF: A multimodal Neural Radiance Field for joint RGB-thermal novel view synthesis of building facades

Sparse autoregressive neural networks for classical spin systems

DEMO: Dielectric elastomer actuators (DEAs) for the restoration of facial movements

33.3 MiBMI: A 192/512-Channel 2.46mm² Miniaturized Brain-Machine Interface Chipset Enabling 31-Class Brain-to-Text Conversion Through Distinctive Neural Codes

Probing the latent hierarchical structure of data via diffusion models

Coupling a recurrent neural network to SPAD TCSPC systems for real-time fluorescence lifetime imaging

What can radars tell us about snowfall microphysics? Insights from a Markov chain Monte-Carlo approach

Enabling Uncertainty Estimation in Iterative Neural Networks

Machine-learning-empowered FDTD/FEM simulations for predictive solar energy absorption in plasmonic metamaterial nanocavity arrays

Aggregating Spatial and Photometric Context for Photometric Stereo

Context selectivity with dynamic availability enables lifelong continual learning