Publications associées à GFN: A graph feedforward network for resolution-invariant reduced operator learning in multifidelity applications

Publications associées (29)

Learning to Reason with Neural Networks: Principles and Methods

This thesis focuses on understanding and improving the reasoning capabilities of neural networks. It develops theoretical results and empirical analyses to uncover reasoning potential and limitations, leveraging these insights to guide the design of improv ...

EPFL2025

Exploiting Representation Similarities in Self-Supervised Learning for Vision Tasks

Thomas Grégoire Stegmüller

Recent progress in computer vision has been driven by a simple yet transformative observation: the potential of 30-year-old neural networks can be unlocked by massively scaling their parameters and the amount of human-labeled training data. This breakthrou ...

EPFL2025

High-performance deep spiking neural networks with 0.3 spikes per neuron

Wulfram Gerstner, Stanislaw Andrzej Wozniak, Guillaume Emmanuel Fernand Bellec, Ana Stanojevic, Angeliki Pantazi

Communication by rare, binary spikes is a key factor for the energy efficiency of biological brains. However, it is harder to train biologically-inspired spiking neural networks than artificial neural networks. This is puzzling given that theoretical resul ...

Springer Science and Business Media LLC2024

Optimal distributed control with stability guarantees by training a network of neural closed-loop maps

Giancarlo Ferrari Trecate, Luca Furieri, Danilo Saccani, Leonardo Massai

This paper proposes a novel approach to improve the performance of distributed nonlinear control systems while preserving stability by leveraging Deep Neural Networks (DNNs). We build upon the Neural System Level Synthesis (Neur-SLS) framework and introduc ...

Institute of Electrical and Electronics Engineers Inc.2024

Learning-based Hierarchical Control: Emulating the Central Nervous System for Bio-Inspired Legged Robot Locomotion

Auke Ijspeert, Guillaume Denis Antoine Bellegarda, Milad Shafiee Ashtiani

Animals possess a remarkable ability to navigate challenging terrains, achieved through the interplay of various pathways between the brain, central pattern generators (CPGs) in the spinal cord, and musculoskeletal system. Traditional bioinspired control f ...

Institute of Electrical and Electronics Engineers Inc.2024

A Theory of Finite-Width Neural Networks: Generalization, Scaling Laws, and the Loss Landscape

Berfin Simsek

Deep learning has achieved remarkable success in various challenging tasks such as generating images from natural language or engaging in lengthy conversations with humans. The success in practice stems from the ability to successfully train massive neural ...

EPFL2023

Multi-layer state evolution under random convolutional design

Lenka Zdeborová, Florent Gérard Krzakala

Signal recovery under generative neural network priors has emerged as a promising direction in statistical inference and computational imaging. Theoretical analysis of reconstruction algorithms under generative priors is, however, challenging. For generati ...

2023

Topologically Better Delineation of Curvilinear Structures

Doruk Oner

Curvilinear structures are frequently observed in a variety of domains and are essential for comprehending neural circuits, detecting fractures in materials, and determining road and irrigation canal networks. It can be costly and time-consuming to manuall ...

EPFL2023

Recurrent Neural Networks Are Universal Approximators With Stochastic Inputs

Wenjie Xu

In this article, we investigate the approximation ability of recurrent neural networks (RNNs) with stochastic inputs in state space model form. More explicitly, we prove that open dynamical systems with stochastic inputs can be well-approximated by a speci ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2022

Universal Solution Manifold Networks (USM-Nets): Non-Intrusive Mesh-Free Surrogate Models for Problems in Variable Domains

Alfio Quarteroni

We introduce universal solution manifold network (USM-Net), a novel surrogate model, based on artificial neural networks (ANNs), which applies to differential problems whose solution depends on physical and geometrical parameters. We employ a mesh-less arc ...

ASME2022

Towards Verifiable, Generalizable and Efficient Robust Deep Neural Networks

Chen Liu

In the last decade, deep neural networks have achieved tremendous success in many fields of machine learning. However, they are shown vulnerable against adversarial attacks: well-designed, yet imperceptible, perturbations can make the state-of-the-art deep ...

EPFL2022

On Breathing Pattern Information in Synthetic Speech

Mathew Magimai Doss, Zohreh Mostaani

The respiratory system is an integral part of human speech production. As a consequence, there is a close relation between respiration and speech signal, and the produced speech signal carries breathing pattern related information. Speech can also be gener ...

ISCA-INT SPEECH COMMUNICATION ASSOC2022

Geometry-Aware Deep Recurrent Neural Networks for Hyperspectral Image Classification

Mathieu Salzmann, Wei Wang

Variants of deep networks have been widely used for hyperspectral image (HSI)-classification tasks. Among them, in recent years, recurrent neural networks (RNNs) have attracted considerable attention in the remote sensing community. However, complex geomet ...

2021

3D Structure From 2D Microscopy Images Using Deep Learning

Suliana Manley, Christian Sieben

Understanding the structure of a protein complex is crucial in determining its function. However, retrieving accurate 3D structures from microscopy images is highly challenging, particularly as many imaging modalities are two-dimensional. Recent advances i ...

Frontiers Media Sa2021

Reservoir Computing meets Recurrent Kernels and Structured Transforms

Florent Gérard Krzakala, Jonathan Yuelin Dong

Reservoir Computing is a class of simple yet efficient Recurrent Neural Networks where internal weights are fixed at random and only a linear output layer is trained. In the large size limit, such random neural networks have a deep connection with kernel m ...

Curran Associates, Inc.2020

Multilingual Training and Adaptation in Speech Recognition

Sibo Tong

State-of-the-art acoustic models for Automatic Speech Recognition (ASR) are based on Hidden Markov Models (HMM) and Deep Neural Networks (DNN) and often require thousands of hours of transcribed speech data during training. Therefore, building multilingual ...

EPFL2020

Detection of Bad PMU Data using Machine Learning Techniques

Sidi-Rachid Cherkaoui, Alexandra Cameron Karpilow

This project presents a pre-State Estimation method for the detection of Bad Data (BD) in Phasor Measurement Units (PMUs) using correlation analysis and a Neural Network Classifier. Presented in this paper is the algorithm design, the steps for generating ...

IEEE2020

MonoLoco: Monocular 3D Pedestrian Localization and Uncertainty Estimation

Alexandre Massoud Alahi, Sven Kreiss, Lorenzo Bertoni

We tackle the fundamentally ill-posed problem of 3D human localization from monocular RGB images. Driven by the limitation of neural networks outputting point estimates, we address the ambiguity in the task by predicting confidence intervals through a loss ...

2019

Machine learning methods to assist energy system optimization

Jean-Louis Scartezzini, Amarasinghage Tharindu Dasun Perera, Vahid Moussavi Nik

This study evaluates the potential of supervised and transfer learning techniques to assist energy system optimization. A surrogate model is developed with the support of a supervised learning technique (by using artificial neural network) in order to bypa ...

2019

Recurrent U-Net for Resource-Constrained Segmentation

Pascal Fua, Mathieu Salzmann, Wei Wang, Kaicheng Yu, Joachim Ludovic Hugonot

State-of-the-art segmentation methods rely on very deep networks that are not always easy to train without very large training datasets and tend to be relatively slow to run on standard GPUs. In this paper, we introduce a novel recurrent U-Net architecture ...

IEEE COMPUTER SOC2019