Publications associées à Monitoring of water volume in a porous reservoir using seismic data: A 3D simulation study

Publications associées (23)

Neural networks trained with SGD learn distributions of increasing complexity

The uncanny ability of over-parameterised neural networks to generalise well has been explained using various ‘simplicity biases’. These theories postulate that neural networks avoid overfitting by first fitting simple, linear classifiers before learning m ...

2025

Enhancing Lift and Dynamic Stability Through Morphological Optimization of Wings for Tailless Flapping-Wing Robots

Josephine Anna Eleanor Hughes

The design of wings is crucial for tailless Flapping-wing robots (FWRs), as these robots rely exclusively on their wings for lift generation and body control. However, the current methodology for wing design primarily depends on the experience and heuristi ...

2025

Hadamard product in deep learning: Introduction, Advances and Challenges

Volkan Cevher, Yongtao Wu

While convolution and self-attention mechanisms have dominated architectural design in deep learning, this survey examines a fundamental yet understudied primitive: the Hadamard product. Despite its widespread implementation across various applications, th ...

2025

Representing and machine learning complex electronic-structure properties of materials

Austin Jacob Zadoks

The rise of high-throughput first-principles calculations of materials since the turn of the millennium has gifted the fields of physics, quantum chemistry, and materials science with a mountainous and ever-growing pile of data ready to be mined for hidden ...

EPFL2025

The Impact of Cosmic Ray Feedback During the Epoch of Reionisation

Marion Nancy Amandine Farcy

Galaxies form and evolve via a multitude of complex physics. In this work, we investigate the role of cosmic ray (CR) feedback in galaxy evolution and reionisation, by examining its impact on the escape of ionising radiation from galaxies. For this purpose ...

EDP SCIENCES S A2025

Rigorous Dynamical Mean-Field Theory for Stochastic Gradient Descent Methods

Lenka Zdeborová, Florent Gérard Krzakala, Emanuele Troiani

We prove closed-form equations for the exact high-dimensional asymptotics of a family of first-order gradient-based methods, learning an estimator (e.g., M-estimator, shallow neural network) from observations on Gaussian data with empirical risk minimizati ...

Society for Industrial & Applied Mathematics (SIAM)2024

LiDAR-NeRF: Novel LiDAR View Synthesis via Neural Radiance Fields

Mathieu Salzmann

We introduce a new task, novel view synthesis for LiDAR sensors. While traditional model-based LiDAR simulators with style-transfer neural networks can be applied to render novel views, they fall short of producing accurate and realistic LiDAR patterns bec ...

Association for Computing Machinery, Inc2024

Higher-order knowledge-enhanced recommendation with heterogeneous hypergraph multi-attention

Thanh Trung Huynh

Recent advancements in recommender systems have focused on integrating knowledge graphs (KGs) to leverage their auxiliary information. The core idea of KG-enhanced recommenders is to incorporate rich semantic information for more accurate recommendations. ...

2024

Compressed Regression Over Adaptive Networks

Ali H. Sayed

In this work we derive the performance achievable by a network of distributed agents that solve, adaptively and in the presence of communication constraints, a regression problem. Agents employ the recently proposed ACTC (adapt-compress-then-combine) diffu ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2024

Bringing the Anthropocene Down to Size, or, How Can We Understand a Gigaton?

Sarah Nichols

This contribution takes on the incomprehensibility of human transformation of the Earth's surface, framing it as a "Constructocene" dominated by architecture and infrastructure. Based on an idea first proposed by Jan Zalasiewicz, it then looks at the Anthr ...

TAYLOR & FRANCIS INC2024

The automated collapse data constructor technique and the data-driven methodology for seismic collapse risk assessment

Dimitrios Lignos, Alexandre Massoud Alahi, Nenad Bijelic

Majority of the past research on application of machine learning (ML) in earthquake engineering focused on contrasting the predictive performance of different ML algorithms. In contrast, the emphasis of this paper is on the use of data to boost the predict ...

WILEY2023

Fast dynamic 1D simulation of divertor plasmas with neural PDE surrogates

Yoeri Renier Johannes Poels

Managing divertor plasmas is crucial for operating reactor scale tokamak devices due to heat and particle flux constraints on the divertor target. Simulation is an important tool to understand and control these plasmas, however, for real-time applications ...

IOP Publishing Ltd2023

From tensor-network quantum states to tensorial recurrent neural networks

Giuseppe Carleo, Filippo Vicentini, Riccardo Rossi, Dian Wu

We show that any matrix product state (MPS) can be exactly represented by a recurrent neural network (RNN) with a linear memory update. We generalize this RNN architecture to two-dimensional lattices using a multilinear memory update. It supports perfect s ...

AMER PHYSICAL SOC2023

AMAE: Adaptation of Pre-trained Masked Autoencoder for Dual-Distribution Anomaly Detection in Chest X-Rays

Jean-Philippe Thiran, Seyedbehzad Bozorgtabar

Unsupervised anomaly detection in medical images such as chest radiographs is stepping into the spotlight as it mitigates the scarcity of the labor-intensive and costly expert annotation of anomaly data. However, nearly all existing methods are formulated ...

Springer International Publishing Ag2023

Synthesis and Analysis of 3D shapes with Geometric Deep Learning in Computer-Aided Engineering

Edoardo Remelli

In this thesis, we advocate that Computer-Aided Engineering could benefit from a Geometric Deep Learning revolution, similarly to the way that Deep Learning revolutionized Computer Vision. To do so, we consider a variety of Computer-Aided Engineering pr ...

EPFL2022

Tensor Methods in Computer Vision and Deep Learning

Grigorios Chrysos

Tensors, or multidimensional arrays, are data structures that can naturally represent visual data of multiple dimensions. Inherently able to efficiently capture structured, latent semantic spaces and high-order interactions, tensors have a long history of ...

2021

Feature Learning for Blood Pressure Estimation from Photoplethysmography

Pascal Frossard, Clémentine Léa Aguet

Blood pressure (BP) is an important indicator for prevention and management of cardiovascular diseases. Alongside the improvement in sensors and wearables, photoplethysmography (PPG) appears to be a promising technology for continuous, non-invasive and cuf ...

IEEE2021

Teaching optics to a machine learning network

André-Pierre Blanchard-Dionne, Olivier Martin

In this Letter, we demonstrate how harmonic oscillator equations can be integrated in a neural network to improve the spectral response prediction for an optical system. We use the optical properties of a one-dimensional nanoslit array for a practical impl ...

2020

ExpandNets: Linear Over-parameterization to Train Compact Convolutional Networks

Mathieu Salzmann, Shuxuan Guo

We introduce an approach to training a given compact network. To this end, we leverage over-parameterization, which typically improves both neural network optimization and generalization. Specifically, we propose to expand each linear layer of the compact ...

Curran Associates Inc.2020

Transformers are RNNs: Fast Autoregressive Transformers with Linear Attention

François Fleuret, Angelos Katharopoulos

Transformers achieve remarkable performance in several tasks but due to their quadratic complexity, with respect to the input's length, they are prohibitively slow for very long sequences. To address this limitation, we express the self-attention as a line ...

JMLR-JOURNAL MACHINE LEARNING RESEARCH2020