Publications related to High-dimensional learning of narrow neural networks

Related publications (23)

OPTIMAL TRANSPORT-INSPIRED DEEP LEARNING FRAMEWORK FOR SLOW-DECAYING KOLMOGOROV \bfitn-WIDTH PROBLEMS: EXPLOITING SINKHORN LOSS AND WASSERSTEIN KERNEL

Reduced-order models (ROMs) are widely used in scientific computing to tackle high-dimensional systems. However, traditional ROM methods may only partially capture the intrinsic geometric characteristics of the data. These characteristics encompass the und ...

2025

Exploiting XAI Maps to Improve MS Lesion Segmentation and Detection in MRI

Meritxell Bach Cuadra

To date, several methods have been developed to explain deep learning algorithms for classification tasks. Recently, an adaptation of two of such methods has been proposed to generate instance-level explainable maps in a semantic segmentation scenario, suc ...

Springer2025

Gradient Approximation of Approximate Multipliers for High-Accuracy Deep Neural Network Retraining

Giovanni De Micheli, Chang Meng

Approximate multipliers (AppMults) are widely employed in deep neural network (DNN) accelerators to reduce the area, delay, and power consumption. However, the inaccuracies of AppMults degrade DNN accuracy, necessitating a retraining process to recover acc ...

Institute of Electrical and Electronics Engineers2025

Predicting electronic screening for fast Koopmans spectral functional calculations

Nicola Marzari

Koopmans spectral functionals are a powerful extension of Kohn-Sham density-functional theory (DFT) that enables the prediction of spectral properties with state-of-the-art accuracy. The success of these functionals relies on capturing the effects of elect ...

2024

Wigner kernels: Body-ordered equivariant machine learning without a basis

Michele Ceriotti, Sergey Pozdnyakov, Filippo Bigi

Machine-learning models based on a point-cloud representation of a physical object are ubiquitous in scientific applications and particularly well-suited to the atomic-scale description of molecules and materials. Among the many different approaches that h ...

AIP Publishing2024

ConGeo: Robust Cross-View Geo-Localization Across Ground View Variations

Devis Tuia, Antoine Bosselut, Javiera Francisca Castillo Navarro, Syrielle Mathilde Marie Montariol, Li Mi

Cross-view geo-localization aims at localizing a ground-level query image by matching it to its corresponding geo-referenced aerial view. In real-world scenarios, the task requires accommodating diverse ground images captured by users with varying orientat ...

Springer Cham2024

Optimizing Dynamic Aperture Studies with Active Learning

Tatiana Pieloni, Mike Seidel, Davide Di Croce, Ekaterina Krymova

Dynamic aperture is an important concept for the study of non-linear beam dynamics in circular accelerators. It describes the extent of the phase-space region where a particle's motion remains bounded over a given number of turns. Understanding the feature ...

Iop Publishing Ltd2024

Improving Lipschitz-Constrained Neural Networks by Learning Activation Functions

Michaël Unser, Dimitris Perdios, Alexis Marie Frederic Goujon, Pakshal Narendra Bohra, Sebastian Jonas Neumayer, Stanislas Ducotterd

Lipschitz-constrained neural networks have several advantages over unconstrained ones and can be applied to a variety of problems, making them a topic of attention in the deep learning community. Unfortunately, it has been shown both theoretically and empi ...

2024

TATTOOED: A Robust Deep Neural Network Watermarking Scheme based on Spread-Spectrum Channel Coding

Fernando Perez Cruz

Deep Neural Networks (DNNs) trained on proprietary company data offer a competitive edge for the owning entity. However, these models can be attractive to competitors (or malicious entities), who can copy or clone these proprietary DNN models to use them t ...

Association for Computing Machinery2024

VETIM: Expanding the Vocabulary of Text-to-Image Models only with Text

Sabine Süsstrunk, Radhakrishna Achanta, Mahmut Sami Arpa, Martin Nicolas Everaert

Text-to-image models, such as Stable Diffusion, can generate high-quality images from simple textual prompts. With methods such as Textual Inversion, it is possible to expand the vocabulary of these models with additional concepts, by learning the vocabula ...

BMVA2023

Reinforcement bond performance in 3D concrete printing: Explainable ensemble learning augmented by deep generative adversarial networks

Xianlin Wang

Integrating various reinforcements into 3D concrete printing (3DCP) is an efficient method to satisfy critical requirements for structural applications. This paper explores an explainable ensemble machine learning (EML) method to predict the bond failure m ...

Elsevier2023

Body Part-Based Representation Learning for Occluded Person Re-Identification

Alexandre Massoud Alahi

Occluded person re-identification (ReID) is a person retrieval task which aims at matching occluded person images with holistic ones. For addressing occluded ReID, part-based methods have been shown beneficial as they offer fine-grained information and are ...

IEEE Computer Soc2023

Classification of Tropical Deforestation Drivers with Machine Learning and Satellite Image Time Series

Devis Tuia, Marc Conrad Russwurm, Lloyd Haydn Hughes, Jan Pisl

Tropical deforestation is a major environmental problem with severe consequences such as carbon emissions or biodiversity loss. While much research focuses on monitoring and mapping deforestation, less attention is paid to understanding the various reasons ...

Institute of Electrical and Electronics Engineers2023

Inferring how animals deform improves cell tracking

Sahand Jamal Rahi

Tracking cells is a time-consuming part of biological image analysis, and traditional manual annotation methods are prohibitively laborious for tracking neurons in the deforming and moving Caenorhabditis elegans brain. By leveraging machine learning to dev ...

Nature Publishing Group2023

Metasurface-Enhanced Infrared Spectroscopy: An Abundance of Materials and Functionalities

Hatice Altug, Andreas Tittl, Aurélian Michel John-Herpin, Felix Ulrich Brikh

Infrared spectroscopy provides unique information on the composition and dynamics of biochemical systems by resolving the characteristic absorption fingerprints of their constituent molecules. Based on this inherent chemical specificity and the capability ...

Wiley-V C H Verlag Gmbh2023

Decentralized Federated Learning for Epileptic Seizures Detection in Low-Power Wearable Systems

David Atienza Alonso, Amir Aminifar, Tomas Teijeiro Campo, Saleh Baghersalimi

In healthcare, data privacy of patients regulations prohibits data from being moved outside the hospital, preventing international medical datasets from being centralized for AI training. Federated learning (FL) is a data privacy-focused method that trains ...

2023

Comparing transferability in neural network approaches and linear models for machine-learning interaction potentials

Kevin Rossi

Atomic simulations using machine learning interatomic potential (MLIP) have gained a lot of popularity owing to their accuracy in comparison to conventional empirical potentials. However, the transferability of MLIP to systems outside the training set pose ...

AMER PHYSICAL SOC2023

A generic diffusion-based approach for 3D human pose prediction in the wild

Alexandre Massoud Alahi, Saeed Saadatnejad, Taylor Ferdinand Mordan

Predicting 3D human poses in real-world scenarios, also known as human pose forecasting, is inevitably subject to noisy inputs arising from inaccurate 3D pose estimations and occlusions. To address these challenges, we propose a diffusion-based approach th ...

IEEE2023

Gradient free cooperative seeking of a moving source

Tony Alan Wood

In this paper, we consider the optimisation of a time varying scalar field by a network of agents with no gradient information. We propose a composite control law, blending extremum seeking with formation control in order to converge to the extrema faster ...

2023

Learning Disentangled Behaviour Patterns for Wearable-based Human Activity Recognition

Tao Lin

In wearable-based human activity recognition (HAR) research, one of the major challenges is the large intra-class variability problem. The collected activity signal is often, if not always, coupled with noises or bias caused by personal, environmental, or ...

ASSOC COMPUTING MACHINERY2022