Publications associées à Multilingual Vision-Language Pre-training for the Remote Sensing Domain

Publications associées (22)

Systolic Arrays and Structured Pruning Co-design for Efficient Transformers in Edge Systems

David Atienza Alonso, Giovanni Ansaloni, Rafael Medina Morillas, Pedro Palacios Almendros

Efficient deployment of resource-intensive transformers on edge devices necessitates cross-stack optimization. We thus study the interrelation between structured pruning and systolic acceleration, matching the size of pruned blocks with the systolic array ...

Association for Computing Machinery2025

MUSt3R: Multi-view Network for Stereo 3D Reconstruction

Lucas Maximilian Stoffl

DUSt3R introduced a novel paradigm in geometric computer vision by proposing a model that can provide dense and unconstrained Stereo 3D Reconstruction of arbitrary image collections with no prior information about camera calibration nor viewpoint poses. Un ...

IEEE2025

Programming Nonlinear Computation with Nonlinear and Linear Optics

Jih-Liang Hsieh

The escalating demands of artificial intelligence have underscored the limitations of traditional electronic computing, particularly in terms of power consumption and scalability. Optical computing offers a promising alternative, providing advantages in sp ...

EPFL2025

Rethinking Personalized Client Collaboration in Federated Learning

Anne-Marie Kermarrec

Federated Learning (FL) has gained considerable attention recently, as it allows clients to cooperatively train a global machine learning model without sharing raw data. However, its performance can be compromised due to the high heterogeneity in clients' ...

2024

SPAHM(a,b): Encoding the Density Information from Guess Hamiltonian in Quantum Machine Learning Representations

Anne-Clémence Corminboeuf, Alberto Fabrizio, Ksenia Briling, Yannick Calvino Alonso

Recently, we introduced a class of molecular representations for kernel-based regression methods─the spectrum of approximated Hamiltonian matrices (SPAHM)─that takes advantage of lightweight one-electron Hamiltonians traditionally used as a self-consistent ...

2024

Interpret3C: Interpretable Student Clustering Through Individualized Feature Selection

Julian Thomas Blackwell, Tanja Christina Käser Jacober, Paola Mejia Domenzain, Vinitra Swamy

Clustering in education, particularly in large-scale online environments like MOOCs, is essential for understanding and adapting to diverse student needs. However, the effectiveness of clustering depends on its interpretability, which becomes challenging w ...

2024

IS-Fusion: Instance-Scene Collaborative Fusion for Multimodal 3D Object Detection

Pascal Frossard

Bird's eye view (BEV) representation has emerged as a dominant solution for describing 3D space in autonomous driving scenarios. However, objects in the BEV representation typically exhibit small sizes, and the associated point cloud context is inherently ...

IEEE Computer Society2024

CloudProphet: A Machine Learning-Based Performance Prediction for Public Clouds

David Atienza Alonso, Marina Zapater Sancho, Ali Pahlevan, Darong Huang, Luis Maria Costero Valero

Computing servers have played a key role in developing and processing emerging compute-intensive applications in recent years. Consolidating multiple virtual machines (VMs) inside one server to run various applications introduces severe competence for limi ...

2024

Exploring neural oscillations during speech perception via surrogate gradient spiking neural networks

Philip Neil Garner

Understanding cognitive processes in the brain demands sophisticated models capable of replicating neural dynamics at large scales. We present a physiologically inspired speech recognition architecture, compatible and scalable with deep learning frameworks ...

2024

Toward universal cell embeddings: integrating single-cell RNA-seq datasets across species with SATURN

Maria Brbic

Analysis of single-cell datasets generated from diverse organisms offers unprecedented opportunities to unravel fundamental evolutionary processes of conservation and diversification of cell types. However, interspecies genomic differences limit the joint ...

Nature Publishing Group2024

Butterfly effects in perceptual development: A review of the 'adaptive initial degradation' hypothesis

Lukas Vogelsang

Human perceptual development evolves in a stereotyped fashion, with initially limited perceptual capabilities maturing over the months or years following the commencement of sensory experience into robust proficiencies. This review focuses on the functiona ...

Academic Press Inc Elsevier Science2024

Task-driven neural network models predict neural dynamics of proprioception: Neural network model weights

Alexander Mathis, Alberto Silvio Chiappa, Alessandro Marin Vargas, Axel Bisi

Proprioception tells the brain the state of the body based on distributed sensors in the body. However, the principles that govern proprioceptive processing from those distributed sensors are poorly understood. Here, we employ a task-driven neural network ...

Zenodo2024

A Functional Extension of Semi-Structured Networks

Jan Almond Stöcker

Semi-structured networks (SSNs) merge the structures familiar from additive models with deep neural networks, allowing the modeling of interpretable partial feature effects while capturing higher-order non-linearities at the same time. A significant challe ...

Curran Associates, Inc.2024

GECCO: Geometrically-Conditioned Point Diffusion Models

Pascal Fua, Eduard Trulls Fortuny, Michal Jan Tyszkiewicz

Diffusion models generating images conditionally on text, such as Dall-E 2 [51] and Stable Diffusion[53], have recently made a splash far beyond the computer vision community. Here, we tackle the related problem of generating point clouds, both uncondition ...

Ieee Computer Soc2023

Phase Retrieval: From Computational Imaging to Machine Learning: A tutorial

Michaël Unser, Thanh-An Michel Pham, Jonathan Yuelin Dong

Phase retrieval consists in the recovery of a complex-valued signal from intensity-only measurements. As it pervades a broad variety of applications, many researchers have striven to develop phase-retrieval algorithms. Classical approaches involve techniqu ...

2023

Dense Multitask Learning to Reconfigure Comics

Sabine Süsstrunk, Mathieu Salzmann, Deblina Bhattacharjee

In this paper, we develop a MultiTask Learning (MTL) model to achieve dense predictions for comic panels to, in turn, facilitate the transfer of comics from one publication channel to another by assisting authors in the task of reconfiguring their narrativ ...

IEEE2023

AIFORE: Smart Fuzzing Based on Automatic Input Format Reverse Engineering

Mathias Josef Payer, Chunmin Zhang, Zhiyao Feng

Knowledge of a program's input format is essential for effective input generation in fuzzing. Automated input format reverse engineering represents an attractive but challenging approach to learning the format. In this paper, we address several challenges ...

Usenix Assoc2023

Modeling lens potentials with continuous neural fields in galaxy-scale strong lenses

Frédéric Courbin, Georgios Vernardos

Strong gravitational lensing is a unique observational tool for studying the dark and luminous mass distribution both within and between galaxies. Given the presence of substructures, current strong lensing observations demand more complex mass models than ...

EDP SCIENCES S A2023

Quantization for Distributed Processing and Learning of Structured Data

Isabela Cunha Maia Nobre

In the domains of machine learning, data science and signal processing, graph or network data, is becoming increasingly popular. It represents a large portion of the data in computer, transportation systems, energy networks, social, biological, and other s ...

EPFL2022

Faster One-Sample Stochastic Conditional Gradient Method for Composite Convex Minimization

Volkan Cevher, Alp Yurtsever, Maria-Luiza Vladarean

We propose a stochastic conditional gradient method (CGM) for minimizing convex finitesum objectives formed as a sum of smooth and non-smooth terms. Existing CGM variants for this template either suffer from slow convergence rates, or require carefully inc ...

2022