Multilingual Vision-Language Pre-training for the Remote Sensing Domain

Chat with Graph Search

Ask any question about EPFL courses, lectures, exercises, research, news, etc. or try the example questions below.

DISCLAIMER: The Graph Chatbot is not programmed to provide explicit or categorical answers to your questions. Rather, it transforms your questions into API requests that are distributed across the various IT services officially administered by EPFL. Its purpose is solely to collect and recommend relevant references to content that you can explore to help you answer your questions.

Efficient deployment of resource-intensive transformers on edge devices necessitates cross-stack optimization. We thus study the interrelation between structured pruning and systolic acceleration, matching the size of pruned blocks with the systolic array ...

DUSt3R introduced a novel paradigm in geometric computer vision by proposing a model that can provide dense and unconstrained Stereo 3D Reconstruction of arbitrary image collections with no prior information about camera calibration nor viewpoint poses. Un ...

The escalating demands of artificial intelligence have underscored the limitations of traditional electronic computing, particularly in terms of power consumption and scalability. Optical computing offers a promising alternative, providing advantages in sp ...

Federated Learning (FL) has gained considerable attention recently, as it allows clients to cooperatively train a global machine learning model without sharing raw data. However, its performance can be compromised due to the high heterogeneity in clients' ...

Recently, we introduced a class of molecular representations for kernel-based regression methods─the spectrum of approximated Hamiltonian matrices (SPAHM)─that takes advantage of lightweight one-electron Hamiltonians traditionally used as a self-consistent ...

Clustering in education, particularly in large-scale online environments like MOOCs, is essential for understanding and adapting to diverse student needs. However, the effectiveness of clustering depends on its interpretability, which becomes challenging w ...

Bird's eye view (BEV) representation has emerged as a dominant solution for describing 3D space in autonomous driving scenarios. However, objects in the BEV representation typically exhibit small sizes, and the associated point cloud context is inherently ...

Computing servers have played a key role in developing and processing emerging compute-intensive applications in recent years. Consolidating multiple virtual machines (VMs) inside one server to run various applications introduces severe competence for limi ...

Understanding cognitive processes in the brain demands sophisticated models capable of replicating neural dynamics at large scales. We present a physiologically inspired speech recognition architecture, compatible and scalable with deep learning frameworks ...

Analysis of single-cell datasets generated from diverse organisms offers unprecedented opportunities to unravel fundamental evolutionary processes of conservation and diversification of cell types. However, interspecies genomic differences limit the joint ...

Proprioception tells the brain the state of the body based on distributed sensors in the body. However, the principles that govern proprioceptive processing from those distributed sensors are poorly understood. Here, we employ a task-driven neural network ...

Semi-structured networks (SSNs) merge the structures familiar from additive models with deep neural networks, allowing the modeling of interpretable partial feature effects while capturing higher-order non-linearities at the same time. A significant challe ...

Diffusion models generating images conditionally on text, such as Dall-E 2 [51] and Stable Diffusion[53], have recently made a splash far beyond the computer vision community. Here, we tackle the related problem of generating point clouds, both uncondition ...

Phase retrieval consists in the recovery of a complex-valued signal from intensity-only measurements. As it pervades a broad variety of applications, many researchers have striven to develop phase-retrieval algorithms. Classical approaches involve techniqu ...

In this paper, we develop a MultiTask Learning (MTL) model to achieve dense predictions for comic panels to, in turn, facilitate the transfer of comics from one publication channel to another by assisting authors in the task of reconfiguring their narrativ ...

Knowledge of a program's input format is essential for effective input generation in fuzzing. Automated input format reverse engineering represents an attractive but challenging approach to learning the format. In this paper, we address several challenges ...

Strong gravitational lensing is a unique observational tool for studying the dark and luminous mass distribution both within and between galaxies. Given the presence of substructures, current strong lensing observations demand more complex mass models than ...

In the domains of machine learning, data science and signal processing, graph or network data, is becoming increasingly popular. It represents a large portion of the data in computer, transportation systems, energy networks, social, biological, and other s ...

We propose a stochastic conditional gradient method (CGM) for minimizing convex finitesum objectives formed as a sum of smooth and non-smooth terms. Existing CGM variants for this template either suffer from slow convergence rates, or require carefully inc ...

Unstructured neural network pruning algorithms have achieved impressive compression ratios. However, the resulting-typically irregular-sparse matrices hamper efficient hardware implementations, leading to additional memory usage and complex control logic t ...

Multilingual Vision-Language Pre-training for the Remote Sensing Domain

Chat with Graph Search

Systolic Arrays and Structured Pruning Co-design for Efficient Transformers in Edge Systems

MUSt3R: Multi-view Network for Stereo 3D Reconstruction

Programming Nonlinear Computation with Nonlinear and Linear Optics

Rethinking Personalized Client Collaboration in Federated Learning

SPAHM(a,b): Encoding the Density Information from Guess Hamiltonian in Quantum Machine Learning Representations

Interpret3C: Interpretable Student Clustering Through Individualized Feature Selection

IS-Fusion: Instance-Scene Collaborative Fusion for Multimodal 3D Object Detection

CloudProphet: A Machine Learning-Based Performance Prediction for Public Clouds

Exploring neural oscillations during speech perception via surrogate gradient spiking neural networks

Toward universal cell embeddings: integrating single-cell RNA-seq datasets across species with SATURN

Task-driven neural network models predict neural dynamics of proprioception: Neural network model weights

A Functional Extension of Semi-Structured Networks

GECCO: Geometrically-Conditioned Point Diffusion Models

Phase Retrieval: From Computational Imaging to Machine Learning: A tutorial

Dense Multitask Learning to Reconfigure Comics

AIFORE: Smart Fuzzing Based on Automatic Input Format Reverse Engineering

Modeling lens potentials with continuous neural fields in galaxy-scale strong lenses

Quantization for Distributed Processing and Learning of Structured Data

Faster One-Sample Stochastic Conditional Gradient Method for Composite Convex Minimization

Dynamic Probabilistic Pruning: A General Framework for Hardware-Constrained Pruning at Different Granularities