Publications related to Prompt–RSVQA: Prompting visual context to a language model for Remote Sensing Visual Question Answering

Related publications (42)

Interact with Earth Observation Images using AI: Transparent Methods and Evaluation for Visual Question Answering

Now is an exciting time for the domain of Earth observation (EO), with a multitude of diverse sensors looking at the planet from satellites, airplanes or drones. The volume of imagery acquired is massive, and hold great potential for a variety of applicati ...

EPFL2025

A Closer Look at Benchmarking Self-supervised Pre-training with Image Classification

Fernando Perez Cruz

Self-supervised learning (SSL) is a machine learning approach where the data itself provides supervision, eliminating the need for external labels. The model is forced to learn about the data's inherent structure or context by solving a pretext task. With ...

SPRINGER2025

Eflop: a Sparsity-aware Metric for Evaluating Computational Cost in Spiking and Non-spiking Neural Networks

Liza Carol Andrea Dunbar

Deploying energy-efficient deep neural networks on energy-constrained edge devices is an important research topic in both machine learning and circuit design communities. Both artificial neural networks (ANNs) and spiking neural networks (SNNs) have been p ...

IOP Publishing Ltd2025

Fifty Shades of Vision: How Does Spatiotemporal Context Influence Perception?

Ayberk Ozkirli

This thesis investigates how spatiotemporal context influences visual perception, critically evaluating two dominant frameworks in vision science: traditional feedforward and Bayesian integration models. Traditional models propose that perception is constr ...

EPFL2025

Mspo: a Machine Learning Hyperparameter Optimization Method for Enhanced Breast Cancer Image Classification

Zaffar Ahmed Shaikh

As one of the major threats to women's health worldwide, breast cancer requires early diagnosis and accurate classification, since they are key to optimizing therapeutic interventions and ensuring precise prognosis. Recently, deep learning has demonstrated ...

SAGE PUBLICATIONS LTD2025

ThermoNeRF: A multimodal Neural Radiance Field for joint RGB-thermal novel view synthesis of building facades

Olga Fink, Florent Evariste Forest, Mariam Ahmed Mahmoud Hegazy Hassan

Thermal scene reconstruction holds great potential for various applications, such as building energy analysis and non-destructive infrastructure testing. However, existing methods rely on dense scene measurements and use RGB images for 3D reconstruction, i ...

2025

Probing the latent hierarchical structure of data via diffusion models

Noam Itzhak Levi, Alessandro Favero, Antonio Sclocchi

High-dimensional data must be highly structured to be learnable. Although the compositional and hierarchical nature of data is often put forward to explain learnability, quantitative measurements establishing these properties are scarce. Likewise, accessin ...

2025

Self-supervised and few-shot learning for robust bioaerosol monitoring

Sophie Catherine Erb

Real-time bioaerosol monitoring is improving the quality of life for people affected by allergies, but it often relies on deep learning models which pose challenges for widespread adoption. These models are typically trained in a supervised fashion and req ...

2025

Understanding the sentiment associated with cultural ecosystem services using images and text from social media

Devis Tuia

Social media is increasingly being employed to develop Cultural Ecosystem Services (CES) indicators. The image-sharing platform Flickr has been one of the most popular sources of data. Most large-scale studies, however, tend to only use the number of image ...

2024

Driving and suppressing the human language network using large language models

Martin Schrimpf

Transformer models such as GPT generate human-like language and are predictive of human brain responses to language. Here, using functional-MRI-measured brain responses to 1,000 diverse sentences, we first show that a GPT-based encoding model can predict t ...

Nature Portfolio2024

Student Answer Forecasting: Transformer-Driven Answer Choice Prediction for Language Learning

Tommaso Martorella, Elena Grazia Gado, Tanja Christina Käser Jacober, Paola Mejia Domenzain, Vinitra Swamy, Jibril Albachir Frej

Intelligent Tutoring Systems (ITS) enhance personalized learning by predicting student answers to provide immediate and customized instruction. However, recent research has primarily focused on the correctness of the answer rather than the student's perfor ...

2024

Performing and Detecting Backdoor Attacks on Face Recognition Algorithms

Alexander Carl Unnervik

The field of biometrics, and especially face recognition, has seen a wide-spread adoption the last few years, from access control on personal devices such as phones and laptops, to automated border controls such as in airports. The stakes are increasingly ...

EPFL2024

Infusing structured knowledge priors in neural models for sample-efficient symbolic reasoning

Mattia Atzeni

The ability to reason, plan and solve highly abstract problems is a hallmark of human intelligence. Recent advancements in artificial intelligence, propelled by deep neural networks, have revolutionized disciplines like computer vision and natural language ...

EPFL2024

Network time series forecasting in photovoltaics power production

Jelena Simeunovic

Accurate forecasting of photovoltaic (PV) power production is crucial for the integration of more renewable energy sources into the power grid. PV power production is highly intermittent, due to the stochastic cloud behaviour and cloud dynamics. Previous w ...

EPFL2024

Course Design - A Visual and Modular Approach

Marc Laperrouza

This book has been designed for instructors in higher education or adult training who wish to develop a new course or revise an existing one. It adopts a practical, visual, and modular approach based on the principle of constructive alignment. At its heart ...

EPFL Press2024

Social-Transmotion: Promptable Human Trajectory Prediction

Alexandre Massoud Alahi, Saeed Saadatnejad, Yang Gao, Kaouther Messaoud Ben Amor

Accurate human trajectory prediction is crucial for applications such as autonomous vehicles, robotics, and surveillance systems. Yet, existing models often fail to fully leverage the non-verbal social cues human subconsciously communicate when navigating ...

2024

Variability is the rule: Neurophysiology and contextual visual processing in schizophrenia

Dario Alejandro Gordillo Lopez

Traditionally, studies in schizophrenia research employ a single experimental paradigm. The results typically demonstrate a significant difference between patients and controls. Subsequent studies aim to describe the underlying abnormal mechanism at the ge ...

EPFL2024

Towards Trustworthy Deep Learning for Image Reconstruction

Alexis Marie Frederic Goujon

The remarkable ability of deep learning (DL) models to approximate high-dimensional functions from samples has sparked a revolution across numerous scientific and industrial domains that cannot be overemphasized. In sensitive applications, the good perform ...

EPFL2024

Text-to-Microstructure Generation Using Generative Deep Learning

Jamie Paik, Xiaoyang Zheng

Designing novel materials is greatly dependent on understanding the design principles, physical mechanisms, and modeling methods of material microstructures, requiring experienced designers with expertise and several rounds of trial and error. Although rec ...

Wiley-V C H Verlag Gmbh2024

Fusing Pre-existing Knowledge and Machine Learning for Enhanced Building Thermal Modeling and Control

Loris Di Natale

Buildings play a pivotal role in the ongoing worldwide energy transition, accounting for 30% of the global energy consumption. With traditional engineering solutions reaching their limits to tackle such large-scale problems, data-driven methods and Machine ...

EPFL2024