Publications related to Training Visual Language Models with Object Detection: Grounded Change Descriptions in Satellite Images

Related publications (13)

Parameter-efficient Methods for Training and Inference of Transformer-based Models

Recent advancements in natural language processing, driven by the success of large language models, have led to the scaling up of models to unprecedented sizes. While these models have achieved remarkable performance across various tasks, their computation ...

EPFL2025

A framework for evaluating the chemical knowledge and reasoning abilities of large language models against the expertise of chemists

Tanuj Gupta, Philippe Schwaller, Seyed Amirmohammad Elahi

Large language models (LLMs) have gained widespread interest owing to their ability to process human language and perform tasks on which they have not been explicitly trained. However, we possess only a limited systematic understanding of the chemical capa ...

Springer Science and Business Media LLC2025

Controlled Training Data Generation with Diffusion Models

Aleksandr Alekseev, Shuqing Teresa Yeo, Andrei Atanov

We present a method to control a text-to-image generative model to produce training data useful for supervised learning. Unlike previous works that employ an open-loop approach via pre-defined prompts to generate new data using either a language model or h ...

2025

Adversarial Training For Defense Against Label Poisoning Attacks

Volkan Cevher

As machine learning models grow in complexity and increasingly rely on publicly sourced data, such as the human-annotated labels used in training large language models, they become more vulnerable to label poisoning attacks. These attacks, in which adversa ...

2025

Fine-tuning protein language models to understand the functional impact of missense variants

Jacques Fellay

Elucidating the functional effects of missense variants is crucial yet challenging. To investigate their impact, we fine-tuned protein language models, including ESM2 and ProtT5, to classify 20 protein features at amino acid resolution. In addition, we tra ...

2025

Towards Reliable Evaluation and Fast Training of Robust Semantic Segmentation Models

Francesco Croce

Adversarial robustness has been studied extensively in image classification, especially for the ℓ∞-threat model, but significantly less so for related tasks such as object detection and semantic segmentation, where attacks turn out to be a much harder opti ...

Springer Science and Business Media Deutschland GmbH2025

Enhancing Peer Review with AI-Powered Suggestion Generation Assistance: Investigating the Design Dynamics

Xiaotian Su, Seyed Parsa Neshaei

While writing peer reviews resembles an important task in science, education, and large organizations, providing fruitful suggestions to peers is not a straightforward task, as different user interaction designs of text suggestion interfaces can have diver ...

Association for Computing Machinery2024

Can Language Models Recognize Convincing Arguments?

Paula Dolores Rescala, Robert West

The capabilities of large language models (LLMs) have raised concerns about their potential to create and propagate convincing narratives.Here, we study their performance in detecting convincing arguments to gain insights into LLMs' persuasive capabilities ...

Association for Computational Linguistics (ACL)2024

Qualify-as-you-go: sensor fusion of optical and acoustic signatures with contrastive deep learning for multi-material composition monitoring in laser powder bed fusion process

Christian Leinenbach, Antonios Nikolaos Baganis

Growing demand for multi-material Laser Powder Bed Fusion (LPBF) faces process control and quality monitoring challenges, particularly in ensuring precise material composition. This study explores optical and acoustic emission signals during LPBF processes ...

Taylor & Francis Ltd2024

Point-process-based Representation Learning for Electronic Health Records

David Atienza Alonso, Anisoara Ionescu, Hojjat Karami

Irregular sampling of time series in electronic health records (EHRs) presents a challenge for the development of machine learning models. Additionally, the pattern of missing data in certain clinical variables is not random, but depends on the decisions o ...

IEEE2023

CoNIC Challenge: Pushing the frontiers of nuclear detection, segmentation, classification and counting

Martin Weigert

Nuclear detection, segmentation and morphometric profiling are essential in helping us further understand the relationship between histology and patient outcome. To drive innovation in this area, we setup a communitywide challenge using the largest availab ...

Elsevier2023

Deep Multitask Gaze Estimation with a Constrained Landmark-Gaze Model

Jean-Marc Odobez, Yu Yu

As an indicator of attention, gaze is an important cue for human behavior and social interaction analysis. Recent deep learning methods for gaze estimation rely on plain regression of the gaze from images without accounting for potential mismatches in eye ...

SPRINGER INTERNATIONAL PUBLISHING AG2018

A Master-Slave Approach for Object Detection and Matching with Fixed and Mobile Cameras

Michel Bierlaire, Murat Kunt, Alexandre Massoud Alahi

Typical object detection algorithms on mobile cameras suffer from the lack of a-priori knowledge on the object to be detected. The variability in the shape, pose, color distribution, and behavior affect the robustness of the detection process. In general, ...

2008