Aligning Multilingual Word Embeddings for Cross-Modal Retrieval Task

Chat with Graph Search

Ask any question about EPFL courses, lectures, exercises, research, news, etc. or try the example questions below.

DISCLAIMER: The Graph Chatbot is not programmed to provide explicit or categorical answers to your questions. Rather, it transforms your questions into API requests that are distributed across the various IT services officially administered by EPFL. Its purpose is solely to collect and recommend relevant references to content that you can explore to help you answer your questions.

We propose a local, non -intrusive model order reduction technique to accurately approximate the solution of coupled multi -component parametrized systems governed by partial differential equations. Our approach is based on the approximation of the boundar ...

Graph neural networks (GNNs) have demonstrated promising performance across various chemistry-related tasks. However, conventional graphs only model the pairwise connectivity in molecules, failing to adequately represent higher order connections, such as m ...

Test time augmentation has been shown to be an effective approach to combat domain shifts in deep learning. Despite their promising performance levels, the interpretability of the underlying used models is however low. Saliency maps have been widely used i ...

This paper examines how the European press dealt with the no-vax reactions against the Covid-19 vaccine and the dis- and misinformation associated with this movement. Using a curated dataset of 1786 articles from 19 European newspapers on the anti-vaccine ...

This paper introduces TACOSS a text-image alignment approach that allows explainable land cover semantic segmentation by directly integrating semantic concepts encoded from texts. TACOSS combines convolutional neural networks for visual feature extraction ...

Myoelectric prostheses allow users to recover lost functionality by controlling a robotic device with their remaining muscle activity. Commercial devices usually use a two-recording-channel system placed on specific muscles to control a single degree of fr ...

Natural language processing has experienced significant improvements with the development of Transformer-based models, which employ self-attention mechanism and pre-training strategies. However, these models still present several obstacles. A notable issue ...

Recent transformer language models achieve outstanding results in many natural language processing (NLP) tasks. However, their enormous size often makes them impractical on memory-constrained devices, requiring practitioners to compress them to smaller net ...

Abstractive summarization has seen big improvements in recent years, mostly due to advances in neural language modeling, language model pretraining, and scaling models and datasets. While large language models generate summaries that are fluent, coherent, ...

Text-to-image models, such as Stable Diffusion, can generate high-quality images from simple textual prompts. With methods such as Textual Inversion, it is possible to expand the vocabulary of these models with additional concepts, by learning the vocabula ...

Introduced to enable a wider use of Earth Observation images using natural language, Remote Sensing Visual Question Answering (RSVQA) remains a challenging task, in particular for questions related to counting. To address this specific challenge, we propos ...

Natural language processing and other artificial intelligence fields have witnessed impressive progress over the past decade. Although some of this progress is due to algorithmic advances in deep learning, the majority has arguably been enabled by scaling ...

Robustness of medical image classification models is limited by its exposure to the candidate disease classes. Generalized zero shot learning (GZSL) aims at correctly predicting seen and unseen classes and most current GZSL approaches have focused on the s ...

Vision-Language Pre-training (VLP) has advanced the performance of many visionlanguage tasks, such as image-text retrieval, visual entailment, and visual reasoning. The pre-training mostly utilizes lexical databases and image queries in English. Previous w ...

Remote sensing visual question answering (RQA) was recently proposed with the aim of interfacing natural language and vision to ease the access of information contained in Earth Observation data for a wide audience, which is granted by simple questions in ...

In the information age, the Web and the growing global connectivity drastically simplified our access to information. Learning and fact-checking from online resources is nowadays part of our daily routine. Studying the dynamic associated with online conten ...

Natural Language Processing (NLP) has become increasingly utilized to provide adaptivity in educational applications. However, recent research has highlighted a variety of biases in pre-trained language models. While existing studies investigate bias in di ...

Named entity linking (NEL) in news is a challenging endeavour due to the frequency of unseen and emerging entities, which necessitates the use of unsupervised or zero-shot methods. However, such methods tend to come with caveats, such as no integration of ...

Term extraction is an information extraction task at the root of knowledge discovery platforms. Developing term extractors that are able to generalize across very diverse and potentially highly technical domains is challenging, as annotations for domains r ...

Most of the Natural Language Processing (NLP) algorithms involve use of distributed vector representations of linguistic units (primarily words and sentences) also known as embeddings in one way or another. These embeddings come in two flavours namely, sta ...

Aligning Multilingual Word Embeddings for Cross-Modal Retrieval Task

Chat with Graph Search

Model reduction of coupled systems based on non-intrusive approximations of the boundary response maps

Molecular hypergraph neural networks

SAGTTA: SALIENCY GUIDED TEST TIME AUGMENTATION FOR MEDICAL IMAGE SEGMENTATION ACROSS VENDOR DOMAIN SHIFT

Examining European Press Coverage of the Covid-19 No-Vax Movement: An NLP Framework

Text as a Richer Source of Supervision in Semantic Segmentation Tasks

Improving hand prosthesis control with advanced single-finger proportional decoding and robotic shared control

Modeling Structured Data in Attention-based Models

Revisiting Offline Compression: Going Beyond Factorization-based Methods for Transformer Language Models

Interpretable Representation Learning and Evaluation for Abstractive Summarization

VETIM: Expanding the Vocabulary of Text-to-Image Models only with Text

Multi-task prompt-RSVQA to explicitly count objects on aerial images

Text Representation Learning for Low Cost Natural Language Understanding

Class Specific Feature Disentanglement and Text Embeddings for Multi-label Generalized Zero Shot CXR Classification

Stop Pre-Training: Adapt Visual-Language Models to Unseen Languages

Prompt–RSVQA: Prompting visual context to a language model for Remote Sensing Visual Question Answering

How We Use Wikipedia: Studying Readers' Behavior with Navigation Traces

Bias at a Second Glance: A Deep Dive into Bias for German Educational Peer-Review Data Modeling

Strong Heuristics for Named Entity Linking

Unsupervised Term Extraction for Highly Technical Domains

Learning computationally efficient static word and sentence representations