Publication

Aligning Multilingual Word Embeddings for Cross-Modal Retrieval Task

Related publications (27)

Semantics-Aware Spatial-Temporal Binaries for Cross-Modal Video Retrieval

With the current exponential growth of video-based social networks, video retrieval using natural language is receiving ever-increasing attention. Most existing approaches tackle this task by extracting individual frame-level spatial features to represent ...

2021

PARSINLU: A Suite of Language Understanding Challenges for Persian

Rabeeh Karimi Mahabadi

Despite the progress made in recent years in addressing natural language understanding (NLU) challenges, the majority of this progress remains to be concentrated on resource-rich languages like English. This work focuses on Persian language, one of the wid ...

2021

Word-level Embeddings for Cross-Task Transfer Learning in Speech Processing

Pierre Anton Beckmann, Milos Cernak

Recent breakthroughs in deep learning often rely on representation learning and knowledge transfer. In recent years, unsupervised and self-supervised techniques for learning speech representation were developed to foster automatic speech recognition. Up to ...

EUROPEAN ASSOC SIGNAL SPEECH & IMAGE PROCESSING-EURASIP2021

Low-Rank Subspaces for Unsupervised Entity Linking

Robert West, Akhil Arora, Alberto Garcia Duran

Entity linking is an important problem with many applications. Most previous solutions were designed for settings where annotated training data is available, which is, however, not the case in numerous domains. We propose a light-weight and scalable entity ...

ASSOC COMPUTATIONAL LINGUISTICS-ACL2021

Concept Discovery for The Interpretation of Landscape Scenicness

Devis Tuia

In this paper, we study how to extract visual concepts to understand landscape scenicness. Using visual feature representations from a Convolutional Neural Network (CNN), we learn a number of Concept Activation Vectors (CAV) aligned with semantic concepts ...

2020

On the Limitations of Cross-lingual Encoders as Exposed by Reference-Free Machine Translation Evaluation

Maxime Jean Julien Peyrard, Robert West, Wei Zhao, Yang Gao

Evaluation of cross-lingual encoders is usually performed either via zero-shot cross-lingual transfer in supervised downstream tasks or via unsupervised cross-lingual textual similarity. In this paper, we concern ourselves with reference-free machine trans ...

ASSOC COMPUTATIONAL LINGUISTICS-ACL2020

Context Mover's Distance & Barycenters: Optimal Transport of Contexts for Building Representations

Martin Jaggi, Sidak Pal Singh, Aymeric Daphnis Kévin Dieuleveut, Andreas Hug

We present a framework for building unsupervised representations of entities and their compositions, where each entity is viewed as a probability distribution rather than a vector embedding. In particular, this distribution is supported over the contexts w ...

ADDISON-WESLEY PUBL CO2020