Publications related to Multilingual Visual Sentiment Concept Matching

Related publications (28)

Examining European Press Coverage of the Covid-19 No-Vax Movement: An NLP Framework

This paper examines how the European press dealt with the no-vax reactions against the Covid-19 vaccine and the dis- and misinformation associated with this movement. Using a curated dataset of 1786 articles from 19 European newspapers on the anti-vaccine ...

ASSOC COMPUTING MACHINERY2023

The Facets of Intangible Heritage in Southern Chinese Martial Arts: Applying a Knowledge-Driven Cultural Contact Detection Approach

Yumeng Hou

Investigating the intangible nature of a cultural domain can take multiple forms, addressing for example the aesthetic, epistemic and social dimensions of its phenomenology. The context of Southern Chinese martial arts is of particular significance as it c ...

Association for Computing Machinery2023

Class Specific Feature Disentanglement and Text Embeddings for Multi-label Generalized Zero Shot CXR Classification

Seyedbehzad Bozorgtabar

Robustness of medical image classification models is limited by its exposure to the candidate disease classes. Generalized zero shot learning (GZSL) aims at correctly predicting seen and unseen classes and most current GZSL approaches have focused on the s ...

Springer International Publishing Ag2023

Text as a Richer Source of Supervision in Semantic Segmentation Tasks

Devis Tuia, Lloyd Haydn Hughes, Javiera Francisca Castillo Navarro, Valérie Zermatten

This paper introduces TACOSS a text-image alignment approach that allows explainable land cover semantic segmentation by directly integrating semantic concepts encoded from texts. TACOSS combines convolutional neural networks for visual feature extraction ...

The Institute of Electrical and Electronics Engineers, Inc2023

Attribute Prediction as Multiple Instance Learning

Devis Tuia, Diego Marcos Gonzalez

Attribute-based representations help machine learning models perform tasks based on human understandable concepts, allowing a closer human-machine collaboration. However, learning attributes that accurately reflect the content of an image is not always str ...

Journal of Machine Learning Research Inc.2022

The Vulnerability of Semantic Segmentation Networks to Adversarial Attacks in Autonomous Driving: Enhancing Extensive Environment Sensing

Peter Clemens Schlicht

Enabling autonomous driving (AD) can be considered one of the biggest challenges in today?s technology. AD is a complex task accomplished by several functionalities, with environment perception being one of its core functions. Environment perception is usu ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2021

Semantics-Aware Spatial-Temporal Binaries for Cross-Modal Video Retrieval

Jie Luo, Mengshi Qi

With the current exponential growth of video-based social networks, video retrieval using natural language is receiving ever-increasing attention. Most existing approaches tackle this task by extracting individual frame-level spatial features to represent ...

2021

Benefiting from Multitask Learning to Improve Single Image Super-Resolution

Jean-Philippe Thiran, Claudiu-Cristian Musat, Hazim Kemal Ekenel, Mohammad Saeed Rad

Despite significant progress toward super resolving more realistic images by deeper convolutional neural networks (CNNs), reconstructing fine and natural textures still remains a challenging problem. Recent works on single image super resolution (SISR) are ...

2020

Concept Discovery for The Interpretation of Landscape Scenicness

Devis Tuia

In this paper, we study how to extract visual concepts to understand landscape scenicness. Using visual feature representations from a Convolutional Neural Network (CNN), we learn a number of Concept Activation Vectors (CAV) aligned with semantic concepts ...

2020

SROBB: Targeted Perceptual Loss for Single Image Super-Resolution

Jean-Philippe Thiran, Hazim Kemal Ekenel, Mohammad Saeed Rad

By benefiting from perceptual losses, recent studies have improved significantly the performance of the super-resolution task, where a high-resolution image is resolved from its low-resolution counterpart. Although such objective functions generate near-ph ...

IEEE COMPUTER SOC2019

Semantic Attribute Matching Networks

Seungryong Kim

We present semantic attribute matching networks (SAM-Net) for jointly establishing correspondences and transferring attributes across semantically similar images, which intelligently weaves the advantages of the two tasks while overcoming their limitations ...

IEEE2019

Enhanced MR Image Classification Using Hybrid Statistical and Wavelets Features

Mohammad Khaja Nazeeruddin

Classification of brain tumor is one of the most vital tasks within medical image processing. Classification of images greatly depends on the features extracted from the image, and thus, feature extraction plays a great role in the correct classification o ...

2019

Detecting the Unexpected via Image Resynthesis

Pascal Fua, Mathieu Salzmann, Krzysztof Maciej Lis, Krishna Kanth Nakka

Classical semantic segmentation methods, including the recent deep learning ones, assume that all classes observed at test time have been seen during training. In this paper, we tackle the more realistic scenario where unexpected objects of unknown classes ...

IEEE2019

Evaluating and Interpreting Deep Convolutional Neural Networks via Non-negative Matrix Factorization

Edo Collins

With ever greater computational resources and more accessible software, deep neural networks have become ubiquitous across industry and academia. Their remarkable ability to generalize to new samples defies the conventional view, which holds that complex, ...

EPFL2019

A Performance Evaluation of Local Features for Image-Based 3D Reconstruction

Pascal Fua, Bin Fan

This paper performs a comprehensive and comparative evaluation of the state of the art local features for the task of image based 3D reconstruction. The evaluated local features cover the recently developed ones by using powerful machine learning technique ...

2019

Unleashing the power of semantic text analysis: a complex systems approach

Andrea Martini

In the present information era, a huge amount of machine-readable data is available regarding scientific publications. Such unprecedented wealth of data offers the opportunity to investigate science itself as a complex interacting system by means of quanti ...

EPFL2018

Simple Unsupervised Keyphrase Extraction using Sentence Embeddings

Martin Jaggi, Claudiu-Cristian Musat

Keyphrase extraction is the task of automatically selecting a small set of phrases that best describe a given free text document. Keyphrases can be used for indexing, searching, aggregating and summarizing text documents, serving many automatic as well as ...

2018

SparseFool: a few pixels make a big difference

Pascal Frossard, Seyed Mohsen Moosavi Dezfooli, Apostolos Modas

Deep Neural Networks have achieved extraordinary results on image classification tasks, but have been shown to be vulnerable to attacks with carefully crafted perturbations of the input data. Although most attacks usually change values of many image's pixe ...

2018

Keyword-based Image Color Re-rendering with Semantic Segmentation

Sabine Süsstrunk, Fayez Lahoud, Bin Jin

Keyword-based image color re-rendering is a convenient way to enhance the color of images. Most methods only focus on the color characteristics of the image while ignoring the semantic meaning of different regions. We propose to incorporate semantic inform ...

2017

Point and sensor estimation from images

Martin Vetterli, Adam James Scholefield, Alireza Ghasemi

System comprising at least one sensor configured to take a set of images from different viewpoints of a scene; a processor configured to identifying a point source represented in the images of a set of images; computing for each image of the set of images ...

2017