Publications related to Class Specific Feature Disentanglement and Text Embeddings for Multi-label Generalized Zero Shot CXR Classification

Related publications (39)

Enhancing skin lesion classification: a CNN approach with human baseline comparison

This study presents an augmented hybrid approach for improving the diagnosis of malignant skin lesions by combining convolutional neural network (CNN) predictions with selective human interventions based on prediction confidence. The algorithm retains high ...

PeerJ2025

XLSR-Transducer: Streaming ASR for Self-Supervised Pretrained Models

Juan Pablo Zuluaga Gomez

Self-supervised pretrained models exhibit competitive performance in automatic speech recognition (ASR) on finetuning, even with limited in-domain supervised data. However, popular pretrained models are not suitable for streaming ASR because they are train ...

Institute of Electrical and Electronics Engineers2025

Automated Generation of Emotion-Conveying Sounds for Robots

Alaa Abboud

Sonic Human-Robot Interaction aims at equipping robots with the ability to convey emotions and intentions via sounds. Such sounds are typically handcrafted by human experts, which results in expensive, small sound sets with limited expressivity. To overcom ...

IEEE2025

Unsupervised Rhythm and Voice Conversion of Dysarthric to Healthy Speech for ASR

Karl El Hajal

Automatic speech recognition (ASR) systems are well known to perform poorly on dysarthric speech. Previous works have addressed this by speaking rate modification to reduce the mismatch with typical speech. Unfortunately, these approaches rely on transcrib ...

Institute of Electrical and Electronics Engineers Inc.2025

MetaCap: Meta-learning Priors from Multi-view Imagery for Sparse-View Human Performance Capture and Rendering

Pascal Fua

Faithful human performance capture and free-view rendering from sparse RGB observations is a long-standing problem in Vision and Graphics. The main challenges are the lack of observations and the inherent ambiguities of the setting, e.g. occlusions and dep ...

Springer Science and Business Media Deutschland GmbH2025

Functionalization of harmonic nanoparticles for drug release and multimodal imaging applications

Adrian Stefan Gheata

Cancer is among the leading causes of death worldwide, and as knowledge of the disease continues to grow there is an increasing interest towards precision medicine: more specifically towards the theranostics field, i.e the development of targeted molecular ...

EPFL2024

Few-shot Learning for Efficient and Effective Machine Learning Model Adaptation

Arnout Jan J Devos

Machine learning (ML) enables artificial intelligent (AI) agents to learn autonomously from data obtained from their environment to perform tasks. Modern ML systems have proven to be extremely effective, reaching or even exceeding human intelligence. Altho ...

EPFL2024

Toward Automatic Typography Analysis: Serif Classification and Font Similarities

Syed Talal Wasim, Mathieu Salzmann, Nicolas Henchoz, Delphine Ribes Lemay, Lara Jacqueline Défayes, Romain Simon Collaud

Whether a document is of historical or contemporary significance, typography plays a crucial role in its composition. From the early days of modern printing, typographic techniques have evolved and transformed, resulting in changes to the features of typog ...

2024

Aggregating Spatial and Photometric Context for Photometric Stereo

David Honzátko

Photometric stereo, a computer vision technique for estimating the 3D shape of objects through images captured under varying illumination conditions, has been a topic of research for nearly four decades. In its general formulation, photometric stereo is an ...

EPFL2024

Transformer Models for Vision

Jean-Baptiste Francis Marie Juliette Cordonnier

The recent developments of deep learning cover a wide variety of tasks such as image classification, text translation, playing go, and folding proteins. All these successful methods depend on a gradient-based learning algorithm to train a model on massive ...

EPFL2023

VETIM: Expanding the Vocabulary of Text-to-Image Models only with Text

Sabine Süsstrunk, Radhakrishna Achanta, Mahmut Sami Arpa, Martin Nicolas Everaert

Text-to-image models, such as Stable Diffusion, can generate high-quality images from simple textual prompts. With methods such as Textual Inversion, it is possible to expand the vocabulary of these models with additional concepts, by learning the vocabula ...

BMVA2023

GANDALF: Graph-based transformer and Data Augmentation Active Learning Framework with interpretable features for multi-label chest Xray classification

Seyedbehzad Bozorgtabar

Informative sample selection in an active learning (AL) setting helps a machine learning system attain optimum performance with minimum labeled samples, thus reducing annotation costs and boosting performance of computer-aided diagnosis systems in the pres ...

Elsevier2024

The multimodality cell segmentation challenge: toward universal solutions

Maxime Emmanuel Scheder, Jun Ma, Sahand Jamal Rahi, Xin Yang, Vojislav Gligorovski, Marco Labagnara

Cell segmentation is a critical step for quantitative single-cell analysis in microscopy images. Existing cell segmentation methods are often tailored to specific modalities or require manual interventions to specify hyper-parameters in different experimen ...

Nature Publishing Group2024

Measurement and modelling of dynamic fluid saturation in carbon reinforcements

Véronique Michaud, Baris Çaglar, Guillaume Clément Broggi, Helena Luisa Teixido Pedarros

We propose a methodology to monitor the progressive saturation of a non-translucent unidirectional carbon fabric stack through its thickness by means of X-ray radiography and extract the dynamic saturation curves using image analysis. Four constant flow ra ...

2023

Development and clinical validation of computational imaging biomarkers for neurodegenerative diseases

Veronica Lily Ravano

Neurodegenerative and neuroinflammatory disorders often involve complex pathophysiological mechanisms that are â to this date â only partially understood. A more comprehensive understanding of those microstructural processes and their characterization ...

EPFL2024

Text as a Richer Source of Supervision in Semantic Segmentation Tasks

Devis Tuia, Lloyd Haydn Hughes, Javiera Francisca Castillo Navarro, Valérie Zermatten

This paper introduces TACOSS a text-image alignment approach that allows explainable land cover semantic segmentation by directly integrating semantic concepts encoded from texts. TACOSS combines convolutional neural networks for visual feature extraction ...

The Institute of Electrical and Electronics Engineers, Inc2023

Advancing Self-Supervised Deep Learning for 3D Scene Understanding

Seyed Mohammad Mahdi Johari

Recent advancements in deep learning have revolutionized 3D computer vision, enabling the extraction of intricate 3D information from 2D images and video sequences. This thesis explores the application of deep learning in three crucial challenges of 3D com ...

EPFL2024

SAGTTA: SALIENCY GUIDED TEST TIME AUGMENTATION FOR MEDICAL IMAGE SEGMENTATION ACROSS VENDOR DOMAIN SHIFT

Seyedbehzad Bozorgtabar, Devavrat Tomar

Test time augmentation has been shown to be an effective approach to combat domain shifts in deep learning. Despite their promising performance levels, the interpretability of the underlying used models is however low. Saliency maps have been widely used i ...

IEEE2023

Interpretable Representation Learning and Evaluation for Abstractive Summarization

Andreas Thomas Marfurt

Abstractive summarization has seen big improvements in recent years, mostly due to advances in neural language modeling, language model pretraining, and scaling models and datasets. While large language models generate summaries that are fluent, coherent, ...

EPFL2023

Infusing structured knowledge priors in neural models for sample-efficient symbolic reasoning

Mattia Atzeni

The ability to reason, plan and solve highly abstract problems is a hallmark of human intelligence. Recent advancements in artificial intelligence, propelled by deep neural networks, have revolutionized disciplines like computer vision and natural language ...

EPFL2024