Publications related to DALL-E

VETIM: Expanding the Vocabulary of Text-to-Image Models only with Text

Sabine Süsstrunk, Radhakrishna Achanta, Mahmut Sami Arpa, Martin Nicolas Everaert

Text-to-image models, such as Stable Diffusion, can generate high-quality images from simple textual prompts. With methods such as Textual Inversion, it is possible to expand the vocabulary of these models with additional concepts, by learning the vocabula ...

BMVA2023

Toward responsible face datasets: modeling the distribution of a disentangled latent space for sampling face images from demographic groups

Sébastien Marcel, Christophe René Joseph Ecabert, Parsa Rahimi Noshanagh

Recently, it has been exposed that some modern facial recognition systems could discriminate specific demographic groups and may lead to unfair attention with respect to various facial attributes such as gender and origin. The main reason are the biases in ...

IEEE2023

OptTTA: Learnable Test-Time Augmentation for Source-Free Medical Image Segmentation Under Domain Shift

Jean-Philippe Thiran, Seyedbehzad Bozorgtabar, Guillaume Marc Georges Vray, Devavrat Tomar

As distribution shifts are inescapable in realistic clinical scenarios due to inconsistencies in imaging protocols, scanner vendors, and across different centers, well-trained deep models incur a domain generalization problem in unseen environments. Despit ...

PMLR2022

MultiMAE: Multi-modal Multi-task Masked Autoencoders

Amir Roshan Zamir, Roman Christian Bachmann, Andrei Atanov, David Mizrahi

We propose a pre-training strategy called Multi-modal Multi-task Masked Autoencoders (MultiMAE). It differs from standard Masked Autoencoding in two key aspects: I) it can optionally accept additional modalities of information in the input besides the RGB ...

SPRINGER INTERNATIONAL PUBLISHING AG2022

Self-Supervision By Prediction For Object Discovery In Videos

Pascal Frossard, Beril Besbinar

Despite their irresistible success, deep learning algorithms still heavily rely on annotated data, and unsupervised settings pose many challenges, such as finding the right inductive bias in diverse scenarios. In this paper, we propose an object-centric mo ...

IEEE2021

Benchmarking Image-Processing Algorithms for Biomicroscopy: Reference Datasets and Perspectives

Michaël Unser, Daniel Sage, Cédric René Jean Vonesch, Stamatios Lefkimmiatis, Hagay Kirshner

As the field of bioimage informatics matures, the issue of the validation of image reconstruction algorithms and the definition of proper performance criteria becomes more pressing. In this work, we discuss benchmarking aspects of fluorescence microscopy q ...

EUSIPCO2013

Text Recognition in Natural Images Using Multiclass Hough Forests

Sabine Süsstrunk, Radhakrishna Achanta, Gökhan Yildirim

Text detection and recognition in natural images are popular yet unsolved problems in computer vision. In this paper, we propose a technique that attempts to detect and recognize text in a unified manner by searching for words directly without reducing the ...

2013