Publications related to A Simple Framework for Open-Vocabulary Zero-Shot Segmentation

Related publications (16)

Dependable learning and control through Neural ODEs

Neural Networks (NNs), renowned for their universal approximation capabilities, have proven well-suited for parametrizing nonlinear control policies and modeling complex processes from available data. However, several NN architectures are physics-agnostic, ...

EPFL2025

Controlled learning of pointwise nonlinearities in neural-network-like architectures

Michaël Unser, Alexis Marie Frederic Goujon, Stanislas Ducotterd

We present a general variational framework for the training of freeform nonlinearities in layered computational architectures subject to some slope constraints. The regularization that we add to the traditional training loss penalizes the second-order tota ...

2025

Deterministic equivalent and error universality of deep random features learning

Hugo Chao Cui

This manuscript considers the problem of learning a random Gaussian network function using a fully connected network with frozen intermediate layers and trainable readout layer. This problem can be seen as a natural generalization of the widely studied ran ...

2024

Label-efficient deep semantic segmentation of intracranial hemorrhages in CT-scans

Antoine Jérôme Spahr

Intracranial hemorrhage (ICH) is a common finding in traumatic brain injury (TBI) and computed tomography (CT) is considered the gold standard for diagnosis. Automated detection of ICH provides clinical value in diagnostics and in the ability to feed robus ...

2023

Text as a Richer Source of Supervision in Semantic Segmentation Tasks

Devis Tuia, Lloyd Haydn Hughes, Javiera Francisca Castillo Navarro, Valérie Zermatten

This paper introduces TACOSS a text-image alignment approach that allows explainable land cover semantic segmentation by directly integrating semantic concepts encoded from texts. TACOSS combines convolutional neural networks for visual feature extraction ...

The Institute of Electrical and Electronics Engineers, Inc2023

Dual-frequency spectral radar retrieval of snowfall microphysics: a physics-driven deep-learning approach

Alexis Berne, Anne-Claire Marie Billault--Roux, Gionata Ghiggi

The use of meteorological radars to study snowfall microphysical properties and processes is well established, in particular via a few distinct techniques: the use of radar polarimetry, of multi-frequency radar measurements, and of the radar Doppler spectr ...

COPERNICUS GESELLSCHAFT MBH2023

Divergences in color perception between deep neural networks and humans

Bhargav Srinivasa Desikan

Deep neural networks (DNNs) are increasingly proposed as models of human vision, bolstered by their impressive performance on image classification and object recognition tasks. Yet, the extent to which DNNs capture fundamental aspects of human vision such ...

2023

Personalized Productive Engagement Recognition in Robot-Mediated Collaborative Learning

Barbara Bruno, Jauwairia Nasir

In this paper, we propose and compare personalized models for Productive Engagement (PE) recognition. PE is defined as the level of engagement that maximizes learning. Previously, in the context of robot-mediated collaborative learning, a framework of prod ...

2022

Self-Supervision By Prediction For Object Discovery In Videos

Pascal Frossard, Beril Besbinar

Despite their irresistible success, deep learning algorithms still heavily rely on annotated data, and unsupervised settings pose many challenges, such as finding the right inductive bias in diverse scenarios. In this paper, we propose an object-centric mo ...

IEEE2021

Partitioning soil organic carbon into its centennially stable and active fractions with machine-learning models based on Rock-Eval (R) thermal analysis (PARTY(SOC)v2.0 and PARTY(SOC)v2.0 (EU))

Juan Carlos Quezada Rivera

Partitioning soil organic carbon (SOC) into two kinetically different fractions that are stable or active on a century scale is key for an improved monitoring of soil health and for more accurate models of the carbon cycle. However, all existing SOC fracti ...

COPERNICUS GESELLSCHAFT MBH2021

Age-Dependent Statistical Learning Trajectories Reveal Differences in Information Weighting

Steffen Alexander Herff

Statistical learning (SL) is the ability to generate predictions based on probabilistic dependencies in the environment, an ability that is present throughout life. The effect of aging on SL is still unclear. Here, we explore statistical learning in health ...

AMER PSYCHOLOGICAL ASSOC2020

Interactive Teaching Algorithms for Inverse Reinforcement Learning

Volkan Cevher, Kamalaruban Parameswaran

We study the problem of inverse reinforcement learning (IRL) with the added twist that the learner is assisted by a helpful teacher. More formally, we tackle the following algorithmic question: How could a teacher provide an informative sequence of demonst ...

2019

MMKG: Multi-modal Knowledge Graphs

Alberto Garcia Duran

We present Mmkg, a collection of three knowledge graphs that contain both numerical features and (links to) images for all entities as well as entity alignments between pairs of KGs. Therefore, multi-relational link prediction and entity matching communiti ...

SPRINGER INTERNATIONAL PUBLISHING AG2019

Semantically Annotated Lesson Observation Data in Learning Analytics Datasets: a Reference Model

Maria Jesus Rodriguez Triana

Learning analytics (LA) and lesson observations are two approaches frequently used to study teaching and learning processes. In both cases, in order to extract meaningful data interpretations, there is a need for contextualization. Previous works propose t ...

2017

Autonomous Learning of Internal Dynamic Models for Reaching Tasks

Auke Ijspeert, Tadej Petric

The paper addresses the problem of learning internal task-specific dynamic models for a reaching task. Using task-specific dynamic models is crucial for achieving both high tracking accuracy and compliant behaviour, which improves safety concerns while wor ...

Springer-Verlag Berlin2016

Nonbinary Associative Memory With Exponential Pattern Retrieval Capacity and Iterative Learning

Mohammad Amin Shokrollahi, Amir Hesam Salavati, Krishna Kumar

We consider the problem of neural association for a network of nonbinary neurons. Here, the task is to first memorize a set of patterns using a network of neurons whose states assume values from a finite number of integer levels. Later, the same network sh ...

Ieee-Inst Electrical Electronics Engineers Inc2014