Publications associées à On the modelling of multi-modal data using redundant dictionaries

Publications associées (30)

From Pose to Behavior: Advancing Multi-Individual Pose Estimation and Hierarchical Action Segmentation with Transformers

Accurately measuring behavior is critical to understanding brain function. While traditional behavioral analysis has relied on human observation and manual processing, advances in machine learning and computer vision have begun to automate the field. This ...

EPFL2025

EntitySAM: Segment Everything in Video

Mingqiao Ye

Automatically tracking and segmenting every video entity remains a significant challenge. Despite rapid advancements in video segmentation, even state-of-the-art models like SAM 2 struggle to consistently track all entities across a video—a task we refer t ...

IEEE2025

Temporal aspects of feature integration in vision

Lukas Vogelsang

To fully comprehend visual perception, we need to necessarily understand its temporal dimension. Our visual environment is highly dynamic, requiring the processing and integration of temporal signals in order to make sense of it. Many processes, such as th ...

EPFL2024

Serial Dependence in Human Visual Perception and Decision-Making

Gizay Ceylan

Decisions about a current visual stimulus are systematically biased by recently encountered stimuli, a phenomenon known as serial dependence. In human vision, for instance, we tend to report the features of current images as more similar â i.e., an attra ...

EPFL2024

Towards Motion Forecasting with Real-World Perception Inputs: Are End-to-End Approaches Competitive?

Alexandre Massoud Alahi

Motion forecasting is crucial in enabling autonomous vehicles to anticipate the future trajectories of surrounding agents. To do so, it requires solving mapping, detection, tracking, and then forecasting problems, in a multi-step pipeline. In this complex ...

2024

SVGC-AVA: 360-Degree Video Saliency Prediction With Spherical Vector-Based Graph Convolution and Audio-Visual Attention

Pascal Frossard

Viewers of 360-degree videos are provided with both visual modality to characterize their surrounding views and audio modality to indicate the sound direction. Though both modalities are important for saliency prediction, little work has been done by joint ...

Ieee-Inst Electrical Electronics Engineers Inc2024

Probing and modulating inter-areal coupling in the cortical visual motion processing pathway with non-invasive brain stimulation

Michele Bevilacqua

In the last few years, stroke ranked as the second most common cause of death and is the third most significant condition affecting disability-adjusted life years (DALYs) worldwide. Being the most prevalent and quality of life impacting post-stroke symptom ...

EPFL2024

The Current State of the OBI DICT Project: A Bilingual e-Dictionary of Oracle-Bone Inscriptions with AI Image Recognition

Shuo Wen

This article reports on the current state of the OBI DICT project, a bilingual e-dictionary of oracle-bone inscriptions (OBI), incorporating artificial intelligence (AI) image recognition technology. It first provides a brief overview of the development of ...

Buro Van Die Wat2024

Aggregating Spatial and Photometric Context for Photometric Stereo

David Honzátko

Photometric stereo, a computer vision technique for estimating the 3D shape of objects through images captured under varying illumination conditions, has been a topic of research for nearly four decades. In its general formulation, photometric stereo is an ...

EPFL2024

Fast and Future: Towards Efficient Forecasting in Video Semantic Segmentation

Evann Pierre Guy Courdier

Deep learning has revolutionized the field of computer vision, a success largely attributable to the growing size of models, datasets, and computational power. Simultaneously, a critical pain point arises as several computer vision applications are deploye ...

EPFL2024

FLO:RE – A new floor system made of reused reinforced concrete and steel elements

Corentin Jean Dominique Fivet, Numa Joy Bertola, Maléna Bastien Masse, Célia Marine Küpfer

Carefully extracting reinforced concrete (RC) elements from soon-to-be demolished structures and reusing them as load-bearing components is an emerging circular low-carbon alternative to building new structures. As floor construction typically accounts for ...

IABSE2024

Statistical Inference for Inverse Problems: From Sparsity-Based Methods to Neural Networks

Pakshal Narendra Bohra

In inverse problems, the task is to reconstruct an unknown signal from its possibly noise-corrupted measurements. Penalized-likelihood-based estimation and Bayesian estimation are two powerful statistical paradigms for the resolution of such problems. They ...

EPFL2024

Vibrational NDT with Under-sampled Data through Physics-informed Neural Networks

Olga Fink

The vibrational response of solid materials and structural components is substantially governed by their mechanical and geometrical properties. Low-frequency vibrations and modal frequencies are sensitive to global geometrical deviations, while high-freque ...

2023

Functional neuroimaging options for tinnitus

Patrick Karl Alois Neff

Background: The pathophysiology behind tinnitus is still not well understood. Different imaging methods help in the understanding of the complex relationships that lead to the perception of tinnitus.Objective: Herein, different functional imaging methods t ...

SPRINGER2023

Temporal windows of unconscious processing cannot easily be disrupted

Michael Herzog, Leila Drissi Daoudi - Kleinbauer, Lukas Vogelsang

Conscious perception is preceded by long periods of unconscious processing. These periods are crucial for analyzing temporal information and for solving the many ill-posed problems of vision. An important question is what starts and ends these windows and ...

Association for Research in Vision and Ophthalmology (ARVO)2024

The full-body illusion changes visual depth perception

Olaf Blanke, Bruno Herbelin, Sophie Jacqueline Andrée Betka

Knowing where objects are relative to us implies knowing where we are relative to the external world. Here, we investigated whether space perception can be influenced by an experimentally induced change in perceived self-location. To dissociate real and ap ...

Nature Research2023

From Nano to Macro An overview of the IEEE Bio Image and Signal Processing Technical Committee

Michaël Unser, Dimitri Nestor Alice Van De Ville, Michael Stefan Daniel Liebling

The Bio Image and Signal Processing (BISP) Technical Committee (TC) of the IEEE Signal Processing Society (SPS) promotes activities within the broad technical field of biomedical image and signal processing. Areas of interest include medical and biological ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2023

Pre-stimulus alpha activity modulates long-lasting unconscious feature integration

Michael Herzog, David Pascucci, Maëlan Quentin Menétrey

Pre-stimulus alpha (α) activity can influence perception of shortly presented, low-contrast stimuli. The underlying mechanisms are often thought to affect perception exactly at the time of presentation. In addition, it is suggested that α cycles determine ...

2023

Hierarchical processing underpins competition in tactile perceptual bistability

Andrea Ferrario

Ambiguous sensory information can lead to spontaneous alternations between perceptual states, recently shown to extend to tactile perception. The authors recently proposed a simplified form of tactile rivalry which evokes two competing percepts for a fixed ...

SPRINGER2023

Tuning perception and decisions to temporal context

David Pascucci

Recent work suggests that serial dependence, where perceptual decisions are biased toward previous stimuli, arises from the prior that sensory input is temporally correlated. However, existing studies have mostly used random stimulus sequences that do not ...

Cell Press2023