Publications related to From Pose to Behavior: Advancing Multi-Individual Pose Estimation and Hierarchical Action Segmentation with Transformers

Related publications (22)

EntitySAM: Segment Everything in Video

Automatically tracking and segmenting every video entity remains a significant challenge. Despite rapid advancements in video segmentation, even state-of-the-art models like SAM 2 struggle to consistently track all entities across a video—a task we refer t ...

IEEE2025

Explainable AI guided unsupervised fault diagnostics for high-voltage circuit breakers

Olga Fink, Gaëtan Michel Frusque, Florent Evariste Forest

Commercial high-voltage circuit breaker (CB) condition monitoring systems rely on directly observable physical parameters such as gas filling pressure with pre-defined thresholds. While these parameters are crucial, they only cover a small subset of malfun ...

2025

Fully data-driven and modular building thermal control with physically consistent modeling

Benjamin Bejar Haro, Carl Pierre Jacques Remlinger

Machine learning has experienced significant growth in the smart building sector, whether for building modeling or energy management. Data-driven approaches leverage available measurements to bypass the slow and costly calibration of physics-based models, ...

2025

Machine learning enhanced tomographic reconstruction for multispectral imaging on TCV

Basil Duval, Artur Perek

A multispectral camera setup is used to infer a 2D map of plasma parameters in a tokamak from spectral emissions. However, the light measured by these cameras is line integrated in the toroidal direction, whereas emissivities on the poloidal plane are nece ...

2025

Rapid prediction of phonon density of states by crystal attention graph neural network and high-throughput screening of candidate substrates for wide bandgap electronic cooling

Changpeng Lin

Machine learning has demonstrated superior performance in predicting vast materials properties. However, predicting a spectral-like continuous material property such as phonon density of states (DOS) is more challenging for machine learning. In this work, ...

2025

ChemLit-QA: a human evaluated dataset for chemistry RAG tasks

Marta Anna Brucka, Anna Kelmanson, Magdalena Lederbauer, Matthew Ryan Hart, Huixuan Guo, Philippe Schwaller, Geemi Piyathma Wellawatte

Retrieval-Augmented Generation (RAG) is a widely used strategy in Large-Language Models (LLMs) to extrapolate beyond the inherent pre-trained knowledge. Hence, RAG is crucial when working in data-sparse fields such as Chemistry. The evaluation of RAG syste ...

IOP Publishing Ltd2025

NNG-Mix: Improving Semi-Supervised Anomaly Detection with Pseudo-Anomaly Generation

Olga Fink, Gaëtan Michel Frusque

Anomaly detection (AD) is essential in identifying rare and often critical events in complex systems, finding applications in fields such as network intrusion detection, financial fraud detection, and fault detection in infrastructure and industrial system ...

2024

Structure-based drug design with equivariant diffusion models

Bruno Emanuel Ferreira De Sousa Correia, Arne Schneuing, Ilia Igashov

Structure-based drug design (SBDD) aims to design small-molecule ligands that bind with high affinity and specificity to pre-determined protein targets. Generative SBDD methods leverage structural data of drugs with their protein targets to propose new dru ...

SPRINGERNATURE2024

Native learning ability and not age determines the effects of brain stimulation

Friedhelm Christoph Hummel, Traian Popa, Pablo Maceira Elvira, Andéol Geoffroy Cadic-Melchior, Anne-Christine Schmid

Healthy aging often entails a decline in cognitive and motor functions, affecting independence and quality of life in older adults. Brain stimulation shows potential to enhance these functions, but studies show variable effects. Previous studies have tried ...

2024

Dynamic Object Catching with Quadruped Robot Front Legs

Auke Ijspeert, Guillaume Denis Antoine Bellegarda

This paper presents a framework for dynamic object catching using a quadruped robot's front legs while it stands on its rear legs. The system integrates computer vision, trajectory prediction, and leg control to enable the quadruped to visually detect, tra ...

Institute of Electrical and Electronics Engineers Inc.2024

Prediction of mycotoxin response of DNA-wrapped nanotube sensor with machine learning

Ardemis Anoush Boghossian, Sara Behjati, Sayyed Hashem Sajjadi, Yahya Rabbani

DNA-wrapped single-walled carbon nanotubes (DNA-SWCNTs) have demonstrated great versatility as optical sensors. SWCNTs emit a near-infrared fluorescence that is responsive to the slightest changes in their environment, enabling the creation of sensors that ...

2023

Data analysis techniques for the visualization and classification of historical vehicle engines' health status using data-driven solutions

Alejandro Roda Buch

In the field of cultural heritage, the use of non-destructive techniques to determine the state ofconservation of an artifact is of the utmost importance, to avoid damage to the object itself. In this paper, we present a data pipeline and several machine l ...

ASSOC PROFISSIONAL CONSERVADORES-RESTAURADORES PORTUGAL2023

Hardware-Software Co-design for Improved Resource Utilization in DNN Accelerators

Ahmet Caner Yüzügüler

Deep neural networks (DNN) have become an essential tool to tackle challenging tasks in many fields of computer science. However, their high computational complexity limits their applicability. Specialized DNN accelerators have been developed to accommodat ...

EPFL2023

Methodology for selecting measurement points that optimize information gain for model updating

Ian Smith, Numa Joy Bertola

Information collected through sensor measurements has the potential to improve knowledge of complex-system behavior, leading to better decisions related to system management. In this situation, and particularly when using digital twins, the quality of sens ...

2023

Exploring quantum perceptron and quantum neural network structures with a teacher-student scheme

Patrick Hümbeli

Near-term quantum devices can be used to build quantum machine learning models, such as quantum kernel methods and quantum neural networks (QNN), to perform classification tasks. There have been many proposals on how to use variational quantum circuits as ...

2022

Machine Learning Models for Mycobacterium tuberculosis In Vitro Activity: Prediction and Target Visualization

Anthony Vocat

Tuberculosis (TB) is a major global health challenge, with approximately 1.4 million deaths per year. There is still a need to develop novel treatments for patients infected with Mycobacterium tuberculosis (Mtb). There have been many large-scale phenotypic ...

AMER CHEMICAL SOC2022

Reviewing the application of machine learning methods to model urban form indicators in planning decision support systems : potential, issues and challenges

Jérôme Chenal, Rémi Jaligot

Modern cities dynamically face several challenges including digitalization, sustainability, resilience and economic development. Urban planners and designers must develop urban forms that address these challenges. With the integration of new communication ...

2022

Multi-agent maintenance scheduling of generation unit in electricity market using safe deep reinforcement learning algorithm

Olga Fink

Improving maintenance scheduling of generation units in an electricity market would increase the safety and reliability of the system. This problem can be modeled as a multi-agent bi-level decision-making problem associated with some safety constraints. In ...

2022

OptTTA: Learnable Test-Time Augmentation for Source-Free Medical Image Segmentation Under Domain Shift

Jean-Philippe Thiran, Seyedbehzad Bozorgtabar, Guillaume Marc Georges Vray, Devavrat Tomar

As distribution shifts are inescapable in realistic clinical scenarios due to inconsistencies in imaging protocols, scanner vendors, and across different centers, well-trained deep models incur a domain generalization problem in unseen environments. Despit ...

PMLR2022

Pedestrian Stop and Go Forecasting with Hybrid Feature Fusion

Alexandre Massoud Alahi, Taylor Ferdinand Mordan

Forecasting pedestrians' future motions is essential for autonomous driving systems to safely navigate in urban areas. However, existing prediction algorithms often overly rely on past observed trajectories and tend to fail around abrupt dynamic changes, s ...

2022