Concept

Activity recognition

Publications associées (29)

Aggregating Spatial and Photometric Context for Photometric Stereo

Photometric stereo, a computer vision technique for estimating the 3D shape of objects through images captured under varying illumination conditions, has been a topic of research for nearly four decades. In its general formulation, photometric stereo is an ...

EPFL2024

Multi-temporal forest monitoring in the Swiss Alps with knowledge-guided deep learning

Devis Tuia, Marc Conrad Russwurm, Thiên-Anh Claris Nguyen, Gaston Jean Lenczner

Monitoring forests, in particular their response to climate and land use change, requires studying long time scales. While efficient deep learning methods have been developed to process short time series of satellite imagery, leveraging long time series of ...

Elsevier Science Inc2024

Complex Daily Activities, Country-Level Diversity, and Smartphone Sensing: A Study in Denmark, Italy, Mongolia, Paraguay, and UK

Daniel Gatica-Perez, Lakmal Buddika Meegahapola

Smartphones enable understanding human behavior with activity recognition to support peoples daily lives. Prior studies focused on using inertial sensors to detect simple activities (sitting, walking, running, etc.) and were mostly conducted in homogeneous ...

Assoc Computing Machinery2023

Detecting Anomalies and Obstacles in Road Scenes

Krzysztof Maciej Lis

We address the problem of segmenting anomalies and unusual obstacles in road scenes for the purpose of self-driving safety. The objects in question are not present in the common training sets as it is not feasible to collect and annotate examples for every ...

EPFL2023

Contrasting action and posture coding with hierarchical deep neural network models of proprioception

Alexander Mathis, Mackenzie Mathis, Matthias Bethge, Kai Jappe Sandbrink

Biological motor control is versatile, efficient, and depends on proprioceptive feedback. Muscles are flexible and undergo continuous changes, requiring distributed adaptive control mechanisms that continuously account for the body's state. The canonical r ...

eLIFE SCIENCES PUBL LTD2023

Region Extraction in Mesh Intersection

Annalisa Buffa, Pablo Antolin Sanchez, Emiliano Cirillo

Region extraction is a very common task in both Computer Science and Engineering with several applications in object recognition and motion analysis, among others. Most of the literature focuses on regions delimited by straight lines, often in the special ...

2023

BLACK-BOX ATTACKS ON IMAGE ACTIVITY PREDICTION AND ITS NATURAL LANGUAGE EXPLANATIONS

Andrea Cavallaro

Explainable AI (XAI) methods aim to describe the decision process of deep neural networks. Early XAI methods produced visual explanations, whereas more recent techniques generate multimodal explanations that include textual information and visual represent ...

Ieee Computer Soc2023

Rigidity-Aware Detection for 6D Object Pose Estimation

Mathieu Salzmann, Yinlin Hu

Most recent 6D object pose estimation methods first use object detection to obtain 2D bounding boxes before actually regressing the pose. However, the general object detection methods they use are ill-suited to handle cluttered scenes, thus producing poor ...

Ieee Computer Soc2023

Regularization of polynomial networks for image recognition

Volkan Cevher, Grigorios Chrysos, Bohan Wang

Deep Neural Networks (DNNs) have obtained impressive performance across tasks, however they still remain as black boxes, e.g., hard to theoretically analyze. At the same time, Polynomial Networks (PNs) have emerged as an alternative method with a promising ...

2023

Regularization of polynomial networks for image recognition

Volkan Cevher, Grigorios Chrysos, Bohan Wang

Ieee Computer Soc2023

Revisiting Evaluation Metrics for Semantic Segmentation: Optimization and Evaluation of Fine-grained Intersection over Union

Devis Tuia

Semantic segmentation datasets often exhibit two types of imbalance: \textit{class imbalance}, where some classes appear more frequently than others and \textit{size imbalance}, where some objects occupy more pixels than others. This causes traditional eva ...

2023

Recognizing distant faces

Lukas Vogelsang

As an 'early alerting' sense, one of the primary tasks for the human visual system is to recognize distant objects. In the specific context of facial identification, this ecologically important task has received surprisingly little attention. Most studies ...

PERGAMON-ELSEVIER SCIENCE LTD2023

The role of the visual field size in artificial vision

Diego Ghezzi

Objective. Artificial vision has been and still is the subject of intense research. The ultimate goal is to help blind people in their daily life. Approaches to artificial vision, including visual prostheses and optogenetics, have strongly focused on resto ...

IOP Publishing Ltd2023

Automated Human Motion Analysis and Synthesis

Sena Kiciroglu

Human motion analysis and synthesis is integral to many computer vision applications, from autonomous driving to sports analysis. In this thesis, we address several problems in this domain. First we consider active viewpoint selection for pose estimation w ...

EPFL2023

Explanation of Face Recognition via Saliency Maps

Touradj Ebrahimi, Yuhang Lu

Despite the significant progress in recent years, deep face recognition is often treated as a "black box" and has been criticized for lacking explainability. It becomes increasingly important to understand the characteristics and decisions of deep face rec ...

2023

Evaluation of the impact of lossy compression on event camera-based computer vision tasks

Touradj Ebrahimi, Davi Nachtigall Lazzarotto, Bowen Huang

In the field of image acquisition, Dynamic Vision Sensors (DVS) present an innovative methodology, capturing only the variations in pixel brightness instead of absolute values and thereby revealing unique features. Given that the primary deployment of DVS ...

2023

Gait Phase Estimation in Steady Walking: A Comparative Study of Methods Based on the Phase Portrait of the Hip Angle

Auke Ijspeert, Mohamed Bouri, Ali Reza Manzoori

Accurate real-time estimation of the gait phase (GP) is crucial for many control methods in exoskeletons and prostheses. A class of approaches to GP estimation construct the phase portrait of a segment or joint angle, and use the normalized polar angle of ...

IEEE Xplore2023

Spatial-Temporal Graph Attention Fuser for Calibration in IoT Air Pollution Monitoring Systems

Olga Fink, Mengjie Zhao, Keivan Faghih Niresi

The use of Internet of Things (IoT) sensors for air pollution monitoring has significantly increased, resulting in the deployment of low-cost sensors. Despite this advancement, accurately calibrating these sensors in uncontrolled environmental conditions r ...

Institute of Electrical and Electronics Engineers2023

Encoder-Decoder Models for Human Segmentation and Motion Analysis

Isinsu Katircioglu

Detecting people from 2D images and analyzing their motion in 3D have been long standing computer vision problems central to numerous applications such as autonomous driving and athletic training. Recently, with the availability of large amounts of trainin ...

EPFL2022

Sound and Complete Verification of Polynomial Networks

Volkan Cevher, Grigorios Chrysos, Fanghui Liu, Elias Abad Rocamora, Mehmet Fatih Sahin

Polynomial Networks (PNs) have demonstrated promising performance on face and image recognition recently. However, robustness of PNs is unclear and thus obtaining certificates becomes imperative for enabling their adoption in real-world applications. Exist ...

2022