Publications associées à Multi-animal pose estimation, identification and tracking with DeepLabCut

Aggregating Spatial and Photometric Context for Photometric Stereo

Photometric stereo, a computer vision technique for estimating the 3D shape of objects through images captured under varying illumination conditions, has been a topic of research for nearly four decades. In its general formulation, photometric stereo is an ...

EPFL2024

Predicting the long-term collective behaviour of fish pairs with deep learning

Francesco Mondada, Alexandre Massoud Alahi, Vaios Papaspyros

Modern computing has enhanced our understanding of how social interactions shape collective behaviour in animal societies. Although analytical models dominate in studying collective behaviour, this study introduces a deep learning model to assess social in ...

2024

Involvement of prelimbic cortex neurons and related circuits in the acquisition of a cooperative learning by pairs of rats

Maria del Carmen Sandi Perez, Elias Georges Gebara, Ana del Rocio Conde Moro

Social behaviors such as cooperation are crucial for mammals. A deeper knowledge of the neuronal mechanisms underlying cooperation can be beneficial for people suffering from pathologies with impaired social behavior. Our aim was to study the brain activit ...

Springer2024

Cross-resolution Face Recognition via Identity-Preserving Network and Knowledge Distillation

Touradj Ebrahimi, Yuhang Lu

Cross-resolution face recognition has become a challenging problem for modern deep face recognition systems. It aims at matching a low-resolution probe image with high-resolution gallery images registered in a database. Existing methods mainly leverage pri ...

2023

4M: Massively Multimodal Masked Modeling

Amir Roshan Zamir, Roman Christian Bachmann, Shuqing Teresa Yeo, David Mizrahi, Oguzhan Fatih Kar

Current machine learning models for vision are often highly specialized and limited to a single modality and task. In contrast, recent large language models exhibit a wide range of capabilities, hinting at a possibility for similarly versatile models in co ...

Neural Information Processing Systems (Nips)2023

Toward responsible face datasets: modeling the distribution of a disentangled latent space for sampling face images from demographic groups

Sébastien Marcel, Christophe René Joseph Ecabert, Parsa Rahimi Noshanagh

Recently, it has been exposed that some modern facial recognition systems could discriminate specific demographic groups and may lead to unfair attention with respect to various facial attributes such as gender and origin. The main reason are the biases in ...

IEEE2023

3D reconstruction of curvilinear one-dimensional objects viewed in transmission electron microscopy

Gulnaz Ganeeva

To obtain a more complete understanding of material microstructure at the nanoscale and to gain profound insights into their properties, there is a growing need for more efficient and precise methods that can streamline the process of 3D imaging using a tr ...

EPFL2023

A biohybrid interaction framework for the integration of robots in animal societies

Francesco Mondada, Daniel Burnier, Vaios Papaspyros, Raphael Cherfan

The collective behavior of animals has been traditionally studied through observation, quantitative models of behavior, and devices of low intelligence. Nowadays, the advancements in the field of robotics allow for closed-loop experiments that occur in rea ...

2023

Beyond undulation! Body morphology and sensing components of elongated animals and robots reveal skills to maintain competent locomotion

Laura Isabel Paez Coy

Locomotion is an essential evolutive innovation of living beings that allows them to colonize and dominate the planet. As diverse as animal morphologies are (living) and were (extinct), their locomotion modalities are also diverse. In particular, animal mo ...

EPFL2023

Improving the Training of Compact Neural Networks for Visual Recognition

Shuxuan Guo

During the Artificial Intelligence (AI) revolution of the past decades, deep neural networks have been widely used and have achieved tremendous success in visual recognition. Unfortunately, deploying deep models is challenging because of their huge model s ...

EPFL2022

Using Animal Motion Capture to Learn Neural Representations

Semih Günel

Understanding behavior from neural activity is a fundamental goal in neuroscience. It has practical applications in building robust brain-machine interfaces, human-computer interaction, and assisting patients with neurological disabilities. Despite the eve ...

EPFL2022

Learning Disentangled Behaviour Patterns for Wearable-based Human Activity Recognition

Tao Lin

In wearable-based human activity recognition (HAR) research, one of the major challenges is the large intra-class variability problem. The collected activity signal is often, if not always, coupled with noises or bias caused by personal, environmental, or ...

ASSOC COMPUTING MACHINERY2022

Natural-Looking Adversarial Examples From Freehand Sketches

Davide Nanni, Hakgu Kim

Deep neural networks (DNNs) have achieved great success in image classification and recognition compared to previous methods. However, recent works have reported that DNNs are very vulnerable to adversarial examples that are intentionally generated to misl ...

IEEE2022

A Novel Framework for Assessment of Deep Face Recognition Systems in Realistic Conditions

Touradj Ebrahimi, Luca Barras, Yuhang Lu

Deep convolutional neural networks have shown remarkable results on face recognition (FR). Despite their significant progress, the performance of current face recognition techniques is often assessed in benchmarks under not always realistic conditions. The ...

2022

Differentiable Patch Selection for Image Recognition

Aravindh Mahendran, Jean-Baptiste Francis Marie Juliette Cordonnier

Neural Networks require large amounts of memory and compute to process high resolution images, even when only a small part of the image is actually informative for the task at hand. We propose a method based on a differentiable Top-K operator to select the ...

IEEE COMPUTER SOC2021

Perspectives on Individual Animal Identification from Biology and Computer Vision

Maxime Michel André Vidal, Alexander Mathis

Identifying individual animals is crucial for many biological investigations. In response to some of the limitations of current identification methods, new automated computer vision approaches have emerged with strong performance. Here, we review current a ...

OXFORD UNIV PRESS INC2021

LiftPose3D, a deep learning-based approach for transforming two-dimensional to three-dimensional poses in laboratory animals

Pascal Fua, Pavan P Ramdya, Helge Jochen Rhodin, Semih Günel, Victor Lobato Rios, Daniel Eduardo Morales Garza, Marco Pietro Abrate, Adám Gosztolai

LiftPose3D infers three-dimensional poses from two-dimensional data or from limited three-dimensional data. The approach is illustrated for videos of behaving Drosophila, mice, rats and macaques. ...

NATURE PORTFOLIO2021

Defect segmentation for multi-illumination quality control systems

Pascal Fua, Engin Türetken, Siavash Arjomand Bigdeli, David Honzátko

Thanks to recent advancements in image processing and deep learning techniques, visual surface inspection in production lines has become an automated process as long as all the defects are visible in a single or a few images. However, it is often necessary ...

2021

Vision-based Drone Flocking in Outdoor Environments

Dario Floreano, Fabian Maximilian Schilling, Fabrizio Schiano

Decentralized deployment of drone swarms usually relies on inter-agent communication or visual markers that are mounted on the vehicles to simplify their mutual detection. This letter proposes a vision-based detection and tracking algorithm that enables gr ...

2021

Crowding and the importance of grouping and segmentation processes in human vision

Alban Bornet

Human vision has evolved to make sense of a world in which elements almost never appear in isolation. Surprisingly, the recognition of an element in a visual scene is strongly limited by the presence of other nearby elements, a phenomenon known as visual c ...

EPFL2021