Home

Publication

Improving speech embedding using crossmodal transfer learning with audio-visual data

About
Privacy
Disclaimer

Graph Chatbot

Related publications (60)

Page 2 of 3

A comparative analysis of gene expression profiling by statistical and machine learning approaches

Anaïs Betsabeh Haget, Maria Boulougouri

Motivation Many machine learning (ML) models developed to classify phenotype from gene expression data provide interpretations for their decisions, with the aim of understanding biological processes. For many models, including neural networks, interpretati ...

OXFORD UNIV PRESS2025

Learning to Reason with Neural Networks: Principles and Methods

Aryo Lotfi Jandaghi

This thesis focuses on understanding and improving the reasoning capabilities of neural networks. It develops theoretical results and empirical analyses to uncover reasoning potential and limitations, leveraging these insights to guide the design of improv ...

EPFL2025

Incorporating Projective Geometry into Deep Learning

Michal Jan Tyszkiewicz

In this thesis we explore the applications of projective geometry, a mathematical theory of the relation between 3D scenes and their 2D images, in modern learning-based computer vision systems. This is an interesting research question which contradicts the ...

EPFL2024

Plasma state monitoring and disruption characterization using multimodal VAEs

Giulio Romanelli, Olivier Sauter, Alessandro Pau, Yoeri Renier Johannes Poels, Cristina Venturini

When a plasma disrupts in a tokamak, significant heat and electromagnetic loads are deposited onto the surrounding device components. These forces scale with plasma current and magnetic field strength, making disruptions one of the key challenges for futur ...

IOP Publishing Ltd2025

Modelleyen: Continual Learning and Planning via Structured Modelling of Environment Dynamics

Boi Faltings, Zeki Doruk Erden

The current machine learning paradigm relies on continuous representations and fixed neural network architectures to approximate environmental structures, leading to challenges with continual learning, internal structure design, and goal-directed behavior ...

Springer Science and Business Media Deutschland GmbH2025

Few-shot Learning for Efficient and Effective Machine Learning Model Adaptation

Arnout Jan J Devos

Machine learning (ML) enables artificial intelligent (AI) agents to learn autonomously from data obtained from their environment to perform tasks. Modern ML systems have proven to be extremely effective, reaching or even exceeding human intelligence. Altho ...

EPFL2024

On the Perspectives of Image-to-Lidar Constraints in Dynamic Network Optimisation

Thibaut Stoltz, Jan Skaloud, Davide Antonio Cucci, Laurent Valentin Jospin, Kyriaki Mouzakidou

The evolution of airborne mapping witnesses the introduction of hybrid lidar-camera systems to enhance data collection, i.e. to obtain simultaneously high-density point-cloud and texture. Yet, the common adjustment of both optical data streams is a nontriv ...

International Society for Photogrammetry and Remote Sensing2025

Multi-temporal forest monitoring in the Swiss Alps with knowledge-guided deep learning

Devis Tuia, Marc Conrad Russwurm, Thiên-Anh Claris Nguyen, Gaston Jean Lenczner

Monitoring forests, in particular their response to climate and land use change, requires studying long time scales. While efficient deep learning methods have been developed to process short time series of satellite imagery, leveraging long time series of ...

Elsevier Science Inc2024

Generalization and Personalization of Machine Learning for Multimodal Mobile Sensing in Everyday Life

Lakmal Buddika Meegahapola

A range of behavioral and contextual factors, including eating and drinking behavior, mood, social context, and other daily activities, can significantly impact an individual's quality of life and overall well-being. Therefore, inferring everyday life aspe ...

EPFL2024

Self-driving microscopy detects the onset of protein aggregation and enables intelligent Brillouin imaging

Camille Valentine Cathala, Hilal Lashuel, Aleksandra Radenovic, Lely Feletti, Khalid Ashraf Mohie Ibrahim

The process of protein aggregation, central to neurodegenerative diseases like Huntington’s, is challenging to study due to its unpredictable nature and relatively rapid kinetics. Understanding its biomechanics is crucial for unraveling its role in disease ...

Springer Science and Business Media LLC2025

Segmenting Object Affordances: Reproducibility and Sensitivity to Scale

Andrea Cavallaro

Visual affordance segmentation identifies image regions of an object an agent can interact with. Existing methods re-use and adapt learning-based architectures for semantic segmentation to the affordance segmentation task and evaluate on small-size dataset ...

Springer Science and Business Media Deutschland GmbH2025

MaskCLR: Attention-Guided Contrastive Learning for Robust Action Representation Learning

Alexandre Massoud Alahi, Mohamed Ossama Ahmed Abdelfattah, Mariam Ahmed Mahmoud Hegazy Hassan

Current transformer-based skeletal action recognition models tend to focus on a limited set of joints and low-level motion patterns to predict action classes. This results in significant performance degradation under small skeleton perturbations or changin ...

2024

Meta-learning to address diverse Earth observation problems across resolutions

Devis Tuia, Marc Conrad Russwurm, Benjamin Alexander Kellenberger

Earth scientists study a variety of problems with remote sensing data, but they most often consider them in isolation from each other, which limits information flows across disciplines. In this work, we present METEOR, a meta-learning methodology for Earth ...

Springernature2024

Harnessing Increased Client Participation with Cohort-Parallel Federated Learning

Anne-Marie Kermarrec, Rafael Pereira Pires, Marinus Abraham de Vos, Akash Balasaheb Dhasade, Tuan Anh Nguyen

Federated learning (FL) is a machine learning approach where nodes collaboratively train a global model. As more nodes participate in a round of FL, the effectiveness of individual model updates by nodes also diminishes. In this study, we increase the effe ...

ACM2025

SaliencyMix plus : Noise-Minimized Image Mixing Method With Saliency Map in Data Augmentation

Zhixiong Jin

Data augmentation is vital in deep learning for enhancing model robustness by artificially expanding training datasets. However, advanced methods like CutMix blend images and assign labels based on pixel ratios, often introducing label noise by neglecting ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2025

Involvement of prelimbic cortex neurons and related circuits in the acquisition of a cooperative learning by pairs of rats

Maria del Carmen Sandi Perez, Elias Georges Gebara

Social behaviors such as cooperation are crucial for mammals. A deeper knowledge of the neuronal mechanisms underlying cooperation can be beneficial for people suffering from pathologies with impaired social behavior. Our aim was to study the brain activit ...

Springer2024

Cost-Efficiency Trade-offs for Neural Cascade Rankers in Web Search

Ekaterina Trimbach

Web search engines process billions of queries daily, making the balance between computational efficiency and ranking quality crucial. While neural ranking models have shown impressive performance, their computational costs, particularly in feature extract ...

ACM2025

Quartiers rhodaniens en transition

Sara Sonia Formery Regazzoni

Over the course of history, the relationship between cities and their waters has shown different gradients of interweaving, marked by cycles of bonding and distancing. Following a period of complete neglect of urban watercourses, the versatile, multifacete ...

EPFL2024

LIONHEART: A Layer-based Mapping Framework for Heterogeneous Systems with Analog In-Memory Computing Tiles

David Atienza Alonso, Giovanni Ansaloni, Marina Zapater Sancho, Irem Boybat Kara, Flavio Ponzina, Joshua Alexander Harrison Klein, Yuxuan Wang, Abu Sebastian

When arranged in a crossbar configuration, resistive memory devices can be used to execute Matrix-Vector Multiplications (MVMs), the most dominant operation of many Machine Learning (ML) algorithms, in constant time complexity. Nonetheless, when performing ...

Institute of Electrical and Electronics Engineers (IEEE)2025

Learning Informative Health Indicators Through Unsupervised Contrastive Learning

Olga Fink

Monitoring the health of complex industrial assets is crucial for safe and efficient operations. Health indicators that provide quantitative real-time insights into the health status of industrial assets over time serve as valuable tools for, e.g., fault d ...

Ieee-Inst Electrical Electronics Engineers Inc2024