Publications related to Learning computationally efficient static word and sentence representations

Related publications (52)

Unsupervised Rhythm and Voice Conversion of Dysarthric to Healthy Speech for ASR

Automatic speech recognition (ASR) systems are well known to perform poorly on dysarthric speech. Previous works have addressed this by speaking rate modification to reduce the mismatch with typical speech. Unfortunately, these approaches rely on transcrib ...

Institute of Electrical and Electronics Engineers Inc.2025

Infusing structured knowledge priors in neural models for sample-efficient symbolic reasoning

Mattia Atzeni

The ability to reason, plan and solve highly abstract problems is a hallmark of human intelligence. Recent advancements in artificial intelligence, propelled by deep neural networks, have revolutionized disciplines like computer vision and natural language ...

EPFL2024

XLSR-Transducer: Streaming ASR for Self-Supervised Pretrained Models

Juan Pablo Zuluaga Gomez

Self-supervised pretrained models exhibit competitive performance in automatic speech recognition (ASR) on finetuning, even with limited in-domain supervised data. However, popular pretrained models are not suitable for streaming ASR because they are train ...

Institute of Electrical and Electronics Engineers2025

Social-Transmotion: Promptable Human Trajectory Prediction

Alexandre Massoud Alahi, Saeed Saadatnejad, Yang Gao, Kaouther Messaoud Ben Amor

Accurate human trajectory prediction is crucial for applications such as autonomous vehicles, robotics, and surveillance systems. Yet, existing models often fail to fully leverage the non-verbal social cues human subconsciously communicate when navigating ...

2024

Retrieval of Surface Solar Radiation through Implicit Albedo Recovery from Temporal Context

Michael Lehning, Devis Tuia, Yael Frischholz

To retrieve Surface Solar Radiation (SSR) from satellite images, a baseline reflectance of the observed ground in clear-sky conditions, also called background reflectance, is necessary to distinguish atmospheric absorption and scattering effects from surfa ...

2025

Advancing Self-Supervised Deep Learning for 3D Scene Understanding

Seyed Mohammad Mahdi Johari

Recent advancements in deep learning have revolutionized 3D computer vision, enabling the extraction of intricate 3D information from 2D images and video sequences. This thesis explores the application of deep learning in three crucial challenges of 3D com ...

EPFL2024

On the added value of sequential deep learning for the upscaling of evapotranspiration

Devis Tuia

Estimating ecosystem-atmosphere fluxes such as evapotranspiration (ET) in a robust manner and at a global scale remains a challenge. Methods based on machine learning (ML) have shown promising results in achieving such upscaling, providing a complementary ...

2025

Student Answer Forecasting: Transformer-Driven Answer Choice Prediction for Language Learning

Tommaso Martorella, Elena Grazia Gado, Tanja Christina Käser Jacober, Paola Mejia Domenzain, Vinitra Swamy, Jibril Albachir Frej

Intelligent Tutoring Systems (ITS) enhance personalized learning by predicting student answers to provide immediate and customized instruction. However, recent research has primarily focused on the correctness of the answer rather than the student's perfor ...

2024

Machine learning-enabled estimation of cardiac output from peripheral waveforms is independent of blood pressure measurement location in an in silico population

Ramin Mohammadi, Nikolaos Stergiopoulos, Georgios Rovas, Lydia Aslanidou, Sokratis Anagnostopoulos

Monitoring of cardiac output (CO) is a mainstay of hemodynamic management in the acutely or critically ill patient. Invasive determination of CO using thermodilution, albeit regarded as the gold standard, is cumbersome and bears risks inherent to catheteri ...

2025

Driving and suppressing the human language network using large language models

Martin Schrimpf

Transformer models such as GPT generate human-like language and are predictive of human brain responses to language. Here, using functional-MRI-measured brain responses to 1,000 diverse sentences, we first show that a GPT-based encoding model can predict t ...

Nature Portfolio2024

MetaCap: Meta-learning Priors from Multi-view Imagery for Sparse-View Human Performance Capture and Rendering

Pascal Fua

Faithful human performance capture and free-view rendering from sparse RGB observations is a long-standing problem in Vision and Graphics. The main challenges are the lack of observations and the inherent ambiguities of the setting, e.g. occlusions and dep ...

Springer Science and Business Media Deutschland GmbH2025

Resource-Efficient Continual Learning for Personalized Online Seizure Detection

Amirhossein Shahbazinia, David Atienza Alonso, Giovanni Ansaloni, Flavio Ponzina, José Angel Miranda Calero, Jonathan Dan

Epilepsy, a major neurological disease, requires careful diagnosis and treatment. However, the detection of epileptic seizures remains a significant challenge. Current clinical practice relies on expert analysis of EEG signals, a process that is time-consu ...

IEEE2024

Collaborative AI Agents in the Era of Large Language Models

Martin Josifoski

Developing agents that can reliably act on our behalf is central to artificial intelligence (AI). These agents must seamlessly interact with tools, like search engines and databases, and collaborate. In this thesis, we study the abstractions, methods, and ...

EPFL2025

The multimodality cell segmentation challenge: toward universal solutions

Maxime Emmanuel Scheder, Jun Ma, Sahand Jamal Rahi, Xin Yang, Vojislav Gligorovski, Marco Labagnara

Cell segmentation is a critical step for quantitative single-cell analysis in microscopy images. Existing cell segmentation methods are often tailored to specific modalities or require manual interventions to specify hyper-parameters in different experimen ...

Nature Publishing Group2024

Enhancing skin lesion classification: a CNN approach with human baseline comparison

Zaffar Ahmed Shaikh

This study presents an augmented hybrid approach for improving the diagnosis of malignant skin lesions by combining convolutional neural network (CNN) predictions with selective human interventions based on prediction confidence. The algorithm retains high ...

PeerJ2025

Generalization and Personalization of Machine Learning for Multimodal Mobile Sensing in Everyday Life

Lakmal Buddika Meegahapola

A range of behavioral and contextual factors, including eating and drinking behavior, mood, social context, and other daily activities, can significantly impact an individual's quality of life and overall well-being. Therefore, inferring everyday life aspe ...

EPFL2024

Automated Generation of Emotion-Conveying Sounds for Robots

Alaa Abboud

Sonic Human-Robot Interaction aims at equipping robots with the ability to convey emotions and intentions via sounds. Such sounds are typically handcrafted by human experts, which results in expensive, small sound sets with limited expressivity. To overcom ...

IEEE2025

Network time series forecasting in photovoltaics power production

Jelena Simeunovic

Accurate forecasting of photovoltaic (PV) power production is crucial for the integration of more renewable energy sources into the power grid. PV power production is highly intermittent, due to the stochastic cloud behaviour and cloud dynamics. Previous w ...

EPFL2024

A Study on Quantum Graph Neural Networks Applied to Molecular Physics

Su Yeon Chang

This paper introduces a novel architecture for Quantum Graph Neural Networks, which is significantly different from previous approaches found in the literature. The proposed approach produces similar outcomes with respect to previous models but with fewer ...

IOP Publishing Ltd2025

Land Cover Mapping From Multiple Complementary Experts Under Heavy Class Imbalance

Devis Tuia, Valérie Zermatten, Javiera Francisca Castillo Navarro

Deep learning has emerged as a promising avenue for automatic mapping, demonstrating high efficacy in land cover categorization through various semantic segmentation models. Nonetheless, the practical deployment of these models encounters important challen ...

Ieee-Inst Electrical Electronics Engineers Inc2024