Publication

Self-Supervised Neural Topic Modeling

Publications associées (30)

Sparse Autoencoders for Speech Modeling and Recognition

Speech recognition-based applications upon the advancements in artificial intelligence play an essential role to transform most aspects of modern life. However, speech recognition in real-life conditions (e.g., in the presence of overlapping speech, varyin ...

EPFL2023

Text as a Richer Source of Supervision in Semantic Segmentation Tasks

Devis Tuia, Valérie Zermatten, Lloyd Haydn Hughes, Javiera Francisca Castillo Navarro

This paper introduces TACOSS a text-image alignment approach that allows explainable land cover semantic segmentation by directly integrating semantic concepts encoded from texts. TACOSS combines convolutional neural networks for visual feature extraction ...

The Institute of Electrical and Electronics Engineers, Inc2023

Online interoperable resources for building hippocampal neuron models via the Hippocampus Hub

Felix Schürmann, Armando Romani, Michele Migliore, Luca Leonardo Bologna

To build biophysically detailed models of brain cells, circuits, and regions, a data-driven approach is increasingly being adopted. This helps to obtain a simulated activity that reproduces the experimentally recorded neural dynamics as faithfully as possi ...

2023

Supervised learning and inference of spiking neural networks with temporal coding

Ana Stanojevic

The way biological brains carry out advanced yet extremely energy efficient signal processing remains both fascinating and unintelligible. It is known however that at least some areas of the brain perform fast and low-cost processing relying only on a smal ...

EPFL2023

NMDA-driven dendritic modulation enables multitask representation learning in hierarchical sensory processing pathways

Walter Senn, Willem Anna Mark Wybo, Matthias Chinyen Tsai, Bernd Albert Illing

While sensory representations in the brain depend on context, it remains unclear how such modulations are implemented at the biophysical level, and how processing layers further in the hierarchy can extract useful features for each possible contex-tual sta ...

National Academy of Sciences2023

Improving Generalization of Pretrained Language Models

Rabeeh Karimi Mahabadi

In this dissertation, we propose multiple methods to improve transfer learning for pretrained language models (PLMs). Broadly, transfer learning is a powerful technique in natural language processing, where a language model is first pre-trained on a data-r ...

EPFL2023

MULTI-TASK CURRICULUM LEARNING FOR PARTIALLY LABELED DATA

Jiancheng Yang, Stanislav Lukyanenko

Incomplete labels are common in multi-task learning for biomedical applications due to several practical difficulties, e.g., expensive annotation efforts by experts, limit of data collection, different sources of data. A naive approach to enable joint lear ...

IEEE2023

Combining biophysical models and machine learning to optimize implant geometry and stimulation protocol for intraneural electrodes

Silvestro Micera, Simone Romeni, Elena Losanno, Luca Pierantoni

Objective. Peripheral nerve interfaces have the potential to restore sensory, motor, and visceral functions. In particular, intraneural interfaces allow targeting deep neural structures with high selectivity, even if their performance strongly depends upon ...

IOP Publishing Ltd2023

Self-Supervised Learning for Patient Stratification and Survival Analysis in Computational Pathology: An Application to Colorectal Cancer

Christian Robert Abbet

Over the years, clinical institutes accumulated large amounts of digital slides from resected tissue specimens. These digital images, called whole slide images (WSIs), are high-resolution tissue snapshots that depict the complex interaction of cells at the ...

EPFL2023

From event-based surprise to lifelong learning. A journey in the timescales of adaptation

Martin Louis Lucien Rémy Barry

Humans and animals constantly adapt to their environment over the course of their life. This thesis seeks to integrate various timescales of adaptation, ranging from the adaptation of synaptic connections between spiking neurons (milliseconds), rapid behav ...

EPFL2023