On the Utility of Speech and Audio Foundation Models for Marmoset Call Analysis

Chat with Graph Search

Ask any question about EPFL courses, lectures, exercises, research, news, etc. or try the example questions below.

DISCLAIMER: The Graph Chatbot is not programmed to provide explicit or categorical answers to your questions. Rather, it transforms your questions into API requests that are distributed across the various IT services officially administered by EPFL. Its purpose is solely to collect and recommend relevant references to content that you can explore to help you answer your questions.

Recent progress in computer vision has been driven by a simple yet transformative observation: the potential of 30-year-old neural networks can be unlocked by massively scaling their parameters and the amount of human-labeled training data. This breakthrou ...

Deep learning has shown remarkable potential for industrial applications, particularly in predictive maintenance and condition monitoring. A key challenge in this domain is prognostics, specifically predicting the Remaining Useful Life (RUL) of assets - a ...

Low-light photography produces images with low signal-to-noise ratios due to limited photons. In such conditions, common approximations like the Gaussian noise model fall short, and many denoising techniques fail to remove noise effectively. Although deep- ...

We introduce BLAP, a model capable of generating high-quality captions for music. BLAP leverages a fine-tuned CLAP audio encoder and a pre-trained Flan-T5 large language model. To achieve effective cross-modal alignment between music and language, BLAP uti ...

Training data mixtures greatly impact the generalization performance of large language models. Existing domain reweighting methods often rely on costly weight computations and require retraining when new data is introduced. To this end, we introduce a flex ...

Semi-supervised semantic segmentation methods leverage unlabeled data by pseudo-labeling them. Thus the success of these methods hinges on the reliability of the pseudo-labels. Existing methods mostly choose high-confidence pixels in an effort to avoid err ...

This thesis focuses on understanding and improving the reasoning capabilities of neural networks. It develops theoretical results and empirical analyses to uncover reasoning potential and limitations, leveraging these insights to guide the design of improv ...

Data augmentation is vital in deep learning for enhancing model robustness by artificially expanding training datasets. However, advanced methods like CutMix blend images and assign labels based on pixel ratios, often introducing label noise by neglecting ...

The current machine learning paradigm relies on continuous representations and fixed neural network architectures to approximate environmental structures, leading to challenges with continual learning, internal structure design, and goal-directed behavior ...

Proteins are the molecular machines of life, driving essential biological processes such as enzymatic catalysis, cellular signaling, and immune responses. The ability to design entirely new proteins with desired structures and functions has immense implica ...

Motivation Many machine learning (ML) models developed to classify phenotype from gene expression data provide interpretations for their decisions, with the aim of understanding biological processes. For many models, including neural networks, interpretati ...

Machine learning models (e.g., neural networks) achieve high accuracy in wind power forecasting, but they are usually regarded as black boxes that lack interpretability. To address this issue, the paper proposes a glass-box model that combines high accurac ...

When arranged in a crossbar configuration, resistive memory devices can be used to execute Matrix-Vector Multiplications (MVMs), the most dominant operation of many Machine Learning (ML) algorithms, in constant time complexity. Nonetheless, when performing ...

Cyclic peptides are attractive for drug discovery due to their excellent binding properties and the potential to cross cell membranes. However, by far not all cyclic peptides are cell permeable, and measuring or predicting their membrane permeability is no ...

Visual affordance segmentation identifies image regions of an object an agent can interact with. Existing methods re-use and adapt learning-based architectures for semantic segmentation to the affordance segmentation task and evaluate on small-size dataset ...

Large language models (LLMs) are transforming research in psychology and the behavioral sciences by enabling advanced text analysis at scale. Their applications range from the analysis of social media posts to infer psychological traits to the automated sc ...

Foundation models have become a powerful tool in single-cell transcriptomics, enabling broad generalization across tasks such as cell type annotation, data integration, and drug response prediction. Yet, most current models are trained predominantly on hea ...

Decentralized learning (DL) is an emerging approach that enables nodes to collaboratively train a machine learning model without sharing raw data. In many application domains, such as healthcare, this approach faces challenges due to the high level of hete ...

The evolution of airborne mapping witnesses the introduction of hybrid lidar-camera systems to enhance data collection, i.e. to obtain simultaneously high-density point-cloud and texture. Yet, the common adjustment of both optical data streams is a nontriv ...

When a plasma disrupts in a tokamak, significant heat and electromagnetic loads are deposited onto the surrounding device components. These forces scale with plasma current and magnetic field strength, making disruptions one of the key challenges for futur ...

On the Utility of Speech and Audio Foundation Models for Marmoset Call Analysis

Chat with Graph Search

Exploiting Representation Similarities in Self-Supervised Learning for Vision Tasks

Overcoming Distribution Shifts and Imbalance Challenges in Representation Learning for Deep Regression Models

Dark Noise Diffusion: Noise Synthesis for Low-Light Image Denoising

Bootstrapping Language-Audio Pre-training for Music Captioning

CHAMELEON: A Flexible Data-mixing Framework for Language Model Pretraining and Finetuning

Weighting Pseudo-labels via High-Activation Feature Index Similarity and Object Detection for Semi-supervised Segmentation

Learning to Reason with Neural Networks: Principles and Methods

SaliencyMix plus : Noise-Minimized Image Mixing Method With Saliency Map in Data Augmentation

Modelleyen: Continual Learning and Planning via Structured Modelling of Environment Dynamics

Computational design of complex protein folds and soluble analogs of membrane proteins

A comparative analysis of gene expression profiling by statistical and machine learning approaches

Explainable modeling for wind power forecasting: A Glass-Box model with high accuracy

LIONHEART: A Layer-based Mapping Framework for Heterogeneous Systems with Analog In-Memory Computing Tiles

Bulk measurement of membrane permeability for random cyclic peptides in living cells to guide drug development

Segmenting Object Affordances: Reproducibility and Sensitivity to Scale

From Embeddings to Explainability: A Tutorial on Large-Language-Model-Based Text Analysis for Behavioral Scientists

Abstract IA02: Cancer-specific foundation models: Friend or foe in healthcare AI?

Fair Decentralized Learning

On the Perspectives of Image-to-Lidar Constraints in Dynamic Network Optimisation

Plasma state monitoring and disruption characterization using multimodal VAEs