Bootstrapping Language-Audio Pre-training for Music Captioning

Chat with Graph Search

Ask any question about EPFL courses, lectures, exercises, research, news, etc. or try the example questions below.

DISCLAIMER: The Graph Chatbot is not programmed to provide explicit or categorical answers to your questions. Rather, it transforms your questions into API requests that are distributed across the various IT services officially administered by EPFL. Its purpose is solely to collect and recommend relevant references to content that you can explore to help you answer your questions.

Training data mixtures greatly impact the generalization performance of large language models. Existing domain reweighting methods often rely on costly weight computations and require retraining when new data is introduced. To this end, we introduce a flex ...

Large language models (LLMs) are transforming research in psychology and the behavioral sciences by enabling advanced text analysis at scale. Their applications range from the analysis of social media posts to infer psychological traits to the automated sc ...

Recent progress in computer vision has been driven by a simple yet transformative observation: the potential of 30-year-old neural networks can be unlocked by massively scaling their parameters and the amount of human-labeled training data. This breakthrou ...

Deep learning has shown remarkable potential for industrial applications, particularly in predictive maintenance and condition monitoring. A key challenge in this domain is prognostics, specifically predicting the Remaining Useful Life (RUL) of assets - a ...

Marmoset monkeys encode vital information in their calls and serve as a surrogate model for neuro-biologists to understand the evolutionary origins of human vocal communication. Traditionally analyzed with signal processing-based features, recent approache ...

Machine learning has transformed many fields and has recently found applications in chemistry and materials science. The small datasets commonly found in chemistry sparked the development of sophisticated machine learning approaches that incorporate chemic ...

Crafting an appealing heading is crucial for attracting readers and marketing work or products. A popular way is to summarize the main idea with a refined description and a memorable acronym. However, there lacks a systematic study and a formal benchmark i ...

Generative artificial intelligence (AI) has made unprecedented advances in vision language models over the past two years. These advances are largely due to diffusion-based generative models, which are very stable and simple to train. These diffusion model ...

For our fifth anniversary, we reconnected with authors of recent Comments and Perspectives in Nature Machine Intelligence and asked them how the topic they wrote about developed. We also wanted to know what other topics in AI they found exciting, surprisin ...

Chat Generative Pre-trained Transformer (ChatGPT) is currently a trending topic worldwide triggering extensive debate about its predictive power, its potential uses, and its wider implications. Recent publications have demonstrated that ChatGPT can correct ...

Smart thermostats are increasingly popular in homes and buildings as they improve occupant comfort, lower energy use in heating and cooling systems, and reduce utility bills by automatically adjusting room temperature according to measurements of their bui ...

Recent approaches to drape garments quickly over arbitrary human bodies leverage self-supervision to eliminate the need for large training sets. However, they are designed to train one network per clothing item, which severely limits their generalization a ...

We propose a pre-training strategy called Multi-modal Multi-task Masked Autoencoders (MultiMAE). It differs from standard Masked Autoencoding in two key aspects: I) it can optionally accept additional modalities of information in the input besides the RGB ...

Bootstrapping Language-Audio Pre-training for Music Captioning

Chat with Graph Search

CHAMELEON: A Flexible Data-mixing Framework for Language Model Pretraining and Finetuning

From Embeddings to Explainability: A Tutorial on Large-Language-Model-Based Text Analysis for Behavioral Scientists

Exploiting Representation Similarities in Self-Supervised Learning for Vision Tasks

Overcoming Distribution Shifts and Imbalance Challenges in Representation Learning for Deep Regression Models

On the Utility of Speech and Audio Foundation Models for Marmoset Call Analysis

Leveraging large language models for predictive chemistry

Unveiling the Art of Heading Design: A Harmonious Blend of Summarization, Neology, and Algorithm

MCMC: Bridging Rendering, Optimization and Generative AI

Anniversary AI reflections

ChatGPT takes on the European Exam in Core Cardiology: an artificial intelligence success story?

Efficacy of temporal and spatial abstraction for training accurate machine learning models: A case study in smart thermostats

DrapeNet: Garment Generation and Self-Supervised Draping

MultiMAE: Multi-modal Multi-task Masked Autoencoders