Publications related to Anniversary AI reflections

Related publications (22)

CHAMELEON: A Flexible Data-mixing Framework for Language Model Pretraining and Finetuning

Training data mixtures greatly impact the generalization performance of large language models. Existing domain reweighting methods often rely on costly weight computations and require retraining when new data is introduced. To this end, we introduce a flex ...

2025

Exploiting Representation Similarities in Self-Supervised Learning for Vision Tasks

Thomas Grégoire Stegmüller

Recent progress in computer vision has been driven by a simple yet transformative observation: the potential of 30-year-old neural networks can be unlocked by massively scaling their parameters and the amount of human-labeled training data. This breakthrou ...

EPFL2025

Sequential Reasoning with Socially Caused Beliefs

Mert Kayaalp

Machine learning and artificial intelligence methods have achieved remarkable success, matching and even surpassing human capabilities in various complex tasks. However, many demonstrations have generally neglected a critical part of the intelligence that ...

EPFL2025

From Embeddings to Explainability: A Tutorial on Large-Language-Model-Based Text Analysis for Behavioral Scientists

Rudolf Georg Debelak

Large language models (LLMs) are transforming research in psychology and the behavioral sciences by enabling advanced text analysis at scale. Their applications range from the analysis of social media posts to infer psychological traits to the automated sc ...

SAGE Publications2025

Explainable modeling for wind power forecasting: A Glass-Box model with high accuracy

Fernando Porté Agel, Jiannong Fang, Wenlong Liao

Machine learning models (e.g., neural networks) achieve high accuracy in wind power forecasting, but they are usually regarded as black boxes that lack interpretability. To address this issue, the paper proposes a glass-box model that combines high accurac ...

2025

Bootstrapping Language-Audio Pre-training for Music Captioning

Nathanaël Perraudin

We introduce BLAP, a model capable of generating high-quality captions for music. BLAP leverages a fine-tuned CLAP audio encoder and a pre-trained Flan-T5 large language model. To achieve effective cross-modal alignment between music and language, BLAP uti ...

Institute of Electrical and Electronics Engineers Inc.2025

Dark Noise Diffusion: Noise Synthesis for Low-Light Image Denoising

Liying Lu, Raphaël Wan-Li Marc Achddou, Sabine Süsstrunk

Low-light photography produces images with low signal-to-noise ratios due to limited photons. In such conditions, common approximations like the Gaussian noise model fall short, and many denoising techniques fail to remove noise effectively. Although deep- ...

2025

Abstract IA02: Cancer-specific foundation models: Friend or foe in healthcare AI?

Maria Brbic

Foundation models have become a powerful tool in single-cell transcriptomics, enabling broad generalization across tasks such as cell type annotation, data integration, and drug response prediction. Yet, most current models are trained predominantly on hea ...

American Association for Cancer Research (AACR)2025

Computational design of complex protein folds and soluble analogs of membrane proteins

Casper Alexander Goverde

Proteins are the molecular machines of life, driving essential biological processes such as enzymatic catalysis, cellular signaling, and immune responses. The ability to design entirely new proteins with desired structures and functions has immense implica ...

EPFL2025

Can we trust explainable artificial intelligence in wind power forecasting?

Fernando Porté Agel, Jiannong Fang, Wenlong Liao

Advanced artificial intelligence (AI) models typically achieve high accuracy in wind power forecasting, but their internal mechanisms lack interpretability, which undermines user confidence in forecast value and strategy execution. To this end, this paper ...

Elsevier BV2024

MCMC: Bridging Rendering, Optimization and Generative AI

Wenzel Alban Jakob

Generative artificial intelligence (AI) has made unprecedented advances in vision language models over the past two years. These advances are largely due to diffusion-based generative models, which are very stable and simple to train. These diffusion model ...

Association for Computing Machinery, Inc2024

Leveraging large language models for predictive chemistry

Berend Smit, Philippe Schwaller, Kevin Maik Jablonka, Andres Adolfo Ortega Guerrero

Machine learning has transformed many fields and has recently found applications in chemistry and materials science. The small datasets commonly found in chemistry sparked the development of sophisticated machine learning approaches that incorporate chemic ...

Nature Portfolio2024

Towards the Detection of AI-Synthesized Human Face Images

Touradj Ebrahimi, Yuhang Lu

Over the past years, image generation and manipulation have achieved remarkable progress due to the rapid development of generative AI based on deep learning. Recent studies have devoted significant efforts to address the problem of face image manipulation ...

2024

Generative AI tools in the nuclear engineering community: A survey-based evaluation of the current adoption and impacts

Alessandro Scolaro, Oskari Ville Pakari

Generative AI tools (often abbreviated genAI or GAI), such as chatGPT, have arguably great potential to induce a paradigm shift in knowledge work.Herein, we present the results of a survey conducted within the nuclear engineering professional community to ...

American Nuclear Society2024

SIMPLE HIERARCHICAL PLANNING WITH DIFFUSION

Caglar Gulcehre

Diffusion-based generative methods have proven effective in modeling trajectories with offline datasets. However, they often face computational challenges and can falter in generalization, especially in capturing temporal abstractions for long- horizon tas ...

2024

From classification to segmentation with explainable AI: A study on crack detection and growth monitoring

Olga Fink, Florent Evariste Forest

Monitoring surface cracks in infrastructure is crucial for structural health monitoring. Automatic visual inspection offers an effective solution, especially in hard-to-reach areas. Machine learning approaches have proven their effectiveness but typically ...

2024

On the Utility of Speech and Audio Foundation Models for Marmoset Call Analysis

Mathew Magimai Doss, Eklavya Sarkar

Marmoset monkeys encode vital information in their calls and serve as a surrogate model for neuro-biologists to understand the evolutionary origins of human vocal communication. Traditionally analyzed with signal processing-based features, recent approache ...

2024

Sparse autoregressive neural networks for classical spin systems

Giuseppe Carleo, Dian Wu, Indaco Biazzo

Efficient sampling and approximation of Boltzmann distributions involving large sets of binary variables, or spins, are pivotal in diverse scientific fields even beyond physics. Recent advances in generative neural networks have significantly impacted this ...

Iop Publishing Ltd2024

Unveiling the Art of Heading Design: A Harmonious Blend of Summarization, Neology, and Algorithm

Boi Faltings, Shaobo Cui, Yiyang Feng

Crafting an appealing heading is crucial for attracting readers and marketing work or products. A popular way is to summarize the main idea with a refined description and a memorable acronym. However, there lacks a systematic study and a formal benchmark i ...

Association for Computational Linguistics2024

When Your AI Becomes a Target: AI Security Incidents and Best Practices

Alexandre Massoud Alahi, Kathrin Grosse

In contrast to vast academic efforts to study AI security, few real-world reports of AI security incidents exist. Released incidents prevent a thorough investigation of the attackers' motives, as crucial information about the company and AI application is ...

AAAI Press2024