Publications associées à Unveiling the Art of Heading Design: A Harmonious Blend of Summarization, Neology, and Algorithm

Publications associées (26)

Exploiting Representation Similarities in Self-Supervised Learning for Vision Tasks

Recent progress in computer vision has been driven by a simple yet transformative observation: the potential of 30-year-old neural networks can be unlocked by massively scaling their parameters and the amount of human-labeled training data. This breakthrou ...

EPFL2025

CHAMELEON: A Flexible Data-mixing Framework for Language Model Pretraining and Finetuning

Volkan Cevher, Wanyun Xie

Training data mixtures greatly impact the generalization performance of large language models. Existing domain reweighting methods often rely on costly weight computations and require retraining when new data is introduced. To this end, we introduce a flex ...

2025

Dark Noise Diffusion: Noise Synthesis for Low-Light Image Denoising

Liying Lu, Raphaël Wan-Li Marc Achddou, Sabine Süsstrunk

Low-light photography produces images with low signal-to-noise ratios due to limited photons. In such conditions, common approximations like the Gaussian noise model fall short, and many denoising techniques fail to remove noise effectively. Although deep- ...

2025

SaliencyMix plus : Noise-Minimized Image Mixing Method With Saliency Map in Data Augmentation

Zhixiong Jin

Data augmentation is vital in deep learning for enhancing model robustness by artificially expanding training datasets. However, advanced methods like CutMix blend images and assign labels based on pixel ratios, often introducing label noise by neglecting ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2025

Bootstrapping Language-Audio Pre-training for Music Captioning

Nathanaël Perraudin

We introduce BLAP, a model capable of generating high-quality captions for music. BLAP leverages a fine-tuned CLAP audio encoder and a pre-trained Flan-T5 large language model. To achieve effective cross-modal alignment between music and language, BLAP uti ...

Institute of Electrical and Electronics Engineers Inc.2025

K-space physics-informed neural network (k-PINN) for compressed spectral mapping and efficient inversion of vibrations in thin composite laminates

Olga Fink

The vibrational response of structural components carries valuable information about their underlying mechanical properties, health status and operational conditions. This underscores the need for the development of efficient physics-based inversion algori ...

Elsevier BV2025

Using Motion Cues to Supervise Single-Frame Body Pose and Shape Estimation in Low Data Regimes

Pascal Fua, Mathieu Salzmann, Andrey Davydov

When enough annotated training data is available, supervised deep-learning. algorithms excel at estimating human body pose and shape using a single camera. The effects of too little such data being available can be mitigated by using other information sour ...

Journal of Machine Learning Research Inc.2024

Leveraging large language models for predictive chemistry

Berend Smit, Philippe Schwaller, Kevin Maik Jablonka, Andres Adolfo Ortega Guerrero

Machine learning has transformed many fields and has recently found applications in chemistry and materials science. The small datasets commonly found in chemistry sparked the development of sophisticated machine learning approaches that incorporate chemic ...

Nature Portfolio2024

On the Utility of Speech and Audio Foundation Models for Marmoset Call Analysis

Mathew Magimai Doss, Eklavya Sarkar

Marmoset monkeys encode vital information in their calls and serve as a surrogate model for neuro-biologists to understand the evolutionary origins of human vocal communication. Traditionally analyzed with signal processing-based features, recent approache ...

2024

Understanding generalization and robustness in modern deep learning

Maksym Andriushchenko

In this thesis, we study two closely related directions: robustness and generalization in modern deep learning. Deep learning models based on empirical risk minimization are known to be often non-robust to small, worst-case perturbations known as adversari ...

EPFL2024

On the Generalization of Stochastic Gradient Descent with Momentum

Volkan Cevher, Kimon Antonakopoulos

While momentum-based accelerated variants of stochastic gradient descent (SGD) are widely used when training machine learning models, there is little theoretical understanding on the generalization error of such methods. In this work, we first show that th ...

Microtome Publishing2024

From classification to segmentation with explainable AI: A study on crack detection and growth monitoring

Olga Fink, Florent Evariste Forest

Monitoring surface cracks in infrastructure is crucial for structural health monitoring. Automatic visual inspection offers an effective solution, especially in hard-to-reach areas. Machine learning approaches have proven their effectiveness but typically ...

2024

Anniversary AI reflections

Francesco Stella

For our fifth anniversary, we reconnected with authors of recent Comments and Perspectives in Nature Machine Intelligence and asked them how the topic they wrote about developed. We also wanted to know what other topics in AI they found exciting, surprisin ...

Nature Portfolio2024

A Theory of Finite-Width Neural Networks: Generalization, Scaling Laws, and the Loss Landscape

Berfin Simsek

Deep learning has achieved remarkable success in various challenging tasks such as generating images from natural language or engaging in lengthy conversations with humans. The success in practice stems from the ability to successfully train massive neural ...

EPFL2023

ChatGPT takes on the European Exam in Core Cardiology: an artificial intelligence success story?

Emmanuel Abbé, Thabodhan Mahendiran

Chat Generative Pre-trained Transformer (ChatGPT) is currently a trending topic worldwide triggering extensive debate about its predictive power, its potential uses, and its wider implications. Recent publications have demonstrated that ChatGPT can correct ...

Oxford Univ Press2023

Understanding the Social Context of Eating with Multimodal Smartphone Sensing: The Role of Country Diversity

Daniel Gatica-Perez

Understanding the social context of eating is crucial for promoting healthy eating behaviors. Multimodal smartphone sensor data could provide valuable insights into eating behavior, particularly in mobile food diaries and mobile health apps. However, resea ...

Assoc Computing Machinery2023

DrapeNet: Garment Generation and Self-Supervised Draping

Pascal Fua, Mathieu Salzmann, Benoît Alain René Guillard, Ren Li

Recent approaches to drape garments quickly over arbitrary human bodies leverage self-supervision to eliminate the need for large training sets. However, they are designed to train one network per clothing item, which severely limits their generalization a ...

IEEE2023

Towards Verifiable, Generalizable and Efficient Robust Deep Neural Networks

Chen Liu

In the last decade, deep neural networks have achieved tremendous success in many fields of machine learning. However, they are shown vulnerable against adversarial attacks: well-designed, yet imperceptible, perturbations can make the state-of-the-art deep ...

EPFL2022

Sparse-RS: A Versatile Framework for Query-Efficient Sparse Black-Box Adversarial Attacks

Nicolas Henri Bernard Flammarion, Maksym Andriushchenko, Francesco Croce

We propose a versatile framework based on random search, Sparse-RS, for score-based sparse targeted and untargeted attacks in the black-box setting. Sparse-RS does not rely on substitute models and achieves state-of-the-art success rate and query efficienc ...

ASSOC ADVANCEMENT ARTIFICIAL INTELLIGENCE2022

Unsupervised Visual Entity Abstraction towards 2D and 3D Compositional Models

Beril Besbinar

Object-centric learning has gained significant attention over the last years as it can serve as a powerful tool to analyze complex scenes as a composition of simpler entities. Well-established tasks in computer vision, such as object detection or instance ...

EPFL2022