Publications associées à Landscape and training regimes in deep learning

Publications associées (44)

Scaling the Modalities in Multimodal Foundation Models

Having a single neural network to handle a wide and varied range of tasks and modalities has been a long-standing goal. Such a model brings notable advantages, such as test-time computational efficiency, modality fusion, and reduced model size. Our goal in ...

EPFL2025

Bayes-optimal learning of deep random networks of extensive-width*

Lenka Zdeborová, Florent Gérard Krzakala, Hugo Chao Cui

We consider the problem of learning a target function corresponding to a deep, extensive-width, non-linear neural network with random Gaussian weights. We consider the asymptotic limit where the number of samples, the input dimension and the network width ...

IOP Publishing Ltd2025

Programming Light Propagation for Efficient Artificial Intelligence

Ilker Oguz

Contemporary artificial intelligence (AI) models' exponentially growing complexity translates to their expanding skill sets. They can create language or image content mimicking human creativity and understanding, becoming indispensable tools in education, ...

EPFL2025

LIU-NET: lightweight Inception U-Net for efficient brain tumor segmentation from multimodal 3D MRI images

Zaffar Ahmed Shaikh

Segmenting brain tumors is a critical task in medical imaging that relies on advanced deep-learning methods. However, effectively handling complex tumor regions requires more comprehensive and advanced strategies to overcome challenges such as computationa ...

2025

Data-driven dynamic friction models based on Recurrent Neural Networks

Gaëtan Bixente Cortes, Antonio Joaquin Garcia Suarez

In this concise contribution, it is demonstrated that Recurrent Neural Networks (RNNs) based on Gated Recurrent Unit (GRU) architecture, possess the capability to learn the complex dynamics of rate-and-state friction (RSF) laws from synthetic data. The dat ...

2025

Optical Processors for AI Computing and Networking

Mustafa Yildirim

Computing has long been central to technological advancements, where each leap in compute power has catalyzed applications once thought impossible, such as smartphones. Recently, the exponential growth in the compute demand of artificial intelligence (AI) ...

EPFL2025

Deep learning for enhancement of low-resolution and noisy scanning probe microscopy images

Georg Fantner, Marcos Penedo Garcia

In this study, we employed traditional methods and deep learning models to improve resolution and quality of low-resolution AFM images made under standard ambient scanning. Both traditional methods and deep learning models were benchmarked and quantified r ...

Beilstein Institut2025

From Preprocessing to Evaluation: The Role of External Knowledge in Advancing Language Models and Machine Translation

Georgios Vernikos

Machine translation (MT) systems and language models (LMs) have demonstrated impressive performance in recent years, driven by advances in architecture, algorithms, and the scaling of parameters and training data. Despite the ability of these models to int ...

EPFL2025

Advancing Phonology-Based Sign Language Assessment: From Learner to Machine-Generated Videos

Neha Tarigopula

Sign languages are rich visual languages that use both manual features like handshape, movement, and location and non-manual features such as facial expressions, head movements, and body posture to convey information. Sign language learning technologies ha ...

EPFL2025

Towards Integrated Processing of Physiological Signals and Speech

Zohreh Mostaani

Research in speech processing has largely focused on source-system modeling, where vocal fold vibrations serve as the source and the vocal cavity's articulations as the system. Nonetheless, speech production includes a complex combination of physiological ...

EPFL2025

Inherent Structural Descriptors Via Machine Learning

Antonio Tinti

Finding proper collective variables for complex systems and processes is one of the most challenging tasks in simulations, which limits the interpretation of experimental and simulated data and the application of enhanced sampling techniques. Here, we prop ...

IOP Publishing Ltd2025

Euclid: Detecting Solar System objects in Euclid images and classifying them using Kohonen self-organising maps

Frédéric Courbin, Georges Meylan, Aurélien Thomas Mathieu Verdier

The ESA Euclid mission will survey more than 14 000 deg2 of the sky in visible and near-infrared wavelengths, mapping the extragalactic sky to constrain our cosmological model of the Universe. Although the survey focusses on regions further than 15 from th ...

2025

On the Effect of Initialization: The Scaling Path of 2-Layer Neural Networks

Michaël Unser, Sebastian Jonas Neumayer, Lénaïc Chizat

In supervised learning, the regularization path is sometimes used as a convenient theoretical proxy for the optimization path of gradient descent initialized from zero. In this paper, we study a modification of the regularization path for infinite-width 2- ...

2024

Seeking the new, learning from the unexpected: Computational models of surprise and novelty in the brain

Alireza Modirshanechi

Human babies have a natural desire to interact with new toys and objects, through which they learn how the world around them works, e.g., that glass shatters when dropped, but a rubber ball does not. When their predictions are proven incorrect, such as whe ...

EPFL2024

Topics in statistical physics of high-dimensional machine learning

Hugo Chao Cui

In the past few years, Machine Learning (ML) techniques have ushered in a paradigm shift, allowing the harnessing of ever more abundant sources of data to automate complex tasks. The technical workhorse behind these important breakthroughs arguably lies in ...

EPFL2024

Understanding generalization and robustness in modern deep learning

Maksym Andriushchenko

In this thesis, we study two closely related directions: robustness and generalization in modern deep learning. Deep learning models based on empirical risk minimization are known to be often non-robust to small, worst-case perturbations known as adversari ...

EPFL2024

Robust machine learning for neuroscientific inference

Steffen Schneider

Modern neuroscience research is generating increasingly large datasets, from recording thousands of neurons over long timescales to behavioral recordings of animals spanning weeks, months, or even years. Despite a great variety in recording setups and expe ...

EPFL2024

Few-shot Learning for Efficient and Effective Machine Learning Model Adaptation

Arnout Jan J Devos

Machine learning (ML) enables artificial intelligent (AI) agents to learn autonomously from data obtained from their environment to perform tasks. Modern ML systems have proven to be extremely effective, reaching or even exceeding human intelligence. Altho ...

EPFL2024

Generalization and Personalization of Machine Learning for Multimodal Mobile Sensing in Everyday Life

Lakmal Buddika Meegahapola

A range of behavioral and contextual factors, including eating and drinking behavior, mood, social context, and other daily activities, can significantly impact an individual's quality of life and overall well-being. Therefore, inferring everyday life aspe ...

EPFL2024

Data and scripts for the RaFSIP scheme

Athanasios Nenes, Paraskevi Georgakaki

This repository contains microphysics routines, scripts, and processed data from the Weather Research and Forecasting (WRF) model simulations presented in the paper "RaFSIP: Parameterizing ice multiplication in models using a machine learning approach", by ...

Zenodo2024