Publications related to On the choice of metric in gradient-based theories of brain function

Related publications (29)

Parental status and markers of brain and cellular age: A 3D convolutional network and classification study

Recent research shows prominent effects of pregnancy and the parenthood transition on structural brain characteristics in humans. Here, we present a comprehensive study of how parental status and number of children born/fathered links to markers of brain a ...

Pergamon-Elsevier Science Ltd2024

Single-cell epigenomic reconstruction of developmental trajectories from pluripotency in human neural organoid systems

Fides Zenk

Cell fate progression of pluripotent progenitors is strictly regulated, resulting in high human cell diversity. Epigenetic modifications also orchestrate cell fate restriction. Unveiling the epigenetic mechanisms underlying human cell diversity has been di ...

Nature Portfolio2024

The interplay between white adipose tissue, adipokines, and structural gray matter changes

Jean-Philippe Thiran, Gabriel Girard, Elda Fischi Gomez

The growing global obesity issue emphasizes the importance of understanding its health implications. Previous research has identified consistent alterations in gray matter (GM) volume in connection with obesity. Given the various implications of distinct f ...

Wiley2024

White adipose tissue distribution and amount are associated with increased white matter connectivity

Jean-Philippe Thiran, Gabriel Girard, Elda Fischi Gomez, Philipp Johannes Koch

Obesity represents a significant public health concern and is linked to various comorbidities and cognitive impairments. Previous research indicates that elevated body mass index (BMI) is associated with structural changes in white matter (WM). However, a ...

Wiley2024

Scalable constrained optimization

Maria-Luiza Vladarean

Modern optimization is tasked with handling applications of increasingly large scale, chiefly due to the massive amounts of widely available data and the ever-growing reach of Machine Learning. Consequently, this area of research is under steady pressure t ...

EPFL2024

Leveraging Continuous Time to Understand Momentum When Training Diagonal Linear Networks

Nicolas Henri Bernard Flammarion, Scott William Pesme, Hristo Georgiev Papazov

In this work, we investigate the effect of momentum on the optimisation trajectory of gradient descent. We leverage a continuous-time approach in the analysis of momentum gradient descent with step size

\gamma

and momentum parameter

\beta

that allows u ...

2024

Driving and suppressing the human language network using large language models

Martin Schrimpf

Transformer models such as GPT generate human-like language and are predictive of human brain responses to language. Here, using functional-MRI-measured brain responses to 1,000 diverse sentences, we first show that a GPT-based encoding model can predict t ...

Nature Portfolio2024

Optimization Algorithms for Decentralized, Distributed and Collaborative Machine Learning

Anastasiia Koloskova

Distributed learning is the key for enabling training of modern large-scale machine learning models, through parallelising the learning process. Collaborative learning is essential for learning from privacy-sensitive data that is distributed across various ...

EPFL2024

Safety, tolerability and blinding efficiency of non-invasive deep transcranial temporal interference stimulation: first experience from more than 250 sessions

Friedhelm Christoph Hummel, Maximilian Jonas Wessel, Elena Beanato, Pierre Theopistos Vassiliadis, Fabienne Windel

Objective. Selective neuromodulation of deep brain regions has for a long time only been possible through invasive approaches, because of the steep depth-focality trade-off of conventional non-invasive brain stimulation (NIBS) techniques. Approach. An appr ...

Iop Publishing Ltd2024

An immersive virtual reality tool for assessing left and right unilateral spatial neglect

Olaf Blanke, Andrea Serino, Roberta Ronchi

The reported rate of the occurrence of unilateral spatial neglect (USN) is highly variable likely due to the lack of validity and low sensitivity of classical tools used to assess it. Virtual reality (VR) assessments try to overcome these limitations by pr ...

Wiley2024

Mesh-based topology, shape and sizing optimization of ribbed plates

Ahmad Abdulrahman Ahmad Majdouba

In this paper, we present a new parameterization and optimization procedure for minimizing the weight of ribbed plates. The primary goal is to reduce embodied CO2 in concrete floors as part of the effort to diminish the carbon footprint of the construction ...

Springer2024

Understanding generalization and robustness in modern deep learning

Maksym Andriushchenko

In this thesis, we study two closely related directions: robustness and generalization in modern deep learning. Deep learning models based on empirical risk minimization are known to be often non-robust to small, worst-case perturbations known as adversari ...

EPFL2024

Integrated Wireless Power, Data Communication, and Thermal Sensing System for Autonomous Multisite Brain Implants

Mohammad Javad Karimi

Implanted medical devices (IMDs) have been widely developed to support the monitoring and recording of biological data inside the body or brain. Wirelessly powered IMDs, a subset of implantable electronics, have been proposed to eliminate the limitations r ...

EPFL2024

Deep Learning Theory Through the Lens of Diagonal Linear Networks

Scott William Pesme

In this PhD manuscript, we explore optimisation phenomena which occur in complex neural networks through the lens of

2

-layer diagonal linear networks. This rudimentary architecture, which consists of a two layer feedforward linear network with a diagonal ...

EPFL2024

Neurobiological and metabolic basis of motivation and effort-based decision-making - A human 1H-MRS, fMRI and machine learning study

Arthur Barakat

Motivation is a multifaceted phenomenon that we explore within the framework of decision-making. Through this cognitive process, actions are directed towards specific goals by performing a trade-off between the cost and benefit of an action. The dorsomedia ...

EPFL2024

Seeking the new, learning from the unexpected: Computational models of surprise and novelty in the brain

Alireza Modirshanechi

Human babies have a natural desire to interact with new toys and objects, through which they learn how the world around them works, e.g., that glass shatters when dropped, but a rubber ball does not. When their predictions are proven incorrect, such as whe ...

EPFL2024

Small-scale robotic devices for medical interventions in the brain

Mahmut Selman Sakar, Lorenzo Francesco John Noseda

This article summarizes the recent advancements in the design, fabrication, and control of microrobotic devices for the diagnosis and treatment of brain disorders. With a focus on diverse actuation methods, we discuss how advancements in materials science ...

2024

On the Generalization of Stochastic Gradient Descent with Momentum

Volkan Cevher, Kimon Antonakopoulos

While momentum-based accelerated variants of stochastic gradient descent (SGD) are widely used when training machine learning models, there is little theoretical understanding on the generalization error of such methods. In this work, we first show that th ...

Microtome Publishing2024

Subcortical correlates of consciousness with human single neuron recordings

Olaf Blanke, Fosco Bernasconi, Nathan Quentin Faivre, Michael Eric Anthony Pereira

Subcortical brain structures such as the basal ganglia or the thalamus are involved in regulating motor and cognitive behavior. However, their contribution to perceptual consciousness is still unclear, due to the inherent difficulties of recording subcorti ...

2024

The effect of smooth parametrizations on nonconvex optimization landscapes

Nicolas Boumal

We develop new tools to study landscapes in nonconvex optimization. Given one optimization problem, we pair it with another by smoothly parametrizing the domain. This is either for practical purposes (e.g., to use smooth optimization algorithms with good g ...

Springer Heidelberg2024