On the choice of metric in gradient-based theories of brain function

Chat with Graph Search

Ask any question about EPFL courses, lectures, exercises, research, news, etc. or try the example questions below.

DISCLAIMER: The Graph Chatbot is not programmed to provide explicit or categorical answers to your questions. Rather, it transforms your questions into API requests that are distributed across the various IT services officially administered by EPFL. Its purpose is solely to collect and recommend relevant references to content that you can explore to help you answer your questions.

Recent research shows prominent effects of pregnancy and the parenthood transition on structural brain characteristics in humans. Here, we present a comprehensive study of how parental status and number of children born/fathered links to markers of brain a ...

Cell fate progression of pluripotent progenitors is strictly regulated, resulting in high human cell diversity. Epigenetic modifications also orchestrate cell fate restriction. Unveiling the epigenetic mechanisms underlying human cell diversity has been di ...

The growing global obesity issue emphasizes the importance of understanding its health implications. Previous research has identified consistent alterations in gray matter (GM) volume in connection with obesity. Given the various implications of distinct f ...

Obesity represents a significant public health concern and is linked to various comorbidities and cognitive impairments. Previous research indicates that elevated body mass index (BMI) is associated with structural changes in white matter (WM). However, a ...

Modern optimization is tasked with handling applications of increasingly large scale, chiefly due to the massive amounts of widely available data and the ever-growing reach of Machine Learning. Consequently, this area of research is under steady pressure t ...

In this work, we investigate the effect of momentum on the optimisation trajectory of gradient descent. We leverage a continuous-time approach in the analysis of momentum gradient descent with step size

\gamma

and momentum parameter

\beta

that allows u ...

Transformer models such as GPT generate human-like language and are predictive of human brain responses to language. Here, using functional-MRI-measured brain responses to 1,000 diverse sentences, we first show that a GPT-based encoding model can predict t ...

Distributed learning is the key for enabling training of modern large-scale machine learning models, through parallelising the learning process. Collaborative learning is essential for learning from privacy-sensitive data that is distributed across various ...

Objective. Selective neuromodulation of deep brain regions has for a long time only been possible through invasive approaches, because of the steep depth-focality trade-off of conventional non-invasive brain stimulation (NIBS) techniques. Approach. An appr ...

The reported rate of the occurrence of unilateral spatial neglect (USN) is highly variable likely due to the lack of validity and low sensitivity of classical tools used to assess it. Virtual reality (VR) assessments try to overcome these limitations by pr ...

In this paper, we present a new parameterization and optimization procedure for minimizing the weight of ribbed plates. The primary goal is to reduce embodied CO2 in concrete floors as part of the effort to diminish the carbon footprint of the construction ...

In this thesis, we study two closely related directions: robustness and generalization in modern deep learning. Deep learning models based on empirical risk minimization are known to be often non-robust to small, worst-case perturbations known as adversari ...

Implanted medical devices (IMDs) have been widely developed to support the monitoring and recording of biological data inside the body or brain. Wirelessly powered IMDs, a subset of implantable electronics, have been proposed to eliminate the limitations r ...

In this PhD manuscript, we explore optimisation phenomena which occur in complex neural networks through the lens of

2

-layer diagonal linear networks. This rudimentary architecture, which consists of a two layer feedforward linear network with a diagonal ...

Motivation is a multifaceted phenomenon that we explore within the framework of decision-making. Through this cognitive process, actions are directed towards specific goals by performing a trade-off between the cost and benefit of an action. The dorsomedia ...

Human babies have a natural desire to interact with new toys and objects, through which they learn how the world around them works, e.g., that glass shatters when dropped, but a rubber ball does not. When their predictions are proven incorrect, such as whe ...

This article summarizes the recent advancements in the design, fabrication, and control of microrobotic devices for the diagnosis and treatment of brain disorders. With a focus on diverse actuation methods, we discuss how advancements in materials science ...

While momentum-based accelerated variants of stochastic gradient descent (SGD) are widely used when training machine learning models, there is little theoretical understanding on the generalization error of such methods. In this work, we first show that th ...

Subcortical brain structures such as the basal ganglia or the thalamus are involved in regulating motor and cognitive behavior. However, their contribution to perceptual consciousness is still unclear, due to the inherent difficulties of recording subcorti ...

We develop new tools to study landscapes in nonconvex optimization. Given one optimization problem, we pair it with another by smoothly parametrizing the domain. This is either for practical purposes (e.g., to use smooth optimization algorithms with good g ...

On the choice of metric in gradient-based theories of brain function

Chat with Graph Search

Parental status and markers of brain and cellular age: A 3D convolutional network and classification study

Single-cell epigenomic reconstruction of developmental trajectories from pluripotency in human neural organoid systems

The interplay between white adipose tissue, adipokines, and structural gray matter changes

White adipose tissue distribution and amount are associated with increased white matter connectivity

Scalable constrained optimization

Leveraging Continuous Time to Understand Momentum When Training Diagonal Linear Networks

Driving and suppressing the human language network using large language models

Optimization Algorithms for Decentralized, Distributed and Collaborative Machine Learning

Safety, tolerability and blinding efficiency of non-invasive deep transcranial temporal interference stimulation: first experience from more than 250 sessions

An immersive virtual reality tool for assessing left and right unilateral spatial neglect

Mesh-based topology, shape and sizing optimization of ribbed plates

Understanding generalization and robustness in modern deep learning

Integrated Wireless Power, Data Communication, and Thermal Sensing System for Autonomous Multisite Brain Implants

Deep Learning Theory Through the Lens of Diagonal Linear Networks

Neurobiological and metabolic basis of motivation and effort-based decision-making - A human 1H-MRS, fMRI and machine learning study

Seeking the new, learning from the unexpected: Computational models of surprise and novelty in the brain

Small-scale robotic devices for medical interventions in the brain

On the Generalization of Stochastic Gradient Descent with Momentum

Subcortical correlates of consciousness with human single neuron recordings

The effect of smooth parametrizations on nonconvex optimization landscapes