Publications related to Video Prediction Recalling Long-term Motion Context via Memory Alignment Learning

Related publications (53)

Eflop: a Sparsity-aware Metric for Evaluating Computational Cost in Spiking and Non-spiking Neural Networks

Deploying energy-efficient deep neural networks on energy-constrained edge devices is an important research topic in both machine learning and circuit design communities. Both artificial neural networks (ANNs) and spiking neural networks (SNNs) have been p ...

IOP Publishing Ltd2025

How Gradient Descent Balances Features: A Dynamical Analysis For Two-Layer Neural Networks

Volkan Cevher, Fanghui Liu, Zhenyu Zhu

This paper investigates the fundamental regression task of learning k neurons (a.k.a. teachers) from Gaussian input, using two-layer ReLU neural networks with width m (a.k.a. students) and m, k = O(1), trained via gradient descent under proper initializati ...

2025

Mspo: a Machine Learning Hyperparameter Optimization Method for Enhanced Breast Cancer Image Classification

Zaffar Ahmed Shaikh

As one of the major threats to women's health worldwide, breast cancer requires early diagnosis and accurate classification, since they are key to optimizing therapeutic interventions and ensuring precise prognosis. Recently, deep learning has demonstrated ...

SAGE PUBLICATIONS LTD2025

Interact with Earth Observation Images using AI: Transparent Methods and Evaluation for Visual Question Answering

Christel Marie Tartini-Chappuis

Now is an exciting time for the domain of Earth observation (EO), with a multitude of diverse sensors looking at the planet from satellites, airplanes or drones. The volume of imagery acquired is massive, and hold great potential for a variety of applicati ...

EPFL2025

Improving the accuracy and interpretability of neural networks for wind power forecasting

Fernando Porté Agel, Jiannong Fang, Wenlong Liao

Deep neural networks (DNNs) are receiving increasing attention in wind power forecasting due to their ability to effectively capture complex patterns in wind data. However, their forecast errors are severely limited by the local optimal weight issue in opt ...

2025

Learning to Assemble with Alternative Plans

Gabriel Rémi Vallat, Maryam Kamgarpour, Stefana Parascho, Ziqi Wang, Jingwen Wang

We present a reinforcement learning framework for constructing assemblies composed of rigid parts, which are commonly seen in many historical masonry buildings and bridges. Traditional construction methods for such structures often depend on dense scaffold ...

Association for Computing Machinery (ACM)2025

Interpret3C: Interpretable Student Clustering Through Individualized Feature Selection

Julian Thomas Blackwell, Tanja Christina Käser Jacober, Paola Mejia Domenzain, Vinitra Swamy

Clustering in education, particularly in large-scale online environments like MOOCs, is essential for understanding and adapting to diverse student needs. However, the effectiveness of clustering depends on its interpretability, which becomes challenging w ...

2024

A phase transition between positional and semantic learning in a solvable model of dot-product attention

Lenka Zdeborová, Florent Gérard Krzakala, Hugo Chao Cui, Freya Behrens

Many empirical studies have provided evidence for the emergence of algorithmic mechanisms (abilities) in the learning of language models, that lead to qualitative improvements in the model capabilities. Yet, a theoretical characterization of how such mecha ...

2025

Incorporating Projective Geometry into Deep Learning

Michal Jan Tyszkiewicz

In this thesis we explore the applications of projective geometry, a mathematical theory of the relation between 3D scenes and their 2D images, in modern learning-based computer vision systems. This is an interesting research question which contradicts the ...

EPFL2024

Domain shift, domain adaptation, and generalization: A focus on MRI

Tobias Kober, Meritxell Bach Cuadra, Veronica Lily Ravano, Jonas Richiardi

Differences in acquisition protocols or hardware result in measurable changes in image characteristics. These differences affect distributional properties and can also affect the spatial and temporal characteristics of the images. Likewise, the distributio ...

Academic Press2025

Foundations of a New Learning Paradigm in AI Grounded in the Principles of Evolutionary Developmental Biology

Zeki Doruk Erden

Contemporary AI faces important limitations that remain unresolved despite significant successes. Chief among these are the inability to acquire new knowledge without destroying old, the incomprehensible and nonengineerable nature of internal representatio ...

EPFL2025

Machine Learning for Modeling Stock Returns

Teng Andrea Xu

Throughout history, the pace of knowledge and information sharing has evolved into an unthinkable speed and media. At the end of the XVII century, in Europe, the ideas that would shape the "Age of Enlightenment" were slowly being developed in coffeehouses, ...

EPFL2024

Self-supervised and few-shot learning for robust bioaerosol monitoring

Sophie Catherine Erb

Real-time bioaerosol monitoring is improving the quality of life for people affected by allergies, but it often relies on deep learning models which pose challenges for widespread adoption. These models are typically trained in a supervised fashion and req ...

2025

Infusing structured knowledge priors in neural models for sample-efficient symbolic reasoning

Mattia Atzeni

The ability to reason, plan and solve highly abstract problems is a hallmark of human intelligence. Recent advancements in artificial intelligence, propelled by deep neural networks, have revolutionized disciplines like computer vision and natural language ...

EPFL2024

Posterior-Based Analysis of Spatio-Temporal Features for Sign Language Assessment

Neha Tarigopula

Sign Language conveys information through multiple channels composed of manual (handshape, hand movement) and non-manual (facial expression, mouthing, body posture) components. Sign language assessment involves giving granular feedback to a learner, in ter ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2025

Towards improving full-length ribosome density prediction by bridging sequence and graph-based representations

Mohan Vamsi Nallapareddy, Pierre Vandergheynst, Felix Naef, Cédric Gobet, Francesco Craighero

Translation elongation plays an important role in regulating protein concentrations in the cell, and dysregulation of this process has been linked to several human diseases. In this study, we use data from ribo-seq experiments to model ribosome densities, ...

PMLR2024

Feature-based encoding of face identity by single neurons in the human amygdala and hippocampus

Emanuela De Falco

Neurons in the human amygdala and hippocampus are classically thought to encode a person’s identity invariant to visual features. However, it remains largely unknown how visual information from higher visual cortical areas is translated into such a semanti ...

2025

Robust machine learning for neuroscientific inference

Steffen Schneider

Modern neuroscience research is generating increasingly large datasets, from recording thousands of neurons over long timescales to behavioral recordings of animals spanning weeks, months, or even years. Despite a great variety in recording setups and expe ...

EPFL2024

Neurocognition and NMDAR co-agonists pathways in individuals with treatment resistant first-episode psychosis: a 3-year follow-up longitudinal study

Lijing Xin

This study aims to determine whether 1) individuals with treatment-resistant schizophrenia display early cognitive impairment compared to treatment-responders and healthy controls and 2) N-methyl-D-aspartate-receptor hypofunction is an underlying mechanism ...

Springernature2024

MaskCLR: Attention-Guided Contrastive Learning for Robust Action Representation Learning

Alexandre Massoud Alahi, Mohamed Ossama Ahmed Abdelfattah, Mariam Ahmed Mahmoud Hegazy Hassan

Current transformer-based skeletal action recognition models tend to focus on a limited set of joints and low-level motion patterns to predict action classes. This results in significant performance degradation under small skeleton perturbations or changin ...

2024