Publications associées à Positional Embeddings for Solving PDEs with Evolutional Deep Neural Networks

Publications associées (25)

Eflop: a Sparsity-aware Metric for Evaluating Computational Cost in Spiking and Non-spiking Neural Networks

Deploying energy-efficient deep neural networks on energy-constrained edge devices is an important research topic in both machine learning and circuit design communities. Both artificial neural networks (ANNs) and spiking neural networks (SNNs) have been p ...

IOP Publishing Ltd2025

Mspo: a Machine Learning Hyperparameter Optimization Method for Enhanced Breast Cancer Image Classification

Zaffar Ahmed Shaikh

As one of the major threats to women's health worldwide, breast cancer requires early diagnosis and accurate classification, since they are key to optimizing therapeutic interventions and ensuring precise prognosis. Recently, deep learning has demonstrated ...

SAGE PUBLICATIONS LTD2025

A phase transition between positional and semantic learning in a solvable model of dot-product attention

Lenka Zdeborová, Florent Gérard Krzakala, Hugo Chao Cui, Freya Behrens

Many empirical studies have provided evidence for the emergence of algorithmic mechanisms (abilities) in the learning of language models, that lead to qualitative improvements in the model capabilities. Yet, a theoretical characterization of how such mecha ...

2025

Interact with Earth Observation Images using AI: Transparent Methods and Evaluation for Visual Question Answering

Christel Marie Tartini-Chappuis

Now is an exciting time for the domain of Earth observation (EO), with a multitude of diverse sensors looking at the planet from satellites, airplanes or drones. The volume of imagery acquired is massive, and hold great potential for a variety of applicati ...

EPFL2025

Domain shift, domain adaptation, and generalization: A focus on MRI

Tobias Kober, Meritxell Bach Cuadra, Veronica Lily Ravano, Jonas Richiardi

Differences in acquisition protocols or hardware result in measurable changes in image characteristics. These differences affect distributional properties and can also affect the spatial and temporal characteristics of the images. Likewise, the distributio ...

Academic Press2025

Self-supervised and few-shot learning for robust bioaerosol monitoring

Sophie Catherine Erb

Real-time bioaerosol monitoring is improving the quality of life for people affected by allergies, but it often relies on deep learning models which pose challenges for widespread adoption. These models are typically trained in a supervised fashion and req ...

2025

Machine-learning-empowered FDTD/FEM simulations for predictive solar energy absorption in plasmonic metamaterial nanocavity arrays

Amir Jafargholi

FDTD/FEM simulations, strengthened by machine learning, achieve 95.44% optical absorption efficiency in TiO 2 /TiN plasmonic nanocavities for solar energy harvesting. ...

Royal Society of Chemistry (RSC)2025

Probing the latent hierarchical structure of data via diffusion models

Noam Itzhak Levi, Alessandro Favero, Antonio Sclocchi

High-dimensional data must be highly structured to be learnable. Although the compositional and hierarchical nature of data is often put forward to explain learnability, quantitative measurements establishing these properties are scarce. Likewise, accessin ...

2025

Posterior-Based Analysis of Spatio-Temporal Features for Sign Language Assessment

Neha Tarigopula

Sign Language conveys information through multiple channels composed of manual (handshape, hand movement) and non-manual (facial expression, mouthing, body posture) components. Sign language assessment involves giving granular feedback to a learner, in ter ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2025

Machine-learning to analyze human-building interactions: How do people use mobile solar protections?

Gloria Serra Coch

Buildings significantly impact urban energy consumption. Mobile passive solutions, such as manual solar protections, can mitigate heat gains, but their effectiveness depends on occupants’ decisions. Analyzing occupant adjustments of manual systems is chall ...

2024

Multi-Scale and Multimodal Species Distribution Modeling

Devis Tuia, Benjamin Alexander Kellenberger, Nina Marion Aurélia Van Tiel, Robin Adrien Zbinden

Species distribution models (SDMs) aim to predict the distribution of species by relating occurrence data with environmental variables. Recent applications of deep learning to SDMs have enabled new avenues, specifically the inclusion of spatial data (envir ...

Springer Nature Link2024

Model Tuning and Performance Evaluation in Machine Learning Models for PV Power Forecasting: Case Study of a BIPV System in Switzerland

Hugo James André Quest

High PV penetration into the electricity grid can lead to issues such as congestion if PV systems are not integrated effectively. Accurate PV power forecasting helps to address this issue. In recent years machine learning approaches have gotten a lot of at ...

Institute of Electrical and Electronics Engineers Inc.2024

Kernels, data & physics

Francesco Cagnetta

Lecture notes from the course given by Professor Julia Kempe at the summer school ‘Statistical physics of Machine Learning’ in Les Houches. The notes discuss the so-called NTK approach to problems in machine learning, which consists of gaining an understan ...

2024

Generalization and Personalization of Machine Learning for Multimodal Mobile Sensing in Everyday Life

Lakmal Buddika Meegahapola

A range of behavioral and contextual factors, including eating and drinking behavior, mood, social context, and other daily activities, can significantly impact an individual's quality of life and overall well-being. Therefore, inferring everyday life aspe ...

EPFL2024

Exploring crystallographic texture manipulation in stainless steels via laser powder bed fusion: insights from neutron diffraction and machine learning

Roland Logé

Laser powder bed fusion of metals (PBF-LB/M) is a pivotal additive manufacturing technique that enables the production of intricate components. In addition to enabling the production of complex shapes, it allows for a high degree of freedom in manipulating ...

Taylor & Francis2024

Navigating the Loop: From Control Systems to Neural Networks and Back

Clara Lucía Galimberti

The work presented in this thesis lies at the intersection of Machine Learning (ML) and control theory. The first part is dedicated to the design of Deep Neural Network (DNN) architectures with specific numerical properties, inspired by dynamical systems m ...

EPFL2024

Meta-learning to address diverse Earth observation problems across resolutions

Devis Tuia, Marc Conrad Russwurm, Benjamin Alexander Kellenberger

Earth scientists study a variety of problems with remote sensing data, but they most often consider them in isolation from each other, which limits information flows across disciplines. In this work, we present METEOR, a meta-learning methodology for Earth ...

Springernature2024

Self-supervised air quality estimation with graph neural network assistance and attention enhancement

Thanh Trung Huynh

The rapid progress of industrial development, urbanization, and traffic has caused air quality degradation that negatively affects human health and environmental sustainability, especially in developed countries. However, due to the limited number of senso ...

2024

From Data to Decision: Exploring Machine Learning's Impact on Shaping Smart Cities

Jérôme Chenal

In today's era of rapid urbanization, smart cities are emerging as a beacon of efficiency and sustainability. At the heart of this evolution is the integration of Machine Learning (ML), which can transform vast streams of data into informed decisions. This ...

Springer Nature2024

RAPNet: Resolution-Adaptive and Predictive Early Exit Network for Efficient Image Recognition

Yung-Cheng Chiang

Deploying compute-intensive deep neural networks (DNNs) on resource-constrained end devices has become a prominent trend, enabling localized intelligence. However, efficiently deploying these DNNs at scale poses challenges. To address this, extensive resea ...

2024