Home

Person

Ali H. Sayed

This person has left EPFL

About
Privacy
Disclaimer

Graph Chatbot

Related publications (142)

Page 4 of 8

Diffusion Moving-Average Adaptation Over Networks

Ali H. Sayed

Recently, the diffusion moving-average (D-MA) scheme has been proposed as a way to combat noisy links over adaptive networks. However, the current theoretical results focus on networks with mean-square error costs where the optimal local solution agrees wi ...

2024

A Regularization Framework for Learning Over Multitask Graphs

Ali H. Sayed, Stefan Vlaski, Roula Nassif

This letter proposes a general regularization framework for inference over multitask networks. The optimization approach relies on minimizing a global cost consisting of the aggregate sum of individual costs regularized by a term that allows to incorporate ...

IEEE Institute of Electrical and Electronics Engineers2019

Distributed Adaptive Learning Under Communication Constraints

Ali H. Sayed

We consider a network of agents that must solve an online optimization problem from continual observation of streaming data. To this end, the agents implement a distributed cooperative strategy where each agent is allowed to perform local exchange of infor ...

Ieee-Inst Electrical Electronics Engineers Inc2024

A Proximal Diffusion Strategy for Multiagent Optimization With Sparse Affine Constraints

Ali H. Sayed, Kun Yuan, Sulaiman A S A E Alghunaim

This article develops a proximal primal-dual decentralized strategy for multiagent optimization problems that involve multiple coupled affine constraints, where each constraint may involve only a subset of the agents. The constraints are generally sparse, ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2020

On the Arithmetic and Geometric Fusion of Beliefs for Distributed Inference

Ali H. Sayed, Emre Telatar, Mert Kayaalp, Yunus Inan

We study the asymptotic learning rates of belief vectors in a distributed hypothesis testing problem under linear and log-linear combination rules. We show that under both combination strategies, agents are able to learn the truth exponentially fast, with ...

Ieee-Inst Electrical Electronics Engineers Inc2024

Exact Diffusion for Distributed Optimization and Learning-Part II: Convergence Analysis

Ali H. Sayed, Kun Yuan, Bicheng Ying

Part I of this paper developed the exact diffusion algorithm to remove the bias that is characteristic of distributed solutions for deterministic optimization problems. The algorithm was shown to be applicable to the larger set of locally balanced left-sto ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2019

Graph Learning with Partial Observations: Role of Degree Concentration

Ali H. Sayed, Augusto José Rabelo Almeida Santos

In this work we consider the problem of learning an Erdos-Renyi graph over a diffusion network when: i) data from only a limited subset of nodes are available (partial observation); ii) and the inferential goal is to discover the graph of interconnections ...

IEEE2019

Distributed Inference over Multitask Graphs under Smoothness

Ali H. Sayed, Stefan Vlaski, Roula Nassif

This paper formulates a multitask optimization problem where agents in the network have individual objectives to meet, or individual parameter vectors to estimate, subject to a smoothness condition over the graph. The smoothness requirement softens the tra ...

IEEE2018

Distributed Learning in Non-Convex Environments-Part I: Agreement at a Linear Rate

Ali H. Sayed, Stefan Vlaski

Driven by the need to solve increasingly complex optimization problems in signal processing and machine learning, there has been increasing interest in understanding the behavior of gradient-descent algorithms in non-convex environments. Most available wor ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2021

Causal Influence in Federated Edge Inference

Ali H. Sayed, Mert Kayaalp, Yunus Inan

In this paper, we consider a setting where heterogeneous agents with connectivity are performing inference using unlabeled streaming data. Observed data are only partially informative about the target variable of interest. In order to overcome the uncertai ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2024

Exact Diffusion for Distributed Optimization and Learning-Part I: Algorithm Development

Ali H. Sayed, Kun Yuan, Bicheng Ying

This paper develops a distributed optimization strategy with guaranteed exact convergence for a broad class of left-stochastic combination policies. The resulting exact diffusion strategy is shown in Part II of this paper to have a wider stability range an ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2019

Dual Coupled Diffusion for Distributed Optimization with Affine Constraints

Ali H. Sayed, Kun Yuan, Sulaiman A S A E Alghunaim

In this work, a distributed multi-agent optimization problem is studied where different subsets of agents are coupled with each other through affine constraints. Moreover, each agent is only aware of its own contribution to the constraints and only knows w ...

IEEE2018

Multitask Learning Over Graphs: An Approach for Distributed, Streaming Machine Learning

Ali H. Sayed, Stefan Vlaski, Roula Nassif

The problem of simultaneously learning several related tasks has received considerable attention in several domains, especially in machine learning, with the so-called multitask learning (MTL) problem, or learning to learn problem [1], [2]. MTL is an appro ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2020

DECENTRALIZED FUSION OF EXPERTS OVER NETWORKS

Ali H. Sayed

This article considers a network of agents interested in solving a classification t ask. The datasets available to accomplish the task are heterogeneous and dispersed across the agents. Each agent is inter-ested in discriminating among the 'inner' hypothes ...

IEEE Computer Society2024

Diffusion LMS With Communication Delays: Stability and Performance Analysis

Ali H. Sayed, Roula Nassif

We study the problem of distributed estimation over adaptive networks where communication delays exist between nodes. In particular, we investigate the diffusion Least-Mean-Square (LMS) strategy where delayed intermediate estimates (due to the communicatio ...

IEEE Institute of Electrical and Electronics Engineers2020

Social Learning with Disparate Hypotheses

Ali H. Sayed, Stefan Vlaski, Virginia Bordignon, Konstantinos Ntemos

In this paper we study the problem of social learning under multiple true hypotheses and self-interested agents. In this setup, each agent receives data that might be generated from a different hypothesis (or state) than the data other agents receive. In c ...

IEEE2022

Learning Dynamic Graphs under Partial Observability

Ali H. Sayed

This work examines the problem of learning a network graph from signals emitted by the network nodes, according to a diffusion model ruled by a Laplacian combination policy. The challenging regime of partial observability is considered, where signals are c ...

IEEE2023

Gramian-Based Adaptive Combination Policies For Diffusion Learning Over Networks

Ali H. Sayed, Stefan Vlaski

This paper presents an adaptive combination strategy for distributed learning over diffusion networks. Since learning relies on the collaborative processing of the stochastic information at the dispersed agents, the overall performance can be improved by d ...

IEEE2021

Causal Impact Analysis for Asynchronous Decision Making

Ali H. Sayed, Mert Kayaalp, Yunus Inan

We consider a collaborative decision-making framework where heterogeneous agents receive streaming and partially informative observations. We consider two asynchronous scenarios that differ based on the agents' participation patterns and the fusion center' ...

IEEE2024

Non-asymptotic performance of social machine learning under limited data

Ali H. Sayed, Virginia Bordignon, Mert Kayaalp, Ping Hu

This paper studies the probability of error associated with the social machine learning framework, which involves an independent training phase followed by a cooperative decision-making phase over a graph. This framework addresses the problem of classifyin ...

2025