Distributed Asynchronous Deterministic and Stochastic Gradient Optimization Algorithms

John N. Tsitsiklis, Dimitri P. Bertsekas, Michael Athans

Research output: Contribution to journalArticlepeer-review

1393 Scopus citations


We present a model for asynchronous distributed computation and then proceed to analyze the convergence of natural asynchronous distributed versions of a large class of deterministic and stochastic gradient-like algorithms. We show that such algorithms retain the desirable convergence properties of their centralized counterparts, provided that the time between consecutive interprocessor communications and the communication delays are not too large.

Original languageEnglish (US)
Pages (from-to)803-812
Number of pages10
JournalIEEE Transactions on Automatic Control
Issue number9
StatePublished - Sep 1986
Externally publishedYes

ASJC Scopus subject areas

  • Control and Systems Engineering
  • Computer Science Applications
  • Electrical and Electronic Engineering


Dive into the research topics of 'Distributed Asynchronous Deterministic and Stochastic Gradient Optimization Algorithms'. Together they form a unique fingerprint.

Cite this