Serial and parallel value iteration algorithms for discounted Markov decision processes

T. W. Archibald*, K. I.M. McKinnon, L. C. Thomas

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

Abstract / Description of output

This paper examines several serial value iteration solution algorithms for Markov decision processes and develops efficient analogous parallel algorithms. The results include a comparison of the computational performance of both the serial and the parallel algorithms and explain how the performance depends upon the properties of the problems being solved.

Original languageEnglish
Pages (from-to)188-203
Number of pages16
JournalEuropean Journal of Operational Research
Volume67
Issue number2
DOIs
Publication statusPublished - 11 Jun 1993

Keywords / Materials (for Non-textual outputs)

  • dynamic programming
  • Markov decision processes
  • parallel programming
  • transputers

Fingerprint

Dive into the research topics of 'Serial and parallel value iteration algorithms for discounted Markov decision processes'. Together they form a unique fingerprint.

Cite this