On the generation of Markov decision processes

T. W. Archibald, K. I. M. McKinnon, L. C. Thomas*

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

Abstract / Description of output

Comparisons of the performance of solution algorithms for Markov decision processes rely heavily on problem generators to provide sizeable sets of test problems. Existing generation techniques allow little control over the properties of the test problems and often result in problems which are not typical of real-world examples. This paper identifies the properties of Markov decision processes which affect the performance of solution algorithms, and also describes a new problem generation technique which allows all of these properties to be controlled.

Original languageEnglish
Pages (from-to)354-361
Number of pages8
JournalJournal of the Operational Research Society
Issue number3
Publication statusPublished - Mar 1995

Keywords / Materials (for Non-textual outputs)

  • Markov decision processes
  • problem generation
  • simulation


Dive into the research topics of 'On the generation of Markov decision processes'. Together they form a unique fingerprint.

Cite this