Forskning ved Københavns Universitet - Københavns Universitet


Hierarchic Markov processes and their applications in replacement models

Publikation: Bidrag til tidsskriftTidsskriftartikelForskningfagfællebedømt

In this paper a new notion of a hierarchic Markov process is introduced. It is a series of Markov decision processes called subprocesses built together in one Markov decision process called the main process. The hierarchic structure is specially designed to fit replacement models which in the traditional formulation as ordinary Markov decision processes are usually very large. The basic theory of hierarchic Markov processes is described and examples are given of applications in replacement models. The theory can be extended to fit a situation where the replacement decision depends on the quality of the new asset available for replacement.

TidsskriftEuropean Journal of Operational Research
Udgave nummer2
Sider (fra-til)207-215
Antal sider9
StatusUdgivet - 1 jan. 1988

ID: 226949894