Exact decomposition approaches for Markov decision processes: a survey.
The expected cumulative operational time for finite semi-Markov systems and estimation
In this paper we, firstly, present a recursive formula of the empirical estimator of the semi-Markov kernel. Then a non-parametric estimator of the expected cumulative operational time for semi-Markov systems is proposed. The asymptotic properties of this estimator, as the uniform strongly consistency and normality are given. As an illustration example, we give a numerical application.
Page 1