Displaying similar documents to “Option pricing in a regime-switching model using the fast Fourier transform.”

Single-use reliability computation of a semi-Markovian system

Guglielmo D'Amico (2014)

Applications of Mathematics

Similarity:

Markov chain usage models were successfully used to model systems and software. The most prominent approaches are the so-called failure state models Whittaker and Thomason (1994) and the arc-based Bayesian models Sayre and Poore (2000). In this paper we propose arc-based semi-Markov usage models to test systems. We extend previous studies that rely on the Markov chain assumption to the more general semi-Markovian setting. Among the obtained results we give a closed form representation...

Second Order optimality in Markov decision chains

Karel Sladký (2017)

Kybernetika

Similarity:

The article is devoted to Markov reward chains in discrete-time setting with finite state spaces. Unfortunately, the usual optimization criteria examined in the literature on Markov decision chains, such as a total discounted, total reward up to reaching some specific state (called the first passage models) or mean (average) reward optimality, may be quite insufficient to characterize the problem from the point of a decision maker. To this end it seems that it may be preferable if not...

Central limit theorem for hitting times of functionals of Markov jump processes

Christian Paroissin, Bernard Ycart (2004)

ESAIM: Probability and Statistics

Similarity:

A sample of i.i.d. continuous time Markov chains being defined, the sum over each component of a real function of the state is considered. For this functional, a central limit theorem for the first hitting time of a prescribed level is proved. The result extends the classical central limit theorem for order statistics. Various reliability models are presented as examples of applications.

Local degeneracy of Markov chain Monte Carlo methods

Kengo Kamatani (2014)

ESAIM: Probability and Statistics

Similarity:

We study asymptotic behavior of Markov chain Monte Carlo (MCMC) procedures. Sometimes the performances of MCMC procedures are poor and there are great importance for the study of such behavior. In this paper we call degeneracy for a particular type of poor performances. We show some equivalent conditions for degeneracy. As an application, we consider the cumulative probit model. It is well known that the natural data augmentation (DA) procedure does not work well for this model and the...

Risk-sensitive average optimality in Markov decision processes

Karel Sladký (2018)

Kybernetika

Similarity:

In this note attention is focused on finding policies optimizing risk-sensitive optimality criteria in Markov decision chains. To this end we assume that the total reward generated by the Markov process is evaluated by an exponential utility function with a given risk-sensitive coefficient. The ratio of the first two moments depends on the value of the risk-sensitive coefficient; if the risk-sensitive coefficient is equal to zero we speak on risk-neutral models. Observe that the first...