On convergence in distribution of the Markov chain generated by the filter kernel induced by a fully dominated Hidden Markov Model

Thomas Kaijser

  • 2016

Abstract

top
Consider a Hidden Markov Model (HMM) such that both the state space and the observation space are complete, separable, metric spaces and for which both the transition probability function (tr.pr.f.) determining the hidden Markov chain of the HMM and the tr.pr.f. determining the observation sequence of the HMM have densities. Such HMMs are called fully dominated. In this paper we consider a subclass of fully dominated HMMs which we call regular. A fully dominated, regular HMM induces a tr.pr.f. on the set of probability density functions on the state space which we call the filter kernel induced by the HMM and which can be interpreted as the Markov kernel associated to the sequence of conditional state distributions. We show that if the underlying hidden Markov chain of the fully dominated, regular HMM is strongly ergodic and a certain coupling condition is fulfilled, then, in the limit, the distribution of the conditional distribution becomes independent of the initial distribution of the hidden Markov chain and, if also the hidden Markov chain is uniformly ergodic, then the distributions tend towards a limit distribution. In the last part of the paper, we present some more explicit conditions, implying that the coupling condition mentioned above is satisfied.

How to cite

top

Thomas Kaijser. On convergence in distribution of the Markov chain generated by the filter kernel induced by a fully dominated Hidden Markov Model. 2016. <http://eudml.org/doc/285960>.

@book{ThomasKaijser2016,
abstract = { Consider a Hidden Markov Model (HMM) such that both the state space and the observation space are complete, separable, metric spaces and for which both the transition probability function (tr.pr.f.) determining the hidden Markov chain of the HMM and the tr.pr.f. determining the observation sequence of the HMM have densities. Such HMMs are called fully dominated. In this paper we consider a subclass of fully dominated HMMs which we call regular. A fully dominated, regular HMM induces a tr.pr.f. on the set of probability density functions on the state space which we call the filter kernel induced by the HMM and which can be interpreted as the Markov kernel associated to the sequence of conditional state distributions. We show that if the underlying hidden Markov chain of the fully dominated, regular HMM is strongly ergodic and a certain coupling condition is fulfilled, then, in the limit, the distribution of the conditional distribution becomes independent of the initial distribution of the hidden Markov chain and, if also the hidden Markov chain is uniformly ergodic, then the distributions tend towards a limit distribution. In the last part of the paper, we present some more explicit conditions, implying that the coupling condition mentioned above is satisfied. },
author = {Thomas Kaijser},
keywords = {hidden Markov models; filtering processes; Markov chains on nonlocally compact spaces; Kantorovich distance; barycenter},
language = {eng},
title = {On convergence in distribution of the Markov chain generated by the filter kernel induced by a fully dominated Hidden Markov Model},
url = {http://eudml.org/doc/285960},
year = {2016},
}

TY - BOOK
AU - Thomas Kaijser
TI - On convergence in distribution of the Markov chain generated by the filter kernel induced by a fully dominated Hidden Markov Model
PY - 2016
AB - Consider a Hidden Markov Model (HMM) such that both the state space and the observation space are complete, separable, metric spaces and for which both the transition probability function (tr.pr.f.) determining the hidden Markov chain of the HMM and the tr.pr.f. determining the observation sequence of the HMM have densities. Such HMMs are called fully dominated. In this paper we consider a subclass of fully dominated HMMs which we call regular. A fully dominated, regular HMM induces a tr.pr.f. on the set of probability density functions on the state space which we call the filter kernel induced by the HMM and which can be interpreted as the Markov kernel associated to the sequence of conditional state distributions. We show that if the underlying hidden Markov chain of the fully dominated, regular HMM is strongly ergodic and a certain coupling condition is fulfilled, then, in the limit, the distribution of the conditional distribution becomes independent of the initial distribution of the hidden Markov chain and, if also the hidden Markov chain is uniformly ergodic, then the distributions tend towards a limit distribution. In the last part of the paper, we present some more explicit conditions, implying that the coupling condition mentioned above is satisfied.
LA - eng
KW - hidden Markov models; filtering processes; Markov chains on nonlocally compact spaces; Kantorovich distance; barycenter
UR - http://eudml.org/doc/285960
ER -

NotesEmbed ?

top

You must be logged in to post comments.

To embed these notes on your page include the following JavaScript code on your page where you want the notes to appear.

Only the controls for the widget will be shown in your chosen language. Notes will be shown in their authored language.

Tells the widget how many notes to show per page. You can cycle through additional notes using the next and previous controls.

    
                

Note: Best practice suggests putting the JavaScript code just before the closing </body> tag.