The search session has expired. Please query the service again.
A number of recent works have sought to generalize the Kolmogorov-Sinai entropy of probability-preserving transformations to the setting of Markov operators acting on the integrable functions on a probability space (X,μ). These works have culminated in a proof by Downarowicz and Frej that various competing definitions all coincide, and that the resulting quantity is uniquely characterized by certain abstract properties.
On the other hand, Makarov has shown that this 'operator...
We provide an extension of topological methods applied to a certain class of Non Feller Models which we call Quasi-Feller. We give conditions to ensure the existence of a stationary distribution. Finally, we strengthen the conditions to obtain a positive Harris recurrence, which in turn implies the existence of a strong law of large numbers.
We provide an extension of topological methods applied to a
certain class of Non Feller Models which we call Quasi-Feller. We
give conditions to ensure the existence of a stationary
distribution. Finally, we strengthen the conditions to obtain a
positive Harris recurrence, which in turn implies the existence
of a strong law of large numbers.
We extend previous results of the same authors ([11]) on the effects of perturbation in the transition probability of a Markov cost chain for discounted Markov control processes. Supposing valid, for each stationary policy, conditions of Lyapunov and Harris type, we get upper bounds for the index of perturbations, defined as the difference of the total expected discounted costs for the original Markov control process and the perturbed one. We present examples that satisfy our conditions.
This work concerns Markov decision chains with finite state and action sets. The transition law satisfies the simultaneous Doeblin condition but is unknown to the controller, and the problem of determining an optimal adaptive policy with respect to the average reward criterion is addressed. A subset of policies is identified so that, when the system evolves under a policy in that class, the frequency estimators of the transition law are consistent on an essential set of admissible state-action pairs,...
We consider evaluating improper priors in a formal Bayes setting according to the consequences of their use. Let be a class of functions on the parameter space and consider estimating elements of under quadratic loss. If the formal Bayes estimator of every function in is admissible, then the prior is strongly admissible with respect to . Eaton’s method for establishing strong admissibility is based on studying the stability properties of a particular Markov chain associated with the inferential...
Currently displaying 1 –
9 of
9