Displaying similar documents to “On impulsive control with long run average cost criterion”

On nearly selfoptimizing strategies for multiarmed bandit problems with controlled arms

Ewa Drabik (1996)

Applicationes Mathematicae

Similarity:

Two kinds of strategies for a multiarmed Markov bandit problem with controlled arms are considered: a strategy with forcing and a strategy with randomization. The choice of arm and control function in both cases is based on the current value of the average cost per unit time functional. Some simulation results are also presented.

On the discrepancy of Markov-normal sequences

M. B. Levin (1996)

Journal de théorie des nombres de Bordeaux

Similarity:

We construct a Markov normal sequence with a discrepancy of O ( N - 1 / 2 log 2 N ) . The estimation of the discrepancy was previously known to be O ( e - c ( log N ) 1 / 2 ) .

Bounds on regeneration times and limit theorems for subgeometric Markov chains

Randal Douc, Arnaud Guillin, Eric Moulines (2008)

Annales de l'I.H.P. Probabilités et statistiques

Similarity:

This paper studies limit theorems for Markov chains with general state space under conditions which imply subgeometric ergodicity. We obtain a central limit theorem and moderate deviation principles for additive not necessarily bounded functional of the Markov chains under drift and minorization conditions which are weaker than the Foster–Lyapunov conditions. The regeneration-split chain method and a precise control of the modulated moment of the hitting time to small sets are employed...