Limiting average cost control problems in a class of discrete-time stochastic systems

Nadine Hilgert; Onesimo Hernández-Lerma

Applicationes Mathematicae (2001)

  • Volume: 28, Issue: 1, page 111-123
  • ISSN: 1233-7234

Abstract

top
We consider a class of d -valued stochastic control systems, with possibly unbounded costs. The systems evolve according to a discrete-time equation x t + 1 = G ( x t , a t ) + ξ t (t = 0,1,... ), for each fixed n = 0,1,..., where the ξ t are i.i.d. random vectors, and the Gₙ are given functions converging pointwise to some function G as n → ∞. Under suitable hypotheses, our main results state the existence of stationary control policies that are expected average cost (EAC) optimal and sample path average cost (SPAC) optimal for the limiting control system x t + 1 = G ( x t , a t ) + ξ t (t = 0,1,...).

How to cite

top

Nadine Hilgert, and Onesimo Hernández-Lerma. "Limiting average cost control problems in a class of discrete-time stochastic systems." Applicationes Mathematicae 28.1 (2001): 111-123. <http://eudml.org/doc/279078>.

@article{NadineHilgert2001,
abstract = {We consider a class of $ℝ^d$-valued stochastic control systems, with possibly unbounded costs. The systems evolve according to a discrete-time equation $x_\{t+1\} = Gₙ(x_t,a_t)+ξ_t$ (t = 0,1,... ), for each fixed n = 0,1,..., where the $ξ_t$ are i.i.d. random vectors, and the Gₙ are given functions converging pointwise to some function $G_\{∞\}$ as n → ∞. Under suitable hypotheses, our main results state the existence of stationary control policies that are expected average cost (EAC) optimal and sample path average cost (SPAC) optimal for the limiting control system $x_\{t+1\} = G_\{∞\}(x_t,a_t)+ξ_t$ (t = 0,1,...).},
author = {Nadine Hilgert, Onesimo Hernández-Lerma},
journal = {Applicationes Mathematicae},
keywords = {nonhomogeneous Markov control processes; discrete-time stochastic systems; long-run average cost criteria; discounted cost; optimal policies; existence of stationary policies; unbounded costs},
language = {eng},
number = {1},
pages = {111-123},
title = {Limiting average cost control problems in a class of discrete-time stochastic systems},
url = {http://eudml.org/doc/279078},
volume = {28},
year = {2001},
}

TY - JOUR
AU - Nadine Hilgert
AU - Onesimo Hernández-Lerma
TI - Limiting average cost control problems in a class of discrete-time stochastic systems
JO - Applicationes Mathematicae
PY - 2001
VL - 28
IS - 1
SP - 111
EP - 123
AB - We consider a class of $ℝ^d$-valued stochastic control systems, with possibly unbounded costs. The systems evolve according to a discrete-time equation $x_{t+1} = Gₙ(x_t,a_t)+ξ_t$ (t = 0,1,... ), for each fixed n = 0,1,..., where the $ξ_t$ are i.i.d. random vectors, and the Gₙ are given functions converging pointwise to some function $G_{∞}$ as n → ∞. Under suitable hypotheses, our main results state the existence of stationary control policies that are expected average cost (EAC) optimal and sample path average cost (SPAC) optimal for the limiting control system $x_{t+1} = G_{∞}(x_t,a_t)+ξ_t$ (t = 0,1,...).
LA - eng
KW - nonhomogeneous Markov control processes; discrete-time stochastic systems; long-run average cost criteria; discounted cost; optimal policies; existence of stationary policies; unbounded costs
UR - http://eudml.org/doc/279078
ER -

NotesEmbed ?

top

You must be logged in to post comments.

To embed these notes on your page include the following JavaScript code on your page where you want the notes to appear.

Only the controls for the widget will be shown in your chosen language. Notes will be shown in their authored language.

Tells the widget how many notes to show per page. You can cycle through additional notes using the next and previous controls.

    
                

Note: Best practice suggests putting the JavaScript code just before the closing </body> tag.