Displaying similar documents to “Semi-group methods in stochastic control”

A complete description of dynamics generated by birth-and-death problem: a semigroup approach

Jacek Banasiak (2003)

Banach Center Publications

Similarity:

We shall present necessary and sufficient conditions for both conservativity and uniqueness of solutions to birth-and-death system of equations using methods of semigroup theory. The derived conditions correspond to the uniqueness criteria for forward and backward birth-and-death systems due to Reuter, [10,11,1], that were derived in a different context by Markov processes' techniques.

Semi-Markov control processes with non-compact action spaces and discontinuous costs

Anna Jaśkiewicz (2009)

Applicationes Mathematicae

Similarity:

We establish the average cost optimality equation and show the existence of an (ε-)optimal stationary policy for semi-Markov control processes without compactness and continuity assumptions. The only condition we impose on the model is the V-geometric ergodicity of the embedded Markov chain governed by a stationary policy.

Modelling and optimal control of networked systems with stochastic communication protocols

Chaoqun Zhu, Bin Yang, Xiang Zhu (2020)

Kybernetika

Similarity:

This paper is concerned with the finite and infinite horizon optimal control issue for a class of networked control systems with stochastic communication protocols. Due to the limitation of networked bandwidth, only the limited number of sensors and actuators are allowed to get access to network mediums according to stochastic access protocols. A discrete-time Markov chain with a known transition probability matrix is employed to describe the scheduling behaviors of the stochastic access...

Semi-Markov control models with average costs

Fernando Luque-Vásquez, Onésimo Hernández-Lerma (1999)

Applicationes Mathematicae

Similarity:

This paper studies semi-Markov control models with Borel state and control spaces, and unbounded cost functions, under the average cost criterion. Conditions are given for (i) the existence of a solution to the average cost optimality equation, and for (ii) the existence of strong optimal control policies. These conditions are illustrated with a semi-Markov replacement model.

Estimation of hidden Markov models for a partially observed risk sensitive control problem

Bernard Frankpitt, John S. Baras (1998)

Kybernetika

Similarity:

This paper provides a summary of our recent work on the problem of combined estimation and control of systems described by finite state, hidden Markov models. We establish the stochastic framework for the problem, formulate a separated control policy with risk-sensitive cost functional, describe an estimation scheme for the parameters of the hidden Markov model that describes the plant, and finally indicate how the combined estimation and control problem can be re-formulated in a framework...