Displaying similar documents to “On adaptive control of a partially observed Markov chain”

Average cost Markov control processes with weighted norms: value iteration

Evgueni Gordienko, Onésimo Hernández-Lerma (1995)

Applicationes Mathematicae

Similarity:

This paper shows the convergence of the value iteration (or successive approximations) algorithm for average cost (AC) Markov control processes on Borel spaces, with possibly unbounded cost, under appropriate hypotheses on weighted norms for the cost function and the transition law. It is also shown that the aforementioned convergence implies strong forms of AC-optimality and the existence of forecast horizons.

Efficient algorithm to solve optimal boundary control problem for Burgers' equation

Alaeddin Malek, Roghayeh Ebrahim Nataj, Mohamad Javad Yazdanpanah (2012)

Kybernetika

Similarity:

In this paper, we propose a novel algorithm for solving an optimal boundary control problem of the Burgers' equation. The solving method is based on the transformation of the original problem into a homogeneous boundary conditions problem. This transforms the original problem into an optimal distributed control problem. The modal expansion technique is applied to the distributed control problem of the Burgers' equation to generate a low-dimensional dynamical system. The control parametrization...

A consumption-investment problem modelled as a discounted Markov decision process

Hugo Cruz-Suárez, Raúl Montes-de-Oca, Gabriel Zacarías (2011)

Kybernetika

Similarity:

In this paper a problem of consumption and investment is presented as a model of a discounted Markov decision process with discrete-time. In this problem, it is assumed that the wealth is affected by a production function. This assumption gives the investor a chance to increase his wealth before the investment. For the solution of the problem there is established a suitable version of the Euler Equation (EE) which characterizes its optimal policy completely, that is, there are provided...

Optimal control processes associated with a class of discontinuous control systems: Applications to sliding mode dynamics

Arturo Enrique Gil García, Vadim Azhmyakov, Michael V. Basin (2014)

Kybernetika

Similarity:

This paper presents a theoretical approach to optimal control problems (OCPs) governed by a class of control systems with discontinuous right-hand sides. A possible application of the framework developed in this paper is constituted by the conventional sliding mode dynamic processes. The general theory of constrained OCPs is used as an analytic background for designing numerically tractable schemes and computational methods for their solutions. The proposed analytic method guarantees...

High-Order Control Variations and Small-Time Local Controllability

Krastanov, Mikhail (2010)

Serdica Journal of Computing

Similarity:

The importance of “control variations” for obtaining local approximations of the reachable set of nonlinear control systems is well known. Heuristically, if one can construct control variations in all possible directions, then the considered control system is small-time locally controllable (STLC). Two concepts of control variations of higher order are introduced for the case of smooth control systems. The relation between these variations and the small-time local controllability is...