All a b c d e f g h i j k l m n o p q r s t u v w x y z Other

Previous Page 4 Next

Displaying 61 – 80 of 862

Showing per page

A spectral characterization of the behavior of discrete time AR–representations over a finite time interval

E. N. Antoniou, Antonis I. G. Vardulakis, Nikolas P. Karampetakis (1998)

Kybernetika

In this paper we investigate the behavior of the discrete time AR (Auto Regressive) representations over a finite time interval, in terms of the finite and infinite spectral structure of the polynomial matrix involved in the AR-equation. A boundary mapping equation and a closed formula for the determination of the solution, in terms of the boundary conditions, are also gived.

A stopping rule for discounted Markov decision processes with finite action sets

Raúl Montes-de-Oca, Enrique Lemus-Rodríguez, Daniel Cruz-Suárez (2009)

Kybernetika

In a Discounted Markov Decision Process (DMDP) with finite action sets the Value Iteration Algorithm, under suitable conditions, leads to an optimal policy in a finite number of steps. Determining an upper bound on the necessary number of steps till gaining convergence is an issue of great theoretical and practical interest as it would provide a computationally feasible stopping rule for value iteration as an algorithm for finding an optimal policy. In this paper we find such a bound depending only...

About the linear-quadratic regulator problem under a fractional brownian perturbation

M. L. Kleptsyna, Alain Le Breton, M. Viot (2003)

ESAIM: Probability and Statistics

In this paper we solve the basic fractional analogue of the classical linear-quadratic gaussian regulator problem in continuous time. For a completely observable controlled linear system driven by a fractional brownian motion, we describe explicitely the optimal control policy which minimizes a quadratic performance criterion.

About the linear-quadratic regulator problem under a fractional Brownian perturbation

M. L. Kleptsyna, Alain Le Breton, M. Viot (2010)

ESAIM: Probability and Statistics

In this paper we solve the basic fractional analogue of the classical linear-quadratic Gaussian regulator problem in continuous time. For a completely observable controlled linear system driven by a fractional Brownian motion, we describe explicitely the optimal control policy which minimizes a quadratic performance criterion.

Active fault diagnosis based on stochastic tests

Niels K. Poulsen, Henrik Niemann (2008)

International Journal of Applied Mathematics and Computer Science

The focus of this paper is on stochastic change detection applied in connection with active fault diagnosis (AFD). An auxiliary input signal is applied in AFD. This signal injection in the system will in general allow us to obtain a fast change detection/isolation by considering the output or an error output from the system. The classical cumulative sum (CUSUM) test will be modified with respect to the AFD approach applied. The CUSUM method will be altered such that it will be able to detect a change...

Adaptive control for discrete-time Markov processes with unbounded costs: Discounted criterion

Evgueni I. Gordienko, J. Adolfo Minjárez-Sosa (1998)

Kybernetika

We study the adaptive control problem for discrete-time Markov control processes with Borel state and action spaces and possibly unbounded one-stage costs. The processes are given by recurrent equations x t + 1 = F ( x t , a t , ξ t ) , t = 0 , 1 , ... with i.i.d. ℜ k -valued random vectors ξ t whose density ρ is unknown. Assuming observability of ξ t we propose the procedure of statistical estimation of ρ that allows us to prove discounted asymptotic optimality of two types of adaptive policies used early for the processes with bounded costs.

Adaptive control of discrete time Markov processes by the large deviations method

T. Duncan, B. Pasik-Duncan, Łukasz Stettner (2000)

Applicationes Mathematicae

Some discrete time controlled Markov processes in a locally compact metric space whose transition operators depend on an unknown parameter are described. The adaptive controls are constructed using the large deviations of empirical distributions which are uniform in the parameter that takes values in a compact set. The adaptive procedure uses a finite family of continuous, almost optimal controls. Using the large deviations property it is shown that an adaptive control which is a fixed almost optimal...

Currently displaying 61 – 80 of 862