On some recent aspects of stochastic control and their applications.
On some stability properties of stochastic differential equations of Itô's type
On steady state minimum variance control strategy
On the adaptive control of countable Markov chains
On the application of statistical kernel estimators for the demand-based design of a wireless data transmission system
On the Argmin-sets of stochastic processes and their distributional convergence in Fell-type-topologies
Let be the collection of all -optimal solutions for a stochastic process with locally bounded trajectories defined on a topological space. For sequences of such stochastic processes and of nonnegative random variables we give sufficient conditions for the (closed) random sets to converge in distribution with respect to the Fell-topology and to the coarser Missing-topology.
On the Asymptotic Behaviour of Linear Learning Processes with Partial Forgetting.
On the Bellman equation for asymptotics of utility from terminal wealth
The asymptotics of utility from terminal wealth is studied. First, a finite horizon problem for any utility function is considered. To study a long run infinite horizon problem, a certain positive homogeneity (PH) assumption is imposed. It is then shown that assumption (PH) is practically satisfied only by power and logarithmic utility functions.
On the boundary ergodic problem for fully nonlinear equations in bounded domains with general nonlinear Neumann boundary conditions
On the consistency of a least squares identification procedure
On the convergence of the dynamic stochastic approximation method for stochastic non-linear multidimensional dynamic systems
On the convergence of the ensemble Kalman filter
Convergence of the ensemble Kalman filter in the limit for large ensembles to the Kalman filter is proved. In each step of the filter, convergence of the ensemble sample covariance follows from a weak law of large numbers for exchangeable random variables, the continuous mapping theorem gives convergence in probability of the ensemble members, and bounds on the ensemble then give convergence.
On the convergence of the wavelet-Galerkin method for nonlinear filtering
The aim of the paper is to examine the wavelet-Galerkin method for the solution of filtering equations. We use a wavelet biorthogonal basis with compact support for approximations of the solution. Then we compute the Zakai equation for our filtering problem and consider the implicit Euler scheme in time and the Galerkin scheme in space for the solution of the Zakai equation. We give theorems on convergence and its rate. The method is numerically much more efficient than the classical Galerkin method....
On the derivation of the nonlinear discrete equations numerically integrating the Euler PDEs.
On the discrete time-varying JLQG problem
In the present paper optimal time-invariant state feedback controllers are designed for a class of discrete time-varying control systems with Markov jumping parameter and quadratic performance index. We assume that the coefficients have limits as time tends to infinity and the boundary system is absolutely observable and stabilizable. Moreover, following the same line of reasoning, an adaptive controller is proposed in the case when system parameters are unknown but their strongly consistent estimators...
On the Distribution of the Present Value of Interest in Continuous Compounding
On the evaluation of properties of the sequential probability ratio test for statistically dependent observations
On the exact controllability of a nonlinear stochastic heat equation.
On the identification of a subclass of finite state channels and their capacity
On the infinite time horizon linear-quadratic regulator problem under a fractional brownian perturbation
In this paper we solve the basic fractional analogue of the classical infinite time horizon linear-quadratic gaussian regulator problem. For a completely observable controlled linear system driven by a fractional brownian motion, we describe explicitely the optimal control policy which minimizes an asymptotic quadratic performance criterion.