In the present paper optimal time-invariant state feedback controllers are designed for a class of discrete time-varying control systems with Markov jumping parameter and quadratic performance index. We assume that the coefficients have limits as time tends to infinity and the boundary system is absolutely observable and stabilizable. Moreover, following the same line of reasoning, an adaptive controller is proposed in the case when system parameters are unknown but their strongly consistent estimators...

We first generalize, in an abstract framework, results on the order of convergence of a semi-discretization in time by an implicit Euler scheme of a stochastic parabolic equation. In this part, all the coefficients are globally Lipchitz. The case when the nonlinearity is only locally Lipchitz is then treated. For the sake of simplicity, we restrict our attention to the Burgers equation. We are not able in this case to compute a pathwise order of the approximation, we introduce the weaker notion...

We first generalize, in an abstract framework, results on the order of convergence of a semi-discretization in time by an implicit Euler scheme of a stochastic parabolic equation. In this part, all the coefficients are globally Lipchitz. The case when the nonlinearity is only locally Lipchitz is then treated. For the sake of simplicity, we restrict our attention to the Burgers equation. We are not able in this case to compute a pathwise order of the approximation, we introduce the weaker notion...

Let X = (Xₜ,ℱₜ) be a continuous BMO-martingale, that is, ${\left|\right|X\left|\right|}_{BMO}\equiv su{p}_T\left|\right|E\left[\right|X_{\infty }-X_T\left|\right|{ℱ}_T{\left]\right||}_{\infty }<\infty$, where the supremum is taken over all stopping times T. Define the critical exponent b(X) by $b\left(X\right)=b>0:su{p}_T\left|\right|E\left[exp\left(b²(⟨X{⟩}_{\infty }-⟨X{⟩}_T)\right)\right|{ℱ}_T]{\left|\right|}_{\infty }<\infty$, where the supremum is taken over all stopping times T. Consider the continuous martingale q(X) defined by $q\left(X\right)ₜ=E\left[⟨X{⟩}_{\infty }\right|ℱₜ]-E\left[⟨X{⟩}_{\infty }\right|ℱ₀]$. We use q(X) to characterize the distance between ⟨X⟩ and the class $L^{\infty }$ of all bounded martingales in the space of continuous BMO-martingales, and we show that the inequalities $1/4d₁(q\left(X\right),L^{\infty })\le b\left(X\right)\le 4/d₁(q\left(X\right),L^{\infty })$ hold for every continuous BMO-martingale X.

Given a normalized Orlicz function M we provide an easy formula for a distribution such that, if X is a random variable distributed accordingly and X₁,...,Xₙ are independent copies of X, then $1/C_p{\left|\right|x\left|\right|}_M\le \left|\right|\left(x_i{X}_i\right){ⁿ}_{i=1}{\left|\right|}_p\le C_p{\left|\right|x\left|\right|}_M$, where $C_p$ is a positive constant depending only on p. In case p = 2 we need the function t ↦ tM’(t) - M(t) to be 2-concave and as an application immediately obtain an embedding of the corresponding Orlicz spaces into L₁[0,1]. We also provide a general result replacing the ${\ell }_p$-norm by an arbitrary N-norm. This...