Limit theorems for stochastic recursions with Markov dependent coefficients

Dariusz Buraczewski; Małgorzata Letachowicz

Displaying similar documents to “Limit theorems for stochastic recursions with Markov dependent coefficients”

Extending the Wong-Zakai theorem to reversible Markov processes

Richard F. Bass, B. Hambly, Terry Lyons (2002)

Journal of the European Mathematical Society

Similarity:

We show how to construct a canonical choice of stochastic area for paths of reversible Markov processes satisfying a weak Hölder condition, and hence demonstrate that the sample paths of such processes are rough paths in the sense of Lyons. We further prove that certain polygonal approximations to these paths and their areas converge in $p$ -variation norm. As a corollary of this result and standard properties of rough paths, we are able to provide a significant generalization of the classical...

Stochastic dynamical systems with weak contractivity properties I. Strong and local contractivity

Marc Peigné, Wolfgang Woess (2011)

Colloquium Mathematicae

Similarity:

Consider a proper metric space and a sequence ${(F ₙ)}_{n \geq 0}$ of i.i.d. random continuous mappings → . It induces the stochastic dynamical system (SDS) $X ₙ^{x} = F ₙ \circ . . . \circ F ₁ (x)$ starting at x ∈ . In this and the subsequent paper, we study existence and uniqueness of invariant measures, as well as recurrence and ergodicity of this process. In the present first part, we elaborate, improve and complete the unpublished work of Martin Benda on local contractivity, which merits publicity and provides an important tool for studying...

Nash -equilibria for stochastic games with total reward functions: an approach through Markov decision processes

Francisco J. González-Padilla, Raúl Montes-de-Oca (2019)

Kybernetika

Similarity:

The main objective of this paper is to find structural conditions under which a stochastic game between two players with total reward functions has an $ϵ$ -equilibrium. To reach this goal, the results of Markov decision processes are used to find $ϵ$ -optimal strategies for each player and then the correspondence of a better answer as well as a more general version of Kakutani’s Fixed Point Theorem to obtain the $ϵ$ -equilibrium mentioned. Moreover, two examples to illustrate the theory developed...

Viability theorems for stochastic inclusions

Michał Kisielewicz (1995)

Discussiones Mathematicae, Differential Inclusions, Control and Optimization

Similarity:

Sufficient conditions for the existence of solutions to stochastic inclusions $x_{t} - x_{s} \in \int_{s}^{t} F_{τ} (x_{τ}) d τ + \int_{s}^{t} G_{τ} (x_{τ}) d w_{τ} + \int_{s}^{t} \int_{I R ⁿ} H_{τ, z} (x_{τ}) ν ̃ (d τ, d z)$ beloning to a given set K of n-dimensional cádlág processes are given.

On Stochastic Differential Equations with Reflecting Boundary Condition in Convex Domains

Weronika Łaukajtys (2004)

Bulletin of the Polish Academy of Sciences. Mathematics

Similarity:

Let D be an open convex set in $ℝ^{d}$ and let F be a Lipschitz operator defined on the space of adapted càdlàg processes. We show that for any adapted process H and any semimartingale Z there exists a unique strong solution of the following stochastic differential equation (SDE) with reflection on the boundary of D: $X_{t} = H_{t} + \int_{0}^{t} ⟨ F {(X)}_{s -}, d Z_{s} ⟩ + K_{t}$ , t ∈ ℝ⁺. Our proofs are based on new a priori estimates for solutions of the deterministic Skorokhod problem.

Tangential Markov inequality in $L^{p}$ norms

Agnieszka Kowalska (2015)

Banach Center Publications

Similarity:

In 1889 A. Markov proved that for every polynomial p in one variable the inequality $| | p^{'} {| |}_{[- 1, 1]} {\leq (d e g p) ² | | p | |}_{[- 1, 1]}$ is true. Moreover, the exponent 2 in this inequality is the best possible one. A tangential Markov inequality is a generalization of the Markov inequality to tangential derivatives of certain sets in higher-dimensional Euclidean spaces. We give some motivational examples of sets that admit the tangential Markov inequality with the sharp exponent. The main theorems show that the results on certain arcs...

The Nagaev-Guivarc’h method via the Keller-Liverani theorem

Loïc Hervé, Françoise Pène (2010)

Bulletin de la Société Mathématique de France

Similarity:

The Nagaev-Guivarc’h method, via the perturbation operator theorem of Keller and Liverani, has been exploited in recent papers to establish limit theorems for unbounded functionals of strongly ergodic Markov chains. The main difficulty of this approach is to prove Taylor expansions for the dominating eigenvalue of the Fourier kernels. The paper outlines this method and extends it by stating a multidimensional local limit theorem, a one-dimensional Berry-Esseen theorem, a first-order...

Stochastic optimization problems with second order stochastic dominance constraints via Wasserstein metric

Vlasta Kaňková, Vadim Omelčenko (2018)

Kybernetika

Similarity:

Optimization problems with stochastic dominance constraints are helpful to many real-life applications. We can recall e. g., problems of portfolio selection or problems connected with energy production. The above mentioned constraints are very suitable because they guarantee a solution fulfilling partial order between utility functions in a given subsystem $𝒰$ of the utility functions. Especially, considering $𝒰 : = 𝒰_{1}$ (where $𝒰_{1}$ is a system of non decreasing concave nonnegative utility functions)...

Some Results on Stochastic Porous Media Equations

Viorel Barbu, Giuseppe Da Prato, Michael Röckner (2008)

Bollettino dell'Unione Matematica Italiana

Similarity:

Some recent results about nonnegative solutions of stochastic porous media equations in bounded open subsets of $\mathbb{R}^{3}$ are considered. The existence of an invariant measure is proved.

Stochastic dynamical systems with weak contractivity properties II. Iteration of Lipschitz mappings

Marc Peigné, Wolfgang Woess (2011)

Colloquium Mathematicae

Similarity:

In this continuation of the preceding paper (Part I), we consider a sequence ${(F ₙ)}_{n \geq 0}$ of i.i.d. random Lipschitz mappings → , where is a proper metric space. We investigate existence and uniqueness of invariant measures, as well as recurrence and ergodicity of the induced stochastic dynamical system (SDS) $X ₙ^{x} = F ₙ \circ . . . \circ F ₁ (x)$ starting at x ∈ . The main results concern the case when the associated Lipschitz constants are log-centered. Principal tools are local contractivity, as considered in detail in Part I,...

Two stationarity conditions in the $G I / r_{0} / M / r_{1}$ dam

M. Jankiewicz (1988)

Applicationes Mathematicae

Similarity:

Compact subsets of $C^{n}$ preserving Markov’s inequality

W. Plesniak (1988)

Matematički Vesnik

Similarity:

Metastability in reversible diffusion processes I: Sharp asymptotics for capacities and exit times

Anton Bovier, Michael Eckhoff, Véronique Gayrard, Markus Klein (2004)

Journal of the European Mathematical Society

Similarity:

We develop a potential theoretic approach to the problem of metastability for reversible diffusion processes with generators of the form $- ϵ Δ + \nabla F (\cdot) \nabla$ on $ℝ^{d}$ or subsets of $ℝ^{d}$ , where $F$ is a smooth function with finitely many local minima. In analogy to previous work on discrete Markov chains, we show that metastable exit times from the attractive domains of the minima of $F$ can be related, up to multiplicative errors that tend to one as $ϵ ↓ 0$ , to the capacities of suitably constructed sets. We show that...

Stochastic convolution in separable Banach spaces and the stochastic linear Cauchy problem

Zdzisław Brzeźniak, Jan van Neerven (2000)

Studia Mathematica

Similarity:

Let H be a separable real Hilbert space and let E be a separable real Banach space. We develop a general theory of stochastic convolution of ℒ(H,E)-valued functions with respect to a cylindrical Wiener process ${W_{t}^{H}}_{t \in [0, T]}$ with Cameron-Martin space H. This theory is applied to obtain necessary and sufficient conditions for the existence of a weak solution of the stochastic abstract Cauchy problem (ACP) $d X_{t} = A X_{t} d t + B d W_{t}^{H}$ (t∈ [0,T]), $X_{0} = 0$ almost surely, where A is the generator of a $C_{0}$ -semigroup ${S (t)}_{t \geq 0}$ of bounded linear...

Eigenvalues of operators in $L_{p}$ -spaces in Markov chains with a general state space

Zbyněk Šidák (1967)

Czechoslovak Mathematical Journal

Similarity:

A stochastic mirror-descent algorithm for solving $A X B = C$ over an multi-agent system

Yinghui Wang, Songsong Cheng (2021)

Kybernetika

Similarity:

In this paper, we consider a distributed stochastic computation of $A X B = C$ with local set constraints over an multi-agent system, where each agent over the network only knows a few rows or columns of matrixes. Through formulating an equivalent distributed optimization problem for seeking least-squares solutions of $A X B = C$ , we propose a distributed stochastic mirror-descent algorithm for solving the equivalent distributed problem. Then, we provide the sublinear convergence of the proposed algorithm....

The scaling limits of a heavy tailed Markov renewal process

Julien Sohier (2013)

Annales de l'I.H.P. Probabilités et statistiques

Similarity:

In this paper we consider heavy tailed Markov renewal processes and we prove that, suitably renormalised, they converge in law towards the $α$ -stable regenerative set. We then apply these results to the strip wetting model which is a random walk $S$ constrained above a wall and rewarded or penalized when it hits the strip $[0, \infty) \times [0, a]$ where $a$ is a given positive number. The convergence result that we establish allows to characterize the scaling limit of this process at criticality.

A note on the existence of Gibbs marked point processes with applications in stochastic geometry

Martina Petráková (2023)

Kybernetika

Similarity:

This paper generalizes a recent existence result for infinite-volume marked Gibbs point processes. We try to use the existence theorem for two models from stochastic geometry. First, we show the existence of Gibbs facet processes in $ℝ^{d}$ with repulsive interactions. We also prove that the finite-volume Gibbs facet processes with attractive interactions need not exist. Afterwards, we study Gibbs-Laguerre tessellations of $ℝ^{2}$ . The mentioned existence result cannot be used, since one of its...

Distortion inequality for the Frobenius-Perron operator and some of its consequences in ergodic theory of Markov maps in $ℝ^{d}$

Piotr Bugiel (1998)

Annales Polonici Mathematici

Similarity:

Asymptotic properties of the sequences (a) ${P_{φ}^{j} g}_{j = 1}^{\infty}$ and (b) ${j^{- 1} \sum_{i = 0}^{j - 1} P ⁱ_{φ} g}_{j = 1}^{\infty}$ , where $P_{φ} : L ¹ \to L ¹$ is the Frobenius-Perron operator associated with a nonsingular Markov map defined on a σ-finite measure space, are studied for g ∈ G = f ∈ L¹: f ≥ 0 and ⃦f ⃦ = 1. An operator-theoretic analogue of Rényi’s Condition is introduced. It is proved that under some additional assumptions this condition implies the L¹-convergence of the sequences (a) and (b) to a unique g₀ ∈ G. The general result is applied to some smooth Markov...

On the central limit theorem for some birth and death processes

Tymoteusz Chojecki (2011)

Annales Universitatis Mariae Curie-Sklodowska, sectio A – Mathematica

Similarity:

Suppose that ${X n : n \geq 0}$ is a stationary Markov chain and $V$ is a certain function on a phase space of the chain, called an observable. We say that the observable satisfies the central limit theorem (CLT) if $Y_{n} : = N^{- 1 / 2} \sum_{n = 0}^{N} V (X_{n})$ converge in law to a normal random variable, as $N \to + \infty$ . For a stationary Markov chain with the $L^{2}$ spectral gap the theorem holds for all $V$ such that $V (X_{0})$ is centered and square integrable, see Gordin [7]. The purpose of this article is to characterize a family of observables $V$ for which the CLT holds...