Displaying similar documents to “Empirical approximation in Markov games under unbounded payoff: discounted and average criteria”

Some applications of the point-open subbase game

D. Guerrero Sánchez, Vladimir Vladimirovich Tkachuk (2017)

Commentationes Mathematicae Universitatis Carolinae

Similarity:

Given a subbase 𝒮 of a space X , the game P O ( 𝒮 , X ) is defined for two players P and O who respectively pick, at the n -th move, a point x n X and a set U n 𝒮 such that x n U n . The game stops after the moves { x n , U n : n ø } have been made and the player P wins if n ø U n = X ; otherwise O is the winner. Since P O ( 𝒮 , X ) is an evident modification of the well-known point-open game P O ( X ) , the primary line of research is to describe the relationship between P O ( X ) and P O ( 𝒮 , X ) for a given subbase 𝒮 . It turns out that, for any subbase 𝒮 , the player P has a winning...

Time-varying Markov decision processes with state-action-dependent discount factors and unbounded costs

Beatris A. Escobedo-Trujillo, Carmen G. Higuera-Chan (2019)

Kybernetika

Similarity:

In this paper we are concerned with a class of time-varying discounted Markov decision models n with unbounded costs c n and state-action dependent discount factors. Specifically we study controlled systems whose state process evolves according to the equation x n + 1 = G n ( x n , a n , ξ n ) , n = 0 , 1 , ... , with state-action dependent discount factors of the form α n ( x n , a n ) , where a n and ξ n are the control and the random disturbance at time n , respectively. Assuming that the sequences of functions { α n } , { c n } and { G n } converge, in certain sense, to α ,...

Covariance structure of wide-sense Markov processes of order k ≥ 1

Arkadiusz Kasprzyk, Władysław Szczotka (2006)

Applicationes Mathematicae

Similarity:

A notion of a wide-sense Markov process X t of order k ≥ 1, X t W M ( k ) , is introduced as a direct generalization of Doob’s notion of wide-sense Markov process (of order k=1 in our terminology). A base for investigation of the covariance structure of X t is the k-dimensional process x t = ( X t - k + 1 , . . . , X t ) . The covariance structure of X t W M ( k ) is considered in the general case and in the periodic case. In the general case it is shown that X t W M ( k ) iff x t is a k-dimensional WM(1) process and iff the covariance function of x t has the triangular...

Spectral condition, hitting times and Nash inequality

Eva Löcherbach, Oleg Loukianov, Dasha Loukianova (2014)

Annales de l'I.H.P. Probabilités et statistiques

Similarity:

Let X be a μ -symmetric Hunt process on a LCCB space 𝙴 . For an open set 𝙶 𝙴 , let τ 𝙶 be the exit time of X from 𝙶 and A 𝙶 be the generator of the process killed when it leaves 𝙶 . Let r : [ 0 , [ [ 0 , [ and R ( t ) = 0 t r ( s ) d s . We give necessary and sufficient conditions for 𝔼 μ R ( τ 𝙶 ) l t ; in terms of the behavior near the origin of the spectral measure of - A 𝙶 . When r ( t ) = t l , l 0 , by means of this condition we derive the Nash inequality for the killed process. In the diffusion case this permits to show that the existence of moments of order l + 1 for τ 𝙶 ...

Norm continuity of pointwise quasi-continuous mappings

Alireza Kamel Mirmostafaee (2018)

Mathematica Bohemica

Similarity:

Let X be a Baire space, Y be a compact Hausdorff space and ϕ : X C p ( Y ) be a quasi-continuous mapping. For a proximal subset H of Y × Y we will use topological games 𝒢 1 ( H ) and 𝒢 2 ( H ) on Y × Y between two players to prove that if the first player has a winning strategy in these games, then ϕ is norm continuous on a dense G δ subset of X . It follows that if Y is Valdivia compact, each quasi-continuous mapping from a Baire space X to C p ( Y ) is norm continuous on a dense G δ subset of X .

Soft local times and decoupling of random interlacements

Serguei Popov, Augusto Teixeira (2015)

Journal of the European Mathematical Society

Similarity:

In this paper we establish a decoupling feature of the random interlacement process u d at level u , d 3 . Roughly speaking, we show that observations of u restricted to two disjoint subsets A 1 and A 2 of d are approximately independent, once we add a sprinkling to the process u by slightly increasing the parameter u . Our results differ from previous ones in that we allow the mutual distance between the sets A 1 and A 2 to be much smaller than their diameters. We then provide an important application...

The Massera-Schäffer problem for a first order linear differential equation

Nina A. Chernyavskaya, Leonid A. Shuster (2022)

Czechoslovak Mathematical Journal

Similarity:

We consider the Massera-Schäffer problem for the equation - y ' ( x ) + q ( x ) y ( x ) = f ( x ) , x , where f L p loc ( ) , p [ 1 , ) and 0 q L 1 loc ( ) . By a solution of the problem we mean any function y , absolutely continuous and satisfying the above equation almost everywhere in . Let positive and continuous functions μ ( x ) and θ ( x ) for x be given. Let us introduce the spaces L p ( , μ ) = f L p loc ( ) : f L p ( , μ ) p = - | μ ( x ) f ( x ) | p d x < , L p ( , θ ) = f L p loc ( ) : f L p ( , θ ) p = - | θ ( x ) f ( x ) | p d x < . We obtain requirements to the functions μ , θ and q under which (1) for every function f L p ( , θ ) there exists a unique solution y L p ( , μ ) of the above equation; (2) there is an absolute constant...

Smoothness of Green's functions and Markov-type inequalities

Leokadia Białas-Cież (2011)

Banach Center Publications

Similarity:

Let E be a compact set in the complex plane, g E be the Green function of the unbounded component of E with pole at infinity and M ( E ) = s u p ( | | P ' | | E ) / ( | | P | | E ) where the supremum is taken over all polynomials P | E 0 of degree at most n, and | | f | | E = s u p | f ( z ) | : z E . The paper deals with recent results concerning a connection between the smoothness of g E (existence, continuity, Hölder or Lipschitz continuity) and the growth of the sequence M ( E ) n = 1 , 2 , . . . . Some additional conditions are given for special classes of sets.

On the topology of polynomials with bounded integer coefficients

De-Jun Feng (2016)

Journal of the European Mathematical Society

Similarity:

For a real number q > 1 and a positive integer m , let Y m ( q ) : = i = 0 n ϵ i q i : ϵ i 0 , ± 1 , ... , ± m , n = 0 , 1 , ... . In this paper, we show that Y m ( q ) is dense in if and only if q < m + 1 and q is not a Pisot number. This completes several previous results and answers an open question raised by Erdös, Joó and Komornik [8].

On the Variational Inequality and Tykhonov Well-Posedness in Game Theory

C. A. Pensavalle, G. Pieri (2010)

Bollettino dell'Unione Matematica Italiana

Similarity:

Consider a M-player game in strategic form G = ( X 1 , , X M , g 1 , , g M ) where the set X i is a closed interval of real numbers and the payoff function g i is concave and differentiable with respect to the variable x i X i , for any i = 1 , , M . The aim of this paper is to find appropriate conditions on the payoff functions under the well-posedness with respect to the related variational inequality is equivalent to the formulation of the Tykhonov well-posedness in a game context. The idea of the proof is to appeal to a third equivalence,...

Evaluating default priors with a generalization of Eaton’s Markov chain

Brian P. Shea, Galin L. Jones (2014)

Annales de l'I.H.P. Probabilités et statistiques

Similarity:

We consider evaluating improper priors in a formal Bayes setting according to the consequences of their use. Let 𝛷 be a class of functions on the parameter space and consider estimating elements of 𝛷 under quadratic loss. If the formal Bayes estimator of every function in 𝛷 is admissible, then the prior is strongly admissible with respect to 𝛷 . Eaton’s method for establishing strong admissibility is based on studying the stability properties of a particular Markov chain associated with...

On square functions associated to sectorial operators

Christian Le Merdy (2004)

Bulletin de la Société Mathématique de France

Similarity:

We give new results on square functions x F = 0 F ( t A ) x 2 d t t 1 / 2 p associated to a sectorial operator A on L p for 1 &lt; p &lt; . Under the assumption that A is actually R -sectorial, we prove equivalences of the form K - 1 x G x F K x G for suitable functions F , G . We also show that A has a bounded H functional calculus with respect to . F . Then we apply our results to the study of conditions under which we have an estimate ( 0 | C e - t A ( x ) | 2 d t ) 1 / 2 q M x p , when - A generates a bounded semigroup e - t A on L p and C : D ( A ) L q is a linear mapping.

On a question of Schmidt and Summerer concerning 3 -systems

Johannes Schleischitz (2020)

Communications in Mathematics

Similarity:

Following a suggestion of W.M. Schmidt and L. Summerer, we construct a proper 3 -system ( P 1 , P 2 , P 3 ) with the property ϕ ¯ 3 = 1 . In fact, our method generalizes to provide n -systems with ϕ ¯ n = 1 , for arbitrary n 3 . We visualize our constructions with graphics. We further present explicit examples of numbers ξ 1 , ... , ξ n - 1 that induce the n -systems in question.

Geometric rigidity of × m invariant measures

Michael Hochman (2012)

Journal of the European Mathematical Society

Similarity:

Let μ be a probability measure on [ 0 , 1 ] which is invariant and ergodic for T a ( x ) = a x 𝚖𝚘𝚍 1 , and 0 < 𝚍𝚒𝚖 μ < 1 . Let f be a local diffeomorphism on some open set. We show that if E and ( f μ ) E μ E , then f ' ( x ) ± a r : r at μ -a.e. point x f - 1 E . In particular, if g is a piecewise-analytic map preserving μ then there is an open g -invariant set U containing supp μ such that g U is piecewise-linear with slopes which are rational powers of a . In a similar vein, for μ as above, if b is another integer and a , b are not powers of a common integer, and if ν is...

Neutral set differential equations

Umber Abbas, Vasile Lupulescu, Donald O&amp;#039;Regan, Awais Younus (2015)

Czechoslovak Mathematical Journal

Similarity:

The aim of this paper is to establish an existence and uniqueness result for a class of the set functional differential equations of neutral type D H X ( t ) = F ( t , X t , D H X t ) , X | [ - r , 0 ] = Ψ , where F : [ 0 , b ] × 𝒞 0 × 𝔏 0 1 K c ( E ) is a given function, K c ( E ) is the family of all nonempty compact and convex subsets of a separable Banach space E , 𝒞 0 denotes the space of all continuous set-valued functions X from [ - r , 0 ] into K c ( E ) , 𝔏 0 1 is the space of all integrally bounded set-valued functions X : [ - r , 0 ] K c ( E ) , Ψ 𝒞 0 and D H is the Hukuhara derivative. The continuous dependence of solutions on initial...