We provide a generalization of Ueno's inequality for n-step transition probabilities of Markov chains in a general state space. Our result is relevant to the study of adaptive control problems and approximation problems in the theory of discrete-time Markov decision processes and stochastic games.
This paper is a first study of correlated equilibria in nonzero-sum semi-Markov stochastic games. We consider the expected average payoff criterion under a strong ergodicity assumption on the transition structure of the games. The main result is an extension of the correlated equilibrium theorem proven for discounted (discrete-time) Markov games in our joint paper with Raghavan. We also provide an existence result for stationary Nash equilibria in the limiting average payoff semi-Markov games with...
We consider a class of uniformly ergodic nonzero-sum stochastic games with the expected average payoff criterion, a separable metric state space and compact metric action spaces. We assume that the payoff and transition probability functions are uniformly continuous. Our aim is to prove the existence of stationary ε-equilibria for that class of ergodic stochastic games. This theorem extends to a much wider class of stochastic games a result proven recently by Bielecki [2].
Let F be a multifunction from a metric space X into L¹, and B a subset of X. We give sufficient conditions for the existence of a measurable selector of F which is continuous at every point of B. Among other assumptions, we require the decomposability of F(x) for x ∈ B.
Let F be a multifunction with values in Lₚ(Ω, X). In this note, we study which regularity properties of F are preserved when we consider the decomposable hull of F.
We study values for cooperative TU-games which are convex combinations of the Shapley value and the solidarity value, introduced in our recent paper [1]. First, we axiomatize the convex combination of the two values in the case when the coefficients are given exogenously. Next, we give an axiomatic description of the whole family of such values.
Let , where is a measurable space, and a topological space. We study inclusions between three classes of extended real-valued functions on which are upper semicontinuous in and satisfy some measurability conditions.
SING i ISDG
Page 1