Displaying similar documents to “Computing the Stackelberg/Nash equilibria using the extraproximal method: Convergence analysis and implementation details for Markov chains games”

Some remarks on equilibria in semi-Markov games

Andrzej Nowak (2000)

Applicationes Mathematicae

Similarity:

This paper is a first study of correlated equilibria in nonzero-sum semi-Markov stochastic games. We consider the expected average payoff criterion under a strong ergodicity assumption on the transition structure of the games. The main result is an extension of the correlated equilibrium theorem proven for discounted (discrete-time) Markov games in our joint paper with Raghavan. We also provide an existence result for stationary Nash equilibria in the limiting average payoff semi-Markov...

Nonzero-sum semi-Markov games with countable state spaces

Wojciech Połowczuk (2000)

Applicationes Mathematicae

Similarity:

We consider nonzero-sum semi-Markov games with a countable state space and compact metric action spaces. We assume that the payoff, mean holding time and transition probability functions are continuous on the action spaces. The main results concern the existence of Nash equilibria for nonzero-sum discounted semi-Markov games and a class of ergodic semi-Markov games with the expected average payoff criterion.

Correlated equilibria in competitive staff selection problem

David M. Ramsey, Krzysztof Szajowski (2006)

Banach Center Publications

Similarity:

This paper deals with an extension of the concept of correlated strategies to Markov stopping games. The Nash equilibrium approach to solving nonzero-sum stopping games may give multiple solutions. An arbitrator can suggest to each player the decision to be applied at each stage based on a joint distribution over the players' decisions. This is a form of equilibrium selection. Examples of correlated equilibria in nonzero-sum games related to the staff selection competition in the case...

Modeling shortest path games with Petri nets: a Lyapunov based theory

Julio Clempner (2006)

International Journal of Applied Mathematics and Computer Science

Similarity:

In this paper we introduce a new modeling paradigm for shortest path games representation with Petri nets. Whereas previous works have restricted attention to tracking the net using Bellman's equation as a utility function, this work uses a Lyapunov-like function. In this sense, we change the traditional cost function by a trajectory-tracking function which is also an optimal cost-to-target function. This makes a significant difference in the conceptualization of the problem domain,...

On infinite horizon multi-person stopping games with priorities

E. Z. Ferenstein (2006)

Banach Center Publications

Similarity:

We study nonzero-sum multi-person multiple stopping games with players' priorities. The existence of Nash equilibrium is proved. Examples of multi stopping of Markov chains are considered. The game may also be presented as a special case of a stochastic game which leads to many variations of it, in which stopping is a part of players' strategies.

Approximations of dynamic Nash games with general state and action spaces and ergodic costs for the players

Tomasz Bielecki (1997)

Applicationes Mathematicae

Similarity:

The purpose of this paper is to prove existence of an ε -equilib- rium point in a dynamic Nash game with Borel state space and long-run time average cost criteria for the players. The idea of the proof is first to convert the initial game with ergodic costs to an ``equivalent" game endowed with discounted costs for some appropriately chosen value of the discount factor, and then to approximate the discounted Nash game obtained in the first step with a countable state space game for which...

On approximations of nonzero-sum uniformly continuous ergodic stochastic games

Andrzej Nowak (1999)

Applicationes Mathematicae

Similarity:

We consider a class of uniformly ergodic nonzero-sum stochastic games with the expected average payoff criterion, a separable metric state space and compact metric action spaces. We assume that the payoff and transition probability functions are uniformly continuous. Our aim is to prove the existence of stationary ε-equilibria for that class of ergodic stochastic games. This theorem extends to a much wider class of stochastic games a result proven recently by Bielecki [2].

Convergence method, properties and computational complexity for Lyapunov games

Julio B. Clempner, Alexander S. Poznyak (2011)

International Journal of Applied Mathematics and Computer Science

Similarity:

We introduce the concept of a Lyapunov game as a subclass of strictly dominated games and potential games. The advantage of this approach is that every ergodic system (repeated game) can be represented by a Lyapunov-like function. A direct acyclic graph is associated with a game. The graph structure represents the dependencies existing between the strategy profiles. By definition, a Lyapunov-like function monotonically decreases and converges to a single Lyapunov equilibrium point identified...