# Nonzero-sum semi-Markov games with countable state spaces

Applicationes Mathematicae (2000)

- Volume: 27, Issue: 4, page 395-402
- ISSN: 1233-7234

## Access Full Article

top## Abstract

top## How to cite

topPołowczuk, Wojciech. "Nonzero-sum semi-Markov games with countable state spaces." Applicationes Mathematicae 27.4 (2000): 395-402. <http://eudml.org/doc/219282>.

@article{Połowczuk2000,

abstract = {We consider nonzero-sum semi-Markov games with a countable state space and compact metric action spaces. We assume that the payoff, mean holding time and transition probability functions are continuous on the action spaces. The main results concern the existence of Nash equilibria for nonzero-sum discounted semi-Markov games and a class of ergodic semi-Markov games with the expected average payoff criterion.},

author = {Połowczuk, Wojciech},

journal = {Applicationes Mathematicae},

keywords = {discounted criterion; Nash equilibrium; countable state space; nonzero-sum semi-Markov game; long run average reward criterion},

language = {eng},

number = {4},

pages = {395-402},

title = {Nonzero-sum semi-Markov games with countable state spaces},

url = {http://eudml.org/doc/219282},

volume = {27},

year = {2000},

}

TY - JOUR

AU - Połowczuk, Wojciech

TI - Nonzero-sum semi-Markov games with countable state spaces

JO - Applicationes Mathematicae

PY - 2000

VL - 27

IS - 4

SP - 395

EP - 402

AB - We consider nonzero-sum semi-Markov games with a countable state space and compact metric action spaces. We assume that the payoff, mean holding time and transition probability functions are continuous on the action spaces. The main results concern the existence of Nash equilibria for nonzero-sum discounted semi-Markov games and a class of ergodic semi-Markov games with the expected average payoff criterion.

LA - eng

KW - discounted criterion; Nash equilibrium; countable state space; nonzero-sum semi-Markov game; long run average reward criterion

UR - http://eudml.org/doc/219282

ER -

## References

top- [1] E. Altman, Non zero-sum stochastic games in admission, service and routing control in queueing systems, Queueing Systems Theory Appl. 23 (1996), 259-279. Zbl0877.90097
- [2] E. Altman and A. Hordijk, Zero-sum Markov games and worst-case optimal control of queueing systems, ibid. 21 (1995), 415-447. Zbl0859.90141
- [3] E. Altman, A. Hordijk and F. M. Spieksma, Contraction conditions for average and α-discount optimality in countable state Markov games with unbounded rewards, Math. Oper. Res. 22 (1997), 588-618. Zbl0887.90190
- [4] D. P. Bertsekas and S. E. Shreve, Stochastic Optimal Control: The Discrete Time Case, Academic Press, New York, 1979. Zbl0471.93002
- [5] V. S. Borkar and M. K. Ghosh, Denumerable state stochastic games with limiting average payoff, J. Optim. Theory Appl. 76 (1993), 539-560. Zbl0797.90128
- [6] A. Federgruen, On n-person stochastic games with denumerable state space, Adv. Appl. Probab. 10 (1978), 452-471. Zbl0411.93031
- [7] A. Federgruen and H. C. Tijms, The optimality equation in average cost denumerable state semi-Markov decision problems, recurrency conditions and algorithms, J. Appl. Probab. 15 (1978), 356-373. Zbl0386.90060
- [8] I. L. Glicksberg, A further generalization of the Kakutani fixed point theorem with application to Nash equilibrium points, Proc. Amer. Math. Soc. 3 (1952), 170-174. Zbl0046.12103
- [9] A. Hordijk, Dynamic Programming and Markov Potential Theory, Math. Centrum, Amsterdam, 1977.
- [10] M. Kurano, Semi-Markov decision processes and their applications in replacement models, J. Oper. Res. Soc. Japan 28 (1985), 18-30. Zbl0564.90090
- [11] A. K. Lal and S. Sinha, Zero-sum two-person semi-Markov games, J. Appl. Probab. 29 (1992), 56-72. Zbl0761.90111
- [12] S. P. Meyn and R. L. Tweedie, Computable bounds for geometric convergence rates of Markov chains, Ann. Appl. Probab. 4 (1994), 981-1011. Zbl0812.60059
- [13] A. S. Nowak, Some remarks on equilibria in semi-Markov games, this issue, 385-394. Zbl1050.91010
- [14] A. S. Nowak, Sensitive equilibria for ergodic stochastic games with countable state spaces, Math. Methods Oper. Res. 50 (1999), 65-76. Zbl0963.91011
- [15] A. S. Nowak and K. Szajowski, Nonzero-sum stochastic games, Ann. Internat. Soc. Dynamic Games 4 (1999), 297-342. Zbl0940.91014
- [16] O. Passchier, The Theory of Markov Games and Queueing Control, Ph.D. thesis, Dept. Math. and Computer Sci., Leiden Univ., 1996. Zbl0909.90285
- [17] S. M. Ross, Applied Probability Models with Optimization Applications, Holden Day, San Francisco, 1970. Zbl0213.19101
- [18] H. Royden, Real Analysis, MacMillan, New York, 1968. Zbl0197.03501
- [19] L. I. Sennott, Average cost semi-Markov decision processes and the control of queueing systems, Probab. Engnrg. Inform. Sci. 3 (1989), 247-272. Zbl1134.60408
- [20] L. I. Sennott, Nonzero-sum stochastic games with unbounded costs: discounted and average cost cases, Z. Oper. Res. 40 (1994), 145-162. Zbl0826.90145

## Citations in EuDML Documents

top## NotesEmbed ?

topTo embed these notes on your page include the following JavaScript code on your page where you want the notes to appear.