Dobrushin's approach to queueing network theory.
We consider an illiquid financial market with different regimes modeled by a continuous time finite-state Markov chain. The investor can trade a stock only at the discrete arrival times of a Cox process with intensity depending on the market regime. Moreover, the risky asset price is subject to liquidity shocks, which change its rate of return and volatility, and induce jumps on its dynamics. In this setting, we study the problem of an economic agent optimizing her expected utility from consumption...
Soit U une fonction définie sur un ensemble fini E muni d'un noyau markovien irréductible M. L'objectif du papier est de comparer théoriquement deux procédures stochastiques de minimisation globale de U : le recuit simulé et un algorithme génétique. Pour ceci on se placera dans la situation idéalisée d'une infinité de particules disponibles et nous ferons une hypothèse commode d'existence de suffisamment de symétries du cadre (E,M,U). On verra notamment que contrairement au recuit simulé, toute...
We answer some questions raised by Gantert, Löwe and Steif (Ann. Inst. Henri Poincaré Probab. Stat.41(2005) 767–780) concerning “signed” voter models on locally finite graphs. These are voter model like processes with the difference that the edges are considered to be either positive or negative. If an edge between a site and a site is negative (respectively positive) the site will contribute towards the flip rate of if and only if the two current spin values are equal (respectively opposed)....
We provide an extension of topological methods applied to a certain class of Non Feller Models which we call Quasi-Feller. We give conditions to ensure the existence of a stationary distribution. Finally, we strengthen the conditions to obtain a positive Harris recurrence, which in turn implies the existence of a strong law of large numbers.
We provide an extension of topological methods applied to a certain class of Non Feller Models which we call Quasi-Feller. We give conditions to ensure the existence of a stationary distribution. Finally, we strengthen the conditions to obtain a positive Harris recurrence, which in turn implies the existence of a strong law of large numbers.
We analyse a Markov chain and perturbations of the transition probability and the one-step cost function (possibly unbounded) defined on it. Under certain conditions, of Lyapunov and Harris type, we obtain new estimates of the effects of such perturbations via an index of perturbations, defined as the difference of the total expected discounted costs between the original Markov chain and the perturbed one. We provide an example which illustrates our analysis.
We extend previous results of the same authors ([11]) on the effects of perturbation in the transition probability of a Markov cost chain for discounted Markov control processes. Supposing valid, for each stationary policy, conditions of Lyapunov and Harris type, we get upper bounds for the index of perturbations, defined as the difference of the total expected discounted costs for the original Markov control process and the perturbed one. We present examples that satisfy our conditions.