### A general stochastic maximum principle for singular control problems.

Skip to main content (access key 's'),
Skip to navigation (access key 'n'),
Accessibility information (access key '0')

This work concerns controlled Markov chains with finite state space and compact action sets. The decision maker is risk-averse with constant risk-sensitivity, and the performance of a control policy is measured by the long-run average cost criterion. Under standard continuity-compactness conditions, it is shown that the (possibly non-constant) optimal value function is characterized by a system of optimality equations which allows to obtain an optimal stationary policy. Also, it is shown that the...

We consider the problem of optimal investment for maximal expected utility in an incomplete market with trading strategies subject to closed constraints. Under the assumption that the underlying utility function has constant sign, we employ the comparison principle for BSDEs to construct a family of supermartingales leading to a necessary and sufficient condition for optimality. As a consequence, the value function is characterized as the initial value of a BSDE with Lipschitz growth.

We consider an illiquid financial market with different regimes modeled by a continuous time finite-state Markov chain. The investor can trade a stock only at the discrete arrival times of a Cox process with intensity depending on the market regime. Moreover, the risky asset price is subject to liquidity shocks, which change its rate of return and volatility, and induce jumps on its dynamics. In this setting, we study the problem of an economic agent optimizing her expected utility from consumption...

This paper is concerned with the stochastic linear quadratic optimal control problems (LQ problems, for short) for which the coefficients are allowed to be random and the cost functionals are allowed to have negative weights on the square of control variables. We propose a new method, the equivalent cost functional method, to deal with the LQ problems. Comparing to the classical methods, the new method is simple, flexible and non-abstract. The new method can also be applied to deal with nonlinear...

We analyze the optimal sales process of a stochastic advertising and pricing model with constant demand elasticities. We derive explicit formulae of the densities of the (optimal) sales times and (optimal) prices when a fixed finite number of units of a product are to be sold during a finite sales period or an infinite one. Furthermore, for any time t the exact distribution of the inventory, i.e. the number of unsold items, at t is determined and will be expressed in terms of elementary functions....

In this paper we introduce the sufficient statistic algebra which is responsible for propagating the sufficient statistic, or information state, in the optimal control of stochastic systems. Certain Lie algebraic methods widely used in nonlinear control theory, are then employed to derive finite- dimensional controllers. The sufficient statistic algebra enables us to determine a priori whether there exist finite-dimensional controllers; it also enables us to classify all finite-dimensional controllers....

We consider a financial market with memory effects in which wealth processes are driven by mean-field stochastic Volterra equations. In this financial market, the classical dynamic programming method can not be used to study the optimal investment problem, because the solution of mean-field stochastic Volterra equation is not a Markov process. In this paper, a new method through Malliavin calculus introduced in [1], can be used to obtain the optimal investment in a Volterra type financial market....

The maximum principle for optimal control problems of fully coupled forward-backward doubly stochastic differential equations (FBDSDEs in short) in the global form is obtained, under the assumptions that the diffusion coefficients do not contain the control variable, but the control domain need not to be convex. We apply our stochastic maximum principle (SMP in short) to investigate the optimal control problems of a class of stochastic partial differential equations (SPDEs in short). And as an example...

The maximum principle for optimal control problems of fully coupled forward-backward doubly stochastic differential equations (FBDSDEs in short) in the global form is obtained, under the assumptions that the diffusion coefficients do not contain the control variable, but the control domain need not to be convex. We apply our stochastic maximum principle (SMP in short) to investigate the optimal control problems of a class of stochastic partial differential equations (SPDEs in short). And as an...