A semimartingale characterization of average optimal stationary policies for Markov decision processes.
A separation principle for the stabilization of a class of time delay nonlinear systems
In this paper, we establish a separation principle for a class of time-delay nonlinear systems satisfying some relaxed triangular-type condition. Under delay independent conditions, we propose a nonlinear time-delay observer to estimate the system states, a state feedback controller and we prove that the observer-based controller stabilizes the system.
A separation theorem for expected value and feared value discrete time control
A Separation Theorem for Expected Value and Feared Value Discrete Time Control
We show how the use of a parallel between the ordinary (+, X) and the (max, +) algebras, Maslov measures that exploit this parallel, and more specifically their specialization to probabilities and the corresponding cost measures of Quadrat, offer a completely parallel treatment of stochastic and minimax control of disturbed nonlinear discrete time systems with partial information. This paper is based upon, and improves, the discrete time part of the earlier paper [9].
A simple asymptotically optimal filter over an infinite horizon.
A simple definition of hidden modes, poles and zeros
A simple mathematical model of the human liver
The parameter estimation problem for a continuous dynamical system is a difficult one. In this paper we study a simple mathematical model of the liver. For the parameter identification we use the observed clinical data obtained by the BSP test. Bellman’s quasilinearization method and its modifications are applied.
A simple recursive estimator with on-line orthogonalization of the input sequence
A simple scheme for semi-recursive identification of Hammerstein system nonlinearity by Haar wavelets
A simple semi-recursive routine for nonlinearity recovery in Hammerstein systems is proposed. The identification scheme is based on the Haar wavelet kernel and possesses a simple and compact form. The convergence of the algorithm is established and the asymptotic rate of convergence (independent of the input density smoothness) is shown for piecewiseLipschitz nonlinearities. The numerical stability of the algorithm is verified. Simulation experiments for a small and moderate number of input-output...
A simple solution to the finite-horizon LQ problem with zero terminal state
This short paper deals with the classical finite-horizon linear-quadratic regulator problem with the terminal state constrained to be zero, for both continuous and discrete-time systems. Closed-form expressions for the optimal state and costate trajectories of the Hamiltonian system, as well as the corresponding control law, are derived through the solutions of two infinite- horizon LQ problems, thus avoiding the use of the Riccati differential equation. The computation of the optimal value of the...
A simplex trained neural network-based architecture for sensor fusion and tracking of target maneuvers
One of the major applications for which neural network-based methods are being successfully employed is in the design of intelligent integrated processing architectures that efficiently implement sensor fusion operations. In this paper we shall present a novel scheme for developing fused decisions for surveillance and tracking in typical multi-sensor environments characterized by the disparity in the data streams arriving from various sensors. This scheme employs an integration of a multilayer neural...
A simultaneous localization and tracking method for a worm tracking system
The idea of worm tracking refers to the path analysis of Caenorhabditis elegans nematodes and is an important tool in neurobiology which helps to describe their behavior. Knowledge about nematode behavior can be applied as a model to study the physiological addiction process or other nervous system processes in animals and humans. Tracking is performed by using a special manipulator positioning a microscope with a camera over a dish with an observed individual. In the paper, the accuracy of a nematode's...
A single-degree-of-freedom polynomial solution to the optimal feedback/feedforward stochastic tracking problem
A singular control problem with an expected and a pathwise ergodic performance criterion.
A singular controllability problem with vanishing viscosity
The aim of this paper is to answer the question: Do the controls of a vanishing viscosity approximation of the one dimensional linear wave equation converge to a control of the conservative limit equation? The characteristic of our viscous term is that it contains the fractional power α of the Dirichlet Laplace operator. Through the parameter α we may increase or decrease the strength of the high frequencies damping which allows us to cover a large class of dissipative mechanisms. The viscous term,...
A singular perturbation problem in exact controllability of the Maxwell system
This paper studies the exact controllability of the Maxwell system in a bounded domain, controlled by a current flowing tangentially in the boundary of the region, as well as the exact controllability the same problem but perturbed by a dissipative term multiplied by a small parameter in the boundary condition. This boundary perturbation improves the regularity of the problem and is therefore a singular perturbation of the original problem. The purpose of the paper is to examine the connection,...
A Singular Perturbation Problem in Exact Controllability of the Maxwell System
This paper studies the exact controllability of the Maxwell system in a bounded domain, controlled by a current flowing tangentially in the boundary of the region, as well as the exact controllability the same problem but perturbed by a dissipative term multiplied by a small parameter in the boundary condition. This boundary perturbation improves the regularity of the problem and is therefore a singular perturbation of the original problem. The purpose of the paper is to examine the connection, for...
A situation-based multi-agent architecture for handling misunderstandings in interactions
During interactions, system actors may face up misunderstandings when their local states contain inconsistent data about the same fact. Misunderstandings in interactions are likely to reduce interactivity performances (deviation or deadlock) or even affect overall system behavior. In this paper, we characterize misunderstandings in interactions between system actors (that may be human users or system agents) in interactive adaptive systems. To deal with such misunderstandings and ensure state consistency,...
A solution of the continuous Lyapunov equation by means of power series
A spectral characterization of the behavior of discrete time AR–representations over a finite time interval
In this paper we investigate the behavior of the discrete time AR (Auto Regressive) representations over a finite time interval, in terms of the finite and infinite spectral structure of the polynomial matrix involved in the AR-equation. A boundary mapping equation and a closed formula for the determination of the solution, in terms of the boundary conditions, are also gived.