Page 1 Next

Displaying 1 – 20 of 38

Showing per page

A simultaneous localization and tracking method for a worm tracking system

Mateusz Kowalski, Piotr Kaczmarek, Rafał Kabaciński, Mieszko Matuszczak, Kamil Tranbowicz, Robert Sobkowiak (2014)

International Journal of Applied Mathematics and Computer Science

The idea of worm tracking refers to the path analysis of Caenorhabditis elegans nematodes and is an important tool in neurobiology which helps to describe their behavior. Knowledge about nematode behavior can be applied as a model to study the physiological addiction process or other nervous system processes in animals and humans. Tracking is performed by using a special manipulator positioning a microscope with a camera over a dish with an observed individual. In the paper, the accuracy of a nematode's...

A stopping rule for discounted Markov decision processes with finite action sets

Raúl Montes-de-Oca, Enrique Lemus-Rodríguez, Daniel Cruz-Suárez (2009)


In a Discounted Markov Decision Process (DMDP) with finite action sets the Value Iteration Algorithm, under suitable conditions, leads to an optimal policy in a finite number of steps. Determining an upper bound on the necessary number of steps till gaining convergence is an issue of great theoretical and practical interest as it would provide a computationally feasible stopping rule for value iteration as an algorithm for finding an optimal policy. In this paper we find such a bound depending only...

Data-driven models for fault detection using kernel PCA: A water distribution system case study

Adam Nowicki, Michał Grochowski, Kazimierz Duzinkiewicz (2012)

International Journal of Applied Mathematics and Computer Science

Kernel Principal Component Analysis (KPCA), an example of machine learning, can be considered a non-linear extension of the PCA method. While various applications of KPCA are known, this paper explores the possibility to use it for building a data-driven model of a non-linear system-the water distribution system of the Chojnice town (Poland). This model is utilised for fault detection with the emphasis on water leakage detection. A systematic description of the system's framework is followed by...

Epoch-incremental reinforcement learning algorithms

Roman Zajdel (2013)

International Journal of Applied Mathematics and Computer Science

In this article, a new class of the epoch-incremental reinforcement learning algorithm is proposed. In the incremental mode, the fundamental TD(0) or TD(λ) algorithm is performed and an environment model is created. In the epoch mode, on the basis of the environment model, the distances of past-active states to the terminal state are computed. These distances and the reinforcement terminal state signal are used to improve the agent policy.

Estimation of feedwater heater parameters based on a grey-box approach

Tomasz Barszcz, Piotr Czop (2011)

International Journal of Applied Mathematics and Computer Science

The first-principle modeling of a feedwater heater operating in a coal-fired power unit is presented, along with a theoretical discussion concerning its structural simplifications, parameter estimation, and dynamical validation. The model is a part of the component library of modeling environments, called the Virtual Power Plant (VPP). The main purpose of the VPP is simulation of power generation installations intended for early warning diagnostic applications. The model was developed in the Matlab/Simulink...

Iterative estimators of parameters in linear models with partially variant coefficients

Shaolin Hu, Karl Meinke, Rushan Chen, Ouyang Huajiang (2007)

International Journal of Applied Mathematics and Computer Science

A new kind of linear model with partially variant coefficients is proposed and a series of iterative algorithms are introduced and verified. The new generalized linear model includes the ordinary linear regression model as a special case. The iterative algorithms efficiently overcome some difficulties in computation with multidimensional inputs and incessantly appending parameters. An important application is described at the end of this article, which shows that this new model is reasonable and...

Currently displaying 1 – 20 of 38

Page 1 Next