Bias of LS estimators in nonlinear regression models with constraints. Part I: General case

Andrej Pázman; Jean-Baptiste Denis

Applications of Mathematics (1999)

  • Volume: 44, Issue: 5, page 359-374
  • ISSN: 0862-7940

Abstract

top
We derive expressions for the asymptotic approximation of the bias of the least squares estimators in nonlinear regression models with parameters which are subject to nonlinear equality constraints. The approach suggested modifies the normal equations of the estimator, and approximates them up to o p ( N - 1 ) , where N is the number of observations. The “bias equations” so obtained are solved under different assumptions on constraints and on the model. For functions of the parameters the invariance of the approximate bias with respect to reparametrisations is demonstrated. Singular models are considered as well, in which case the constraints may serve either to identify the parameters, or eventually to restrict the parameter space.

How to cite

top

Pázman, Andrej, and Denis, Jean-Baptiste. "Bias of LS estimators in nonlinear regression models with constraints. Part I: General case." Applications of Mathematics 44.5 (1999): 359-374. <http://eudml.org/doc/32523>.

@article{Pázman1999,
abstract = {We derive expressions for the asymptotic approximation of the bias of the least squares estimators in nonlinear regression models with parameters which are subject to nonlinear equality constraints. The approach suggested modifies the normal equations of the estimator, and approximates them up to $o_\{p\}( N^\{-1\}) $, where $N$ is the number of observations. The “bias equations” so obtained are solved under different assumptions on constraints and on the model. For functions of the parameters the invariance of the approximate bias with respect to reparametrisations is demonstrated. Singular models are considered as well, in which case the constraints may serve either to identify the parameters, or eventually to restrict the parameter space.},
author = {Pázman, Andrej, Denis, Jean-Baptiste},
journal = {Applications of Mathematics},
keywords = {nonlinear least squares; maximum likelihood; asymptotic bias; nonlinear constraints; transformation of parameters; nonlinear least squares; maximum likelihood; asymptotic bias; nonlinear constraints},
language = {eng},
number = {5},
pages = {359-374},
publisher = {Institute of Mathematics, Academy of Sciences of the Czech Republic},
title = {Bias of LS estimators in nonlinear regression models with constraints. Part I: General case},
url = {http://eudml.org/doc/32523},
volume = {44},
year = {1999},
}

TY - JOUR
AU - Pázman, Andrej
AU - Denis, Jean-Baptiste
TI - Bias of LS estimators in nonlinear regression models with constraints. Part I: General case
JO - Applications of Mathematics
PY - 1999
PB - Institute of Mathematics, Academy of Sciences of the Czech Republic
VL - 44
IS - 5
SP - 359
EP - 374
AB - We derive expressions for the asymptotic approximation of the bias of the least squares estimators in nonlinear regression models with parameters which are subject to nonlinear equality constraints. The approach suggested modifies the normal equations of the estimator, and approximates them up to $o_{p}( N^{-1}) $, where $N$ is the number of observations. The “bias equations” so obtained are solved under different assumptions on constraints and on the model. For functions of the parameters the invariance of the approximate bias with respect to reparametrisations is demonstrated. Singular models are considered as well, in which case the constraints may serve either to identify the parameters, or eventually to restrict the parameter space.
LA - eng
KW - nonlinear least squares; maximum likelihood; asymptotic bias; nonlinear constraints; transformation of parameters; nonlinear least squares; maximum likelihood; asymptotic bias; nonlinear constraints
UR - http://eudml.org/doc/32523
ER -

References

top
  1. Bias in nonlinear estimation, Journal of the Royal Statistical Society B 33 (1971), 171–201. (1971) Zbl0232.62029MR0315827
  2. A general definition of residuals, Journal of the Royal Statistical Society B 30 (1968), 248–275. (1968) MR0237052
  3. Mathematical Methods of Statistics, 13th edition, Princeton University Press, Princeton, 1974. (1974) MR1816288
  4. 10.1023/A:1023045028073, Appl. Math. 44 (1999), 375–403. (1999) MR1709502DOI10.1023/A:1023045028073
  5. Nonlinear statistical models, Kluwer Academic Publishers, Dordrecht, 1993. (1993) MR1254661
  6. Bias of the MLE in singular nonlinear regression models, (to appear). (to appear) MR0483216
  7. Bias in nonlinear regression models with constrained parameters, Technical report n 4, Unité de biométrie INRA, Versailles, 1997. (1997) 
  8. 10.1214/aoms/1177706259, 30 (1959), 389–407. (1959) MR0104307DOI10.1214/aoms/1177706259
  9. Statistical Inference, 3rd edition, Chapman and Hall, London, 1979. (1979) MR0500810
  10. Generalized inverse of matrices and its applications, John Wiley, New York, 1971. (1971) MR0338013

NotesEmbed ?

top

You must be logged in to post comments.

To embed these notes on your page include the following JavaScript code on your page where you want the notes to appear.

Only the controls for the widget will be shown in your chosen language. Notes will be shown in their authored language.

Tells the widget how many notes to show per page. You can cycle through additional notes using the next and previous controls.

    
                

Note: Best practice suggests putting the JavaScript code just before the closing </body> tag.