A sharp analysis on the asymptotic behavior of the Durbin–Watson statistic for the first-order autoregressive process

Bernard Bercu; Frédéric Proïa

ESAIM: Probability and Statistics (2013)

  • Volume: 17, page 500-530
  • ISSN: 1292-8100

Abstract

top
The purpose of this paper is to provide a sharp analysis on the asymptotic behavior of the Durbin–Watson statistic. We focus our attention on the first-order autoregressive process where the driven noise is also given by a first-order autoregressive process. We establish the almost sure convergence and the asymptotic normality for both the least squares estimator of the unknown parameter of the autoregressive process as well as for the serial correlation estimator associated with the driven noise. In addition, the almost sure rates of convergence of our estimates are also provided. It allows us to establish the almost sure convergence and the asymptotic normality for the Durbin–Watson statistic. Finally, we propose a new bilateral statistical test for residual autocorrelation. We show how our statistical test procedure performs better, from a theoretical and a practical point of view, than the commonly used Box–Pierce and Ljung–Box procedures, even on small-sized samples.

How to cite

top

Bercu, Bernard, and Proïa, Frédéric. "A sharp analysis on the asymptotic behavior of the Durbin–Watson statistic for the first-order autoregressive process." ESAIM: Probability and Statistics 17 (2013): 500-530. <http://eudml.org/doc/273627>.

@article{Bercu2013,
abstract = {The purpose of this paper is to provide a sharp analysis on the asymptotic behavior of the Durbin–Watson statistic. We focus our attention on the first-order autoregressive process where the driven noise is also given by a first-order autoregressive process. We establish the almost sure convergence and the asymptotic normality for both the least squares estimator of the unknown parameter of the autoregressive process as well as for the serial correlation estimator associated with the driven noise. In addition, the almost sure rates of convergence of our estimates are also provided. It allows us to establish the almost sure convergence and the asymptotic normality for the Durbin–Watson statistic. Finally, we propose a new bilateral statistical test for residual autocorrelation. We show how our statistical test procedure performs better, from a theoretical and a practical point of view, than the commonly used Box–Pierce and Ljung–Box procedures, even on small-sized samples.},
author = {Bercu, Bernard, Proïa, Frédéric},
journal = {ESAIM: Probability and Statistics},
keywords = {Durbin–Watson statistic; autoregressive process; residual autocorrelation; statistical test for serial correlation; Durbin-Watson statistic},
language = {eng},
pages = {500-530},
publisher = {EDP-Sciences},
title = {A sharp analysis on the asymptotic behavior of the Durbin–Watson statistic for the first-order autoregressive process},
url = {http://eudml.org/doc/273627},
volume = {17},
year = {2013},
}

TY - JOUR
AU - Bercu, Bernard
AU - Proïa, Frédéric
TI - A sharp analysis on the asymptotic behavior of the Durbin–Watson statistic for the first-order autoregressive process
JO - ESAIM: Probability and Statistics
PY - 2013
PB - EDP-Sciences
VL - 17
SP - 500
EP - 530
AB - The purpose of this paper is to provide a sharp analysis on the asymptotic behavior of the Durbin–Watson statistic. We focus our attention on the first-order autoregressive process where the driven noise is also given by a first-order autoregressive process. We establish the almost sure convergence and the asymptotic normality for both the least squares estimator of the unknown parameter of the autoregressive process as well as for the serial correlation estimator associated with the driven noise. In addition, the almost sure rates of convergence of our estimates are also provided. It allows us to establish the almost sure convergence and the asymptotic normality for the Durbin–Watson statistic. Finally, we propose a new bilateral statistical test for residual autocorrelation. We show how our statistical test procedure performs better, from a theoretical and a practical point of view, than the commonly used Box–Pierce and Ljung–Box procedures, even on small-sized samples.
LA - eng
KW - Durbin–Watson statistic; autoregressive process; residual autocorrelation; statistical test for serial correlation; Durbin-Watson statistic
UR - http://eudml.org/doc/273627
ER -

References

top
  1. [1] B. Bercu, On the convergence of moments in the almost sure central limit theorem for martingales with statistical applications. Stoch. Process. Appl.11 (2004) 157–173. Zbl1076.62066MR2049573
  2. [2] B. Bercu, P. Cenac and G. Fayolle, On the almost sure central limit theorem for vector martingales: convergence of moments and statistical applications. J. Appl. Probab.46 (2009) 151–169. Zbl1175.60009MR2508511
  3. [3] V. Bitseki Penda, H. Djellout and F. Proïa, Moderate deviations for the Durbin–Watson statistic related to the first-order autoregressive process. Submitted for publication, arXiv:1201.3579 (2012). Zbl1312.60034
  4. [4] G. Box and G. Ljung, On a measure of a lack of fit in time series models. Biometrika65 (1978) 297–303. Zbl0386.62079
  5. [5] G. Box and D. Pierce, Distribution of residual autocorrelations in autoregressive-integrated moving average time series models. Amer. Statist. Assn. J.65 (1970) 1509–1526. Zbl0224.62041MR273762
  6. [6] T. Breusch, Testing for autocorrelation in dynamic linear models. Austral. Econ. Papers.17 (1978) 334–355. 
  7. [7] M. Duflo, Random iterative models, Appl. Math., vol. 34. Springer-Verlag, Berlin (1997). Zbl0868.62069MR1485774
  8. [8] J. Durbin, Testing for serial correlation in least-squares regression when some of the regressors are lagged dependent variables. Econometrica38 (1970) 410–421. Zbl0042.38201MR269030
  9. [9] J. Durbin, Approximate distributions of student’s t-statistics for autoregressive coefficients calculated from regression residuals. J. Appl. Probab. 23A (1986) 173–185. Zbl0581.62021MR803171
  10. [10] J. Durbin and G.S. Watson, Testing for serial correlation in least squares regression I. Biometrika 37 (1950) 409–428. Zbl0039.35803MR39210
  11. [11] J. Durbin and G.S. Watson, Testing for serial correlation in least squares regression II. Biometrika38 (1951) 159–178. Zbl0042.38201MR42662
  12. [12] J. Durbin and G.S. Watson, Testing for serial correlation in least squares regession III. Biometrika58 (1971) 1–19. Zbl0225.62112MR281300
  13. [13] L. Godfrey, Testing against general autoregressive and moving average error models when the regressors include lagged dependent variables. Econometrica46 (1978) 1293–1302. Zbl0395.62062
  14. [14] P. Hall and C.C. Heyde, Martingale limit theory and its application, Probability and Mathematical Statistics. Academic Press Inc., New York (1980). Zbl0462.60045MR624435
  15. [15] B.A. Inder, Finite-sample power of tests for autocorrelation in models containing lagged dependent variables. Econom. Lett.14 (1984) 179–185. Zbl1273.62268
  16. [16] B.A. Inder, An approximation to the null distribution of the Durbin–Watson statistic in models containing lagged dependent variables. Econom. Theory2 (1986) 413–428. 
  17. [17] M.L. King and P.X. Wu, Small-disturbance asymptotics and the Durbin–Watson and related tests in the dynamic regression model. J. Econometrics47 (1991) 145–152. MR1087210
  18. [18] G.S. Maddala and A.S. Rao, Tests for serial correlation in regression models with lagged dependent variables and serially correlated errors. Econometrica41 (1973) 761–774. Zbl0332.62050
  19. [19] E. Malinvaud, Estimation et prévision dans les modèles économiques autorégressifs. Review of the International Institute of Statistics29 (1961) 1–32. Zbl0269.90007
  20. [20] M. Nerlove and K.F. Wallis, Use of the Durbin–Watson statistic in inappropriate situations. Econometrica34 (1966) 235–238. MR208790
  21. [21] S.B. Park, On the small-sample power of Durbin’s h-test. J. Amer. Stat. Assoc.70 (1975) 60–63. Zbl0309.62016
  22. [22] F. Proïa, A new statistical procedure for testing the presence of a significative correlation in the residuals of stable autoregressive processes. Submitted for publication, arXiv:1203.1871 (2012). 
  23. [23] T. Stocker, On the asymptotic bias of OLS in dynamic regression models with autocorrelated errors. Statist. Papers48 (2007) 81–93. Zbl1132.62348MR2288173
  24. [24] W.F. Stout, A martingale analogue of Kolmogorov’s law of the iterated logarithm. Z. Wahrscheinlichkeitstheorie und Verw. Gebiete15 (1970) 279–290. Zbl0209.49004MR293701
  25. [25] W.F. Stout, Almost sure convergence, Probab. Math. Statist. Academic Press, New York, London 24 (1974). Zbl0321.60022MR455094
  26. [26] J.A. Tillman, The power of the Durbin–Watson test. Econometrica43 (1975) 959–974. Zbl0322.62027MR440768
  27. [27] C. Wei and J. Winnicki, Estimation on the means in the branching process with immigration. Ann. Statist.18 (1990) 1757–1773. Zbl0736.62071MR1074433

NotesEmbed ?

top

You must be logged in to post comments.

To embed these notes on your page include the following JavaScript code on your page where you want the notes to appear.

Only the controls for the widget will be shown in your chosen language. Notes will be shown in their authored language.

Tells the widget how many notes to show per page. You can cycle through additional notes using the next and previous controls.

    
                

Note: Best practice suggests putting the JavaScript code just before the closing </body> tag.