Oracle inequalities and nonparametric function estimation.
Este artículos concierne las distribuciones usadas para construir intervalos de confianza para la función de densidad en una situación no paramétrica. Se comparan los órdenes de convergencia para el límite normal, su aproximación "plug in" y el método bootstrap. Se deduce que el bootstrap se comporta mejor que las otras dos aproximaciones tanto en su forma clásica como con la aproximación bootstrap normal.
We propose a general partition-based strategy to estimate conditional density with candidate densities that are piecewise constant with respect to the covariate. Capitalizing on a general penalized maximum likelihood model selection result, we prove, on two specific examples, that the penalty of each model can be chosen roughly proportional to its dimension. We first study a classical strategy in which the densities are chosen piecewise conditional according to the variable. We then consider Gaussian...
In this article we tackle the problem of inverse non linear ill-posed problems from a statistical point of view. We discuss the problem of estimating an indirectly observed function, without prior knowledge of its regularity, based on noisy observations. For this we consider two approaches: one based on the Tikhonov regularization procedure, and another one based on model selection methods for both ordered and non ordered subsets. In each case we prove consistency of the estimators and show...
In this paper we obtain root-n consistency and functional central limit theorems in weighted L1-spaces for plug-in estimators of the two-step transition density in the classical stationary linear autoregressive model of order one, assuming essentially only that the innovation density has bounded variation. We also show that plugging in a properly weighted residual-based kernel estimator for the unknown innovation density improves on plugging in an unweighted residual-based kernel estimator....
We study estimation problems for periodically correlated, non gaussian processes. We estimate the correlation functions and the spectral densities from continuous-time samples. From a random time sample, we construct three types of estimators for the spectral densities and we prove their consistency.
Dvoretzky-Kiefer-Wolfowitz type inequalities for some polynomial and spline estimators of distribution functions are constructed. Moreover, hints on the corresponding algorithms are given as well.
This paper presents a practical and simple fully nonparametric multivariate smoothing procedure that adapts to the underlying smoothness of the true regression function. Our estimator is easily computed by successive application of existing base smoothers (without the need of selecting an optimal smoothing parameter), such as thin-plate spline or kernel smoothers. The resulting smoother has better out of sample predictive capabilities than the underlying base smoother, or competing structurally...
We give a review on the properties and applications of M-estimators with redescending score function. For regression analysis, some of these redescending M-estimators can attain the maximum breakdown point which is possible in this setup. Moreover, some of them are the solutions of the problem of maximizing the efficiency under bounded influence function when the regression coefficient and the scale parameter are estimated simultaneously. Hence redescending M-estimators satisfy several outlier robustness...
Kernel smoothers belong to the most popular nonparametric functional estimates used for describing data structure. They can be applied to the fix design regression model as well as to the random design regression model. The main idea of this paper is to present a construction of the optimum kernel and optimum boundary kernel by means of the Gegenbauer and Legendre polynomials.
In this paper we focus on the problem of estimating a bounded density using a finite combination of densities from a given class. We consider the Maximum Likelihood Estimator (MLE) and the greedy procedure described by Li and Barron (1999) under the additional assumption of boundedness of densities. We prove an bound on the estimation error which does not depend on the number of densities in the estimated combination. Under the boundedness assumption, this improves the bound of Li and Barron by...
In this paper we focus on the problem of estimating a bounded density using a finite combination of densities from a given class. We consider the Maximum Likelihood Estimator (MLE) and the greedy procedure described by Li and Barron (1999) under the additional assumption of boundedness of densities. We prove an bound on the estimation error which does not depend on the number of densities in the estimated combination. Under the boundedness assumption, this improves the bound of Li and Barron...
We consider the segmentation problem of Poisson and negative binomial (i.e. overdispersed Poisson) rate distributions. In segmentation, an important issue remains the choice of the number of segments. To this end, we propose a penalized -likelihood estimator where the penalty function is constructed in a non-asymptotic context following the works of L. Birgé and P. Massart. The resulting estimator is proved to satisfy an oracle inequality. The performances of our criterion is assessed using simulated...
Supongamos que yi = ζiT β + m(ti) + εi, i = 1, ..., n, donde el vector (p x 1) β y la función m(·) son desconocidos, y los errores εi provienen de un proceso autorregresivo de orden uno (AR(1)) estacionario. Discutimos aquí el problema de la selección del parámetro ventana de un estimador tipo núcleo de la función m(·) basado en un estimador Generalizado de Mínimos Cuadrados de β. Obtenemos la expresión asintótica de una ventana óptima y proponemos un método para estimarla, de modo que dé lugar...
This paper deals with semiparametric convolution models, where the noise sequence has a gaussian centered distribution, with unknown variance. Non-parametric convolution models are concerned with the case of an entirely known distribution for the noise sequence, and they have been widely studied in the past decade. The main property of those models is the following one: the more regular the distribution of the noise is, the worst the rate of convergence for the estimation of the signal’s density...
This paper deals with semiparametric convolution models, where the noise sequence has a Gaussian centered distribution, with unknown variance. Non-parametric convolution models are concerned with the case of an entirely known distribution for the noise sequence, and they have been widely studied in the past decade. The main property of those models is the following one: the more regular the distribution of the noise is, the worst the rate of convergence for the estimation of the signal's density...
In the paper we investigate properties of maximum pseudo-likelihood estimators for the copula density and minimum distance estimators for the copula. We derive statements on the consistency and the asymptotic normality of the estimators for the parameters.