The aim of this paper is to establish theorems on the absolute continuity of translation as well as scale invariant statistics in general, from which the related results by Hodges-Lehmann and Puri-Sen follow. The continuity relations between the joint cdf of a random vector and its marginal cdf's are also considered.
In order to develop a general criterion for proving strong consistency of estimators in Statistics of stochastic processes, we study an extension, to the continuous-time case, of the strong law of large numbers for discrete time square integrable martingales (e.g. Neveu, 1965, 1972). Applications to estimation in diffusion models are given.
We study sample-based estimates of the expectation of the function produced by the empirical minimization algorithm. We investigate the extent to which one can estimate the rate of convergence of the empirical minimizer in a data dependent manner. We establish three main results. First, we provide an algorithm that upper bounds the expectation of the empirical minimizer in a completely data-dependent manner. This bound is based on a structural result due to Bartlett and Mendelson, which relates...
We consider, in the framework of multidimensional observations, nonparametric functional estimators, which include, as special cases, the Akaike–Parzen–Rosenblatt kernel density estimators ([1, 18, 20]), and the Nadaraya–Watson kernel regression estimators ([16, 22]). We evaluate the sup-norm, over a given set , of the difference between the estimator and a non-random functional centering factor (which reduces to the estimator mean for kernel density estimation). We show that, under suitable general...
A survey of some recent results on nonparametric on-line estimation is presented. The first result deals with an on-line estimation for a smooth signal S(t) in the classic 'signal plus Gaussian white noise' model. Then an analogous on-line estimator for the regression estimation problem with equidistant design is described and justified. Finally some preliminary results related to the on-line estimation for the diffusion observed process are described.
"A high quantile is a quantile of order q with q close to one." A precise constructive definition of high quantiles is given and optimal estimates are presented.
This paper is a survey of recent results on some problems of supervised learning in the setting formulated by Cucker and Smale. Supervised learning, or learning-from-examples, refers to a process that builds on the base of available data of inputs and outputs , i = 1,...,m, a function that best represents the relation between the inputs x ∈ X and the corresponding outputs y ∈ Y. The goal is to find an estimator on the base of given data that approximates well the regression function of...
In this paper we deepen the study of the nonlinear principal components introduced by Salinelli in 1998, referring to a real random variable. New insights on their probabilistic and statistical meaning are given with some properties. An estimation procedure based on spline functions, adapting to a statistical framework the classical Rayleigh–Ritz method, is introduced. Asymptotic properties of the estimator are proved, providing an upper bound for the rate of convergence under suitable mild conditions....
We propose a novel 3-way alternating regression (3-AR) method as an effective strategy for the estimation of parameter values in S-distributions from frequency data. The 3-AR algorithm is very fast and performs well for error-free distributions and artificial noisy data obtained as random samples generated from S-distributions, as well as for traditional statistical distributions and for actual observation data. In rare cases where the algorithm does not immediately converge, its enormous speed...
This paper deals with the problem of estimating a regression function f, in a random design framework. We build and study two adaptive estimators based on model selection, applied with warped bases. We start with a collection of finite dimensional linear spaces, spanned by orthonormal bases. Instead of expanding directly the target function f on these bases, we rather consider the expansion of h = f ∘ G-1, where G is the cumulative distribution function of the design, following Kerkyacharian and...
This paper deals with the problem of estimating the level sets L(c) = {F(x) ≥ c}, with c ∈ (0,1), of an unknown distribution function F on ℝ+2. A plug-in approach is followed. That is, given a consistent estimator Fn of F, we estimate L(c) by Ln(c) = {Fn(x) ≥ c}. In our setting, non-compactness property is a priori required for the level sets to estimate. We state consistency results with respect to the Hausdorff distance and the volume of the symmetric difference. Our results are motivated by...
A method for estimation of probability distribution of transformed random variables is presented. The proposed approach admits an approximation of the transformation of the random variables. The approximate probability density function (pdf) is corrected to obtain a resulting pdf which incorporates a prior knowledge of approximation errors. The corrected pdf is not contaminated by any uncontrollable approximation. The method is applied to pattern recognition. It is shown that class conditional pdf...
A method is introduced to select the significant or non null mean terms among a collection of independent random variables. As an application we consider the problem of recovering the significant coefficients in non ordered model selection. The method is based on a convenient random centering of the partial sums of the ordered observations. Based on L-statistics methods we show consistency of the proposed estimator. An extension to unknown parametric distributions is considered. Simulated examples...