Rank theory approach to ridge, LASSO, preliminary test and Stein-type estimators: Comparative study

A. K. Md. Ehsanes Saleh; Radim Navrátil

Displaying similar documents to “Rank theory approach to ridge, LASSO, preliminary test and Stein-type estimators: Comparative study”

Existence, Consistency and computer simulation for selected variants of minimum distance estimators

Václav Kůs, Domingo Morales, Jitka Hrabáková, Iva Frýdlová (2018)

Kybernetika

Similarity:

The paper deals with sufficient conditions for the existence of general approximate minimum distance estimator (AMDE) of a probability density function $f_{0}$ on the real line. It shows that the AMDE always exists when the bounded $φ$ -divergence, Kolmogorov, Lévy, Cramér, or discrepancy distance is used. Consequently, $n^{- 1 / 2}$ consistency rate in any bounded $φ$ -divergence is established for Kolmogorov, Lévy, and discrepancy estimators under the condition that the degree of variations of the corresponding...

$M$ -estimators of structural parameters in pseudolinear models

Friedrich Liese, Igor Vajda (1999)

Applications of Mathematics

Similarity:

Real valued $M$ -estimators ${\hat{θ}}_{n} : = min \sum_{1}^{n} ρ (Y_{i} - τ (θ))$ in a statistical model with observations $Y_{i} \sim F_{θ_{0}}$ are replaced by $ℝ^{p}$ -valued $M$ -estimators ${\hat{β}}_{n} : = min \sum_{1}^{n} ρ (Y_{i} - τ (u (z_{i}^{T} β)))$ in a new model with observations $Y_{i} \sim F_{u (z_{i}^{t} β_{0})}$ , where $z_{i} \in ℝ^{p}$ are regressors, $β_{0} \in ℝ^{p}$ is a structural parameter and $u : ℝ \to ℝ$ a structural function of the new model. Sufficient conditions for the consistency of ${\hat{β}}_{n}$ are derived, motivated by the sufficiency conditions for the simpler “parent estimator” ${\hat{θ}}_{n}$ . The result is a general method of consistent estimation in a class of nonlinear (pseudolinear) statistical...

Instrumental weighted variables under heteroscedasticity. Part I – Consistency

Jan Ámos Víšek (2017)

Kybernetika

Similarity:

The proof of consistency instrumental weighted variables, the robust version of the classical instrumental variables is given. It is proved that all solutions of the corresponding normal equations are contained, with high probability, in a ball, the radius of which can be selected - asymptotically - arbitrarily small. Then also $\sqrt{n}$ -consistency is proved. An extended numerical study (the Part II of the paper) offers a picture of behavior of the estimator for finite samples under various...

Estimator selection in the gaussian setting

Yannick Baraud, Christophe Giraud, Sylvie Huet (2014)

Annales de l'I.H.P. Probabilités et statistiques

Similarity:

We consider the problem of estimating the mean $f$ of a Gaussian vector $Y$ with independent components of common unknown variance $σ^{2}$ . Our estimation procedure is based on estimator selection. More precisely, we start with an arbitrary and possibly infinite collection $𝔽$ of estimators of $f$ based on $Y$ and, with the same data $Y$ , aim at selecting an estimator among $𝔽$ with the smallest Euclidean risk. No assumptions on the estimators are made and their dependencies with respect to $Y$ may be unknown....

Compact hypothesis and extremal set estimators

João Tiago Mexia, Pedro Corte Real (2003)

Discussiones Mathematicae Probability and Statistics

Similarity:

In extremal estimation theory the estimators are local or absolute extremes of functions defined on the cartesian product of the parameter by the sample space. Assuming that these functions converge uniformly, in a convenient stochastic way, to a limit function g, set estimators for the set ∇ of absolute maxima (minima) of g are obtained under the compactness assumption that ∇ is contained in a known compact U. A strongly consistent test is presented for this assumption. Moreover, when...

Locally and uniformly best estimators in replicated regression model

Júlia Volaufová, Lubomír Kubáček (1983)

Aplikace matematiky

Similarity:

The aim of the paper is to estimate a function $γ = t r (D β β^{'}) + t r (C \sum)$ (with $d, C$ known matrices) in a regression model $(Y, X β, \sum)$ with an unknown parameter $β$ and covariance matrix $\sum$ . Stochastically independent replications $Y_{1}, ..., Y_{m}$ of the stochastic vector $Y$ are considered, where the estimators of $X β$ and $\sum$ are $\bar{Y} = \frac{1}{m} \sum_{i = 1}^{m} Y_{i}$ and $\sum^{^} = {(m - 1)}^{- 1} \sum_{i = 1}^{m} (Y_{i} - \bar{Y}) {(Y_{i} - \bar{Y})}^{'}$ , respectively. Locally and uniformly best inbiased estimators of the function $γ$ , based on $\bar{Y}$ and $\sum^{^}$ , are given.

Orthogonal series regression estimation under long-range dependent errors

Waldemar Popiński (2001)

Applicationes Mathematicae

Similarity:

This paper is concerned with general conditions for convergence rates of nonparametric orthogonal series estimators of the regression function. The estimators are obtained by the least squares method on the basis of an observation sample $Y_{i} = f (X_{i}) + η_{i}$ , i=1,...,n, where $X_{i} \in A \subset ℝ^{d}$ are independently chosen from a distribution with density ϱ ∈ L¹(A) and $η_{i}$ are zero mean stationary errors with long-range dependence. Convergence rates of the error $n^{- 1} \sum_{i = 1}^{n} (f (X_{i}) - f ̂_{N} (X_{i})) ²$ for the estimator $f ̂_{N} (x) = \sum_{k = 1}^{N} c ̂_{k} e_{k} (x)$ , constructed using an orthonormal system...

Orthogonal series estimation of band-limited regression functions

Waldemar Popiński (2014)

Applicationes Mathematicae

Similarity:

The problem of nonparametric function fitting using the complete orthogonal system of Whittaker cardinal functions $s_{k}$ , k = 0,±1,..., for the observation model $y_{j} = f (u_{j}) + η_{j}$ , j = 1,...,n, is considered, where f ∈ L²(ℝ) ∩ BL(Ω) for Ω > 0 is a band-limited function, $u_{j}$ are independent random variables uniformly distributed in the observation interval [-T,T], $η_{j}$ are uncorrelated or correlated random variables with zero mean value and finite variance, independent of the observation points. Conditions...

An adaptive $h p$ -discontinuous Galerkin approach for nonlinear convection-diffusion problems

Dolejší, Vít

Similarity:

We deal with a numerical solution of nonlinear convection-diffusion equations with the aid of the discontinuous Galerkin method (DGM). We propose a new $h p$ -adaptation technique, which is based on a combination of a residuum estimator and a regularity indicator. The residuum estimator as well as the regularity indicator are easily evaluated quantities without the necessity to solve any local problem and/or any reconstruction of the approximate solution. The performance of the proposed $h p$ -DGM...

The Bayes choice of an experiment in estimating a success probability

Alicja Jokiel-Rokita, Ryszard Magiera (2002)

Applicationes Mathematicae

Similarity:

A Bayesian method of estimation of a success probability p is considered in the case when two experiments are available: individual Bernoulli (p) trials-the p-experiment-or products of r individual Bernoulli (p) trials-the $p^{r}$ -experiment. This problem has its roots in reliability, where one can test either single components or a system of r identical components. One of the problems considered is to find the degree r̃ of the $p^{r ̃}$ -experiment and the size m̃ of the p-experiment such that the...

Best unbiased estimates for parameters of three-level multivariate data with doubly exchangeable covariance structure and structured mean vector

Arkadiusz Kozioł (2016)

Discussiones Mathematicae Probability and Statistics

Similarity:

In this article author obtain the best unbiased estimators of doubly exchangeable covariance structure. For this purpose the coordinate free-coordinate approach is used. Considered covariance structure consist of three unstructured covariance matrices for three-level $m -$ variate observations with equal mean vector over v points in time and u sites under the assumption of multivariate normality. To prove, that the estimators are best unbiased, complete statistics are used. Additionally,...

Instrumental weighted variables under heteroscedasticity. Part II – Numerical study

Jan Ámos Víšek (2017)

Kybernetika

Similarity:

Results of a numerical study of the behavior of the instrumental weighted variables estimator – in a competition with two other estimators – are presented. The study was performed under various frameworks (homoscedsticity/heteroscedasticity, several level and types of contamination of data, fulfilled/broken orthogonality condition). At the beginning the optimal values of eligible parameters of estimatros in question were empirically established. It was done under the various sizes of...