Displaying similar documents to “Note on universal algorithms for learning theory”

Stacked regression with restrictions

Tomasz Górecki (2005)

Discussiones Mathematicae Probability and Statistics

Similarity:

When we apply stacked regression to classification we need only discriminant indices which can be negative. In many situations, we want these indices to be positive, e.g., if we want to use them to count posterior probabilities, when we want to use stacked regression to combining classification. In such situation, we have to use leastsquares regression under the constraint βₖ ≥ 0, k = 1,2,...,K. In their earlier work [5], LeBlanc and Tibshirani used an algorithm given in [4]. However,...

Directional quantile regression in Octave (and MATLAB)

Pavel Boček, Miroslav Šiman (2016)

Kybernetika

Similarity:

Although many words have been written about two recent directional (regression) quantile concepts, their applications, and the algorithms for computing associated (regression) quantile regions, their software implementation is still not widely available, which, of course, severely hinders the dissemination of both methods. Wanting to partly fill in the gap here, we provide all the codes needed for computing and plotting the multivariate (regression) quantile regions in Octave and MATLAB,...

Smoothing dichotomy in randomized fixed-design regression with strongly dependent errors based on a moving average

Artur Bryk (2014)

Applicationes Mathematicae

Similarity:

We consider a fixed-design regression model with errors which form a Borel measurable function of a long-range dependent moving average process. We introduce an artificial randomization of grid points at which observations are taken in order to diminish the impact of strong dependence. We show that the Priestley-Chao kernel estimator of the regression fuction exhibits a dichotomous asymptotic behaviour depending on the amount of smoothing employed. Moreover, the resulting estimator is...

Adaptive trimmed likelihood estimation in regression

Tadeusz Bednarski, Brenton R. Clarke, Daniel Schubert (2010)

Discussiones Mathematicae Probability and Statistics

Similarity:

In this paper we derive an asymptotic normality result for an adaptive trimmed likelihood estimator of regression starting from initial high breakdownpoint robust regression estimates. The approach leads to quickly and easily computed robust and efficient estimates for regression. A highlight of the method is that it tends automatically in one algorithm to expose the outliers and give least squares estimates with the outliers removed. The idea is to begin with a rapidly computed consistent...

Exploring the impact of post-training rounding in regression models

Jan Kalina (2024)

Applications of Mathematics

Similarity:

Post-training rounding, also known as quantization, of estimated parameters stands as a widely adopted technique for mitigating energy consumption and latency in machine learning models. This theoretical endeavor delves into the examination of the impact of rounding estimated parameters in key regression methods within the realms of statistics and machine learning. The proposed approach allows for the perturbation of parameters through an additive error with values within a specified...

Detecting atypical data in air pollution studies by using shorth intervals for regression

Cécile Durot, Karelle Thiébot (2010)

ESAIM: Probability and Statistics

Similarity:

To validate pollution data, subject-matter experts in Airpl (an organization that maintains a network of air pollution monitoring stations in western France) daily perform visual examinations of the data and check their consistency. In this paper, we describe these visual examinations and propose a formalization for this problem. The examinations consist in comparisons of so-called shorth intervals so we build a statistical test that compares such intervals in a nonparametric regression...

Some Diagnostic Tools in Robust Econometrics

Jan Kalina (2011)

Acta Universitatis Palackianae Olomucensis. Facultas Rerum Naturalium. Mathematica

Similarity:

Highly robust statistical and econometric methods have been developed not only as a diagnostic tool for standard methods, but they can be also used as self-standing methods for valid inference. Therefore the robust methods need to be equipped by their own diagnostic tools. This paper describes diagnostics for robust estimation of parameters in two econometric models derived from the linear regression. Both methods are special cases of the generalized method of moments estimator based...

Redescending M-estimators in regression analysis, cluster analysis and image analysis

Christine H. Müller (2004)

Discussiones Mathematicae Probability and Statistics

Similarity:

We give a review on the properties and applications of M-estimators with redescending score function. For regression analysis, some of these redescending M-estimators can attain the maximum breakdown point which is possible in this setup. Moreover, some of them are the solutions of the problem of maximizing the efficiency under bounded influence function when the regression coefficient and the scale parameter are estimated simultaneously. Hence redescending M-estimators satisfy several...

Trimmed Estimators in Regression Framework

TomĂĄĹĄ Jurczyk (2011)

Acta Universitatis Palackianae Olomucensis. Facultas Rerum Naturalium. Mathematica

Similarity:

From the practical point of view the regression analysis and its Least Squares method is clearly one of the most used techniques of statistics. Unfortunately, if there is some problem present in the data (for example contamination), classical methods are not longer suitable. A lot of methods have been proposed to overcome these problematic situations. In this contribution we focus on special kind of methods based on trimming. There exist several approaches which use trimming off part...

An adaptive method of estimation and outlier detection in regression applicable for small to moderate sample sizes

Brenton R. Clarke (2000)

Discussiones Mathematicae Probability and Statistics

Similarity:

In small to moderate sample sizes it is important to make use of all the data when there are no outliers, for reasons of efficiency. It is equally important to guard against the possibility that there may be single or multiple outliers which can have disastrous effects on normal theory least squares estimation and inference. The purpose of this paper is to describe and illustrate the use of an adaptive regression estimation algorithm which can be used to highlight outliers, either single...