Comparison of regression estimators using Pitman measures of nearness. (English) Zbl 1099.62525

Summary: Using the criterion of Pitman measure of nearness, the paper provides a theoretical result about the performance of any two members of a class of ridge-type estimators of the regression parameter. Based on the result, it is possible to establish conditions under which a member of the ridge-type class of estimators is better than the standard least squares estimator in the Pitman-nearness sense.


62J07 Ridge regression; shrinkage estimators (Lasso)
Full Text: DOI


[1] Bertuzzi, A. and Gandolfi, A. (1991): Ridge regression versus OLS by Pitman’s closeness under quadratic and Fisher’s loss. Communications in Statistics – Theory and Methods 20, 3581–3590. · Zbl 0800.62414
[2] Conerly, M.D. and Hardin, M.J. (1990): A comparison of biased regression estimators using a Pitman Nearness criterion. Journal of Statistical Computation and Simulations 34, 75–95. · Zbl 0726.62117
[3] Hocking, R.R., Speed, F.M. and Lynn, M.J. (1976): A class of biased estimators in linear regression. Technometrics 18, 425–437. · Zbl 0346.62046
[4] Hoerl, A.E. and Kennard, R.W. (1970a): Ridge regression: Biased estimation for non-orthogonal problems. Technometrics 12, 55–67. · Zbl 0202.17205
[5] Hoerl, A.E. and Kennard, R.W. (1970b): Ridge regression: Applications to non-orthogonal problems. Technometrics 12, 69–82. · Zbl 0202.17206
[6] Keating, J.P., Mason, R.L. and Sen, P.K. (1993): Pitman Measure of Closeness: A Comparison of Statistical Estimators. Society for Industrial and Applied Mathematics (SIAM), (monograph).
[7] Marquardt, D.W. (1970): Generalized inverses, ridge regression, biased linear estimation and non-linear estimation. Technometrics 12, 591–612. · Zbl 0205.46102
[8] Mason, R.L. and Blaylock, N.W. (1991): Ridge regression estimator comparisons using Pitman’s Measure of Closeness. Communications in Statistics-Theory and Methods 20, 3629–3641. · Zbl 04505311
[9] Mason, R.L., Keating, J.P., Sen, P.K and Blaylock, N.W. (1990): Comparison of linear estimators using Pitman’s Measure of Closeness. Journal of American Statistical Association 85, 579–581. · Zbl 0702.62049
[10] Mayer, L.S. and Willke, T.A. (1973): On biased estimation in linear models. Technometrics 15, 497–508. · Zbl 0265.62017
[11] Pitman, E.J.G. (1937): The closest estimates of statistical parameters. Proceedings of the Cambridge Philosophical Society 33, 212–222. · JFM 63.0515.03
[12] Obenchain, R.L. (1975): Ridge analysis following a preliminary test of shrunken hypothesis. Technometrics 17, 431–445. · Zbl 0324.62050
[13] Obenchain, R.L. (1978): Good and optimal ridge estimators. Annals of Statistics 6, 1111–1121. · Zbl 0384.62059
[14] Rao, C.R. (1981): Some comments on the minimum mean square error as a criterion of estimation. In: Statistics and Related Topics. Eds. M. Csorgo, D.A. Dawson, J.N.K. Rao, A.A. M. E. Saleh. Amsterdam: North-Holland, 123–143.
[15] Trenkler, D. (1986): Verallgemeinerte Ridge Regression. In: Mathematical Systems in Economics 104. Anton Hain Verlag, Frankfurt/Main. · Zbl 0597.62077
[16] Trenkler, G. (1981): Biased estimators in linear regression model. In: Mathematical Systems in Economics 58. Oelgeschlager, Gunn/Hain, Cambridge, Massachussets. · Zbl 0471.62070
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. It attempts to reflect the references listed in the original paper as accurately as possible without claiming the completeness or perfect precision of the matching.