Caltech Control and Dynamical Systems Technical Reports

Significance Regression: Improved Estimation from Collinear Data for the Measurement Error Model

Holcomb, Tyler R. and Morari, Manfred (1993) Significance Regression: Improved Estimation from Collinear Data for the Measurement Error Model. Technical Report. California Institute of Technology, Pasadena, CA. [CaltechCDSTR:1993.004]

Full text available as:

PDF - Requires Adobe Acrobat Reader or other PDF viewer.
Postscript - Requires a viewer, such as GhostView

Abstract

This paper examines improved regression methods for the linear multivariable measurement error model (MEM) when the data suffers from "collinearity." The difficulty collinearity presents for reliable estinlation is discussed and a systematic procedure, significance regression (SR-MEM), is developed to address collinearity. In addition to mitigating collinearity difficulties SR-MEM produces asymptotically unbiased estimates. The use of ordinary least squares (OLS) for the MEM is examined. For collinear data OLS can improve the mean squared error of estimation over the maximum likelihood (ML) unbiased estimator in a manner analogous to ridge regression (RR). The significance regression method developed for the classical model (SR-classical) can also be used for data with measurement errors. SR-classical is similar SR-MEM and can yield better estimation than the ML estimator for collinear data. Numerical examples illustrate several points.

EPrint Type:Monograph (Technical Report)
Additional Information:The author's thank Håkan Hjalmarsson for his helpful comments concerning asymptotic distributions. This research was partially supported by the Department of Energy, Office of Basic Energy Sciences, and by the Caltech Consortium in Chemistry and Chemical Engineering. Founding members of the Consortium are E. I. du Pont de Nemours and Company, inc., Eastman Kodak Company, Minnesota Mining and Manufacturing Company, and Shell Oil Company Foundation.
Uncontrolled Keywords:measurement error models, biased regression, partial least squares, multivariable regression, significance regression, collinearity
Subjects:All Records
ID Code:72
Deposited By:Caltech Library System
Deposited On:28 August 2006
Unique Identifier:CaltechCDSTR:1993.004
Official Persistent URL:http://resolver.caltech.edu/CaltechCDSTR:1993.004
Usage Policy:You are granted permission for individual, educational, research and non-commercial reproduction, distribution, display and performance of this work in any format.

Archive Staff Only: edit this record