Dimension reduction methods in [[base/Linear Regression/linear regression|linear regression]] transform the predictors and fit the [[least squares estimator]] using the transformed variables. Methods include [[principal component analysis]]. ## principal component regression In principal component regression, the first $p$ principal components, as derived by [[principal component analysis]], are used to fit the regression model.