False parsimony and its detection with GLMs

A search for a good parsimonious model is often required in data analysis. However, unfortunately we may end up with a falsely parsimonious model. Misspecification of the variance structure causes a loss of efficiency in regression estimation and this can lead to large standard-error estimates, producing possibly false parsimony. With generalized linear models (GLMs) we can keep the link function fixed while changing the variance function, thus allowing us to recognize false parsimony caused by such increased standard errors. With data transformation, any change of transformation automatically changes the scale for additivity, making false parsimony hard to recognize.