Generalized Least Squares Model Averaging

In this article, we propose a method of averaging generalized least squares estimators for linear regression models with heteroskedastic errors. The averaging weights are chosen to minimize Mallows’ C_p-like criterion. We show that the weight vector selected by our method is optimal. It is also shown that this optimality holds even when the variances of the error terms are estimated and the feasible generalized least squares estimators are averaged. The variances can be estimated parametrically or nonparametrically. Monte Carlo simulation results are encouraging. An empirical example illustrates that the proposed method is useful for predicting a measure of firms’ performance.     

Bandwidth selection for kernel regression with correlated errors

In this paper, we propose bandwidth selectors for nonparametric regression with dependent errors. The methods are based on criteria that approximate the average squared error. We show that these approximations are uniform over the bandwidth sequence. The criteria involve some constants that depend on the unknown error correlations. We propose a novel way of estimating these constants. Our numerical study shows that the method is quite efficient in a variety of error models.     

Resistant selection of the smoothing parameter for smoothing splines

Robust automatic selection techniques for the smoothing parameter of a smoothing spline are introduced. They are based on a robust predictive error criterion and can be viewed as robust versions of C _p and cross-validation. They lead to smoothing splines which are stable and reliable in terms of mean squared error over a large spectrum of model distributions.     

Goodness of fit for thei ordered categories discrete uniform distribution

Goodness of fit for thei ordered categories discrete uniform distribution can be carried out using Pearson's X² _pstatistic and its components. Applications of this technique are considered and comparisons made with recently suggested empirical uniform distribution     

Lower confidence bounds as precision measure for truncated processes

Process capability index C_p has been the most popular one used in the manufacturing industry to provide numerical measures on process precision. For normally distributed processes with automatic fully inspections, the inspected processes follow truncated normal distributions. In this article, we provide the formulae of moments used for the Edgeworth approximation on the precision measurement C_p for truncated normally distributed processes. Based on the developed moments, lower confidence bounds with various sample sizes and confidence levels are provided and tabulated. Consequently, practitioners can use lower confidence bounds to determine whether their manufacturing processes are capable of preset precision requirements.     

A MORE GENERAL CRITERION FOR SUBSET SELECTION IN MULTIPLE LINEAR REGRESSION

ABSTRACT

In this article, we propose a more general criterion called S_p -criterion, for subset selection in the multiple linear regression Model. Many subset selection methods are based on the Least Squares (LS) estimator of β, but whenever the data contain an influential observation or the distribution of the error variable deviates from normality, the LS estimator performs ‘poorly’ and hence a method based on this estimator (for example, Mallows’ C_p -criterion) tends to select a ‘wrong’ subset. The proposed method overcomes this drawback and its main feature is that it can be used with any type of estimator (either the LS estimator or any robust estimator) of β without any need for modification of the proposed criterion. Moreover, this technique is operationally simple to implement as compared to other existing criteria. The method is illustrated with examples.     

A modified Cp statistic in a system-of-equations model

A new statistic, SΓ(p), is developed for variable selection in a system-of-equations model. The standardized total mean square error in the SΓ(p)statistic is weighted by the covariance matrix of dependent variables instead of the error covariance matrix of the true model as in the original definition. The new statistic can be also used for model selection in the non-nested models. The estimate of SΓ(p), SC(p), is derived and shown to become SC_ε(p) in the similar form of C_p in a single-equation model when the covariance matrix of sampled dependent variables is replaced by the error covariance matrix under the full model.     

Regularization and variable selection via the elastic net

Summary.  We propose the elastic net, a new regularization and variable selection method. Real world data and a simulation study show that the elastic net often outperforms the lasso, while enjoying a similar sparsity of representation. In addition, the elastic net encourages a grouping effect, where strongly correlated predictors tend to be in or out of the model together. The elastic net is particularly useful when the number of predictors ( p ) is much bigger than the number of observations ( n ). By contrast, the lasso is not a very satisfactory variable selection method in the p ≫ n case. An algorithm called LARS-EN is proposed for computing elastic net regularization paths efficiently, much like algorithm LARS does for the lasso.     

Empirical Bayes vs. fully Bayes variable selection

For the problem of variable selection for the normal linear model, fixed penalty selection criteria such as AIC, _Cp${\mathrm{C}}_p$, BIC and RIC correspond to the posterior modes of a hierarchical Bayes model for various fixed hyperparameter settings. Adaptive selection criteria obtained by empirical Bayes estimation of the hyperparameters have been shown by George and Foster [2000. Calibration and Empirical Bayes variable selection. Biometrika 87(4), 731–747] to improve on these fixed selection criteria. In this paper, we study the potential of alternative fully Bayes methods, which instead margin out the hyperparameters with respect to prior distributions. Several structured prior formulations are considered for which fully Bayes selection and estimation methods are obtained. Analytical and simulation comparisons with empirical Bayes counterparts are studied.     

Bayesian variable selection using an adaptive powered correlation prior

The problem of selecting the correct subset of predictors within a linear model has received much attention in recent literature. Within the Bayesian framework, a popular choice of prior has been Zellner's g$g$-prior which is based on the inverse of empirical covariance matrix of the predictors. An extension of the Zellner's prior is proposed in this article which allow for a power parameter on the empirical covariance of the predictors. The power parameter helps control the degree to which correlated predictors are smoothed towards or away from one another. In addition, the empirical covariance of the predictors is used to obtain suitable priors over model space. In this manner, the power parameter also helps to determine whether models containing highly collinear predictors are preferred or avoided. The proposed power parameter can be chosen via an empirical Bayes method which leads to a data adaptive choice of prior. Simulation studies and a real data example are presented to show how the power parameter is well determined from the degree of cross-correlation within predictors. The proposed modification compares favorably to the standard use of Zellner's prior and an intrinsic prior in these examples.     

A program to calculate bootstrap confidence intervals for the process capability index Cpk

Franklin and Wasserman (1991) introduced the use of Bootstrap sampling procedures for deriving nonparametric confidence intervals for the process capability index, C_pk, which are applicable for instances when at least twenty data points are available. This represents a significant reduction in the usually recommended sample requirement of 100 observations (see Gunther 1989). To facilitate and encourage the use of these procedures. a FORTRAN program is provided for computation of confidence intervals for C_pk. Three methods are provided for this calculation including the standard method, the percentile confidence interval, and the biased - corrected percentile confidence interval.     

A variable selection method for detecting abnormality based on the T2 test

This paper proposes a variable selection method for detecting abnormal items based on the T² test when the observations on abnormal items are available. Based on the unbiased estimates of the powers for all subsets of variables, the variable selection method selects the subset of variables that maximizes the power estimate. Since more than one subsets of variables maximize the power estimate frequently, the averaged p-value of the rejected items is used as a second criterion. Although the performance of the method depends on the sample size for the abnormal items and the true power values for all subsets of variables, numerical experiments show the effectiveness of the proposed method. Since normal and abnormal items are simulated using one-factor and two-factor models, basic properties of the power functions for the models are investigated.     

On the efficiency of using the sample kurtosis in selecting optimal lpestimators

This paper examines the efficiency of thesample kurtosisin obtaining L_P estimates as an estimates of central tendency for symmetric distributions. Moreover, guidelines are established for determining an optimal value of P based on the kurtosis of the error distribution.     

Statistical analysis of process capability indices with measurement errors: The case ofC p

Process capability indices (PCIs) have been widely used in manufacturing industries to previde a quantitative measure of process potential and performance. While some efforts have been dedicated in the literature to the statistical properties of PCIs estimators, scarce attention has been given to the evaluation of these properties when sample data are affected by measurement errors. In this work we deal with the problem of measurement errors effects on the performance of PCIs. The analysis is illustrated with reference toC _p , i.e. the simplest and most common measure suggested to evaluate process capability. The authors would like to thank two anonymous referees for their comments and suggestion that were useful in the preparation and improvement of this paper. This work was partially supported by a MURST research grant.     

Consistent variable selection via the optimal discovery procedure in multiple testing

In this paper, we translate variable selection for linear regression into multiple testing, and select significant variables according to testing result. New variable selection procedures are proposed based on the optimal discovery procedure (ODP) in multiple testing. Due to ODP’s optimality, if we guarantee the number of significant variables included, it will include less non significant variables than marginal p-value based methods. Consistency of our procedures is obtained in theory and simulation. Simulation results suggest that procedures based on multiple testing have improvement over procedures based on selection criteria, and our new procedures have better performance than marginal p-value based procedures.     

基于偏最小二乘回归分析的农民收入影响因素研究

文章运用偏最小二乘(PLS)回归方法,分析了转轨以来影响农民增收的12个因素。研究表明,城市化率、农村工业化程度、农户受教育程度以及劳务经济对农民增收作用最为明显。基于以上分析结论,本文认为,加快城市化进程、大力发展乡镇企业以及提高农民文化素质是增加农民收入的根本途径。     

Asymptotics of the Lp-Norms of Density Estimators in the Nonlinear Autoregressive Models

This article investigates the asymptotic behavior of the error density function in nonlinear autoregressive stationary time series regression models. For any 1 ? p < ∞, the kernel density estimator of residuals is shown to be consistent for the error estimator concerning the L_p-distance, which extends the result developed by Cheng and Sun (2008 Cheng, F. X. (2005). Asymptotic distributions of error density estimators in first-order autoregression models. Sankhy Ind. J. Statist. 67:553–567. [Google Scholar]) in L₂-norm. Moreover, the result developed in this article is extended the results of Horváth and Zitikis (2003 Horváth, L., Zitikis, R. (2003). Asymptotics of the L_p-norms of density estimators in the first-order autoregressive models. Statist. Probab. Lett. 65:331342.[Crossref], [Web of Science ®] , [Google Scholar]) to nonlinear autoregressive models.