Phase I Analysis of Multiple Linear Regression Profiles

This article considers the Phase I analysis of data when the quality of a process or product is characterized by a multiple linear regression model. This is usually referred to as the analysis of linear profiles in the statistical quality control literature. The literature includes several approaches for the analysis of simple linear regression profiles. Little work, however, has been done in the analysis of multiple linear regression profiles. This article proposes a new approach for the analysis of Phase I multiple linear regression profiles. Using this approach, regardless of the number of explanatory variables used to describe it, the profile response is monitored using only three parameters, an intercept, a slope, and a variance. Using simulation, the performance of the proposed method is compared to that of the existing methods for monitoring multiple linear profiles data in terms of the probability of a signal. The advantage of the proposed method over the existing methods is greatly improved detection of changes in the process parameters of linear profiles with high-dimensional space. The article also proposes useful diagnostic aids based on F-statistics to help in identifying the source of profile variation and the locations of out-of-control samples. Finally, the use of multiple linear profile methods is illustrated by a data set from a calibration application at National Aeronautics and Space Administration (NASA) Langley Research Center.     

Empirical Likelihood for Generalized Partially Linear Single-index Models

Empirical-likelihood based inference for the parameters in a generalized partially linear single-index models (GPLSIM) is investigated. Based on the local linear estimators of the nonparametric parts of the GPLSIM, an estimated empirical likelihood-based statistic of the parametric components is proposed. We show that the resulting statistic is asymptotically standard chi-squared distributed, the confidence regions for the parametric components are constructed. Some simulations are conducted to illustrate the proposed method.     

A Coefficient of Determination for Generalized Linear Models

The coefficient of determination, a.k.a. R², is well-defined in linear regression models, and measures the proportion of variation in the dependent variable explained by the predictors included in the model. To extend it for generalized linear models, we use the variance function to define the total variation of the dependent variable, as well as the remaining variation of the dependent variable after modeling the predictive effects of the independent variables. Unlike other definitions that demand complete specification of the likelihood function, our definition of R² only needs to know the mean and variance functions, so applicable to more general quasi-models. It is consistent with the classical measure of uncertainty using variance, and reduces to the classical definition of the coefficient of determination when linear regression models are considered.     

Testing Serial Correlation in Partially Linear Single-Index Errors-in-Variables Models

In this article, we propose two test statistics for testing the underlying serial correlation in a partially linear single-index model Y = η(Z ^τα) + X ^τβ + ? when X is measured with additive error. The proposed test statistics are shown to have asymptotic normal or chi-squared distributions under the null hypothesis of no serial correlation. Monte Carlo experiments are also conducted to illustrate the finite sample performance of the proposed test statistics. The simulation results confirm that these statistics perform satisfactorily in both estimated sizes and powers.     

Diagnosis Aids in Multivariate Multiple Linear Regression Profiles Monitoring

Diagnosis aids in addition to detecting the out-of-control state is an important issue in multivariate multiple linear regression profiles monitoring; because a large number of parameters and profiles in this structure are involved. In this paper, we specifically concentrate on identification of profile(s) and parameter(s) which have changed during the process in multivariate multiple linear regression profiles structure in Phase II. We demonstrate the effectiveness of our proposed approaches through Monte Carlo simulations and a real case study in terms of accuracy percent.     

Semiparametric inference on partially linear single-index model

ABSTRACT

We consider semiparametric inference on the partially linearsingle-index model (PLSIM). The generalized likelihood ratio (GLR) test is proposed to examine whether or not a family of new semiparametric models fits adequately our given data in the PLSIM. A new GLR statistic is established to deal with the testing of the index parameter α₀ in the PLSIM. The newly proposed statistic is shown to asymptotically follow a χ²-distribution with the scale constant and the degrees of freedom being independent of the nuisance parameters or function. Some finite sample simulations and a real example are used to illustrate our proposed methodology.     

A New Regression Model: Modal Linear Regression

The mode of a distribution provides an important summary of data and is often estimated on the basis of some non‐parametric kernel density estimator. This article develops a new data analysis tool called modal linear regression in order to explore high‐dimensional data. Modal linear regression models the conditional mode of a response Y given a set of predictors x as a linear function of x . Modal linear regression differs from standard linear regression in that standard linear regression models the conditional mean (as opposed to mode) of Y as a linear function of x . We propose an expectation–maximization algorithm in order to estimate the regression coefficients of modal linear regression. We also provide asymptotic properties for the proposed estimator without the symmetric assumption of the error density. Our empirical studies with simulated data and real data demonstrate that the proposed modal regression gives shorter predictive intervals than mean linear regression, median linear regression and MM‐estimators.     

Simultaneous Small Sample Inference for Linear Combinations of Generalized Linear Model Parameters

A method is proposed to construct simultaneous confidence intervals for multiple linear combinations of generalized linear model parameters, that uses a multivariate normal- or t-distribution together with the signed likelihood root statistic. In an application to a case study simultaneous confidence bands for logistic regression are calculated. A simulation study based on the example evaluation suggests superior performance compared to the common Wald-type approaches. The proposed methods are readily implemented in the R extension package mcprofile.     

Linear representation of M-estimates in linear models

Consider the linear regression model, y_i = x_iβ₀ + e_i, i = l,…,n, and an M-estimate β of β_o obtained by minimizing Σρ(y_i — x_iβ), where ρ is a convex function. Let S_n = ΣX_iX_iX_i and r_n = S_n^½ (β — β₀) — S_n ² Σx_ih(e_i), where, with a suitable choice of h(.), the expression Σ x_ix(e,) provides a linear representation of β. Bahadur (1966) obtained the order of r_n as n→ ∞ when β_o is a one-dimensional location parameter representing the median, and Babu (1989) proved a similar result for the general regression parameter estimated by the LAD (least absolute deviations) method. We obtain the stochastic order of r_n as n → ∞ for a general M-estimate as defined above, which agrees with the results of Bahadur and Babu in the special cases considered by them.     

A test for variance-covarianch parameters in normal linear models

This paper derives a test statistic for the variance-covariance parameters which is a quadratic function of their MINQUE (Minimum Norm Quadratic Unbiased Estimation) estimates. The test is a Wald-type test, and its development closely parallels the theory used to derive a similar test for the coefficients in linear models. In fact, the derivation proceeds by first setting up the estimation problem in a derived linear model in which the dispersion parameters are the coefficients. The test statistic is shown to be the sum of the squares of independent standardized x² variables.     

Using a Truncated C p Statistic for Variable Selection in Multiple Linear Regression

In multiple linear regression analysis each lower-dimensional subspace L of a known linear subspace M of ? ⁿ corresponds to a non empty subset of the columns of the regressor matrix. For a fixed subspace L, the C _p statistic is an unbiased estimator of the mean square error if the projection of the response vector onto L is used to estimate the expected response. In this article, we consider two truncated versions of the C _p statistic that can also be used to estimate this mean square error. The C _p statistic and its truncated versions are compared in two example data sets, illustrating that use of the truncated versions may result in models different from those selected by standard C _p .     

Empirical Likelihood for Partial Linear Models under Negatively Associated Errors

In this paper, we use blockwise empirical likelihood (EL) technique to construct confidence regions for the parameter of the partial linear models under negatively associated errors. It is shown that the blockwise EL ratio statistic for the parameter of interest is asymptotically χ²-type distributed by employing the large-block and small-block arguments. The result can be used to obtain confidence regions for the parameter of interest.     

Statistical inferences for partially linear single-index models with error-prone linear covariates

We consider statistical inference for partially linear single-index models (PLSIM) when some linear covariates are not observed, but ancillary variables are available. Based on the profile least-squared estimators of the unknowns, we study the testing problems for parametric components in the proposed models. It is to see whether the generalized likelihood ratio (GLR) tests proposed by Fan et al. (2001) are applicable to testing for the parametric components. We show that under the null hypothesis the proposed GLR statistics follow asymptotically the χ²-distributions with the scale constants and the degrees of freedom being independent of the nuisance parameters or functions, which is called the Wilks phenomenon. Simulated experiments are conducted to illustrate our proposed methodology.     

Estimation in Partially Linear Single-Index Models with Missing Covariates

In this article, we consider a partially linear single-index model Y = g(Z ^τθ₀) + X ^τβ₀ + ? when the covariate X may be missing at random. We propose weighted estimators for the unknown parametric and nonparametric part by applying weighted estimating equations. We establish normality of the estimators of the parameters and asymptotic expansion for the estimator of the nonparametric part when the selection probabilities are unknown. Simulation studies are also conducted to illustrate the finite sample properties of these estimators.     

A Robust Variable Selection to t-type Joint Generalized Linear Models via Penalized t-type Pseudo-likelihood

Although the t-type estimator is a kind of M-estimator with scale optimization, it has some advantages over the M-estimator. In this article, we first propose a t-type joint generalized linear model as a robust extension to the classical joint generalized linear models for modeling data containing extreme or outlying observations. Next, we develop a t-type pseudo-likelihood (TPL) approach, which can be viewed as a robust version to the existing pseudo-likelihood (PL) approach. To determine which variables significantly affect the variance of the response variable, we then propose a unified penalized maximum TPL method to simultaneously select significant variables for the mean and dispersion models in t-type joint generalized linear models. Thus, the proposed variable selection method can simultaneously perform parameter estimation and variable selection in the mean and dispersion models. With appropriate selection of the tuning parameters, we establish the consistency and the oracle property of the regularized estimators. Simulation studies are conducted to illustrate the proposed methods.     

Estimation in Singular Linear Models with Stochastic Linear Restrictions and Linear Equality Restrictions

This article is concerned with the parameter estimation in a singular linear regression model with stochastic linear restrictions and linear equality restrictions simultaneously. A new estimator is introduced and it is proved that the proposed estimator is superior to the least squares estimator and singular mixed estimator in the mean squared error sense under certain conditions.     

Estimation for Partially Linear Single-index Instrumental Variables Models

In this article, we generalize the partially linear single-index models to the scenario with some endogenous covariates variables. It is well known that the estimators based on the existing methods are often inconsistent because of the endogeneity of covariates. To deal with the endogenous variables, we introduce some auxiliary instrumental variables. A three-stage estimation procedure is proposed for partially linear single-index instrumental variables models. The first stage is to obtain a linear projection of endogenous variables on a set of instrumental variables, the second stage is to estimate the link function by using local linear smoother for given constant parameters, and the last stage is to obtain the estimators of constant parameters based on the estimating equation. Asymptotic normality is established for the proposed estimators. Some simulation studies are undertaken to assess the finite sample performance of the proposed estimation procedure.     

Smooth-Threshold GEE Variable Selection in High-Dimensional Partially Linear Models with Longitudinal Data

We consider the problem of variable selection in high-dimensional partially linear models with longitudinal data. A variable selection procedure is proposed based on the smooth-threshold generalized estimating equation (SGEE). The proposed procedure automatically eliminates inactive predictors by setting the corresponding parameters to be zero, and simultaneously estimates the nonzero regression coefficients by solving the SGEE. We establish the asymptotic properties in a high-dimensional framework where the number of covariates p_n increases as the number of clusters n increases. Extensive Monte Carlo simulation studies are conducted to examine the finite sample performance of the proposed variable selection procedure.