Online Control Charts for Process Averages Based on Repeated Median Filters

Two types of estimates of process level, namely repeated median estimates (Siegel, 1982 Siegel , A. F. ( 1982 ). Robust regression using repeated medians . Biometrika 69 : 242 – 244 .[Crossref], [Web of Science ®] , [Google Scholar]) and full online estimates (Gather et al., 2006 Gather , U. , Schettlinger , K. , Fried , R. ( 2006 ). Online signal extraction by robust linear regression . Computational Statistics 21 : 33 – 51 .[Crossref], [Web of Science ®] , [Google Scholar]) based on repeated median filters, are used to develop control charts. The distributional properties of the estimates are studied using simulation and these are found to closely follow normal distribution. The repeated median being robust against outliers with asymptotically 50% breakdown value and having small standard deviation is found to be useful as a basis for monitoring process averages. The control charts using repeated median estimates have been recommended for general use.     

More Efficient Tests Robust to Heteroskedasticity of Unknown Form

ABSTRACT

In the presence of heteroskedasticity of unknown form, the Ordinary Least Squares parameter estimator becomes inefficient, and its covariance matrix estimator inconsistent. Eicker (1963 Eicker , B. ( 1963 ). Limit theorems for regression with unequal and dependant errors . Ann. Math. Statist. 34 : 447 – 456 .[Crossref] , [Google Scholar]) and White (1980 White , H. ( 1980 ). A heteroskedasticity-consistent covariance matrix estimator and a direct test for heteroskedasticity . Econometrica 48 : 817 – 838 .[Crossref], [Web of Science ®] , [Google Scholar]) were the first to propose a robust consistent covariance matrix estimator, that permits asymptotically correct inference. This estimator is widely used in practice. Cragg (1983 Cragg , J. G. ( 1983 ). More efficient estimation in the presence of heteroskedasticity of unknown form . Econometrica 51 : 751 – 63 .[Crossref], [Web of Science ®] , [Google Scholar]) proposed a more efficient estimator, but concluded that tests basd on it are unreliable. Thus, this last estimator has not been used in practice. This article is concerned with finite sample properties of tests robust to heteroskedasticity of unknown form. Our results suggest that reliable and more efficient tests can be obtained with the Cragg estimators in small samples.     

Correlation Structure and Model Selection for Negative Binomial Distribution in GEE

A new model selection criterion, termed as the “quasi-likelihood under the independence model criterion” (QIC), was proposed by Pan (2001 Pan , W. ( 2001 ). Akaike's information criterion in generalized estimating equations . Biometrics 57 : 120 – 125 .[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]) for GEE models. Cui (2007 Cui , J. ( 2007 ). QIC program and model selection in GEE analyses . Stata Journal 7 : 209 – 220 .[Web of Science ®] , [Google Scholar]) developed a general computing program to implement the QIC method for a range of statistical distributions. However, only a special case of the negative binomial distribution was considered in Cui (2007 Cui , J. ( 2007 ). QIC program and model selection in GEE analyses . Stata Journal 7 : 209 – 220 .[Web of Science ®] , [Google Scholar]), where the dispersion parameter equals to unity. This article introduces a new computing program that can be applied for the general negative binomial model, where the dispersion parameter can be any fixed value. An example is also given in this article.     

Inference Under Heteroskedasticity and Leveraged Data

We evaluate the finite-sample behavior of different heteros-ke-das-ticity-consistent covariance matrix estimators, under both constant and unequal error variances. We consider the estimator proposed by Halbert White (HC0), and also its variants known as HC2, HC3, and HC4; the latter was recently proposed by Cribari-Neto (2004 Cribari-Neto , F. ( 2004 ). Asymptotic inference under heteroskedasticity of unknown form . Computat. Statist. Data Anal. 45 : 215 – 233 .[Crossref], [Web of Science ®] , [Google Scholar]). We propose a new covariance matrix estimator: HC5. It is the first consistent estimator to explicitly take into account the effect that the maximal leverage has on the associated inference. Our numerical results show that quasi-t inference based on HC5 is typically more reliable than inference based on other covariance matrix estimators.     

The Exact General Formulas for the Moments of a Ridge Regression Estimator when the Regression Error Terms Follow a Multivariate t Distribution

Huang (1999 Huang , J. C. ( 1999 ). Improving the estimation precision for a selected parameter in multiple regression analysis: an algebraic approach . Econ. Lett. 62 : 261 – 264 .[Crossref], [Web of Science ®] , [Google Scholar]) proposed a feasible ridge regression (FRR) estimator to estimate a specific regression coefficient. Assuming that the error terms follow a normal distribution, Huang (1999 Huang , J. C. ( 1999 ). Improving the estimation precision for a selected parameter in multiple regression analysis: an algebraic approach . Econ. Lett. 62 : 261 – 264 .[Crossref], [Web of Science ®] , [Google Scholar]) examined the small sample properties of the FRR estimator. In this article, assuming that the error terms follow a multivariate t distribution, we derive an exact general formula for the moments of the FRR estimator to estimate a specific regression coefficient. Using the exact general formula, we obtain exact formulas for the bias, mean squared error (MSE), skewness, and kurtosis of the FRR estimator. Since these formulas are very complex, we compare the bias, MSE, skewness, and kurtosis of the FRR estimator with those of ordinary least square (OLS) estimator by numerical evaluations. Our numerical results show that the range of MSE dominance of the FRR estimator over the OLS estimator is widen under a fat tail distributional assumption.     

Least Median of Squares Solution of Multiple Linear Regression Models Through the Origin

Barreto and Maharry (2006 Barreto , H. , Maharry , D. ( 2006 ). Least median of squares and regression through the origin . Comput. Statist. Data Anal. 50 : 1391 – 1397 .[Crossref], [Web of Science ®] , [Google Scholar]) showed that PROGRESS algorithm fails to find a correct minimum “Least Median of Squares/LMS” estimate for bivariate regression models which have no intercept. Kayhan and Gunay (2008 Kayhan , Y. , Gunay , S. ( 2008 ). A new approach to least median of squares and regression through the origin . Commun. Statist. Theor. Meth. 37 ( 5 ): 773 – 781 .[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]) presented a different approach for the regression models through the origin which includes at most two unknown parameters. However, LMS estimate for multiple linear regression models still remains an open issue. The aim of this study is to show that finding true LMS estimate for zero intercept multiple linear regression models can be treated as a convex optimization problem and to provide a more general algorithm for any dimensional linear regression models.     

A Note on Testing Homogeneity of Several Exponential Location Parameters

In this article, the problems of testing homogeneity of several exponential location parameters against simple and tree ordered alternatives are considered separately. Test procedures for both the alternatives are proposed using restricted maximum likelihood estimators (RMLE) of exponential location parameters under the respective orderings. Critical constants for the implementation of the proposed procedures are tabulated. Power comparison of the proposed test procedure under the simple ordered alternative with the procedure of Chen (1982 Chen , H. J. ( 1982 ). A new range statistic for comparisons of several exponential location parameters . Biometrika 69 ( 1 ): 257 – 260 .[Crossref], [Web of Science ®] , [Google Scholar]) and of Dhawan and Gill (1999 Dhawan , A. K. , Gill , A. N. ( 1999 ). A one-sided test for testing homogeneity of scale parameters against ordered alternative . Communication in Statistics—Theory and Methods 28 ( 10 ): 2417 – 2439 .[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]) is carried out using Monte-Carlo simulation.     

The Research on Two Kinds of Restricted Biased Estimators Based on Mean Squared Error Matrix

Sakall?oglu et al. (2001 Sakall?oglu , Kaç?ranlar , Akdeniz ( 2001 ). Mean squared error comparisons of some biased estimators . Commun. Statist. Theor. Meth. 30 : 347 – 361 .[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]) dealt with the comparisons among the ridge estimator, Liu estimator, and iteration estimator. Akdeniz and Erol (2003 Akdeniz , F. , Erol , H. ( 2003 ). Mean squared error matrix comparisons of some biased estimators in linear regression . Commun. Statist. Theor. Meth. 32 : 2389 – 2413 .[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]) have compared the (almost unbiased) generalized ridge regression estimator with the (almost unbiased) generalized Liu estimator in the matrix mean squared error sense. In this article, we study the ridge estimator and Liu estimator with respect to linear equality restriction, and establish some sufficient conditions for the superiority of the restricted ridge estimator over the restricted Liu estimator and the superiority of the restricted Liu estimator over the restricted ridge estimator under mean squared error matrix, respectively. Furthermore, we give a numerical example.     

Parametric Nonlinear Regression with Endogenous Switching

Based on the insightful work of Olsen (1980 Olsen , R. J. ( 1980 ). A least squares correction for selectivity bias . Econometrica 48 : 1815 – 1820 .[Crossref], [Web of Science ®] , [Google Scholar]) for the linear context, a generic and unifying framework is developed that affords a simple extension of the classical method of Heckman (1974 Heckman , J. ( 1974 ). Shadow prices, market wages, and labor supply . Econometrica 42 : 679 – 694 .[Crossref], [Web of Science ®] , [Google Scholar], 1976 Heckman , J. ( 1976 ). The common structure of statistical models of truncation sample selection and limited dependent variables and a simple estimator for such models . Annals of Economic and Social Measurement 5 : 475 – 492 . [Google Scholar], 1978 Heckman , J. ( 1978 ). Dummy endogenous variables in a simultaneous equation system . Econometrica 46 : 931 – 959 .[Crossref], [Web of Science ®] , [Google Scholar], 1979 Heckman , J. ( 1979 ). Sample selection bias as a specification error . Econometrica 47 : 153 – 161 .[Crossref], [Web of Science ®] , [Google Scholar]) to a broad class of nonlinear regression models involving endogenous switching and its two most common incarnations, endogenous sample selection and endogenous treatment effects. The approach should be appealing to applied researchers for three reasons. First, econometric applications involving endogenous switching abound. Secondly, the approach requires neither linearity of the regression function nor full parametric specification of the model. It can, in fact, be applied under the minimal parametric assumptions—i.e., specification of only the conditional means of the outcome and switching variables. Finally, it is amenable to relatively straightforward estimation methods. Examples of applications of the method are discussed.     

From Ordinary to Shrinkage Square-Root Estimators

Consider a skewed population. Suppose an intelligent guess could be made about an interval that contains the population mean. There may exist biased estimators with smaller mean squared error than the arithmetic mean within such an interval. This article indicates when it is advisable to shrink the arithmetic mean towards a guessed interval using root estimators. The goal is to obtain an estimator that is better near the average of natural origins. An estimator proposed. This estimator contains the Thompson (1968 Thompson , J. R. ( 1968 ). Accuracy borrowing in the estimation of the mean by shrinkage towards an interval . J. Amer. Statist. Assoc. 63 : 953 – 963 . [CSA] [CROSSREF] [Taylor & Francis Online], [Web of Science ®] , [Google Scholar]) ordinary shrinkage estimator, the Jenkins et al. (1973 Jenkins , O. C. , Ringer , L. J. , Hartley , H. O. ( 1973 ). Root estimators . J Amer. Statist. Assoc. 68 : 414 – 419 . [CSA] [CROSSREF] [Taylor & Francis Online], [Web of Science ®] , [Google Scholar]) square-root estimator, and the arithmetic sample mean as special cases. The bias and the mean squared error of the proposed more general estimator is compared with the three special cases. Shrinkage coefficients that yield minimum mean squared error estimators are obtained. The proposed estimator is considerably more efficient than the three special cases. This remains true for highly skewed populations. The merits of the proposed shrinkage square-root estimator are supported by the results of numerical and simulation studies.     

Relations for Moments of Progressively Type-II Censored Order Statistics from Log-Logistic Distribution with Applications to Inference

In this article, we establish several recurrence relations for the single and product moments of progressively Type-II right censored order statistics from a log-logistic distribution. The use of these relations in a systematic recursive manner would enable the computation of all the means, variances and covariances of progressively Type-II right censored order statistics from the log-logistic distribution for all sample sizes n, effective sample sizes m, and all progressive censoring schemes (R ₁,…, R _m ). The results established here generalize the corresponding results for the usual order statistics due to Balakrishnan and Malik (1987 Balakrishnan , N. , Malik , H. J. ( 1987 ). Moments of order statistics from truncated log-logistic distribution . J. Statist. Plann. Infer. 17 : 251 – 267 .[Crossref], [Web of Science ®] , [Google Scholar]) and Balakrishnan et al. (1987 Balakrishnan , N. , Malik , H. J. , Puthenpura , S. ( 1987 ). Best linear unbiased estimation of location and scale parameters of the log-logistic distribution . Commun. Statist. Theor. Meth. 16 : 3477 – 3495 .[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]). The moments so determined are then utilized to derive best linear unbiased estimators for the scale- and location-scale log-logistic distributions. A comparison of these estimates with the maximum likelihood estimates is made through Monte Carlo simulation. The best linear unbiased predictors of progressively censored failure times is then discussed briefly. Finally, a numerical example is presented to illustrate all the methods of inference developed here.     

Designs Robust Against the Presence of an Aberration in a Diallel Cross Design Setup

In this article, we find designs insensitive to the presence of an outlier in a diallel cross design setup for estimating a complete set of orthonormal contrasts among the effects of the general combining abilities of a set of parental lines. The criterion of robustness, suggested by Mandal (1989 Mandal , N. K. ( 1989 ). On robust designs . Cal. Stat. Assoc. Bull. 38 : 115 – 119 . [Google Scholar]) in block design setup and used by Biswas (2012 Biswas , A. ( 2012 ). Block designs robust against the presence of an aberration in a treatment-control setup . Commun. Statist. Theor. Meth. 41 : 920 – 933 .[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]) in treatment-control setup, is adapted here. Complete diallel cross designs, suggested by Gupta and Kageyama (1994 Gupta , S. , Kageyama , S. ( 1994 ). Optimal complete diallel crosses . Biometrika 81 : 420 – 424 .[Crossref], [Web of Science ®] , [Google Scholar]), and partial diallel cross designs, suggested by Gupta et al. (1995 Gupta , S. , Das , A. , Kageyama , S. ( 1995 ). Single replicate orthogonal block designs for circulant partial diallel crosses . Commun. Statist. A 24 : 2601 – 2607 .[Taylor & Francis Online] , [Google Scholar]) and Mukerjee (1997 Mukerjee , R. ( 1997 ). Optimal partial diallel crosses . Biometrika 84 : 939 – 948 .[Crossref], [Web of Science ®] , [Google Scholar]), are found to be robust under certain conditions.     

Computing the Exact Fisher Information Matrix of Periodic State-Space Models

The purpose of this article is to develop algorithms for computing the exact Fisher information matrix of periodic time-varying state-space models. We first present a relatively simple recursive algorithm which computes the elements of the exact information matrix without involving numerical differentiation, since all required derivatives are analytically evaluated. The proposed algorithm extends the procedure due to Cavanaugh and Shumway (1996 Cavanaugh , J. E. , Shumway , R. H. ( 1996 ). On computing the expected Fisher information matrix for state-space model parameters . Statist. Probab. Lett. 26 : 347 – 355 .[Crossref], [Web of Science ®] , [Google Scholar]) to the periodic state-space framework. Exploiting the approach used in Klein et al. (2000 Klein , A. , Mélard , G. , Zahaf , T. ( 2000 ). Construction of the exact Fisher information matrix of Gaussian time series models by means of matrix differential rules . Linear Alg. Applic. 321 : 209 – 232 .[Crossref], [Web of Science ®] , [Google Scholar]), a second algorithm is proposed in order to obtain the exact information matrix as a whole instead of element by element. The algorithms are first developed in a general framework and then specialized to the case of a periodic Gaussian vector autoregressive moving-average (PVARMA) model.     

Testing for Upper Outliers in Gamma Sample

The problem of multiple upper outlier detection in gamma sample is considered. Balasooriya and Gadag (1994 Balasooriya , U. , Gadag , V. ( 1994 ). Tests for upper outliers in the two-parameter exponential distribution . J. Statist. Computat. Simul. 50 : 249 – 259 .[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]) proposed a location and scale invariant test based on the test statistic Z _k for testing the k upper outliers in two-parameter exponential sample. In this article, the test statistic is extended for gamma sample and the null distribution of the statistic is obtained. A simulation study is carried out to compare the performance of the tests and is found that the test based on Z _k is more powerful than the test based on the test statistic proposed by Jabbari Nooghabi et al. (2010 Jabbari Nooghabi , M. , Jabbari Nooghabi , H. , Nasiri , P. ( 2010 ). Detecting outliers in gamma distribution . Commun. Statist. Theor. Meth. 39 : 698 – 706 .[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]).     

A New Estimator of Population Mean in Stratified Sampling

Kadilar and Cingi (2005 Kadilar , C. , Cingi , H. ( 2005 ). A new ratio estimator in stratified sampling . Comm. Statist. Theory Meth. 34 : 1 – 6 . [CSA] [Taylor & Francis Online], [Web of Science ®] , [Google Scholar]) have suggested a new ratio estimator in stratified sampling. The efficiency of this estimator is compared with the traditional combined ratio estimator on the basis of mean square error (MSE). We propose another estimator by utilizing a simple transformation introduced by Bedi (1996 Bedi , P. K. ( 1996 ). Efficient utilization of auxiliary information at estimation stage . Biomet. J. 38 ( 8 ): 973 – 976 . [CSA] [Crossref], [Web of Science ®] , [Google Scholar]). The proposed estimator is found to be more efficient than the traditional combined ratio estimator as well as the Kadilar and Cingi (2005 Kadilar , C. , Cingi , H. ( 2005 ). A new ratio estimator in stratified sampling . Comm. Statist. Theory Meth. 34 : 1 – 6 . [CSA] [Taylor & Francis Online], [Web of Science ®] , [Google Scholar]) ratio estimator.     

Is Each NPMLE of a Continuous Bivariate Distribution Function with Singly Right-Censored Data Really Inconsistent?

We consider non-parametric estimation of a continuous cdf of a random vector (X ₁, X ₂). With bivariate RC data, it is stated in van der Laan (1996 Van der Laan , M. J. ( 1996 ) Efficient estimation in the bivariate censoring model and repairing NPMLE . Ann. Statist. 24 : 596 – 627 .[Crossref], [Web of Science ®] , [Google Scholar], p. 598¹⁰, Ann. Statist.), Quale et al. (2006 Quale , C. M. , van der Laan , M. J. , Robins , J. R. ( 2006 ). Locally efficient estimation with bivariate right-censored data . JASA. 101 : 1076 – 1084 .[Taylor & Francis Online], [Web of Science ®] , [Google Scholar], JASA) etc. that “it is well known that the NPMLE for continuous data is inconsistent (Tsai et al. (1986 Tsai , W. Y. , Leurgans , S. , Crowley , J. ( 1986 ). Nonparametric estimation of a bivariate survival function in the presence of censoring . Ann. Statist. 14 : 1351 – 1365 .[Crossref], [Web of Science ®] , [Google Scholar])).” The claim is based on a result in Tsai et al. (1986 Tsai , W. Y. , Leurgans , S. , Crowley , J. ( 1986 ). Nonparametric estimation of a bivariate survival function in the presence of censoring . Ann. Statist. 14 : 1351 – 1365 .[Crossref], [Web of Science ®] , [Google Scholar], p.1352, Ann. Statist.) that if X ₁ is right censored but not X ₂, then common ways for defining one NPMLE lead to inconsistency. If X ₁ is right censored and X ₂ is type I right-censored (which includes the case in Tsai et al.), we present a consistent NPMLE. The result corrects a common misinterpretation of Tsai's example (Tsai et al., 1986 Tsai , W. Y. , Leurgans , S. , Crowley , J. ( 1986 ). Nonparametric estimation of a bivariate survival function in the presence of censoring . Ann. Statist. 14 : 1351 – 1365 .[Crossref], [Web of Science ®] , [Google Scholar], Ann. Statist.).     

Empirical Likelihood Ratio for Linear Transformation Models with Doubly Censored Data

Double censoring arises when T represents an outcome variable that can only be accurately measured within a certain range, [L, U], where L and U are the left- and right-censoring variables, respectively. When L is always observed, we consider the empirical likelihood inference for linear transformation models, based on the martingale-type estimating equation proposed by Chen et al. (2002 Chen , K. , Jin , Z. , Ying , Z. ( 2002 ). Semiparametric analysis of transformation models with censored data . Biometrika 89 : 659 – 668 .[Crossref], [Web of Science ®] , [Google Scholar]). It is demonstrated that both the approach of Lu and Liang (2006 Lu , W. , Liang , Y. ( 2006 ). Empirical likelihood inference for linear transformation models . Journal of Multivariate Analysis 97 : 1586 – 1599 .[Crossref], [Web of Science ®] , [Google Scholar]) and that of Yu et al. (2011 Yu , W. , Sun , Y. , Zheng , M. ( 2011 ). Empirical likelihood method for linear transformation models . Annals of the Institute of Statistical Mathematics 63 : 331 – 346 .[Crossref], [Web of Science ®] , [Google Scholar]) can be extended to doubly censored data. Simulation studies are conducted to investigate the performance of the empirical likelihood ratio methods.     

Independent Quadratic Forms in 3-Variance-Component Models

This article addresses derivation and existence of quadratic forms that were suggested by Burch (2007 Burch , B. D. ( 2007 ). Generalized confidence intervals for proportions of total variance in mixed linear models . J. Statist. Plann. Infer. 137 : 2394 – 2404 .[Crossref], [Web of Science ®] , [Google Scholar]) for procedures for inference on variance components in mixed linear models in combination with generalized fiducial inference. A relatively simple algorithm leading to the required quadratic forms in a general 3-variance-component model is stated and designs for two-way ANOVA models without interactions that permit Burch's procedure are characterized. This complements developments in the original article by Burch.     

Hazards Regression for Cancer Studies

The complication in analyzing tumor data is that the tumors detected in a screening program tend to be slowly progressive tumors, which is the so-called length-biased sampling that is inherent in screening studies. Under the assumption that all subjects have the same tumor growth function, Ghosh (2008 Ghosh , D. ( 2008 ). Proportional hazards regression for cancer studies . Biometrics 64 : 141 – 148 .[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]) developed estimation procedures for proportional hazards model. In this article, by modeling growth function as a function of covariates, we demonstrate that Ghosh (2008 Ghosh , D. ( 2008 ). Proportional hazards regression for cancer studies . Biometrics 64 : 141 – 148 .[Crossref], [PubMed], [Web of Science ®] , [Google Scholar])'s approach can be extended to the case when each subject has a specific growth function. A simulation study is conducted to demonstrate the potential usefulness of the proposed estimators for the regression parameters in the proportional and additive hazards model.     

Regression Diagnostics of the Semiparametric Proportional Rate Model for Irregularly Spaced Repeated Measurements

Counting process techniques have been successfully introduced to semiparametric inference of repeated measurements. Cheng and Wei (2000 Cheng , S. C. , Wei , L. J. ( 2000 ). Inference for a semiparametric model with panel data . Biometrika 87 : 89 – 97 .[Crossref], [Web of Science ®] , [Google Scholar]) proposed a simple inference procedure for the semiparametric proportional rate model, which reduces to relative risk regression models for binary data. While the baseline mean functions are completely unspecified, it still requires several assumptions for valid inference. In this article, a goodness-of-fit test for it is proposed based on cumulative residuals. Theoretical justification is provided and an illustration with a dataset from a clinical trial is given. Results of simulation studies to evaluate finite sample performance are also provided.