Assessing One-Step-Ahead Prediction Error Based on the Median for First-Order Autoregressive Models in the Presence Of Outliers

The prediction of the one-step-ahead observation of the first-order autoregressive process in the presence of outliers is considered. The mean square of the prediction error is obtained based on the median estimator of the model parameter for a stationary process. Monte Carlo simulation methods are employed to investigate the performance of the proposed estimator as well as the conventional ordinary least squares estimators proposed by Zhang and Shaman (1995 Zhang , P. , Shaman , P. ( 1995 ). Assessing prediction error in autoregressive models . Trans. Amer. Mathemat. Soc. 347 : 627 – 637 .[Crossref], [Web of Science ®] , [Google Scholar]) and Kabaila and He (1999 Kabaila , P. , He , Z. ( 1999 ). On assessing prediction error in autoregressive models . J. Time Ser. Anal. 20 : 663 – 670 .[Crossref] , [Google Scholar]) for a process without outliers. The results show that the proposed method outperforms the conventional method. These conclusions are substantiated with results from actual datasets.     

Relative Errors of Difference-Based Variance Estimators in Nonparametric Regression

Difference-based estimators for the error variance are popular since they do not require the estimation of the mean function. Unlike most existing difference-based estimators, new estimators proposed by Müller et al. (2003 Müller , U. , Schick , A. , Wefelmeyer , W. ( 2003 ). Estimating the error variance in nonparametric regression by a covariate-matched U-statistic . Statistics 37 : 179 – 188 .[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]) and Tong and Wang (2005 Tong , T. , Wang , Y. ( 2005 ). Estimating residual variance in nonparametric regression using least squares . Biometrika 92 : 821 – 830 .[Crossref], [Web of Science ®] , [Google Scholar]) achieved the asymptotic optimal rate as residual-based estimators. In this article, we study the relative errors of these difference-based estimators which lead to better understanding of the differences between them and residual-based estimators. To compute the relative error of the covariate-matched U-statistic estimator proposed by Müller et al. (2003 Müller , U. , Schick , A. , Wefelmeyer , W. ( 2003 ). Estimating the error variance in nonparametric regression by a covariate-matched U-statistic . Statistics 37 : 179 – 188 .[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]), we develop a modified version by using simpler weights. We further investigate its asymptotic property for both equidistant and random designs and show that our modified estimator is asymptotically efficient.     

Tuning Parameter Selection and Various Good Fitting Characteristics for the Liu-Type Estimator in Linear Regression

Liu (2003 Liu , K. ( 2003 ). Using Liu-Type estimator to combat collinearity . Commun. Statist. Theor. Meth. 32 ( 5 ): 1009 – 1020 .[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]) proposed the Liu-Type estimator (LTE) to combat the well-known multicollinearity problem in linear regression. In this article, various better fitting characteristics of the LTE than those of the ordinary ridge regression estimator (Hoerl and Kennard, 1970 Hoerl , A. E. , Kennard , R. W. ( 1970 ). Ridge regression: Biased estimation for non-orthogonal problems . Technometrics 12 : 55 – 67 .[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]) are considered. In particular, we derived two methods to determine the parameter d for the LTE and find that the ridge parameter k could serve for regularization of an ill-conditioned design matrix, while the other parameter d could be used for tuning the fit quality. In addition, the coefficients of regression, coefficient of multiple determination, residual error variance, and generalized cross validation (GCV) of the prediction quality are very stable, and as the ridge parameter increases they eventually reach asymptotic levels, which produces robust regression models. Furthermore, a Monte Carlo evaluation of these features is also given to illustrate some of the theoretical results.     

Bayesian Inference for the Precision Matrix for Scale Mixtures of Normal Distributions

Baysian inference is considered for the precision matrix of the multivariate regression model with distribution of the random responses belonging to the multivariate scale mixtures of normal distributions. The posterior distribution and some identities involving expectations taken with respect to this posterior distribution are derived when the prior distribution of the parameters is from the conjugate family. The results are specialized to the case where the random responses have a matrix-t distribution and thus generalizing the results of Zellner (1976 Zellner , A. ( 1976 ). Bayesian and non-Bayesian analysis of the regression model with multivariate Student-t error terms . J. Amer. Statist. Assoc. 71 : 400 – 405 .[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]) and Muirhead (1986 Muirhead , R. J. ( 1986 ). A note on some Wishart expectations . Metrika 33 : 247 – 251 .[Crossref] , [Google Scholar]).     

Scalar Statistics Which Have Constant Regression on the Mean of a Riesz Distribution

We propose a new estimator for the population variance using an auxiliary variable in simple random sampling and obtain the equations for its mean square error (MSE) and bias. In addition, theoretically, we show that the proposed estimator is more efficient than the traditional ratio and regression estimators, suggested by Isaki (1983 Isaki , C. T. (1983). Variance estimation using auxiliary information. J. Amer. Statist. Assoc. 78:117–123.[Taylor &; Francis Online], [Web of Science ®] , [Google Scholar]), under certain conditions that are defined in this article. These conditions are satisfied with a numerical example.     

The Exact General Formulas for the Moments of a Ridge Regression Estimator when the Regression Error Terms Follow a Multivariate t Distribution

Huang (1999 Huang , J. C. ( 1999 ). Improving the estimation precision for a selected parameter in multiple regression analysis: an algebraic approach . Econ. Lett. 62 : 261 – 264 .[Crossref], [Web of Science ®] , [Google Scholar]) proposed a feasible ridge regression (FRR) estimator to estimate a specific regression coefficient. Assuming that the error terms follow a normal distribution, Huang (1999 Huang , J. C. ( 1999 ). Improving the estimation precision for a selected parameter in multiple regression analysis: an algebraic approach . Econ. Lett. 62 : 261 – 264 .[Crossref], [Web of Science ®] , [Google Scholar]) examined the small sample properties of the FRR estimator. In this article, assuming that the error terms follow a multivariate t distribution, we derive an exact general formula for the moments of the FRR estimator to estimate a specific regression coefficient. Using the exact general formula, we obtain exact formulas for the bias, mean squared error (MSE), skewness, and kurtosis of the FRR estimator. Since these formulas are very complex, we compare the bias, MSE, skewness, and kurtosis of the FRR estimator with those of ordinary least square (OLS) estimator by numerical evaluations. Our numerical results show that the range of MSE dominance of the FRR estimator over the OLS estimator is widen under a fat tail distributional assumption.     

Interaction Terms in Distance-Based Regression

We propose a method of including polynomial and interaction terms in Distance-Based Regression (Cuadras and Arenas, 1990 Cuadras , C. M. , Arenas , C. ( 1990 ). A distance based regression model for prediction with mixed data . Commun. Statist. A Theor. Meth. 19 : 2261 – 2279 .[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]), relying on properties of a semi-Hadamard or Khatri-Rao product of matrices. We demonstrate its application to real data examples.     

The Research on Two Kinds of Restricted Biased Estimators Based on Mean Squared Error Matrix

Sakall?oglu et al. (2001 Sakall?oglu , Kaç?ranlar , Akdeniz ( 2001 ). Mean squared error comparisons of some biased estimators . Commun. Statist. Theor. Meth. 30 : 347 – 361 .[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]) dealt with the comparisons among the ridge estimator, Liu estimator, and iteration estimator. Akdeniz and Erol (2003 Akdeniz , F. , Erol , H. ( 2003 ). Mean squared error matrix comparisons of some biased estimators in linear regression . Commun. Statist. Theor. Meth. 32 : 2389 – 2413 .[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]) have compared the (almost unbiased) generalized ridge regression estimator with the (almost unbiased) generalized Liu estimator in the matrix mean squared error sense. In this article, we study the ridge estimator and Liu estimator with respect to linear equality restriction, and establish some sufficient conditions for the superiority of the restricted ridge estimator over the restricted Liu estimator and the superiority of the restricted Liu estimator over the restricted ridge estimator under mean squared error matrix, respectively. Furthermore, we give a numerical example.     

Additive Mixed Effect Model for Clustered Doubly Censored Data

Cai and Zeng (2011 Cai, J. and Zeng, D. 2011. Additive mixed effect model for clustered failure time data. Biometrics, 67(4): 1340–1351. [Crossref], [PubMed] , [Google Scholar]) proposed an additive mixed effect model to analyze clustered right-censored data. In this article, we demonstrate that the approach of Cai and Zeng (2011 Cai, J. and Zeng, D. 2011. Additive mixed effect model for clustered failure time data. Biometrics, 67(4): 1340–1351. [Crossref], [PubMed] , [Google Scholar]) can be extended to clustered doubly censored data. Furthermore, when both left- and right-censoring variables are always observed, we propose alternative estimators using the approach of Cai and Cheng (2004 Cai, T. and Cheng, S. C. 2004. Semiparametric regression analysis for doubly censored data. Biometrika, 91: 277–290. [Crossref], [Web of Science ®] , [Google Scholar]). A simulation study is conducted to investigate the performance of the proposed estimators.     

Permutation Matrix with Application to Optimal Invariant Quadratic Prediction in Finite Populations

In this article, we primarily aim to apply the permutation matrix techniques to the problem of the optimal invariant quadratic prediction in a finite population. An alternative to the work of Liu and Rong (2007 Liu , X. , Rong , J. ( 2007 ). Quadratic prediction problems in finite populations . Statist. Probab. Lett. 77 : 483 – 489 .[Crossref], [Web of Science ®] , [Google Scholar]) is offered. In addition, we derive the OIQP for the population variance and show that it has less PMSE than the ordinary optimal unbiased predictor.     

Generalized Symmetric Divergence Measures and the Probability of Error

There are three classical divergence measures exist in the literature on information theory and statistics. These are namely, Jeffryes-Kullback-Leiber (Jeffreys, 1946 Jeffreys , H. ( 1946 ). An invariant form for the prior probability in estimation problems . Proc. Roy. Soc. Lon. Ser. A 186 : 453 – 461 .[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]; Kullback and Leibler, 1951 Kullback , S. , Leibler , R. A. ( 1951 ). On information and sufficiency . Ann. Math. Statist. 22 : 79 – 86 .[Crossref] , [Google Scholar]) J-divergence. Sibson-Burbea-Rao (Sibson, 1969 Sibson , R. ( 1969 ). Information radius . Z. Wahrs. und verw Geb. 14 : 149 – 160 .[Crossref], [Web of Science ®] , [Google Scholar]), Jensen-Shannon divegernce, (Burbea and Rao, 1982 Burbea , J. , Rao , C. R. ( 1982 ). On the convexity of some divergence measures based on entropy functions . IEEE Trans. Inform. Theor. IT-28 : 489 – 495 .[Crossref], [Web of Science ®] , [Google Scholar]), and Taneja (1995 Taneja , I.J. ( 1995 ). New developments in generalized information measures , In: Hawkes , P. W. , Ed., Advances in Imaging and Electron Physics . 91:37–136 . [Google Scholar]). Arithmetic-Geometric divergence. These three measures bear an interesting relationship among each other. The divergence measures like Hellinger (1909 Hellinger , H. ( 1909 ). Neue Begründung der theorie der quadratischen formen von unendlichen vielen Veränderlichen . J. Reine Aug. Math. 136 : 210 – 271 .[Crossref] , [Google Scholar]) discrimination, symmetric χ²-divergence, and triangular discrimination are also known in the literature. In this article, we have considered generalized symmetric divergence measures having the measures given above as particular cases. Bounds on the probability of error are obtained in terms of generalized symmetric divergence measures. Study of bounds on probability of error is extended for the difference of divergence measures.     

Comment on Ridge Estimation to the Restricted Linear Model

In this note, we show that the estimator and the following results given by Zhong and Yang (2007 Zhong , Z. , Yang , H. ( 2007 ). Ridge estimation to the restricted linear model . Commun. Statist. Theor. Meth. 36 : 2099 – 2115 .[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]) are the same with that of Groß (2003 Groß , J. ( 2003 ). Restricted ridge estimation . Statist. Probab. Lett. 65 : 57 – 64 .[Crossref], [Web of Science ®] , [Google Scholar]).     

On Testing Sample Selection Bias Under the Multicollinearity Problem

ABSTRACT

This paper reviews and extends the literature on the finite sample behavior of tests for sample selection bias. Monte Carlo results show that, when the “multicollinearity problem” identified by Nawata (1993 Nawata , K. ( 1993 ). A note on the estimation of models with sample-selection biases . Economics Letters 42 : 15 – 24 . [CSA] [CROSSREF] [Crossref], [Web of Science ®] , [Google Scholar]) is severe, (i) the t-test based on the Heckman–Greene variance estimator can be unreliable, (ii) the Likelihood Ratio test remains powerful, and (iii) nonnormality can be interpreted as severe sample selection bias by Maximum Likelihood methods, leading to negative Wald statistics. We also confirm previous findings (Leung and Yu, 1996 Leung , S. F. , Yu , S. ( 1996 ). On the choice between sample selection and two-part models . Journal of Econometrics 72 : 197 – 229 . [CSA] [CROSSREF] [Crossref], [Web of Science ®] , [Google Scholar]) that the standard regression-based t-test (Heckman, 1979 Heckman , J. J. ( 1979 ). Sample selection bias as a specification error . Econometrica 47 : 153 – 161 . [CSA] [Crossref], [Web of Science ®] , [Google Scholar]) and the asymptotically efficient Lagrange Multiplier test (Melino, 1982 Melino , A. ( 1982 ). Testing for sample selection bias . Review of Economic Studies 49 : 151 – 153 . [CSA] [Crossref], [Web of Science ®] , [Google Scholar]), are robust to nonnormality but have very little power.     

Optimal Binning Strategies under Squared Error Loss in Selective Assembly with Measurement Error

Selective assembly is an effective approach for improving a quality of a product assembled from two types of components, when the quality characteristic is the clearance between the mating components. Mease et al. (2004 Mease , D. , Nair , V. N. , Sudjianto , A. ( 2004 ). Selective assembly in manufacturing: statistical issues and optimal binning strategies . Technometrics 46 : 165 – 175 .[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]) have extensively studied optimal binning strategies under squared error loss in selective assembly, especially for the case when two types of component dimensions are identically distributed. However, the presence of measurement error in component dimensions has not been addressed. Here we study optimal binning strategies under squared error loss when measurement error is present. We give the equations for the optimal partition limits minimizing expected squared error loss, and show that the solution to them is unique when the component dimensions and the measurement errors are normally distributed. We then compare the expected losses of the optimal binning strategies with and without measurement error for normal distribution, and also evaluate the influence of the measurement error.     

New Prediction Interval and Band in the Nonlinear Regression Model: Application to Predictive Modeling in Foods

This article is concerned with the proposal of a new prediction interval and band for the nonlinear regression model. The construction principle of this interval and band is based on an exact (the meaning of the term “exact” will be given later) confidence region for parameters of the nonlinear regression model. This region, fully described in Vila and Gauchi (2007 Vila , J.-P. , Gauchi , J.-P. ( 2007 ). Optimal designs based on exact confidence regions for parameter estimation of a nonlinear regression model . Journal of Statistical Planning and Inference 137 ( 9 ): 2935 – 2953 .[Crossref], [Web of Science ®] , [Google Scholar]), provides a rigorous justification for the new prediction interval and band that we propose. This new band is then compared to the classical bands (which are asymptotic and thus approximate for small n), and also to the band based on the bootstrap resampling method. The comparison of these bands is undertaken with simulated and real data from predictive modeling in food science.     

Efficient Ratio and Product Estimators in Stratified Random Sampling

This paper suggests an efficient class of ratio and product estimators for estimating the population mean in stratified random sampling using auxiliary information. It is interesting to mention that, in addition to many, Koyuncu and Kadilar (2009 Koyuncu , N. , Kadilar , C. ( 2009 ). Ratio and product estimators in stratified random sampling . J. Statist. Plann. Infer. 139 : 2552 – 2558 .[Crossref], [Web of Science ®] , [Google Scholar]), Kadilar and Cingi (2003 Kadilar , C. , Cingi , H. ( 2003 ). Ratio estimator in stratified sampling . Biometr. J. 45 : 218 – 225 .[Crossref], [Web of Science ®] , [Google Scholar], 2005 Kadilar , C. , Cingi , H. ( 2005 ). A new estimator in stratified random sampling . Commun. Statist. Theor. Meth. 34 : 597 – 602 .[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]), and Singh and Vishwakarma (2007 Singh , H. P. , Vishwakarma , G. K. ( 2007 ). Modified exponential ratio and product estimators for finite population mean in double sampling . Austr. J. Statist. 36 ( 3 ): 217 – 225 . [Google Scholar]) estimators are identified as members of the proposed class of estimators. The expressions of bias and mean square error (MSE) of the proposed estimators are derived under large sample approximation in general form. Asymptotically optimum estimator (AOE) in the class is identified alongwith its MSE formula. It has been shown that the proposed class of estimators is more efficient than combined regression estimator and Koyuncu and Kadilar (2009 Koyuncu , N. , Kadilar , C. ( 2009 ). Ratio and product estimators in stratified random sampling . J. Statist. Plann. Infer. 139 : 2552 – 2558 .[Crossref], [Web of Science ®] , [Google Scholar]) estimator. Moreover, theoretical findings are supported through a numerical example.     

An Efficiency and Protection Degree-Based Comparison Among the Quantitative Randomized Response Strategies

There have been many alternative strategies for implementing sampling survey on quantitative characteristic of sensitive issues by using randomized response (RR) technique. The efficiency of most of those strategies has been improved by choosing the suitable design parameters of model. However, the two different procedures with pre-assigned design parameter values cannot ensure that they possess the same protection degree to the respondents. Some earlier comparisons of those strategies are inadequate (as in Eichhorn and Hayre, 1983 Eichhorn , B. H. , Hayre , L. S. ( 1983 ). Scrambled randomized response methods for obtaining sensitive quantitative data . J. Statist. Plann. Infer. 7 : 307 – 316 .[Crossref], [Web of Science ®] , [Google Scholar]; Gupta et al., 2002 Gupta , S. , Gupta , B. , Singh , S. ( 2002 ). Estimation of sensitivity level of personal interview survey questions . J. Statist. Plann. Infer. 100 ( 2 ): 239 – 247 .[Crossref], [Web of Science ®] , [Google Scholar]). Some literature contains a more comprehensive comparison based on efficiency and protection degree to the respondents among the qualitative characteristic RR techniques (see Bhargava and Singh, 2002 Bhargava , M. , Singh , R. ( 2002 ). On the efficiency comparison of certain randomized response strategies . Metrika 55 : 191 – 197 .[Crossref], [Web of Science ®] , [Google Scholar]; Nayak, 1994 Nayak , T. K. ( 1994 ). On randomized response surveys for estimating a proportion . Commun. Statist. Theor. Meth. 23 ( 11 ): 3303 – 3321 .[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]; Zaizai and Zankan, 2004 Zaizai , Y. , Zankan , N. ( 2004 ). A fair comparison of the randomized response strategies . Acta Mathematica Scientia 24A ( 3 ): 362 – 368 . [Google Scholar]). As far as the comparisons are concerned that are based on efficiency and protection degree to the respondents among the quantitative characteristic RR techniques, very few related studies have been found so far. The purpose of this article is to give a more adequate comparison among those earlier quantitative characteristic RR strategies. It is found that several important differences between the results obtained in this article and some known results exist. Therefore, these earlier RR strategies should be reevaluated.     

The Identification of Potential Longitudinal Biomarkers and Measurements of Effectiveness for Biomarkers as Surrogates in Multivariate Survival Data

A proposed method based on frailty models is used to identify longitudinal biomarkers or surrogates for a multivariate survival. This method is an extention of earlier models by Wulfsohn and Tsiatis (1997 Wulfsohn , M. S. , Tsiatis , A. A. ( 1997 ). A joint model for survival and longitudinal data measured with error . Biometrics 53 ( 1 ): 330 – 339 .[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]) and Song et al. (2002 Song , X. , Davidian , M. , Tsiatis , A. A. ( 2002 ). A Semiparametric likelihood approach to joint modeling of longitudinal and time-to-event data . Biometrics 58 ( 4 ): 742 – 753 .[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]). In this article, similar to Henderson et al. (2002 Henderson , R. , Diggle , P. J. , Dobson , A. ( 2002 ). Identification and efficacy of longitudinal markers for survival . Biostatistics 3 ( 1 ): 33 – 50 .[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]), a joint likelihood function combines the likelihood functions of the longitudinal biomarkers and the multivariate survival times. We use simulations to explore how the number of individuals, the number of time points per individual and the functional form of the random effects from the longitudianl biomarkers influence the power to detect the association of a longitudinal biomarker and the multivariate survival time. The proposed method is illustrate by using the gastric cancer data.     

Parametric Nonlinear Regression with Endogenous Switching

Based on the insightful work of Olsen (1980 Olsen , R. J. ( 1980 ). A least squares correction for selectivity bias . Econometrica 48 : 1815 – 1820 .[Crossref], [Web of Science ®] , [Google Scholar]) for the linear context, a generic and unifying framework is developed that affords a simple extension of the classical method of Heckman (1974 Heckman , J. ( 1974 ). Shadow prices, market wages, and labor supply . Econometrica 42 : 679 – 694 .[Crossref], [Web of Science ®] , [Google Scholar], 1976 Heckman , J. ( 1976 ). The common structure of statistical models of truncation sample selection and limited dependent variables and a simple estimator for such models . Annals of Economic and Social Measurement 5 : 475 – 492 . [Google Scholar], 1978 Heckman , J. ( 1978 ). Dummy endogenous variables in a simultaneous equation system . Econometrica 46 : 931 – 959 .[Crossref], [Web of Science ®] , [Google Scholar], 1979 Heckman , J. ( 1979 ). Sample selection bias as a specification error . Econometrica 47 : 153 – 161 .[Crossref], [Web of Science ®] , [Google Scholar]) to a broad class of nonlinear regression models involving endogenous switching and its two most common incarnations, endogenous sample selection and endogenous treatment effects. The approach should be appealing to applied researchers for three reasons. First, econometric applications involving endogenous switching abound. Secondly, the approach requires neither linearity of the regression function nor full parametric specification of the model. It can, in fact, be applied under the minimal parametric assumptions—i.e., specification of only the conditional means of the outcome and switching variables. Finally, it is amenable to relatively straightforward estimation methods. Examples of applications of the method are discussed.     

The Alpha-power Tobit Model

The main object of this article is to propose an extension of the tobit model for which the error distribution follows the power-normal distribution (Gupta and Gupta, 2008 Gupta , D. , Gupta , R. C. ( 2008 ). Analyzing skewed data by power normal model . Test 17 : 197 – 210 .[Crossref], [Web of Science ®] , [Google Scholar]). Inference is dealt with by using the likelihood approach. Simulation studies and application to a real data set are used to demonstrate the usefulness of the extension.