An efficient integrated nonparametric entropy estimator of serial dependence

ABSTRACT

We propose an efficient numerical integration-based nonparametric entropy estimator for serial dependence and show that the new entropy estimator has a smaller asymptotic variance than Hong and White’s (2005 Hong, Y., White, H. (2005). Asymptotic distribution theory for nonparametric entropy measures of serial dependence. Econometrica 73:837–901.[Crossref], [Web of Science ®] , [Google Scholar]) sample average-based estimator. This delivers an asymptotically more efficient test for serial dependence. In particular, the uniform kernel gives the smallest asymptotic variance for the numerical integration-based entropy estimator over a class of positive kernel functions. Moreover, the naive bootstrap can be used to obtain accurate inferences for our test, whereas it is not applicable to Hong and White’s (2005 Hong, Y., White, H. (2005). Asymptotic distribution theory for nonparametric entropy measures of serial dependence. Econometrica 73:837–901.[Crossref], [Web of Science ®] , [Google Scholar]) sample averaging approach. A simulation study confirms the merits of our approach.     

Scalar Statistics Which Have Constant Regression on the Mean of a Riesz Distribution

We propose a new estimator for the population variance using an auxiliary variable in simple random sampling and obtain the equations for its mean square error (MSE) and bias. In addition, theoretically, we show that the proposed estimator is more efficient than the traditional ratio and regression estimators, suggested by Isaki (1983 Isaki , C. T. (1983). Variance estimation using auxiliary information. J. Amer. Statist. Assoc. 78:117–123.[Taylor &; Francis Online], [Web of Science ®] , [Google Scholar]), under certain conditions that are defined in this article. These conditions are satisfied with a numerical example.     

Optimal nonparametric estimator of the area under ROC curve based on clustered data

Abstract

In diagnostic trials, clustered data are obtained when several subunits of the same patient are observed. Intracluster correlations need to be taken into account when analyzing such clustered data. A nonparametric method has been proposed by Obuchowski (1997 Obuchowski, N. A. 1997. Nonparametric analysis of clustered ROC curve data. Biometrics 53 (2):567–78.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]) to estimate the Receiver Operating Characteristic curve area (AUC) for such clustered data. However, Obuchowski’s estimator is not efficient as it gives equal weight to all pairwise rankings within and between cluster. In this paper, we propose a more efficient nonparametric AUC estimator with two sets of optimal weights. Simulation results show that the loss of efficiency of Obuchowski’s estimator for a single AUC or the AUC difference can be substantial when there is a moderate intracluster test correlation and the cluster size is large. The efficiency gain of our weighted AUC estimator for a single AUC or the AUC difference is further illustrated using the data from a study of screening tests for neonatal hearing.     

Some imputation methods to compensate with non-response for estimation of population mean in two-occasion successive sampling

Abstract

Non-response is an unavoidable phenomenon in almost all sample survey, and if it is not dealt carefully at the very starting of the analysis, results may lead to significant biases in the survey estimates. Keeping these facts in mind and inspired by the work of Singh (2009 Singh, S. 2009. A new method of imputation in survey sampling. Statistics 43 (5):499–511. doi:10.1080/02331880802605114.[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]), this article suggests some alternative efficient methods to deal with the missing data problems at the beginning of the analysis and proposes estimation procedures of the current population mean in two-occasion successive sampling. The properties of the resultant estimation procedures have been examined and supplemented with empirical studies. Results have been critically analyzed, and recommendations are made to the survey practitioners.     

On Improvement in Variance Estimation Using Auxiliary Information

Kadilar and Cingi (2006 Kadilar , C. , Cingi , H. ( 2006 ). Improvement in variance estimation using auxiliary information . Hacett. J. Math. Statist. 35 ( 1 ): 111 – 115 . [Google Scholar]) have introduced an estimator for the population variance using an auxiliary variable in simple random sampling. We propose a new ratio-type exponential estimator for population variance which is always more efficient than usual ratio and regression estimators suggested by Isaki (1983 Isaki , C. T. ( 1983 ). Variance estimation using auxiliary information . J. Amer. Statist. Assoc. 78 : 117 – 123 .[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]) and by Kadilar and Cingi (2006 Kadilar , C. , Cingi , H. ( 2006 ). Improvement in variance estimation using auxiliary information . Hacett. J. Math. Statist. 35 ( 1 ): 111 – 115 . [Google Scholar]). Efficiency comparison is carried out both mathematically and numerically.     

A side sensitive modified group runs control chart to detect shifts in the process mean

Gadre and Rattihalli [5 Gadre, M. P. and Rattihalli, R. N. 2006. Modified group runs control charts to detect increases in fraction non-conforming and shifts in the process mean. Commun. Stat. Simul. Comput., 35: 225–240. [Taylor & Francis Online], [Web of Science ®] [Google Scholar]] have introduced the Modified Group Runs (MGR) control chart to identify the increases in fraction non-conforming and to detect shifts in the process mean. The MGR chart reduces the out-of-control average time-to-signal (ATS), as compared with most of the well-known control charts. In this article, we develop the Side Sensitive Modified Group Runs (SSMGR) chart to detect shifts in the process mean. With the help of numerical examples, it is illustrated that the SSMGR chart performs better than the Shewhart's X¯ chart, the synthetic chart [12 Wu, Z. and Spedding, T. A. 2000. A synthetic control chart for detecting small shifts in the process mean. J. Qual. Technol., 32: 32–38. [Taylor & Francis Online], [Web of Science ®] [Google Scholar]], the Group Runs chart [4 Gadre, M. P. and Rattihalli, R. N. 2004. A group runs control chart for detecting shifts in the process mean. Econ. Qual. Control, 19: 29–43. [Crossref] [Google Scholar]], the Side Sensitive Group Runs chart [6 Gadre, M. P. and Rattihalli, R. N. 2007. A side sensitive group runs control chart for detecting shifts in the process mean. Stat. Methods Appl., 16: 27–37. [Crossref], [Web of Science ®] [Google Scholar]], as well as the MGR chart [5 Gadre, M. P. and Rattihalli, R. N. 2006. Modified group runs control charts to detect increases in fraction non-conforming and shifts in the process mean. Commun. Stat. Simul. Comput., 35: 225–240. [Taylor & Francis Online], [Web of Science ®] [Google Scholar]]. In some situations it is also superior to the Cumulative Sum chart p9 Page, E. S. 1954. Continuous inspection schemes. Biometrika, 41: 100–114. [Crossref], [Web of Science ®] [Google Scholar]] and the exponentially weighed moving average chart [10 Roberts, S. W. 1959. Control chart tests based on geometric moving averages. Technometrics, 1: 239–250. [Taylor & Francis Online] [Google Scholar]]. In the steady state also, its performance is better than the above charts.     

Quantile estimation for a progressively censored exponential distribution

Abstract

In this paper, we consider the problem of estimating the quantile of a two-parameter exponential distribution with respect to an arbitrary strictly convex loss function under progressive type II censoring. Inadmissibility of the best affine equivariant (BAE) estimator is established through a conditional risk analysis. In particular we provide dominance results for quadratic, linex and absolute value loss functions. Further, a class of dominating estimators is derived using the IERD (integral expression of risk difference) approach of Kubokawa (1994 Kubokawa, T. 1994. A unified approach to improving equivariant estimators. The Annals of Statistics 22 (1):290–9. doi:10.1214/aos/1176325369.[Crossref], [Web of Science ®] , [Google Scholar]). In sequel the generalized Bayes estimator is shown to improve the BAE estimator.     

On a class exhibiting trend change in average failure rate

Abstract

Weak convergence and moment convergence issues are investigated for the New Better than Average Failure Rate (NBAFR) family (introduced by Loh (1984 Loh, W. Y. 1984. A new generalization of the class of NBU distributions. IEEE Transactions on Reliability R-33 :97–113[Crossref], [Web of Science ®] , [Google Scholar])). We explore the validity of these results in the context of a more general ageing class that we introduce. We prove some new properties of this class and derive its interrelationships with other non-monotonic ageing families. Reliability and moment bounds are obtained and an interesting characterization of exponentiality is proved. Special cases of our results lead to new theorems for the NBAFR class. Finally weak convergence and related issues are established for this class.     

On Testing Sample Selection Bias Under the Multicollinearity Problem

ABSTRACT

This paper reviews and extends the literature on the finite sample behavior of tests for sample selection bias. Monte Carlo results show that, when the “multicollinearity problem” identified by Nawata (1993 Nawata , K. ( 1993 ). A note on the estimation of models with sample-selection biases . Economics Letters 42 : 15 – 24 . [CSA] [CROSSREF] [Crossref], [Web of Science ®] , [Google Scholar]) is severe, (i) the t-test based on the Heckman–Greene variance estimator can be unreliable, (ii) the Likelihood Ratio test remains powerful, and (iii) nonnormality can be interpreted as severe sample selection bias by Maximum Likelihood methods, leading to negative Wald statistics. We also confirm previous findings (Leung and Yu, 1996 Leung , S. F. , Yu , S. ( 1996 ). On the choice between sample selection and two-part models . Journal of Econometrics 72 : 197 – 229 . [CSA] [CROSSREF] [Crossref], [Web of Science ®] , [Google Scholar]) that the standard regression-based t-test (Heckman, 1979 Heckman , J. J. ( 1979 ). Sample selection bias as a specification error . Econometrica 47 : 153 – 161 . [CSA] [Crossref], [Web of Science ®] , [Google Scholar]) and the asymptotically efficient Lagrange Multiplier test (Melino, 1982 Melino , A. ( 1982 ). Testing for sample selection bias . Review of Economic Studies 49 : 151 – 153 . [CSA] [Crossref], [Web of Science ®] , [Google Scholar]), are robust to nonnormality but have very little power.     

The exponential distribution analog of the Grubbs–Weaver method

Abstract

Grubbs and Weaver (1947 Grubbs, F. E., and C. L. Weaver. 1947. The best unbiased estimate of population standard deviation based on group ranges. Journal of the American Statistical Association 42 (238):224–41. doi: 10.2307/2280652.[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]) suggest a minimum-variance unbiased estimator for the population standard deviation of a normal random variable, where a random sample is drawn and a weighted sum of the ranges of subsamples is calculated. The optimal choice involves using as many subsamples of size eight as possible. They verified their results numerically for samples of size up to 100, and conjectured that their “rule of eights” is valid for all sample sizes. Here we examine the analogous problem where the underlying distribution is exponential and find that a “rule of fours” yields optimality and prove the result rigorously.     

A Nonparametric Test for Symmetry Based on Freeman and Halton's Ideas on Contingency Tables

In this article, we propose a nonparametric method to test for symmetry in bivariate data. By using the extension of Fisher's exact treatment for 2 × 2 contingency tables proposed by Freeman and Halton (1951 Freeman , G. H. , Halton , J. H. ( 1951 ). Note on an exact treatment of contingency tables, goodness of fit and other problems of significance . Biometrika 38 : 141 – 149 .[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]), we can test the hypothesis of equal distribution for two samples of integer valued variables. Then, by counting the number of observations belonging to each cell of a symmetric, appropriately built grid, we can produce the two samples of integers required to use this test for equal distribution. The resulting test for symmetry is potentially extendible to higher dimensions. A simulation study is performed to compare with some known tests (Bowker, 1948 Bowker , A. H. ( 1948 ). A test for symmetry in contingency tables . Journal of the American Statistical Association 43 : 572 – 574 .[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]; Hollander, 1971 Hollander , M. ( 1971 ). A nonparametric test for bivariate symmetry . Biometrika 58-1 : 203 – 212 .[Crossref], [Web of Science ®] , [Google Scholar]; and its improvement given in Krampe and Kuhnt, 2007 Krampe , A. , Kuhnt , S. ( 2007 ). Bowker's test for symmetry and modifications within the algebraic framework . Computational Statistics and Data Analysis 51 : 4124 – 4142 .[Crossref], [Web of Science ®] , [Google Scholar]). Our proposal represents a competitive option as a test for symmetry.     

Bayesian Capture-Recapture Analysis: An Application in Modeling Semelparity of a Neotropical Didelphid Marsupial

We develop a series of Bayesian statistical models for estimating survival of a neotropic didelphid marsupial, the Brazilian gracile mouse opossum (Gracilinanus microtarsus). These models are based on the Cormack–Jolly–Seber model (Cormack, 1964 Cormack , R. M. ( 1964 ). Estimates of survival from the sighting of marked animals . Biometrika 51 : 429 – 438 .[Crossref], [Web of Science ®] , [Google Scholar]; Jolly 1965 Jolly , G. M. ( 1965 ). Explicit estimates from capture-recapture data with both death and immigration stochastic model . Biometrika 52 : 225 – 247 .[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]; Seber 1965 Seber , G. A. F. ( 1965 ). A note on the multiple recapture census . Biometrika 52 : 249 – 259 .[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]) with both survival and recapture rates expressed as a function of covariates using a logit link. The proposed models allow taking into account heterogeneity in capture probability caused by the existence of different groups of individuals in the population. The models were applied to two cohorts (Cohort, 2000, 2001) with the first one including 14 and the second one 15 sampling occasions. The best models for each of the cohorts indicate that G. microtarsus is best described as partially semelparous, a condition in which mortality after the first mating is high but graded over time, with a fraction of males surviving for a second breeding season (Boonstra, 2005 Boonstra , R. ( 2005 ). Equipped for life: the adaptive role of the stress axis in male mammals . Journal of Mammalogy 86 : 236 – 247 .[Crossref], [Web of Science ®] , [Google Scholar]).     

Estimating Prediction Error: Cross-Validation vs. Accumulated Prediction Error

We study the validation of prediction rules such as regression models and classification algorithms through two out-of-sample strategies, cross-validation and accumulated prediction error. We use the framework of Efron (1983 Efron , B. ( 1983 ). Estimating the error rate of a prediction rule: improvement on cross-validation . Journal of the American Statistical Association 78 : 316 – 331 .[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]) where measures of prediction errors are defined as sample averages of expected errors and show through exact finite sample calculations that cross-validation and accumulated prediction error yield different smoothing parameter choices in nonparametric regression. The difference in choice does not vanish as sample size increases.     

Complete integral convergence for arrays of row-wise extended independent random variables under Sub-linear expectations

Abstract

In this paper, we establish the complete convergence and complete integral convergence for arrays of row-wise extended independent random variables under sub-linear expectation space with some conditions. At the same time we extend some complete convergence and complete integral convergence theorems from the classical probability space to the sub-linear expectation space. The results generalize corresponding results obtained by Wu et al. (2017 Zhang, L. X. 2016b. Exponential inequalities under the sub-linear expectations with applications to laws of the iterated logarithm. Science China Mathematics 59 (12):2503–26. doi: 10.1007/s11425-016-0079-1.[Crossref], [Web of Science ®] , [Google Scholar]).     

A finite-sample sensitivity analysis of the Dickey–Fuller test under local-to-unity detrending

In recent research, Elliott et al. (1996) Elliott, G. 1996. Efficient tests for an autoregressive unit root. Econometrica, 64: 813–836. [Crossref], [Web of Science ®] [Google Scholar] have shown the use of local-to-unity detrending via generalized least squares (GLS) to substantially increase the power of the Dickey–Fuller (1979) unit root test. In this paper the relationship between the extent of detrending undertaken, determined by the detrending parameter &art1;, and the power of the resulting GLS-based Dickey–Fuller (DF-GLS) test is examined. Using Monte Carlo simulation it is shown that the values of &art1; suggested by Elliott et al. (1996) Elliott, G. 1996. Efficient tests for an autoregressive unit root. Econometrica, 64: 813–836. [Crossref], [Web of Science ®] [Google Scholar] on the basis of a limiting power function seldom maximize the power of the DF-GLS test for the finite samples encountered in applied research. This result is found to hold for the DF-GLS test including either an intercept or an intercept and a trend term. An empirical examination of the order of integration of the UK household savings ratio illustrates these findings, with the unit root hypothesis rejected using values of &art1; other than that proposed by Elliott et al. (1996) Elliott, G. 1996. Efficient tests for an autoregressive unit root. Econometrica, 64: 813–836. [Crossref], [Web of Science ®] [Google Scholar].     

The performance of the truncated mixed control chart

Abstract

When the mixed chart proposed by Aslam et al. (2015 Aslam, M., M. Azam, N. Khan, and C.-H. Jun. 2015. A mixed control chart to monitor the process. International Journal of Production Research 53 (15):4684–93. doi:10.1080/00207543.2015.1031354.[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]) is in use, the sample items are classified as defective or not defective and, depending on the number of defectives, the quality characteristic X of the sample items are also measured. In this case, an Xbar chart decides the state of the process. The previous conforming/non-conforming classification truncates the X distribution and, because of that, the mathematical development to obtain the ARLs is complex. Aslam et al. (2015 Aslam, M., M. Azam, N. Khan, and C.-H. Jun. 2015. A mixed control chart to monitor the process. International Journal of Production Research 53 (15):4684–93. doi:10.1080/00207543.2015.1031354.[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]) didn’t pay attention to the fact that the X distribution is truncated and, due to that, they obtained incorrect ARLs.     

Use of Two Decks of Cards in Randomized Response Techniques for Complex Survey Designs

The randomized response (RR) technique with two decks of cards proposed by Odumade and Singh (2009 Odumade , O. , Singh , S. ( 2009 ). Efficient use of two deck of cards in randomized response sampling . Commun. Statist. Theor. Meth. 38 : 439 – 446 .[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]) can always be made more efficient than the RR techniques proposed by Warner (1965 Warner , S. L. ( 1965 ). Randomize response: A survey technique for eliminating evasive answer bias . J. Amer. Statist. Assoc. 60 : 63 – 69 .[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]), Mangat and Singh (1990 Mangat , N. S. , Singh , R. ( 1990 ). An alternative randomized response procedure . Biometrika 77 : 349 – 442 .[Crossref], [Web of Science ®] , [Google Scholar]), and Mangat (1994 Mangat , N. S. ( 1994 ). An improved randomized response strategy . J. Roy. Statist. Soc. B 56 : 93 – 95 . [Google Scholar]) by adjusting the proportion of cards in the decks. The proposed method of Odumade and Singh (2009 Odumade , O. , Singh , S. ( 2009 ). Efficient use of two deck of cards in randomized response sampling . Commun. Statist. Theor. Meth. 38 : 439 – 446 .[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]) is limited to simple random sampling with replacement (SRSWR) sampling only. In this article, generalization of Odumade and Singh strategy is provided for complex survey designs and a wider class of estimators. The results of Odumade and Singh (2009 Odumade , O. , Singh , S. ( 2009 ). Efficient use of two deck of cards in randomized response sampling . Commun. Statist. Theor. Meth. 38 : 439 – 446 .[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]) can be derived from the proposed method as a special case.     

Additive Mixed Effect Model for Clustered Doubly Censored Data

Cai and Zeng (2011 Cai, J. and Zeng, D. 2011. Additive mixed effect model for clustered failure time data. Biometrics, 67(4): 1340–1351. [Crossref], [PubMed] , [Google Scholar]) proposed an additive mixed effect model to analyze clustered right-censored data. In this article, we demonstrate that the approach of Cai and Zeng (2011 Cai, J. and Zeng, D. 2011. Additive mixed effect model for clustered failure time data. Biometrics, 67(4): 1340–1351. [Crossref], [PubMed] , [Google Scholar]) can be extended to clustered doubly censored data. Furthermore, when both left- and right-censoring variables are always observed, we propose alternative estimators using the approach of Cai and Cheng (2004 Cai, T. and Cheng, S. C. 2004. Semiparametric regression analysis for doubly censored data. Biometrika, 91: 277–290. [Crossref], [Web of Science ®] , [Google Scholar]). A simulation study is conducted to investigate the performance of the proposed estimators.     

Relative Errors of Difference-Based Variance Estimators in Nonparametric Regression

Difference-based estimators for the error variance are popular since they do not require the estimation of the mean function. Unlike most existing difference-based estimators, new estimators proposed by Müller et al. (2003 Müller , U. , Schick , A. , Wefelmeyer , W. ( 2003 ). Estimating the error variance in nonparametric regression by a covariate-matched U-statistic . Statistics 37 : 179 – 188 .[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]) and Tong and Wang (2005 Tong , T. , Wang , Y. ( 2005 ). Estimating residual variance in nonparametric regression using least squares . Biometrika 92 : 821 – 830 .[Crossref], [Web of Science ®] , [Google Scholar]) achieved the asymptotic optimal rate as residual-based estimators. In this article, we study the relative errors of these difference-based estimators which lead to better understanding of the differences between them and residual-based estimators. To compute the relative error of the covariate-matched U-statistic estimator proposed by Müller et al. (2003 Müller , U. , Schick , A. , Wefelmeyer , W. ( 2003 ). Estimating the error variance in nonparametric regression by a covariate-matched U-statistic . Statistics 37 : 179 – 188 .[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]), we develop a modified version by using simpler weights. We further investigate its asymptotic property for both equidistant and random designs and show that our modified estimator is asymptotically efficient.