RAO'S STATISTIC FOR THE ANALYSIS OF UNIFORM ASSOCIATION IN CROSS-CLASSIFICATIONS

In this paper we introduce a new measure for the analysis of association in cross-classifications having ordered categories. Association is measured in terms of the odd-ratios in 2 × 2 subtables formed from adjacent rows and adjacent columns. We focus our attention in the uniform association model. Our measure is based in the family of divergences introduced by Burbea and Rao [1] Burbea, J. and Rao, C. R. 1982a. On the convexity of some divergence measures based on entropy functions. IEEE Transactions on Information Theory, 28: 489–495. [Crossref], [Web of Science ®] , [Google Scholar]. Some well-known sets of data are reanalyzed and a simulation study is presented to analyze the behavior of the new families of test statistics introduced in this paper.     

EVALUATION OF POWER OF TESTS INVOLVING COVARIATES UNDER NONCONSTANT VARIANCE

In many experiments where pre-treatment and post-treatment measurements are taken, investigators wish to determine if there is a difference between two treatment groups. For this type of data, the post-treatment variable is used as the primary comparison variable and the pre-treatment variable is used as a covariate. Although most of the discussion in this paper is written with the pre-treatment variable as the covariate the results are applicable to other choices of a covariate. Tests based on residuals have been proposed as alternatives to the usual covariance methods. Our objective is to investigate how the powers of these tests are affected when the conditional variance of the post-treatment variable depends on the magnitude of the pre-treatment variable. In particular, we investigate two cases. [1] Crager, Michael R. 1987. Analysis of Covariance in Parallel-Group Clinical Trials With Pretreatment Baselines. Biometrics, 43: 895–901. [Crossref], [PubMed], [Web of Science ®] , [Google Scholar] The conditional variance of the post-treatment variable gradually increases as the magnitude of the pre-treatment variable increases. (In many biological models this is the case.) [2] Knoke, James D. 1991. Nonparametric Analysis of Covariance for Comparing Change in Randomized Studies with Baseline Values Subject to Error. Biometrics, 47: 523–533. [Crossref], [PubMed], [Web of Science ®] , [Google Scholar] The conditional variance of the post-treatment variable is dependent upon natural or imposed subgroups contained within the pre-treatment variable. Power comparisons are made using Monte Carlo techniques.     

RANDOM PERMUTATION TESTING IN MULTIPLE LINEAR REGRESSION

We developed an alternative random permutation testing method for multiple linear regression, which is an improvement over the existing one proposed by [1] Kennedy, P. E. 1995. Randomization tests in econometrics. Journal of Business and Economic Statistics, 13: 85–94. [Taylor & Francis Online], [Web of Science ®] , [Google Scholar] or [2] Freedman, D. and Lane, D. 1983. A nonstochastic interpretation of reported significance levels. Journal of Business and Economic Statistics, 1: 292–298. [Taylor & Francis Online] , [Google Scholar].     

A NOTE ON ‘A COMPARISON OF BAYES AND MAXIMUM LIKELIHOOD ESTIMATION OF THE INTRACLASS CORRELATION COEFFICIENT’

Palmer and Broemeling [1] Palmer, J. L. and Broemeling, L. D. 1990. A Comparison of Bayes and Maximum Likelihood Estimation of the Intraclass Correlation Coefficient. Comm. Statist.-Theory Meth, 19: 953–975. [Taylor & Francis Online], [Web of Science ®] , [Google Scholar] compare Bayes and maximum likelihood estimates of the intraclass correlation (ICC). The prior information in their derivation of the Bayes estimator is placed on the variance components instead of the ICC itself. This paper finds a Bayes estimator of the ICC with the prior placed on the ICC. Bayes estimates based on three different priors are then compared to method of moments estimate.     

Two Statistics for Unconditional Exact Tests in Matched-Pairs Design

Abstract

In a recent article Hsueh et al. (Hsueh, H.-M., Liu, J.-P., Chen, J. J. (2001 Hsueh, H.-M., Liu, J.-P. and Chen, J. J. 2001. Unconditional exact tests for equivalence or noninferiority for paired binary endpoints. Biometrics, 57: 478–483. [Crossref], [PubMed], [Web of Science ®] , [Google Scholar]). Unconditional exact tests for equivalence or noninferiority for paired binary endpoints. Biometrics 57:478–483.) considered unconditional exact tests for paired binary endpoints. They suggested two statistics one of which is based on the restricted maximum-likelihood estimator. Properties of these statistics and the related tests are treated in this article.     

ESTIMATION OF PARAMETERS IN ARFIMA PROCESSES: A SIMULATION STUDY

It is known that, in the presence of short memory components, the estimation of the fractional parameter d in an Autoregressive Fractionally Integrated Moving Average, ARFIMA(p, d, q), process has some difficulties (see [1] Smith, J., Taylor, N. and Yadav, S. 1997. Comparing the bias and misspecification in ARFIMA models. Journal of Time Series Analysis, 18(5): 507–527. [Crossref] , [Google Scholar]). In this paper, we continue the efforts made by Smith et al. [1] Smith, J., Taylor, N. and Yadav, S. 1997. Comparing the bias and misspecification in ARFIMA models. Journal of Time Series Analysis, 18(5): 507–527. [Crossref] , [Google Scholar] and Beveridge and Oickle [2] Beveridge, S. and Oickle, C. 1993. Estimating fractionally integrated time series models. Economics Letters, 43: 137–142.  [Google Scholar] by conducting a simulation study to evaluate the convergence properties of the iterative estimation procedure suggested by Hosking [3] Hosking, J. 1981. Fractional differencing. Biometrika, 68(1): 165–176. [Crossref], [Web of Science ®] , [Google Scholar]. In this context we consider some semiparametric approaches and a parametric method proposed by Fox-Taqqu[4] Fox, R. and Taqqu, M. S. 1986. Large-sample properties of parameter estimates for strongly dependent stationary gaussian time series. The Annals of Statistics, 14(2): 517–532. [Crossref], [Web of Science ®] , [Google Scholar]. We also investigate the method proposed by Robinson [5] Robinson, P. M. 1995a. Log-periodogram regression of time series with long range dependence. The Annals of Statistics, 23(3): 1048–1072. [Crossref], [Web of Science ®] , [Google Scholar] and a modification using the smoothed periodogram function.     

POOLED SLICING METHODS VERSUS SLICING METHODS

We consider the semiparametric regression model introduced by [1] Duan, N. and Li, K. C. 1991. Slicing regression: a link-free regression method. The Annals of Statistics, 19: 505–530. [Crossref], [Web of Science ®] , [Google Scholar]. The dependent variable y is linked to the index x′ β through an unknown link function. [1] Duan, N. and Li, K. C. 1991. Slicing regression: a link-free regression method. The Annals of Statistics, 19: 505–530. [Crossref], [Web of Science ®] , [Google Scholar] and [2] Li, K. C. 1991. Sliced inverse regression for dimension reduction, with discussions. Journal of the American Statistical Association, 86: 316–342. [Taylor & Francis Online], [Web of Science ®] , [Google Scholar] present Slicing methods (the Sliced Inverse Regression methods SIR-I, SIR-II and SIR_α) in order to estimate the direction of the unknown slope parameter β. These methods are computationally simple and fast but depend on the choice of an arbitrary slicing fixed by the user. When the sample size is small, the number and the position of slices have an influence on the estimated direction. In this paper, we suggest to use the corresponding Pooled Slicing methods: PSIR-I (proposed by [3] Aragon, Y. and Saracco, J. 1997. Sliced Inverse Regression (SIR): an appraisal of small sample alternatives to slicing. Computational Statistics, 12: 109–130. [Web of Science ®] , [Google Scholar]), PSIR-II and PSIR_α. These methods combine the results from a number of slicings. We compare the sample behaviour of Slicing and Pooled Slicing methods on simulations. We also propose a practical choice of α in SIR_α and PSIR_α methods.     

A Variance Estimator for Systematic Sampling from a Deliberately Ordered Population

ABSTRACT

The systematic sampling (SYS) design (Madow and Madow, 1944 Madow , L. H. , Madow , W. G. ( 1944 ). On the theory of systematic sampling . Ann. Math. Statist. 15 : 1 – 24 .[Crossref] , [Google Scholar]) is widely used by statistical offices due to its simplicity and efficiency (e.g., Iachan, 1982 Iachan , R. ( 1982 ). Systematic sampling a critical review . Int. Statist. Rev. 50 : 293 – 303 .[Crossref], [Web of Science ®] , [Google Scholar]). But it suffers from a serious defect, namely, that it is impossible to unbiasedly estimate the sampling variance (Iachan, 1982 Iachan , R. ( 1982 ). Systematic sampling a critical review . Int. Statist. Rev. 50 : 293 – 303 .[Crossref], [Web of Science ®] , [Google Scholar]) and usual variance estimators (Yates and Grundy, 1953 Yates , F. , Grundy , P. M. ( 1953 ). Selection without replacement from within strata with probability proportional to size . J. Roy. Statist. Soc. Series B 1 : 253 – 261 . [Google Scholar]) are inadequate and can overestimate the variance significantly (Särndal et al., 1992 Särndal , C. E. , Swenson , B. , Wretman , J. H. ( 1992 ). Model Assisted Survey Sampling . New York : Springer-Verlag , Ch. 3 .[Crossref] , [Google Scholar]). We propose a novel variance estimator which is less biased and that can be implemented with any given population order. We will justify this estimator theoretically and with a Monte Carlo simulation study.     

A MONTE CARLO COMPARISON OF VARIOUS ASYMPTOTIC APPROXIMATIONS TO THE DISTRIBUTION OF INSTRUMENTAL VARIABLES ESTIMATORS

ABSTRACT

We examine empirical relevance of three alternative asymptotic approximations to the distribution of instrumental variables estimators by Monte Carlo experiments. We find that conventional asymptotics provides a reasonable approximation to the actual distribution of instrumental variables estimators when the sample size is reasonably large. For most sample sizes, we find Bekker[11] Bekker, P. A. 1994. Alternative Approximations to the Distributions of Instrumental Variable Estimators. Econometrica, 62: 657–681. [Crossref], [Web of Science ®] , [Google Scholar] asymptotics provides reasonably good approximation even when the first stage R ² is very small. We conclude that reporting Bekker[11] Bekker, P. A. 1994. Alternative Approximations to the Distributions of Instrumental Variable Estimators. Econometrica, 62: 657–681. [Crossref], [Web of Science ®] , [Google Scholar] confidence interval would suffice for most microeconometric (cross-sectional) applications, and the comparative advantage of Staiger and Stock[5] Staiger, D. and Stock, J. H. 1997. Instrumental Variables Regression with Weak Instruments. Econometrica, 65: 556–586. [Crossref], [Web of Science ®] , [Google Scholar] asymptotic approximation is in applications with sample sizes typical in macroeconometric (time series) applications.     

MODIFICATION OF KELLY AND RICE METHOD FOR SYNERGISM TESTS

ABSTRACT

In this paper, we present a modified Kelly and Rice method for testing synergism. This approach is consistent with Berenbaum's1-3 Berenbaum, M.C. 1977. Synergism, Additivism, and Antagonism in Immuno-Suppression: A Critical Review. Clinical and Experimental Immunology, 28: 1–18. Berenbaum, M.C. 1985. The Expected Effect of a Combination of Agents: The General Solution. Journal of Theoretical Biology, 114: 413–431. Berenbaum, M.C. 1989. What is Synergism? Pharmacological Reviews. 41: 93–141.   framework for additivity. The delta method[4] Bishop, Y.M., Fienberg, S.E. and Holland, P.W. 1975. Discrete Multivariate Analysis: Theory and Practice Massachusetts: MIT Press.  [Google Scholar] is applied to obtain the estimated variance for the predicted additivity proportion. A Monte Carlo simulation study for the evaluation of the method's performance, i.e., global overall tests for synergism, is also discussed. Kelly and Rice[5] Kelly, C. and Rice, J. 1990. Monotone Smoothing with Application to Dose-Response Curves and the Assessment of Synergism. Biometrics, 46: 1071–1085. [Crossref], [PubMed], [Web of Science ®] , [Google Scholar] do not provide a correct test statistic because the variance is underestimated. Hence, the performance of the Kelly–Rice[5] Kelly, C. and Rice, J. 1990. Monotone Smoothing with Application to Dose-Response Curves and the Assessment of Synergism. Biometrics, 46: 1071–1085. [Crossref], [PubMed], [Web of Science ®] , [Google Scholar] method is generally anti-conservative, based on the simulation findings. In addition, the overall test of synergism with χ²(r) from the modified Kelly and Rice method for larger sample sizes is better than that with χ²(1) from the modified Kelly and Rice method.     

COMBINING THE LIU ESTIMATOR AND THE PRINCIPAL COMPONENT REGRESSION ESTIMATOR

In this paper we introduce a class of estimators which includes the ordinary least squares (OLS), the principal components regression (PCR) and the Liu estimator [1] Liu, K. 1993. A new class of biased estimate in linear regression. Communications in Statistics – Theory and Methods, 22(2): 393–402. [Taylor & Francis Online], [Web of Science ®] , [Google Scholar]. In particular, we show that our new estimator is superior, in the scalar mean-squared error (mse) sense, to the Liu estimator, to the OLS estimator and to the PCR estimator.     

A Class of Improved Heteroskedasticity-Consistent Covariance Matrix Estimators

Abstract

The heteroskedasticity-consistent covariance matrix estimator proposed by White [White, H. A. (1980 White, H. A. 1980. Heteroskedasticity-consistent covariance matrix estimator and a direct test for heteroskedasticity. Econometrica, 48: 817–838. [Crossref], [Web of Science ®] , [Google Scholar]). Heteroskedasticity-consistent covariance matrix estimator and a direct test for heteroskedasticity. Econometrica 48:817–838], also known as HC0, is commonly used in practical applications and is implemented into a number of statistical software. Cribari–Neto et al. [Cribari–Neto, F., Ferrari, S. L. P., Cordeiro, G. M. (2000 Cribari–Neto, F., Ferrari, S. L. P. and Cordeiro, G. M. 2000. Improved heteroscedasticity–consistent covariance matrix estimators. Biometrika, 87: 907–918. [Crossref], [Web of Science ®] , [Google Scholar]). Improved heteroscedasticity–consistent covariance matrix estimators. Biometrika 87:907–918] have developed a bias-adjustment scheme that delivers bias-corrected White estimators. There are several variants of the original White estimator that are also commonly used by practitioners. These include the HC1, HC2, and HC3 estimators, which have proven to have superior small-sample behavior relative to White's estimator. This paper defines a general bias-correction mechamism that can be applied not only to White's estimator, but to variants of this estimator as well, such as HC1, HC2, and HC3. Numerical evidence on the usefulness of the proposed corrections is also presented. Overall, the results favor the sequence of improved HC2 estimators.     

BEADS,BAGS, BAYES,AND THE FUNDAMENTAL PROBLEM OF SAMPLING THEORY

Motivated by a discussion of an elementary probability puzzle provided by Anderson and Provost [1] Anderson, O. D. and Provost, S. B. 1992. Beads, bags and Bayes. Int. J. Math. Educ. Sci. Technol., 23: 25–37. [Taylor & Francis Online] , [Google Scholar], we review what may be called the fundamental problem of finite population sampling theory and propose that only super-model or Bayesian approaches to finite population sampling are acceptable.     

REGRESSION DIAGNOSTIC USING LOCAL INFLUENCE: A REVIEW

The local influence approach of Cook [1] Cook, R. D. 1986. Assessment of Local Influence. Journal Of The Royal Statistical Society Series B-Methodological, 48: 133–169.  [Google Scholar]to regression diagnostic is developed and discussed, and compared with Cook's [2] Cook, R. D. 1977. Detection of Influential Observations in Linear Regression. Technometrics, 19: 15–18. [Taylor & Francis Online], [Web of Science ®] , [Google Scholar]deletion approach. The ability of the local influence approach to handle cases simultaneously, as well as some of its theoretical and practical difficulties, are reviewed. The perturbation ideas of the approach are applied to the linear model making distinction between the local perturbations on the assumptions of the model and the data.     

On General Continuous Triangular and Two-sided Power Distributions

In this article, we directly introduce the continuous version of the general discrete triangular distributions (Kokonendji and Zocchi, 2010 Kokonendji, C.C., Zocchi, S.S. (2010). Extensions of discrete triangular distribution and boundary bias in kernel estimation for discrete functions. Statist. Probab. Lett. 80:1655–1662.[Crossref], [Web of Science ®] , [Google Scholar]). It is bounded and, in general, unimodal with pike. It contains thus a very useful class of two-sided power distributions (van Dorp and Kotz, 2002a Van Dorp, J.R., Kotz, S. (2002a). A novel extension of the triangular distribution and its parameter estimation. Statistician 51:1–17. [Google Scholar],b Van Dorp, J.R., Kotz, S. (2002b). The standard two-sided power distribution and its properties; with applications in financial engineering. Amer. Statistician 56:90–99.[Taylor & Francis Online], [Web of Science ®] , [Google Scholar], 2003 Van Dorp, J.R., Kotz, S. (2003). Generalization of two-sided power distributions and their convolution. Commun. Statist. Theor. Meth. 32:1703–1723.[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]). Moments, particular cases, limit distributions, and relations between parameters are straightforwardly derived.     

Quantile-based Chernoff distance for truncated random variables

Several probability distributions such as power-Pareto distribution (see Gilchrist 2000 Gilchrist, W. 2000. Statistical modelling with quantile functions. Boca Raton, FL: Chapman and Hall/CRC.[Crossref] , [Google Scholar] and Hankin and Lee 2006 Hankin, R. K. S., and A. Lee. 2006. A new family of non-negative distributions. Australian and New Zealand Journal of Statistics 48:67–78.[Crossref], [Web of Science ®] , [Google Scholar]), various forms of lambda distributions (see Ramberg and Schmeiser 1974 Ramberg, J. S., and B. W. Schmeiser. 1974. An appropriate method for generating asymmetric random variables. Communications of the ACM 17:78–82.[Crossref], [Web of Science ®] , [Google Scholar] and Freimer et al. 1988 Freimer, M., S. Mudholkar, G. Kollia, and C. T. Lin. 1988. A study of the generalized lambda family. Communications in Statistics - Theory and Methods 17:3547–67.[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]), Govindarajulu distribution (see Nair, Sankaran, and Vineshkumar 2012 Nair, U. N., P. G. Sankaran, and B. Vineshkumar. 2012. The Govindarajulu distribution: some properties and applications. Communications in Statistics—Theory and Methods 41:4391–406.[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]), etc., do not have manageable distribution functions, though they have tractable quantile functions. Hence, analytical study of the properties of Chernoff distance of two random variables associated with these distributions via traditional distribution function-based tool becomes difficult. To make this simple, in this paper, we introduce quantile-based Chernoff distance for (left or right) truncated random variables and study its various properties. Some useful bounds as well as characterization results are obtained.     

Note on posterior inference for the Bingham distribution

The properties of high-dimensional Bingham distributions have been studied by Kume and Walker (2014 Kume, A., and S. G. Walker. 2014. On the Bingham distribution with large dimension. Journal of Multivariate Analysis 124:345–52.[Crossref], [Web of Science ®] , [Google Scholar]). Fallaize and Kypraios (2016 Fallaize, C. J., and T. Kypraios. 2016. Exact Bayesian inference for the Bingham distribution. Statistics and Computing 26:349–60.[Crossref], [Web of Science ®] , [Google Scholar]) propose the Bayesian inference for the Bingham distribution and they use developments in Bayesian computation for distributions with doubly intractable normalizing constants (Møller et al. 2006 Møller, J., A. N. Pettitt, R. Reeves, and K. K. Berthelsen. 2006. An efficient Markov chain Monte Carlo method for distributions with intractable normalising constants. Biometrika 93 (2):451–458.[Crossref], [Web of Science ®] , [Google Scholar]; Murray, Ghahramani, and MacKay 2006 Murray, I., Z. Ghahramani, and D. J. C. MacKay. 2006. MCMC for doubly intractable distributions. In Proceedings of the 22nd annual conference on uncertainty in artificial intelligence (UAI-06), 359–66. AUAI Press. [Google Scholar]). However, they rely heavily on two Metropolis updates that they need to tune. In this article, we propose instead a model selection with the marginal likelihood.     

On Fitting Transformation Model to Survey Data

In this article, we consider fitting a semiparametric linear model to survey data with censored observations. The specific goal of the paper is to extend the methods of Cheng et al. (1995 Cheng, S.C., Wei, L.J., Ying, Z. (1995). Analysis of transformation models with censored data. Biometrika 82(4):835–845.[Crossref], [Web of Science ®] , [Google Scholar]) and Chen et al. (2002 Chen, K., Jin, Z. Ying, Z. (2002). Semiparametric analysis of transformation models with censored data. Biometrika 89:659–668.[Crossref], [Web of Science ®] , [Google Scholar]) to the case when the sample has been drawn from a population using a complex sampling design. Similar to the approach of Lin (2000 Lin, D.Y. (2000). On fitting Cox’s proportional hazards models to survey data. Biometrika 87:37–47.[Crossref], [Web of Science ®] , [Google Scholar]), we regard the survey population as a random sample from an infinite universe and accounts for this randomness in the statistical inference. A simulation study is conducted to investigate the performance of the proposed estimators.     

An improved estimation in stratified random sampling

ABSTRACT

The article suggests a class of estimators of population mean in stratified random sampling using auxiliary information with its properties. In addition, various known estimators/classes of estimators are identified as members of the suggested class. It has been shown that the suggested class of estimators under optimum condition performs better than the usual unbiased, usual combined ratio, usual combined regression, Kadilar and Cingi (2005 Kadilar, C., Cingi, H. (2005). A new ratio estimator in stratified sampling. Commun. Stat. Theory Methods 34:597–602.[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]), Singh and Vishwakarma (2006 Singh, H.P., Vishwakarma, G.K. (2006). Combined ratio-product estimator of finite population mean in stratified sampling. Metodologia de Encuestas Monografico: Incidencias en el trabjo de Campo 7(1):32–40. [Google Scholar]) estimators and the members belonging to the classes of estimators envisaged by Kadilar and Cingi (2003 Kadilar, C., Cingi, H. (2003). Ratio estimator in stratified sampling. Biomet. J. 45:218–225.[Crossref], [Web of Science ®] , [Google Scholar]), Singh, Tailor et al. (2008 Singh, H.P., Agnihotri, N. (2008). A general procedure of estimating population mean using auxiliary information in sample surveys. Stat. Trans. 9(1):71–87. [Google Scholar]), Singh et al. (2009 Singh, R., Kumar, M., Chaudhary, M.K., Kadilar, C. (2009). Improved exponential estimator in stratified random sampling. Pak. J. Stat. Oper. Res. 5(2):67–82.[Crossref] , [Google Scholar]), Singh and Vishwakarma (2010 Singh, H.P., Vishwakarma, G.K. (2010). A general procedure for estimating the population mean in stratified sampling using auxiliary information. METRON 67(1):47–65.[Crossref] , [Google Scholar]) and Koyuncu and Kadilar (2010) Koyuncu, N., Kadilar, C. (2010). On improvement in estimating population mean in stratified random sampling. J. Appl. Stat. 37(6):999–1013.[Taylor & Francis Online], [Web of Science ®] , [Google Scholar].     

THE SEQUENTIAL BOOTSTRAP: A COMPARISON WITH REGULAR BOOTSTRAP

Based on Bradley Efron's observation that individual resamples in the regular bootstrap have support on approximately 63% of the original observations, C. R. Rao, P. K. Pathak and V. I. Koltchinskii [1] Rao, C. R., Pathak, P. K. and Koltchinskii, V. I. 1997. Bootstrap by Sequential Resampling. Journal of Statistical Planning and Inference, 64: 257–281. [Crossref], [Web of Science ®] , [Google Scholar]have proposed a sequential resampling scheme. This sequential bootstrap stabilizes the information content of each resample by fixing the number of unique observations and letting N, the number of observatons in each resample, vary. The Rao-Pathak-Koltchinskii paper establishes the asymptotic correctness (consistency) of the sequential bootstrap. The main object of our investigation is to study the empirical properties of the Rao-Pathak-Koltchinskii sequential bootstrap as compared to the regular bootstrap. In all our settings, sequential bootstrap performs as well or better than regular bootstrap. In the particular case where we estimate standard errors of sample medians, we find that sequential bootstrap outperforms regular bootstrap by reducing variability in the final bootstrap estimates.