A Novel Approach to Evaluate Repeatability and Reproducibility for Ordinal Data

We propose a novel usage of CUB models in order to evaluate Repeatability and Reproducibility (R&R) for ordinal data in business and industrial experiments. This is a context where there is a small group of appraisers who have to evaluate a sample of objects classifying them according to ordinal categories. By comparing the cumulative distribution functions obtained fitting CUB models to judgments given by appraisers, we give both graphical and analytical instruments to assess R&R for an ordinal measurement system. The approach is applied to the real-life example reported in de Mast and van Wieringen (2010 de Mast , J. , van Wieringen , W. N. ( 2010 ). Modeling and evaluating repeatibility and reproducibility of ordinal classifications . Technometrics 52 : 94 – 106 .[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]).     

Marginal Correlation from Logit- and Probit-Beta-Normal Models for Hierarchical Binary Data

In hierarchical data settings, be it of a longitudinal, spatial, multi-level, clustered, or otherwise repeated nature, often the association between repeated measurements attracts at least part of the scientific interest. Quantifying the association frequently takes the form of a correlation function, including but not limited to intraclass correlation. Vangeneugden et al. (2010 Vangeneugden, T., Molenberghs, G., Laenen, A., Geys, H., Beunckens, C., Sotto, C. (2010). Marginal correlation in longitudinal binary data based on generalized linear mixed models. Communi. Stati. Theory &; Methods. 39:3542–3557. [Google Scholar]) derived approximate correlation functions for longitudinal sequences of general data type, Gaussian and non-Gaussian, based on generalized linear mixed-effects models. Here, we consider the extended model family proposed by Molenberghs et al. (2010 Molenberghs, G., Verbeke, G., Demétrio, C., Vieira, A. (2010). A family of generalized linear models for repeated measures with normal and conjugate random effects. Stat. Sci. 25:325–347.[Crossref], [Web of Science ®] , [Google Scholar]). This family flexibly accommodates data hierarchies, intra-sequence correlation, and overdispersion. The family allows for closed-form means, variance functions, and correlation function, for a variety of outcome types and link functions. Unfortunately, for binary data with logit link, closed forms cannot be obtained. This is in contrast with the probit link, for which such closed forms can be derived. It is therefore that we concentrate on the probit case. It is of interest, not only in its own right, but also as an instrument to approximate the logit case, thanks to the well-known probit-logit ‘conversion.’ Next to the general situation, some important special cases such as exchangeable clustered outcomes receive attention because they produce insightful expressions. The closed-form expressions are contrasted with the generic approximate expressions of Vangeneugden et al. (2010 Vangeneugden, T., Molenberghs, G., Laenen, A., Geys, H., Beunckens, C., Sotto, C. (2010). Marginal correlation in longitudinal binary data based on generalized linear mixed models. Communi. Stati. Theory &; Methods. 39:3542–3557. [Google Scholar]) and with approximations derived for the so-called logistic-beta-normal combined model. A simulation study explores performance of the method proposed. Data from a schizophrenia trial are analyzed and correlation functions derived.     

A non-iterative sampling Bayesian method for linear mixed models with normal independent distributions

In this paper, we utilize normal/independent (NI) distributions as a tool for robust modeling of linear mixed models (LMM) under a Bayesian paradigm. The purpose is to develop a non-iterative sampling method to obtain i.i.d. samples approximately from the observed posterior distribution by combining the inverse Bayes formulae, sampling/importance resampling and posterior mode estimates from the expectation maximization algorithm to LMMs with NI distributions, as suggested by Tan et al. [33 Tan, M., Tian, G. and Ng, K. 2003. A noniterative sampling method for computing posteriors in the structure of EM-type algorithms. Statist. Sinica, 13(3): 625–640. [Web of Science ®] , [Google Scholar]]. The proposed algorithm provides a novel alternative to perfect sampling and eliminates the convergence problems of Markov chain Monte Carlo methods. In order to examine the robust aspects of the NI class, against outlying and influential observations, we present a Bayesian case deletion influence diagnostics based on the Kullback–Leibler divergence. Further, some discussions on model selection criteria are given. The new methodologies are exemplified through a real data set, illustrating the usefulness of the proposed methodology.     

Marginal correlation from an extended random-effects model for repeated and overdispersed counts

Vangeneugden et al. [15 Vangeneugden, T., Molenberghs, G., Laenen, A., Geys, H., Beunckens, C. and Sotto, C. 2007. Marginal correlation in longitudinal binary data based on generalized linear mixed models, Tech. Rep., Hasselt University. submitted for publication [Google Scholar]] derived approximate correlation functions for longitudinal sequences of general data type, Gaussian and non-Gaussian, based on generalized linear mixed-effects models (GLMM). Their focus was on binary sequences, as well as on a combination of binary and Gaussian sequences. Here, we focus on the specific case of repeated count data, important in two respects. First, we employ the model proposed by Molenberghs et al. [13 Molenberghs, G., Verbeke, G. and Demétrio, C. G.B. 2007. An extended random-effects approach to modeling repeated, overdispersed count data. Lifetime Data Anal., 13: 513–531. [Crossref], [PubMed], [Web of Science ®] [Google Scholar]], which generalizes at the same time the Poisson-normal GLMM and the conventional overdispersion models, in particular the negative-binomial model. The model flexibly accommodates data hierarchies, intra-sequence correlation, and overdispersion. Second, means, variances, and joint probabilities can be expressed in closed form, allowing for exact intra-sequence correlation expressions. Next to the general situation, some important special cases such as exchangeable clustered outcomes are considered, producing insightful expressions. The closed-form expressions are contrasted with the generic approximate expressions of Vangeneugden et al. [15 Vangeneugden, T., Molenberghs, G., Laenen, A., Geys, H., Beunckens, C. and Sotto, C. 2007. Marginal correlation in longitudinal binary data based on generalized linear mixed models, Tech. Rep., Hasselt University. submitted for publication [Google Scholar]]. Data from an epileptic-seizures trial are analyzed and correlation functions derived. It is shown that the proposed extension strongly outperforms the classical GLMM.     

On generalized exponential chain ratio estimators under stratified two-phase random sampling

Sanaullah et al. (2014 Sanaullah, A., Ali, H.M., Noor ul Amin, M., Hanif, M. (2014). Generalized exponential chain ratio estimators under stratified two-phase random sampling. Appl. Math. Comput. 226:541–547.[Crossref], [Web of Science ®] , [Google Scholar]) have suggested generalized exponential chain ratio estimators under stratified two-phase sampling scheme for estimating the finite population mean. However, the bias and mean square error (MSE) expressions presented in that work need some corrections, and consequently the study based on efficiency comparison also requires corrections. In this article, we revisit Sanaullah et al. (2014 Sanaullah, A., Ali, H.M., Noor ul Amin, M., Hanif, M. (2014). Generalized exponential chain ratio estimators under stratified two-phase random sampling. Appl. Math. Comput. 226:541–547.[Crossref], [Web of Science ®] , [Google Scholar]) estimator and provide the correct bias and MSE expressions of their estimator. We also propose an estimator which is more efficient than several competing estimators including the classes of estimators in Sanaullah et al. (2014 Sanaullah, A., Ali, H.M., Noor ul Amin, M., Hanif, M. (2014). Generalized exponential chain ratio estimators under stratified two-phase random sampling. Appl. Math. Comput. 226:541–547.[Crossref], [Web of Science ®] , [Google Scholar]). Three real datasets are used for efficiency comparisons.     

Independent Quadratic Forms in 3-Variance-Component Models

This article addresses derivation and existence of quadratic forms that were suggested by Burch (2007 Burch , B. D. ( 2007 ). Generalized confidence intervals for proportions of total variance in mixed linear models . J. Statist. Plann. Infer. 137 : 2394 – 2404 .[Crossref], [Web of Science ®] , [Google Scholar]) for procedures for inference on variance components in mixed linear models in combination with generalized fiducial inference. A relatively simple algorithm leading to the required quadratic forms in a general 3-variance-component model is stated and designs for two-way ANOVA models without interactions that permit Burch's procedure are characterized. This complements developments in the original article by Burch.     

Inequalities for sums of squares of reranked differences involving ties and missing data

An inequality for the sum of squares of rank differences associated with Spearman’s rank correlation coefficient, when ties and missing data are present in both rankings, was established numerically in Loukas and Papaioannou (1991 Loukas, S., Papaioannou, T. (1991). Rank correlation inequalities with ties and missing data. Stat. Probab. Lett. 11:53–56.[Crossref], [Web of Science ®] , [Google Scholar]). That inequality is improved and generalized.     

The Identification of Potential Longitudinal Biomarkers and Measurements of Effectiveness for Biomarkers as Surrogates in Multivariate Survival Data

A proposed method based on frailty models is used to identify longitudinal biomarkers or surrogates for a multivariate survival. This method is an extention of earlier models by Wulfsohn and Tsiatis (1997 Wulfsohn , M. S. , Tsiatis , A. A. ( 1997 ). A joint model for survival and longitudinal data measured with error . Biometrics 53 ( 1 ): 330 – 339 .[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]) and Song et al. (2002 Song , X. , Davidian , M. , Tsiatis , A. A. ( 2002 ). A Semiparametric likelihood approach to joint modeling of longitudinal and time-to-event data . Biometrics 58 ( 4 ): 742 – 753 .[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]). In this article, similar to Henderson et al. (2002 Henderson , R. , Diggle , P. J. , Dobson , A. ( 2002 ). Identification and efficacy of longitudinal markers for survival . Biostatistics 3 ( 1 ): 33 – 50 .[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]), a joint likelihood function combines the likelihood functions of the longitudinal biomarkers and the multivariate survival times. We use simulations to explore how the number of individuals, the number of time points per individual and the functional form of the random effects from the longitudianl biomarkers influence the power to detect the association of a longitudinal biomarker and the multivariate survival time. The proposed method is illustrate by using the gastric cancer data.     

The CUSUM Test for Detecting Structural Changes in Strong Mixing Processes

Strong mixing property holds for a broad class of linear and nonlinear time series models such as Auto-Regressive Moving Average Processes and Generalized Auto-Regressive Conditional Heteroscedasticity Processes models. In this article, we study correlation structure of strong mixing sequences, and some asymptotic properties are presented. We also present a new method for detecting change point in correlation structure of strong mixing sequences, and present a nonparametric sequential analysis for detecting changes named cumulative sum test statistic for this. Asymptotic consistency of this test statistics is shown. This method is applied to simulated data of some linear and nonlinear models and power of the test is evaluated. For linear models, it is shown that this method has a better performance in comparison to Berkes et al. (2009 Berkes, I., Gombay, E., Horvath, L. (2009). Testing for changes in the covariance structure of linear processes. J. Stat. Plan. Inf. 139:2044–2063.[Crossref], [Web of Science ®] , [Google Scholar]).     

Estimation of the covariance matrix with two-step monotone missing data

Abstract

We suggest shrinkage based technique for estimating covariance matrix in the high-dimensional normal model with missing data. Our approach is based on the monotone missing scheme assumption, meaning that missing values patterns occur completely at random. Our asymptotic framework allows the dimensionality p grow to infinity together with the sample size, N, and extends the methodology of Ledoit and Wolf (2004) Ledoit, O., Wolf, M. (2004). A well-conditioned estimator for large dimensional covariance matrices. J. Multivariate Anal. 88:365–411.[Crossref], [Web of Science ®] , [Google Scholar] to the case of two-step monotone missing data. Two new shrinkage-type estimators are derived and their dominance properties over the Ledoit and Wolf (2004) Ledoit, O., Wolf, M. (2004). A well-conditioned estimator for large dimensional covariance matrices. J. Multivariate Anal. 88:365–411.[Crossref], [Web of Science ®] , [Google Scholar] estimator are shown under the expected quadratic loss. We perform a simulation study and conclude that the proposed estimators are successful for a range of missing data scenarios.     

Ignorability conditions for frequentist non parametric analysis of conditional distributions with incomplete data

Rubin (1976 Rubin, D.B. (1976). Inference and missing data. Biometrika 63(3):581–592.[Crossref], [Web of Science ®] , [Google Scholar]) derived general conditions under which inferences that ignore missing data are valid. These conditions are sufficient but not generally necessary, and therefore may be relaxed in some special cases. We consider here the case of frequentist estimation of a conditional cdf subject to missing outcomes. We partition a set of data into outcome, conditioning, and latent variables, all of which potentially affect the probability of a missing response. We describe sufficient conditions under which a complete-case estimate of the conditional cdf of the outcome given the conditioning variable is unbiased. We use simulations on a renal transplant data set (Dienemann et al.) to illustrate the implications of these results.     

SECOND-ORDER ASYMPTOTICS FOR SCORE TESTS IN HETEROSKEDASTIC t REGRESSION MODELS

ABSTRACT

This paper develops corrected score tests for heteroskedastic t regression models, thus generalizing results by Cordeiro, Ferrari and Paula[1] Cordeiro, G.M., Ferrari, S.L.P. and Paula, G.A. 1993. Improved Score Tests for Generalized Linear Models. Journal of the Royal Statistical Society B, 55: 661–674.  [Google Scholar] and Cribari-Neto and Ferrari[2] Cribari-Neto, F. and Ferrari, S.L.P. 1995. Second-order Asymptotics for Score Tests in Generalised Linear Models. Biometrika, 82: 426–432. [Crossref], [Web of Science ®] , [Google Scholar] for normal regression models and by Ferrari and Arellano-Valle[3] Ferrari, S.L.P. and Arellano-Valle, R. 1996. Modified Likelihood Ratio and Score Tests in Linear Regression Models Using the t Distribution. Brazilian Journal of Probability and Statistics, 10: 15–33.  [Google Scholar] for homoskedastic t regression models. We present, in matrix notation, Bartlett-type correction formulae to improve score tests in this class of models. The corrected score statistics have a chi-squared distribution to order n ^?1, where n is the sample size. We apply our main result to a few special models and present simulation results comparing the performance of the usual score tests and their corrected versions.     

Estimating the Parameters of the Generalized Lambda Distribution: Which Method Performs Best?

Generalized lambda distribution (GLD) is a flexible distribution that can represent a wide variety of distributional shapes. This property of the GLD has made it very popular in simulation input modeling in recent years, and several fitting methods for estimating the parameters of the GLD have been proposed. Nevertheless, there appears to be a lack of insights about the performances of these fitting methods in estimating the parameters of the GLD for a variety of distributional shapes and input data. Our primary goal in this article is to compare the goodness-of-fits of the popular fitting methods in estimating the parameters of the GLD introduced in Freimer et al. (1988 Freimer, M., Mudholkar, G., Kollia, G., Lin, C. (1988). A study of the Generalized Tukey Lambda family. Communications in Statistics-Theory and Methods 17:3547–3567.[Taylor &; Francis Online], [Web of Science ®] , [Google Scholar]), i.e., Freimer–Mudholkar–Kollia–Lin (FMKL) GLD, and provide guidelines to the simulation practitioner about when to use each method. We further describe the use of the genetic algorithm for the FMKL GLD, and investigate the performances of the suggested methods in modeling the daily exchange rates of eight currencies.     

A Consistent Variance Estimator for 2SLS When Instruments Identify Different LATEs

Under treatment effect heterogeneity, an instrument identifies the instrument-specific local average treatment effect (LATE). With multiple instruments, two-stage least squares (2SLS) estimand is a weighted average of different LATEs. What is often overlooked in the literature is that the postulated moment condition evaluated at the 2SLS estimand does not hold unless those LATEs are the same. If so, the conventional heteroscedasticity-robust variance estimator would be inconsistent, and 2SLS standard errors based on such estimators would be incorrect. I derive the correct asymptotic distribution, and propose a consistent asymptotic variance estimator by using the result of Hall and Inoue (2003 Hall, A.R., and Inoue, A. (2003), “The Large Sample Behaviour of the Generalized Method of Moments Estimator in Misspecified Models,” Journal of Econometrics, 114, 361–394.[Crossref], [Web of Science ®] , [Google Scholar], Journal of Econometrics) on misspecified moment condition models. This can be used to correctly calculate the standard errors regardless of whether there is more than one LATE or not.     

A Computer Program to Improve LR Tests for Generalized Linear Models

Generalized linear models enable the fitting of models to a wide range of data types. These models are based on exponential dispersion distributions. Improved likelihood ratio tests for these models were developed by Cordeiro (1983 Cordeiro , G. M. (1983). Improved likelihood ratio statistics for generalized linear models. Journal of the Royal Statistical Society, Series B: Methodological 45:404–413. [Google Scholar])Cordeiro (1987 Cordeiro , G. M. ( 1987 ). On the corrections to the likelihood ratio statistics . Biometrika 74 : 265 – 274 .[Crossref], [Web of Science ®] , [Google Scholar]). We present a simple R program source for calculating Bartlett corrections to improve likelihood ratio tests in these models. The program was tested on some special models, confirming all of the previously reported numerical results for the Bartlett corrections.     

Determination of the Selection Statistics and Best Significance Level in Backward Stepwise Logistic Regression

The weighted generalized estimating equation (WGEE), an extension of the generalized estimating equation (GEE) method, is a method for analyzing incomplete longitudinal data. An inappropriate specification of the working correlation structure results in the loss of efficiency of the GEE estimation. In this study, we evaluated the efficiency of WGEE estimation for incomplete longitudinal data when the working correlation structure was misspecified. As a result, we found that the efficiency of the WGEE estimation was lower when an improper working correlation structure was selected, similar to the case of the GEE method. Furthermore, we modified the criterion proposed by Gosho et al. (2011 Gosho, M., Hamada, C. and Yoshimura, I. 2011. Criterion for the selection of a working correlation structure in the generalized estimating equation approach for longitudinal balanced data. Communications in Statistics -Theory and Methods, 40: 3839–3856. [Taylor &; Francis Online], [Web of Science ®] , [Google Scholar]) for selecting a working correlation structure, such that the GEE and WGEE methods can be applied to incomplete longitudinal data, and we investigated the performance of the modified criterion. The results revealed that when the modified criterion was adopted, the proportion that the true correlation structure was selected was likely higher than that in the case of adopting other competing approaches.     

Random Effects,Fixed Effects and Hausman's Test for the Generalized Mixed Regressive Spatial Autoregressive Panel Data Model

This article suggests random and fixed effects spatial two-stage least squares estimators for the generalized mixed regressive spatial autoregressive panel data model. This extends the generalized spatial panel model of Baltagi et al. (2013 Baltagi, B. H., Egger, P., Pfaffermayr, M. (2013). A generalized spatial panel data model with random effects. Econometric Reviews 32:650–685.[Taylor &; Francis Online], [Web of Science ®] , [Google Scholar]) by the inclusion of a spatial lag term. The estimation method utilizes the Generalized Moments method suggested by Kapoor et al. (2007 Kapoor, M., Kelejian, H. H., Prucha, I. R. (2007). Panel data models with spatially correlated error components. Journal of Econometrics 127(1):97–130.[Crossref], [Web of Science ®] , [Google Scholar]) for a spatial autoregressive panel data model. We derive the asymptotic distributions of these estimators and suggest a Hausman test a la Mutl and Pfaffermayr (2011 Mutl, J., Pfaffermayr, M. (2011). The Hausman test in a Cliff and Ord panel model. Econometrics Journal 14:48–76.[Crossref], [Web of Science ®] , [Google Scholar]) based on the difference between these estimators. Monte Carlo experiments are performed to investigate the performance of these estimators as well as the corresponding Hausman test.     

D-optimal Factorial Designs under Generalized Linear Models

Generalized linear models (GLMs) have been used widely for modeling the mean response both for discrete and continuous random variables with an emphasis on categorical response. Recently Yang, Mandal and Majumdar (2013 Yang, J., Mandal, A., Majumdar, D. (2013). Optimal designs for 2^k factorial experiments with binary response. Technical Report, Available at: http://arxiv.org/pdf/1109.5320v4.pdf. [Google Scholar]) considered full factorial and fractional factorial locally D-optimal designs for binary response and two-level experimental factors. In this article, we extend their results to a general setup with response belonging to a single-parameter exponential family and for multilevel predictors.     

Generalized Point Estimation with Application to Small Response Estimation

Motivated by a number of drawbacks of classical methods of point estimation, we generalize the definitions of point estimation, and address such notions as unbiasedness and estimation under constraints. The utility of the extension is shown by deriving more reliable estimates for small coefficients of regression models, and for variance components and random effects of mixed models. The extension is in the spirit of generalized confidence intervals introduced by Weerahandi (1993 Weerahandi , S. ( 1993 ). Generalized confidence intervals . J. Amer. Statist. Assoc. 88 : 899 – 905 .[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]) and should encourage much needed further research in point estimation in unbalanced models, multi-variate models, non normal models, and nonlinear models.     

Regression Analysis with Covariates Missing at Random: A Piece-wise Nonparametric Model for Missing Covariates

Statistical analysis for the regression model f _β(y | x, z) with missing values in the covariate vector X requires modeling of the covariate distribution g(x | z). Likelihood methods, including Ibrahim (1990 Ibrahim , J. G. ( 1990 ). Incomplete data in generalized linear models . J. Amer. Statist. Assoc. 85 : 765 – 769 .[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]), Chen (2004 Chen , H. Y. (2004). Nonparametric and semiparametric models for missing covariates in parametric regression. J. Amer. Statist. Assoc. 99:1176–1189.[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]), and Zhao (2005 Zhao , Y. ( 2005 ). Design and Efficient Estimation in Regression Analysis with Missing Data in Two-Phase Studies. Ph.D. thesis , University of Waterloo . [Google Scholar]), need either X or Z to be discrete. This article considers extending the likelihood methods to deal with cases where both X and Z may be continuous. We propose modeling the covariate distribution g(x | z) using a piece-wise nonparametric model, then a maximum likelihood estimate (MLE) of β can be computed following the maximum likelihood estimating procedure of Chen (2004 Chen , H. Y. (2004). Nonparametric and semiparametric models for missing covariates in parametric regression. J. Amer. Statist. Assoc. 99:1176–1189.[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]) or Zhao (2005 Zhao , Y. ( 2005 ). Design and Efficient Estimation in Regression Analysis with Missing Data in Two-Phase Studies. Ph.D. thesis , University of Waterloo . [Google Scholar]). The resulting estimation method is easy to implement and the asymptotic properties of the MLE follow under certain conditions. Extensive simulation studies for different models indicate that the proposed method is acceptable for practical implementation. A real data example is used to illustrate the method.