Some Remarks on Latent Variable Models in Categorical Data Analysis

We present an overview of some important and/or interesting contributions to the latent variable literature for the analysis of multivariate categorical responses, beginning with Lazarsfeld's introduction of latent class models. There is by now an enormous literature on latent variable models for categorical responses, especially in the context of including random effects in generalized linear mixed models, so this is necessarily a highly selective overview. Due to space considerations, we summarize the main ideas, suppressing details. As part of our presentation, we raise a couple of questions that may suggest future research work.     

A Novel Approach to Evaluate Repeatability and Reproducibility for Ordinal Data

We propose a novel usage of CUB models in order to evaluate Repeatability and Reproducibility (R&R) for ordinal data in business and industrial experiments. This is a context where there is a small group of appraisers who have to evaluate a sample of objects classifying them according to ordinal categories. By comparing the cumulative distribution functions obtained fitting CUB models to judgments given by appraisers, we give both graphical and analytical instruments to assess R&R for an ordinal measurement system. The approach is applied to the real-life example reported in de Mast and van Wieringen (2010 de Mast , J. , van Wieringen , W. N. ( 2010 ). Modeling and evaluating repeatibility and reproducibility of ordinal classifications . Technometrics 52 : 94 – 106 .[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]).     

Power-Divergence Test Statistics for Testing Linear by Linear Association

Power-divergence test statistics have been considered to test linear by linear association for two-way contingency tables. These test statistics have been compared based on designed simulation study and asymptotic results for 2 × 2, 2 × 3, and 3 × 3 tables. According to the results, there are test statistics with better properties than the well-known likelihood ratio test statistic for small and moderate samples.     

Hierarchical CUB Models for Ordinal Variables

Hierarchical CUB models are a generalization of CUB models in which parameters are allowed to be random. The main feature that distinguishes such proposal from the standard one is the modeling of variation among groups. We illustrate the usefulness of these hierarchical structures by discussing model specification, inferential issues, and empirical results with reference to a real data set.     

有序秩聚类及对地震活跃期的分析

 本文在对Fisher最优求解有序聚类方法和有序近邻聚类方法剖析的基础上,提出了有序秩聚类分析方法,并对Fisher最优求解、有序近邻聚类和有序秩聚类在计算效率上进行了比较分析,研究表明有序秩聚类在处理海量数据具有明显的优势。最后利用该方法对我国南北地震带活跃期进行分析,取得了良好的效果。     

Rank Regression Analysis of Multivariate Failure Time Data Based on Marginal Linear Models

Abstract.  Multivariate failure time data arises when each study subject can potentially ex-perience several types of failures or recurrences of a certain phenomenon, or when failure times are sampled in clusters. We formulate the marginal distributions of such multivariate data with semiparametric accelerated failure time models (i.e. linear regression models for log-transformed failure times with arbitrary error distributions) while leaving the dependence structures for related failure times completely unspecified. We develop rank-based monotone estimating functions for the regression parameters of these marginal models based on right-censored observations. The estimating equations can be easily solved via linear programming. The resultant estimators are consistent and asymptotically normal. The limiting covariance matrices can be readily estimated by a novel resampling approach, which does not involve non-parametric density estimation or evaluation of numerical derivatives. The proposed estimators represent consistent roots to the potentially non-monotone estimating equations based on weighted log-rank statistics. Simulation studies show that the new inference procedures perform well in small samples. Illustrations with real medical data are provided.     

A Simulation Study Comparing Multiple Imputation Methods for Incomplete Longitudinal Ordinal Data

Multiple imputation (MI) is now a reference solution for handling missing data. The default method for MI is the Multivariate Normal Imputation (MNI) algorithm that is based on the multivariate normal distribution. In the presence of longitudinal ordinal missing data, where the Gaussian assumption is no longer valid, application of the MNI method is questionable. This simulation study compares the performance of the MNI and ordinal imputation regression model for incomplete longitudinal ordinal data for situations covering various numbers of categories of the ordinal outcome, time occasions, sample sizes, rates of missingness, well-balanced, and skewed data.     

Tests of Multivariate Independence for Ordinal Data

Population and sample versions of Kendall and Spearman measures of association suitable for multivariate ordinal data are defined. The latter generalize the indices of dependence of Ruymgaart and van Zuijlen (1978 Ruymgaart , F. H. , van Zuijlen , M. C. A. ( 1978 ). Asymptotic normality of multivariate linear rank statistics in the non-i.i.d. case . Ann. Statist. 6 : 588 – 602 .[Crossref], [Web of Science ®] , [Google Scholar]), Joe (1990 Joe , H. ( 1990 ). Multivariate concordance . J. Multivariate Anal. 35 : 12 – 30 .[Crossref], [Web of Science ®] , [Google Scholar]), and Schmid and Schmidt (2007 Schmid , F. , Schmidt , R. ( 2007 ). Multivariate extensions of Spearman's rho and related statistics . Statist. Probab. Lett. 77 : 407 – 416 .[Crossref], [Web of Science ®] , [Google Scholar]) by allowing atoms in the underlying distribution. The representation of the proposed empirical measures as U-statistics enables to establish their asymptotic normality under general distributions. A special attention is given to tests of independence for multivariate ordinal data, where the power of the new methodologies are investigated under fixed and contiguous alternatives.     

Simple Fitting Algorithms for Incomplete Categorical Data

A popular approach to estimation based on incomplete data is the EM algorithm. For categorical data, this paper presents a simple expression of the observed data log-likelihood and its derivatives in terms of the complete data for a broad class of models and missing data patterns. We show that using the observed data likelihood directly is easy and has some advantages. One can gain considerable computational speed over the EM algorithm and a straightforward variance estimator is obtained for the parameter estimates. The general formulation treats a wide range of missing data problems in a uniform way. Two examples are worked out in full.     

Association Models for Multi-Dimensional Cross-Classifications of Ordinal Variables

Models are formulated for describing associations among ordinal variables in multidimensional tables.Uniform association and uniform interaction models occur as special cases in which equal-interval scores are assigned to levels of the variables.The models described are extensions of ones proposed by Goodman (1979).     

A Comparison of Different Methods for Representing Categorical Data

We first compare correspondence analysis, which uses chi-square distance, and an alternative approach using Hellinger distance, for representing categorical data in a contingency table. We propose a coefficient which globally measures the similarity between these two approaches. This coefficient can be decomposed into several components, one component for each principal dimension, indicating the contribution of the dimensions to the difference between the two representations. We also make comparisons with the logratio approach based on compositional data. These three methods of representation can produce quite similar results. Two illustrative examples are given.     

Imputation of Household Survey Data Using Linear Mixed Models

Mixed models are regularly used in the analysis of clustered data, but are only recently being used for imputation of missing data. In household surveys where multiple people are selected from each household, imputation of missing values should preserve the structure pertaining to people within households and should not artificially change the apparent intracluster correlation (ICC). This paper focuses on the use of multilevel models for imputation of missing data in household surveys. In particular, the performance of a best linear unbiased predictor for both stochastic and deterministic imputation using a linear mixed model is compared to imputation based on a single level linear model, both with and without information about household respondents. In this paper an evaluation is carried out in the context of imputing hourly wage rate in the Household, Income and Labour Dynamics of Australia Survey. Nonresponse is generated under various assumptions about the missingness mechanism for persons and households, and with low, moderate and high intra‐household correlation to assess the benefits of the multilevel imputation model under different conditions. The mixed model and single level model with information about the household respondent lead to clear improvements when the ICC is moderate or high, and when there is informative missingness.     

Bivariate Negative Binomial Generalized Linear Models for Environmental Count Data

We propose a new bivariate negative binomial model with constant correlation structure, which was derived from a contagious bivariate distribution of two independent Poisson mass functions, by mixing the proposed bivariate gamma type density with constantly correlated covariance structure (Iwasaki & Tsubaki, 2005), which satisfies the integrability condition of McCullagh & Nelder (1989, p. 334). The proposed bivariate gamma type density comes from a natural exponential family. Joe (1997) points out the necessity of a multivariate gamma distribution to derive a multivariate distribution with negative binomial margins, and the luck of a convenient form of multivariate gamma distribution to get a model with greater flexibility in a dependent structure with indices of dispersion. In this paper we first derive a new bivariate negative binomial distribution as well as the first two cumulants, and, secondly, formulate bivariate generalized linear models with a constantly correlated negative binomial covariance structure in addition to the moment estimator of the components of the matrix. We finally fit the bivariate negative binomial models to two correlated environmental data sets.     

Variable Selection for Partially Linear Models with Randomly Censored Data

This article proposes a variable selection procedure for partially linear models with right-censored data via penalized least squares. We apply the SCAD penalty to select significant variables and estimate unknown parameters simultaneously. The sampling properties for the proposed procedure are investigated. The rate of convergence and the asymptotic normality of the proposed estimators are established. Furthermore, the SCAD-penalized estimators of the nonzero coefficients are shown to have the asymptotic oracle property. In addition, an iterative algorithm is proposed to find the solution of the penalized least squares. Simulation studies are conducted to examine the finite sample performance of the proposed method.     

Partial Linear Models for Longitudinal Data Based on Quadratic Inference Functions

In this paper, we consider improved estimating equations for semiparametric partial linear models (PLM) for longitudinal data, or clustered data in general. We approximate the non‐parametric function in the PLM by a regression spline, and utilize quadratic inference functions (QIF) in the estimating equations to achieve a more efficient estimation of the parametric part in the model, even when the correlation structure is misspecified. Moreover, we construct a test which is an analogue to the likelihood ratio inference function for inferring the parametric component in the model. The proposed methods perform well in simulation studies and real data analysis conducted in this paper.     

A goodness of fit test for the multilevel proportional odds model

It is essential to test the goodness of fit of the model before making inferences based on it. Multilevel modeling of ordinal categorical responses is not as developed as for continuous responses. Assessing model adequacy in terms of the goodness of fit with ordinal categorical responses is still being developed and no satisfactory tests are available so far. As a consequence of that, this study concentrates on developing such a goodness of fit test for Multilevel Proportional Odds models and to study the properties of the test.     

Generalized Empirical Likelihood Inference in Generalized Linear Models for Longitudinal Data

In this article, the generalized linear model for longitudinal data is studied. A generalized empirical likelihood method is proposed by combining generalized estimating equations and quadratic inference functions based on the working correlation matrix. It is proved that the proposed generalized empirical likelihood ratios are asymptotically chi-squared under some suitable conditions, and hence it can be used to construct the confidence regions of the parameters. In addition, the maximum empirical likelihood estimates of parameters are obtained, and their asymptotic normalities are proved. Some simulations are undertaken to compare the generalized empirical likelihood and normal approximation-based method in terms of coverage accuracies and average areas/lengths of confidence regions/intervals. An example of a real data is used for illustrating our methods.     

Empirical Analysis of Interval-Censored Failure Time Data with Linear Transformation Models

Interval-censored data naturally arise in many studies. For their regression analysis, many approaches have been proposed under various models and for most of them, the inference is carried out based on the asymptotic normality. In particular, Zhang et al. (2005) discussed the procedure under the linear transformation model. It is well-known that the symmetric property implied by the normal distribution may not be appropriate sometimes. Also the method could underestimate the variance of estimated parameters. This paper proposes an empirical likelihood-based procedure for the problem. Simulation and the analysis of a real data set are conducted to assess the performance of the procedure.     

Estimation of Some Nonlinear Panel Data Models With Both Time-Varying and Time-Invariant Explanatory Variables

The so-called “fixed effects” approach to the estimation of panel data models suffers from the limitation that it is not possible to estimate the coefficients on explanatory variables that are time-invariant. This is in contrast to a “random effects” approach, which achieves this by making much stronger assumptions on the relationship between the explanatory variables and the individual-specific effect. In a linear model, it is possible to obtain the best of both worlds by making random effects-type assumptions on the time-invariant explanatory variables while maintaining the flexibility of a fixed effects approach when it comes to the time-varying covariates. This article attempts to do the same for some popular nonlinear models.     

Efficient Estimation in Marginal Partially Linear Models for Longitudinal/Clustered Data Using Splines

Abstract.  We consider marginal semiparametric partially linear models for longitudinal/clustered data and propose an estimation procedure based on a spline approximation of the non-parametric part of the model and an extension of the parametric marginal generalized estimating equations (GEE). Our estimates of both parametric part and non-parametric part of the model have properties parallel to those of parametric GEE, that is, the estimates are efficient if the covariance structure is correctly specified and they are still consistent and asymptotically normal even if the covariance structure is misspecified. By showing that our estimate achieves the semiparametric information bound, we actually establish the efficiency of estimating the parametric part of the model in a stronger sense than what is typically considered for GEE. The semiparametric efficiency of our estimate is obtained by assuming only conditional moment restrictions instead of the strict multivariate Gaussian error assumption.