Missing data mechanisms and their implications on the analysis of categorical data

We review some issues related to the implications of different missing data mechanisms on statistical inference for contingency tables and consider simulation studies to compare the results obtained under such models to those where the units with missing data are disregarded. We confirm that although, in general, analyses under the correct missing at random and missing completely at random models are more efficient even for small sample sizes, there are exceptions where they may not improve the results obtained by ignoring the partially classified data. We show that under the missing not at random (MNAR) model, estimates on the boundary of the parameter space as well as lack of identifiability of the parameters of saturated models may be associated with undesirable asymptotic properties of maximum likelihood estimators and likelihood ratio tests; even in standard cases the bias of the estimators may be low only for very large samples. We also show that the probability of a boundary solution obtained under the correct MNAR model may be large even for large samples and that, consequently, we may not always conclude that a MNAR model is misspecified because the estimate is on the boundary of the parameter space.     

Robust nonparametric estimation of the intensity function of point data

Intensity functions—which describe the spatial distribution of the occurrences of point processes—are useful for risk assessment. This paper deals with the robust nonparametric estimation of the intensity function of space–time data from events such as earthquakes. The basic approach consists of smoothing the frequency histograms with the local polynomial regression (LPR) estimator. This method allows for automatic boundary corrections, and its jump-preserving ability can be improved with robustness. We derive a robust local smoother from the weighted-average approach to M-estimation and we select its bandwidths with robust cross-validation (RCV). Further, we develop a robust recursive algorithm for sequential processing of the data binned in time. An extensive application to the Northern California earthquake catalog in the San Francisco, CA, area illustrates the method and proves its validity.     

GEE estimation of the covariance structure of a bivariate panel data model with an application to wage dynamics and the incidence of profit-sharing in West Germany

We propose a generalized estimating equations (GEE) approach to the estimation of the mean and covariance structure of bivariate time series processes of panel data. The one-step approach allows for mixed continuous and discrete dependent variables. A Monte Carlo Study is presented to compare our particular GEE estimator with more standard GEE-estimators. In the empirical illustration, we apply our estimator to the analysis of individual wage dynamics and the incidence of profit-sharing in West Germany. Our findings show that time-invariant unobserved individual ability jointly influences individual wages and participation in profit sharing schemes.     

A stable estimator of the information matrix under EM for dependent data

This article develops a new and stable estimator for information matrix when the EM algorithm is used in maximum likelihood estimation. This estimator is constructed using the smoothed individual complete-data scores that are readily available from running the EM algorithm. The method works for dependent data sets and when the expectation step is an irregular function of the conditioning parameters. In comparison to the approach of Louis (J. R. Stat. Soc., Ser. B 44:226–233, 1982), this new estimator is more stable and easier to implement. Both real and simulated data are used to demonstrate the use of this new estimator.     

Finite mixtures of matrix normal distributions for classifying three-way data

Matrix-variate distributions represent a natural way for modeling random matrices. Realizations from random matrices are generated by the simultaneous observation of variables in different situations or locations, and are commonly arranged in three-way data structures. Among the matrix-variate distributions, the matrix normal density plays the same pivotal role as the multivariate normal distribution in the family of multivariate distributions. In this work we define and explore finite mixtures of matrix normals. An EM algorithm for the model estimation is developed and some useful properties are demonstrated. We finally show that the proposed mixture model can be a powerful tool for classifying three-way data both in supervised and unsupervised problems. A simulation study and some real examples are presented.     

Goodness-of-fit tests via ϕ-measures of divergence for censored data

Measures of divergence or discrepancy are used extensively in statistics in various fields. In this article, we are focusing on divergence measures that are based on a class of measures known as Csiszar's divergence measures. In particular, we propose a class of goodness-of-fit tests based on Csiszar's class of measures designed for censored survival or reliability data. Further, we derive the asymptotic distribution of the test statistic under simple and composite null hypotheses as well as under contiguous alternative hypotheses. Simulations are furnished and real data are analysed to show the performance of the proposed tests for different ?-divergence measures.     

Confidence regions for the stationary point of a quadratic response surface based on the asymptotic distribution of its MLE

Response surface methodology aims at finding the combination of factor levels which optimizes a response variable. A second order polynomial model is typically employed to make inference on the stationary point of the true response function. A suitable reparametrization of the polynomial model, where the coordinates of the stationary point appear as the parameter of interest, is used to derive unconstrained confidence regions for the stationary point. These regions are based on the asymptotic normal approximation to the sampling distribution of the maximum likelihood estimator of the stationary point. A simulation study is performed to evaluate the coverage probabilities of the proposed confidence regions. Some comparisons with the standard confidence regions due to Box and Hunter are also showed.     

Assessing the impact of initial nonresponse and attrition in the analysis of unemployment duration with panel surveys

We show how register data combined at person-level with survey data can be used to conduct a novel type of nonresponse analysis in a panel survey. The availability of register data provides a unique opportunity to directly test the type of the missingness mechanism as well as estimate the size of bias due to initial nonresponse and attrition. We are also able to study in-depth the determinants of initial nonresponse and attrition. We use the Finnish subset of the European Community Household Panel (FI ECHP) data combined with register panel data and unemployment spells as outcome variables of interest. Our results show that initial nonresponse and attrition are clearly different processes driven by different background variables. Both the initial nonresponse and attrition mechanisms are nonignorable with respect to analysis of unemployment spells. Finally, our results suggest that initial nonresponse may play a role at least as important as attrition in causing bias. This result challenges the common view of attrition being the main threat to the value of panel data.     

Improved auxiliary mixture sampling for hierarchical models of non-Gaussian data

The article considers Bayesian analysis of hierarchical models for count, binomial and multinomial data using efficient MCMC sampling procedures. To this end, an improved method of auxiliary mixture sampling is proposed. In contrast to previously proposed samplers the method uses a bounded number of latent variables per observation, independent of the intensity of the underlying Poisson process in the case of count data, or of the number of experiments in the case of binomial and multinomial data. The bounded number of latent variables results in a more general error distribution, which is a negative log-Gamma distribution with arbitrary integer shape parameter. The required approximations of these distributions by Gaussian mixtures have been computed. Overall, the improvement leads to a substantial increase in efficiency of auxiliary mixture sampling for highly structured models. The method is illustrated for finite mixtures of generalized linear models and an epidemiological case study.     

Distribution of the mean reversion estimator in the Ornstein–Uhlenbeck process

ABSTRACT

We derive the exact distribution of the maximum likelihood estimator of the mean reversion parameter (κ) in the Ornstein–Uhlenbeck process using numerical integration through analytical evaluation of a joint characteristic function. Different scenarios are considered: known or unknown drift term, fixed or random start-up value, and zero or positive κ. Monte Carlo results demonstrate the remarkably reliable performance of our exact approach across all the scenarios. In comparison, misleading results may arise under the asymptotic distributions, including the advocated infill asymptotic distribution, which performs poorly in the tails when there is no intercept in the regression and the starting value of the process is nonzero.     

A semi-parametric method for transforming data to normality

A non-parametric transformation function is introduced to transform data to any continuous distribution. When transformation of data to normality is desired, the use of a suitable parametric pre-transformation function improves the performance of the proposed non-parametric transformation function. The resulting semi-parametric transformation function is shown empirically, via a Monte Carlo study, to perform at least as well as any parametric transformation currently available in the literature.     

Non parametric estimation of the structural expectation of a stochastic increasing function

This article introduces a non parametric warping model for functional data. When the outcome of an experiment is a sample of curves, data can be seen as realizations of a stochastic process, which takes into account the variations between the different observed curves. The aim of this work is to define a mean pattern which represents the main behaviour of the set of all the realizations. So, we define the structural expectation of the underlying stochastic function. Then, we provide empirical estimators of this structural expectation and of each individual warping function. Consistency and asymptotic normality for such estimators are proved.     

Inference for the common mean of several Birnbaum–Saunders populations

The Birnbaum–Saunders distribution is a widely used distribution in reliability applications to model failure times. For several samples from possible different Birnbaum–Saunders distributions, if their means can be considered as the same, it is of importance to make inference for the common mean. This paper presents procedures for interval estimation and hypothesis testing for the common mean of several Birnbaum–Saunders populations. The proposed approaches are hybrids between the generalized inference method and the large sample theory. Some simulation results are conducted to present the performance of the proposed approaches. The simulation results indicate that our proposed approaches perform well. Finally, the proposed approaches are applied to analyze a real example on the fatigue life of 6061-T6 aluminum coupons for illustration.     

Advances in structural equation modeling—the 2009 meeting of the working group SEM

This editorial introduces the Special Issue “Advances in Structural Equation Modeling” which provides a snapshot of the different research activities performed by members of the working group “Structural Equation Modeling”. More specifically, this issue contains a selection of papers presented at the 2009 annual meeting in Berlin at Humboldt University.     

An extension of the Blinder–Oaxaca decomposition to nonlinear models

This paper develops a general Blinder–Oaxaca decomposition that allows the differences in an outcome variable between two groups to be decomposed into (i) a part that is explained by differences in observed characteristics and (ii) a part attributable to differences in the estimated coefficients also for nonlinear regression models. Based on this general model, we show how it can be applied to different models with discrete and limited dependent variables.     

Asymmetry models for square contingency tables: exact tests via algebraic statistics

Square contingency tables with the same row and column classification occur frequently in a wide range of statistical applications, e.g. whenever the members of a matched pair are classified on the same scale, which is usually ordinal. Such tables are analysed by choosing an appropriate loglinear model. We focus on the models of symmetry, triangular, diagonal and ordinal quasi symmetry. The fit of a specific model is tested by the chi-squared test or the likelihood-ratio test, where p-values are calculated from the asymptotic chi-square distribution of the test statistic or, if this seems unjustified, from the exact conditional distribution. Since the calculation of exact p-values is often not feasible, we propose alternatives based on algebraic statistics combined with MCMC methods.     

On the Kullback–Leibler information of hybrid censored data

ABSTRACT

A hybrid censoring is a mixture of Type I and Type II censoring where the experiment terminates when either rth failure or predetermined censoring time comes first or later. In this article, we consider order statistics of the Type I censored data and provide a simple expression for their Kullback–Leibler (KL) information. Then, we provide the expressions for the KL information of the Type I and Type II hybrid censored data.     

Maximum of the weighted Kaplan–Meier tests for the two-sample censored data

In this paper, some versatile test procedures are considered, which are useful for the case where the association of survival functions is unclear. These procedures are based on a maximum of a class of the weighted Kaplan–Meier statistics. The weight functions used in the procedures account for both the censored and non-censored data points. Numerical simulations with these weight functions show that, under various levels of censoring, the proposed procedures perform well across a wide range of alternative configurations. Implementation of the proposed procedures is illustrated in a real data example.