On the Comparison of Two Ordinal Responses

Responses of two groups, measured on the same ordinal scale, are compared through the column effect association model, applied on the corresponding 2 × J contingency table. Monotonic or umbrella shaped ordering for the scores of the model are related to stochastic or umbrella ordering of the underlying response distributions, respectively. An algorithm for testing all possible hypotheses of stochastic ordering and deciding on an appropriate one is proposed.     

Overview of multinomial models for ordinal data

The purpose of this paper is to relate a number of multinomial models currently in use for ordinal response data in a unified manner. By studying generalized logit models, proportional generalized odds ratio models and proportional generalized hazard models under different parameterizations, we conclude that there are only four different models and they can be specified genericaUy in a uniform way. These four models all possess the same stochastic ordering property and we compare them graphically in a simple case. Data from the NHLBI TYPE II study (Brensike et al (1984)) is used to illustrate these models. We show that the BMDP programs LE and PR can be employed in computing maximum likelihood estimators for these four models.     

A permutation-based Bayesian approach for inverse covariance estimation

Abstract

Covariance estimation and selection for multivariate datasets in a high-dimensional regime is a fundamental problem in modern statistics. Gaussian graphical models are a popular class of models used for this purpose. Current Bayesian methods for inverse covariance matrix estimation under Gaussian graphical models require the underlying graph and hence the ordering of variables to be known. However, in practice, such information on the true underlying model is often unavailable. We therefore propose a novel permutation-based Bayesian approach to tackle the unknown variable ordering issue. In particular, we utilize multiple maximum a posteriori estimates under the DAG-Wishart prior for each permutation, and subsequently construct the final estimate of the inverse covariance matrix. The proposed estimator has smaller variability and yields order-invariant property. We establish posterior convergence rates under mild assumptions and illustrate that our method outperforms existing approaches in estimating the inverse covariance matrices via simulation studies.     

A structural model for the markov chain of change in vote intention

Assuming a first-order Markov chain, we propose a structural model for the transition probabilities in vote intention. The proposed model utilizes the ordering among the categories representing vote intentions and carries the flavor of distance models. It also allows a stochastic ordering among distributions reflecting the extent of change. The model is easy to fit and provides a nice interpretation of the data. The model is applied to a panel study of vote intention acquired through six successive interviews before the 1940 Presidential election in Erie County, Ohio.     

Ordered Regressions

There are often situations where two or more regression functions are ordered over a range of covariate values. In this paper, we develop efficient constrained estimation and testing procedures for such models. Specifically, necessary and sufficient conditions for ordering generalized linear regressions are given and shown to unify previous results obtained for simple linear regression, for polynomial regression and in the analysis of covariance models. We show that estimating the parameters of ordered linear regressions requires either quadratic programming or semi‐infinite programming, depending on the shape of the covariate space. A distance‐type test for order is proposed. Simulations demonstrate that the proposed methodology improves the mean square error and power compared with the usual, unconstrained, estimation and testing procedures. Improvements are often substantial. The methodology is extended to order generalized linear models where convex semi‐infinite programming plays a role. The methodology is motivated by, and applied to, a hearing loss study.     

A STOCHASTIC ORDERING FOR RANDOM VARIABLES WITH APPLICATIONS

A new univariate stochastic ordering is introduced. Some characterization results for such an ordering are stated. It is proved that the ordering is an integral stochastic ordering, obtaining a maximal generator. By means of this generator, the main properties of the ordering are deduced. A method for introducing univariate stochastic orderings, suggested by the new ordering, is analysed. Relationships with other stochastic orderings are also developed. To conclude, an example of an application of the new ordering to the field of medicine is proposed.     

Extensions of empirical likelihood and chi-squared-based tests for ordered alternatives

Several methods for comparing k populations have been proposed in the literature. These methods assess the same null hypothesis of equal distributions but differ in the alternative hypothesis they consider. We focus on two important alternative hypotheses: monotone and umbrella ordering. Two new families of test statistics are proposed, including two known tests, as well as two new powerful tests under monotone ordering. Furthermore, these families are adapted for testing umbrella ordering. We compare some members of the families with respect to power and Type I errors under different simulation scenarios. Finally, the methods are illustrated in several applications to real data.     

Recent History Functional Linear Models for Sparse Longitudinal Data

We consider the recent history functional linear models, relating a longitudinal response to a longitudinal predictor where the predictor process only in a sliding window into the recent past has an effect on the response value at the current time. We propose an estimation procedure for recent history functional linear models that is geared towards sparse longitudinal data, where the observation times across subjects are irregular and total number of measurements per subject is small. The proposed estimation procedure builds upon recent developments in literature for estimation of functional linear models with sparse data and utilizes connections between the recent history functional linear models and varying coefficient models. We establish uniform consistency of the proposed estimators, propose prediction of the response trajectories and derive their asymptotic distribution leading to asymptotic point-wise confidence bands. We include a real data application and simulation studies to demonstrate the efficacy of the proposed methodology.     

Robust confirmatory factor analysis based on the forward search algorithm

A key concept of the forward search algorithm in confirmatory factor analysis is ordering of the data on the basis of observational residuals. These residuals are computed under the proposed model and measure the discrepancy between the observed and predicted response for each unit of the sample. Regression-type factor scores are used to estimate model predictions. Informative forward plots are created for indexing influential observations and to show the dynamics of the estimates throughout the search. The detailed influence of each observation on the model parameters and fit indices is analyzed and a robust model inference is achieved. Real and simulated data sets with known contamination schemes are used to demonstrate the performance of the forward search algorithm.     

Stochastic comparisons between extreme order statistics from scale models

Stochastic ordering relations between extreme order statistics from exponential, Weibull and gamma distributions have been studied extensively by many researchers in recent years. In this work, we obtain various ordering results for the comparisons of two extreme order statistics from scale models when one set of scale parameters majorizes the other. The new results obtained here are applied when the baseline distributions are exponentiated Weibull or generalized gamma distributions. In this way, we generalize and extend some results established recently in the literature.     

Extended zero-one inflated beta and adjusted three-part regression models for proportional data analysis

Extended zero-one inflated beta and adjusted three-part regression models are introduced to analyze proportional response data where there are nonzero probabilities that the response variable takes the values zero and one. The proposed models adapt skewness and heteroscedasticity of the fractional response data, and are constructed to estimate the unknown parameters. Extensive Monte Carlo simulation studies are used to compare the performance of the two approaches with respect to bias and root mean square error. A real data example is presented to illustrate the application of both regression models.     

A permutation test for umbrella alternatives

There is a wide variety of stochastic ordering problems where K groups (typically ordered with respect to time) are observed along with a (continuous) response. The interest of the study may be on finding the change-point group, i.e. the group where an inversion of trend of the variable under study is observed. A change point is not merely a maximum (or a minimum) of the time-series function, but a further requirement is that the trend of the time-series is monotonically increasing before that point, and monotonically decreasing afterwards. A suitable solution can be provided within a conditional approach, i.e. by considering some suitable nonparametric combination of dependent tests for simple stochastic ordering problems. The proposed procedure is very flexible and can be extended to trend and/or repeated measure problems. Some comparisons through simulations and examples with the well known Mack & Wolfe test for umbrella alternative and with Page’s test for trend problems with correlated data are investigated.     

Robust quasi-randomization-based estimation with ensemble learning for missing data

Missing data analysis requires assumptions about an outcome model or a response probability model to adjust for potential bias due to nonresponse. Doubly robust (DR) estimators are consistent if at least one of the models is correctly specified. Multiply robust (MR) estimators extend DR estimators by allowing for multiple models for both the outcome and/or response probability models and are consistent if at least one of the multiple models is correctly specified. We propose a robust quasi-randomization-based model approach to bring more protection against model misspecification than the existing DR and MR estimators, where any multiple semiparametric, nonparametric or machine learning models can be used for the outcome variable. The proposed estimator achieves unbiasedness by using a subsampling Rao–Blackwell method, given cell-homogenous response, regardless of any working models for the outcome. An unbiased variance estimation formula is proposed, which does not use any replicate jackknife or bootstrap methods. A simulation study shows that our proposed method outperforms the existing multiply robust estimators.     

On tail-ordering and comparison of failure rates

In this paper, we have studied some implications between tail-ordering (also known as dispersive ordering) and failure rate ordering (also called TP₂ ordering) of two probability distribution functions. Based on independent random samples from these distributions, a class of distribution-free tests has been proposed for testing the null hypothesis that the two life distributions are identical against the alternative that one failure rate is uniformly smaller than the other. The tests have good efficiencies as compared to their competitors.     

Multivariate partially linear single-index models: Bayesian analysis

Partially linear single-index models play important roles in advanced non-/semi-parametric statistics due to their generality and flexibility. We generalise these models from univariate response to multivariate responses. A Bayesian method with free-knot spline is used to analyse the proposed models, including the estimation and the prediction, and a Metropolis-within-Gibbs sampler is provided for posterior exploration. We also utilise the partially collapsed idea in our algorithm to speed up the convergence. The proposed models and methods of analysis are demonstrated by simulation studies and are applied to a real data set.     

Order restricted inference for multivariate binary data with application to toxicology

In many applications researchers collect multivariate binary response data under two or more, naturally ordered, experimental conditions. In such situations one is often interested in using all binary outcomes simultaneously to detect an ordering among the experimental conditions. To make such comparisons we develop a general methodology for testing for the multivariate stochastic order between K ≥ 2 multivariate binary distributions. The proposed test uses order restricted estimators which, according to our simulation study, are more efficient than the unrestricted estimators in terms of mean squared error. The power of the proposed test was compared with several alternative tests. These included procedures which combine individual univariate tests for order, such as union intersection tests and a Bonferroni based test. We also compared the proposed test with unrestricted Hotelling's T(2) type test. Our simulations suggest that the proposed method competes well with these alternatives. The gain in power is often substantial. The proposed methodology is illustrated by applying it to a two-year rodent cancer bioassay data obtained from the US National Toxicology Program (NTP). Supplemental materials are available online.     

Multiplicative-interaction logit models for i×j×2 three-way tables

Multiplicative-interaction (M-I) logit models are proposed for three-way IxJx2 contingency tables where the third variable constitutes a binary response. Models are derived by assigning unknown scores to the categories and forming product interactions from them. Asymptotic results under special sampling constraints are derived for maximum likelihood estimates and the goodness-of-fit statistics. The class of models proposed in this paper are found to be useful when no obvious scores are available. An example is included.     

Penalised spline estimation for generalised partially linear single-index models

Generalised linear models are frequently used in modeling the relationship of the response variable from the general exponential family with a set of predictor variables, where a linear combination of predictors is linked to the mean of the response variable. We propose a penalised spline (P-spline) estimation for generalised partially linear single-index models, which extend the generalised linear models to include nonlinear effect for some predictors. The proposed models can allow flexible dependence on some predictors while overcome the “curse of dimensionality”. We investigate the P-spline profile likelihood estimation using the readily available R package mgcv, leading to straightforward computation. Simulation studies are considered under various link functions. In addition, we examine different choices of smoothing parameters. Simulation results and real data applications show effectiveness of the proposed approach. Finally, some large sample properties are established.     

A Bayesian multivariate partially linear single-index probit model for ordinal responses

Combining the multivariate probit models with the multivariate partially linear single-index models, we propose new semiparametric latent variable models for multivariate ordinal response data. Based on the reversible jump Markov chain Monte Carlo technique, we develop a fully Bayesian method with free-knot splines to analyse the proposed models. To address the problem that the ordinary Gibbs sampler usually converges slowly, we make use of the partial-collapse and parameter-expansion techniques in our algorithm. The proposed methodology are demonstrated by simulated and real data examples.     

Rank repeated measures analysis of covariance

When analyzing a response variable at the presence of both factors and covariates, with potentially correlated responses and violated assumptions of the normal residual or the linear relationship between the response and the covariates, rank-based tests can be an option for inferential procedures instead of the parametric repeated measures analysis of covariance (ANCOVA) models. This article derives a rank-based method for multi-way ANCOVA models with correlated responses. The generalized estimating equations (GEE) technique is employed to construct the proposed rank tests. Asymptotic properties of the proposed tests are derived. Simulation studies confirmed the performance of the proposed tests.