Testing Constancy for Isotonic Regressions

Abstract.  In this paper, we propose a bootstrap method for testing the constancy of an isotonic regression. The technique we develop is completely non-parametric and enlarges the appli-cability of the classical chi-bar-squared tests, which require normality assumptions. We prove that our procedure is asymptotically correct and consistent. Moreover, by means of simulations we show that it behaves suitably in practice, and similarly to the chi-bar-squared tests under normality. Finally, we illustrate the method with the study of a real case that is well known in the related literature.     

Classification rules for two parameter exponential populations under order restrictions on parameters

In this paper, we suggest classification procedures of an observation into one of two exponential populations assuming a known ordering between population parameters. We propose classification rules when either location or scale parameters are ordered. Some of these classification rules under ordering are better than usual classification rules with respect to the expected probability of correct classification. We also derive likelihood ratio-based classification rules. Comparison of these classification rules has been done using Monte Carlo simulations.     

Testing the equality of multinomial populations ordered by increasing convexity under the alternative

The authors derive the asymptotic null distribution of the likelihood ratio statistic for testing equality of multinomial populations whose parameters are ordered by increasing convexity under the alternative. They also show how to compute critical values for the test.     

Analysis of ordered covariate effects among groups with repeated measurements

Testing procedures for ordered covariate effects are developed in the repeated measures experiment. The maximum likelihood estimators of covariate effects under the ordered hypothesis are approximated by the isotonic regression of their unconstrained estimators. The asymptotic null distributions of the test statistics are chi-bar-square distributions which are mixtures of chi-square distributions. A Monte-Carlo simulation reveals that the proposed test for ordered covariate effects is seriously more powerful than the usual chi-square test that neglects the information on the order restriction. These testing methods are applied for analyzing the effect of vitamin E diet supplement on growth rate of animals.     

Linear regression analysis with inequality constraints on the regression parameters via empirical likelihood

An empirical likelihood ratio test is developed for testing for or against inequality constraints on regression parameters in linear regression analysis. The proposed approach imposes no parametric model nor identically distributing assumption on the random errors. The asymptotic distribution of the proposed test statistic under null hypothesis is shown to be of chi-bar-squared type. The asymptotic power under contiguous alternatives is also briefly discussed. Moreover, an adjusted empirical likelihood method is adopted to improve the small sample size behaviour of the proposed test. Several simulation studies are carried out to assess the finite sample performance of the proposed tests. The results reveal that the proposed tests could be valuable for improving inference efficiency. A real-life example is discussed to illustrate the theoretical results.     

Testing randomness against ordered alternatives in a multinomial experiment with grouped frequencies

A test is derived for homogeneity of probabilities of a multi nomial trial against ordered alternatives, applicable to cases in which only the frequencies of grouped categories are known. Its asymptotic null distribution is obtained.     

Tests for the equality of multinomial parameters

In this paper we face the problem of testing the equality of two or more parameters of a multinomial distribution. We develop a likelihood ratio test and we consider an asymptotically equivalent Pearson's statistic. Moreover we develop an exact and a randomized test. Relationships between these tests are then discussed. The behaviour of these tests is studied by simulations. Results from two known tests developed for less general situations are compared to ours.     

Testing parallelism of regression lines against ordered alternatives

For the problem of testing the equality of slopes of several regression lines against the alternative that the slopes are in increasing (decreasing) order of magnitude, two types of tests are proposed. These are the likelihood ratio test and a test that depends on suitable linear combination of one group statistics. Rank analogues of the two tests are also examined.     

Estimation of odds ratios under order restrictions

A new method for estimating a set of odds ratios under an order restriction based on estimating equations is proposed. The method is applied to those of the conditional maximum likelihood estimators and the Mantel-Haenszel estimators. The estimators derived from the conditional likelihood estimating equations are shown to maximize the conditional likelihoods. It is also seen that the restricted estimators converge almost surely to the respective odds ratios when the respective sample sizes become large regularly. The restricted estimators are compared with the unrestricted maximum likelihood estimators by a Monte Carlo simulation. The simulation studies show that the restricted estimates improve the mean squared errors remarkably, while the Mantel-Haenszel type estimates are competitive with the conditional maximum likelihood estimates, being slightly worse.     

Maximum likelihood estimation for the negative multinomial log-linear model

A log-linear model is defined for multiway contingency tables with negative multinomial frequency counts. The maximum likelihood estimator of the model parameters and the estimator covariance matrix is given. The likelihood ratio test for the general log-linear hypothesis also is presented.     

Testing equality of location parameters of two exponential distributions from censored samples

A modification to Tiku's (1981) test, which may be seriously biased, is proposed. The modified test is only marginally biased if at all and is substantially more powerful. A ratio test based on Tiku’s (1967) modified likelihood function is also proposed, and shown to have power comparable to the power of the ratio test based on the likelihood function. The proposed ratio test is, however, much easier from a computational viewpoint.     

Tests for Monotonic Intensity in a Poisson Process

Likelihood ratio tests about the intensity function are obtained by confining the estimated intensity function of a Poisson process to a sample-dependent, left-continuous step function class. These tests have relatively simple test statistics and their distributions are stochastically maximized when the process is homogeneous.     

Negative exponential disparity based family of goodness-of-fit tests for multinomial models

This paper investigates a new family of goodness-of-fit tests based on the negative exponential disparities. This family includes the popular Pearson's chi-square as a member and is a subclass of the general class of disparity tests (Basu and Sarkar, 1994) which also contains the family of power divergence statistics. Pitman efficiency and finite sample power comparisons between different members of this new family are made. Three asymptotic approximations of the exact null distributions of the negative exponential disparity famiiy of tests are discussed. Some numerical results on the small sample perfomance of this family of tests are presented for the symmetric null hypothesis. It is shown that the negative exponential disparity famiiy, Like the power divergence family, produces a new goodness-of-fit test statistic that can be a very attractive alternative to the Pearson's chi-square. Some numerical results suggest that, application of this test statistic, as an alternative to Pearson's chi-square, could be preferable to the I ^2/3 statistic of Cressie and Read (1984) under the use of chi-square critical values.     

Testing the linearity of negative binomial regression models

The negative binomial (NB) is frequently used to model overdispersed Poisson count data. To study the effect of a continuous covariate of interest in an NB model, a flexible procedure is used to model the covariate effect by fixed-knot cubic basis-splines or B-splines with a second-order difference penalty on the adjacent B-spline coefficients to avoid undersmoothing. A penalized likelihood is used to estimate parameters of the model. A penalized likelihood ratio test statistic is constructed for the null hypothesis of the linearity of the continuous covariate effect. When the number of knots is fixed, its limiting null distribution is the distribution of a linear combination of independent chi-squared random variables, each with one degree of freedom. The smoothing parameter value is determined by setting a specified value equal to the asymptotic expectation of the test statistic under the null hypothesis. The power performance of the proposed test is studied with simulation experiments.     

Testing for two states in a hidden Markov model

The authors consider hidden Markov models (HMMs) whose latent process has m ≥ 2 states and whose state‐dependent distributions arise from a general one‐parameter family. They propose a test of the hypothesis m = 2. Their procedure is an extension to HMMs of the modified likelihood ratio statistic proposed by Chen, Chen & Kalbfleisch (2004) for testing two states in a finite mixture. The authors determine the asymptotic distribution of their test under the hypothesis m = 2 and investigate its finite‐sample properties in a simulation study. Their test is based on inference for the marginal mixture distribution of the HMM. In order to illustrate the additional difficulties due to the dependence structure of the HMM, they show how to test general regular hypotheses on the marginal mixture of HMMs via a quasi‐modified likelihood ratio. They also discuss two applications.     

Model selection and parameter estimation of a multinomial logistic regression model

In the multinomial regression model, we consider the methodology for simultaneous model selection and parameter estimation by using the shrinkage and LASSO (least absolute shrinkage and selection operation) [R. Tibshirani, Regression shrinkage and selection via the LASSO, J. R. Statist. Soc. Ser. B 58 (1996), pp. 267–288] strategies. The shrinkage estimators (SEs) provide significant improvement over their classical counterparts in the case where some of the predictors may or may not be active for the response of interest. The asymptotic properties of the SEs are developed using the notion of asymptotic distributional risk. We then compare the relative performance of the LASSO estimator with two SEs in terms of simulated relative efficiency. A simulation study shows that the shrinkage and LASSO estimators dominate the full model estimator. Further, both SEs perform better than the LASSO estimators when there are many inactive predictors in the model. A real-life data set is used to illustrate the suggested shrinkage and LASSO estimators.     

Generalized manova double linear hypothesis with double linear restrictions

For the generalized MANOVA model of Potthoff and Roy [7], Gleser and Olkin [3] give a likelihood ratio test criterion for testing double linear parametric functions of the regression parameters. Their theory is extended in this paper to the testing of double linear parametric functions with double linear restrictions on the parameters. The theory is presented in terms of the original variates unlike Gleser and Olkin [3] who resort to canonical transformations of the original variates.     

Multivariate Life Testing in Variably Scaled Environments

This paper examines modeling and inference questions for experiments in which different subsets of a set of k possibly dependent components are tested in r different environments. In each environment, the failure times of the set of components on test is assumed to be governed by a particular type of multivariate exponential (MVE) distribution. For any given component tested in several environments, it is assumed that its marginal failure rate varies from one environment to another via a change of scale between the environments, resulting in a joint MVE model which links in a natural way the applicable MVE distributions describing component behavior in each fixed environment. This study thus extends the work of Proschan and Sullo (1976) to multiple environments and the work of Kvam and Samaniego (1993) to dependent data. The problem of estimating model parameters via the method of maximum likelihood is examined in detail. First, necessary and sufficient conditions for the identifiability of model parameters are established. We then treat the derivation of the MLE via a numerically-augmented application of the EM algorithm. The feasibility of the estimation method is demonstrated in an example in which the likelihood ratio test of the hypothesis of equal component failure rates within any given environment is carried out.