On the wald,lagrangian multiplier and likelihood ratio tests when the information matrix is singular

Summary Modified formulas for the Wald and Lagrangian multiplier statistics are introduced and considered together with the likelihood ratio statistics for testing a typical null hypothesisH ₀ stated in terms of equality constraints. It is demonstrated, subject to known standard regularity conditions, that each of these statistics and the known Wald statistic has the asymptotic chi-square distribution with degrees of freedom equal to the number of equality constraints specified byH ₀ whether the information matrix is singular or nonsingular. The results of this paper include a generalization of the results of Sively (1959) concerning the equivalence of the Wald, Lagrange multiplier and likelihood ratio tests to the case of singular information matrices.     

Optimal design results for 2n factorial paired comparison experiments

Four general classes of partially balanced designs for 2ⁿ factorials, corresponding to four different forms of a general null hypothesis H on factorial effects, are presented. For the typical design in each class, the simplified form of the non-centrality parameter λ² of the asymptotic chi-square distribution of the likelihood ratio statistic for testing the corresponding form of H₀ is derived under defined local alternatives. Optimal designs d₁ maximizing λ² in the i-th class and minimizing the trace, determinant and largest eigenvalue of a defined covariance matrix, i =1,…,4, are determined.     

Generalized likelihood-ratio test of the number of components in finite mixture models

The number of components is an important feature in finite mixture models. Because of the irregularity of the parameter space, the log-likelihood-ratio statistic does not have a chi-square limit distribution. It is very difficult to find a test with a specified significance level, and this is especially true for testing k — 1 versus k components. Most of the existing work has concentrated on finding a comparable approximation to the limit distribution of the log-likelihood-ratio statistic. In this paper, we use a statistic similar to the usual log likelihood ratio, but its null distribution is asymptotically normal. A simulation study indicates that the method has good power at detecting extra components. We also discuss how to improve the power of the test, and some simulations are performed.     

Optimal designs for asymmetrical factorial paired comparison experiments

Three forms of a general null hypothesis Ho on the factorial parameters of a general asymmetrical factorial paired comparison experiment are considered. A class of partially balanced designscorresponding to each form of H₀ is constructed and the A,D and ioptimal design, minimizing the trace, determinant and largest eigenvalue of a defined covariance matrix of related maximumlikelihoodestimators, in that class is determined. Moreover, the optimal design in each class maximizes the noncentrality parameter λ² of the asymptotic noncentral chi-square distribution of the likelihood ratiostatistic -2 log λ for testing H_o under defined local alternatives. These results apply directly to symmetrical factorial paired comparison experiments as special casesExamples are given forillustrating applications of the developed results     

ASYMPTOTIC AND SMALL SAMPLE STATISTICAL PROPERTIES OF RANDOM FRAILTY VARIANCE ESTIMATES FOR SHARED GAMMA FRAILTY MODELS

This paper concerns maximum likelihood estimation for the semiparametric shared gamma frailty model; that is the Cox proportional hazards model with the hazard function multiplied by a gamma random variable with mean 1 and variance θ. A hybrid ML-EM algorithm is applied to 26 400 simulated samples of 400 to 8000 observations with Weibull hazards. The hybrid algorithm is much faster than the standard EM algorithm, faster than standard direct maximum likelihood (ML, Newton Raphson) for large samples, and gives almost identical results to the penalised likelihood method in S-PLUS 2000. When the true value θ₀ of θ is zero, the estimates of θ are asymptotically distributed as a 50–50 mixture between a point mass at zero and a normal random variable on the positive axis. When θ₀ > 0, the asymptotic distribution is normal. However, for small samples, simulations suggest that the estimates of θ are approximately distributed as an x ? (100 ? x)% mixture, 0 ≤ x ≤ 50, between a point mass at zero and a normal random variable on the positive axis even for θ₀ > 0. In light of this, p-values and confidence intervals need to be adjusted accordingly. We indicate an approximate method for carrying out the adjustment.     

THE LIMITING FORM OF THE NON-CENTRAL WISHART DISTRIBUTION1,2

Let S (p×p) have a Wishart distribution -with v degrees of freedom and non-centrality matrix θ= [θ_jK] (p×p). Define θ₀= min {| θ_jk |}, let θ₀→∞, and suppose that | θ_jK | = 0(θ_o). Then the limiting form of the standardized non-central distribution, as θ while n? remains fixed, is a multivariate Gaussian distribution. This result in turn is used to obtain known asymptotic properties of multivariate chi-square and Rayleigh distributions under somewhat weaker conditions.     

Testing Goodness of Fit for Parametric Families of Copulas—Application to Financial Data

ABSTRACT

This article suggests a chi-square test of fit for parametric families of bivariate copulas. The marginal distribution functions are assumed to be unknown and are estimated by their empirical counterparts. Therefore, the standard asymptotic theory of the test is not applicable, but we derive a rule for the determination of the appropriate degrees of freedom in the asymptotic chi-square distribution. The behavior of the test under H ₀ and for selected alternatives is investigated by Monte Carlo simulation. The test is applied to investigate the dependence structure of daily German asset returns. It turns out that the Gauss copula is inappropriate to describe the dependencies in the data. A t _ν-copula with low degrees of freedom performs better.     

Goodness-of-fit test for uniform stochastic ordering among several distributions

The likelihood-ratio test (LRT) is considered as a goodness-of-fit test for the null hypothesis that several distribution functions are uniformly stochastically ordered. Under the null hypothesis, H₁ : F₁ ? F₂ ?···? F_N, the asymptotic distribution of the LRT statistic is a convolution of several chi-bar-square distributions each of which depends upon the location parameter. The least-favourable parameter configuration for the LRT is not unique. It can be two different types and depends on the number of distributions, the number of intervals and the significance level α. This testing method is illustrated with a data set of survival times of five groups of male fruit flies.     

Large sample interval mapping method for genetic trait loci in finite regression mixture models

This article investigates the large sample interval mapping method for genetic trait loci (GTL) in a finite non-linear regression mixture model. The general model includes most commonly used kernel functions, such as exponential family mixture, logistic regression mixture and generalized linear mixture models, as special cases. The populations derived from either the backcross or intercross design are considered. In particular, unlike all existing results in the literature in the finite mixture models, the large sample results presented in this paper do not require the boundness condition on the parametric space. Therefore, the large sample theory presented in this article possesses general applicability to the interval mapping method of GTL in genetic research. The limiting null distribution of the likelihood ratio test statistics can be utilized easily to determine the threshold values or p-values required in the interval mapping. The limiting distribution is proved to be free of the parameter values of null model and free of the choice of a kernel function. Extension to the multiple marker interval GTL detection is also discussed. Simulation study results show favorable performance of the asymptotic procedure when sample sizes are moderate.     

An exact decomposition for a class of exponential dispersion models: Application to sequential testing

We define the Wishart distribution on the cone of positive definite matrices and an exponential distribution on the Lorentz cone as exponential dispersion models. We show that these two distributions possess a property of exact decomposition, and we use this property to solve the following problem: given q samples (y_il,… y_iNj), i = l,…,q, from a N(μ_i,Σ_i,) distribution, test H:Σ₁ = Σ₂ = … = σ_q. Using the exact decomposition property, the classical test statistic for H, involving q parameters p_i = (N_i, - l)/2, i = 1,…,q, is replaced by a sequence of q - l test statistics for the sequence of tests H_i,:σ₁ =σ₂ = … =σ_i given that H_i-1 is true, i = 2,…,q. Each one of these test statistics involves two parameters only, p._i-1 = p₁ + … + p_i-1 and p_i. We also use the exact decomposition property to test equality of the “direction parameters” for q sample points from the exponential distribution on the Lorentz cone. We give a table of critical values for the distribution on the three-dimensional Lorentz cone. Tables of critical values in higher dimensions can easily be computed following the same method as in dimension three.     

Empirical likelihood ratio tests for the linear regression model with inequality constraints

Abstract

In this article, empirical likelihood is applied to the linear regression model with inequality constraints. We prove that asymptotic distribution of the adjusted empirical likelihood ratio test statistic is a weighted mixture of chi-square distribution.     

Maximum Likelihood Estimation in the Bivariate Binomial (0,1) Distribution:Application TO 2×2 Tables

We consider a 2×2 contingency table, with dichotomized qualitative characters (A,A) and (B,B), as a sample of size n drawn from a bivariate binomial (0,1) distribution. Maximum likelihood estimates p?₁p?₂ and p? are derived for the parameters of the two marginals p₁p₂ and the coefficient of correlation. It is found that p? is identical to Pearson's (1904)?=(χ²/n)½, where ?² is Pearson's usual chi-square for the 2×2 table. The asymptotic variance-covariance matrix of p?_lp?₂and p is also derived.     

Standard Exponential Cure Rate Model with Noninformative or Informative Uniform-Exponential Censoring

In survival data analysis it is frequent the occurrence of a significant amount of censoring to the right indicating that there may be a proportion of individuals in the study for which the event of interest will never happen. This fact is not considered by the ordinary survival theory. Consequently, the survival models with a cure fraction have been receiving a lot of attention in the recent years. In this article, we consider the standard mixture cure rate model where a fraction p ₀ of the population is of individuals cured or immune and the remaining 1 ? p ₀ are not cured. We assume an exponential distribution for the survival time and an uniform-exponential for the censoring time. In a simulation study, the impact caused by the informative uniform-exponential censoring on the coverage probabilities and lengths of asymptotic confidence intervals is analyzed by using the Fisher information and observed information matrices.     

Testing for and against a set of linear inequality constraints in a multinomial setting

There are numerous situations in categorical data analysis where one wishes to test hypotheses involving a set of linear inequality constraints placed upon the cell probabilities. For example, it may be of interest to test for symmetry in k × k contingency tables against one-sided alternatives. In this case, the null hypothesis imposes a set of linear equalities on the cell probabilities (namely p_ij = P_ji ×i > j), whereas the alternative specifies directional inequalities. Another important application (Robertson, Wright, and Dykstra 1988) is testing for or against stochastic ordering between the marginals of a k × k contingency table when the variables are ordinal and independence holds. Here we extend existing likelihood-ratio results to cover more general situations. To be specific, we consider testing H_t,0 against H₁ - H₀ and H₁ against H₂ - H ₁ when H₀:k × i=1 p_ix_ji = 0, j = 1,…, s, H₁:k × i=1 p_ix_ji × 0, j = 1,…, s, and does not impose any restrictions on p. The x_ji's are known constants, and s × k - 1. We show that the asymptotic distributions of the likelihood-ratio tests are of chi-bar-square type, and provide expressions for the weighting values.     

A class of tests for testing ‘new is better than used’

A class of tests is proposed for testing H₀ F?(x) = e^?λx, λ > 0, x≥0 vs. H₁ F?(x + y) ≤ F?(x)F?(y), x, y≥0, with strict inequality for some x, y ≥ 0 (F = new is better than used). Efficiency comparisons of some tests within the class are made and a new test is proposed on the basis of these comparisons. Consistency and the asymptotic normality of the class of tests is proved under fairly broad conditions on the underlying entities.     

Estimates of the parameters of type-II extreme value distribution from censored samples

Maximum likelihood estimators of a Type-II extreme value distribution are derived from doubly censored samples. The asymptotic variances and covariances of the maximum likelihood estimators are discussed and these are numerically evaluated for different censoring proportions q₁ = 0.0(0. l) (0.9) from below and q₂ = 0.0 (0. l) (0.9- q₁) from above. The asymptotic relative efficiencies of the parameter estimates revealed that lower order statistics are more important for estimating the parameters of Type-II extreme value distribution as compared to higher order statistics.     

An Estimator of the Exponent of Regular Variation Based on K-Record Values

Let {X _n:n ≥ 1} be an i.i.d. sequence of random variables with a continuous distribution function F. Under the assumption that the upper tail of Fis regularly varying with exponent 1/α, α > 0, we study the asymptotic properties of an estimator of α based on k-record values.     

Profile likelihood approaches for semiparametric copula and frailty models for clustered survival data

ABSTRACT

In clustered survival data, the dependence among individual survival times within a cluster has usually been described using copula models and frailty models. In this paper we propose a profile likelihood approach for semiparametric copula models with different cluster sizes. We also propose a likelihood ratio method based on profile likelihood for testing the absence of association parameter (i.e. test of independence) under the copula models, leading to the boundary problem of the parameter space. For this purpose, we show via simulation study that the proposed likelihood ratio method using an asymptotic chi-square mixture distribution performs well as sample size increases. We compare the behaviors of the two models using the profile likelihood approach under a semiparametric setting. The proposed method is demonstrated using two well-known data sets.     

Approximations for marginal densities of M-estimators

We develop a saddle-point approximation for the marginal density of a real-valued function p(), where is a general M-estimator of a p-dimensional parameter, that is, the solution of the system {n^-1_ljl (Y_l,) = 0}_j=1,…,p. The approximation is applied to several regression problems and yields very good accuracy for small samples. This enables us to compare different classes of estimators according to their finite-sample properties and to determine when asymptotic approximations are useful in practice.     

SELECTION PROCEDURES FOR SCALE PARAMETERS USING TWO-SAMPLE U-STATISTICS

Let be k independent populations having the same known quantile of order p (0 p 1) and let F(x)=F(x/_i) be the absolutely continuous cumulative distribution function of the ith population indexed by the scale parameter ₁, i = 1,…, k. We propose subset selection procedures based on two-sample U-statistics for selecting a subset of k populations containing the one associated with the smallest scale parameter. These procedures are compared with the subset selection procedures based on two-sample linear rank statistics given by Gill & Mehta (1989) in the sense of Pitman asymptotic relative efficiency, with interesting results.