Discriminating among Weibull,log-normal,and log-logistic distributions

In this article, we consider the problem of the model selection/discrimination among three different positively skewed lifetime distributions. All these three distributions, namely; the Weibull, log-normal, and log-logistic, have been used quite effectively to analyze positively skewed lifetime data. In this article, we have used three different methods to discriminate among these three distributions. We have used the maximized likelihood method to choose the correct model and computed the asymptotic probability of correct selection. We have further obtained the Fisher information matrices of these three different distributions and compare them for complete and censored observations. These measures can be used to discriminate among these three distributions. We have also proposed to use the Kolmogorov–Smirnov distance to choose the correct model. Extensive simulations have been performed to compare the performances of the three different methods. It is observed that each method performs better than the other two for some distributions and for certain range of parameters. Further, the loss of information due to censoring are compared for these three distributions. The analysis of a real dataset has been performed for illustrative purposes.     

Discriminating between the Weibull and log-normal distributions for Type-II censored data

Log-normal and Weibull distributions are the two most popular distributions for analysing lifetime data. In this paper, we consider the problem of discriminating between the two distribution functions. It is assumed that the data are coming either from log-normal or Weibull distributions and that they are Type-II censored. We use the difference of the maximized log-likelihood functions, in discriminating between the two distribution functions. We obtain the asymptotic distribution of the discrimination statistic. It is used to determine the probability of correct selection in this discrimination process. We perform some simulation studies to observe how the asymptotic results work for different sample sizes and for different censoring proportions. It is observed that the asymptotic results work quite well even for small sizes if the censoring proportions are not very low. We further suggest a modified discrimination procedure. Two real data sets are analysed for illustrative purposes.     

Discriminating between generalized exponential,geometric extreme exponential and Weibull distributions

Generalized exponential, geometric extreme exponential and Weibull distributions are three non-negative skewed distributions that are suitable for analysing lifetime data. We present diagnostic tools based on the likelihood ratio test (LRT) and the minimum Kolmogorov distance (KD) method to discriminate between these models. Probability of correct selection has been calculated for each model and for several combinations of shape parameters and sample sizes using Monte Carlo simulation. Application of LRT and KD discrimination methods to some real data sets has also been studied.     

Discriminating between the generalized Rayleigh and Weibull distributions

Generalized Rayleigh (GR) and Weibull (WE) distributions are used quite effectively for analysing skewed lifetime data. In this paper, we consider the problem of selecting either GR or WE distribution as a more appropriate fitting model for a given data set. We use the ratio of maximized likelihoods (RML) for discriminating between the two distributions. The asymptotic and simulated distributions of the logarithm of the RML are applied to determine the probability of correctly selecting between these two families of distributions. It is examined numerically that the asymptotic results work quite well even for small sample sizes. A real data set involving the annual rainfall recorded at Los Angeles Civic Center during 25 years is analysed to illustrate the procedures developed here.     

The likelihood ratio under noncontiguous alternatives

The asymptotic distribution of the likelihood ratio under noncontiguous alternatives is shown to be normal for the exponential family of distributions. The rate of convergence of the parameters to the hypothetical value is specified where the asymptotic noncentral chi-square distribution no longer holds. It is only a little slower than $\O\left( {n^{ - \frac{1}{2}} } \right)$. The result provides compact power approximation formulae and is shown to work reasonably well even for moderate sample sizes.     

An Approximation for the Test of the Equality of the Smallest Eigenvalues of a Covariance Matrix

A limiting distribution of the likelihood ratio statistic for the test of the equality of the q smallest eigenvalues of a covariance matrix is obtained. This distribution can be used as an alternative to the chi-squared distribution which is usually used with this test. It is shown that this new method yields reasonable significance levels for those situations in which the chi-squared approximation is inadequate.     

Test for the existence of finite moments via bootstrap

This paper develops a bootstrap hypothesis test for the existence of finite moments of a random variable, which is nonparametric and applicable to both independent and dependent data. The test is based on a property in bootstrap asymptotic theory, in which the m out of n bootstrap sample mean is asymptotically normal when the variance of the observations is finite. Consistency of the test is established. Monte Carlo simulations are conducted to illustrate the finite sample performance and compare it with alternative methods available in the literature. Applications to financial data are performed for illustration.     

Objective Bayesian Inference for the Half-Normal and Half-t Distributions

In this article, Bayesian inference for the half-normal and half-t distributions using uninformative priors is considered. It is shown that exact Bayesian inference can be undertaken for the half-normal distribution without the need for Gibbs sampling. Simulation is then used to compare the sampling properties of Bayesian point and interval estimators with those of their maximum likelihood based counterparts. Inference for the half-t distribution based on the use of Gibbs sampling is outlined, and an approach to model comparison based on the use of Bayes factors is discussed. The fitting of the half-normal and half-t models is illustrated using real data on the body fat measurements of elite athletes.     

Testing for the mean of the inverse gaussian distribution and adaptive estimation of parameters

This paper provides the modified likelihood ratio criterion for testing whether the mean of the inverse Gaussian distribution can be set to unity giving rise to Standard form of the Wald distribution. Estimates of probability of correct selection has been obtained on the basis of a Monte Carlo study of 1,000 samples. Finally a set of adaptive estimators for the parameters are proposed and studied on the basis of data generated from the two distributions.     

Bootstrap Method for Order Statistics and Modeling Study of the Air Pollution

In this article, the block maxima (BM) and the peak over threshold (POT) methods are used to model the air pollution. A simulation technique is suggested to choose a suitable threshold value. The validity of the estimated models is checked by the Kolmogorov–Smirnov (K-S) test. A new efficient approach for modeling extreme values is suggested. Finally, the inconsistency and weak consistency of bootstrapping central and intermediate order statistics for an appropriate choice of re-sample size are investigated.     

Powerful goodness-of-fit tests based on the likelihood ratio

Summary. A new approach of parameterization is proposed to construct a general goodness-of-fit test. It can not only generate traditional tests (including the Kolmogorov–Smirnov, Cramér–von Mises and Anderson–Darling tests) but also produce new types of omnibus tests, which are generally much more powerful than the old ones.     

Goodness-of-fit tests based on the distance between the Dirichlet process and its base measure

The Dirichlet process is a fundamental tool in studying Bayesian nonparametric inference. The Dirichlet process has several sum representations, where each one of these representations highlights some aspects of this important process. In this paper, we use the sum representations of the Dirichlet process to derive explicit expressions that are used to calculate Kolmogorov, Lévy, and Cramér–von Mises distances between the Dirichlet process and its base measure. The derived expressions of the distance are used to select a proper value for the concentration parameter of the Dirichlet process. These tools are also used in a goodness-of-fit test. Illustrative examples and simulation results are included.     

A density-based empirical likelihood ratio goodness-of-fit test for the Rayleigh distribution and power comparison

The Rayleigh distribution has been used to model right skewed data. Rayleigh [On the resultant of a large number of vibrations of the some pitch and of arbitrary phase. Philos Mag. 1880;10:73–78] derived it from the amplitude of sound resulting from many important sources. In this paper, a new goodness-of-fit test for the Rayleigh distribution is proposed. This test is based on the empirical likelihood ratio methodology proposed by Vexler and Gurevich [Empirical likelihood ratios applied to goodness-of-fit tests based on sample entropy. Comput Stat Data Anal. 2010;54:531–545]. Consistency of the proposed test is derived. It is shown that the distribution of the proposed test does not depend on scale parameter. Critical values of the test statistic are computed, through a simulation study. A Monte Carlo study for the power of the proposed test is carried out under various alternatives. The performance of the test is compared with some well-known competing tests. Finally, an illustrative example is presented and analysed.     

Jarque–Bera Test and its Competitors for Testing Normality – A Power Comparison

For testing normality we investigate the power of several tests, first of all, the well-known test of Jarque & Bera (1980) and furthermore the tests of Kuiper (1960) and Shapiro & Wilk (1965) as well as tests of Kolmogorov–Smirnov and Cramér-von Mises type. The tests on normality are based, first, on independent random variables (model I) and, second, on the residuals in the classical linear regression (model II). We investigate the exact critical values of the Jarque–Bera test and the Kolmogorov–Smirnov and Cramér-von Mises tests, in the latter case for the original and standardized observations where the unknown parameters μ and σ have to be estimated. The power comparison is carried out via Monte Carlo simulation assuming the model of contaminated normal distributions with varying parameters μ and σ and different proportions of contamination. It turns out that for the Jarque–Bera test the approximation of critical values by the chi-square distribution does not work very well. The test is superior in power to its competitors for symmetric distributions with medium up to long tails and for slightly skewed distributions with long tails. The power of the Jarque–Bera test is poor for distributions with short tails, especially if the shape is bimodal – sometimes the test is even biased. In this case a modification of the Cramér-von Mises test or the Shapiro–Wilk test may be recommended.     

Sequential and two-stage procedures for selecting the better exponential population covering the case of unknown and unequal scale parameters

The problems of selecting the larger location parameter of two exponential distributions are discussed. When the scale parameters are the same but unknown, we consider the procedure of Desu et al. (1977) in detail, and study some of its exact and asymptotic properties. We indicate how this procedure can be modified along the lines of Mukhopadhyay (1979, 1980) to achieve first-order asymptotic efficiency. We then propose a sequential procedure for this set-up and show that it is asymptotically second-order efficient according to Ghosh and Mukhopadhyay (1981). In case the scale parameters are completely unknown and unequal, we propose a two-stage procedure that guarantees the probability of correct selection to exceed the prescribed nominal level in the preference zone. We do not need any new tables to implement this particular procedure other than those in Krishnaiah and Armitage (1964), Gupta and Sobel (1962), Guttman and Milton (1969). We also propose a sequential method in this case and derive some of its asymptotic properties.     

On the asymptotic normality and other large sample properties of grenander's mode estimator

The problem of estimating the mode of a continuous distribution has received considerable attention in recent years. Grenander (1965) has proposed a direct estimator of the mode based on the intuitive idea that raising a density to a positive power will make the mode more pronounced and, hence, easier to estimate. Grenander shows his estimator is weakly consistent and conjectures that it is also asymptotically normal. The analytical complexity of the estimator makes a mathematical study of this conjecture quite difficult. Another approach is to conduct goodness-of-fit studies to see how well the normal distribution approximates the sampling distribution of the estimator for various sample sizes and underlying parent distributions. The results of the study are presented where the main inferential tools were a Kolmogorov–Smirnov test statistic and a modified Shapiro–Wilk test statistic. The results of a simulation study exploring other large sample properties of the estimator (and a modification) are also given.     

Penalized and Shrinkage Estimation in the Cox Proportional Hazards Model

This article considers the shrinkage estimation procedure in the Cox's proportional hazards regression model when it is suspected that some of the parameters may be restricted to a subspace. We have developed the statistical properties of the shrinkage estimators including asymptotic distributional biases and risks. The shrinkage estimators have much higher relative efficiency than the classical estimator, furthermore, we consider two penalty estimators—the LASSO and adaptive LASSO—and compare their relative performance with that of the shrinkage estimators numerically. A Monte Carlo simulation experiment is conducted for different combinations of irrelevant predictors and the performance of each estimator is evaluated in terms of simulated mean squared error. Simulation study shows that the shrinkage estimators are comparable to the penalty estimators when the number of irrelevant predictors in the model is relatively large. The shrinkage and penalty methods are applied to two real data sets to illustrate the usefulness of the procedures in practice.     

New asymptotic inferences about the difference,ratio, and linear combination of two independent proportions

In statistics it is customary to realize asymptotic inferences about the difference d, the ratio R or a linear combination L of two independent proportions. In this article the authors evaluate ten inference methods, and conclude that for α = 1% some of the new procedures behave better than the classical. In cases d, R, or L, the optimal method consists in adding 0.5, 0.5 or 1 to all the data, respectively, and then applying a modification of the arc-sine transformation (d or R) or the likelihood ratio test (L). A free program may be obtained at ULR http://www.ugr.es/local/bioest/Z_LINEAR_K.EXE.     

On the wald,lagrangian multiplier and likelihood ratio tests when the information matrix is singular

Summary Modified formulas for the Wald and Lagrangian multiplier statistics are introduced and considered together with the likelihood ratio statistics for testing a typical null hypothesisH ₀ stated in terms of equality constraints. It is demonstrated, subject to known standard regularity conditions, that each of these statistics and the known Wald statistic has the asymptotic chi-square distribution with degrees of freedom equal to the number of equality constraints specified byH ₀ whether the information matrix is singular or nonsingular. The results of this paper include a generalization of the results of Sively (1959) concerning the equivalence of the Wald, Lagrange multiplier and likelihood ratio tests to the case of singular information matrices.