Entropy estimation and goodness-of-fit tests for the inverse Gaussian and Laplace distributions using paired ranked set sampling

ABSTRACT

In this paper, Vasicek [A test for normality based on sample entropy. J R Stat Soc Ser B. 1976;38:54–59] entropy estimator is modified using paired ranked set sampling (PRSS) method. Also, two goodness-of-fit tests using PRSS are suggested for the inverse Gaussian and Laplace distributions. The new suggested entropy estimator and goodness-of-fit tests using PRSS are compared with their counterparts using simple random sampling (SRS) via Monte Carlo simulations. The critical values of the suggested tests are obtained, and the powers of the tests based on several alternatives hypotheses using SRS and PRSS are calculated. It turns out that the proposed PRSS entropy estimator is more efficient than the SRS counterpart in terms of root mean square error. Also, the proposed PRSS goodness-of-fit tests have higher powers than their counterparts using SRS for all alternative considered in this study.     

Goodness-of-fit tests based on Verma Kullback–Leibler information

In this article, a new consistent estimator of Veram’s entropy is introduced. We establish the entropy test based on the new information namely Verma Kullback–Leibler discrimination methodology. The results are used to introduce goodness-of-fit tests for normal and exponential distributions. The root of mean square errors, critical values, and powers for some alternatives are obtained by simulation. The proposed test is compared with other tests.     

Normal tests for unit roots based on instrumental variable estimators

For estimating unit roots of autoregressive processes, we introduce a new instrumental variable (IV) method which discounts large values of regressors corresponding to the unit roots. Based on the IV estimator, we propose new unit root tests whose limiting null distributions are standard normal. Observation at time t is adjusted for mean recursively by the sample mean of observations up to the time t. The powers of the proposed tests are better than those of the Dickey–Fuller tests and are comparable to those of the tests based on the weighted symmetric estimator, which are known to have the best power against stationary alternatives.     

Testing exponentiality based on characterizations of the exponential distribution

In this paper, we first present two characterizations of the exponential distribution and next introduce three exact goodness-of-fit test for exponentiality. By simulation, the powers of the proposed tests under various alternatives are compared with the existing tests.     

Estimation of the parameters of the Gompertz distribution under the first failure-censored sampling plan

This article presents the goodness-of-fit tests for the Laplace distribution based on its maximum entropy characterization result. The critical values of the test statistics estimated by Monte Carlo simulations are tabulated for various window and sample sizes. The test statistics use an entropy estimator depending on the window size; so, the choice of the optimal window size is an important problem. The window sizes for yielding the maximum power of the tests are given for selected sample sizes. Power studies are performed to compare the proposed tests with goodness-of-fit tests based on the empirical distribution function. Simulation results report that entropy-based tests have consistently higher power than EDF tests against almost all alternatives considered.     

Tests of fit for the Gumbel distribution: EDF-based tests against entropy-based tests

In this article, we propose some tests of fit based on sample entropy for the composite Gumbel (Extreme Value) hypothesis. The proposed test statistics are constructed using different entropy estimates. Through a Monte Carlo simulation, critical values of the test statistics for various sample sizes are obtained. Since the tests based on the empirical distribution function (EDF) are commonly used in practice, the power values of the entropy-based tests with those of the EDF tests are compared against various alternatives and different sample sizes. Finally, two real data sets are modeled by the Gumbel distribution.KEYWORDS: Entropy estimator, Gumbel distribution, Monte Carlo simulation, test power     

Some tests for a poisson process and their powers with respect to trend in the intensity

Recently many authors have worked on Wei bull process in the area of modelling and analysis. Much less work is done in the area of testing of hypothesis. In this article, some tests for testing the Poisson process against a class of Wei bull process based on the conditional distribution of observations given the sufficient statistic, are proposed. The percentage points of the distributions of the proposed test statistics are simulated. The powers of the tests under alternatives are computed by Monte Carlo method. It is seen that the suggested tests perform well for decreasing intensities.     

Two classes of divergence statistics for testing uniform association

The problem of testing uniform association in cross-classifications having ordered categories is considered. Two families of test statistics, both based on divergences between certain functions of the observed data, are studied and compared. Our theoretical study is based on asymptotic properties. For each family, two consistent approximations to the null distribution of the test statistic are studied: the asymptotic null distribution and a bootstrap estimator; all the tests considered are consistent against fixed alternatives; finally, we do a local power study. Surprisingly, both families detect the same local alternatives. The finite sample performance of the tests in these two classes is numerically investigated through some simulation experiments. In the light of the obtained results, some practical recommendations are given.     

An efficient correction to the density-based empirical likelihood ratio goodness-of-fit test for the inverse Gaussian distribution

The inverse Gaussian (IG) distribution is widely used to model positively skewed data. An important issue is to develop a powerful goodness-of-fit test for the IG distribution. We propose and examine novel test statistics for testing the IG goodness of fit based on the density-based empirical likelihood (EL) ratio concept. To construct the test statistics, we use a new approach that employs a method of the minimization of the discrimination information loss estimator to minimize Kullback–Leibler type information. The proposed tests are shown to be consistent against wide classes of alternatives. We show that the density-based EL ratio tests are more powerful than the corresponding classical goodness-of-fit tests. The practical efficiency of the tests is illustrated by using real data examples.     

Extropy estimators with applications in testing uniformity

Two estimators for estimating the extropy of an absolutely continuous random variable with known support were introduced by using spacing. It is shown that the proposed estimators are consistent and their mean square errors are shift invariant. Their behaviours were also studied by means of real data and Monte Carlo simulation. The winner estimator of extropy in the Monte Carlo experiment was used to develop goodness-of-fit test for standard uniform distribution. It is shown that the extropy-based test that we proposed performs well by comparing its powers with that of other tests for uniformity.     

Exponentiality test based on Renyi distance between equilibrium distributions

ABSTRACT

On the basis of Csiszar's φ-divergence discrimination information, we propose a measure of discrepancy between equilibriums associated with two distributions. Proving that a distribution can be characterized by associated equilibrium distribution, a Renyi distance of the equilibrium distributions is constructed that made us to propose an EDF-based goodness-of-fit test for exponential distribution. For comparing the performance of the proposed test, some well-known EDF-based tests and some entropy-based tests are considered. Based on the simulation results, the proposed test has better powers than those of competing entropy-based tests for the alternatives with decreasing hazard rate function. The use of the proposed test is evaluated in an illustrative example.     

Modified inference about the mean of the exponential distribution using moving extreme ranked set sampling

The maximum likelihood estimator (MLE) and the likelihood ratio test (LRT) will be considered for making inference about the scale parameter of the exponential distribution in case of moving extreme ranked set sampling (MERSS). The MLE and LRT can not be written in closed form. Therefore, a modification of the MLE using the technique suggested by Maharota and Nanda (Biometrika 61:601–606, 1974) will be considered and this modified estimator will be used to modify the LRT to get a test in closed form for testing a simple hypothesis against one sided alternatives. The same idea will be used to modify the most powerful test (MPT) for testing a simple hypothesis versus a simple hypothesis to get a test in closed form for testing a simple hypothesis against one sided alternatives. Then it appears that the modified estimator is a good competitor of the MLE and the modified tests are good competitors of the LRT using MERSS and simple random sampling (SRS).     

Efficiency of ranked set sampling in tests for normality

In this article, we consider the ranked set sampling (RSS) and investigate seven tests for normality under RSS. Each test is described and then power of each test is obtained by Monte Carlo simulations under various alternatives. Finally, the powers of the tests based on RSS are compared with the powers of the tests based on the simple random sampling and the results are discussed.     

The power of some tests of normality against weibull alternatives

The powers of the Kolmogorov-Smirnov, Weisberg-Bingham and Anderson-Darling tests of normality are determined by Monte Carlo sampling ror Weibull alternatives with 10 shape parameters ranging from 1.0 to 10.0 and seven sample sizes from 10 to 100. There is, in general, good agreement at the relatively few points for which power values have previously been published. The usefulness of examining the power as a function of the parameter(s) of an alternate distribution family is outlined.     

A class of tests for exponentiality against decreasing mean residual life alternatives

A class of tests is proposed for testing Exponentiality against the Decreasing Mean Residual Life (DMRL) class of non-exponential probability distributions. These tests are consistent and asymptotically unbiased against all continuous DMRL alternatives. They are U - statistics and hence asymptotically normally distributed. The asymptotic relative efficiency (ARE) with respect to other tests for DMRL are quite high. Small sample powers are also comparable with small sample powers of the competitors.     

A new estimator of entropy and its application in testing normality

In this paper, we introduce a new estimator of entropy of a continuous random variable. We compare the proposed estimator with the existing estimators, namely, Vasicek [A test for normality based on sample entropy, J. Roy. Statist. Soc. Ser. B 38 (1976), pp. 54–59], van Es [Estimating functionals related to a density by class of statistics based on spacings, Scand. J. Statist. 19 (1992), pp. 61–72], Correa [A new estimator of entropy, Commun. Statist. Theory and Methods 24 (1995), pp. 2439–2449] and Wieczorkowski-Grzegorewski [Entropy estimators improvements and comparisons, Commun. Statist. Simulation and Computation 28 (1999), pp. 541–567]. We next introduce a new test for normality. By simulation, the powers of the proposed test under various alternatives are compared with normality tests proposed by Vasicek (1976) and Esteban et al. [Monte Carlo comparison of four normality tests using different entropy estimates, Commun. Statist.–Simulation and Computation 30(4) (2001), pp. 761–785].     

A study of several useful tests for ordered alternatives in the randomized block design

This study investigates the small sample powers of several tests designed against ordered location alternatives in randomized block experiments. The results are intended to aid the researcher in the selection process. Toward this end the small sample powers of three classes of rank tests — tests based on ‘within-blocks’ rankings (W-tests), ‘among-b locks’ rankings (A-tests), and ‘ranking after alignment’ within blocks (RAA-tests)— are compared and contrasted with the asymptotic properties given by Pirie (1974) as well as with the empirical powers of competing parametric procedures.     

Power studies of tests for uniformity,II

Results from a power study of six statistics for testing that a sample is from a uniform distribution on the unit interval (0,1) are reported. The test statistics are all well-known and each of them was originally proposed because they should have high power against some alternative distributions. The tests considered are the Pearson probability product test, the Neyman smooth test, the Sukhatme test, the Durbin-Kolmogorov test, the Kuiper test, and the Sherman test. Results are given for each of these tests against each of four classes of alternatives. Also, the most powerful test against each member of the first three alternatives is obtained, and the powers of these tests are given for the same sample sizes as for the six general "omnibus" test statistics. These values constitute a "power envelope" against which all tests can be compared. The Neyman smooth tests with 2nd and 4th degree polynomials are found to have good power and are recommended as general tests for uniformity.     

Modified entropy estimators for testing normality

In this paper, we present two new estimators for the entropy of absolutely continuous random variables and consider some of their properties. Consistency of the first estimator is shown by Monte Carlo method, and the consistency of the second estimator is proved theoretically. Using these estimators, two new tests for normality are presented and their powers are compared with the other entropy-based tests. Simulation results show that the proposed estimators and test statistics perform very well. Finally, a real example is presented and analysed.     

An entropy test for the Rayleigh distribution and power comparison

In this paper, a goodness-of-fit test is proposed for the Rayleigh distribution. This test is based on the Kullback–Leibler discrimination methodology proposed by Song [2002, Goodness of fit tests based on Kullback–Leibler discrimination, IEEE Trans. Inf. Theory 48(5), pp. 1103–1117]. The critical values and powers for some alternatives are obtained by simulation. The proposed test is compared with other tests, namely Kolmogorov–Smirnov, Kuiper, Cramer–von Mises, Watson and Anderson–Darling. The use of the proposed test is shown in a real example.