A New Goodness-of-Fit Test Based on the Empirical Characteristic Function

In this article, we present a goodness-of-fit test for a distribution based on some comparisons between the empirical characteristic function c_n(t) and the characteristic function of a random variable under the simple null hypothesis, c₀(t). We do this by introducing a suitable distance measure. Empirical critical values for the new test statistic for testing normality are computed. In addition, the new test is compared via simulation to other omnibus tests for normality and it is shown that this new test is more powerful than others.     

Omnibus tests for the error distribution in the linear regression model

Test procedures are constructed for testing the goodness-of-fit of the error distribution in the regression context. The test statistic is based on an L ²-type distance between the characteristic function of the (assumed) error distribution and the empirical characteristic function of the residuals. The asymptotic null distribution as well as the behavior of the test statistic under contiguous alternatives is investigated, while the issue of the choice of suitable estimators has been particularly emphasized. Theoretical results are accompanied by a simulation study.     

Testing the Fit of Gamma Distributions Using the Empirical Moment Generating Function

ABSTRACT

This article presents goodness-of-fit tests for two and three-parameter gamma distributions that are based on minimum quadratic forms of standardized logarithmic differences of values of the moment generating function and its empirical counterpart. The test statistics can be computed without reliance to special functions and have asymptotic chi-squared distributions. Monte Carlo simulations are used to compare the proposed test for the two-parameter gamma distribution with goodness-of-fit tests employing empirical distribution function or spacing statistics. Two data sets are used to illustrate the various tests.     

Normality testing for a long-memory sequence using the empirical moment generating function

Moment generating functions and more generally, integral transforms for goodness-of-fit tests have been in use in the last several decades. Given a set of observations, the empirical transforms are easy to compute, being simply a sample mean, and due to uniqueness properties, these functions can be used for goodness-of-fit tests. This paper focuses on time series observations from a stationary process for which the moment generating function exists and the correlations have long-memory. For long-memory processes, the infinite sum of the correlations diverges and the realizations tend to have spurious trend like patterns where there may be none. Our aim is to use the empirical moment generating function to test the null hypothesis that the marginal distribution is Gaussian. We provide a simple proof of a central limit theorem using ideas from Gaussian subordination models (Taqqu, 1975) and derive critical regions for a graphical test of normality, namely the T₃-plot ( Ghosh, 1996). Some simulated and real data examples are used for illustration.     

A Laguerre polynomial approximation for a goodness-of-fit test for exponential distribution based on progressively censored data

This paper proposes an approximation to the distribution of a goodness-of-fit statistic proposed recently by Balakrishnan et al. [Balakrishnan, N., Ng, H.K.T. and Kannan, N., 2002, A test of exponentiality based on spacings for progressively Type-II censored data. In: C. Huber-Carol et al. (Eds.), Goodness-of-Fit Tests and Model Validity (Boston: Birkhäuser), pp. 89–111.] for testing exponentiality based on progressively Type-II right censored data. The moments of this statistic can be easily calculated, but its distribution is not known in an explicit form. We first obtain the exact moments of the statistic using Basu's theorem and then the density approximants based on these exact moments of the statistic, expressed in terms of Laguerre polynomials, are proposed. A comparative study of the proposed approximation to the exact critical values, computed by Balakrishnan and Lin [Balakrishnan, N. and Lin, C.T., 2003, On the distribution of a test for exponentiality based on progressively Type-II right censored spacings. Journal of Statistical Computation and Simulation, 73 (4), 277–283.], is carried out. This reveals that the proposed approximation is very accurate.     

Parameter Estimation for the Discrete Stable Family

The discrete stable family constitutes an interesting two-parameter model of distributions on the non-negative integers with a Paretian tail. The practical use of the discrete stable distribution is inhibited by the lack of an explicit expression for its probability function. Moreover, the distribution does not possess moments of any order. Therefore, the usual tools—such as the maximum-likelihood method or even the moment method—are not feasible for parameter estimation. However, the probability generating function of the discrete stable distribution is available in a simple form. Hence, we initially explore the application of some existing estimation procedures based on the empirical probability generating function. Subsequently, we propose a new estimation method by minimizing a suitable weighted L ²-distance between the empirical and the theoretical probability generating functions. In addition, we provide a goodness-of-fit statistic based on the same distance.     

An empirical likelihood ratio based goodness-of-fit test for Inverse Gaussian distributions

The Inverse Gaussian (IG) distribution is commonly introduced to model and examine right skewed data having positive support. When applying the IG model, it is critical to develop efficient goodness-of-fit tests. In this article, we propose a new test statistic for examining the IG goodness-of-fit based on approximating parametric likelihood ratios. The parametric likelihood ratio methodology is well-known to provide powerful likelihood ratio tests. In the nonparametric context, the classical empirical likelihood (EL) ratio method is often applied in order to efficiently approximate properties of parametric likelihoods, using an approach based on substituting empirical distribution functions for their population counterparts. The optimal parametric likelihood ratio approach is however based on density functions. We develop and analyze the EL ratio approach based on densities in order to test the IG model fit. We show that the proposed test is an improvement over the entropy-based goodness-of-fit test for IG presented by Mudholkar and Tian (2002). Theoretical support is obtained by proving consistency of the new test and an asymptotic proposition regarding the null distribution of the proposed test statistic. Monte Carlo simulations confirm the powerful properties of the proposed method. Real data examples demonstrate the applicability of the density-based EL ratio goodness-of-fit test for an IG assumption in practice.     

Testing the validity of the logistic model based on the empirical distribution function

The logistic distribution is one of the fundamental distribution and is widely used for describing model growth curves in survival analysis and biological studies. Applications of this distribution are presented in statistical literature. In this article, goodness of fit tests for the logistic distribution based on the empirical distribution function (EDF) are considered. In order to compute the test statistics, because the MLEs cannot be obtained explicitly, we use the approximate maximum likelihood estimates (AMLEs) suggested by Balakrishnan and Cohen (1990 Balakrishnan, N., Cohen, A. C. (1990). Order Statistics and Inference: Estimation Methods. Boston: Academic Press. [Google Scholar]), which are simple explicit estimators. Power comparisons of the considered tests are carried out via simulations. Finally, two illustrative examples are presented and analyzed.     

A Generalization of Shapiro–Wilk's Test for Multivariate Normality

A goodness-of-fit test for multivariate normality is proposed which is based on Shapiro–Wilk's statistic for univariate normality and on an empirical standardization of the observations. The critical values can be approximated by using a transformation of the univariate standard normal distribution. A Monte Carlo study reveals that this test has a better power performance than some of the best known tests for multinormality against a wide range of alternatives.     

Exact likelihood inference based on an unified hybrid censored sample from the exponential distribution

Recently, exact confidence bounds and exact likelihood inference have been developed based on hybrid censored samples by Chen and Bhattacharyya [Chen, S. and Bhattacharyya, G.K. (1998). Exact confidence bounds for an exponential parameter under hybrid censoring. Communications in Statistics—Theory and Methods, 17, 1857–1870.], Childs et al. [Childs, A., Chandrasekar, B., Balakrishnan, N. and Kundu, D. (2003). Exact likelihood inference based on Type-I and Type-II hybrid censored samples from the exponential distribution. Annals of the Institute of Statistical Mathematics, 55, 319–330.], and Chandrasekar et al. [Chandrasekar, B., Childs, A. and Balakrishnan, N. (2004). Exact likelihood inference for the exponential distribution under generalized Type-I and Type-II hybrid censoring. Naval Research Logistics, 51, 994–1004.] for the case of the exponential distribution. In this article, we propose an unified hybrid censoring scheme (HCS) which includes many cases considered earlier as special cases. We then derive the exact distribution of the maximum likelihood estimator as well as exact confidence intervals for the mean of the exponential distribution under this general unified HCS. Finally, we present some examples to illustrate all the methods of inference developed here.     

The performance of univariate goodness-of-fit tests for normality based on the empirical characteristic function in large samples

A test based on the studentized empirical characteristic function calculated in a single point is derived. An empirical power comparison is made between this test and tests like the Epps–Pulley, Shapiro–Wilks, Anderson–Darling and other tests for normality. It is shown to outperform the more complicated Epps-Pulley test based on the empirical characteristic function and a Cramér-von Mises type expression in a simulation study. The test performs especially good in large samples and the derived test statistic has an asymptotic normal distribution which is easy to apply.     

Jacobi and Laguerre polynomial approximations for the distributions of statistics useful in testing for outliers in exponential and gamma samples

Recently, Sanjel and Balakrishnan [A Laguerre Polynomial Approximation for a goodness-of-fit test for exponential distribution based on progressively censored data, J. Stat. Comput. Simul. 78 (2008), pp. 503–513] proposed the use of Laguerre orthogonal polynomials for a goodness-of-fit test for the exponential distribution based on progressively censored data. In this paper, we use Jacobi and Laguerre orthogonal polynomials in order to obtain density approximants for some test statistics useful in testing for outliers in gamma and exponential samples. We first obtain the exact moments of the statistics and then the density approximants, based on these moments, are expressed in terms of Jacobi and Laguerre polynomials. A comparative study is carried out of the critical values obtained by using the proposed methods to the corresponding results given by Barnett and Lewis [Outliers in Statistical Data, 3rd ed., John Wiley & Sons, New York, 1993]. This reveals that the proposed techniques provide very accurate approximations to the distributions. Finally, we present some numerical examples to illustrate the proposed approximations. Monte Carlo simulations suggest that the proposed approximate densities are very accurate.     

Empirical likelihood dimension reduction inference for partially non-linear error-in-responses models with validation data

ABSTRACT

In this article, partially non linear models when the response variable is measured with error and explanatory variables are measured exactly are considered. Without specifying any error structure equation, a semiparametric dimension reduction technique is employed. Two estimators of unknown parameter in non linear function are obtained and asymptotic normality is proved. In addition, empirical likelihood method for parameter vector is provided. It is shown that the estimated empirical log-likelihood ratio has asymptotic Chi-square distribution. A simulation study indicates that, compared with normal approximation method, empirical likelihood method performs better in terms of coverage probabilities and average length of the confidence intervals.     

Goodness-of-fit tests for the Gompertz distribution

Abstract

While the Gompertz distribution is often fitted to lifespan data, testing whether the fit satisfies theoretical criteria is being neglected. Here four goodness-of-fit measures – the Anderson–Darling statistic, the correlation coefficient test, a statistic using moments, and a nested test against the generalized extreme value distributions – are discussed. Along with an application to laboratory rat data, critical values calculated by the empirical distribution of the test statistics are also presented.     

Graphical procedures and goodness-of-fit tests for the compound poisson-exponential distribution

ABSTRACT

The compound Poisson-exponential distribution is a basic model in risk analysis and stochastic hydrology. Graphical procedures for assessing this distribution are proposed which utilize the residuals from a regression involving the moment generating function. Plots furnished with a 95% simultaneous confidence band are constructed. The band and critical points of the equivalent goodness-of-fit test are found by utilizing asymptotic results and fitted regressions involving the supremum of the standardized residuals, the sample size, and the estimated Poisson mean. Simulation results indicate that the tests have good level stability and appreciable power against competing compound Poisson distributions of a mixed type.     

New estimators of distribution functions

ABSTRACT

This article considers the estimation of a distribution function F_X(x) based on a random sample X₁, X₂, …, X_n when the sample is suspected to come from a close-by distribution F₀(x). The new estimators, namely the preliminary test (PTE) and Stein-type estimator (SE) are defined and compared with the “empirical distribution function” (edf) under local departure. In this case, we show that Stein-type estimators are superior to edf and PTE is superior to edf when it is close to F₀(x). As a by-product similar estimators are proposed for population quantiles.     

Customizing Generalizations of the Kolmogorov-Smirnov Goodness-of-fit Test

This paper presents a method of customizing goodness-of-fit tests that transforms the empirical distribution function in such a way as to create tests for certain alternatives. Using the @ , g transform described in Blom(1958), one can create non-parametric tests for an assortment of alternative distributions. As examples, three new ( f , g )-corrected Kolmogorov-Smirnov tests for goodness-of-fit are discussed. One of these tests is powerful for testing whether or not the data come from an alternative that is heavier in the tails. Another test identifies whether or not the data come from an alternative which is heavier in the middle of the distribution. The last test identifies if the data come from an alternative in which the first or third quartile is far from the corresponding quartile of the hypothesized distribution. The behavior of the three new tests is investigated through a power study.     

A modified one-sample test for goodness-of-fit

This paper introduces a modified one-sample test of goodness-of-fit based on the cumulative distribution function. Damico [A new one-sample test for goodness-of-fit. Commun Stat – Theory Methods. 2004;33:181–193] proposed a test for testing goodness-of-fit of univariate distribution that uses the concept of partitioning the probability range into n intervals of equal probability mass 1/n and verifies that the hypothesized distribution evaluated at the observed data would place one case into each interval. The present paper extends this notion by allowing for m intervals of probability mass r/n, where r≥1 and n=m×r. A simulation study for small and moderate sample sizes demonstrates that the proposed test for two observations per interval under various alternatives is more powerful than the test proposed by Damico (2004).     

A goodness-of-fit test for multivariate multiparameter copulas based on multiplier central limit theorems

Recent large scale simulations indicate that a powerful goodness-of-fit test for copulas can be obtained from the process comparing the empirical copula with a parametric estimate of the copula derived under the null hypothesis. A first way to compute approximate p-values for statistics derived from this process consists of using the parametric bootstrap procedure recently thoroughly revisited by Genest and Rémillard. Because it heavily relies on random number generation and estimation, the resulting goodness-of-fit test has a very high computational cost that can be regarded as an obstacle to its application as the sample size increases. An alternative approach proposed by the authors consists of using a multiplier procedure. The study of the finite-sample performance of the multiplier version of the goodness-of-fit test for bivariate one-parameter copulas showed that it provides a valid alternative to the parametric bootstrap-based test while being orders of magnitude faster. The aim of this work is to extend the multiplier approach to multivariate multiparameter copulas and study the finite-sample performance of the resulting test. Particular emphasis is put on elliptical copulas such as the normal and the t as these are flexible models in a multivariate setting. The implementation of the procedure for the latter copulas proves challenging and requires the extension of the Plackett formula for the t distribution to arbitrary dimension. Extensive Monte Carlo experiments, which could be carried out only because of the good computational properties of the multiplier approach, confirm in the multivariate multiparameter context the satisfactory behavior of the goodness-of-fit test.     

Optimal Bayesian sampling plans for exponential distributions based on hybrid censored samples

We study variable sampling plans for exponential distributions based on type-I hybrid censored samples. For this problem, two sampling plans based on the non-failure sample proportion and the conditional maximum likelihood estimator are proposed by Chen et al. [J. Chen, W. Chou, H. Wu, and H. Zhou, Designing acceptance sampling schemes for life testing with mixed censoring, Naval Res. Logist. 51 (2004), pp. 597–612] and Lin et al. [C.-T. Lin, Y.-L. Huang, and N. Balakrishnan, Exact Bayesian variable sampling plans for the exponential distribution based on type-I and type-II censored samples, Commun. Statist. Simul. Comput. 37 (2008), pp. 1101–1116], respectively. From the theoretic decision point of view, the preceding two sampling plans are not optimal due to their decision functions not being the Bayes decision functions. In this article, we consider the decision theoretic approach, and the optimal Bayesian sampling plan based on sufficient statistics is derived under a general loss function. Furthermore, for the conjugate prior distribution, the closed-form formula of the Bayes decision rule can be obtained under either the linear or quadratic decision loss. The resulting Bayesian sampling plan has the minimum Bayes risk, and hence it is better than the sampling plans proposed by Chen et al. (2004) and Lin et al. (2008). Numerical comparisons are given and demonstrate that the performance of the proposed Bayesian sampling plan is superior to that of Chen et al. (2004) and Lin et al. (2008).