An entropy test for the Rayleigh distribution and power comparison

In this paper, a goodness-of-fit test is proposed for the Rayleigh distribution. This test is based on the Kullback–Leibler discrimination methodology proposed by Song [2002, Goodness of fit tests based on Kullback–Leibler discrimination, IEEE Trans. Inf. Theory 48(5), pp. 1103–1117]. The critical values and powers for some alternatives are obtained by simulation. The proposed test is compared with other tests, namely Kolmogorov–Smirnov, Kuiper, Cramer–von Mises, Watson and Anderson–Darling. The use of the proposed test is shown in a real example.     

A test for randomness based on a complexity measure

A test for randomness based on a statistic related to the complexity of finite sequences is presented. Simulation of binary sequences under different stochastic models provides estimates of the power of the test. The results show that the test is sensitive to a variety of alternatives to randomness and suggest that the proposed test statistic is a reasonable measure of the stochastic complexity of a finite sequence of discrete random variables.     

A modified runs test for symmetry

We propose a modification of a Modarres–Gastwirth test for the hypothesis of symmetry about a known center. By means of a Monte Carlo Study we show that the modified test overtakes the original Modarres–Gastwirth test for a wide spectrum of asymmetrical alternatives coming from the lambda family and for all assayed sample sizes. We also show that our test is the best runs test among the runs tests we have compared.     

An approximate degrees of freedom test for heteroscedastic two-way ANOVA

Heteroscedastic two-way ANOVA are frequently encountered in real data analysis. In the literature, classical F-tests are often blindly employed although they are often biased even for moderate heteroscedasticity. To overcome this problem, several approximate tests have been proposed in the literature. These tests, however, are either too complicated to implement or do not work well in terms of size controlling. In this paper, we propose a simple and accurate approximate degrees of freedom (ADF) test. The ADF test is shown to be invariant under affine-transformations, different choices of contrast matrix for the same null hypothesis, or different labeling schemes of cell means. Moreover, it can be conducted easily using the usual F-distribution with one unknown degree of freedom estimated from the data. Simulations demonstrate that the ADF test works well in various cell sizes and parameter configurations but the classical F-tests work badly when the cell variance homogeneity assumption is violated. A real data example illustrates the methodologies.     

A simple test for equally likely random responses in a sequence of bernoulli trials

A simple versatile combinatorial test is given for the null hypothesis that the two kinds of responses in a sequence of binary random variables are both equiprobable and randomly distributed. It is sensitive to a preponderance of either kind of response in either of two pre-selected halves of the positions of the sequence, e.g., the right half vs. the left, or the center vs. both ends. It combines the nice features of being, on the one hand, relatively assumption free and easy to apply and, on the other hand, sensitive to basic patterns underlying a poor fit of the empirical distribution to a theoretical model.     

Improvement of goodness-of-fit test for normal distribution based on entropy and power comparison

Vasicek's entropy test for normality is based on sample entropy and a parametric entropy estimator. These estimators are known to have bias in small samples. The use of Vasicek's test could affect the capability of detecting non-normality to some extent. This paper presents an improved entropy test, which uses bias-corrected entropy estimators. A Monte Carlo simulation study is performed to compare the power of the proposed test under several alternative distributions with some other tests. The results report that as anticipated, the improved entropy test has consistently higher power than the ordinary entropy test in nearly all sample sizes and alternatives considered, and compares favorably with other tests.     

The two-sample t test versus satterthwaite's approximate f test

A comparison between the two-sample t test and Satterthwaite's approximate F test is made, assuming the choice between these two tests is based on a preliminary test on the variances. Exact formulas for the sizes and powers of the tests are derived. Sizes and powers are then calculated and compared for several situations.     

Adaptive positive and negative runs test

As a nonparametric randomness test, the positive and negative runs test is widely used in practice due to the simplicity of its procedures. The test can lose efficiency if the alternative distribution is symmetrical at 0.5. In addition, the test can only be applied to test the randomness of a sequence from the uniform distribution. In this paper, we introduce an adaptive positive and negative runs test method to maximize the power function by choosing the optimal cut point. Also, the test is extended to check the randomness of a sequence generated from any other given distributions. Furthermore, we derive the exact distribution and obtain the asymptotical critical values of the proposed test statistics. Compared with the existed test, the efficiency of the proposed adaptive positive and negative runs test is competitive through simulation study.     

Test for normality based on two new estimators of entropy

In this article, two new consistent estimators are introduced of Shannon's entropy that compares root of mean-square error with other estimators. Then we define new tests for normality based on these new estimators. Finally, by simulation, the powers of the proposed tests are compared under different alternatives with other entropy tests for normality.     

On entropy goodness-of-fit test based on integrated distribution function

In this study, we consider an entropy-type goodness-of-fit (GOF) test based on integrated distribution functions. We first construct the test for the simple vs. simple hypothesis and then extend it to the composite hypothesis case. It is shown that under regularity conditions, the null limiting distribution of the proposed test is a function of a Brownian bridge. A bootstrap method is also considered and is shown to be weakly consistent. A simulation study and real data analysis are conducted for illustration.     

Bootstrap entropy test for general location-scale time series models with heteroscedasticity

This study considers a goodness-of-fit test for location-scale time series models with heteroscedasticity, including a broad class of generalized autoregressive conditional heteroscedastic-type models. In financial time series analysis, the correct identification of model innovations is crucial for further inferences in diverse applications such as risk management analysis. To implement a goodness-of-fit test, we employ the residual-based entropy test generated from the residual empirical process. Since this test often shows size distortions and is affected by parameter estimation, its bootstrap version is considered. It is shown that the bootstrap entropy test is weakly consistent, and thereby its usage is justified. A simulation study and data analysis are conducted by way of an illustration.     

Some factors affecting statistical power of approximate tests in the linear mixed model for longitudinal data

Different longitudinal study designs require different statistical analysis methods and different methods of sample size determination. Statistical power analysis is a flexible approach to sample size determination for longitudinal studies. However, different power analyses are required for different statistical tests which arises from the difference between different statistical methods. In this paper, the simulation-based power calculations of F-tests with Containment, Kenward-Roger or Satterthwaite approximation of degrees of freedom are examined for sample size determination in the context of a special case of linear mixed models (LMMs), which is frequently used in the analysis of longitudinal data. Essentially, the roles of some factors, such as variance–covariance structure of random effects [unstructured UN or factor analytic FA0], autocorrelation structure among errors over time [independent IND, first-order autoregressive AR1 or first-order moving average MA1], parameter estimation methods [maximum likelihood ML and restricted maximum likelihood REML] and iterative algorithms [ridge-stabilized Newton-Raphson and Quasi-Newton] on statistical power of approximate F-tests in the LMM are examined together, which has not been considered previously. The greatest factor affecting statistical power is found to be the variance–covariance structure of random effects in the LMM. It appears that the simulation-based analysis in this study gives an interesting insight into statistical power of approximate F-tests for fixed effects in LMMs for longitudinal data.     

Exact and approximate runs distributions

Let R = R_n denote the total (and unconditional) number of runs of successes or failures in a sequence of n Bernoulll (p) trials, where p is assumed to be known throughout. The exact distribution of R is related to a convolution of two negative binomial random variables with parameters p and q (=1-p). Using the representation of R as the sum of 1 - dependent indicators, a Berry - Esséen theorem is derived; the obtained rate of sup norm convergence is O(n^-½). This yields an unconditional version of the classical result of Wald and Wolfowitz (1940). The Stein - Chen method for m - dependent random variables is used, together with a suitable coupling, to prove a Poisson limit theorem for R. but with the limiting support set being the set of odd integers, Total variation error bounds (of order O(p) are found for the last result. Applications are indicated.     

A new estimator of entropy and its application in testing normality

In this paper, we introduce a new estimator of entropy of a continuous random variable. We compare the proposed estimator with the existing estimators, namely, Vasicek [A test for normality based on sample entropy, J. Roy. Statist. Soc. Ser. B 38 (1976), pp. 54–59], van Es [Estimating functionals related to a density by class of statistics based on spacings, Scand. J. Statist. 19 (1992), pp. 61–72], Correa [A new estimator of entropy, Commun. Statist. Theory and Methods 24 (1995), pp. 2439–2449] and Wieczorkowski-Grzegorewski [Entropy estimators improvements and comparisons, Commun. Statist. Simulation and Computation 28 (1999), pp. 541–567]. We next introduce a new test for normality. By simulation, the powers of the proposed test under various alternatives are compared with normality tests proposed by Vasicek (1976) and Esteban et al. [Monte Carlo comparison of four normality tests using different entropy estimates, Commun. Statist.–Simulation and Computation 30(4) (2001), pp. 761–785].     

Using the dependent wild bootstrap for the nonparametric goodness-of-fit test for density functions

In this paper, we consider the well-known nonparametric consistent model-specification test for the stationary density function (see [Aït-Sahalia Y. Testing continuous-time models of the spot interest rate. Rev Financ Stud. 1996;9:385–426; Li Q. Nonparametric testing of closeness between two unknown distribution functions. Econ Rev. 1996;15:261–274; Fan Y, Ullah A. On goodness-of-fit tests for weakly dependent processes using kernel method. J Nonparametric Stat. 2000;11:337–360]) and reinvestigate it carefully using asymptotics and simulation. Our work reveals that the test is subject to power and size distortions, which are mainly caused by dependence or convergence rate changes under the null and alternative hypothesis. A dependent wild bootstrap is newly suggested as a feasible remedy to such distortions. Our result provides a complete explanation as well as a solution to the problem that experienced by Aït-Sahalia [Testing continuous-time models of the spot interest rate. Rev Financ Stud. 1996;9:385–426], that is, that the test rejects true models too often when independent and identically distributed asymptotic critical values are used.     

Monte Carlo comparison of five exponentiality tests using different entropy estimates

The paper studies five entropy tests of exponentiality using five statistics based on different entropy estimates. Critical values for various sample sizes determined by means of Monte Carlo simulations are presented for each of the test statistics. By simulation, we compare the power of these five tests for various alternatives and sample sizes.     

Conditions equivalent and doubly equivalent to consistency of approximate MLE's

Summary Strasser (1981) introduced approximately maximum likelihood estimators (AMLE's) and found a condition equivalent to strong consistency of all AMLE's. Here a condition weaker than that of Strasser is proved to be equivalent to the usual consistency of all AMLE's. Under an additional regularity this condition is shown to be doubly equivalent, which means that it is equivalent to consistency, and its contrary is equivalent to inconsistency of all AMLE's. The doubly equivalent conditions are important—we present an example where MLE is strongly consistent but some AMLE's are inconsistent. It is proved that the additional regularity can be reduced to the finiteness of an observations entropy. All results are motivate and illustrated by examples. Supported by CSAS grant N. 17503.     

Approximate entropy: Statistical properties and applications

ApEn, approximate entropy, is a recently developed family of parameters and statistics quantifying regularity (complexity) in data, providing an information-theoretic quantity for continuous-state processes. We provide the motivation for ApEn development, and indicate the superiority of ApEn to the K-S entropy for statistical application, and for discrimination of both correlated stochastic and noisy deterministic processes. We study the variation of ApEn with input parameter choices, reemphasizing that ApEn is a relative measure of regularity. We study the bias in the ApEn statistic, and present evidence for asymptotic normality in the ApEn distributions, assuming weak dependence. We provide a new test for the hypothesis that an underlying time-series is generated by i.i.d. variables, which does not require distribution specification. We introduce randomized ApEn, which derives an empirical significance probability that two processes differ, based on one data set from each process.     

A test for randomness of the environments in a branching process

This paper discusses an approximate score test for testing randomness of environments in a branching process without observing the environments. Using an appropriate martingale central limit theorem the asymptotic null distribution of test statistic is shown to be normal. When the offspring distribution is Poisson, the detail derivation of asymptotic distribution of the test statistic is presented.     

On entropy-based goodness-of-fit test for asymmetric Student-t and exponential power distributions

This paper examines the goodness-of-fit (GOF) test for a generalized asymmetric Student-t distribution (ASTD) and asymmetric exponential power distribution (AEPD). These distributions are known to include a broad class of distribution families and are quite suitable to modelling the innovations of financial time series. Despite their popularity, to our knowledge, no studies in the literature have so far investigated their affinity and differences in implementation. To fill this gap, we examine the empirical power behaviour of entropy-based GOF tests for hypotheses wherein the ASTD and AEPD play the role of null and alternative distributions. Our findings through a simulation study and real data analysis indicate that the two distributions are generally hard to distinguish and that the ASTD family accommodates AEPDs to a greater degree than the other way around for larger samples.