Correcting moments for goodness of fit tests based on two entropy estimates

The sample entropy (Vasicek, 1976) has been most widely used as a nonparametric entropy estimator due to its simplicity, but its underlying distribution function has not been known yet though its moments are required in establishing the entropy-based goodness of test statistic (Soofi et al., 1995). In this paper we derive the nonparametric distribution function of the sample entropy as a piece-wise uniform distribution in the lights of Theil (1980) and Dudwicz and van der Meulen (1987). Then we establish the entropy-based goodness of fit test statistics based on the nonparametric distribution functions of the sample entropy and modified sample entropy (Ebrahimi et al., 1994), and compare their performances for the exponential and normal distributions.     

Prediction intervals for ordinary and dual generalized order statistics from two independent sequences

ABSTRACT

Based on the observed dual generalized order statistics drawn from an arbitrary unknown distribution, nonparametric two-sided prediction intervals as well as prediction upper and lower bounds for an ordinary and a dual generalized order statistic from another iid sequence with the same distribution are developed. The prediction intervals for dual generalized order statistics based on the observed ordinary generalized order statistics are also developed. The coverage probabilities of these prediction intervals are exact and free of the parent distribution, F. Finally, numerical computations and real examples of the coverage probabilities are presented for choosing the appropriate limits of the prediction.     

Wavelets in statistics: A review

The field of nonparametric function estimation has broadened its appeal in recent years with an array of new tools for statistical analysis. In particular, theoretical and applied research on the field of wavelets has had noticeable influence on statistical topics such as nonparametric regression, nonparametric density estimation, nonparametric discrimination and many other related topics. This is a survey article that attempts to synthetize a broad variety of work on wavelets in statistics and includes some recent developments in nonparametric curve estimation that have been omitted from review articles and books on the subject. After a short introduction to wavelet theory, wavelets are treated in the familiar context of estimation of «smooth» functions. Both «linear» and «nonlinear» wavelet estimation methods are discussed and cross-validation methods for choosing the smoothing parameters are addressed. Finally, some areas of related research are mentioned, such as hypothesis testing, model selection, hazard rate estimation for censored data, and nonparametric change-point problems. The closing section formulates some promising research directions relating to wavelets in statistics.     

An Asymptotic Characterization of Finite Degree U-statistics With Sample Size-Dependent Kernels: Applications to Nonparametric Estimators and Test Statistics

We provide a simple result on the H-decomposition of a U-statistics that allows for easy determination of its magnitude when the statistic’s kernel depends on the sample size n. The result provides a direct and convenient method to characterize the asymptotic magnitude of semiparametric and nonparametric estimators or test statistics involving high dimensional sums. We illustrate the use of our result in previously studied estimators/test statistics and in a novel nonparametric R² test for overall significance of a nonparametric regression model.     

Tests of fit for the Laplace distribution based on correcting moments of entropy estimators

ABSTRACT

In this paper, we first consider the entropy estimators introduced by Vasicek [A test for normality based on sample entropy. J R Statist Soc, Ser B. 1976;38:54–59], Ebrahimi et al. [Two measures of sample entropy. Stat Probab Lett. 1994;20:225–234], Yousefzadeh and Arghami [Testing exponentiality based on type II censored data and a new cdf estimator. Commun Stat – Simul Comput. 2008;37:1479–1499], Alizadeh Noughabi and Arghami [A new estimator of entropy. J Iran Statist Soc. 2010;9:53–64], and Zamanzade and Arghami [Goodness-of-fit test based on correcting moments of modified entropy estimator. J Statist Comput Simul. 2011;81:2077–2093], and the nonparametric distribution functions corresponding to them. We next introduce goodness-of-fit test statistics for the Laplace distribution based on the moments of nonparametric distribution functions of the aforementioned estimators. We obtain power estimates of the proposed test statistics with Monte Carlo simulation and compare them with the competing test statistics against various alternatives. Performance of the proposed new test statistics is illustrated in real cases.     

Hypothesis Testing Problems in an Unbalanced Longitudinal Ophthalmology Study

ABSTRACT

The analysis of clustered data in a longitudinal ophthalmology study is complicated by correlations between repeatedly measured visual outcomes of paired eyes in a participant and missing observations due to the loss of follow-up. In the present article we consider hypothesis testing problems in an ophthalmology study, where eligible eyes are randomized to two treatments (when two eyes of a participant are eligible, the paired eyes are assigned to different treatments), and vision function outcomes are repeatedly measured over time. A large sample-based nonparametric test statistic and a nonparametric Bootstrap test analog are proposed for testing an interaction effect of two factors and testing an effect of a eye-specific factor within a level of the other person-specific factor on visual function outcomes. Both test statistics allow for missing observations, correlations between repeatedly measured outcomes on individual eyes, and correlations between repeatedly measured outcomes on both eyes of each participant. A simulation study shows that these proposed test statistics maintain nominal significance levels approximately and comparable powers to each other, as well as higher powers than the naive test statistic ignoring correlations between repeated bilateral measurements of both eyes in the same person. For illustration, we apply the proposed test statistics to the changes of visual field defect score in the Advanced Glaucoma Intervention Study.     

A simple nonparametric test for bivariate symmetry about a line

Over the years many researchers have dealt with testing the hypotheses of symmetry in univariate and multivariate distributions in the parametric and nonparametric setup. In a multivariate setup, there are several formulations of symmetry, for example, symmetry about an axis, joint symmetry, marginal symmetry, radial symmetry, symmetry about a known point, spherical symmetry, and elliptical symmetry among others. In this paper, for the bivariate case, we formulate a concept of symmetry about a straight line passing through the origin in a plane and accordingly develop a simple nonparametric test for testing the hypothesis of symmetry about a straight line. The proposed test is based on a measure of deviance between observed counts of bivariate samples in suitably defined pairs of sets. The exact null distribution and non-null distribution, for specified classes of alternatives, of the test statistics are obtained. The null distribution is tabulated for sample size from n=5 up to n=30. The null mean, null variance and the asymptotic null distributions of the proposed test statistics are also obtained. The empirical power of the proposed test is evaluated by simulating samples from the suitable class of bivariate distributions. The empirical findings suggest that the test performs reasonably well against various classes of asymmetric bivariate distributions. Further, it is advocated that the basic idea developed in this work can be easily adopted to test the hypotheses of exchangeability of bivariate random variables and also bivariate symmetry about a given axis which have been considered by several authors in the past.     

Rate of uniform consistency for nonparametric estimates with functional variables

In this paper we investigate nonparametric estimation of some functionals of the conditional distribution of a scalar response variable Y given a random variable X taking values in a semi-metric space. These functionals include the regression function, the conditional cumulative distribution, the conditional density and some other ones. The literature on nonparametric functional statistics is only concerning pointwise consistency results, and our main aim is to prove the uniform almost complete convergence (with rate) of the kernel estimators of these nonparametric models. Unlike in standard multivariate cases, the gap between pointwise and uniform results is not immediate. So, suitable topological considerations are needed, implying changes in the rates of convergence which are quantified by entropy considerations. These theoretical uniform consistency results are (or will be) key tools for many further developments in functional data analysis.     

Will the ASA's Efforts to Improve Statistical Practice be Successful? Some Evidence to the Contrary

ABSTRACT

Recent efforts by the American Statistical Association to improve statistical practice, especially in countering the misuse and abuse of null hypothesis significance testing (NHST) and p-values, are to be welcomed. But will they be successful? The present study offers compelling evidence that this will be an extraordinarily difficult task. Dramatic citation-count data on 25 articles and books severely critical of NHST's negative impact on good science, underlining that this issue was/is well known, did nothing to stem its usage over the period 1960–2007. On the contrary, employment of NHST increased during this time. To be successful in this endeavor, as well as restoring the relevance of the statistics profession to the scientific community in the 21st century, the ASA must be prepared to dispense detailed advice. This includes specifying those situations, if they can be identified, in which the p-value plays a clearly valuable role in data analysis and interpretation. The ASA might also consider a statement that recommends abandoning the use of p-values.     

Nonparametric control charts based on order statistics: Some advances

ABSTRACT

In this article, we introduce new nonparametric Shewhart-type control charts that take into account the location of two order statistics of the test sample as well as the number of observations in that sample that lie between the control limits. Exact formulae for the alarm rate, the run length distribution and the average run length (ARL) are all derived. A key advantage of the new charts is that, due to its nonparametric nature, the false alarm rate (FAR) and in-control run length distribution is the same for all continuous process distributions. Tables are provided for the implementation of the proposed charts for some typical FAR and ARL values. Furthermore, a numerical study carried out reveals that the new charts are quite flexible and efficient in detecting shifts to Lehmann-type out-of-control situations, while they seem preferable from a robustness point of view in comparison with the distribution-free control chart of Balakrishnan et al. (2009).     

Nonparametric estimation of extreme conditional quantiles

The estimation of extreme conditional quantiles is an important issue in different scientific disciplines. Up to now, the extreme value literature focused mainly on estimation procedures based on independent and identically distributed samples. Our contribution is a two-step procedure for estimating extreme conditional quantiles. In a first step nonextreme conditional quantiles are estimated nonparametrically using a local version of [Koenker, R. and Bassett, G. (1978). Regression quantiles. Econometrica, 46, 33–50.] regression quantile methodology. Next, these nonparametric quantile estimates are used as analogues of univariate order statistics in procedures for extreme quantile estimation. The performance of the method is evaluated for both heavy tailed distributions and distributions with a finite right endpoint using a small sample simulation study. A bootstrap procedure is developed to guide in the selection of an optimal local bandwidth. Finally the procedure is illustrated in two case studies.     

Minimum distance lack-of-fit tests for fixed design

This paper discusses a class of tests of lack-of-fit of a parametric regression model when design is non-random and uniform on [0,1]. These tests are based on certain minimized distances between a nonparametric regression function estimator and the parametric model being fitted. We investigate asymptotic null distributions of the proposed tests, their consistency and asymptotic power against a large class of fixed and sequences of local nonparametric alternatives, respectively. The best fitted parameter estimate is seen to be n^1/2-consistent and asymptotically normal. A crucial result needed for proving these results is a central limit lemma for weighted degenerate U statistics where the weights are arrays of some non-random real numbers. This result is of an independent interest and an extension of a result of Hall for non-weighted degenerate U statistics.     

Nonparametric estimators for quantile density function under length-biased sampling

Abstract

In this article, the strong uniform consistency of two nonparametric estimators for the quantile density function is established under length-biased sampling. The rate of the strong approximation of the resulting processes of these estimators will be presented as well. A Monte Carlo simulation study is carried out to compare the proposed estimators with each other in terms of mean squared errors.     

Application domains for the Delta method

The Delta method uses truncated Lagrange expansions of statistics to obtain approximations to their distributions. In this paper, we consider statistics Y=g(μ+X), where X is any random vector. We obtain domains 𝒟 such that, when μ∈𝒟, we may apply the distribution derived from the Delta method. Namely, we will consider an application on the normal case to illustrate our approach.     

Edgeworth expansions for nonparametric distribution estimation with applications

In this paper, we will investigate the nonparametric estimation of the distribution function F of an absolutely continuous random variable. Two methods are analyzed: the first one based on the empirical distribution function, expressed in terms of i.i.d. lattice random variables and, secondly, the kernel method, which involves nonlattice random vectors dependent on the sample size n; this latter procedure produces a smooth distribution estimator that will be explicitly corrected to reduce the effect of bias or variance. For both methods, the non-Studentized and Studentized statistics are considered as well as their bootstrap counterparts and asymptotic expansions are constructed to approximate their distribution functions via the Edgeworth expansion techniques. On this basis, we will obtain confidence intervals for F(x) and state the coverage error order achieved in each case.     

Test of symmetry based on copula function

We introduce some new nonparametric statistical tests of symmetry. The limiting behaviors of the proposed statistics are established under the null hypothesis. Emphasis is placed on explanation of the strong approximation methodology. The asymptotic validity of a re-sampling method to compute p-values is also established. A simulation study for some considered statistics is performed.     

Nonparametric Estimation of Distribution Functions of Nonstandard Mixtures

ABSTRACT

Nonstandard mixtures are those that result from a mixture of a discrete and a continuous random variable. They arise in practice, for example, in medical studies of exposure. Here, a random variable that models exposure might have a discrete mass point at no exposure, but otherwise may be continuous. In this article we explore estimating the distribution function associated with such a random variable from a nonparametric viewpoint. We assume that the locations of the discrete mass points are known so that we will be able to apply a classical nonparametric smoothing approach to the problem. The proposed estimator is a mixture of an empirical distribution function and a kernel estimate of a distribution function. A simple theoretical argument reveals that existing bandwidth selection algorithms can be applied to the smooth component of this estimator as well. The proposed approach is applied to two example sets of data.     

Nonparametrics: The Early Years—Impressions and Recollections

In 1942 Wolfowitz introduced the term nonparametric into the statistical literature to call attention to the need for extending then-existing statistical theory beyond the customary parametric framework. Subsequently, statistical methods that did not depend on a strictly parametric setup became known as nonparametric methods. This article surveys developments in nonparametrics roughly up to 1960. The suggestion is made that statistics might be better served by eliminating the term nonparametric altogether from the statistical vocabulary.     

Statistical inference for oscillation processes

ABSTRACT

A new model for time series with a specific oscillation pattern is proposed. The model consists of a hidden phase process controlling the speed of polling and a nonparametric curve characterizing the pattern, leading together to a generalized state space model. Identifiability of the model is proved and a method for statistical inference based on a particle smoother and a nonparametric EM algorithm is developed. In particular, the oscillation pattern and the unobserved phase process are estimated. The proposed algorithms are computationally efficient and their performance is assessed through simulations and an application to human electrocardiogram recordings.     

On algorithms for ordinary least squares regression spline fitting: A comparative study

Regression spline smoothing is a popular approach for conducting nonparametric regression. An important issue associated with it is the choice of a "theoretically best" set of knots. Different statistical model selection methods, such as Akaike's information criterion and generalized cross-validation, have been applied to derive different "theoretically best" sets of knots. Typically these best knot sets are defined implicitly as the optimizers of some objective functions. Hence another equally important issue concerning regression spline smoothing is how to optimize such objective functions. In this article different numerical algorithms that are designed for carrying out such optimization problems are compared by means of a simulation study. Both the univariate and bivariate smoothing settings will be considered. Based on the simulation results, recommendations for choosing a suitable optimization algorithm under various settings will be provided.