An asymptotically distribution-free test of symmetry

A procedure, based on sample spacings, is proposed for testing whether a univariate distribution is symmetric about some unknown value. The proposed test is a modification of a sign test suggested by Antille and Kersting [1977. Tests for symmetry. Z. Wahrscheinlichkeitstheorie verw. Gebiete 39, 235–255], but unlike Antille and Kersting's test, our modified test is asymptotically distribution-free and is usable in practice. A simulation study indicates that the proposed test maintains the nominal level of significance, α$\alpha$ fairly accurately even for samples of size as small as 20, and a comparison with the classical test based on sample coefficient of skewness, shows that our test has good power for detecting different asymmetric distributions.     

On the asymptotic behaviour of location-scale invariant Bickel–Rosenblatt tests

Location-scale invariant Bickel–Rosenblatt goodness-of-fit tests (IBR tests) are considered in this paper to test the hypothesis that f, the common density function of the observed independent d-dimensional random vectors, belongs to a null location-scale family of density functions. The asymptotic behaviour of the test procedures for fixed and non-fixed bandwidths is studied by using an unifying approach. We establish the limiting null distribution of the test statistics, the consistency of the associated tests and we derive its asymptotic power against sequences of local alternatives. These results show the asymptotic superiority, for fixed and local alternatives, of IBR tests with fixed bandwidth over IBR tests with non-fixed bandwidth.     

Sufficient conditions for Bayesian consistency

We introduce the Hausdorff α$\alpha$-entropy to study the strong Hellinger consistency of posterior distributions. We obtain general Bayesian consistency theorems which extend the well-known results of Barron et al. [1999. The consistency of posterior distributions in nonparametric problems. Ann. Statist. 27, 536–561] and Ghosal et al. [1999. Posterior consistency of Dirichlet mixtures in density estimation. Ann. Statist. 27, 143–158] and Walker [2004. New approaches to Bayesian consistency. Ann. Statist. 32, 2028–2043]. As an application we strengthen previous results on Bayesian consistency of the (normal) mixture models.     

Joint modeling of degradation and failure time data

This paper surveys some approaches to model the relationship between failure time data and covariate data like internal degradation and external environmental processes. These models which reflect the dependency between system state and system reliability include threshold models and hazard-based models. In particular, we consider the class of degradation–threshold–shock models (DTS models) in which failure is due to the competing causes of degradation and trauma. For this class of reliability models we express the failure time in terms of degradation and covariates. We compute the survival function of the resulting failure time and derive the likelihood function for the joint observation of failure times and degradation data at discrete times. We consider a special class of DTS models where degradation is modeled by a process with stationary independent increments and related to external covariates through a random time scale and extend this model class to repairable items by a marked point process approach. The proposed model class provides a rich conceptual framework for the study of degradation–failure issues.     

Some nonparametric precedence-type tests based on progressively censored samples and evaluation of power

In this paper, we consider the problem of testing the equality of two distributions when both samples are progressively Type-II censored. We discuss the following two statistics: one based on the Wilcoxon-type rank-sum precedence test, and the second based on the Kaplan–Meier estimator of the cumulative distribution function. The exact null distributions of these test statistics are derived and are then used to generate critical values and the corresponding exact levels of significance for different combinations of sample sizes and progressive censoring schemes. We also discuss their non-null distributions under Lehmann alternatives. A power study of the proposed tests is carried out under Lehmann alternatives as well as under location-shift alternatives through Monte Carlo simulations. Through this power study, it is shown that the Wilcoxon-type rank-sum precedence test performs the best.     

Some properties of tests for parameters that can be arbitrarily close to being unidentified

Confidence intervals for parameters that can be arbitrarily close to being unidentified are unbounded with positive probability [e.g. Dufour, J.-M., 1997. Some impossibility theorems in econometrics with applications to instrumental variables and dynamic models. Econometrica 65, 1365–1388; Pfanzagl, J. 1998. The nonexistence of confidence sets for discontinuous functionals. Journal of Statistical Planning and Inference 75, 9–20], and the asymptotic risks of their estimators are unbounded [Pötscher, B.M., 2002. Lower risk bounds and properties of confidence sets for ill-posed estimation problems with applications to spectral density and persistence estimation, unit roots, and estimation of long memory parameters. Econometrica 70, 1035–1065]. We extend these “impossibility results” and show that all tests of size α concerning parameters that can be arbitrarily close to being unidentified have power that can be as small as α for any sample size even if the null and the alternative hypotheses are not adjacent. The results are proved for a very general framework that contains commonly used models.     

On the uth geometric conditional quantile

Motivated by Chaudhuri's work [1996. On a geometric notion of quantiles for multivariate data. J. Amer. Statist. Assoc. 91, 862–872] on unconditional geometric quantiles, we explore the asymptotic properties of sample geometric conditional quantiles, defined through kernel functions, in high-dimensional spaces. We establish a Bahadur-type linear representation for the geometric conditional quantile estimator and obtain the convergence rate for the corresponding remainder term. From this, asymptotic normality including bias on the estimated geometric conditional quantile is derived. Based on these results, we propose confidence ellipsoids for multivariate conditional quantiles. The methodology is illustrated via data analysis and a Monte Carlo study.     

Nonparametric estimation of the conditional distribution function in a semiparametric censorship model

In this paper we propose a new nonparametric estimator of the conditional distribution function under a semiparametric censorship model. We establish an asymptotic representation of the estimator as a sum of iid random variables, balanced by some kernel weights. This representation is used for obtaining large sample results such as the rate of uniform convergence of the estimator, or its limit distributional law. We prove that the new estimator outperforms the conditional Kaplan–Meier estimator for censored data, in the sense that it exhibits lower asymptotic variance. Illustration through real data analysis is provided.     

A bias correction and acceleration approach for the problem of regions

For testing the problem of regions in the space of distribution functions, this paper considers approaches to modify the bootstrap probability to be a second-order accurate p$p$-value based on the familiar bias correction and acceleration method. It is shown that Shimodaira's [2004a. Approximately unbiased tests of regions using multistep-multiscale bootstrap resampling. Ann. Statist. 32, 2616–2641] twostep-multiscale bootstrap method works even in the problem of regions in functional space. In this paper the bias correction quantity is estimated by his onestep-multiscale bootstrap method. Instead of using the twostep-multiscale bootstrap method, the acceleration constant is estimated by a newly proposed jackknife method which requires first-level bootstrap resamplings only. Some numerical examples are illustrated, in which an application to testing significance in model selection is included.     

Minimax optimality of the Shiryayev–Roberts change-point detection rule

The result of Pollak [1985. Optimal detection of a change in distribution. Ann. Statist. 13, 206–227] proving the asymptotic optimality in sequential change-point detection of a suitable Shirayayev–Roberts stopping rule up to terms that vanish in the limit is generalized from the case of two completely specified distributions to that of a composite alternative hypothesis in a multidimensional exponential family. An explicit asymptotic lower bound on the expected Kullback–Leibler information required to detect a change-point is derived and is shown to be attained by a Shirayayev–Roberts stopping rule.     

Erratum to “Progressively Type-II right censored order statistics from discrete distributions” [J. Statist. Plann. Inference 138 (2008) 845–856]

In this note, we correct the proof of Representation 1 of Balakrishnan and Dembińska [2008. Progressively Type-II right censored order statistics from discrete distributions. J. Statist. Plann. Inference 138, 845–856] which relates the joint distribution of progressively Type-II right censored order statistics corresponding to an arbitrary population to progressively Type-II right censored order statistics from the standard uniform distribution.     

Adaptation over parametric families of symmetric linear estimators

This paper treats an abstract parametric family of symmetric linear estimators for the mean vector of a standard linear model. The estimator in this family that has smallest estimated quadratic risk is shown to attain, asymptotically, the smallest risk achievable over all candidate estimators in the family. The asymptotic analysis is carried out under a strong Gauss–Markov form of the linear model in which the dimension of the regression space tends to infinity. Leading examples to which the results apply include: (a) penalized least squares fits constrained by multiple, weighted, quadratic penalties; and (b) running, symmetrically weighted, means. In both instances, the weights define a parameter vector whose natural domain is a continuum.     

Partial derivatives and confidence intervals of bivariate tail dependence functions

Bivariate extreme value theory was used to estimate a rare event (see de Haan and de Ronde [1998. Sea and wind: multivariate extremes at work. Extremes 1, 7–45]). This procedure involves estimating a tail dependence function. There are several estimators for the tail dependence function in the literature, but their limiting distributions depend on partial derivatives of the tail dependence function. In this paper smooth estimators are proposed for estimating partial derivatives of bivariate tail dependence functions and their asymptotic distributions are derived as well. A simulation study is conducted to compare different estimators of partial derivatives in terms of both mean squared errors and coverage accuracy of confidence intervals of the bivariate tail dependence function based on these different estimators of partial derivatives.     

Multivariate spatial U-quantiles: A Bahadur–Kiefer representation,a Theil–Sen estimator for multiple regression,and a robust dispersion estimator

A leading multivariate extension of the univariate quantiles is the so-called “spatial” or “geometric” notion, for which sample versions are highly robust and conveniently satisfy a Bahadur–Kiefer representation. Another extension of univariate quantiles has been to univariate U-quantiles, on the basis of which, for example, the well-known Hodges–Lehmann location estimator has a natural formulation. Generalizing both extensions, we introduce multivariate spatial U-quantiles and develop a corresponding Bahadur–Kiefer representation. New statistics based on spatial U-quantiles are presented for nonparametric estimation of multiple regression coefficients, extending the classical Theil–Sen nonparametric simple linear regression slope estimator, and for robust estimation of multivariate dispersion. Some other applications are mentioned as well.     

Asymptotic properties of numbers of near minimum observations under progressive Type-II censoring

In this paper, some results of Pakes and Steutel [1997. On the number of records near the maximum, Austral. J. Statist. 39, 179–193] on the properties of the numbers of near order statistic observations are extended to the case of progressively Type-II censored data. In this way, we introduce the notion of the numbers of near minimum observations under progressive censoring. We derive distributional and asymptotic results for them and discuss the notion of the “increasing” sample in the case of progressive censoring. Some applications for the spacings, associated with the order statistics from progressively Type-II censored samples, are also provided.     

A LAN based Neyman smooth test for Pareto distributions

The Pareto distribution is found in a large number of real world situations and is also a well-known model for extreme events. In the spirit of Neyman [1937. Smooth tests for goodness of fit. Skand. Aktuarietidskr. 20, 149–199] and Thomas and Pierce [1979. Neyman's smooth goodness-of-fit test when the hypothesis is composite. J. Amer. Statist. Assoc. 74, 441–445], we propose a smooth goodness of fit test for the Pareto distribution family which is motivated by LeCam's theory of local asymptotic normality (LAN). We establish the behavior of the associated test statistic firstly under the null hypothesis that the sample follows a Pareto distribution and secondly under local alternatives using the LAN framework. Finally, simulations are provided in order to study the finite sample behavior of the test statistic.     

The convolution theorem for estimating linear functionals in indirect nonparametric regression models

Nonparametric regression—directly or indirectly observed—is one of the important statistical models. On one hand it contains two infinite dimensional parameters (the regression function and the error density), and on the other it is of rather simple structure. Therefore, it may serve as an interesting paradigm for illustrating or developing abstract statistical theory for non-Euclidean parameters. In this paper estimation of a linear functional of the indirectly observed regression function is considered, when a deterministic design is used. It should be noted that any Fourier coefficient of an expansion of the regression function in an orthonormal basis is such a functional. Because the design is deterministic the observables are independent but not identically distributed. Local asymptotic normality is established and applied to prove Hájek's convolution theorem for this functional. Pertinent references are Beran [1977. Robust location estimates. Ann. Statist. 5, 431–444] and McNeney and Wellner [2000. Application of convolution theorems in semiparametric models with non-i.i.d. data. J. Statist. Plann. Inference 91, 441–480]. For purposes explained above, however, the paper is kept self-contained and full proofs are provided.     

Robust permutation tests for two samples

We consider robust permutation tests for a location shift in the two sample case based on estimating equations, comparing the test statistics based on a score function and an M-estimate. First we obtain a form for both tests so that the exact tests may be carried out using the same algorithms as used for permutation tests based on the mean. Then we obtain the Bahadur slopes of the tests in these two statistics, giving numerical results for two cases equivalent to a test based on Huber scores and a particular case of this related to a median test. We show that they have different Bahadur slopes with neither exceeding the other over the whole range. Finally, we give some numerical results illustrating the robustness properties of the tests and confirming the theoretical results on Bahadur slopes.     

Efficiency of weighted averages

When combining estimates of a common parameter (of dimension d?1$d?1$) from independent data sets—as in stratified analyses and meta analyses—a weighted average, with weights ‘proportional’ to inverse variance matrices, is shown to have a minimal variance matrix (a standard fact when d=1$d=1$)—minimal in the sense that all convex combinations of the coordinates of the combined estimate have minimal variances. Minimum variance for the estimation of a single coordinate of the parameter can therefore be achieved by joint estimation of all coordinates using matrix weights. Moreover, if each estimate is asymptotically efficient within its own data set, then this optimally weighted average, with consistently estimated weights, is shown to be asymptotically efficient in the combined data set and avoids the need to merge the data sets and estimate the parameter in question afresh. This is so whatever additional non-common nuisance parameters may be in the models for the various data sets. A special case of this appeared in Fisher [1925. Theory of statistical estimation. Proc. Cambridge Philos. Soc. 22, 700–725.]: Optimal weights are ‘proportional’ to information matrices, and he argued that sample information should be used as weights rather than expected information, to maintain second-order efficiency of maximum likelihood. A number of special cases have appeared in the literature; we review several of them and give additional special cases, including stratified regression analysis—proportional-hazards, logistic or linear—, combination of independent ROC curves, and meta analysis. A test for homogeneity of the parameter across the data sets is also given.     

A class of count models and a new consistent test for the Poisson distribution

We define a class of count distributions which includes the Poisson as well as many alternative count models. Then the empirical probability generating function is utilized to construct a test for the Poisson distribution, which is consistent against this class of alternatives. The limit distribution of the test statistic is derived in case of a general underlying distribution, and efficiency considerations are addressed. A simulation study indicates that the new test is comparable in performance to more complicated omnibus tests.