Asymptotic joint distribution of sample quantiles and sample mean with applications

Based on a sample from an absolutely continuous distribution F with density f, and with the aid of the Bahadur (Ann. Math. Statist. 37( 1966 ), 577-580) representation of sample quantiles, the asymptotic joint distribution of three statistics, the sample p^th and q^th quantiles (0 < p < q < l) and the sample mean, is obtained. Using the Cramer-Wold device, asymptotic distributions of functions of the three statistics can be derived. In particular, the asymptotic joint distribution of the ratio of sample p^th quantile to sample mean and the ratio of sample q^th quantile to sample mean is presented. Finally, consistent estimators are proposed for the variances and covariances of these limiting distributions.     

On the error term in bahadur's representation of an order statistic

Bahadur (1966) presented a representation of an order statistic, giving its asymptotic distribution and the rate of convergence, under weak assumptions on the density function of the parent distribution. In this paper we consider the mean(squared) deviation of the error term in Bahadur’s approximation of the q th sample quantile (q_n ). We derive a uniform bound on the mean (squared) deviation of q_n , not depending on the value of q. An application of the given result provides the corresponding result for a kernel type estimator of the q th quantile.     

Reconciliation of asymptotics for unequal probability sampling without replacement

In simple random sampling without replacement (SRSWOR), certain reverse martingale structures render simple asymptotics for the conventional linear statistics. In unequal probability sampling (UPS) WOR, such martingale-based methodology may not be generally adoptable. General asymptotics for UPSWOR sampling schemes, developed by Hartley and Rao (Ann. Math. Statist. 33 (1962) 350), and Hájek (Ann. Math. Statist. 35 (1964) 1491), rest on different sets of regularity assumptions, and they differ in their treatise too. Some anomalies in this context are eliminated here with a reconciliation of both the approaches, and estimation of the asymptotic variance of linear estimators is considered in the same vein. Applications to small area sampling are also stressed.     

The Bahadur representation for sample quantiles under strongly mixing sequence

Sun [2006, The Bahadur representation for sample quantiles under weak dependence. Statist. Probab. Lett. 76, 1238-1244] established the Bahadur representation for sample quantiles under the strongly mixing sequence. But there are some problems in the proofs of the main results. In the paper, we further investigate the Bahadur representation for sample quantiles under strongly mixing sequence and get better bound than that in Sun (2006).     

Random coefficient regressions: parametric goodness-of-fit tests

Random coefficient regression models have been applied in different fields during recent years and they are a unifying frame for many statistical models. Recently, Beran and Hall (Ann. Statist. 20 (1992) 1970) raised the question of the nonparametric study of the coefficients distribution. Nonparametric goodness-of-fit tests were considered in Delicado and Romo (Ann. Inst. Statist. Math. 51 (1999) 125). In this nonparametric framework, the study of parametric families for the coefficient distributions was started by Beran (Ann. Inst. Statist. Math. (1993) 639). Here we propose statistics for parametric goodness-of-fit tests and we obtain their asymptotic distributions. Moreover, we construct bootstrap approximations to these distributions, proving their validity. Finally, a simulation study illustrates our results.     

Sequential point estimation of the means of u-statistics in finite population sampling

In simple random sampling without replacement from a finite population, sequential point estimators of the means of U-statistics are proposed. The proposed procedure is shown to be asymptotically risk efficient in the sense of Starr (Ann. Math. Statist. (1966), 1173-1185)     

Alternative estimators of the common regression matrix in two GMANOVA models under weighted quadratic losses

We consider the problem of estimating the common regression matrix of two GMANOVA models with different unknown covariance matrices under certain type of loss functions which include a weighted quadratic loss function as a special case. We consider a class of estimators, which contains the Graybill–Deal-type estimator proposed by Sugiura and Kubokawa (Ann. Inst. Statist. Math. 40 (1988) 119), and we give its risk representation via Kubokawa and Srivastava's (Ann. Statist. 27 (1999) 600; J. Multivariate Anal. 76 (2001) 138) identities when the error matrices follow the elliptically contoured distributions. Using the method similar to an approximate minimization of the unbiased risk estimate due to Stein (Studies in the Statistical Theory of Estimation, vol. 74, Nauka, Leningrad, 1977, p. 4), we obtain an alternative estimator to the Graybill–Deal-type estimator which was given under the normality assumption. However, it seems difficult to evaluate the risk of our proposed estimator analytically because of complex nature of its risk function. Instead, we conduct a Monte-Carlo simulation to evaluate the performance of our proposed estimator. The results indicate that our proposed estimator compares favorably with the Graybill–Deal-type estimator.     

Sur la linéarité asymptotique du premier ordre de statistiques de rang signé

Two first-order uniform asymptotic linearity theorems for signed-rank statistics are given which generalize similar theorems of Jure?ková [Sankhyā Ser. A, 33, 1-18 (1971)], van Eeden [Ann. Math. Statist., 43, 791-802 (1972)], and Kraft and van Eeden [Ann. Math. Statist., 43, 42-57 (1972)]. It is seen that the concordance conditions imposed by these authors are not needed.     

Empirical bayes estimation of a distribution function with a gamma process prior

A sequence of empirical Bayes estimators is given for estimating a distribution function. It is shown that ‘i’ this sequence is asymptotically optimum relative to a Gamma process prior, ‘ii’ the overall expected loss approaches the minimum Bayes risk at a rate of n , and ‘iii’ the estimators form a sequence of proper distribution functions. Finally, the numerical example presented by Susarla and Van Ryzin ‘Ann. Statist., 6, 1978’ reworked by Phadia ‘Ann. Statist., 1, 1980, to appear’ has been analyzed and the results are compared to the numerical results by Phadia     

Estimation of a scale parameter in mixture models with unknown location

Estimation of the scale parameter in mixture models with unknown location is considered under Stein's loss. Under certain conditions, the inadmissibility of the “usual” estimator is established by exhibiting better estimators. In addition, robust improvements are found for a specified submodel of the original model. The results are applied to mixtures of normal distributions and mixtures of exponential distributions. Improved estimators of the variance of a normal distribution are shown to be robust under any scale mixture of normals having variance greater than the variance of that normal distribution. In particular, Stein's (Ann. Inst. Statist. Math. 16 (1964) 155) and Brewster's and Zidek's (Ann. Statist. 2 (1974) 21) estimators obtained under the normal model are robust under the t model, for arbitrary degrees of freedom, and under the double-exponential model. Improved estimators for the variance of a t distribution with unknown and arbitrary degrees of freedom are also given. In addition, improved estimators for the scale parameter of the multivariate Lomax distribution (which arises as a certain mixture of exponential distributions) are derived and the robustness of Zidek's (Ann. Statist. 1 (1973) 264) and Brewster's (Ann. Statist. 2 (1974) 553) estimators of the scale parameter of an exponential distribution is established under a class of modified Lomax distributions.     

Some aspects of statistical inference on the lagrange (generalized) poisson distribution

A generalization of the Poisson distribution was defined by Consul and Jain (Ann. Math. Statist., 41, (1970)) and was obtained as a particular family of Lagrange distributions by Consul and Shenton (SIAM. J. Appl. Math., 23, (1972)). The distribution is subsequently named the generalized Poisson distribution (GPD). This GPD reduces to the Poisson distribution for ? = 0. When the data have a one-way layout structure, the asymptotically locally optimal Neyman's C(d) test is constructed and compared with the conditional test on the hypothesis H_o? = 0. Within the framework of the generalized linear models an appropriate link function is given, and the asymptotic distributions of the estimated parameters are derived.     

Simulation from the bessel distribution with applications

The Bessel distribution, introduced recently by Yuan and Kalbfleisch (Ann. Inst. Math. Statist., 2000), can be useful in many applications. In particular, this distribution appears in two Bayesian estimation problems, namely, estimation of the noncentrality parameter of a noncentral chi-square distribution and of the parameters of Downton's bivariate exponential distribution. Implementation of Markov chain Monte Carlo algorithms requires generation of observations from the Bessel distribution. In this paper we propose and compare exact simulation schemes generating Bessel variates based on certain properties of the distribution as well as the rejection method.     

On characterizations of the logistic distribution

We modify and extend George and Mudholkar's [1981. A characterization of the logistic distribution by a sample median. Ann. Inst. Statist. Math. 33, 125–129] characterization result about the logistic distribution, which is in terms of the sample median and Laplace distribution. Moreover, we give some new characterization results in terms of the smallest order statistics and the exponential distribution.     

Exact distribution of the MLEs of the parameters and of the quantiles of two-parameter exponential distribution under hybrid censoring

Epstein [Truncated life tests in the exponential case, Ann. Math. Statist. 25 (1954), pp. 555–564] introduced a hybrid censoring scheme (called Type-I hybrid censoring) and Chen and Bhattacharyya [Exact confidence bounds for an exponential parameter under hybrid censoring, Comm. Statist. Theory Methods 17 (1988), pp. 1857–1870] derived the exact distribution of the maximum-likelihood estimator (MLE) of the mean of a scaled exponential distribution based on a Type-I hybrid censored sample. Childs et al. [Exact likelihood inference based on Type-I and Type-II hybrid censored samples from the exponential distribution, Ann. Inst. Statist. Math. 55 (2003), pp. 319–330] provided an alternate simpler expression for this distribution, and also developed analogous results for another hybrid censoring scheme (called Type-II hybrid censoring). The purpose of this paper is to derive the exact bivariate distribution of the MLE of the parameter vector of a two-parameter exponential model based on hybrid censored samples. The marginal distributions are derived and exact confidence bounds for the parameters are obtained. The results are also used to derive the exact distribution of the MLE of the pth quantile, as well as the corresponding confidence bounds. These exact confidence intervals are then compared with parametric bootstrap confidence intervals in terms of coverage probabilities. Finally, we present some numerical examples to illustrate the methods of inference developed here.     

Sequential estimation for semiparametric models with application to the proportional hazards model

In this paper, we show that if the Euclidean parameter of a semiparametric model can be estimated through an estimating function, we can extend straightforwardly conditions by Dmitrienko and Govindarajulu [2000. Ann. Statist. 28 (5), 1472–1501] in order to prove that the estimator indexed by any regular sequence (sequential estimator), has the same asymptotic behavior as the non-sequential estimator. These conditions also allow us to obtain the asymptotic normality of the stopping rule, for the special case of sequential confidence sets. These results are applied to the proportional hazards model, for which we show that after slight modifications, the classical assumptions given by Andersen and Gill [1982. Ann. Statist. 10(4), 1100–1120] are sufficient to obtain the asymptotic behavior of the sequential version of the well-known [Cox, 1972. J. Roy. Statist. Soc. Ser. B (34), 187–220] partial maximum likelihood estimator. To prove this result we need to establish a strong convergence result for the regression parameter estimator, involving mainly exponential inequalities for both continuous martingales and some basic empirical processes. A typical example of a fixed-width confidence interval is given and illustrated by a Monte Carlo study.     

On Non-parametric Testing, the Uniform Behaviour of the t-test, and Related Problems

Abstract.  In this article, we revisit some problems in non-parametric hypothesis testing. First, we extend the classical result of Bahadur & Savage [ Ann. Math. Statist . 25 (1956) 1115] to other testing problems, and we answer a conjecture of theirs. Other examples considered are testing whether or not the mean is rational, testing goodness-of-fit, and equivalence testing. Next, we discuss the uniform behaviour of the classical t -test. For most non-parametric models, the Bahadur–Savage result yields that the size of the t -test is one for every sample size. Even if we restrict attention to the family of symmetric distributions supported on a fixed compact set, the t -test is not even uniformly asymptotically level α . However, the convergence of the rejection probability is established uniformly over a large family with a very weak uniform integrability type of condition. Furthermore, under such a restriction, the t -test possesses an asymptotic maximin optimality property.     

On nonparametric regression estimators based on regression quantiles

In the ciassical regression model Y_i=h(x_i) + ? _i, i=1,…,n, Cheng (1984) introduced linear combinations of regression quantiles as a new class of estimators for the unknown regression function h(x). The asymptotic properties studied in Cheng (1984) are reconsidered. We obtain a sharper scrong consistency rate and we improve on the conditions for asymptotic normality by proving a new result on the remainder term in the Bahadur representation for regression quantiles.     

Asymptotic expansions of the null distributions of some test statistics for profile analysis in general distributions

This paper discusses asymptotic expansions for the null distributions of some test statistics for profile analysis under non-normality. It is known that the null distributions of these statistics converge to chi-square distribution under normality [Siotani, M., 1956. On the distributions of the Hotelling's T²$T^2$-statistics. Ann. Inst. Statist. Math. Tokyo 8, 1–14; Siotani, M., 1971. An asymptotic expansion of the non-null distributions of Hotelling's generalized T²$T^2$-statistic. Ann. Math. Statist. 42, 560–571]. We extend this result by obtaining asymptotic expansions under general distributions. Moreover, the effect of non-normality is also considered. In order to obtain all the results, we make use of matrix manipulations such as direct products and symmetric tensor, rather than usual elementwise tensor notation.     

Alternative posterior consistency results in nonparametric binary regression using Gaussian process priors

We establish consistency of posterior distribution when a Gaussian process prior is used as a prior distribution for the unknown binary regression function. Specifically, we take the work of Ghosal and Roy [2006. Posterior consistency of Gaussian process prior for nonparametric binary regression. Ann. Statist. 34, 2413–2429] as our starting point, and then weaken their assumptions on the smoothness of the Gaussian process kernel while retaining a stronger yet applicable condition about design points. Furthermore, we extend their results to multi-dimensional covariates under a weaker smoothness condition on the Gaussian process. Finally, we study the extent to which posterior consistency can be achieved under a general model where, when additional hyperparameters in the covariance function of a Gaussian process are involved.     

Quadratic estimators of covariance components in a multivariate mixed linear model

It is known that the Henderson Method III (Biometrics 9:226–252, 1953) is of special interest for the mixed linear models because the estimators of the variance components are unaffected by the parameters of the fixed factor (or factors). This article deals with generalizations and minor extensions of the results obtained for the univariate linear models. A MANOVA mixed model is presented in a convenient form and the covariance components estimators are given on finite dimensional linear spaces. The results use both the usual parametric representations and the coordinate-free approach of Kruskal (Ann Math Statist 39:70–75, 1968) and Eaton (Ann Math Statist 41:528–538, 1970). The normal equations are generalized and it is given a necessary and sufficient condition for the existence of quadratic unbiased estimators for covariance components in the considered model.