Bhattacharyya-Type Information Inequality for the Bayes Risk

Lower bounds for the Bayes risk are obtained. The bounds improve the Brown-Gajek bound and the asymptotic expression is derived. As an application of the bound, lower bounds for the local minimax and Bayes prediction risk are also given.     

Bhattacharyya and Kshirsagar Bounds in Generalized Gamma Distribution

In this article, we consider the exact computation of the famous halfspace depth (HD) and regression depth (RD) from the view of cutting a convex cone with hyperplanes. Two new algorithms are proposed for computing these two notions of depth. The first one is relatively straightforward but quite inefficient, whereas the second one is much faster. It is noteworthy that both of them can be implemented to spaces with dimension beyond three. Some numerical examples are also provided in what follows to illustrate the performances.     

Kshirsagar-Type Lower Bounds for Mean Squared Error of Prediction

Let Y be an observable random vector and Z be an unobserved random variable with joint density f(y, z | θ), where θ is an unknown parameter vector. Considering the problem of predicting Z based on Y, we derive Kshirsagar type lower bounds for the mean squared error of any predictor of Z. These bounds do not require the regularity conditions of Bhattacharyya bounds and hence are more widely applicable. Moreover, the new bounds are shown to be sharper than the corresponding Bhattacharyya bounds. The conditions for attaining the new lower bounds are useful for easy derivation of best unbiased predictors, which we illustrate with some examples.     

On a Relation Between a Family of Distributions Attaining the Bhattacharyya Bound and That of Linear Combinations of the Distributions from an Exponential Family

Abstract

An unbiased estimation problem of a function g(θ) of a real parameter is considered. A relation between a family of distributions for which an unbiased estimator of a function g(θ) attains the general order Bhattacharyya lower bound and that of linear combinations of the distributions from an exponential family is discussed. An example on a family of distributions involving an exponential and a double exponential distributions with a scale parameter is given. An example on a normal distribution with a location parameter is also given.     

Variance bounds for estimators in autoregressive models with constraints

We consider nonlinear and heteroscedastic autoregressive models whose residuals are martingale increments with conditional distributions that fulfil certain constraints. We treat two classes of constraints: residuals depending on the past through some function of the past observations only, and residuals that are invariant under some finite group of transformations. We determine the efficient influence function for estimators of the autoregressive parameter in such models, calculate variance bounds, discuss information gains, and suggest how to construct efficient estimators. Without constraints, efficient estimators can be given by weighted least squares estimators. With the constraints considered here, efficient estimators are obtained differently, as one-step improvements of some initial estimator, similarly as in autoregressive models with independent increments.     

Goodness-of-Fit Tests for the Skew-Normal Distribution When the Parameters Are Estimated from the Data

In this article, tests are developed which can be used to investigate the goodness-of-fit of the skew-normal distribution in the context most relevant to the data analyst, namely that in which the parameter values are unknown and are estimated from the data. We consider five test statistics chosen from the broad Cramér–von Mises and Kolmogorov–Smirnov families, based on measures of disparity between the distribution function of a fitted skew-normal population and the empirical distribution function. The sampling distributions of the proposed test statistics are approximated using Monte Carlo techniques and summarized in easy to use tabular form. We also present results obtained from simulation studies designed to explore the true size of the tests and their power against various asymmetric alternative distributions.     

An integral formula for the distribution of self-normalized Gaussian random samples

Given i.i.d. Gaussian random variables and after standardizing the sample by subtracting the sample mean and dividing it by the sample deviation, we obtain an integral formula for the distribution of these self-normalized variables. Using geometrical arguments, we obtain the distribution of each and the joint distribution of two of them. These formulas can be used to calculate the expected value of the particular type of Cramér von Mises statistic to test normality.     

Minimum-Distance Estimator for Stable Exponent

Assume that X ₁, X ₂,…, X _n is a sequence of i.i.d. random variables with α-stable distribution (α ∈ (0,2], the stable exponent, is the unknown parameter). We construct minimum distance estimators for α by minimizing the Kolmogorov distance or the Cramér–von-Mises distance between the empirical distribution function G _n , and a class of distributions defined based on the sum-preserving property of stable random variables. The minimum distance estimators can also be obtained by minimizing a U-statistic estimate of an empirical distribution function involving the stable exponent. They share the same invariance property with the maximum likelihood estimates. In this article, we prove the strong consistency of the minimum distance estimators. We prove the asymptotic normality of our estimators. Simulation study shows that the new estimators are competitive to the existing ones and perform very closely even to the maximum likelihood estimator.     

A Goodness-of-Fit Test for a Class of Autoregressive Conditional Duration Models

This article develops a method for testing the goodness-of-fit of a given parametric autoregressive conditional duration model against unspecified nonparametric alternatives. The test statistics are functions of the residuals corresponding to the quasi maximum likelihood estimate of the given parametric model, and are easy to compute. The limiting distributions of the test statistics are not free from nuisance parameters. Hence, critical values cannot be tabulated for general use. A bootstrap procedure is proposed to implement the tests, and its asymptotic validity is established. The finite sample performances of the proposed tests and several other competing ones in the literature, were compared using a simulation study. The tests proposed in this article performed well consistently throughout, and they were either the best or close to the best. None of the tests performed uniformly the best. The tests are illustrated using an empirical example.     

Non-parametric weighted tests for independence based on empirical copula process

We propose a class of flexible non-parametric tests for the presence of dependence between components of a random vector based on weighted Cramér–von Mises functionals of the empirical copula process. The weights act as a tuning parameter and are shown to significantly influence the power of the test, making it more sensitive to different types of dependence. Asymptotic properties of the test are stated in the general case, for an arbitrary bounded and integrable weighting function, and computational formulas for a number of weighted statistics are provided. Several issues relating to the choice of the weights are discussed, and a simulation study is conducted to investigate the power of the test under a variety of dependence alternatives. The greatest gain in power is found to occur when weights are set proportional to true deviations from independence copula.     

Lower bounds on Bayes risks for estimating a normal variance: With applications

Brown and Gajek (1990) gave useful lower bounds on Bayes risks, which improve on earlier bounds by various authors. Many of these use the information inequality. For estimating a normal variance using the invariant quadratic loss and any arbitrary prior on the reciprocal of the variance that is a mixture of Gamma distributions, we obtain lower bounds on Bayes risks that are different from Borovkov-Sakhanienko bounds. The main tool is convexity of appropriate functionals as opposed to the information inequality. The bounds are then applied to many specific examples, including the multi-Bayesian setup (Zidek and his coauthors). Subsequent use of moment theory and geometry gives a number of new results on efficiency of estimates which are linear in the sufficient statistic. These results complement earlier results of Donoho, Liu and MacGibbon (1990), Johnstone and MacGibbon (1992) and Vidakovic and DasGupta (1994) for the location case.     

Testing goodness-of-fit for some lifetime distributions with conventional Type-I censoring

A goodness-of-fit test procedure is proposed for some lifetime distributions when the available data are subject to Type-I censoring. The proposed method extends the test procedure of Pakyari and Balakrishnan to other lifetime distributions. The extension to Weibull and log-normal models is studied in details. The new test recovers the nominal level of significance and exhibits more power in comparison to the existing tests for several alternative distributions by means of Monte Carlo simulations. Finally, a real dataset is considered for illustrative purposes.     

A Statistical Reanalysis of the Classical Rutherford's Experiment

Modified chi-squared and some newly developed tests for the Poisson, binomial, and an approximated Feller's distribution are discussed. A reanalysis of the classical Rutherford's experimental data on alpha decay is done. Previous analyses of the data were not correct from the point of view of the theory of statistical testing. Tests used show that the data contradict to both Poisson and binomial distribution and do not contradict to a precise “binomial” approximation of Feller's distribution that takes into account a counter's dead time. This gives a plausible statistically correct confirmation of the well-established exponential law of radioactive decay.     

A hierarchical Bayes analysis for one-shot device testing experiment under the assumption of exponentiality

The article considers a two-stage hierarchical Bayes technique to analyze a dataset coming from a “one-shot” device testing experiment. The development is based on the assumption of exponential model for the lifetimes with failure rate regressed according to the Cox proportional hazards model. The Bayes implementation is done through a Gibbs–Metropolis hybridization scheme that easily entertains the missing data cases as well. Lastly, numerical illustration is provided based on a real data example on electro-explosive devices. The results show that the Bayesian method performs considerably well for such type of experiments.     

An efficient algorithm for estimating the parameters of superimposed exponential signals

An efficient computational algorithm is proposed for estimating the parameters of undamped exponential signals, when the parameters are complex valued. Such data arise in several areas of applications including telecommunications, radio location of objects, seismic signal processing and computer assisted medical diagnostics. It is observed that the proposed estimators are consistent and the dispersion matrix of these estimators is asymptotically the same as that of the least squares estimators. Moreover, the asymptotic variances of the proposed estimators attain the Cramer–Rao lower bounds, when the errors are Gaussian.     

Jarque–Bera Test and its Competitors for Testing Normality – A Power Comparison

For testing normality we investigate the power of several tests, first of all, the well-known test of Jarque & Bera (1980) and furthermore the tests of Kuiper (1960) and Shapiro & Wilk (1965) as well as tests of Kolmogorov–Smirnov and Cramér-von Mises type. The tests on normality are based, first, on independent random variables (model I) and, second, on the residuals in the classical linear regression (model II). We investigate the exact critical values of the Jarque–Bera test and the Kolmogorov–Smirnov and Cramér-von Mises tests, in the latter case for the original and standardized observations where the unknown parameters μ and σ have to be estimated. The power comparison is carried out via Monte Carlo simulation assuming the model of contaminated normal distributions with varying parameters μ and σ and different proportions of contamination. It turns out that for the Jarque–Bera test the approximation of critical values by the chi-square distribution does not work very well. The test is superior in power to its competitors for symmetric distributions with medium up to long tails and for slightly skewed distributions with long tails. The power of the Jarque–Bera test is poor for distributions with short tails, especially if the shape is bimodal – sometimes the test is even biased. In this case a modification of the Cramér-von Mises test or the Shapiro–Wilk test may be recommended.