Testing a covariance matrix: exact null distribution of its likelihood criterion

For X～ N _p (μ, Σ) testing H _o:Σ = Σ ₀, with Σ ₀ known, relies at present on an approximation of the null-distribution of the likelihood ratio statistic.

We present here the exact null distribution and also its computation, hence providing a precise tool that can be used in small sample cases.     

Order-preserving Estimators and an Inequality on the Integration of Zonal Polynomial

ABSTRACT

Suppose X , p × p p.d. random matrix, has the distribution which depends on a p × p p.d. parameter matrix Σ and this distribution is orthogonally invariant. The orthogonally invariant estimator of Σ which has the eigenvalues of the same order as the eigenvalues of X is called order-preserving. We conjecture that a non-order-preserving estimator is dominated by modified order-preserving estimators with respect to the entropy (Stein's) loss function. We show that an inequality on the integration of zonal polynomial is sufficient for this conjecture. We also prove this inequality for the case p = 2.     

Estimation of a multivariate normal covariance matrix under a certain structure

We consider the estimation of Σ of the p-dimensional normal distribution N_p (0, Σ) when Σ?=?θ₀ I_p ?+?θ₁ aa′, where a is an unknown p-dimensional normalized vector and θ₀?>?0, θ₁?≥?0 are also unknown. First, we derive the restricted maximum likelihood (REML) estimator. Second, we propose a new estimator, which dominates the REML estimator with respect to Stein's loss function. Finally, we carry out Monte Carlo simulation to investigate the magnitude of the new estimator's superiority.     

Locking the Wiener Process to its Level-Crossing Time

We consider the specific transformation of a Wiener process {X(t), t ≥ 0} in the presence of an absorbing barrier a that results when this process is “time-locked” with respect to its first passage time T _a through a criterion level a, and the evolution of X(t) is considered backwards (retrospectively) from T _a . Formally, we study the random variables defined by Y(t) ≡ X(T _a  ? t) and derive explicit results for their density and mean, and also for their asymptotic forms. We discuss how our results can aid interpretations of time series “response-locked” to their times of crossing a criterion level.     

A Property of Count Distributions in the Hinde–Demétrio Family

The Hinde–Demétrio (HD) family of distributions, which are discrete exponential dispersion models with an additional real index parameter p, have been recently characterized from the unit variance function μ + μ ^p . For p equals to 2, 3,…, the corresponding distributions are concentrated on non negative integers, overdispersed and zero-inflated with respect to a Poisson distribution having the same mean. The negative binomial (p = 2) and strict arcsine (p = 3) distributions are HD families; the limit case (p → ∞) is associated to a suitable Poisson distribution. Apart from these count distributions, none of the HD distributions has explicit probability mass functions p _k . This article shows that the ratios r _k  = k p _k /p _k?1, k = 1,…, p ? 1, are equal and different from r _p . This new property allows, for a given count data set, to determine the integer p by some tests. The extreme situation of p = 2 is of general interest for count data. Some examples are used for illustrations and discussions.     

Characterizing Relationships Between Estimations Under a General Linear Model with Explicit and Implicit Restrictions by Rank of Matrix

In the investigation of the restricted linear model ? _r  = {y, X β | A β = b, σ² Σ}, the parameter constraints A β = b are often handled by transforming the model into certain implicitly restricted model. Any estimation derived from the explicitly and implicitly restricted models on the vector β and its functions should be equivalent, although the expressions of the estimation under the two models may be different. However, people more likely want to directly compare different expressions of estimations and yield a conclusion on their equivalence by using some algebraic operations on expressions of estimations. In this article, we give some results on equivalence of the well-known OLSEs and BLUEs under the explicitly and implicitly restricted linear models by using some expansion formulas for ranks of matrices.     

A Subset Selection Procedure for Selecting the Exponential Population Having the Longest Mean Lifetime When the Guarantee Times are the Same

ABSTRACT

Consider k(≥ 2) independent exponential populations Π₁, Π₂, …, Π _k , having the common unknown location parameter μ ∈ (?∞, ∞) (also called the guarantee time) and unknown scale parameters σ₁, σ₂, …σ _k , respectively (also called the remaining mean lifetimes after the completion of guarantee times), σ _i  > 0, i = 1, 2, …, k. Assume that the correct ordering between σ₁, σ₂, …, σ _k is not known apriori and let σ_[i], i = 1, 2, …, k, denote the ith smallest of σ _j s, so that σ_[1] ≤ σ_[2] ··· ≤ σ_[k]. Then Θ _i  = μ + σ _i is the mean lifetime of Π _i , i = 1, 2, …, k. Let Θ_[1] ≤ Θ_[2] ··· ≤ Θ_[k] denote the ranked values of the Θ _j s, so that Θ_[i] = μ + σ_[i], i = 1, 2, …, k, and let Π_(i) denote the unknown population associated with the ith smallest mean lifetime Θ_[i] = μ + σ_[i], i = 1, 2, …, k. Based on independent random samples from the k populations, we propose a selection procedure for the goal of selecting the population having the longest mean lifetime Θ_[k] (called the “best” population), under the subset selection formulation. Tables for the implementation of the proposed selection procedure are provided. It is established that the proposed subset selection procedure is monotone for a general k (≥ 2). For k = 2, we consider the loss measured by the size of the selected subset and establish that the proposed subset selection procedure is minimax among selection procedures that satisfy a certain probability requirement (called the P*-condition) for the inclusion of the best population in the selected subset.     

Goodness-of-Fit Tests for Multivariate Distributions

We propose three new statistics, Z _p , C _p , and R _p for testing a p-variate (p ≥ 2) normal distribution and compare them with the prominent test statistics. We show that C _p is overall most powerful and is effective against skew, long-tailed as well as short-tailed symmetric alternatives. We show that Z _p and R _p are most powerful against skew and long-tailed alternatives, respectively. The Z _p and R _p statistics can also be used for testing an assumed p-variate nonnormal distribution.     

The Likelihood Ratio Test with the Box–Cox Transformation for the Normal Mixture Problem: Power and Sample Size Study

Abstract

Through simulation and regression, we study the alternative distribution of the likelihood ratio test in which the null hypothesis postulates that the data are from a normal distribution after a restricted Box–Cox transformation and the alternative hypothesis postulates that they are from a mixture of two normals after a restricted (possibly different) Box–Cox transformation. The number of observations in the sample is called N. The standardized distance between components (after transformation) is D = (μ₂ ? μ₁)/σ, where μ₁ and μ₂ are the component means and σ² is their common variance. One component contains the fraction π of observed, and the other 1 ? π. The simulation results demonstrate a dependence of power on the mixing proportion, with power decreasing as the mixing proportion differs from 0.5. The alternative distribution appears to be a non-central chi-squared with approximately 2.48 + 10N ^?0.75 degrees of freedom and non-centrality parameter 0.174N(D ? 1.4)² × [π(1 ? π)]. At least 900 observations are needed to have power 95% for a 5% test when D = 2. For fixed values of D, power, and significance level, substantially more observations are necessary when π ≥ 0.90 or π ≤ 0.10. We give the estimated powers for the alternatives studied and a table of sample sizes needed for 50%, 80%, 90%, and 95% power.     

On Thresholds of Moving Averages with Given On-Target Significant Levels

Let X ₁, X ₂,… be a sequence of independent and identically distributed random variables, and let Y _n , n = K, K + 1, K + 2,… be the corresponding backward moving average of order K. At epoch n ≥ K, the process Y _n will be off target by the input X _n if it exceeds a threshold. By introducing a two-state Markov chain, we define a level of significance (1 ? a)% to be the percentage of times that the moving average process stays on target. We establish a technique to evaluate, or estimate, a threshold, to guarantee that {Y _n } will stay (1 ? a)% of times on target, for a given (1 ? a)%. It is proved that if the distribution of the inputs is exponential or normal, then the threshold will be a linear function in the mean of the distribution of inputs μ _X . The slope and intercept of the line, in each case, are specified. It is also observed that for the gamma inputs, the threshold is merely linear in the reciprocal of the scale parameter. These linear relationships can be easily applied to estimate the desired thresholds by samples from the inputs.     

Stochastic Comparisons and Dependence of Spacings from Two Samples of Exponential Random Variables

Let X ₁,X ₂,…,X _n be independent exponential random variables such that X _i has hazard rate λ for i = 1,…,p and X _j has hazard rate λ* for j = p + 1,…,n, where 1 ≤ p < n. Denote by D _i:n (λ, λ*) = X _i:n  ? X _i?1:n the ith spacing of the order statistics X _1:n  ≤ X _2:n  ≤ ··· ≤ X _n:n , i = 1,…,n, where X _0:n ≡ 0. It is shown that the spacings (D _1,n ,D _2,n ,…,D _n:n ) are MTP₂, strengthening one result of Khaledi and Kochar (2000), and that (D _1:n (λ₂, λ*),…,D _n:n (λ₂, λ*)) ≤ _lr (D _1:n (λ₁, λ*),…,D _n:n (λ₁, λ*)) for λ₁ ≤ λ* ≤ λ₂, where ≤ _lr denotes the multivariate likelihood ratio order. A counterexample is also given to show that this comparison result is in general not true for λ* < λ₁ < λ₂.     

Estimation of Parameters of a Clipped MA(1) Process

Let {X _t , t ∈ ?} be a sequence of iid random variables with an absolutely continuous distribution. Let a > 0 and c ∈ ? be some constants. We consider a sequence of 0-1 valued variables {ξ _t , t ∈ ?} obtained by clipping an MA(1) process X _t  ? aX _t?1 at the level c, i.e., ξ _t  = I[X _t  ? aX _t?1 < c] for all t ∈ ?. We deal with the estimation problem in this model. Properties of the estimators of the parameters a and c, the success probability p, and the 1-lag autocorrelation r ₁ are investigated. A numerical study is provided as an illustration of the theoretical results.     

A Resampling Approach for Under-estimating a Finite Population Total from a Censored Sample

Abstract

Suppose a finite population of N objects each of which has an unknown value μ _i  ≥ 0, i = 1, … , N of a nonnegative characteristic of interest. A random sample has been drawn, but only for a selected subset of the sample the μ-values have been observed. The subset selection procedure has been somewhat obscure, and thus the subsample is censorized rather than random. Despite that, a reliable lower bound for the population total (the sum of all μ _i ) is required which uses the statistical information contained in the data. We propose a resampling procedure to construct an under-estimate of the population total. We also consider the case when the objects of the population have unequal sampling probabilities, in particular when the population is divided into a few number of strata with constant probabilities within each stratum. A real data example illustrates the method.     

Asymptotic Distribution for Symmetric Spacing Statistics

A new procedure for testing the H ₀: μ₁ = ··· = μ _k against the alternative H _u :μ₁ ≥ ··· ≥μ _r  ≤ ··· ≤ μ _k with at least one strict inequality, where μ _i is the location parameter of the ith two-parameter exponential distribution, i = 1,…, k, is proposed. Exact critical constants are computed using a recursive integration algorithm. Tables containing these critical constants are provided to facilitate the implementation of the proposed test procedure. Simultaneous confidence intervals for certain contrasts of the location parameters are derived by inverting the proposed test statistic. In comparison to existing tests, it is shown, by a simulation study, that the new test statistic is more powerful in detecting U-shaped alternatives when the samples are derived from exponential distributions. As an extension, the use of the critical constants for comparing Pareto distribution parameters is discussed.     

Local Convergence Rate of Mean Squared Error in Density Estimation

The local convergence rate of a multivariate density estimators based on the certain delta-sequence is studied. In contrast to known results, the conditions on the density are formulated in terms of the modulus of continuity. The main contribution of this study is relaxing the corresponding smoothing conditions in terms of arbitrary modulus of continuity type majorant. In particular, when the density f ∈ L ^p (R ^d ) satisfies Lipschitz condition of order γ = 1 at x, the rate of convergency contains terms with logarithm, which is the best possible convergency rate.     

On a Confidence Interval for the Mean of an Asymmetric Distribution

A clarification is given of the main result (1.1) in Communications in Statistics: Theory and Methods 34:753–766. The term {1 + 6a(r ? a)}^1/3 is to be understood as sgn(1 + 6a(r ? a)) | 1 + 6a(r ? a)|^1/3. The result is expressed in a more user-friendly form. An issue is raised regarding the common usage of the expression x ^1/n when n is even.