Estimation of a multivariate normal covariance matrix under a certain structure

We consider the estimation of Σ of the p-dimensional normal distribution N_p (0, Σ) when Σ?=?θ₀ I_p ?+?θ₁ aa′, where a is an unknown p-dimensional normalized vector and θ₀?>?0, θ₁?≥?0 are also unknown. First, we derive the restricted maximum likelihood (REML) estimator. Second, we propose a new estimator, which dominates the REML estimator with respect to Stein's loss function. Finally, we carry out Monte Carlo simulation to investigate the magnitude of the new estimator's superiority.     

A note on the asymptotic efficiency of the sobel–wald test

Let X₁,X₂, … be iid random variables with the pdf f(x,θ)=exp(θx?b(θ)) relative to a σ-finite measure μ, and consider the problem of deciding among three simple hypotheses H_i:θ=θ_i (1?i?3) subject to P(acceptH_i|θ_i)=1?α (1?i?3). A procedure similar to Sobel–Wald procedure is discussed and its asymptotic efficiency as compared with the best nonsequential test is obtained by finding the limit lim_a→0(E_iN(a)/n(a)), where N (a) is the stopping time of the proposed procedure and n(a) is the sample size of the best non-sequential test. It is shown that the same asymptotic limit holds for the original Sobel–Wald procedure. Specializing to N(θ,1) distribution it is found that lim_a→0$\text{(E}{}_{\mathrm{i}}\text{N(α)/n(α))=}\text{1}\text{4}$ (i=1,2) and lim_a→0 (E₃N(α)n(α))=δ²₁/4δ, where δ_i=(θ_i+1?θ_i) with 0<δ₁?δ₂. Also, the asymptotic efficiency evaluated when the X's have an exponential distribution.     

MINIMUM MSE ESTIMATION BY LINEAR COMBINATIONS OF ORDER STATISTICS1

In this paper we assume that in a random sample of size ndrawn from a population having the pdf f(x; θ) the smallest r₁ observations and the largest r₂ observations are censored (r₁0, r₂0). We consider the problem of estimating θ on the basis of the middle n-r₁-r₂ observations when either f(x;θ)=θ^-1f(x/θ) or f(x;θ) = (aθ)¹f(x-θ)/aθ) where f(·) is a known pdf, a (<0) is known and θ (>0) is unknown. The minimum mean square error (MSE) linear estimator of θ proposed in this paper is a “shrinkage” of the minimum variance linear unbiased estimator of θ. We obtain explicit expressions of these estimators and their mean square errors when (i) f(·) is the uniform pdf defined on an interval of length one and (ii) f(·) is the standard exponential pdf, i.e., f(x) = exp(–x), x0. Various special cases of censoring from the left (right) and no censoring are considered.     

A One Sided Test Based on Sample Quasi Ranges

Abstract

Let the data from the ith treatment/population follow a distribution with cumulative distribution function (cdf) F _i (x) = F[(x ? μ _i )/θ _i ], i = 1,…, k (k ≥ 2). Here μ _i (?∞ < μ _i  < ∞) is the location parameter, θ _i (θ _i  > 0) is the scale parameter and F(?) is any absolutely continuous cdf, i.e., F _i (?) is a member of location-scale family, i = 1,…, k. In this paper, we propose a class of tests to test the null hypothesis H ₀ ? θ₁ = · = θ _k against the simple ordered alternative H _A  ? θ₁ ≤ · ≤ θ _k with at least one strict inequality. In literature, use of sample quasi range as a measure of dispersion has been advocated for small sample size or sample contaminated by outliers [see David, H. A. (1981). Order Statistics. 2nd ed. New York: John Wiley, Sec. 7.4]. Let X _i1,…, X _in be a random sample of size n from the population π _i and R _ir  = X _i:n?r  ? X _i:r+1, r = 0, 1,…, [n/2] ? 1 be the sample quasi range corresponding to this random sample, where X _i:j represents the jth order statistic in the ith sample, j = 1,…, n; i = 1,…, k and [x] is the greatest integer less than or equal to x. The proposed class of tests, for the general location scale setup, is based on the statistic W _r  = max_1≤i<j≤k (R _jr /R _ir ). The test is reject H ₀ for large values of W _r . The construction of a three-decision procedure and simultaneous one-sided lower confidence bounds for the ratios, θ _j /θ _i , 1 ≤ i < j ≤ k, have also been discussed with the help of the critical constants of the test statistic W _r . Applications of the proposed class of tests to two parameter exponential and uniform probability models have been discussed separately with necessary tables. Comparisons of some members of our class with the tests of Gill and Dhawan [Gill A. N., Dhawan A. K. (1999). A One-sided test for testing homogeneity of scale parameters against ordered alternative. Commun. Stat. – Theory and Methods 28(10):2417–2439] and Kochar and Gupta [Kochar, S. C., Gupta, R. P. (1985). A class of distribution-free tests for testing homogeneity of variances against ordered alternatives. In: Dykstra, R. et al., ed. Proceedings of the Conference on Advances in Order Restricted Statistical Inference at Iowa city. Springer Verlag, pp. 169–183], in terms of simulated power, are also presented.     

Lower percentage points of hartley's extremal quotient statistic and their applications

Consider K(>2) independent populations π₁,..,π _k such that observations obtained from π _k are independent and normally distributed with unknown mean µ _i and unknown variance θ _i i = 1,…,k. In this paper, we provide lower percentage points of Hartley's extremal quotient statistic for testing an interval hypothesisH ₀ θ _[k] θ _[k] > δ vs. H _a : θ _[k] θ _[1] ≤ δ , where δ ≥ 1 is a predetermined constant and θ _[k](θ _[1]) is the max (min) of the θ_i,…,θ _k . The least favorable configuration (LFC) for the test under H ₀ is determined in order to obtain the lower percentage points. These percentage points can also be used to construct an upper confidence bound for θ_[k]/θ_[1].     

THE LIMITING FORM OF THE NON-CENTRAL WISHART DISTRIBUTION1,2

Let S (p×p) have a Wishart distribution -with v degrees of freedom and non-centrality matrix θ= [θ_jK] (p×p). Define θ₀= min {| θ_jk |}, let θ₀→∞, and suppose that | θ_jK | = 0(θ_o). Then the limiting form of the standardized non-central distribution, as θ while n? remains fixed, is a multivariate Gaussian distribution. This result in turn is used to obtain known asymptotic properties of multivariate chi-square and Rayleigh distributions under somewhat weaker conditions.     

Randomly weighted sums and their maxima with heavy-tailed increments and dependence structure

Consider the randomly weighted sums S_m(θ) = ∑^m_{i = 1}θ_iX_i, 1 ? m ? n, and their maxima M_n(θ) = max?_{1 ? m ? n}S_m(θ), where X_i, 1 ? i ? n, are real-valued and dependent according to a wide type of dependence structure, and θ_i, 1 ? i ? n, are non negative and arbitrarily dependent, but independent of X_i, 1 ? i ? n. Under some mild conditions on the right tails of the weights θ_i, 1 ? i ? n, we establish some asymptotic equivalence formulas for the tail probabilities of S_n(θ) and M_n(θ) in the case where X_i, 1 ? i ? n, are dominatedly varying, long-tailed and subexponential distributions, respectively.     

On the bounded regret of empirical bayes estimators

Let (θ₁,x₁),…,(θ_n,x_n) be independent and identically distributed random vectors with E(xθ) = θ and Var(x|θ) = a + bθ + cθ². Let t_i be the linear Bayes estimator of θ_i and θ~_i be the linear empirical Bayes estimator of θ_i as proposed in Robbins (1983). When Ex and Var x are unknown to the statistician. The regret of using θ~_i instead of t_i because of ignorance of the mean and the variance is r_i = E(θ_i ? θ_i)² ?E(t_i ?θ_i)². Under appropriate conditions cumulative regret R_n = r₁+…r_n is shown to have a finite limit even when n tends to infinity. The limit can be explicitly computed in terms of a,b,c and the first four moments of x.     

Estimation After Selection Under Reflected Normal Loss Function

Let X ₁ and X ₂ be two independent random variables from normal populations Π₁, Π₂ with different unknown location parameters θ₁ and θ₂, respectively and common known scale parameter σ. Let X ₍₂₎ = max (X ₁, X ₂) and X ₍₁₎ = min (X ₁, X ₂). We consider the problem of estimating the location parameter θ _M (or θ _J ) of the selected population under the reflected normal loss function. We obtain minimax estimators of θ _M and θ _J . Also, we provide sufficient conditions for the inadmissibility of invariant estimators of θ _M and θ _J .     

On comparing two poisson intensity functions

Given realizations of two possion processes with unknown intensities A(·) and F(·) observed over the interval (t₁,t₂), we suppose that it is desired to distinution between H₀ Ξ(·)/λ(·) is constant on (t₁,t₂) versus H₊:Ξ(·)/λ(·) increases on (t₁,t₂). We propose a decision rule which uses the percentage points of the Mann-Whitney U-distribution. We show that the decision rule is unbiased and that the set of alternatives in H₊ can be weakly ordered, specifically: if Ξ(·)/λ(·), β(·)/λ(·) and Ξ(·)/β(·) are increasing on (t₁, t₂) then P{H₀ is rejected |Ξ(·)}≧P{H₀ is rejected|B(·)}≧P{H₀ is rejected|H₀}.     

On estimating uniform distribution via linear Bayes method

A linear Bayes procedure is suggested to simultaneously estimate the parameters of the uniform distribution U(θ₁, θ₂). The proposed linear Bayes estimator is simple and easy to use and its superiorities are established.     

The parametric hypothesis test of multiple uniform populations

X₁, X₂, …, X_k are k(k ? 2) uniform populations which each X_i follows U(0, θ_i). This note shows the test statistic for the null hypothesis H₀: θ₁ = θ₂ = ??? = θ_k by using the order statistics.     

Bootstrap test of goodness of fit to a linear model when errors are correlated

Given the regression model Y_i = m(x_i) +ε_i (x_i ε C, i = l,…,n, C a compact set in R) where m is unknown and the random errors {ε_i} present an ARMA structure, we design a bootstrap method for testing the hypothesis that the regression function follows a general linear model: H_o : m ε {mθ(.) = A^t(.)θ : θ ε ? ? R^q} with A a functional from R to R^q. The criterion of the test derives from a Cramer-von-Mises type functional distance D = d²([mcirc]_n, A^t(.)θ_n), between [mcirc]_n, a Gasser-Miiller non-parametric estimator of m, and the member of the class defined in H_o that is closest to m_n in terms of this distance. The consistency of the bootstrap distribution of D and θ_n is obtained under general conditions. Finally, simulations show the good behavior of the bootstrap approximation with respect to the asymptotic distribution of D = d².     

The interpretation of maximum-likelihood estimation

Maximum-likelihood estimation is interpreted as a procedure for generating approximate pivotal quantities, that is, functions u(X;θ) of the data X and parameter θ that have distributions not involving θ. Further, these pivotals should be efficient in the sense of reproducing approximately the likelihood function of θ based on X, and they should be approximately linear in θ. To this end the effect of replacing θ by a parameter ϕ = ϕ(θ) is examined. The relationship of maximum-likelihood estimation interpreted in this way to conditional inference is discussed. Examples illustrating this use of maximum-likelihood estimation on small samples are given.     

Rate of consistency of one sample tests of location

Let X₁,…,X_n be a sample from a population with continuous distribution function F(x?θ) such that F(x)+F(-x)=1 and 0<F(x)<1, x?R¹. It is shown that the power- function of a monotone test of H: θ=θ₀ against K: θ>θ₀ cannot tend to 1 as θ?θ₀ → ∞ more than n times faster than the tails of F tend to 0. Some standard as well as robust tests are considered with respect to this rate of convergence.     

Estimation of the Scale Parameter of the Selected Gamma Population Under the Entropy Loss Function

Let X ₁, X ₂,…, X _k be k (≥2) independent random variables from gamma populations Π₁, Π₂,…, Π _k with common known shape parameter α and unknown scale parameter θ _i , i = 1,2,…,k, respectively. Let X _(i) denotes the ith order statistics of X ₁,X ₂,…,X _k . Suppose the population corresponding to largest X _(k) (or the smallest X ₍₁₎) observation is selected. We consider the problem of estimating the scale parameter θ _M (or θ _J ) of the selected population under the entropy loss function. For k ≥ 2, we obtain the Unique Minimum Risk Unbiased (UMRU) estimator of θ _M (and θ _J ). For k = 2, we derive the class of all linear admissible estimators of the form cX ₍₂₎ (and cX ₍₁₎) and show that the UMRU estimator of θ _M is inadmissible. The results are extended to some subclass of exponential family.     

An inclusion-consistent solution to the problem of absurd confidence statements: 2. Consistent nonexact-confidence-interval estimation

Two consistent nonexact-confidence-interval estimation methods, both derived from the consistency-equivalence theorem in Plante (1991), are suggested for estimation of problematic parametric functions with no consistent exact solution and for which standard optimal confidence procedures are inadequate or even absurd, i.e., can provide confidence statements with a 95% empty or all-inclusive confidence set. A belt C(·) from a consistent nonexact-belt family, used with two confidence coefficients (γ = inf_θ P_θ [ θ ? C(X)] and γ⁺ = sup_θ P_θ[θ ? C(X)], is shown to provide a consistent nonexact-belt solution for estimating μ₂ -μ₁ in the Behrens-Fisher problem. A rule for consistent behaviour enables any confidence belt to be used consistently by providing each sample point with best upper and lower confidence levels [δ⁺(x) ≥ γ⁺, δ(x) ≤ γ], which give least-conservative consistent confidence statements ranging from practically exact through informative to noninformative. The rule also provides a consistency correction L(x) = δ⁺(x)-δ(X) enabling alternative confidence solutions to be compared on grounds of adequacy; this is demonstrated by comparing consistent conservative sample-point-wise solutions with inconsistent standard solutions for estimating μ₂/μ₁ (Creasy-Fieller-Neyman problem) and $\sqrt {\mu _1^2 + \mu _2^2 }$, a distance-estimation problem closely related to Stein's 1959 example