Confidence intervals for the largest mean from k correlated normal populations

Let X= (X₁,…, X_k)’ be a k-variate (k ≥ 2) normal random vector with unknown population mean vector μ = (μ₁ ,…, μ_k)’ and covariance matrix Σ of order k and let μ_[1] ≤ … ≤ μ_[k] be the ordered values of the μ ’ s. No prior knowledge of the pairing of the μ_[i] with the X_j. (or μ_[i] with the σ_j ²) is assumed for any i and j (1 ≤ i, j ≤ k). Based on a random sample of N independent vector observations on X, this paper considers both upper and lower (one-sided) and two-sided 100γ% (0 < γ < 1) confidence intervals for μ_[k] and μ_[1], the largest and the smallest mean, respectively, when Σ is known and when Σ is equal to σ²R with common unknown variance σ² > 0 and correlation matrix R known, respectively. An optimum two-sided confidence interval via finding the shortest length from this class is also considered. Necessary tables and computer program to actually apply these procedures are provided.     

Inference on the Common Variance of Correlated Normal Random Variables

ABSTRACT

Scale equivariant estimators of the common variance σ², of correlated normal random variables, have mean squared errors (MSE) which depend on the unknown correlations. For this reason, a scale equivariant estimator of σ² which uniformly minimizes the MSE does not exist. For the equi-correlated case, we have developed three equivariant estimators of σ²: a Bayesian estimator for invariant prior as well as two non-Bayesian estimators. We then generalized these three estimators for the case of several variables with multiple unknown correlations. In addition, we developed a system of confidence intervals which produce the desired coverage probability while being efficient in terms of expected length.     

Unverfälschte Variablenprüfpläne für exponentialverteilte Merkmale mit zweiseitigen Toleranzgrenzen

As a well known fact the standard X²-procedures (e.g. confidence intervals for σ², tests of the hypothesis H:″σ=σ_o″ in the case of normal population with variance σ²) are biased. We refer to some useful tables which enable in the case of normal population to procure unbiased confidence intervals or confidence intervals with minimal length for σ², control charts for σ with minimal distance between the limit lines, and unbiased tests of H:″σ=σ_o″. Another important application yields—as main result of the present paper—unbiased sampling plans in the case of an exponential distributed attribute with upper and lower specification limit (two-way-protection). It turns out to be possible, also in the case of exponential distribution, to reduce the sample size by using incomplete prior information about the proportion p of defectives.     

Shortest confidence and prediction intervals for the log-normal

We provide the shortest prediction interval for X, and the shortest confidence interval for the median of X, when X has the log-normal distribution for both the case σ², the variance of log X, known and unknown. Tables are given to assist the practitioner in constructing these intervals. A real-life example is provided to illustrate the results.     

A class of fixed-width confidence intervals for a ranked normal mean

Suppose that we are given k(≥ 2) independent and normally distributed populations π₁, …, π_k where π_i has unknown mean μ_i and unknown variance σ² _i (i = 1, …, k). Let μ_[i] (i = 1, …, k) denote the i^th smallest one of μ₁, …, μ_k. A two-stage procedure is used to construct lower and upper confidence intervals for μ_[i] and then use these to obtain a class of two-sided confidence intervals on μ_[i] with fixed width. For i = k, the interval given by Chen and Dudewicz (1976) is a special case. Comparison is made between the class of two-sided intervals and a symmetric interval proposed by Chen and Dudewicz (1976) for the largest mean, and it is found that for large values of k at least one of the former intervals requires a smaller total sample size. The tables needed to actually apply the procedure are provided.     

CONFIDENCE INTERVALS UTILIZING PRIOR INFORMATION IN THE BEHRENS–FISHER PROBLEM

Consider two independent random samples of size f + 1 , one from an N (μ₁, σ²₁) distribution and the other from an N (μ₂, σ²₂) distribution, where σ²₁/σ²₂∈ (0, ∞) . The Welch ‘approximate degrees of freedom’ (‘approximate t‐solution’) confidence interval for μ₁?μ₂ is commonly used when it cannot be guaranteed that σ²₁/σ²₂= 1 . Kabaila (2005, Comm. Statist. Theory and Methods 34 , 291–302) multiplied the half‐width of this interval by a positive constant so that the resulting interval, denoted by J₀, has minimum coverage probability 1 ?α. Now suppose that we have uncertain prior information that σ²₁/σ²₂= 1. We consider a broad class of confidence intervals for μ₁?μ₂ with minimum coverage probability 1 ?α. This class includes the interval J₀, which we use as the standard against which other members of will be judged. A confidence interval utilizes the prior information substantially better than J₀ if (expected length of J)/(expected length of J₀) is (a) substantially less than 1 (less than 0.96, say) for σ²₁/σ²₂= 1 , and (b) not too much larger than 1 for all other values of σ²₁/σ²₂ . For a given f, does there exist a confidence interval that satisfies these conditions? We focus on the question of whether condition (a) can be satisfied. For each given f, we compute a lower bound to the minimum over of (expected length of J)/(expected length of J₀) when σ²₁/σ²₂= 1 . For 1 ?α= 0.95 , this lower bound is not substantially less than 1. Thus, there does not exist any confidence interval belonging to that utilizes the prior information substantially better than J₀.     

Interval Estimation for the Correlation Coefficient

ABSTRACT

The correlation coefficient (CC) is a standard measure of a possible linear association between two continuous random variables. The CC plays a significant role in many scientific disciplines. For a bivariate normal distribution, there are many types of confidence intervals for the CC, such as z-transformation and maximum likelihood-based intervals. However, when the underlying bivariate distribution is unknown, the construction of confidence intervals for the CC is not well-developed. In this paper, we discuss various interval estimation methods for the CC. We propose a generalized confidence interval for the CC when the underlying bivariate distribution is a normal distribution, and two empirical likelihood-based intervals for the CC when the underlying bivariate distribution is unknown. We also conduct extensive simulation studies to compare the new intervals with existing intervals in terms of coverage probability and interval length. Finally, two real examples are used to demonstrate the application of the proposed methods.     

Small samples confidencce intervals on common mean of two normal distributions variances

Let X₁,X₂,…,X_m be distributed normally with mean μ and variance σ² _X; Let Y₁,Y₂,…,Y_n be distributed normally with mean μ and variance σ² _Y; let X₁,X₂,…,X_m,Y₁,Y₂,…,Y_n be jointly independent. There have been several papers written concerning point estimation of μ for this problem, but very little is available in the literature concerning confidence intervals on the common mean μ. In this paper a method is proposed that results in a confidence interval with confidence coefficient essentially equal to a prescribed value 1 - α. The method is evaluated and compnred with other methods through the expected length of the confidence interval.     

New bootstrap confidence intervals for means of positively skewed distributions

ABSTRACT

In this paper, we consider the problem of constructing non parametric confidence intervals for the mean of a positively skewed distribution. We suggest calibrated, smoothed bootstrap upper and lower percentile confidence intervals. For the theoretical properties, we show that the proposed one-sided confidence intervals have coverage probability α + O(n^{? 3/2}). This is an improvement upon the traditional bootstrap confidence intervals in terms of coverage probability. A version smoothed approach is also considered for constructing a two-sided confidence interval and its theoretical properties are also studied. A simulation study is performed to illustrate the performance of our confidence interval methods. We then apply the methods to a real data set.     

ON THE COVERAGE PROBABILITY OF CONFIDENCE INTERVALS IN REGRESSION AFTER VARIABLE SELECTION

This paper considers a linear regression model with regression parameter vector β. The parameter of interest is θ= a^Tβ where a is specified. When, as a first step, a data‐based variable selection (e.g. minimum Akaike information criterion) is used to select a model, it is common statistical practice to then carry out inference about θ, using the same data, based on the (false) assumption that the selected model had been provided a priori. The paper considers a confidence interval for θ with nominal coverage 1 ‐ α constructed on this (false) assumption, and calls this the naive 1 ‐ α confidence interval. The minimum coverage probability of this confidence interval can be calculated for simple variable selection procedures involving only a single variable. However, the kinds of variable selection procedures used in practice are typically much more complicated. For the real‐life data presented in this paper, there are 20 variables each of which is to be either included or not, leading to 2²⁰ different models. The coverage probability at any given value of the parameters provides an upper bound on the minimum coverage probability of the naive confidence interval. This paper derives a new Monte Carlo simulation estimator of the coverage probability, which uses conditioning for variance reduction. For these real‐life data, the gain in efficiency of this Monte Carlo simulation due to conditioning ranged from 2 to 6. The paper also presents a simple one‐dimensional search strategy for parameter values at which the coverage probability is relatively small. For these real‐life data, this search leads to parameter values for which the coverage probability of the naive 0.95 confidence interval is 0.79 for variable selection using the Akaike information criterion and 0.70 for variable selection using Bayes information criterion, showing that these confidence intervals are completely inadequate.     

Wavelet Estimation of a Density in a GARCH-type Model

We consider the GARCH-type model: S = σ² Z, where σ² and Z are independent random variables. The density of σ² is unknown whereas the one of Z is known. We want to estimate the density of σ² from n observations of S under some dependence assumption (the exponentially strongly mixing dependence). Adopting the wavelet methodology, we construct a nonadaptive estimator based on projections and an adaptive estimator based on the hard thresholding rule. Taking the mean integrated squared error over Besov balls, we prove that the adaptive one attains a sharp rate of convergence.     

Confidence bands for the laplace distribution

Based on a random sample from the Laplace population with unknown shape and scale parameters, one- and two-sided confidence bands on the entire cumulative distribution function and simultaneous confidence intervals for the interval probabilities under the distribution are constructed using Kolmogorov–Smirnov type statistics. Small sample and asymptotic percentiles of the relevant statistics are provided.     

Variance Estimation for Fractional Brownian Motions with Fixed Hurst Parameters

Some real-world phenomena in geo-science, micro-economy, and turbulence, to name a few, can be effectively modeled by a fractional Brownian motion indexed by a Hurst parameter, a regularity level, and a scaling parameter σ², an energy level. This article discusses estimation of a scaling parameter σ² when a Hurst parameter is known. To estimate σ², we propose three approaches based on maximum likelihood estimation, moment-matching, and concentration inequalities, respectively, and discuss the theoretical characteristics of the estimators and optimal-filtering guidelines. We also justify the improvement of the estimation of σ² when a Hurst parameter is known. Using the three approaches and a parametric bootstrap methodology in a simulation study, we compare the confidence intervals of σ² in terms of their lengths, coverage rates, and computational complexity and discuss empirical attributes of the tested approaches. We found that the approach based on maximum likelihood estimation was optimal in terms of efficiency and accuracy, but computationally expensive. The moment-matching approach was found to be not only comparably efficient and accurate but also computationally fast and robust to deviations from the fractional Brownian motion model.     

Nonparametric confidence intervals for location in time series data

We extend the confidence interval construction procedure for location for symmetric iid data using the one-sample Wilcoxon signed rank statistic (T⁺) to stationary time series data. We propose a normal approximation procedure when explicit knowledge of the underlying dependence structure/distribution is unknown. By conducting extensive simulations from linear and nonlinear time series models, we show that the extended procedure is a strong contender for use in the construction of confidence intervals in time series analysis. Finally we demonstrate real application implementations in two case studies.     

Comparing Equal-Tail Probability and Unbiased Confidence Intervals for the Intraclass Correlation Coefficient

The conventional confidence interval for the intraclass correlation coefficient assumes equal-tail probabilities. In general, the equal-tail probability interval is biased and other interval procedures should be considered. Unbiased confidence intervals for the intraclass correlation coefficient are readily available. The equal-tail probability and unbiased intervals have exact coverage as they are constructed using the pivotal quantity method. In this article, confidence intervals for the intraclass correlation coefficient are built using balanced and unbalanced one-way random effects models. The expected length of confidence intervals serves as a tool to compare the two procedures. The unbiased confidence interval outperforms the equal-tail probability interval if the intraclass correlation coefficient is small and the equal-tail probability interval outperforms the unbiased interval if the intraclass correlation coefficient is large.     

Frequentist and Bayesian Interval Estimators for the Normal Mean

It is well known that a Bayesian credible interval for a parameter of interest is derived from a prior distribution that appropriately describes the prior information. However, it is less well known that there exists a frequentist approach developed by Pratt (1961 Pratt , J. W. ( 1961 ). Length of confidence intervals . J. Amer. Statist. Assoc. 56 : 549 – 657 .[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]) that also utilizes prior information in the construction of frequentist confidence intervals. This frequentist approach produces confidence intervals that have minimum weighted average expected length, averaged according to some weight function that appropriately describes the prior information. We begin with a simple model as a starting point in comparing these two distinct procedures in interval estimation. Consider X ₁,…, X _n that are independent and identically N(μ, σ²) distributed random variables, where σ² is known, and the parameter of interest is μ. Suppose also that previous experience with similar data sets and/or specific background and expert opinion suggest that μ = 0. Our aim is to: (a) develop two types of Bayesian 1 ? α credible intervals for μ, derived from an appropriate prior cumulative distribution function F(μ) more importantly; (b) compare these Bayesian 1 ? α credible intervals for μ to the frequentist 1 ? α confidence interval for μ derived from Pratt's frequentist approach, in which the weight function corresponds to the prior cumulative distribution function F(μ). We show that the endpoints of the Bayesian 1 ? α credible intervals for μ are very different to the endpoints of the frequentist 1 ? α confidence interval for μ, when the prior information strongly suggests that μ = 0 and the data supports the uncertain prior information about μ. In addition, we assess the performance of these intervals by analyzing their coverage probability properties and expected lengths.     

Tables of confidence limits on the tail area of the normal distribution

Tables are given of confidence limits on tail areas, γ, of the normal distribution, where γ = P{Y ≥ L}, and where L is a given number, and Y is normally distributed with unknown mean, μ, and unknown variance, σ².     

An inclusion-consistent solution to the problem of absurd confidence statements: 1. Consistent exact confidence-interval estimation

An example is given of a uniformly most accurate unbiased confidence belt which yields absurd confidence statements with 100% occurrence. In several known examples, as well as in the 100%-occurrence counterexample, an optimal confidence belt provides absurd statements because it is inclusion-inconsistent with either a null or an all-inclusive belt or both. It is concluded that confidence-theory optimality criteria alone are inadequate for practice, and that a consistency criterion is required. An approach based upon inclusion consistency of belts [C(x) C C C(x), for some x, implies γ ≤ γ for confidence coefficients] is suggested for exact interval estimation in continuous parametric models. Belt inclusion consistency, the existence of a proper-pivotal vector [a pivotal vector T(X, θ) such that the effective range of T(x,.) is independent of x], and the existence of a confidence distribution are proven mutually equivalent. This consistent approach being restrictive, it is shown, using Neyman's anomalous 1954 example, how to determine whether any given parametric function can be estimated consistently and exactly or whether a consistent nonexact solution must be attempted.