Confidence intervals in regression utilizing prior information

We consider a linear regression model with regression parameter β=(_β1,…,_βp)$\beta =({\beta }_1,\dots ,{\beta }_p)$ and independent and identically N(0,σ²)$N(0,{\sigma }^2)$ distributed errors. Suppose that the parameter of interest is θ=a^Tβ$\theta =a^T\beta$ where a$a$ is a specified vector. Define the parameter τ=c^Tβ-t$\tau =c^T\beta -t$ where the vector c$c$ and the number t$t$ are specified and a$a$ and c$c$ are linearly independent. Also suppose that we have uncertain prior information that τ=0$\tau =0$. We present a new frequentist 1-α$1-\alpha$ confidence interval for θ$\theta$ that utilizes this prior information. We require this confidence interval to (a) have endpoints that are continuous functions of the data and (b) coincide with the standard 1-α$1-\alpha$ confidence interval when the data strongly contradict this prior information. This interval is optimal in the sense that it has minimum weighted average expected length where the largest weight is given to this expected length when τ=0$\tau =0$. This minimization leads to an interval that has the following desirable properties. This interval has expected length that (a) is relatively small when the prior information about τ$\tau$ is correct and (b) has a maximum value that is not too large. The following problem will be used to illustrate the application of this new confidence interval. Consider a 2×2$2\times 2$ factorial experiment with 20 replicates. Suppose that the parameter of interest θ$\theta$ is a specified simple   effect and that we have uncertain prior information that the two-factor interaction is zero. Our aim is to find a frequentist 0.95 confidence interval for θ$\theta$ that utilizes this prior information.     

Higher order approximations by a two-stage procedure for a negative exponential distribution

This paper deals with the problem of fixed-width confidence interval estimation of the location μ of a negative exponential distribution with unknown scale σ. Suppose we have information on the scale parameter σ such that σ>σ_L where σ_L(>0) is known to the experimenter from past experiences. We propose a two-stage procedure and provide higher order asymptotic expansions of the expected sample size and the coverage probability.     

Sequential Fixed-Width Confidence Interval for a Function of the Parameters

Let X₁…, X_m and Y₁…, Y_n be two independent sequences of i.i.d. random variables with distribution functions F_x(.|θ) and F_y(. | φ) respectively. Let g(θ, φ) be a real-valued function of the unknown parameters θ and φ. The purpose of this paper is to suggest a sequential procedure which gives a fixed-width confidence interval for g(θ, φ) so that the coverage probability is approximately α (preas-signed). Certain asymptotic optimality properties of the sequential procedure are established. A Monte Carlo study is presented.     

A one-sided test for testino homogeneity of scale parameters against simple ordered alternative

In an earlier paper the authors (1997) extended the results of Hayter (1990) to the two parameter exponential probability model. This paper addressee the extention to the scale parameter case under location-scale probability model. Consider k (k≧3) treatments or competing firms such that an observation from with treatment or firm follows a distribution with cumulative distribution function (cdf) F_i(x)=F[(x-μ_i)/Q_i], where F(·) is any absolutely continuous cdf, i=1,…,k. We propose a test to test the null hypothesis H₀:θ₁=…=θ_k against the simple ordered alternative H₁:θ₁≦…≦θ_k, with at least one strict inequality, using the data X_i,j, i=1,…k; j=1,…,n₁. Two methods to compute the critical points of the proposed test have been demonstrated by talking k two parameter exponential distributions. The test procedure also allows us to construct simultaneous one sided confidence intervals (SOCIs) for the ordered pairwise ratios θ_j/θ_i, 1≦i<j≦k. Statistical simulation revealed that: 9i) actual sizes of the critical points are almost conservative and (ii) power of the proposed test relative to some existing tests is higher.     

THE COVERAGE PROBABILITY OF CONFIDENCE INTERVALS IN 2r FACTORIAL EXPERIMENTS AFTER PRELIMINARY HYPOTHESIS TESTING

We consider a 2^r factorial experiment with at least two replicates. Our aim is to find a confidence interval for θ, a specified linear combination of the regression parameters (for the model written as a regression, with factor levels coded as ?1 and 1). We suppose that preliminary hypothesis tests are carried out sequentially, beginning with the rth‐order interaction. After these preliminary hypothesis tests, a confidence interval for θ with nominal coverage 1 ?α is constructed under the assumption that the selected model had been given to us a priori. We describe a new efficient Monte Carlo method, which employs conditioning for variance reduction, for estimating the minimum coverage probability of the resulting confidence interval. The application of this method is demonstrated in the context of a 2³ factorial experiment with two replicates and a particular contrast θ of interest. The preliminary hypothesis tests consist of the following two‐step procedure. We first test the null hypothesis that the third‐order interaction is zero against the alternative hypothesis that it is non‐zero. If this null hypothesis is accepted, we assume that this interaction is zero and proceed to the second step; otherwise, we stop. In the second step, for each of the second‐order interactions we test the null hypothesis that the interaction is zero against the alternative hypothesis that it is non‐zero. If this null hypothesis is accepted, we assume that this interaction is zero. The resulting confidence interval, with nominal coverage probability 0.95, has a minimum coverage probability that is, to a good approximation, 0.464. This shows that this confidence interval is completely inadequate.     

SOME PROPERTIES OF PROFILE BOOTSTRAP CONFIDENCE INTERVALS

We consider the problem of finding an equi-tailed confidence interval, with coverage probability (1-α), for a scalar parameter θ₀ in the presence of a (possibly infinite dimensional) nuisance parameter ψ₀. It is supposed that the value taken by θ₀ does not restrict the value that ψ₀ may take and vice-versa. Given a sensible estimate ψ_n of ψ₀, profile bootstrap confidence interval for θ₀ is defined to be the exact equi-tailed confidence interval with coverage probability (1-α) assuming that ψ₀=ψ_n. We compare the properties of the profile bootstrap confidence interval and the ordinary bootstrap confidence interval when they are based on studentised and unstudentised quantities. Under mild regularity conditions the profile bootstrap confidence interval is always a subset of the set of allowable values of θ₀ and is transformation-respecting when based on either an unstudentised quantity or a studentised quantity satisfying certain restrictions. As a confidence interval for the autoregressive parameter of an AR(1) process, the profile bootstrap confidence interval has important advantages over the ordinary bootstrap confidence interval based on a studentised quantity.     

Rate of consistency of one sample tests of location

Let X₁,…,X_n be a sample from a population with continuous distribution function F(x?θ) such that F(x)+F(-x)=1 and 0<F(x)<1, x?R¹. It is shown that the power- function of a monotone test of H: θ=θ₀ against K: θ>θ₀ cannot tend to 1 as θ?θ₀ → ∞ more than n times faster than the tails of F tend to 0. Some standard as well as robust tests are considered with respect to this rate of convergence.     

Empirical Bayes testing for equivalence

For a fixed point θ₀ and a positive value c₀, this paper studies the problem of testing the hypotheses H₀:|θ−θ₀|≤c₀ against H₁:|θ−θ₀|>c₀ for the normal mean parameter θ using the empirical Bayes approach. With the accumulated past data, a monotone empirical Bayes test is constructed by mimicking the behavior of a monotone Bayes test. Such an empirical Bayes test is shown to be asymptotically optimal and its regret converges to zero at a rate (lnn)^2.5/n where n is the number of past data available, when the current testing problem is considered. A simulation study is also given, and the results show that the proposed empirical Bayes procedure has good performance for small to moderately large sample sizes. Our proposed method can be applied for testing close to a control problem or testing the therapeutic equivalence of one standard treatment compared to another in clinical trials.     

ON THE COVERAGE PROBABILITY OF CONFIDENCE INTERVALS IN REGRESSION AFTER VARIABLE SELECTION

This paper considers a linear regression model with regression parameter vector β. The parameter of interest is θ= a^Tβ where a is specified. When, as a first step, a data‐based variable selection (e.g. minimum Akaike information criterion) is used to select a model, it is common statistical practice to then carry out inference about θ, using the same data, based on the (false) assumption that the selected model had been provided a priori. The paper considers a confidence interval for θ with nominal coverage 1 ‐ α constructed on this (false) assumption, and calls this the naive 1 ‐ α confidence interval. The minimum coverage probability of this confidence interval can be calculated for simple variable selection procedures involving only a single variable. However, the kinds of variable selection procedures used in practice are typically much more complicated. For the real‐life data presented in this paper, there are 20 variables each of which is to be either included or not, leading to 2²⁰ different models. The coverage probability at any given value of the parameters provides an upper bound on the minimum coverage probability of the naive confidence interval. This paper derives a new Monte Carlo simulation estimator of the coverage probability, which uses conditioning for variance reduction. For these real‐life data, the gain in efficiency of this Monte Carlo simulation due to conditioning ranged from 2 to 6. The paper also presents a simple one‐dimensional search strategy for parameter values at which the coverage probability is relatively small. For these real‐life data, this search leads to parameter values for which the coverage probability of the naive 0.95 confidence interval is 0.79 for variable selection using the Akaike information criterion and 0.70 for variable selection using Bayes information criterion, showing that these confidence intervals are completely inadequate.     

NON-EXISTENCE OF AN EXACT β-CONFIDENCE INTERVAL FOR A SCALE PARAMETER*

Abstract There are given k (≥22) independent distributions with c.d.f.'s F(x;θ_j) indexed by a scale parameter θ_j, j = 1,…, k. Let θ_[i] (i = 1,…, k) denote the ith smallest one of θ₁,…, θ_k. In this paper we wish to show that, under some regularity conditions, there does not exist an exact β-level (0≤β1) confidence interval for the ith smallest scale parameter θ_i based on k independent samples. Since the log transformation method may not yield the desired results for the scale parameter problem, we will treat the scale parameter case directly without transformation. Application is considered for normal variances. Two conservative one-sided confidence intervals for the ith smallest normal variance and the percentage points needed to actually apply the intervals are provided.     

Exact average coverage probabilities and confidence coefficients of confidence intervals for discrete distributions

For a confidence interval (L(X),U(X)) of a parameter θ in one-parameter discrete distributions, the coverage probability is a variable function of θ. The confidence coefficient is the infimum of the coverage probabilities, inf  _θ P _θ (θ∈(L(X),U(X))). Since we do not know which point in the parameter space the infimum coverage probability occurs at, the exact confidence coefficients are unknown. Beside confidence coefficients, evaluation of a confidence intervals can be based on the average coverage probability. Usually, the exact average probability is also unknown and it was approximated by taking the mean of the coverage probabilities at some randomly chosen points in the parameter space. In this article, methodologies for computing the exact average coverage probabilities as well as the exact confidence coefficients of confidence intervals for one-parameter discrete distributions are proposed. With these methodologies, both exact values can be derived.     

Bayesian decision theoretic approach to hypothesis problems with skewed alternatives

Many hypothesis problems in practice require the selection of the left side or the right side alternative when the null is rejected. For parametric models, this problem can be stated as _H0:θ=_θ0$H_0:\theta ={\theta }_0$vs.  _H−:θ<_θ0$H_{-}:\theta <{\theta }_0$ or _H+:θ>_θ0$H_{+}:\theta >{\theta }_0$. Frequentists use Type-III error (directional error) to develop statistical methodologies. This approach and other approaches considered in the literature do not take into account the situations where the selection of one side may be more important or when one side may be more probable than the other. This problem can be tackled by specifying a loss function and/or by specifying a hierarchical prior structure with allowing the skewness in the alternatives. Based on this, we develop a Bayesian decision theoretic methodology and show that the resulted Bayes rule perform better in the side of the alternatives which is more probable. The methodology can be also used in a frequentist's framework when it is desired to discover an alternative that is more important. We also consider the multiple hypotheses problem and develop new false discovery rates for the selection of the left and the right sides of alternatives. These discovery rates would be useful in the situations when one side of the alternatives are more important or more probable than the other.     

Asymptotic tail behavior of a random sum with conditionally dependent subexponential summands

In this paper, we obtain some results for the asymptotic behavior of the tail probability of a random sum S_τ = ∑^τ_{k = 1}X_k, where the summands X_k, k = 1, 2, …, are conditionally dependent random variables with a common subexponential distribution F, and the random number τ is a non negative integer-valued random variable, independent of {X_k: k ? 1}.     

The large sample coverage probability of confidence intervals in general regression models after a preliminary hypothesis test

We derive a computationally convenient formula for the large sample coverage probability of a confidence interval for a scalar parameter of interest following a preliminary hypothesis test that a specified vector parameter takes a given value in a general regression model. Previously, this large sample coverage probability could only be estimated by simulation. Our formula only requires the evaluation, by numerical integration, of either a double or a triple integral, irrespective of the dimension of this specified vector parameter. We illustrate the application of this formula to a confidence interval for the odds ratio of myocardial infarction when the exposure is recent oral contraceptive use, following a preliminary test where two specified interactions in a logistic regression model are zero. For this real‐life data, we compare this large sample coverage probability with the actual coverage probability of this confidence interval, obtained by simulation.     

Changepoint Problems Under Random Censorship

Let X ₁, …, X _[nθ], X _{[nθ] + 1}, …, X _n be a sequence of independent random variables (the “lifetimes”) such that X _j ? F ₁ for 1 ≤ j ≤ [nθ] and X _j ? F ₂ for [nθ] + 1 ≤ j ≤ n, with F ₁ ≠ F ₂ unknown. In this paper we investigate an estimator θ _n for the changepoint θ if the X's are subject to censoring. The rate of almost sure convergence of θ _n to θ is established and a test for the hypothesis θ = 0, i.e. “no change”, is proposed.     

Confidence intervals centred on bootstrap smoothed estimators

Bootstrap smoothed (bagged) parameter estimators have been proposed as an improvement on estimators found after preliminary data‐based model selection. A result of Efron in 2014 is a very convenient and widely applicable formula for a delta method approximation to the standard deviation of the bootstrap smoothed estimator. This approximation provides an easily computed guide to the accuracy of this estimator. In addition, Efron considered a confidence interval centred on the bootstrap smoothed estimator, with width proportional to the estimate of this approximation to the standard deviation. We evaluate this confidence interval in the scenario of two nested linear regression models, the full model and a simpler model, and a preliminary test of the null hypothesis that the simpler model is correct. We derive computationally convenient expressions for the ideal bootstrap smoothed estimator and the coverage probability and expected length of this confidence interval. In terms of coverage probability, this confidence interval outperforms the post‐model‐selection confidence interval with the same nominal coverage and based on the same preliminary test. We also compare the performance of the confidence interval centred on the bootstrap smoothed estimator, in terms of expected length, to the usual confidence interval, with the same minimum coverage probability, based on the full model.     

On confidence intervals for nonmonotone parametric functions and an application to the squared mean of the normal distribution

Consider the problem of obtaining a confidence interval for some function g(θ) of an unknown parameter θ, for which a (1-α)-confidence interval is given. If g(θ) is one-to-one the solution is immediate. However, if g is not one-to-one the problem is more complex and depends on the structure of g. In this note the situation where g is a nonmonotone convex function is considered. Based on some inequality, a confidence interval for g(θ) with confidence level at least 1-α is obtained from the given (1-α) confidence interval on θ. Such a result is then applied to the n(μ, σ ²) distribution with σ known. It is shown that the coverage probability of the resulting confidence interval, while being greater than 1-α, has in addition an upper bound which does not exceed Θ(3z_1−α/2)-α/2.     

A note on the asymptotic efficiency of the sobel–wald test

Let X₁,X₂, … be iid random variables with the pdf f(x,θ)=exp(θx?b(θ)) relative to a σ-finite measure μ, and consider the problem of deciding among three simple hypotheses H_i:θ=θ_i (1?i?3) subject to P(acceptH_i|θ_i)=1?α (1?i?3). A procedure similar to Sobel–Wald procedure is discussed and its asymptotic efficiency as compared with the best nonsequential test is obtained by finding the limit lim_a→0(E_iN(a)/n(a)), where N (a) is the stopping time of the proposed procedure and n(a) is the sample size of the best non-sequential test. It is shown that the same asymptotic limit holds for the original Sobel–Wald procedure. Specializing to N(θ,1) distribution it is found that lim_a→0$\text{(E}{}_{\mathrm{i}}\text{N(α)/n(α))=}\text{1}\text{4}$ (i=1,2) and lim_a→0 (E₃N(α)n(α))=δ²₁/4δ, where δ_i=(θ_i+1?θ_i) with 0<δ₁?δ₂. Also, the asymptotic efficiency evaluated when the X's have an exponential distribution.