Changepoint Problems Under Random Censorship

Let X ₁, …, X _[nθ], X _{[nθ] + 1}, …, X _n be a sequence of independent random variables (the “lifetimes”) such that X _j ? F ₁ for 1 ≤ j ≤ [nθ] and X _j ? F ₂ for [nθ] + 1 ≤ j ≤ n, with F ₁ ≠ F ₂ unknown. In this paper we investigate an estimator θ _n for the changepoint θ if the X's are subject to censoring. The rate of almost sure convergence of θ _n to θ is established and a test for the hypothesis θ = 0, i.e. “no change”, is proposed.     

Parametric inference based on judgment post stratified samples

In this paper, we consider a judgment post stratified (JPS) sample of set size $H$ from a location and scale family of distributions. In a JPS sample, ranks of measured units are random variables. By conditioning on these ranks, we derive the maximum likelihood (MLEs) and best linear unbiased estimators (BLUEs) of the location and scale parameters. Since ranks are random variables, by considering the conditional distributions of ranks given the measured observations we construct Rao-Blackwellized version of MLEs and BLUEs. We show that Rao-Blackwellized estimators always have smaller mean squared errors than MLEs and BLUEs in a JPS sample. In addition, the paper provides empirical evidence for the efficiency of the proposed estimators through a series of Monte Carlo simulations.     

Inference Under Right Censoring in a Discrete Setup

In this article, we consider the right random censoring scheme in a discrete setup when the lifetime and censoring variables are independent and have geometric distributions with means 1/θ₁ and 1/θ₂, respectively. We first obtain the Maximum Likelihood and Method of Moment estimators of the unknown parameters. We also find the Bayes and Posterior Regret Gamma Minimax estimators of the parameters for the two cases when the prior distributions are dependent and independent, assuming a squared error loss function. We then discuss the Proportional Hazard model, and obtain Maximum Likelihood estimators of the unknown parameters and derive the Bayes estimators assuming squared error loss using Markov Chain Monte Carlo methods.     

Estimating the parameter of selected uniform population under the squared log error loss function

Let π₁, …, π_k be k (? 2) independent populations, where π_i denotes the uniform distribution over the interval (0, θ_i) and θ_i > 0 (i = 1, …, k) is an unknown scale parameter. The population associated with the largest scale parameter is called the best population. For selecting the best population, We use a selection rule based on the natural estimators of θ_i, i = 1, …, k, for the case of unequal sample sizes. Consider the problem of estimating the scale parameter θ_L of the selected uniform population when sample sizes are unequal and the loss is measured by the squared log error (SLE) loss function. We derive the uniformly minimum risk unbiased (UMRU) estimator of θ_L under the SLE loss function and two natural estimators of θ_L are also studied. For k = 2, we derive a sufficient condition for inadmissibility of an estimator of θ_L. Using these condition, we conclude that the UMRU estimator and natural estimator are inadmissible. Finally, the risk functions of various competing estimators of θ_L are compared through simulation.     

Robust Linear Calibration

We regard the simple linear calibration problem where only the response y of the regression line y = β₀ + β₁ t is observed with errors. The experimental conditions t are observed without error. For the errors of the observations y we assume that there may be some gross errors providing outlying observations. This situation can be modeled by a conditionally contaminated regression model. In this model the classical calibration estimator based on the least squares estimator has an unbounded asymptotic bias. Therefore we introduce calibration estimators based on robust one-step-M-estimators which have a bounded asymptotic bias. For this class of estimators we discuss two problems: The optimal estimators and their corresponding optimal designs. We derive the locally optimal solutions and show that the maximin efficient designs for non-robust estimation and robust estimation coincide.     

Order statistics from extreme value distribution,ii: best linear unbiased estimates and some other uses

Let Y_r+1:n ≤ _Y:r+2:n ≤≤… <Y_n?6:n-<: TYPE-II censored sample from an extreme value population with µ and α as the location and scale parameters, respectively. Tables of coefficients for the best linear unbiased estimators (BLUEs) of µ and α are presented for various choices of censoring and sample sizes n = 2(1)15(5)30; variances and covariance of these estimators are also presented. The computational formulae and procedure used and some checks employed are explained. We finally illustrate some uses of the tables by taking examples.     

Improved reduced-bias tail index and quantile estimators

In this paper, we deal with bias reduction techniques for heavy tails, trying to improve mainly upon the performance of classical high quantile estimators. High quantiles depend strongly on the tail index γ$\gamma$, for which new classes of reduced-bias estimators have recently been introduced, where the second-order parameters in the bias are estimated at a level _k1$k_1$ of a larger order than the level k at which the tail index is estimated. Doing this, it was seen that the asymptotic variance of the new estimators could be kept equal to the one of the popular Hill estimators. In a similar way, we now introduce new classes of tail index and associated high quantile estimators, with an asymptotic mean squared error smaller than that of the classical ones for all k in a large class of heavy-tailed models. We derive their asymptotic distributional properties and compare them with those of alternative estimators. Next to that, an illustration of the finite sample behavior of the estimators is also provided through a Monte Carlo simulation study and the application to a set of real data in the field of insurance.     

Central limit theorems for LS estimators in the EV regression model with dependent measurements

In this paper, we consider the simple linear errors-in-variables (EV) regression models: η_i=θ+βx_i+ε_i,ξ_i=x_i+δ_i,1≤i≤n, where θ,β,x₁,x₂,… are unknown constants (parameters), (ε₁,δ₁),(ε₂,δ₂),… are errors and ξ_i,η_i,i=1,2,… are observable. The asymptotic normality for the least square (LS) estimators of the unknown parameters β and θ in the model are established under the assumptions that the errors are m-dependent, martingale differences, ?-mixing, ρ-mixing and α-mixing.     

Some inadmissibility results for estimating ordered uniform scale parameters

Independent random samples (of possibly unequal sizes) are drawn from k (≥2) uniform populations having unknown scale parameters μ₁,…,μ_k. The problem of componentwise estimation of ordered parameters is investigated. The loss function is assumed to be squared error and the cases of known and unknown ordering among μ₁,…,μ_k. are dealt with separately. Sufficient conditions for an estimator to be inadmissible are provided and as a consequence, many natural estimators are shown to be inadmissible, Better estimators are provided.     

Some locally optimal subset selection rules for comparison with a control

Let π₀,π₁,…,π_k be k+1 independent populations. For i=0,1,…,k,π_i has the densit f(x,θ_i), where the (unknown) parameter θ_i belongs to an interval of the real line. Our goal is to select from π₁,… π_k (experimental treatments) those populations, if any, that are better (suitably defined) than π₀ which is the control population. A locally optimal rule is derived in the class of rules for which Pr(π_i is selected)γ_i, i=1,…,k, when θ₀=θ₁=?=θ_k. The criterion used for local optimality amounts to maximizing the efficiency in a certain sense of the rule in picking out the superior populations for specific configurations of θ=(θ₀,…,θ_k) in a neighborhood of an equiparameter configuration. The general result is then applied to the following special cases: (a) normal means comparison — common known variance, (b) normal means comparison — common unknown variance, (c) gamma scale parameters comparison — known (unequal) shape parameters, and (d) comparison of regression slopes. In all these cases, the rule is obtained based on samples of unequal sizes.     

The superharmonic condition for simultaneous estimation of means in exponential familles

The mean vector associated with several independent variates from the exponential subclass of Hudson (1978) is estimated under weighted squared error loss. In particular, the formal Bayes and “Stein-like” estimators of the mean vector are given. Conditions are also given under which these estimators dominate any of the “natural estimators”. Our conditions for dominance are motivated by a result of Stein (1981), who treated the N_p (θ, I) case with p ≥ 3. Stein showed that formal Bayes estimators dominate the usual estimator if the marginal density of the data is superharmonic. Our present exponential class generalization entails an elliptic differential inequality in some natural variables. Actually, we assume that each component of the data vector has a probability density function which satisfies a certain differential equation. While the densities of Hudson (1978) are particular solutions of this equation, other solutions are not of the exponential class if certain parameters are unknown. Our approach allows for the possibility of extending the parametric Stein-theory to useful nonexponential cases, but the problem of nuisance parameters is not treated here.     

Estimation of Pr( x<y ) in the exponential case with common location parameter

This paper considers the problem of estimating the probability P = Pr(X < Y) when X and Y are independent exponential random variables with unequal scale parameters and a common location parameter. Uniformly minimum variance unbiased estimator of P is obtained. The asymptotic distribution of the maximum likelihood estimator is obtained and then the asymptotic equivalence of the two estimators is established. Performance of the two estimators for moderate sample sizes is studied by Monte Carlo simulation. An approximate interval estimator is also obtained.     

Estimation of location parameters of several exponential distributions

In this paper we address the problem of simultaneous estimation of location parameters of several exponential distributions assuming that the scale parameters are unknown and possibly unequal. From a decision theoretic point of view it is shown that the standard estimators are inadmissible and the improved estimators are obtained when p, the number of populations, is more than one.     

VARIANCE ESTIMATION IN TWO-PHASE SAMPLING

Two‐phase sampling is often used for estimating a population total or mean when the cost per unit of collecting auxiliary variables, x, is much smaller than the cost per unit of measuring a characteristic of interest, y. In the first phase, a large sample s₁ is drawn according to a specific sampling design p(s₁) , and auxiliary data x are observed for the units i∈s₁ . Given the first‐phase sample s₁ , a second‐phase sample s₂ is selected from s₁ according to a specified sampling design {p(s₂∣s₁) } , and (y, x) is observed for the units i∈s₂ . In some cases, the population totals of some components of x may also be known. Two‐phase sampling is used for stratification at the second phase or both phases and for regression estimation. Horvitz–Thompson‐type variance estimators are used for variance estimation. However, the Horvitz–Thompson ( Horvitz & Thompson, J. Amer. Statist. Assoc. 1952 ) variance estimator in uni‐phase sampling is known to be highly unstable and may take negative values when the units are selected with unequal probabilities. On the other hand, the Sen–Yates–Grundy variance estimator is relatively stable and non‐negative for several unequal probability sampling designs with fixed sample sizes. In this paper, we extend the Sen–Yates–Grundy ( Sen , J. Ind. Soc. Agric. Statist. 1953; Yates & Grundy , J. Roy. Statist. Soc. Ser. B 1953) variance estimator to two‐phase sampling, assuming fixed first‐phase sample size and fixed second‐phase sample size given the first‐phase sample. We apply the new variance estimators to two‐phase sampling designs with stratification at the second phase or both phases. We also develop Sen–Yates–Grundy‐type variance estimators of the two‐phase regression estimators that make use of the first‐phase auxiliary data and known population totals of some of the auxiliary variables.     

Minimax estimation of a lower-bounded scale parameter of a gamma distribution for scale-invariant squared-error loss

Let X have a gamma distribution with known shape parameter θr;aL and unknown scale parameter θ. Suppose it is known that θ ≥ a for some known a > 0. An admissible minimax estimator for scale-invariant squared-error loss is presented. This estimator is the pointwise limit of a sequence of Bayes estimators. Further, the class of truncated linear estimators C = {θ_ρ|θ_ρ(x) = max(a, ρ), ρ > 0} is studied. It is shown that each θ_ρ is inadmissible and that exactly one of them is minimax. Finally, it is shown that Katz's [Ann. Math. Statist., 32, 136–142 (1961)] estimator of θ is not minimax for our loss function. Some further properties of and comparisons among these estimators are also presented.     

Recurrence relations for single and product moments of progressively Type-II censored order statistics from generalized logistic distribution with applications to inference

In this article, we establish several recurrence relations for the single and product moments of progressively Type-II right censored order statistics from a generalized logistic distribution. The use of these relations in a systematic manner allow us to compute all the means, variances, and covariances of progressively Type-II right censored order statistics from the generalized logistic distribution for all sample sizes n, effective sample sizes m, and all progressive censoring schemes (R₁, …, R_m). These moments are then utilized to derive best linear unbiased estimators of the scale and location-scale parameters of the generalized logistic distribution. A comparison of these estimators with the maximum likelihood estimates is then made through Monte Carlo simulations. Finally, the best linear unbiased predictors of censored failure times is discussed briefly.     

Testing for equivalence of variances using Hartley's ratio

Hartley's test for homogeneity of k normal‐distribution variances is based on the ratio between the maximum sample variance and the minimum sample variance. In this paper, the author uses the same statistic to test for equivalence of k variances. Equivalence is defined in terms of the ratio between the maximum and minimum population variances, and one concludes equivalence when Hartley's ratio is small. Exact critical values for this test are obtained by using an integral expression for the power function and some theoretical results about the power function. These exact critical values are available both when sample sizes are equal and when sample sizes are unequal. One related result in the paper is that Hartley's test for homogeneity of variances is no longer unbiased when the sample sizes are unequal. The Canadian Journal of Statistics 38: 647–664; 2010 © 2010 Statistical Society of Canada     

Subset selection based on likelihood from uniform and related popupulations

Let π_i (i=1,2,…, k) be charceterized by the uniform distribution on (a_i;b_i), where exactly one of a_i and b_i is unknown. With unequal sample sizes, suppose that from the k (>=2) given populations, we wish to select a random-size subset containing the one with the smllest value of θ_i= b_i - a_i. RuleR_i selects π if a likelihood-based k-dimensional confidence region for the unknown (θ₁,… θ_k) contains at least one point having θ_i as its smallest component. A second rule, R , is derived through a likelihood ratio and turns out to be that of Barr and prabhu whenthe sample sizes are equal. Numerical comparisons are made. The results apply to the larger class of densities g ( z ; θ_i) =M(z)Q(θ_i) if a(θ_i) < z <b(θ_i). Extensions to the cases when both a_i and b_i are unknown and when θ_j isof interest are indicated. 1<=j<=k     

One-step M-estimators in the linear model,with dependent errors

We consider the problem of robust M-estimation of a vector of regression parameters, when the errors are dependent. We assume a weakly stationary, but otherwise quite general dependence structure. Our model allows for the representation of the correlations of any time series of finite length. We first construct initial estimates of the regression, scale, and autocorrelation parameters. The initial autocorrelation estimates are used to transform the model to one of approximate independence. In this transformed model, final one-step M-estimates are calculated. Under appropriate assumptions, the regression estimates so obtained are asymptotically normal, with a variance-covariance structure identical to that in the case in which the autocorrelations are known a priori. The results of a simulation study are given. Two versions of our estimator are compared with the L₁ -estimator and several Huber-type M-estimators. In terms of bias and mean squared error, the estimators are generally very close. In terms of the coverage probabilities of confidence intervals, our estimators appear to be quite superior to both the L₁-estimator and the other estimators. The simulations also indicate that the approach to normality is quite fast.     

Inferences from biased samples with a memory effect

Biased sampling occurs often in observational studies. With one biased sample, the problem of nonparametrically estimating both a target density function and a selection bias function is unidentifiable. This paper studies the nonparametric estimation problem when there are two biased samples that have some overlapping observations (i.e. recaptures) from a finite population. Since an intelligent subject sampled previously may experience a memory effect if sampled again, two general 2-stage models that incorporate both a selection bias and a possible memory effect are proposed. Nonparametric estimators of the target density, selection bias, and memory functions, as well as the population size are developed. Asymptotic properties of these estimators are studied and confidence bands for the selection function and memory function are provided. Our procedures are compared with those ignoring the memory effect or the selection bias in finite sample situations. A nonparametric model selection procedure is also given for choosing a model from the two 2-stage models and a mixture of these two models. Our procedures work well with or without a memory effect, and with or without a selection bias. The paper concludes with an application to a real survey data set.