A note on the admissibility of hammersley's estimator of an integer mean

Let X₁, X₂, …, X_n be identically, independently distributed N(i,1) random variables, where i = 0, ±1, ±2, … Hammersley (1950) showed that d = [X?_n], the nearest integer to the sample mean, is the maximum likelihood estimator of i. Khan (1973) showed that d is minimax and admissible with respect to zero-one loss. This note now proves a conjecture of Stein to the effect that in the class of integer-valued estimators d is minimax and admissible under squared-error loss.     

A semiparametric estimator of the distribution function of a variable measured with error

The estimation of the distribution functon of a random variable X measured with error is studied. Let the i-th observation on X be denoted by Y_iX_i+ε_i where ε_i is the measuremen error. Let {Y_i} (i=1,2,…,n) be a sample of independent observations. It is assumed that {X_i} and {∈_i} are mutually independent and each is identically distributed. As is standard in the literature for this problem, the distribution of e is assumed known in the development of the methodology. In practice, the measurement error distribution is estimated from replicate observations.

The proposed semiparametric estimator is derived by estimating the quantises of X on a set of n transformed V-values and smoothing the estimated quantiles using a spline function. The number of parameters of the spline function is determined by the data with a simple criterion, such as AIC. In a simulation study, the semiparametric estimator dominates an optimal kernel estimator and a normal mixture estimator for a wide class of densities.

The proposed estimator is applied to estimate the distribution function of the mean pH value in a field plot. The density function of the measurement error is estimated from repeated measurements of the pH values in a plot, and is treated as known for the estimation of the distribution function of the mean pH value.     

On the predictive performance of the almost unbiased Liu estimator

ABSTRACT

Regression models are usually used in forecasting (predicting) unknown values of the response variable y. This article considers the predictive performance of the almost unbiased Liu estimator compared to the ordinary least-squares estimator, principal component regression estimator, and Liu estimator. Finally, we present a numerical example to explain the theoretical results and we obtain a region where the almost unbiased Liu estimator is uniformly superior to the ordinary least-squares estimator, principal component regression estimator, and Liu estimator.     

New estimator for functions of the canonical correlation coefficients

Let ρ₁,…,ρ_p be the population canonical correlation coefficients from a normal distribution. This paper considers the estimation of δ₁,…,δ_p, where $\text{δ}{}_{\mathrm{i}}\text{=ρ}{}_{\mathrm{i}}{}^2\text{/(1−ρ}{}_{\mathrm{i}}{}^2\text{),}\text{i=1,…,p}$, in a decision theoretic way. Since the distribution of δ_i's is complicated, two-staged estimation has been a usual method so far; i.e., first find a good estimator of a matrix whose eigenvalues are the δ_i's, then use its eigenvalues as the estimators of δ_i's. In this paper we directly estimate δ_i's and evaluate the estimators with respect to a quadratic loss function. We propose a new class of estimators and prove its dominance over the usual estimator.     

A Bayes-type estimator for the Bradley-Terry model for paired comparison

A Bayes-type estimator is proposed for the worth parameter π_i and for the treatment effect parameter ln π_i in the Bradley-Terry Model for paired comparison. In contrast to current Bayes estimators which require iterative numberical calculations, this estimator has a closed form expression. This estimation technique is also extended to obtain estimators for the Luce Multiple Comparison Model. An application of this technique to a 2³ factorial experiment with paired comparisons is presented.     

On the stability of the jackknife variance estimator in ratio estimation

The stability of a slightly modified version of the usual jackknife variance estimator is evaluated exactly in small samples under a suitable linear regression model and compared with that of two different linearization variance estimators. Depending on the degree of heteroscedasticity of the error variance in the model, the stability of the jackknife variance estimator is found to be somewhat comparable to that of one or the other of the linearization variance estimators under conditions especially favorable to ratio estimation (i.e., regression approximately through the origin with a relatively small coefficient of variation in the x population). When these conditions do not hold, however, the jackknife variance estimator is found to be less stable than either of the linearization variance estimators.     

Robust second-order least-squares estimator for regression models

The second-order least-squares estimator (SLSE) was proposed by Wang (Statistica Sinica 13:1201–1210, 2003) for measurement error models. It was extended and applied to linear and nonlinear regression models by Abarin and Wang (Far East J Theor Stat 20:179–196, 2006) and Wang and Leblanc (Ann Inst Stat Math 60:883–900, 2008). The SLSE is asymptotically more efficient than the ordinary least-squares estimator if the error distribution has a nonzero third moment. However, it lacks robustness against outliers in the data. In this paper, we propose a robust second-order least squares estimator (RSLSE) against X-outliers. The RSLSE is highly efficient with high breakdown point and is asymptotically normally distributed. We compare the RSLSE with other estimators through a simulation study. Our results show that the RSLSE performs very well.     

A jackknife variance estimator for unequal probability sampling

Summary.  The jackknife method is often used for variance estimation in sample surveys but has only been developed for a limited class of sampling designs. We propose a jackknife variance estimator which is defined for any without-replacement unequal probability sampling design. We demonstrate design consistency of this estimator for a broad class of point estimators. A Monte Carlo study shows how the proposed estimator may improve on existing estimators.     

A nonparametric estimator of the number of classes based on a stratified random sample

Under stratified random sampling, we develop a k^th-order bootstrap bias-corrected estimator of the number of classes θ which exist in a study region. This research extends Smith and van Belle’s (1984) first-order bootstrap bias-corrected estimator under simple random sampling. Our estimator has applicability for many settings including: estimating the number of animals when there are stratified capture periods, estimating the number of species based on stratified random sampling of subunits (say, quadrats) from the region, and estimating the number of errors/defects in a product based on observations from two or more types of inspectors. When the differences between the strata are large, utilizing stratified random sampling and our estimator often results in superior performance versus the use of simple random sampling and its bootstrap or jackknife [Burnham and Overton (1978)] estimator. The superior performance is often associated with more observed classes, and we provide insights into optimal designation of the strata and optimal allocation of sample sectors to strata.     

Improved estimators for the selected location parameters

_i , i = 1, 2, ..., k be k independent exponential populations with different unknown location parameters θ _i , i = 1, 2, ..., k and common known scale parameter σ. Let Y _i denote the smallest observation based on a random sample of size n from the i-th population. Suppose a subset of the given k population is selected using the subset selection procedure according to which the population π _i is selected iff Y _i ≥Y ₍₁₎−d, where Y ₍₁₎ is the largest of the Y _i 's and d is some suitable constant. The estimation of the location parameters associated with the selected populations is considered for the squared error loss. It is observed that the natural estimator dominates the unbiased estimator. It is also shown that the natural estimator itself is inadmissible and a class of improved estimators that dominate the natural estimator is obtained. The improved estimators are consistent and their risks are shown to be O(kn ⁻²). As a special case, we obtain the coresponding results for the estimation of θ₍₁₎, the parameter associated with Y ₍₁₎. Received: January 6, 1998; revised version: July 11, 2000     

Robust median estimator in logistic regression

This paper introduces a median estimator of the logistic regression parameters. It is defined as the classical _L1$L_1$-estimator applied to continuous data _Z1,…,_Zn$Z_1,\dots ,Z_n$ obtained by a statistical smoothing of the original binary logistic regression observations _Y1,…,_Yn$Y_1,\dots ,Y_n$. Consistency and asymptotic normality of this estimator are proved. A method called enhancement is introduced which in some cases increases the efficiency of this estimator. Sensitivity to contaminations and leverage points is studied by simulations and compared in this manner with the sensitivity of some robust estimators previously introduced to the logistic regression. The new estimator appears to be more robust for larger sample sizes and higher levels of contamination.     

Estimation of the linear-plateau segmented regression model in the presence of measurement error

It is well known that when the true values of the independent variable are unobservable due to measurement error, the least squares estimator for a regression model is biased and inconsistent. When repeated observations on each x_i are taken, consistent estimators for the linear-plateau model can be formed. The repeated observations are required to classify each observation to the appropriate line segment. Two cases of repeated observations are treated in detail. First, when a single value of y_i is observed with the repeated observations of x_i the least squares estimator using the mean of the repeated x_i observations is consistent and asymptotically normal. Second, when repeated observations on the pair (x_i, y_i ) are taken the least squares estimator is inconsistent, but two consistent estimators are proposed: one that consistently estimates the bias of the least squares estimator and adjusts accordingly; the second is the least squares estimator using the mean of the repeated observations on each pair.     

The limiting distribution of the least-squares estimator in nearly integrated seasonal models

We consider the least-squares estimator of the autoregressive parameter in a nearly integrated seasonal model. Building on the study by Chan (1989), who obtained the limiting distribution, we derive a closed-form expression for the appropriate limiting joint moment generating function. We use this function to tabulate percentage points of the asymptotic distribution for various seasonal periods via numerical integration. The results are extended by deriving a stochastic asymptotic expansion to order O_p(T^-l), whose percentage points are also obtained by numerically integrating the appropriate limiting joint moment generating function. The adequacy of the approximation to the finite-sample distribution is discussed.     

Estimating the parameter of selected uniform population under the squared log error loss function

Let π₁, …, π_k be k (? 2) independent populations, where π_i denotes the uniform distribution over the interval (0, θ_i) and θ_i > 0 (i = 1, …, k) is an unknown scale parameter. The population associated with the largest scale parameter is called the best population. For selecting the best population, We use a selection rule based on the natural estimators of θ_i, i = 1, …, k, for the case of unequal sample sizes. Consider the problem of estimating the scale parameter θ_L of the selected uniform population when sample sizes are unequal and the loss is measured by the squared log error (SLE) loss function. We derive the uniformly minimum risk unbiased (UMRU) estimator of θ_L under the SLE loss function and two natural estimators of θ_L are also studied. For k = 2, we derive a sufficient condition for inadmissibility of an estimator of θ_L. Using these condition, we conclude that the UMRU estimator and natural estimator are inadmissible. Finally, the risk functions of various competing estimators of θ_L are compared through simulation.     

On the bounded regret of empirical bayes estimators

Let (θ₁,x₁),…,(θ_n,x_n) be independent and identically distributed random vectors with E(xθ) = θ and Var(x|θ) = a + bθ + cθ². Let t_i be the linear Bayes estimator of θ_i and θ~_i be the linear empirical Bayes estimator of θ_i as proposed in Robbins (1983). When Ex and Var x are unknown to the statistician. The regret of using θ~_i instead of t_i because of ignorance of the mean and the variance is r_i = E(θ_i ? θ_i)² ?E(t_i ?θ_i)². Under appropriate conditions cumulative regret R_n = r₁+…r_n is shown to have a finite limit even when n tends to infinity. The limit can be explicitly computed in terms of a,b,c and the first four moments of x.     

A study on the least squares estimator of multivariate isotonic regression function

Consider the problem of pointwise estimation of f in a multivariate isotonic regression model Z=f(X₁,…,X_d)+ϵ, where Z is the response variable, f is an unknown nonparametric regression function, which is isotonic with respect to each component, and ϵ is the error term. In this article, we investigate the behavior of the least squares estimator of f. We generalize the greatest convex minorant characterization of isotonic regression estimator for the multivariate case and use it to establish the asymptotic distribution of properly normalized version of the estimator. Moreover, we test whether the multivariate isotonic regression function at a fixed point is larger (or smaller) than a specified value or not based on this estimator, and the consistency of the test is established. The practicability of the estimator and the test are shown on simulated and real data as well.     

A distribution function estimator for the difference of order statistics from two independent samples

For two independent populations X and Y we develop the empirical distribution function estimator for the difference of order statistics of the form X _(i)−Y _(j). The key practical application for this estimator pertains to inference between quantiles from two independent populations.     

The feasible generalized restricted ridge regression estimator

The presence of autocorrelation in errors and multicollinearity among the regressors have undesirable effects on the least-squares regression. There are a wide range of methods which are proposed to overcome the usefulness of the ordinary least-squares estimator or the generalized least-squares estimator, such as the Stein-rule, restricted least-squares or ridge estimator. Therefore, we introduce a new feasible generalized restricted ridge regression (FGRR) estimator to examine multicollinearity and autocorrelation problems simultaneously for the general linear regression model. We also derive some statistical properties of the FGRR estimator and comparisons have been conducted using matrix mean-square error. Moreover, a Monte Carlo simulation experiment is performed to investigate the performance of the proposed estimator over the others.     

Pmc-optimal nonparametric quantile estimator

According to Pitman's Measure of Closeness, if T₁and T₂are two estimators of a real parameter $[d], then T₁is better than T₂if Po[d]{\T₁-o[d] < \T₂-0[d]\} > 1/2 for all 0[d]. It may however happen that while T₁is better than T₂and T₂is better than T₃, T₃is better than T₁. Given q ? (0,1) and a sample X₁, X₂, ..., X_nfrom an unknown F ? F, an estimator T* = T*(X₁,X₂...X_n)of the q-th quantile of the distribution F is constructed such that P_F{\F(T*)-q\ <[d] \F(T)-q\} >[d] 1/2 for all F?F and for all T€T, where F is a nonparametric family of distributions and T is a class of estimators. It is shown that T* =X_j:n'for a suitably chosen jth order statistic.     

Estimating the mean of the selected uniform population

Let π_i(i=1,2,…K) be independent U(0,?_i) populations. Let Y_i denote the largest observation based on a random sample of size n from the i-th population. for selecting the best populaton, that is the one associated with the largest ?_i, we consider the natural selection rule, according to which the population corresponding to the largest Y_i is selected. In this paper, the estimation of M. the mean of the selected population is considered. The natural estimator is positively biased. The UMVUE (uniformly minimum variance unbiased estimator) of M is derived using the (U,V)-method of Robbins (1987) and its asymptotic distribution is found. We obtain a minimax estimator of M for K≤4 and a class of admissible estimators among those of the form cY_max. For the case K = 2, the UMVUE is improved using the Brewster-Zidek (1974) Technique with respect to the squared error loss function L₁ and the scale-invariant loss function L₂. For the case K = 2, the MSE'S of all the estimators are compared for selected values of n and ρ=?₁/(?₁+?₂).