Sequential estimation for continuous time finite markov processes

Efficient sequential estimation of the intensity rates of a continuous-time finite Markov process is discussed. An information inequality which gives a lower bound for the variance of an unbiased estimator of a function of the intensity rates is obtained and it is used to define an efficient estimator. All closed efficient sequential sampling schemes are characterized.     

A NOTE ON VARIANCE ESTIMATION FOR THE GENERALIZED REGRESSION PREDICTOR

The generalized regression (GREG) predictor is used for estimating a finite population total when the study variable is well‐related to the auxiliary variable. In 1997, Chaudhuri & Roy provided an optimal estimator for the variance of the GREG predictor within a class of non‐homogeneous quadratic estimators (H) under a certain superpopulation model M. They also found an inequality concerning the expected variances of the estimators of the variance of the GREG predictor belonging to the class H under the model M. This paper shows that the derivation of the optimal estimator and relevant inequality, presented by Chaudhuri & Roy, are incorrect.     

On the sampling performance of an inequality pre-test estimator of the regression error variance under LINEX loss

We consider the estimation of the error variance of a linear regression model where prior information is available in the form of an (uncertain) inequality constraint on the coefficients. Previous studies on this and other related problems use the squared error loss in comparing estimator’s performance. Here, by adopting the asymmetric LINEX loss function, we derive and numerically evaluate the exact risks of the inequality constrained estimator and the inequality pre-test estimator which results after a preliminary test for an inequality constraint on the coefficients. The risks based on squared error loss are special cases of our results, and we draw appropriate comparisons.     

Efficient sequential estimation in multiplicative counting processes

The problem of efficient sequential estimation is counting processes with multiplicative intensity processes is considered. A sequential version of Cramér-Rao type information inequality is obtained and all the 'efficient' triples (S, f, g) are characterized: the variance of an unbiased estimator f for g attains the lower bound under a sampling plan S. Applications to Poisson processes, Markov processes, birth and death processes and Markov branching processes with immigration are also considered.     

Simultaneous confidence intervals in the analysis of orthogonal saturated designs

We present the first known method of constructing exact simultaneous confidence intervals for the analysis of orthogonal, saturated factorial designs. Given m independent, normally distributed, unbiased estimators of treatment contrasts, if there is an independent chi-squared estimator of error variance, then simultaneous confidence intervals based on the Studentized maximum modulus distribution are exact under all parameter configurations. In this paper, an analogous method is developed for the case of an orthogonal saturated design, for which the treatment contrasts are independently estimable but there is no independent estimator of error variance. Lacking an independent estimator of the error variance, the smallest sums of squares of effect estimators are pooled. The simultaneous confidence intervals are based on a probability inequality, for which the simultaneous confidence coefficient is achieved in the null case.     

On the Sampling Performance of an Improved Stein Inequality Restricted Estimator

Using the Stein (1964) variance estimator, this paper defines a modified Stein inequality constrained estimator and derives its exact risk under quadratic loss. Numerical evaluations show that over a wide range of the parameter space, the modified Stein inequality constrained estimator has lower risk than the traditional Stein inequality constrained estimator introduced by Judge et al . (1984).     

An Adjustment to Improve the Bivariate Survivor Function Repaired NPMLE

We recently proposed a representation of the bivariate survivor function as a mapping of the hazard function for truncated failure time variates. The representation led to a class of estimators that includes van der Laan’s repaired nonparametric maximum likelihood estimator (NPMLE) as an important special case. We proposed a Greenwood-like variance estimator for the repaired NPMLE but found somewhat poor agreement between the empirical variance estimates and these analytic estimates for the sample sizes and bandwidths considered in our simulation study. The simulation results also confirmed those of others in showing slightly inferior performance for the repaired NPMLE compared to other competing estimators as well as a sensitivity to bandwidth choice in moderate sized samples. Despite its attractive asymptotic properties, the repaired NPMLE has drawbacks that hinder its practical application. This paper presents a modification of the repaired NPMLE that improves its performance in moderate sized samples and renders it less sensitive to the choice of bandwidth. Along with this modified estimator, more extensive simulation studies of the repaired NPMLE and Greenwood-like variance estimates are presented. The methods are then applied to a real data example. This revised version was published online in September 2005 with a correction to the second author's name.     

Asymptotics for an Adaptive Trimmed Likelihood Location Estimator

An asymptotic normality result is given for an adaptive trimmed likelihood estimator of location, which parallels the asymptotic normality result for the adaptive trimmed mean. The new result comes out of studying the adaptive trimmed likelihood estimator modelled parametrically by a normal family but then examining the behavior when the underlying distribution is in fact some F different from normal. The asymptotic variance of the adaptive estimator is equal to the asymptotic variance of the trimmed likelihood estimator at the optimal trimming proportion for the distribution F, subject to that trimming proportion being positive and F being suitably smooth.     

Estimating variances of strata in ranked set sampling

In RSS, the variance of observations in each ranked set plays an important role in finding an optimal design for unbalanced RSS and in inferring the population mean. The empirical estimator (i.e., the sample variance in a given ranked set) is most commonly used for estimating the variance in the literature. However, the empirical estimator does not use the information in the entire data over different ranked sets. Further, it is highly variable when the sample size is not large enough, as is typical in RSS applications. In this paper, we propose a plug-in estimator for the variance of each set, which is more efficient than the empirical one. The estimator uses a result in order statistics which characterizes the cumulative distribution function (CDF) of the rth order statistics as a function of the population CDF. We analytically prove the asymptotic normality of the proposed estimator. We further apply it to estimate the standard error of the RSS mean estimator. Both our simulation and empirical study show that our estimators consistently outperform existing methods.     

On the cramer-frechet-rao inequality for translation parameter in the case of finite support

In this paper we investigate the problem of deriving the C-F-R (CRAMER-FRECHET-RAO) bound for the variance of an unbiased estimator of the translation para¬meter for a class of distributions having as support an interval of fixed length. Starting with the general form of the O-F-R, inequality studied earlier by VINCZE (1979) for mixed

densities, we prove some inequalities related to the information quantity occurring in the C-F-R bound. The case when the variance of the unbiased estimator does not depend upon the translation parameter is investigated. The case when the variance depends upon the translation parameter is also briefly discussed. Finally some remarks will be given

concerning the attainability of the variance,bounds given in this paper     

Optimal estimation for finite population mean in two-phase sampling

Using two-phase sampling scheme, we propose a general class of estimators for finite population mean. This class depends on the sample means and variances of two auxiliary variables. The minimum variance bound for any estimator in the class is provided (up to terms of ordern ⁻¹). It is also proved that there exists at least a chain regression type estimator which reaches this minimum. Finally, it is shown that other proposed estimators can reach the minimum variance bound, i.e. the optimal estimator is not unique.     

Nonparametric kernel estimation of expected shortfall under negatively associated sequences

Abstract

In this article, Bahadur type expansions of a nonparametric kernel estimator for ES under NA sequences are given. The strong consistency and the uniformly asymptotic normality of the estimator are yielded from the Bahadur type expansions, while the convergence rates of the above asymptotic properties are also obtained. Moreover, the expectation, the variance and the mean squared error (MSE) of the estimator are given. Besides, the optimal bandwidth selection of this estimator is discussed. We point out that all above results are based on the NA sequences. Finally, we conduct numerical simulations and compare performances of some ES estimators.     

Hazard-based nonparametric survivor function estimation

Summary.  A representation is developed that expresses the bivariate survivor function as a function of the hazard function for truncated failure time variables. This leads to a class of nonparametric survivor function estimators that avoid negative mass. The transformation from hazard function to survivor function is weakly continuous and compact differentiable, so that such properties as strong consistency, weak convergence to a Gaussian process and bootstrap applicability for a hazard function estimator are inherited by the corresponding survivor function estimator. The set of point mass assignments for a survivor function estimator is readily obtained by using a simple matrix calculation on the set of hazard rate estimators. Special cases arise from a simple empirical hazard rate estimator, and from an empirical hazard rate estimator following the redistribution of singly censored observations within strips. The latter is shown to equal van der Laan's repaired nonparametric maximum likelihood estimator, for which a Greenwood-like variance estimator is given. Simulation studies are presented to compare the moderate sample performance of various nonparametric survivor function estimators.     

A new linearized ridge Poisson estimator in the presence of multicollinearity

Poisson regression is a very commonly used technique for modeling the count data in applied sciences, in which the model parameters are usually estimated by the maximum likelihood method. However, the presence of multicollinearity inflates the variance of maximum likelihood (ML) estimator and the estimated parameters give unstable results. In this article, a new linearized ridge Poisson estimator is introduced to deal with the problem of multicollinearity. Based on the asymptotic properties of ML estimator, the bias, covariance and mean squared error of the proposed estimator are obtained and the optimal choice of shrinkage parameter is derived. The performance of the existing estimators and proposed estimator is evaluated through Monte Carlo simulations and two real data applications. The results clearly reveal that the proposed estimator outperforms the existing estimators in the mean squared error sense.KEYWORDS: Poisson regression, multicollinearity, ridge Poisson estimator, linearized ridge regression estimator, mean squared errorMathematics Subject Classifications: 62J07, 62F10     

A conditional perspective of weighted variance estimation of the optimal regression estimator

The estimation of the variance for the GREG (general regression) estimator by weighted residuals is widely accepted as a method which yields estimators with good conditional properties. Since the optimal (regression) estimator shares the properties of GREG estimators which are used in the construction of weighted variance estimators, we introduce the weighting procedure also for estimating the variance of the optimal estimator. This method of variance estimation was originally presented in a seemingly ad hoc manner, and we shall discuss it from a conditional point of view and also look at an alternative way of utilizing the weights. Examples that stress conditional behaviour of estimators are then given for elementary sampling designs such as simple random sampling, stratified simple random sampling and Poisson sampling, where for the latter design we have conducted a small simulation study.     

Variance Estimators of the Gini Coefficient—Probability Sampling

An estimator of the Gini coefficient (the well-known income inequality measure) of a finite population is defined for an arbitrary probability sampling design, taking the sampling design into consideration. Alternative estimators of the variance of the estimated Gini coefficient are introduced. The sampling performance of the Gini coefficient estimator and its variance estimators is studied by means of a Monte Carlo study, using stratified sampling from a miniature population of Swedish households with authentic income data.     

A nonparametric estimator of the number of classes based on a stratified random sample

Under stratified random sampling, we develop a k^th-order bootstrap bias-corrected estimator of the number of classes θ which exist in a study region. This research extends Smith and van Belle’s (1984) first-order bootstrap bias-corrected estimator under simple random sampling. Our estimator has applicability for many settings including: estimating the number of animals when there are stratified capture periods, estimating the number of species based on stratified random sampling of subunits (say, quadrats) from the region, and estimating the number of errors/defects in a product based on observations from two or more types of inspectors. When the differences between the strata are large, utilizing stratified random sampling and our estimator often results in superior performance versus the use of simple random sampling and its bootstrap or jackknife [Burnham and Overton (1978)] estimator. The superior performance is often associated with more observed classes, and we provide insights into optimal designation of the strata and optimal allocation of sample sectors to strata.     

The Asymptotic Distribution of the S–Gini Index

Several generalizations of the classical Gini index, placing smaller or greater weights on various portions of income distribution, have been proposed by a number of authors. For purposes of statistical inference, the large sample distribution theory of the estimators of those measures of economic inequality is required. The present paper was stimulated by the use of bootstrap by Xu (2000) to estimate the variance of the estimator of the S –Gini index. It shows that the theory of L –statistics (Chernoff, Gastwirth & Johns, 1967; Shorack & Wellner, 1986) makes possible the construction of a consistent estimator for the S –Gini index and proof of its asymptotic normality. The paper also presents an explicit formula for the asymptotic variance. The formula should be helpful in planning the size of samples from which the S –Gini index can be estimated with a prescribed margin of error.     

A minimum variance kernel estimator and a discrete frequency polygon estimator for ordinal contingency tables

This paper introduces two estimators, a boundary corrected minimum variance kernel estimator based on a uniform kernel and a discrete frequency polygon estimator, for the cell probabilities of ordinal contingency tables. Simulation results show that the minimum variance boundary kernel estimator has a smaller average sum of squared error than the existing boundary kernel estimators. The discrete frequency polygon estimator is simple and easy to interpret, and it is competitive with the minimum variance boundary kernel estimator. It is proved that both estimators have an optimal rate of convergence in terms of mean sum of squared error, The estimators are also defined for high-dimensional tables.     

SEMIPARAMETRIC COMPARISON OF REGRESSION CURVES VIA NORMAL LIKELIHOODS

Härdle & Marron (1990) treated the problem of semiparametric comparison of nonparametric regression curves by proposing a kernel-based estimator derived by minimizing a version of weighted integrated squared error. The resulting estimators of unknown transformation parameters are n-consistent, which prompts a consideration of issues. of optimality. We show that when the unknown mean function is periodic, an optimal nonparametric estimator may be motivated by an elegantly simple argument based on maximum likelihood estimation in a parametric model with normal errors. Strikingly, the asymptotic variance of an optimal estimator of θ does not depend at all on the manner of estimating error variances, provided they are estimated n-consistently. The optimal kernel-based estimator derived via these considerations is asymptotically equivalent to a periodic version of that suggested by Härdle & Marron, and so the latter technique is in fact optimal in this sense. We discuss the implications of these conclusions for the aperiodic case.