Exactly optimal sampling designs for processes with a product covariance structure

The author considers the problem of finding exactly optimal sampling designs for estimating a second‐order, centered random process on the basis of finitely many observations. The value of the process at an unsampled point is estimated by the best linear unbiased estimator. A weighted integrated mean squared error or the maximum mean squared error is used to measure the performance of the estimator. The author presents a set of necessary and sufficient conditions for a design to be exactly optimal for processes with a product covariance structure. Expansions of these conditions lead to conditions for asymptotic optimality.     

A generalized class of estimators under two-phase stratified sampling for non response

In this paper, we propose a generalized class of estimators for finite population mean using two auxiliary variables in two-phase stratified sampling for non response. We identify 17 estimators as special cases of the proposed class of estimators. Expressions for the bias and mean squared error (MSE) of estimators are obtained up to first order of approximation. A data set is used for efficiency comparisons.     

Matrix mean square error comparisons based on a certain covariance structure

For two given estimators of a parameter vector the covariance structure of their difference is used to compare them in terms of their mean square error matrices. The results obtained are applied to the covariance adjustment technique and regression     

Adaptive normal reference bandwidth based on quantile for kernel density estimation

Bandwidth selection is an important problem of kernel density estimation. Traditional simple and quick bandwidth selectors usually oversmooth the density estimate. Existing sophisticated selectors usually have computational difficulties and occasionally do not exist. Besides, they may not be robust against outliers in the sample data, and some are highly variable, tending to undersmooth the density. In this paper, a highly robust simple and quick bandwidth selector is proposed, which adapts to different types of densities.     

A note on the estimation of variance of sample mean Using the knowledge of coefficient of variation in normal population

A class of estimators for the variance of sample mean is defined and its properties are studied in case of normal population. It is identified that the usual unbiased estimator, Singh, Pandey and Hirano (1973) -type estimator and Lee (1931) estimator are particular members of the proposed class of estimators. It is found that the minimum Mean Squared Error (MSE) of the proposed class of estimators is less than that of other estimators.     

An alternative approach to variable selection for prediction

A procedure for selecting a subset of predictor variables in regression analysis is suggested. The procedure is so designed that it leads to the selection of a subset of variables having an adequate degree of informativeness with a directly specified confidence coefficient. Some examples are considered to illustrate the application of the procedure.     

A note on a modified double stage shrinkage estimator

A modified double stage shrinkage estimator has been proposed for the single parameter θ of a distribution function _Fθ. It is shown to be locally better in comparison to the usual double stage shrinkage estimator in the sense of smaller mean squared error in a certain neighbourhood of prior estimate θ_o of θ.     

Nonparametric Shrinkage Estimation for Aalen's Additive Hazards Model

Aalen's nonparametric additive model in which the regression coefficients are assumed to be unspecified functions of time is a flexible alternative to Cox's proportional hazards model when the proportionality assumption is in doubt. In this paper, we incorporate a general linear hypothesis into the estimation of the time‐varying regression coefficients. We combine unrestricted least squares estimators and estimators that are restricted by the linear hypothesis and produce James‐Stein‐type shrinkage estimators of the regression coefficients. We develop the asymptotic joint distribution of such restricted and unrestricted estimators and use this to study the relative performance of the proposed estimators via their integrated asymptotic distributional risks. We conduct Monte Carlo simulations to examine the relative performance of the estimators in terms of their integrated mean square errors. We also compare the performance of the proposed estimators with a recently devised LASSO estimator as well as with ridge‐type estimators both via simulations and data on the survival of primary billiary cirhosis patients.     

On the relationship between the sample size and the number of variables in a linear regression model

The problem of determining the number of variables to be included in the linear regression model is considered under the assumption that the dependent and independent variables have a joint normal distribution. It is shown that for a given sample size n there exists an optimal number k₀ (0 ≤ k₀ < n-2) of variables among all independent variables in the model, such that the expectation of the mean squared error corresponding to the prediction equation with k₀ variables is minimal.Application of this result to ustepwise procedures is discussed.     

Estimating the population median using only a central subset of observations

In estimating the population median, it is common to encounter estimators which are linear combinations of a small number of central observations. Sample medians, sample quasi medians, trimmed means, jackknifed (and delete‐d jackknifed) medians and jackknifed quasi medians are all familiar examples. The objective of this paper is to show that within this class the quasi medians turn out to have the best asymptotic mean squared error.     

Shrinkage estimation of scale in exponential distribution from censored samples

In this paper some shrunken and pretest shrunken estimators are suggested for the scale parameter of an exponential distribution, when observations become available from life test experiments. These estimators are shown to be more efficient than the usual estimator when a guessed value is nearer to the true value.     

A New Kernel Distribution Function Estimator Based on a Non-parametric Transformation of the Data

Abstract.  A new kernel distribution function (df) estimator based on a non-parametric transformation of the data is proposed. It is shown that the asymptotic bias and mean squared error of the estimator are considerably smaller than that of the standard kernel df estimator. For the practical implementation of the new estimator a data-based choice of the bandwidth is proposed. Two possible areas of application are the non-parametric smoothed bootstrap and survival analysis. In the latter case new estimators for the survival function and the mean residual life function are derived.     

Autocovariance Estimation in Regression with a Discontinuous Signal and m‐Dependent Errors: A Difference‐Based Approach

We discuss a class of difference‐based estimators for the autocovariance in nonparametric regression when the signal is discontinuous and the errors form a stationary m‐dependent process. These estimators circumvent the particularly challenging task of pre‐estimating such an unknown regression function. We provide finite‐sample expressions of their mean squared errors for piecewise constant signals and Gaussian errors. Based on this, we derive biased‐optimized estimates that do not depend on the unknown autocovariance structure. Notably, for positively correlated errors, that part of the variance of our estimators that depend on the signal is minimal as well. Further, we provide sufficient conditions for ‐consistency; this result is extended to piecewise Hölder regression with non‐Gaussian errors. We combine our biased‐optimized autocovariance estimates with a projection‐based approach and derive covariance matrix estimates, a method that is of independent interest. An R package, several simulations and an application to biophysical measurements complement this paper.     

A note on iterative AK composite estimator for Current Population Survey

In this article, we introduce the iterative AK composite estimator for the Current Population Survey. This estimator adopts the AK composite estimator as the initial value and further makes good use of the intrinsic composite scheme of the AK composite estimator. We derive the mean squared error (MSE) formula for the iterative composite estimator and describe how to select the optimal tuning coefficients by minimising the MSE. Finally, we examine the proposed method through a simulation study.     

A sufficient condition for the MSE dominance of the positive-part shrinkage estimator when each individual regression coefficient is estimated in a misspecified linear regression model

In this paper, assuming that there exist omitted explanatory variables in the specified model, we derive the exact formula for the mean squared error (MSE) of a general family of shrinkage estimators for each individual regression coefficient. It is shown analytically that when our concern is to estimate each individual regression coefficient, the positive-part shrinkage estimators have smaller MSE than the original shrinkage estimators under some conditions even when the relevant regressors are omitted. Also, by numerical evaluations, we showed the effects of our theorem for several specific cases. It is shown that the positive-part shrinkage estimators have smaller MSE than the original shrinkage estimators for wide region of parameter space even when there exist omitted variables in the specified model.     

Two Non-Negative Estimators for the Model With a Common Mean

Recently C. R. Rao (1984) suggested two modifications to the MINQUE, called MINQUE(S.D.) and MINQUE(C.P.), for estimating the variance components in a linear model. These modifications provide non-negative estimates unlike the MINQUE. In this article we shall compare the performance of these two estimators with some of the other existing modifications of MINQUE in terms of standard criteria such as the mean squared error and total squared bias.     

A Convolution Estimator for the Density of Nonlinear Regression Observations

Abstract. The problem of estimating an unknown density function has been widely studied. In this article, we present a convolution estimator for the density of the responses in a nonlinear heterogenous regression model. The rate of convergence for the mean square error of the convolution estimator is of order n ^?1 under certain regularity conditions. This is faster than the rate for the kernel density method. We derive explicit expressions for the asymptotic variance and the bias of the new estimator, and further a data‐driven bandwidth selector is proposed. We conduct simulation experiments to check the finite sample properties, and the convolution estimator performs substantially better than the kernel density estimator for well‐behaved noise densities.     

Comparisons of methods of estimation for a pareto distribution of the first kind

This paper compares methods of estimation for the parameters of a Pareto distribution of the first kind to determine which method provides the better estimates when the observations are censored, The unweighted least squares (LS) and the maximum likelihood estimates (MLE) are presented for both censored and uncensored data. The MLE's are obtained using two methods, In the first, called the ML method, it is shown that log-likelihood is maximized when the scale parameter is the minimum sample value. In the second method, called the modified ML (MML) method, the estimates are found by utilizing the maximum likelihood value of the shape parameter in terms of the scale parameter and the equation for the mean of the first order statistic as a function of both parameters. Since censored data often occur in applications, we study two types of censoring for their effects on the methods of estimation: Type II censoring and multiple random censoring. In this study we consider different sample sizes and several values of the true shape and scale parameters.

Comparisons are made in terms of bias and the mean squared error of the estimates. We propose that the LS method be generally preferred over the ML and MML methods for estimating the Pareto parameter γ for all sample sizes, all values of the parameter and for both complete and censored samples. In many cases, however, the ML estimates are comparable in their efficiency, so that either estimator can effectively be used. For estimating the parameter α, the LS method is also generally preferred for smaller values of the parameter (α ≤4). For the larger values of the parameter, and for censored samples, the MML method appears superior to the other methods with a slight advantage over the LS method. For larger values of the parameter α, for censored samples and all methods, underestimation can be a problem.     

Consistent Smooth Bootstrap Kernel Intensity Estimation for Inhomogeneous Spatial Poisson Point Processes

Non‐parametric estimation and bootstrap techniques play an important role in many areas of Statistics. In the point process context, kernel intensity estimation has been limited to exploratory analysis because of its inconsistency, and some consistent alternatives have been proposed. Furthermore, most authors have considered kernel intensity estimators with scalar bandwidths, which can be very restrictive. This work focuses on a consistent kernel intensity estimator with unconstrained bandwidth matrix. We propose a smooth bootstrap for inhomogeneous spatial point processes. The consistency of the bootstrap mean integrated squared error (MISE) as an estimator of the MISE of the consistent kernel intensity estimator proves the validity of the resampling procedure. Finally, we propose a plug‐in bandwidth selection procedure based on the bootstrap MISE and compare its performance with several methods currently used through both as a simulation study and an application to the spatial pattern of wildfires registered in Galicia (Spain) during 2006.     

Note on the minimum mean integrated squared error of kernel estimates of a distribution function and its derivatives

An exact expiession for the minimum integrated squared error associated with the kernel distribution function and its derivatives is given. Furthermore, the virtual optimality of the Fourier integral estimate in density estimation, shown by Davis (1977), is extended to estimation of a distibution function and its derivatives.