Variances of UMVU Estimators for Means and Variances After Using a Normalizing Transformation

Suppose that the function f is of recursive type and the random variable X is normally distributed with mean μ and variance α². We set C = f(x). Neyman & Scott (1960) and Hoyle (1968) gave the UMVU estimators for the mean E(C) and for the variance Var(C) from independent and identically distributed random variables X₁,…, X_n(n ≧ 2) having a normal distribution with mean μ and variance σ², respectively. Shimizu & Iwase (1981) gave the variance of the UMVU estimator for E(C). In this paper, the variance of the UMVU estimator for Var(C) is given.     

A Bayesian model for local smoothing in kernel density estimation

A new procedure is proposed for deriving variable bandwidths in univariate kernel density estimation, based upon likelihood cross-validation and an analysis of a Bayesian graphical model. The procedure admits bandwidth selection which is flexible in terms of the amount of smoothing required. In addition, the basic model can be extended to incorporate local smoothing of the density estimate. The method is shown to perform well in both theoretical and practical situations, and we compare our method with those of Abramson (The Annals of Statistics 10: 1217–1223) and Sain and Scott (Journal of the American Statistical Association 91: 1525–1534). In particular, we note that in certain cases, the Sain and Scott method performs poorly even with relatively large sample sizes.We compare various bandwidth selection methods using standard mean integrated square error criteria to assess the quality of the density estimates. We study situations where the underlying density is assumed both known and unknown, and note that in practice, our method performs well when sample sizes are small. In addition, we also apply the methods to real data, and again we believe our methods perform at least as well as existing methods.     

A Bayesian test of independence in a two-way contingency table using surrogate sampling

We consider a Bayesian approach to the study of independence in a two-way contingency table which has been obtained from a two-stage cluster sampling design. If a procedure based on single-stage simple random sampling (rather than the appropriate cluster sampling) is used to test for independence, the p-value may be too small, resulting in a conclusion that the null hypothesis is false when it is, in fact, true. For many large complex surveys the Rao–Scott corrections to the standard chi-squared (or likelihood ratio) statistic provide appropriate inference. For smaller surveys, though, the Rao–Scott corrections may not be accurate, partly because the chi-squared test is inaccurate. In this paper, we use a hierarchical Bayesian model to convert the observed cluster samples to simple random samples. This provides surrogate samples which can be used to derive the distribution of the Bayes factor. We demonstrate the utility of our procedure using an example and also provide a simulation study which establishes our methodology as a viable alternative to the Rao–Scott approximations for relatively small two-stage cluster samples. We also show the additional insight gained by displaying the distribution of the Bayes factor rather than simply relying on a summary of the distribution.     

On improving convergence rate of Bernstein polynomial density estimator

This paper is concerned with the Bernstein estimator [Vitale, R.A. (1975), ‘A Bernstein Polynomial Approach to Density Function Estimation’, in Statistical Inference and Related Topics, ed. M.L. Puri, 2, New York: Academic Press, pp. 87–99] to estimate a density with support [0, 1]. One of the major contributions of this paper is an application of a multiplicative bias correction [Terrell, G.R., and Scott, D.W. (1980), ‘On Improving Convergence Rates for Nonnegative Kernel Density Estimators’, The Annals of Statistics, 8, 1160–1163], which was originally developed for the standard kernel estimator. Moreover, the renormalised multiplicative bias corrected Bernstein estimator is studied rigorously. The mean squared error (MSE) in the interior and mean integrated squared error of the resulting bias corrected Bernstein estimators as well as the additive bias corrected Bernstein estimator [Leblanc, A. (2010), ‘A Bias-reduced Approach to Density Estimation Using Bernstein Polynomials’, Journal of Nonparametric Statistics, 22, 459–475] are shown to be O(n^?8/9) when the underlying density has a fourth-order derivative, where n is the sample size. The condition under which the MSE near the boundary is O(n^?8/9) is also discussed. Finally, numerical studies based on both simulated and real data sets are presented.     

A note on bias reduction in variable-kernel density estimates

It is well known that the inverse-square-root rule of Abramson (1982) for the bandwidth h of a variable-kernel density estimator achieves a reduction in bias from the fixed-bandwidth estimator, even when a nonnegative kernel is used. Without some form of “clipping” device similar to that of Abramson, the asymptotic bias can be much greater than O(h⁴) for target densities like the normal (Terrell and Scott 1992) or even compactly supported densities. However, Abramson used a nonsmooth clipping procedure intended for pointwise estimation. Instead, we propose a smoothly clipped estimator and establish a globally valid, uniformly convergent bias expansion for densities with uniformly continuous fourth derivatives. The main result extends Hall's (1990) formula (see also Terrell and Scott 1992) to several dimensions, and actually to a very general class of estimators. By allowing a clipping parameter to vary with the bandwidth, the usual O(h⁴) bias expression holds uniformly on any set where the target density is bounded away from zero.     

Crossing over to cross-over trials

If you have never designed a cross-over trial before then Byron Jones and Scott Haughie give some helpful tips on how to do it.     

Estimation of Fibre Length Distributions from Fibre Endpoints

Estimating the fibre length distribution in composite materials is of practical relevance in materials science. We propose an estimator for the fibre length distribution using the point process of fibre endpoints as input. Assuming that this point process is a realization of a Neyman–Scott process, we use results for the reduced second moment measure to derive a consistent and unbiased estimator for the fibre length distribution. We introduce various versions of the estimator taking anisotropy or errors in the observation into account. The estimator is evaluated using a heuristic for its mean squared error as well as a simulation study. Finally, the estimator is applied to the fibre endpoint process extracted from a tomographic image of a glass fibre composite.     

Asymptotic behaviour of frequency polygons under φ-mixing samples

Under mild conditions, we study the asymptotic behaviour of the uniformly strong consistency of the frequency polygon investigated by Scott under φ ?mixing samples. The results obtained weaken the relevant conditions used by Carbon et al. [6].     

Comments on goodness-of-fitmeasures in binary choice models by frank windmeijer

Review of OPTIMAL CONTROL, EXPECTATIONS AND UNCERTAINTY by Sean Holly and Andrew Hughes Hallett by Scott David Hakala Southern Methodist Univ., Dept. of Economics, Dallas, Tx 75275.     

Book review

Review of OPTIMAL CONTROL, EXPECTATIONS AND UNCERTAINTY by Sean Holly and Andrew Hughes Hallett by Scott David Hakala Southern Methodist Univ., Dept. of Economics, Dallas, Tx 75275.     

Estimation in the presence of incidental parameters

This paper considers the estimation of “structural” parameters when the number of unknown parameters increases with the sample size. Neyman and Scott (1948) had demonstrated that maximum likelihood estimators (MLE) of structural parameters may be inconsistent in this case. Patefield (1977) further observed that the asymptotic covariance matrix of the MLE is not equal to the inverse of the information matrix. In this paper we establish asymptotic properties of estimators (which include in particular the MLE) obtained via the usual likelihood approach when the incidental parameters are first replaced by their estimates (which are allowed to depend on the structural parameters). Conditions for consistency and asymptotic normality together with a proper formula for the asymptotic covariance matrix are given. The results are illustrated and applied to the problem of estimating linear functional relationships, and mild conditions on the incidental parameters for the MLE (or an adjusted MLE) to be consistent and asymptotically normal are obtained. These conditions are weaker than those imposed by previous authors.     

Choosing a robustness tuning parameter

A novel method is proposed for choosing the tuning parameter associated with a family of robust estimators. It consists of minimising estimated mean squared error, an approach that requires pilot estimation of model parameters. The method is explored for the family of minimum distance estimators proposed by [Basu, A., Harris, I.R., Hjort, N.L. and Jones, M.C., 1998, Robust and efficient estimation by minimising a density power divergence. Biometrika, 85, 549–559.] Our preference in that context is for a version of the method using the L ₂ distance estimator [Scott, D.W., 2001, Parametric statistical modeling by minimum integrated squared error. Technometrics, 43, 274–285.] as pilot estimator.     

Tests for Regression Models Fitted to Survey Data

Data from complex surveys are being used increasingly to build the same sort of explanatory and predictive models as those used in the rest of statistics. Unfortunately the assumptions underlying standard statistical methods are not even approximately valid for most survey data. The problem of parameter estimation has been largely solved, at least for routine data analysis, through the use of weighted estimating equations, and software for most standard analytical procedures is now available in the major statistical packages. One notable omission from standard software is an analogue of the likelihood ratio test. An exception is the Rao–Scott test for loglinear models in contingency tables. In this paper we show how the Rao–Scott test can be extended to handle arbitrary regression models. We illustrate the process of fitting a model to survey data with an example from NHANES.     

Residual Analysis for Inhomogeneous Neyman–Scott Processes

Abstract. In this article, we introduce a residual analysis for inhomogeneous Neyman–Scott models based on Laplace functionals. Our simulation study shows that this residual analysis method has a good performance in assessing goodness‐of‐fit and revealing inadequacy of the fitted model. The method is employed in fitting a Thomas model to California redwood trees data and a Matérn model to the locations of hickory trees in Lansing woods, Michigan.     

Uniformly strong consistency and Berry-Esseen bound of frequency polygons for α-mixing samples

In this article, the frequency polygon investigated by Scott is studied as a nonparametric estimator for α-mixing samples. By some known exponent and moment inequalities, we obtain the uniformly strong consistency and Berry-Esseen bound of the estimator. The present results relax the relevant conditions used by Carbon et al. Furthermore, the convergence rate of the uniformly asymptotic normality is derived, which is O(n^{? 1/11}) under the given conditions.     

Preliminary Test Estimators Induced by Three Large Sample Tests for Stochastic Constraints in a Regression Model with Multivariate Student-t Error

In this article, we consider the preliminary test approach to the estimation of the regression parameter in a multiple regression model with multivariate Student-t distribution. The preliminary test estimators (PTE) based on the Wald (W), Likelihood Ratio (LR), and Lagrangian Multiplier (LM) tests are given under the suspicion of stochastic constraints occurring. The bias, mean square error matr ix (MSEM), and weighted mean square error (WMSE) of the proposed estimators are derived and compared. The conditions of superiority of the proposed estimators are obtained. Finally, we conclude that the optimum choice of the level of significance becomes the traditional choice by using the W test.     

Correlational biases in mean response latency differences

Multifarious psychological constructs are indexed by the mean latency difference (MLD), the within-subject difference between mean response latency on two tasks. Two associations consistently emerge in mean latency data. Firstly, across subjects, mean latencies on distinct tasks are positively correlated. This correlation arises from individual differences in general rates of information processing that are a shared influence on response latency in diverse tasks. Secondly, across tasks, the mean and variance of mean latency are positively correlated. Compared to a simple task, a complex task has both a larger average mean latency and a larger variance of mean latency, across subjects. Taken together, these associations make the interpretation of the MLD problematic by biasing correlations between the MLD and (a) task mean latencies, (b) the average of the mean latencies, (c) external criteria, and (d) other MLDs. A variety of mean latency transformations were evaluated and, while they differed in their effectiveness, they did not satisfactorily rectify MLD biases. An alternative approach, focusing on scale invariant contrasts of within-subject response latency distributions, is introduced in the conclusion.     

Optimal minimax squared error risk estimation of the mean of a multivariate normal distribution

Minimax squared error risk estimators of the mean of a multivariate normal distribution are characterized which have smallest Bayes risk with respect to a spherically symmetric prior distribution for (i) squared error loss, and (ii) zero-one loss depending on whether or not estimates are consistent with the hypothesis that the mean is null. In (i), the optimal estimators are the usual Bayes estimators for prior distributions with special structure. In (ii), preliminary test estimators are optimal. The results are obtained by applying the theory of minimax-Bayes-compromise decision problems.     

A Note on Regression-Type Estimators Using Multiple Auxiliary Information

Kiregyera (1984), Mukerjee, Rao & Vijayan (1987), and Tripathi & Ahmed (1995) considered a number of regression-type estimators where information on two auxiliary variables related to study variable is available at different levels. Mukerjee et al . (1987) suggested three estimators and computed their mean square errors, but the computations seem to be incorrect. This note corrects them, and finds their estimators are no better than that of Kiregyera (1984). The estimator suggested by Tripathi & Ahmed (1995) is the best in the sense of having the smallest mean square error.     

The three-fold nested random effects model

Estimation of the variance components and the mean of the balanced and unbalanced threefold nested design is considered. The relative merits of the following procedures are evaluated: Analysis of variance (ANOVA), maximum likelihood (ML), restricted maximum likelihood (REML), and minimum variance quadratic unbiased estimator (MIVQUE). A new procedure called the weighted analysis of means (WAM) estimator which utilizes prior information on the variance components is proposed. It is found to have optimum properties similar to the REML and MIVQUE, and it is also computationally simpler. For the mean, the overall sample average, grand mean, unweighted mean, and generalized least-squares (GLS) estimator with its weights obtained from the above estimators for the variance components are considered. Comparisons of the above procedures for the variance components and the mean are made from exact expressions for the biases and mean square errors (MSEs) of the estimators and from empirical investigations.