Shrinkage and Orthogonal Decomposition

ABSTRACT. The problem of estimating the mean of a multivariate normal distribution when the parameter space allows an orthogonal decomposition is discussed. Risk functions and lower bounds for a class of shrinkage estimators that includes Stein's estimator are derived, and an improvement on Stein's estimator that takes advantage of the orthogonal decomposition is introduced. Uniform asymptotics related to Pinsker's minimax risk is derived and we give conditions for attaining the lower risk bound. Special cases including regression and analysis of variance are discussed.     

Kernel Density Estimation with Generalized Binning

We propose kernel density estimators based on prebinned data. We use generalized binning schemes based on the quantiles points of a certain auxiliary distribution function. Therein the uniform distribution corresponds to usual binning. The statistical accuracy of the resulting kernel estimators is studied, i.e. we derive mean squared error results for the closeness of these estimators to both the true function and the kernel estimator based on the original data set. Our results show the influence of the choice of the auxiliary density on the binned kernel estimators and they reveal that non-uniform binning can be worthwhile.     

A Characterization of the Normal Family of Distributions Based on the Bias of the Maximum Likelihood Estimator

This paper characterizes the family of Normal distributions within the class of exponential families of distributions, via the structure of the bias of the maximum likelihood estimator Θ _n of the canonical parameter Θ . More specifically, when E _θ ( Θ n ) – Θ = (1/ n ) Q ( Θ ) + o (1/ n ), the equality Q ( Θ ) = 0 proves to be a property of the Normal distribution only. The same conclusion is obtained for the one-dimensional case bt assuming that Q ( Θ ) is a polynomial of Θ .     

Bayesian estimation for the Pareto income distribution

The Bayes estimators of the Gini index, the mean income and the proportion of the population living below a prescribed income level are obtained in this paper on the basis of censored income data from a pareto income distribution. The said estimators are obtained under the assumptions of a two-parameter exponential prior distribution and the usual squared error loss function. This work is also extended to the case when the income data are grouped and the exact incomes for the individuals in the population are not available. The method for the assessment of the hyperparameters is also outlined. Finally, the results are generalized for the doubly truncated gamma prior distribution. Now deceased.     

On the relative accuracy of certain bootstrap procedures

We show the second-order relative accuracy, on bounded sets, of the Studentized bootstrap, exponentially tilted bootstrap and nonparametric likelihood tilted bootstrap, for means and smooth functions of means. We also consider the relative errors for larger deviations. Our method exploits certain connections between Edgeworth and saddlepoint approximations to simplify the computations.     

Testing lack of fit of regression models under heteroscedasticity

A test is proposed for assessing the lack of fit of heteroscedastic nonlinear regression models that is based on comparison of nonparametric kernel and parametric fits. A data-driven method is proposed for bandwidth selection using the asymptotically optimal bandwidth of the parametric null model which leads to a test that has a limiting normal distribution under the null hypothesis and is consistent against any fixed alternative. The resulting test is applied to the problem of testing the lack of fit of a generalized linear model.     

RECENTERED AND RESCALED INSTRUMENTAL VARIABLE ESTIMATION OF TOBIT AND PROBIT MODELS WITH ERRORS IN VARIABLES

Since Durbin (1954) and Sargan (1958), instrumental variable (IV) method has long been one of the most popular procedures among economists and other social scientists to handle linear models with errors-in-variables. A direct application of this method to nonlinear errors-in-variables models, however, fails to yield consistent estimators.

This article restricts attention to Tobit and Probit models and shows that simple recentering and rescaling of the observed dependent variable may restore consistency of the standard IV estimator if the true dependent variable and the IV's are jointly normally distributed. Although the required condition seems rarely to be satisfied by real data, our Monte Carlo experiment suggests that the proposed estimator may be quite robust to the possible deviation from normality.     

Book Reviews

Books reviewed:
Philip Hans Franses & Dick van Dijk, Non-linear Time Series Models in Empirical Finance
Herbert Spirer, Louise Spirer & A.J. Jaffe, Misused Statistics
Deborah J. Bennett, Randomness
C.E. Linneborg, Data Analysis by Resampling: Concepts and Applications
I. Clark and W.V. Harper, Practical Geostatistics 2000     

Conditionally Reducible Natural Exponential Families and Enriched Conjugate Priors

Consider a standard conjugate family of prior distributions for a vector-parameter indexing an exponential family. Two distinct model parameterizations may well lead to standard conjugate families which are not consistent, i.e. one family cannot be derived from the other by the usual change-of-variable technique. This raises the problem of finding suitable parameterizations that may lead to enriched conjugate families which are more flexible than the traditional ones. The previous remark motivates the definition of a new property for an exponential family, named conditional reducibility. Features of conditionally-reducible natural exponential families are investigated thoroughly. In particular, we relate this new property to the notion of cut, and show that conditionally-reducible families admit a reparameterization in terms of a vector having likelihood-independent components. A general methodology to obtain enriched conjugate distributions for conditionally-reducible families is described in detail, generalizing previous works and more recent contributions in the area. The theory is illustrated with reference to natural exponential families having simple quadratic variance function.     

Smoothing for discrete-valued time series

We deal with smoothed estimators for conditional probability functions of discrete-valued time series { Y_t } under two different settings. When the conditional distribution of Y_t given its lagged values falls in a parametric family and depends on exogenous random variables, a smoothed maximum (partial) likelihood estimator for the unknown parameter is proposed. While there is no prior information on the distribution, various nonparametric estimation methods have been compared and the adjusted Nadaraya–Watson estimator stands out as it shares the advantages of both Nadaraya–Watson and local linear regression estimators. The asymptotic normality of the estimators proposed has been established in the manner of sparse asymptotics, which shows that the smoothed methods proposed outperform their conventional, unsmoothed, parametric counterparts under very mild conditions. Simulation results lend further support to this assertion. Finally, the new method is illustrated via a real data set concerning the relationship between the number of daily hospital admissions and the levels of pollutants in Hong Kong in 1994–1995. An ad hoc model selection procedure based on a local Akaike information criterion is proposed to select the significant pollutant indices.