A CONSISTENT MODEL SPECIFICATION TEST FOR A REGRESSION FUNCTION BASED ON NONPARAMETRIC WAVELET ESTIMATION

In this paper we present a consistent specification test of a parametric regression function against a general nonparametric alternative. The proposed test is based on wavelet estimation and it is shown to have similar rates of convergence to the more commonly used kernel based tests. Monte Carlo simulations show that this test statistic has adequate size and high power and that it compares favorably with its kernel based counterparts in small samples.     

A NOTE ON VARIANCE ESTIMATION FOR THE GENERALIZED REGRESSION PREDICTOR

The generalized regression (GREG) predictor is used for estimating a finite population total when the study variable is well‐related to the auxiliary variable. In 1997, Chaudhuri & Roy provided an optimal estimator for the variance of the GREG predictor within a class of non‐homogeneous quadratic estimators (H) under a certain superpopulation model M. They also found an inequality concerning the expected variances of the estimators of the variance of the GREG predictor belonging to the class H under the model M. This paper shows that the derivation of the optimal estimator and relevant inequality, presented by Chaudhuri & Roy, are incorrect.     

ESTIMATING THE ROOT OF A NONPARAMETRIC REGRESSION FUNCTION IN A ROBUST FASHION

For a nonparametric regression model y = m(x)+e with n independent observations, we analyze a robust method of finding the root of m(x) based on an M-estimation first discussed by Härdle & Gasser (1984). It is shown here that the robustness properties (minimaxity and breakdown function) of such an estimate are quite analogous to those of an M -estimator in the simple location model, but the rate of convergence is somewhat limited due to the nonparametric nature of the problem.     

VARIANCE ESTIMATION IN THE ERROR COMPONENTS REGRESSION MODEL

ABSTRACT

In a regression model with a random individual and a random time effect explicit representations of the nonnegative quadratic minimum biased estimators of the corresponding variances are deduced. These estimators always exist and are unique. Moreover, under normality assumption of the dependent variable unbiased estimators of the mean squared errors of the variance estimates are derived. Finally, confidence intervals on the variance components are considered.     

VARIANCE ESTIMATION IN TWO-PHASE SAMPLING

Two‐phase sampling is often used for estimating a population total or mean when the cost per unit of collecting auxiliary variables, x, is much smaller than the cost per unit of measuring a characteristic of interest, y. In the first phase, a large sample s₁ is drawn according to a specific sampling design p(s₁) , and auxiliary data x are observed for the units i∈s₁ . Given the first‐phase sample s₁ , a second‐phase sample s₂ is selected from s₁ according to a specified sampling design {p(s₂∣s₁) } , and (y, x) is observed for the units i∈s₂ . In some cases, the population totals of some components of x may also be known. Two‐phase sampling is used for stratification at the second phase or both phases and for regression estimation. Horvitz–Thompson‐type variance estimators are used for variance estimation. However, the Horvitz–Thompson ( Horvitz & Thompson, J. Amer. Statist. Assoc. 1952 ) variance estimator in uni‐phase sampling is known to be highly unstable and may take negative values when the units are selected with unequal probabilities. On the other hand, the Sen–Yates–Grundy variance estimator is relatively stable and non‐negative for several unequal probability sampling designs with fixed sample sizes. In this paper, we extend the Sen–Yates–Grundy ( Sen , J. Ind. Soc. Agric. Statist. 1953; Yates & Grundy , J. Roy. Statist. Soc. Ser. B 1953) variance estimator to two‐phase sampling, assuming fixed first‐phase sample size and fixed second‐phase sample size given the first‐phase sample. We apply the new variance estimators to two‐phase sampling designs with stratification at the second phase or both phases. We also develop Sen–Yates–Grundy‐type variance estimators of the two‐phase regression estimators that make use of the first‐phase auxiliary data and known population totals of some of the auxiliary variables.     

DO NOT WEIGHT FOR HETEROSCEDASTICITY IN NONPARAMETRIC REGRESSION

The potential role of weighting in kernel regression is examined. The concept that weighting has something to do with heteroscedastic errors is shown to be false. However, weighting does affect bias, and ways in which this might be exploited are indicated.     

SADDLEPOINT METHODS FOR BOOTSTRAP CONFIDENCE BANDS IN NONPARAMETRIC REGRESSION

Bootstrap techniques have been used to construct confidence bands in nonparametric regression problems (Härdle & Bowman, 1988). Yet the required simulation is generally computationally intensive and therefore makes it difficult to conduct further investigations. In this paper, two saddlepoint methods are considered as alternatives to the naive simulation procedure. Some improvements to Härdle & Bowman's bootstrap method are suggested. The improvements are numerically verified using these efficient and accurate analytic methods.     

RANDOM PERMUTATION TESTING IN MULTIPLE LINEAR REGRESSION

We developed an alternative random permutation testing method for multiple linear regression, which is an improvement over the existing one proposed by [1] Kennedy, P. E. 1995. Randomization tests in econometrics. Journal of Business and Economic Statistics, 13: 85–94. [Taylor & Francis Online], [Web of Science ®] , [Google Scholar] or [2] Freedman, D. and Lane, D. 1983. A nonstochastic interpretation of reported significance levels. Journal of Business and Economic Statistics, 1: 292–298. [Taylor & Francis Online] , [Google Scholar].     

NONPARAMETRIC AUTOCOVARIANCE FUNCTION ESTIMATION

Nonparametric estimators of autocovariance functions for non-stationary time series are developed. The estimators are based on straightforward nonparametric mean function estimation ideas and allow use of any linear smoother (e.g. smoothing spline, local polynomial). The paper studies the properties of the estimators, and illustrates their usefulness through application to some meteorological and seismic time series.     

NONPARAMETRIC ESTIMATION OF ANGULAR DISTRIBUTIONS FROM CARTESIAN OBSERVATIONS WITH ERROR

If angular data are obtained from Cartesian observations, then any measurement error in these observations will produce a particular error structure in the angular data. The paper shows how non-parametric density estimation by orthogonal series may be performed in this case.     

MODEL-BASED VARIANCE ESTIMATION IN SURVEYS WITH STRATIFIED CLUSTERED DESIGN

A model-based method for estimating the sampling variances of estimators of (sub-)population means, proportions, quantiles, and regression parameters in surveys with stratified clustered design is described and applied to a survey of US secondary education. The method is compared with the jackknife by a simulation study. The model-based estimators of the sampling variances have much smaller mean squared errors than their jackknife counterparts. In addition, they can be improved by incorporating information about the unknown parameters (variances) from external sources. A regression-based smoothing method for estimating the sampling variances of the estimators for a large number of subpopulation means is proposed. Such smoothing may be invaluable when subpopulations are represented in the sample by only few subjects.     

BOOTSTRAP TESTS FOR THE ERROR DISTRIBUTION IN LINEAR AND NONPARAMETRIC REGRESSION MODELS

In this paper we investigate several tests for the hypothesis of a parametric form of the error distribution in the common linear and non‐parametric regression model, which are based on empirical processes of residuals. It is well known that tests in this context are not asymptotically distribution‐free and the parametric bootstrap is applied to deal with this problem. The performance of the resulting bootstrap test is investigated from an asymptotic point of view and by means of a simulation study. The results demonstrate that even for moderate sample sizes the parametric bootstrap provides a reliable and easy accessible solution to the problem of goodness‐of‐fit testing of assumptions regarding the error distribution in linear and non‐parametric regression models.     

VARIANCE ESTIMATION IN MULTI-STAGE SAMPLING

In multi-stage sampling with the first stage units (fsu) chosen without replacement (WOR) with varying probability schemes (VPS) unbiased estimators (UE) of variances of homogeneous linear (HL) functions of unbiased estimators (UE) T_i's of fsu totals Y_i's based on selection of subsequent stage units (SSU) from chosen fsu's are derived as homogeneous quadratic (HQ) functions of alternative less efficient UE's, say of T_i';'s of Y_i's. Specific strategies are illustrated.     

THE CONSTRUCTION OF EQUILEVERAGE DESIGNS FOR MULTIPLE LINEAR REGRESSION

The hat matrix is widely used as a diagnostic tool in linear regression because it contains the leverages which the independent variables exert on the fitted values. In some experiments, cases with high leverage may be avoided by judicious choice of design for the independent variables. A variety of methods for constructing equileverage designs for linear regression are discussed. Such designs remove one of the factors, namely large leverage points, which can lead to nonrobust estimators and tests. In addition, a method is given for combining equileverage designs to test for lack of fit of the linear model.     

EXPLICIT NONPARAMETRIC CONFIDENCE INTERVALS FOR THE VARIANCE WITH GUARANTEED COVERAGE

ABSTRACT

In this paper, we provide a method for constructing confidence intervals for the variance which exhibits guaranteed coverage probability for any sample size, uniformly over a wide class of probability distributions. In contrast, standard methods achieve guaranteed coverage only in the limit for a fixed distribution or for any sample size over a very restrictive (parametric) class of probability distributions. Of course, it is impossible to construct effective confidence intervals for the variance without some restriction, due to a result of Bahadur and Savage.[1] Bahadur, R. and Savage, L. 1956. The Nonexistence of Certain Statistical Procedures in Nonparametric Problems. Annals of Mathematical Statistics, 25: 1115–1122.  [Google Scholar] However, it is possible if the observations lie in a fixed compact set. We also consider the case of lower confidence bounds without any support restriction. Our method is based on the behavior of the variance over distributions that lie within a Kolmogorov–Smirnov confidence band for the underlying distribution. The method is a generalization of an idea of Anderson,[2] Anderson, T. 1967. Confidence Limits for the Expected Value of an Arbitrary Bounded Random Variable with a Continuous Distribution Function. Bull. ISI, 43: 249–251.  [Google Scholar] who considered only the case of the mean; it applies to very general parameters, and particularly the variance. While typically it is not clear how to compute these intervals explicitly, for the special case of the variance we provide an algorithm to do so. Asymptotically, the length of the intervals is of order n ^?/2 (in probability), so that, while providing guaranteed coverage, they are not overly conservative. A small simulation study examines the finite sample behavior of the proposed intervals.     

NONPARAMETRIC REGRESSION ON FUNCTIONAL DATA: INFERENCE AND PRACTICAL ASPECTS

We consider the problem of predicting a real random variable from a functional explanatory variable. The problem is tackled using a nonparametric kernel approach, which has been recently adapted to this functional context. We derive theoretical results from a deep asymptotic analysis of the behaviour of the estimate, including mean squared convergence (with rates and precise evaluation of the constant terms) as well as asymptotic distribution. Practical use of these results relies on the ability to estimate these constants. Some perspectives in this direction are discussed. In particular, a functional version of wild bootstrapping ideas is proposed and used both on simulated and real functional datasets.     

EFFICIENT ESTIMATION IN REGRESSION FRAILTY OR TRANSFORMATION MODELS BASED ON AN ALGORITHM

This paper considers a regression frailty or transformation model in which the structural parameter is the vector of regression coefficients and the nuisance parameter is a vector of arbitrarily high dimension. It proposes jointly (implicitly) defined parameter estimators which have been proved to be consistent and asymptotically efficient, and develops an algorithmic procedure that provides these estimators. The behaviour of the algorithm is illustrated by analysing simulated and real data.     

ESTIMATION OF PARAMETERS IN THE MARGINAL FISHER DISTRIBUTION1

The Fisher distribution is frequently used as a model for the probability distribution of directional data, which may be specified either in terms of unit vectors or angular co-ordinates (co-latitude and azimuth). If, in practical situations, only the co-latitudes can be observed, the available data must be regarded as a sample from the corresponding marginal distribution. This paper discusses the estimation by Maximum Likelihood (ML) and the Method of Moments of the two parameters of this marginal Fisher distribution. The moment estimators are generally simpler to compute than the ML estimators, and have high asymptotic efficiency.     

ON VARIANCE ESTIMATION IN UNEQUAL PROBABILITY SAMPLING1

The purpose of this article is to propose a model-based estimator of the variance of the Horvitz-Thompson estimator. Empirical investigations reveal that the estimator is seldom greatly biased and is quite satisfactory from the stability point of view.