Estimation of linear models for field experiments

General mixed linear models for experiments conducted over a series of sltes and/or years are described. The ordinary least squares (OLS) estlmator is simple to compute, but is not the best unbiased estimator. Also, the usuaL formula for the varlance of the OLS estimator is not correct and seriously underestimates the true variance. The best linear unbiased estimator is the generalized least squares (GLS) estimator. However, t requires an inversion of the variance-covariance matrix V, whlch is usually of large dimension. Also, in practice, V is unknown.

We presented an estlmator [Vcirc] of the matrix V using the estimators of variance components [for sites, blocks (sites), etc.]. We also presented a simple transformation of the data, such that an ordinary least squares regression of the transformed data gives the estimated generalized least squares (EGLS) estimator. The standard errors obtained from the transformed regression serve as asymptotic standard errors of the EGLS estimators. We also established that the EGLS estlmator is unbiased.

An example of fitting a linear model to data for 18 sites (environments) located in Brazil is given. One of the site variables (soil test phosphorus) was measured by plot rather than by site and this established the need for a covariance model such as the one used rather than the usual analysis of variance model. It is for this variable that the resulting parameter estimates did not correspond well between the OLS and EGLS estimators. Regression statistics and the analysis of variance for the example are presented and summarized.     

Efficiency of least squares estimators in the presence of spatial autocorrelation

The effect of spatial autocorrelation on inferences made using ordinary least squares estimation is considered. It is found, in some cases, that ordinary least squares estimators provide a reasonable alternative to the estimated generalized least squares estimators recommended in the spatial statistics literature. One of the most serious problems in using ordinary least squares is that the usual variance estimators are severely biased when the errors are correlated. An alternative variance estimator that adjusts for any observed correlation is proposed. The need to take autocorrelation into account in variance estimation negates much of the advantage that ordinary least squares estimation has in terms of computational simplicity     

A new algorithm for maximum likelihood estimation in normal scale-mixture generalized autoregressive conditional heteroskedastic models

In this paper, we propose a new generalized autoregressive conditional heteroskedastic (GARCH) model using infinite normal scale-mixtures which can suitably avoid order selection problems in the application of finite normal scale-mixtures. We discuss its theoretical properties and develop a two-stage algorithm for the maximum likelihood estimator to estimate the mixing distribution non-parametric maximum likelihood estimator (NPMLE) as well as GARCH parameters (two-stage MLE). For the estimation of a mixing distribution, we employ a fast computational algorithm proposed by Wang [On fast computation of the non-parametric maximum likelihood estimate of a mixing distribution. J R Stat Soc Ser B. 2007;69:185–198] under the gradient characterization of the non-parametric mixture likelihood. The GARCH parameters are then estimated either using the expectation-mazimization algorithm or general optimization scheme. In addition, we propose a new forecasting algorithm of value-at-risk (VaR) using the two-stage MLE and the NPMLE. Through a simulation study and real data analysis, we compare the performance of the two-stage MLE with the existing ones including quasi-maximum likelihood estimator based on the standard normal density and the finite normal mixture quasi maximum estimated-likelihood estimator (cf. Lee S, Lee T. Inference for Box–Cox transformed threshold GARCH models with nuisance parameters. Scand J Stat. 2012;39:568–589) in terms of the relative efficiency and accuracy of VaR forecasting.     

The double sampling S2 chart with estimated process variance

This paper proposes useful exact bounds for the parameters of the double sampling S² chart with known process variance and it also investigates the properties of the double sampling S² chart with estimated process variance, in terms of the average run length, the standard deviation of the run length and the average sample size, providing a numerical comparison with the known process variance case. It also provides guidelines to systematically design the double sampling S² chart both with known and estimated process variance and proposes two optimal design procedures with estimated process variance, for (a) minimizing the out-of-control average run length and (b) minimizing the out-of-control average sample size.     

Comparison of efficiencies of some symmetry tests around an unknown centre

In this paper, some recent and classical tests of symmetry are modified for the case of an unknown centre. The unknown centre is estimated with its α-trimmed mean estimator. The asymptotic behaviour of the new tests is explored. The local approximate Bahadur efficiency is used to compare the tests to each other as well as to some other tests.     

Predicting objective physical activity from self-report surveys: a model validation study using estimated generalized least-squares regression

Physical activity measurements derived from self-report surveys are prone to measurement errors. Monitoring devices like accelerometers offer more objective measurements of physical activity, but are impractical for use in large-scale surveys. A model capable of predicting objective measurements of physical activity from self-reports would offer a practical alternative to obtaining measurements directly from monitoring devices. Using data from National Health and Nutrition Examination Survey 2003–2006, we developed and validated models for predicting objective physical activity from self-report variables and other demographic characteristics. The prediction intervals produced by the models were large, suggesting that the ability to predict objective physical activity for individuals from self-reports is limited.     

Goodness of fit for the poisson distribution based on the probability generating function

For testing the fit of a discrete distribution, use of the probability generating function and its empirical counterpart has been suggested in Koeherlakota and Kocherlakota (1986). In the present paper, a particular functional of the corresponding empirical probability generating function process is proposed as a measure to test the discrepancy between the evidence and the hypothesis. The asymptotic behavior of the empirical probability generating function when a parameter is estimated is obtained, The study is exemplified for the Poisson case only but the procedure can be extended to other discrete distributions.     

Lower bounds for confidence coefficients for confidence intervals for finite population quantiles

Assuming stratified simple random sampling, a confidence interval for a finite population quantile may be desired. Using a confidence interval with endpoints given by order statistics from the combined stratified sample, several procedures to obtain lower bounds (and approximations for the lower bounds) for the confidence coefficients are presented. The procedures differ with respect to the amount of prior information assumed about the var-iate values in the finite population, and the extent to which sample data is used to estimate the lower bounds.     

The biases associated with maximum likelihood methods of estimation of the multivariate logistic risk function

The posterior probability of an object belonging to one of two populations can be estimated using multivariate logistic regression. The bias associated with this procedure is derived In the context of normal populations with different mean vectors and a common covariance matrix and is compared with the bias of the classical method based on this normality assumption, -It Is found that the bias of the more robust procedure of logistic regression is of a lower order than that of the normality based method.     

Weighted Likelihood for Semiparametric Models and Two-phase Stratified Samples, with Application to Cox Regression

Abstract.  We consider semiparametric models for which solution of Horvitz–Thompson or inverse probability weighted (IPW) likelihood equations with two-phase stratified samples leads to consistent and asymptotically Gaussian estimators of both Euclidean and non-parametric parameters. For Bernoulli (independent and identically distributed) sampling, standard theory shows that the Euclidean parameter estimator is asymptotically linear in the IPW influence function. By proving weak convergence of the IPW empirical process, and borrowing results on weighted bootstrap empirical processes, we derive a parallel asymptotic expansion for finite population stratified sampling. Several of our key results have been derived already for Cox regression with stratified case–cohort and more general survey designs. This paper is intended to help interpret this previous work and to pave the way towards a general Horvitz–Thompson approach to semiparametric inference with data from complex probability samples.     

Shewhart x-charts with estimated process variance

Properties of the Shewhart X-chart for controlling the mean of a process with a normal distribution are investigated for the situation where the process variance Ó²must be estimated from initial sample data. The control limits of the X-chart depend on the estimate of Ó²and thus, unlike the case when Ó²is known, the X-chart is not equivalent to a sequence of independent tests. When Ó²is estimated the distribution of the run length is not geometric and cannot be characterized simply in terms of the probability of a signal at a given point. The average run length (ARL) for the X-chart is expressed in terms of an integral involving the normal cdf, and it is shown that the chart signals with

probability one, but the ARL may not be finite if the size of the 2 sample used to estimate Ó²is sufficiently small. In addition, certain bounds for the ARL are also derived. Numerical integration is use to show that the effect of using small sample sizes in estimating Ó²is to increase the ARL and the variance of the run length distribution     

Goodness-of-fit Tests for Mixed Models

Abstract.  Mixed linear models have become a very useful tool for modelling experiments with dependent observations within subjects, but to establish their appropriateness several assumptions have to be checked. In this paper, we focus on the normality assumptions, using goodness-of-fit tests that make allowance for possible design imbalance. These tests rely on asymptotic results, which are established via empirical process theory. The power of the tests is explored empirically, and examples illustrate some aspects of the usage of the tests.     

Exact percentage points for the Kolmogorov test on truncated versions of known continuous distributions with unknown truncation parameters

In this paper we deal with Kolmogorov-Smirnov testson uniformity with completely or partly unknown limits. Tables of exact percentage points are presented or referred using the wellknown determinant formula given by Steck (1971). It is shown that these tables also give the percentage points for the analogous statistics of the test on truncated versions of known continuous distributions with completely or partly unknown truncation limits. We will give some examples of these applications. Among these are the tests on exponentiality and on Pareto distribution with known shape parameter and unknown lower terminal.     

Estimated Generalized Least Squares for Random Coefficient Regression Models

ABSTRACT. This paper considers a general class of random coefficient regression (RCR) models to represent pooled cross-sectional and time series data. A new method is given to estimate the covariance matrix of the error component in these RCR models. Also, the asymptotic and small sample properties of the estimated generalized least squares estimator of the regression coefficient vector are established. Procedures for testing a linear restriction on the mean vector of the random coefficients are derived. Finally, a test for non-randomness in the RCR model is devised, and the asymptotic distribution of the test statistic is obtained.     

Accurate Confidence Interval Estimation of Small Area Parameters Under the Fay–Herriot Model

Small area estimation has long been a popular and important research topic due to its growing demand in public and private sectors. We consider here the basic area level model, popularly known as the Fay–Herriot model. Although much of current research is predominantly focused on second order unbiased estimation of mean squared prediction errors, we concentrate on developing confidence intervals (CIs) for the small area means that are second order correct. The corrected CI can be readily implemented, because it only requires quantities that are already estimated as part of the mean squared error estimation. We extend the approach to a CI for the difference of two small area means. The findings are illustrated with a simulation study.     

Conditional design of the CUSUM median chart for the process position when process parameters are unknown

In practice, different practitioners will use different Phase I samples to estimate the process parameters, which will lead to different Phase II control chart's performance. Researches refer to this variability as between-practitioners-variability of control charts. Since between-practitioners-variability is important in the design of the CUSUM median chart with estimated process parameters, the standard deviation of average run length (SDARL) will be used to study its properties. It is shown that the CUSUM median chart requires a larger amount of Phase I samples to sufficiently reduce the variation in the in-control ARL of the CUSUM median chart. Considering the limitation of the amount of the Phase I samples, a bootstrap approach is also used here to adjust the control limits of the CUSUM median chart. Comparisons are made for the CUSUM and Shewhart median charts with estimated parameters when using the adjusted- and unadjusted control limits and some conclusions are made.     

Exact tests for equality of two proportions: fisher v. bayes

Yates (1984) using theoretical and philosophical arguments claims to have proved that the Fisher exact test for comparing the proportions of two binomial experiments is the best exact test. The present article uses objective and practical arguments to confront the Fisher exact test with a Bayes exact test. Using simulated samples we claim to have proved here the inferiority of the Fisher exact test in relation to a Bayes exact test. The comparison is based on the quality concept of Dawid (1982).     

Comments on a Paper by Lachenbruch and Flack

Razzaghi (1987) conjectured that a wrong choice of covariance matrix in a restricted linear model results in loss of efficiency. This conjecture was proved correct by Kabe and Gupta for a wrong choice of constant covariance matrix. The present paper demonstrates that this loss of efficiency persists even with an estimated covariance matrix, thereby resulting in inefficient estimation, prediction, and confidence intervals.     

Large sample prediction regions with estimated parameters

We obtain and asymptotic correction for the coverage probability of prediction regions when the parameter are estimated for dependent observations. Both stationary adn non-stationary type models are considered as applications. Asymptotic power of theses regions is also studied briefly.