Obtaining efficient estimates of park use and testing for the structural adequacy of models

This paper provides an examination of the problem of heteroscedasticity as it relates to estimating park use, although the results can also be applied to a wide variety of flow problems involving traffic, people or commodities. The major issue is that estimates of flows obtained using ordinary least squares, OLS, often yield statistically significant results while still giving rise to large differences between observed and predicted flows (residuals). The paper presents results which show that for the flow estimation problem of concern, more accurate use estimates may be obtained by using generalized least squares, GLS, rather than using OLS. Weights to use in GLS regression are developed taking into account the variance to be expected in origin-destination flows. It is shown that deriving the correct weights, estimates of variances, to use in a regression analysis results in an ‘absolute’ test for the structural appropriateness of the regression model. Tests related to the ‘absolute’ adequacy test are introduced and their use to identify specific structural problems with a model is illustrated.     

A mixed model analysis of variance for multi-environment variety trials

Of interest is the analysis of data resulting from a series of experiments repeated at several environments with the same set of plant varieties. Suppose that the experiments, multi-environment variety trials (as they are called), are all conducted in resolvable incomplete block designs. Adopting the randomization-derived mixed model obtained in Caliński et al. (Biometrics 61:448–455, 2005), a suitable analysis of variance methodology is considered and relevant test procedures are examined. The proposed methods are illustrated by the analysis of results of a series of trials with rye varieties.     

Combining estimators from variety trials that are connected by control varieties only

At one site and year often numerous variety trials are performed. Sometimes these trials only have a small number of control varieties in common. It is possible to obtain best linear unbiased estimators (BLUEs) of estimable linear combinations of the variety parameters without analysing the joint observations of all trials as a whole. The unbiased local estimator of the contrast between the parameter of a new variety and the average of the parameters of the control varieties, calculated at a single trial, can be improved to the BLUE with information from the other trials. This improvement represents a contrast of contrasts between control variety parameters at the various trials. In some situations the local estimator is already the BLUE, e.g. if only one control variety is used or in case of variance-balanced designs.     

The 'improved' brown and forsythe test for mean equality: some things can't be fixed

Mehrotra (1997) presented an ‘;improved’ Brown and Forsythe (1974) statistic which is designed to provide a valid test of mean equality in independent groups designs when variances are heterogeneous. In particular, the usual Brown and Fosythe procedure was modified by using a Satterthwaite approximation for numerator degrees of freedom instead of the usual value of number of groups minus one. Mehrotra then, through Monte Carlo methods, demonstrated that the ‘improved’ method resulted in a robust test of significance in cases where the usual Brown and Forsythe method did not. Accordingly, this ‘improved’ procedure was recommended. We show that under conditions likely to be encountered in applied settings, that is, conditions involving heterogeneous variances as well as nonnormal data, the ‘improved’ Brown and Forsythe procedure results in depressed or inflated rates of Type I error in unbalanced designs. Previous findings indicate, however, that one can obtain a robust test by adopting a heteroscedastic statistic with the robust estimators, rather than the usual least squares estimators, and further improvement can be expected when critical significance values are obtained through bootstrapping methods.     

An efficient procedure for computing minque of variance components and generalized least squares estimates of fixed effects

An efficient method for computing minimum norm quadratic unbiased estimates (MINQUE) of variance components and generalized least squares estimates of the fixed effects in the mixed model is developed. The computing algorithm uses a modification of the W transformation.     

AN ESTIMATE OF THE ASYMPTOTIC STANDARD ERROR OF THE SAMPLE MEDIAN

A method for estimating the asymptotic standard error of the sample median based on generalized least squares is outlined. The practical problems of implementing this new estimate along with those associated with two existing estimates are discussed. Finally a simulation study is presented to compare the three estimates.     

Fitting Time Series Models by Minimizing Multistep-ahead Errors: a Frequency Domain Approach

This paper brings together two topics in the estimation of time series forecasting models: the use of the multistep-ahead error sum of squares as a criterion to be minimized and frequency domain methods for carrying out this minimization. The methods are developed for the wide class of time series models having a spectrum which is linear in unknown coefficients. This includes the IMA(1, 1) model for which the common exponentially weigh-ted moving average predictor is optimal, besides more general structural models for series exhibiting trends and seasonality. The method is extended to include the Box–Jenkins `air line' model. The value of the multistep criterion is that it provides protection against using an incorrectly specified model. The value of frequency domain estimation is that the iteratively reweighted least squares scheme for fitting generalized linear models is readily extended to construct the parameter estimates and their standard errors. It also yields insight into the loss of efficiency when the model is correct and the robustness of the criterion against an incorrect model. A simple example is used to illustrate the method, and a real example demonstrates the extension to seasonal models. The discussion considers a diagnostic test statistic for indicating an incorrect model.     

Further properties of generalized residual designs

The concept of ‘residuation’ is extended so that all ‘generalized residual designs’ (in the sense of Shrinkhande and Singhi) are in fact ‘residual’ with respect to the extended type of residuation. A measure of departure from the usual type of residuation is given in general, and stronger estimates of this measure are given for affine designs.     

Estimation of linear models for field experiments

General mixed linear models for experiments conducted over a series of sltes and/or years are described. The ordinary least squares (OLS) estlmator is simple to compute, but is not the best unbiased estimator. Also, the usuaL formula for the varlance of the OLS estimator is not correct and seriously underestimates the true variance. The best linear unbiased estimator is the generalized least squares (GLS) estimator. However, t requires an inversion of the variance-covariance matrix V, whlch is usually of large dimension. Also, in practice, V is unknown.

We presented an estlmator [Vcirc] of the matrix V using the estimators of variance components [for sites, blocks (sites), etc.]. We also presented a simple transformation of the data, such that an ordinary least squares regression of the transformed data gives the estimated generalized least squares (EGLS) estimator. The standard errors obtained from the transformed regression serve as asymptotic standard errors of the EGLS estimators. We also established that the EGLS estlmator is unbiased.

An example of fitting a linear model to data for 18 sites (environments) located in Brazil is given. One of the site variables (soil test phosphorus) was measured by plot rather than by site and this established the need for a covariance model such as the one used rather than the usual analysis of variance model. It is for this variable that the resulting parameter estimates did not correspond well between the OLS and EGLS estimators. Regression statistics and the analysis of variance for the example are presented and summarized.     

Amemiya's generalized least squares and tests of overidentification in simultaneous equation models with qualitative or limited dependent variables

Amemiya's generalized least squares method for the estimation of simultaneous equation modeis with qualitative or limited dependent variables is known to be efficient relative to many popular two stage estimators. This note points out that test statistics for overidentification restrictions can be obtained as by-products of Amerniya's generalized least squares procedure. Amemiya's procedure is shown to be a minimum chisquare method. The Amemiya procedure is valuable both for efficient estimation and for model evaluation of such models.     

Generalized Least Squares Model Averaging

In this article, we propose a method of averaging generalized least squares estimators for linear regression models with heteroskedastic errors. The averaging weights are chosen to minimize Mallows’ C_p-like criterion. We show that the weight vector selected by our method is optimal. It is also shown that this optimality holds even when the variances of the error terms are estimated and the feasible generalized least squares estimators are averaged. The variances can be estimated parametrically or nonparametrically. Monte Carlo simulation results are encouraging. An empirical example illustrates that the proposed method is useful for predicting a measure of firms’ performance.     

A Balanced System of U.S. Industry Accounts and Distribution of the Aggregate Statistical Discrepancy by Industry

This article describes and illustrates a generalized least squares (GLS) method that systematically incorporates all available information on the reliability of initial data in the reconciliation of a large disaggregated system of national accounts. The GLS method is applied to reconciling the 1997 U.S. Input-Output and Gross Domestic Product (GDP)-by-industry accounts with benchmarked GDP estimated from expenditures. The GLS procedure produced a balanced system of industry accounts and distributed the aggregate statistical discrepancy by industry according to the estimated relative reliabilities of initial estimates. The study demonstrates the empirical feasibility and computational efficiency of the GLS method for large accounts reconciliation.     

Amemiya‘s generalized least squares and tests of overidentification in simultaneous equation models with qualitative or limited dependent variables

Amemiya's generalized least squares method for the estimation of simultaneous equation modeis with qualitative or limited dependent variables is known to be efficient relative to many popular two stage estimators. This note points out that test statistics for overidentification restrictions can be obtained as by-products of Amerniya's generalized least squares procedure. Amemiya's procedure is shown to be a minimum chisquare method. The Amemiya procedure is valuable both for efficient estimation and for model evaluation of such models.     

Effects of non-normality and mild heteroscedasticity on estimators in regression

Several estimators are examined for the simple linear regression model under a controlled, experimental situation with multiple observations at each design point. The model is examined under normal and non-normal error distributions and mild heterogeneity of variances across the chosen design points. We consider the ordinary, generalized, and estimated generalized least squares estimators and several examples of M estimators. The asymptotic properties of the M estimator using the Huber ψ are presented under these conditions for the multiple regression model. A simulation study is also presented which indicates that the M estimator possesses strong robustness properties under the presence of both non-normality and mild heteroscedasticity o£ errors. Finally, the M estimates are compared to the least squares estimates in two examples.     

Estimation for the parameters of the generalized half-normal distribution

As an applicable and flexible lifetime model, the two-parameter generalized half-normal (GHN) distribution has been received wide attention in the field of reliability analysis and lifetime study. In this paper maximum likelihood estimates of the model parameters are discussed and we also proposed corresponding bias-corrected estimates. Unweighted and weighted least squares estimates for the parameters of the GHN distribution are also presented for comparison purpose. Moreover, the likelihood ratio test is provided as complementary. Simulation study and illustrative examples are provided to compare the performance of the proposed methods.     

Regression analysis of autocorrelated poisson-distribution) data

A regression model assuming Poisson-dia distributed data. with autocorrelated errors falls into the class of regression models that; have the error structure which is both heteroscedastic and autocorrelated. In general, this class of regression models are not estimable. However, due to the properties of the Poisson distribution that the variance is equal to the mean, this regression model on Poisson-distributed data with autocorrelated. errors is estimable. In this note the special structure of the covarlance matrix of the model with the first order auto-correlated error Is derived utilizing this property, A method based on the least squares method of Frome, Kutner, and Beauchamp (1973), supplemented by steps for handling autocorrelation in studies of time series analysis, nonlinear regression, and econometrics is presented for obtaining generalized least squares estimates for the parameters of the model.     

Theoretical evaluation of prediction error in linear regression with a bivariate response variable containing missing data

Methods for linear regression with multivariate response variables are well described in statistical literature. In this study we conduct a theoretical evaluation of the expected squared prediction error in bivariate linear regression where one of the response variables contains missing data. We make the assumption of known covariance structure for the error terms. On this basis, we evaluate three well-known estimators: standard ordinary least squares, generalized least squares, and a James–Stein inspired estimator. Theoretical risk functions are worked out for all three estimators to evaluate under which circumstances it is advantageous to take the error covariance structure into account.     

An estimation in a linear model with response-related error

A maximum likelihood solution is presented for analyzing data which arise from a linear model whose error term is assumed to have variance proportional to some unknown power of the response. An efficient iterative method for solving the likelihood equations is obtained which incoporates use of a transfomation to orthogonalize the two variance paramaters. Assessments of the method are made through simulations study and the results are compared with those of the ordinary least squares. Examples from the literature are included to illustrate the method and also to compare the results with a weighted least squares estimates.     

Imposing and Testing Curvature Conditions on a Box–Cox Cost Function

We present a new method for imposing and testing concavity of cost functions using asymptotic least squares, which can be easily implemented even for nonlinear cost functions. We provide an illustration for a (generalized) Box–Cox cost function with six inputs: capital, labor disaggregated in three skill levels, energy, and intermediate materials. We present a parametric concavity test and compare price elasticities when curvature conditions are imposed versus when they are not. Although concavity is statistically rejected, estimates are not very sensitive to its imposition. We find stronger substitution between the different type of labor than between any other two inputs.