Bootstrapping an Econometric Model: Some Empirical Results

The bootstrap, like the jackknife, is a technique for estimating standard errors. The idea is to use Monte Carlo simulation, based on a nonparametric estimate of the underlying error distribution. The bootstrap will be applied to an econometric model describing the demand for capital, labor, energy, and materials. The model is fitted by three-stage least squares. In sharp contrast with previous results, the coefficient estimates and the estimated standard errors perform very well. However, the model's forecasts show serious bias and large random errors, significantly understated by the conventional standard error of forecast.     

Geometric characterization of planar regression

The geometric characterization of linear regression in terms of the ‘concentration ellipse’ by Galton [Galton, F., 1886, Family likeness in stature (with Appendix by Dickson, J.D.H.). Proceedings of the Royal Society of London, 40, 42–73.] and Pearson [Pearson, K., 1901, On lines and planes of closest fit to systems of points in space. Philosophical Magazine, 2, 559–572.] was extended to the case of unequal variances of the presumably uncorrelated errors in the experimental data [McCartin, B.J., 2003, A geometric characterization of linear regression. Statistics, 37(2), 101–117.]. In this paper, this geometric characterization is further extended to planar (and also linear) regression in three dimensions where a beautiful interpretation in terms of the concentration ellipsoid is developed.     

Reply to comments on “artificial neural networks: an econometric perspective“

We briefly discuss the so called pseudo-GLS estimator in a standard linear regression model with nonsperical disturbances, and conclude that the potentiality for applications is higher than originally assumed by Fiebig Bartels and Krämer (1996).     

Forecasting with serially correlated regression models

In this article we investigate the asymptotic and finite-sample properties of predictors of regression models with autocorrelated errors. We prove new theorems associated with the predictive efficiency of generalized least squares (GLS) and incorrectly structured GLS predictors. We also establish the form associated with their predictive mean squared errors as well as the magnitude of these errors relative to each other and to those generated from the ordinary least squares (OLS) predictor. A large simulation study is used to evaluate the finite-sample performance of forecasts generated from models using different corrections for the serial correlation.     

Estimation of parameters in a generalized GMANOVA model based on an outer product analogy and least squares

This paper investigates estimation of parameters in a combination of the multivariate linear model and growth curve model, called a generalized GMANOVA model. Making analogy between the outer product of data vectors and covariance yields an approach to directly do least squares to covariance. An outer product least squares estimator of covariance (COPLS estimator) is obtained and its distribution is presented if a normal assumption is imposed on the error matrix. Based on the COPLS estimator, two-stage generalized least squares estimators of the regression coefficients are derived. In addition, asymptotic normalities of these estimators are investigated. Simulation studies have shown that the COPLS estimator and two-stage GLS estimators are alternative competitors with more efficiency in the sense of sample mean, standard deviations and mean of the variance estimates to the existing ML estimator in finite samples. An example of application is also illustrated.     

Trend estimation of multivariate time series with controlled smoothness

This paper extends the univariate time series smoothing approach provided by penalized least squares to a multivariate setting, thus allowing for joint estimation of several time series trends. The theoretical results are valid for the general multivariate case, but particular emphasis is placed on the bivariate situation from an applied point of view. The proposal is based on a vector signal-plus-noise representation of the observed data that requires the first two sample moments and specifying only one smoothing constant. A measure of the amount of smoothness of an estimated trend is introduced so that an analyst can set in advance a desired percentage of smoothness to be achieved by the trend estimate. The required smoothing constant is determined by the chosen percentage of smoothness. Closed form expressions for the smoothed estimated vector and its variance-covariance matrix are derived from a straightforward application of generalized least squares, thus providing best linear unbiased estimates for the trends. A detailed algorithm applicable for estimating bivariate time series trends is also presented and justified. The theoretical results are supported by a simulation study and two real applications. One corresponds to Mexican and US macroeconomic data within the context of business cycle analysis, and the other one to environmental data pertaining to a monitored site in Scotland.     

Tail Functions and Iterative Weights in Binary Regression

In interpreting the binary regression models often used in the analysis of dose-response data, it is common to introduce the idea of an underlying continuous tolerance distribution. Different choices of link function lead to different tolerance distributions. A useful way of comparing these alternatives is to compare the hazard functions or tail functions associated with each tolerance distribution. Tail functions can also be applied to give numerically preferable formulas for the iterative weights and the adjusted dependent variable in the fitting of binary regression models by the iteratively reweighted least-squares algorithm.     

Generalized least squares with misspecified serial correlation structures

Summary. The regression literature contains hundreds of studies on serially correlated disturbances. Most of these studies assume that the structure of the error covariance matrix Ω is known or can be estimated consistently from data. Surprisingly, few studies investigate the properties of estimated generalized least squares (GLS) procedures when the structure of Ω is incorrectly identified and the parameters are inefficiently estimated. We compare the finite sample efficiencies of ordinary least squares (OLS), GLS and incorrect GLS (IGLS) estimators. We also prove new theorems establishing theoretical efficiency bounds for IGLS relative to GLS and OLS. Results from an exhaustive simulation study are used to evaluate the finite sample performance and to demonstrate the robustness of IGLS estimates vis-à-vis OLS and GLS estimates constructed for models with known and estimated (but correctly identified) Ω. Some of our conclusions for finite samples differ from established asymptotic results.     

E-optimal block designs under heteroscedastic model

This paper mainly studies the E-optimality of block designs under a general heteroscedastic setting. The C-matrix of a block design under a heteroscedastic setting is obtained by using generalized least squares. Some bounds for the smallest positive eigenvalue of C-matrix are obtained in some general classes of connected designs. Use of these bounds is then made to obtain certain E-optimal block designs in various classes of connected block designs.     

Estimation for the parameters of the generalized half-normal distribution

As an applicable and flexible lifetime model, the two-parameter generalized half-normal (GHN) distribution has been received wide attention in the field of reliability analysis and lifetime study. In this paper maximum likelihood estimates of the model parameters are discussed and we also proposed corresponding bias-corrected estimates. Unweighted and weighted least squares estimates for the parameters of the GHN distribution are also presented for comparison purpose. Moreover, the likelihood ratio test is provided as complementary. Simulation study and illustrative examples are provided to compare the performance of the proposed methods.     

Least squares variogram fitting by spatial subsampling

Summary. Least squares methods are popular for fitting valid variogram models to spatial data. The paper proposes a new least squares method based on spatial subsampling for variogram model fitting. We show that the method proposed is statistically efficient among a class of least squares methods, including the generalized least squares method. Further, it is computationally much simpler than the generalized least squares method. The method produces valid variogram estimators under very mild regularity conditions on the underlying random field and may be applied with different choices of the generic variogram estimator without analytical calculation. An extension of the method proposed to a class of spatial regression models is illustrated with a real data example. Results from a simulation study on finite sample properties of the method are also reported.     

Leverages and Influential Observations in a Regression Model with Autocorrelated Errors

This article deals with the general form of the hat matrix and the DFBETA measure to detect the influential observations and the leverages in the linear regression model with more than one regressor when the errors are from AR(1) and AR(2) processes. Previous studies dealing with the influential observations and the leverages in the constant mean model and regression through the origin model are obtained as special cases. To demonstrate the utility of the hat matrix and the DFBETA measure, two numerical examples based on the ice cream consumption data with AR(1) errors and the Fox-Hartnagel data with AR(2) errors are analyzed. The results show that the parameter of the autoregressive process affects the influential and leverage points.     

Application of 'delete = replace' to deletion diagnostics for variance component estimation in the linear mixed model

Summary.  'Delete = replace' is a powerful and intuitive modelling identity. This paper extends previous work by stating and proving the identity in more general terms and extending its application to deletion diagnostics for estimates of variance components obtained by restricted maximum likelihood estimation for the linear mixed model. We present a new, fast, transparent and approximate computational procedure, arising as a by-product of the fitting process. We illustrate the effect of the deletion of individual observations, of 'subjects' and of arbitrary subsets. Central to the identity and its application is the conditional residual.     

Estimation of the linear-linear segmented regression model in the presence of measurement error

A simple segmented regression model in which the independent variable is measured with error is considered. The method of moments is used to obtain parameter estimates and the joint asymptotic distribution of the estimators is presented. The small sample properties of the inference procedures based on the asymptotic distribution of the estimators are studied numerically.     

Smoothing spline Gaussian regression: more scalable computation via efficient approximation

Summary.  Smoothing splines via the penalized least squares method provide versatile and effective nonparametric models for regression with Gaussian responses. The computation of smoothing splines is generally of the order O ( n ³), n being the sample size, which severely limits its practical applicability. We study more scalable computation of smoothing spline regression via certain low dimensional approximations that are asymptotically as efficient. A simple algorithm is presented and the Bayes model that is associated with the approximations is derived, with the latter guiding the porting of Bayesian confidence intervals. The practical choice of the dimension of the approximating space is determined through simulation studies, and empirical comparisons of the approximations with the exact solution are presented. Also evaluated is a simple modification of the generalized cross-validation method for smoothing parameter selection, which to a large extent fixes the occasional undersmoothing problem that is suffered by generalized cross-validation.     

Bootstrapping a time series model: some empirical results

The bootstrap is a methodology for estimating standard errors. The idea is to use a Monte Carlo simulation experiment based on a nonparametric estimate of the error distribution. The main objective of this article is to demonstrate the use of the bootstrap to attach standard errors to coefficient estimates in a second-order autoregressive model fitted by least squares and maximum likelihood estimation. Additionally, a comparison of the bootstrap and the conventional methodology is made. As it turns out, the conventional asymptotic formulae (both the least squares and maximum likelihood estimates) for estimating standard errors appear to overestimate the true standard errors. But there are two problems:i. The first two observations y₁ and y₂ have been fixed, and ii. The residuals have not been inflated. After these two factors are considered in the trial and bootstrap experiment, both the conventional maximum likelihood and bootstrap estimates of the standard errors appear to be performing quite well.     

基于效用函数和消费数据的动态价格指数测度

 本文针对现有CPI的缺点,在微观效用理论的基础上,引入了动态价格指数(DPI)的概念,并利用Epstein-Zin效用函数简化了Reis(2005)关于DPI的编制过程,同时,利用2000年12月－2010年12月间的样本数据,对我国的DPI进行编制。研究表明,DPI在衡量消费者当前和未来的真实生活成本变化方面更具有优势,应成为衡量居民福利变化和政策制定者制定政策的重要参考指标。     

Tuning Parameter Estimation in Penalized Least Squares Methodology

The efficiency of the penalized methods (Fan and Li, 2001 Fan , J. , Li , R. ( 2001 ). Variable selection via nonconcave penalized likelihood and its oracle properties . Journal of the American Statistical Association 96 : 1348 – 1360 .[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]) depends strongly on a tuning parameter due to the fact that it controls the extent of penalization. Therefore, it is important to select it appropriately. In general, tuning parameters are chosen by data-driven approaches, such as the commonly used generalized cross validation. In this article, we propose an alternative method for the derivation of the tuning parameter selector in penalized least squares framework, which can lead to an ameliorated estimate. Simulation studies are presented to support theoretical findings and a comparison of the Type I and Type II error rates, considering the L ₁, the hard thresholding and the Smoothly Clipped Absolute Deviation penalty functions, is performed. The results are given in tables and discussion follows.     

Generalized exponential distribution: different method of estimations

Recently a new distribution, named as generalized exponential distribution has been introduced and studied quite extensively by the authors. Generalized exponential distribution can be used as an alternative to gamma or Weibull distribution in many situations. In a companion paper, the authors considered the maximum likelihood estimation of the different parameters of a generalized exponential distribution and discussed some of the testing of hypothesis problems. In this paper we mainly consider five other estimation procedures and compare their performances through numerical simulations.     

Properties of Designs in Experiments on Spatial Lattices

ABSTRACT

When spatial variation is present in experiments, it is clearly sensible to use designs with favorable properties under both generalized and ordinary least squares. This will make the statistical analysis more robust to misspecification of the spatial model than would be the case if designs were based solely on generalized least squares. In this article, treatment information is introduced as a way of studying the ordinary least squares properties of designs. The treatment information is separated into orthogonal frequency or polynomial components which are assumed to be independent under the spatial model. The well-known trend-resistant designs are those with no treatment information at the very low order frequency or polynomial components which tend to have the higher variances under the spatial model. Ideally, designs would be chosen with all the treatment information distributed at the higher-order components. However, the results in this article show that there are limits on how much trend resistance can be achieved as there are many constraints on the treatment information. In addition, appropriately chosen Williams squares designs are shown to have favorable properties under both ordinary and generalized least squares. At all times, the ordinary least squares properties of the designs are balanced against the generalized least squares objectives of optimizing neighbor balance.