Robust bootstrap estimates in heteroscedastic semi-varying coefficient models and applications in analyzing Australia CPI data

This article deals with the estimation of the parametric component, which is of primary interest, in the heteroscedastic semi-varying coefficient models. Based on the bootstrap technique, we present a procedure for estimating the parameters, which can provide a reliable approximation to the asymptotic distribution of the profile least-square (PLS) estimator. Furthermore, a bootstrap-type estimator of covariance matrix is developed, which is proved to be a consistent estimator of the covariance matrix. Moreover, some simulation experiments are conducted to evaluate the finite sample performance for the proposed methodology. Finally, the Australia CPI dataset is analyzed to demonstrate the application of the methods.     

Testing Serial Correlation in Partially Linear Additive Errors-in-variables Models

This article considers testing serial correlation in partially linear additive errors-in-variables model. Based on the empirical likelihood based approach, a test statistic was proposed, and it was shown to follow asymptotically a chi-square distribution under the null hypothesis of no serial correlation. Finally, some simulation studies are conducted to illustrate the performance of the proposed method.     

Stochastic analysis of covariance when the error distribution is long-tailed symmetric

In this study, we consider stochastic one-way analysis of covariance model when the distribution of the error terms is long-tailed symmetric. Estimators of the unknown model parameters are obtained by using the maximum likelihood (ML) methodology. Iteratively reweighting algorithm is used to compute the ML estimates of the parameters. We also propose new test statistic based on ML estimators for testing the linear contrasts of the treatment effects. In the simulation study, we compare the efficiencies of the traditional least-squares (LS) estimators of the model parameters with the corresponding ML estimators. We also compare the power of the test statistics based on LS and ML estimators, respectively. A real-life example is given at the end of the study.     

The Frisch–Waugh–Lovell theorem for the lasso and the ridge regression

The Frisch–Waugh–Lovell (FWL) (partitioned regression) theorem is essential in regression analysis. This is partly because it is quite useful to derive theoretical results. The lasso regression and the ridge regression, both of which are penalized least-squares regressions, have become popular statistical techniques. This article describes that the FWL theorem remains valid for these penalized least-squares regressions. More precisely, we demonstrate that the covariates corresponding to unpenalized regression parameters in these penalized least-squares regression can be projected out. Some other results related to the FWL theorem in such penalized least-squares regressions are also presented.     

A note on the monotonicity of the ES algorithm

In the study of the robust nonparametric regression problem, Oh et al. [The role of pseudo data for robust smoothing with application to wavelet regression, Biometrika 94 (2007), pp. 893–904] developed and named the ES algorithm. In the event that the ES algorithm converges, the robust estimator can be obtained through a sequence of conventional penalized least-squares estimates, the computation of which is fast and straightforward. However, the convergence of the ES algorithm was not established theoretically in Oh et al. In this note, we show that under a certain simple condition, the ES algorithm is monotonic. In particular, the ES algorithm does converge globally in the setting of Oh et al.     

Geometric Anisotropic Spatial Point Pattern Analysis and Cox Processes

We consider spatial point processes with a pair correlation function, which depends only on the lag vector between a pair of points. Our interest is in statistical models with a special kind of ‘structured’ anisotropy: the pair correlation function is geometric anisotropic if it is elliptical but not spherical. In particular, we study Cox process models with an elliptical pair correlation function, including shot noise Cox processes and log Gaussian Cox processes, and we develop estimation procedures using summary statistics and Bayesian methods. Our methodology is illustrated on real and synthetic datasets of spatial point patterns.     

Regression Methods for Combining Multiple Classifiers

As no single classification method outperforms other classification methods under all circumstances, decision-makers may solve a classification problem using several classification methods and examine their performance for classification purposes in the learning set. Based on this performance, better classification methods might be adopted and poor methods might be avoided. However, which single classification method is the best to predict the classification of new observations is still not clear, especially when some methods offer similar classification performance in the learning set. In this article we present various regression and classical methods, which combine several classification methods to predict the classification of new observations. The quality of the combined classifiers is examined on some real data. Nonparametric regression is the best method of combining classifiers.     

Estimation of parameters for a Birnbaum–Saunders regression model with censored data

Little work has been published on the analysis of censored data for the Birnbaum–Saunders distribution (BISA). In this article, we implement the EM algorithm to fit a regression model with censored data when the failure times follow the BISA. Three approaches to implement the E-Step of the EM algorithm are considered. In two of these implementations, the M-Step is attained by an iterative least-squares procedure. The algorithm is exemplified with a single explanatory variable in the model.     

Estimation of Polygons and Areas

Abstract.  In forestry the problem of estimating areas is central. This paper addresses area estimation through fitting of a polygon to observed coordinate data. Coordinates of corners and points along the sides of a simple closed polygon are measured with independent random errors. This paper focuses on procedures to adjust the coordinates for estimation of the polygon and its area. Different new techniques that consider different amounts of prior information are described and compared. The different techniques use restricted least squares, maximum likelihood and the expectation maximization algorithm. In a simulation study it is shown that the root mean square errors of the estimates are decreased when coordinates are adjusted before estimation. Minor further improvement is achieved by using prior information about the order and the distribution of the points along the sides of the polygon. This paper has its origin in forestry but there are also other applications.     

Criteria for the equality between ordinary least squares and best linear unbiased estimators under certain linear models

A new necessary and sufficient condition is derived for the equality between the ordinary least-squares estimator and the best linear unbiased estimator of the expectation vector in linear models with certain specific design matrices. This condition is then applied to special cases involving one-way and two-way classification models.