Corrected maximum likelihood estimators in heteroscedastic symmetric nonlinear models

In this article, we derive general matrix formulae for second-order biases of maximum likelihood estimators (MLEs) in a class of heteroscedastic symmetric nonlinear regression models, thus generalizing some results in the literature. This class of regression models includes all symmetric continuous distributions, and has a wide range of practical applications in various fields such as engineering, biology, medicine and economics, among others. The variety of distributions with different kurtosis coefficients than the normal may give more flexibility in the choice of an appropriate distribution, particularly to accommodate outlying and influential observations. We derive a joint iterative process for estimating the mean and dispersion parameters. We also present simulation studies for the biases of the MLEs.     

Diagnostics for elliptical linear mixed models with first-order autoregressive errors

For longitudinal time series data, linear mixed models that contain both random effects across individuals and first-order autoregressive errors within individuals may be appropriate. Some statistical diagnostics based on the models under a proposed elliptical error structure are developed in this work. It is well known that the class of elliptical distributions offers a more flexible framework for modelling since it contains both light- and heavy-tailed distributions. Iterative procedures for the maximum-likelihood estimates of the model parameters are presented. Score tests for the presence of autocorrelation and the homogeneity of autocorrelation coefficients among individuals are constructed. The properties of test statistics are investigated through Monte Carlo simulations. The local influence method for the models is also given. The analysed results of a real data set illustrate the values of the models and diagnostic statistics.     

Adaptive Estimation of the Integral of Squared Regression Derivatives

A problem of estimating the integral of a squared regression function and of its squared derivatives has been addressed in a number of papers. For the case of a heteroscedastic model where smoothness of the underlying regression function, the design density, and the variance of errors are known, the asymptotically sharp minimax lower bound and a sharp estimator were found in Pastuchova & Khasminski (1989). However, there are apparently no results on the either rate optimal or sharp optimal adaptive, or data-driven, estimation when neither the degree of regression function smoothness nor design density, scale function and distribution of errors are known. After a brief review of main developments in non-parametric estimation of non-linear functionals, we suggest a simple adaptive estimator for the integral of a squared regression function and its derivatives and prove that it is sharp-optimal whenever the estimated derivative is sufficiently smooth.     

Testing for heteroscedasticity of exponential correlation mixed-effects linear models based on M-estimation

Homogeneity of variance is a basic assumption in longitudinal data analysis. However, the assumption is not necessarily appropriate. In this paper, Fisher scoring method is applied to get M-estimator in the exponential correlation mixed-effects linear model. The score tests for heteroscedasticity and correlation coefficient based on M-estimator are then studied. Monte Carlo method is applied to investigate the properties of test statistics. At last, the methods and properties are illustrated by an actual data example.     

Large sample estimation and prediction for explosive growth curve models

Asymptotic distributions of maximum likelihood estimators for the parameters in explosive growth curve models are derived. Limit distributions of prediction errors when the parameters are estimated are also obtained. The growth curve models are viewed as multivariate time-series models, and the usual time-series methods are used for prediction. Estimation constrained by a hypothesis of homogeneity of growth rates is also considered.     

Considerations for optimal nonparametric regression under a generalizederror structure

Nonparametric smoothing, such as kernel or spline estimation, has been examined extensively under the assumption of uncorrelated errors. This paper addresses the effects of potential correlation on consistency and other asymptotic properties in a repeated-measures model, using directly optimized linear smoothers of the replicate means. Unrestricted optimal weights, with respect to squared error loss, are used to confirm a lack of consistency for all linear estimators in an autocorrelated errors model. The results indicate kernel methods that work well for an uncorrelated errors model may not have the ability to perform satisfactorily when correlation is introduced, due to an asymmetry in the optimal weights, which disappears for an uncorrelated errors model. These would include data-driven bandwidth selection methods, adjustments of the bandwidth to accommodate correlation, higher-order kernels, and related bias reduction techniques. The analytic results suggest alternative approaches, not considered here in detail, which have shown merit.     

Ridge regression estimators in the linear regression models with non-spherical errors

The present paper considers a family of ordinary ridge regression estimators in the linear regression model when the disturbances covariance matrix depends upon a few unknown parameters. An asymptotic expansion for the distribution of the ridge regression estimator is developed and under the quadratic loss function its asymptotic risk is compared with that of the feasible GLS estimator.     

Influence measure for the L1 regression

Because outliers and leverage observations unduly affect the least squares regression, the identification of influential observations is considered an important and integrai part of the analysis. However, very few techniques have been developed for the residual analysis and diagnostics for the minimum sum of absolute errors, L₁ regression. Although the L₁ regression is more resistant to the outliers than the least squares regression, it appears that outliers (leverage) in the predictor variables may affect it. In this paper, our objective is to develop an influence measure for the L₁ regression based on the likelihood displacement function. We illustrate the proposed influence measure with examples.     

Empirical Likelihood for Single-Index Regression Models under Negatively Associated Errors

In this article, we use bockwise empirical likelihood technique to construct confidence regions for the parameter of the single-index models under negatively associated errors. It is shown that the blockwise empirical likelihood ratio statistic for the parameter of interest is asymptotically χ²-type distributed. The result can be used to obtain confidence regions for the parameter of interest.     

Performing armchair roundoff analyses of statistical algorithms

Numerical stability is but one of many desirable properties which should be considered when designing statistical software. However, rigorous roundoff analysis is rarely done because it seems not worth the price; the influence of rounding error is usually of secondary importance, and the analysis is thought to be beyond the reach of all but a few specialists. This note discusses the role of roundoff analysis in the design of a statistical program and shows that new techniques sometimes make assessment of the effect of rounding errors no more difficult than the verification of other program properties.