A Bayesian approach to non-parametric monotone function estimation

Summary.  The paper proposes two Bayesian approaches to non-parametric monotone function estimation. The first approach uses a hierarchical Bayes framework and a characterization of smooth monotone functions given by Ramsay that allows unconstrained estimation. The second approach uses a Bayesian regression spline model of Smith and Kohn with a mixture distribution of constrained normal distributions as the prior for the regression coefficients to ensure the monotonicity of the resulting function estimate. The small sample properties of the two function estimators across a range of functions are provided via simulation and compared with existing methods. Asymptotic results are also given that show that Bayesian methods provide consistent function estimators for a large class of smooth functions. An example is provided involving economic demand functions that illustrates the application of the constrained regression spline estimator in the context of a multiple-regression model where two functions are constrained to be monotone.     

Influence measure for the L1 regression

Because outliers and leverage observations unduly affect the least squares regression, the identification of influential observations is considered an important and integrai part of the analysis. However, very few techniques have been developed for the residual analysis and diagnostics for the minimum sum of absolute errors, L₁ regression. Although the L₁ regression is more resistant to the outliers than the least squares regression, it appears that outliers (leverage) in the predictor variables may affect it. In this paper, our objective is to develop an influence measure for the L₁ regression based on the likelihood displacement function. We illustrate the proposed influence measure with examples.     

Weighted Stochastic Restricted Estimation in Linear Measurement Error Models

This article discusses the consistent estimation of the parameters in a linear measurement error model when stochastic linear restrictions on regression coefficients are available. We propose some methodologies to obtain the consistent estimation when either the covariance matrix of the measurement errors or the reliability matrix of independent variables is known. Their finite- and large-sample properties are derived with not necessarily normal errors. A Monte Carlo simulation is carried out to study the the finite properties of the estimators.     

BARTLETT CORRECTED LIKELIHOOD RATIO TESTS IN LOCATION-SCALE NONLINEAR MODELS

The paper derives Bartlett corrections for improving the chisquare approximation to the likelihood ratio statistics in a class of location-scale family of distributions, which encompasses the elliptical family of distributions and also asymmetric distributions such as the extreme value distributions. We present, in matrix notation, a Bartlett corrected likelihood ratio statistic for testing that a subset of the nonlinear regression coefficients in this class of models equals a given vector of constants. The formulae derived are simple enough to be used analytically to obtain several Bartlett corrections in a variety of important models. We show that these formulae generalize a number of previously published results. We also present simulation results comparing the sizes and powers of the usual likelihood ratio tests and their Bartlett corrected versions when the scale parameter is considered known and when this parameter is uncorrectly specified.     

Testing Covariance Stationarity

In this paper, we show that the widely used stationarity tests such as the Kwiatkowski Phillips, Schmidt, and Shin (KPSS) test have power close to size in the presence of time-varying unconditional variance. We propose a new test as a complement of the existing tests. Monte Carlo experiments show that the proposed test possesses the following characteristics: (i) in the presence of unit root or a structural change in the mean, the proposed test is as powerful as the KPSS and other tests; (ii) in the presence of a changing variance, the traditional tests perform badly whereas the proposed test has high power comparing to the existing tests; (iii) the proposed test has the same size as traditional stationarity tests under the null hypothesis of stationarity. An application to daily observations of return on U.S. Dollar/Euro exchange rate reveals the existence of instability in the unconditional variance when the entire sample is considered, but stability is found in subsamples.     

A one- sample test based on subsamples medians

Nonparametric test statistics are constructed by considering the medians in subsamples of appropriate size taken -from n independent observations. These tests are shown to be sensitive to both heavy and moderate tailed distributions.     

EGARCH Model with Weighted Liquidity

We analyze a variant of the EGARCH model which captures the variation of the intra-day price. We study the asymptotic behavior of the estimators for the parameters of the model. We also illustrate our theoretical results by empirical studies.     

Diagnostics for elliptical linear mixed models with first-order autoregressive errors

For longitudinal time series data, linear mixed models that contain both random effects across individuals and first-order autoregressive errors within individuals may be appropriate. Some statistical diagnostics based on the models under a proposed elliptical error structure are developed in this work. It is well known that the class of elliptical distributions offers a more flexible framework for modelling since it contains both light- and heavy-tailed distributions. Iterative procedures for the maximum-likelihood estimates of the model parameters are presented. Score tests for the presence of autocorrelation and the homogeneity of autocorrelation coefficients among individuals are constructed. The properties of test statistics are investigated through Monte Carlo simulations. The local influence method for the models is also given. The analysed results of a real data set illustrate the values of the models and diagnostic statistics.     

VARIANCE ESTIMATION IN NONPARAMETRIC MULTIPLE REGRESSION

ABSTRACT

We consider the variance estimation in a general nonparametric regression model with multiple covariates. We extend difference methods to the multivariate setting by introducing an algorithm that orders the design points in higher dimensions. We also consider an adaptive difference estimator which requires much less strict assumptions on the covariate design and can significantly reduce mean squared error for small sample sizes.     

COMPARATIVE CALIBRATION WITH SUBGROUPS

The main object of this paper is to consider structural comparative calibration models under the assumption that the unknown quantity being measured is not identically distributed for all units. We consider the situation where the mean of the unknown quantity being measured is different within subgroups of the population. Method of moments and maximum likelihood estimators are considered for estimating the parameters in the model. Large sample inference is facilitated by the derivation of the asymptotic variances. An application to a data set which indeed motivated the consideration of such general model and was obtained by measuring the heights of a group of trees with five different instruments is considered.