MOSUM monitoring for variance change in nonparametric regression models

ABSTRACT

This article considers the monitoring for variance change in nonparametric regression models. First, the local linear estimator of the regression function is given. A moving square cumulative sum procedure is proposed based on residuals of the estimator. And the asymptotic results of the statistic under the null hypothesis and the alternative hypothesis are obtained. Simulations and Application support our procedure.     

Adding functions to ensure regression converges

Regression fits a curve to data by minimizing a function of the residuals. The process of fitting a family of functions may fail to converge because the family of candidate functions has no minimum. After investigating what functions to add to a family to ensure a minimum exists, four families are examined. The family of polynomials needs no additional functions. Additional functions are found for the families of exponential growth curves, probit curves, and logistic curves. A sufficient condition tells when the minimum is not in the original family.     

Estimating systems of trending variables

A survey is given of some results on inference in cointegrated systems. We discuss some regression methods, and contrast them with the analysis of the vector autoregressive model. We discuss determination of cointegrating rank and estimation of parameters, as well as asymptotic inference. The problems are treated for 1(1) and for 1(2) variables.     

Is regression adjustment supported by the Neyman model for causal inference?

This paper examines both theoretically and empirically whether the common practice of using OLS multivariate regression models to estimate average treatment effects (ATEs) under experimental designs is justified by the Neyman model for causal inference. Using data from eight large U.S. social policy experiments, the paper finds that estimated standard errors and significance levels for ATE estimators are similar under the OLS and Neyman models when baseline covariates are included in the models, even though theory suggests that this may not have been the case. This occurs primarily because treatment effects do not appear to vary substantially across study subjects.     

Testing the Martingale Difference Hypothesis

In this paper we consider testing that an economic time series follows a martingale difference process. The martingale difference hypothesis has typically been tested using information contained in the second moments of a process, that is, using test statistics based on the sample autocovariances or periodograms. Tests based on these statistics are inconsistent since they cannot detect nonlinear alternatives. In this paper we consider tests that detect linear and nonlinear alternatives. Given that the asymptotic distributions of the considered tests statistics depend on the data generating process, we propose to implement the tests using a modified wild bootstrap procedure. The paper theoretically justifies the proposed tests and examines their finite sample behavior by means of Monte Carlo experiments.     

Bayesian variable selection and regularization for time–frequency surface estimation

Summary.  We describe novel Bayesian models for time–frequency inverse modelling of non-stationary signals. These models are based on the idea of a Gabor regression , in which a time series is represented as a superposition of translated, modulated versions of a window function exhibiting good time–frequency concentration. As a necessary consequence, the resultant set of potential predictors is in general overcomplete—constituting a frame rather than a basis—and hence the resultant models require careful regularization through appropriate choices of variable selection schemes and prior distributions. We introduce prior specifications that are tailored to representative time series, and we develop effective Markov chain Monte Carlo methods for inference. To highlight the potential applications of such methods, we provide examples using two of the most distinctive time–frequency surfaces—speech and music signals—as well as standard test functions from the wavelet regression literature.     

Testing the Normality Assumption in the Tobit Model

This paper examines a number of statistics that have been proposed to test the normality assumption in the tobit (censored regression) model. It argues that a number of commonly proposed statistics can be interpreted as different versions of the Lagrange multiplier, or score, test for a common null hypothesis. This observation is useful in examining the Monte Carlo results presented in the paper. The Monte Carlo results suggest that the computational convenience of a number of statistics is obtained at the cost of poor finite sample performance under the null hypothesis.     

Estimation of the intercept parameter for linear regression model with uncertain non-sample prior information

This paper considers alternative estimators of the intercept parameter of the linear regression model with normal error when uncertain non-sample prior information about the value of the slope parameter is available. The maximum likelihood, restricted, preliminary test and shrinkage estimators are considered. Based on their quadratic biases and mean square errors the relative performances of the estimators are investigated. Both analytical and graphical comparisons are explored. None of the estimators is found to be uniformly dominating the others. However, if the non-sample prior information regarding the value of the slope is not too far from its true value, the shrinkage estimator of the intercept parameter dominates the rest of the estimators.     

Nonparametric estimation of a change in defect intensity

Summary.  In an important class of problems involving mixture distributions, interest focuses on the mixture proportions, considering other possible parameters as nuisance parameters. We formulate a new variation on such problems that arose in a study on the link between the number of cells in a charge-coupled detector image sensor that turned defective because of cosmic radiation and the storage conditions of such sensors. In this variation, the component densities are bivariate, there are two classes and only a subset of the mixture proportions is of relevance. We propose a nonparametric method to estimate the relevant subset of the proportions and apply our method to the data in our study.     

Semiparametric mixture models and repeated measures: the multinomial cut point model

Summary.  Suppose that we have m repeated measures on each subject, and we model the observation vectors with a finite mixture model.  We further assume that the repeated measures are conditionally independent. We present methods to estimate the shape of the component distributions along with various features of the component distributions such as the medians, means and variances. We make no distributional assumptions on the components; indeed, we allow different shapes for different components.