Sequential empirical process in autoregressive models with measurement errors

In this paper, we study the weak convergence of the sequential empirical process based on the residuals from autoregressive models with measurement errors. It is shown that the sequential empirical process converges weakly to the sum of a Gaussian process which is the limit of a sequential empirical process of certain p-dependent random variables and an additional term depending on the parameter estimators of the model. As an application, we discuss the change point problem in the distribution of the error process in the autoregressive model. We present the numerical result of a simulation study for an asymptotically distribution-free test.     

Pitman closest equivariant estimators and predictors under location–scale models

For location, scale and location–scale models, which are common in practical applications, we derive optimum equivariant estimators and predictors using the Pitman closeness criterion. This approach is very robust with respect to the choice of the loss function as it only requires the loss function to be strictly monotone. We also prove that, in general, the Pitman closeness comparison of any two equivariant predictors depends on the unknown parameter only through a maximal invariant, and hence it is independent of the parameter when the parameter space is transitive. We present several examples illustrating applications of our theoretical results.     

Robust weighted one-way ANOVA: Improved approximation and efficiency

A robust test for the one-way ANOVA model under heteroscedasticity is developed in this paper. The data are assumed to be symmetrically distributed, apart from some outliers, although the assumption of normality may be violated. The test statistic to be used is a weighted sum of squares similar to the Welch [1951. On the comparison of several mean values: an alternative approach. Biometrika 38, 330-336.] test statistic, but any of a variety of robust measures of location and scale for the populations of interest may be used instead of the usual mean and standard deviation. Under the commonly occurring condition that the robust measures of location and scale are asymptotically normal, we derive approximations to the distribution of the test statistic under the null hypothesis and to its distribution under alternative hypotheses. An expression for relative efficiency is derived, thus allowing comparison of the efficiency of the test as a function of the choice of the location and scale estimators used in the test statistic. As an illustration of the theory presented here, we apply it to three commonly used robust location–scale estimator pairs: the trimmed mean with the Winsorized standard deviation; the Huber Proposal 2 estimator pair; and the Hampel robust location estimator with the median absolute deviation.     

Regression model checking with Berkson measurement errors

This paper discusses asymptotically distribution free tests for the lack-of-fit of a parametric regression model in the Berkson measurement error model. These tests are based on a martingale transform of a certain marked empirical process of calibrated residuals. A simulation study is included to assess the effect of measurement error on the proposed test. It is observed that empirical level is more stable across the chosen measurement error variances when fitting a linear model compared to when fitting a nonlinear model, while, in both cases, the empirical power decreases as this error variance increases, against all chosen alternatives.     

Testing Symmetry of the Error Distribution in Nonlinear Heteroscedastic Models

Using the empirical characteristic function, we derive a Cramér-von Mises test for symmetry of the error distribution in a class of nonlinear parametric heteroscedastic models. We study the convergence of the residual-based empirical distribution function. We establish a functional limit theorem for an empirical process of residuals, and investigate the asymptotic null distribution function of our test statistic. A simulation experiment is conducted to evaluate small-sample performances of our test.     

Nonparametric Two‐Sample Tests of the Marginal Mark Distribution with Censored Marks

Occasionally, investigators collect auxiliary marks at the time of failure in a clinical study. Because the failure event may be censored at the end of the follow‐up period, these marked endpoints are subject to induced censoring. We propose two new families of two‐sample tests for the null hypothesis of no difference in mark‐scale distribution that allows for arbitrary associations between mark and time. One family of proposed tests is a nonparametric extension of an existing semi‐parametric linear test of the same null hypothesis while a second family of tests is based on novel marked rank processes. Simulation studies indicate that the proposed tests have the desired size and possess adequate statistical power to reject the null hypothesis under a simple change of location in the marginal mark distribution. When the marginal mark distribution has heavy tails, the proposed rank‐based tests can be nearly twice as powerful as linear tests.     

Normality testing for a long-memory sequence using the empirical moment generating function

Moment generating functions and more generally, integral transforms for goodness-of-fit tests have been in use in the last several decades. Given a set of observations, the empirical transforms are easy to compute, being simply a sample mean, and due to uniqueness properties, these functions can be used for goodness-of-fit tests. This paper focuses on time series observations from a stationary process for which the moment generating function exists and the correlations have long-memory. For long-memory processes, the infinite sum of the correlations diverges and the realizations tend to have spurious trend like patterns where there may be none. Our aim is to use the empirical moment generating function to test the null hypothesis that the marginal distribution is Gaussian. We provide a simple proof of a central limit theorem using ideas from Gaussian subordination models (Taqqu, 1975) and derive critical regions for a graphical test of normality, namely the T₃-plot ( Ghosh, 1996). Some simulated and real data examples are used for illustration.     

Residuals for log-Burr XII regression models in survival analysis

In this paper, we compare three residuals to assess departures from the error assumptions as well as to detect outlying observations in log-Burr XII regression models with censored observations. These residuals can also be used for the log-logistic regression model, which is a special case of the log-Burr XII regression model. For different parameter settings, sample sizes and censoring percentages, various simulation studies are performed and the empirical distribution of each residual is displayed and compared with the standard normal distribution. These studies suggest that the residual analysis usually performed in normal linear regression models can be straightforwardly extended to the modified martingale-type residual in log-Burr XII regression models with censored data.     

Utilizing the Flexibility of the Epsilon-Skew-Normal Distribution for Common Regression Problems

In this paper we illustrate the properties of the epsilon-skew-normal (ESN) distribution with respect to developing more flexible regression models. The ESN model is a simple one-parameter extension of the standard normal model. The additional parameter ~ corresponds to the degree of skewness in the model. In the fitting process we take advantage of relatively new powerful routines that are now available in standard software packages such as SAS. It is illustrated that even if the true underlying error distribution is exactly normal there is no practical loss n power with respect to testing for non-zero regression coefficients. If the true underlying error distribution is slightly skewed, the ESN model is superior in terms of statistical power for tests about the regression coefficient. This model has good asymptotic properties for samples of size n>50.     

Vector autoregressive models with measurement errors for testing Granger causality

This paper develops a method for estimating the parameters of a vector autoregression (VAR) observed in white noise. The estimation method assumes that the noise variance matrix is known and does not require any iterative process. This study provides consistent estimators and the asymptotic distribution of the parameters required for conducting tests of Granger causality. Methods in the existing statistical literature cannot be used for testing Granger causality, since under the null hypothesis the model becomes unidentifiable. Measurement error effects on parameter estimates were evaluated by using computational simulations. The results suggest that the proposed approach produces empirical false positive rates close to the adopted nominal level (even for small samples) and has a satisfactory performance around the null hypothesis. The applicability and usefulness of the proposed approach are illustrated using a functional magnetic resonance imaging dataset.     

Change-Point Tests for the Error Distribution in Non-parametric Regression

Abstract.  Several testing procedures are proposed that can detect change-points in the error distribution of non-parametric regression models. Different settings are considered where the change-point either occurs at some time point or at some value of the covariate. Fixed as well as random covariates are considered. Weak convergence of the suggested difference of sequential empirical processes based on non-parametrically estimated residuals to a Gaussian process is proved under the null hypothesis of no change-point. In the case of testing for a change in the error distribution that occurs with increasing time in a model with random covariates the test statistic is asymptotically distribution free and the asymptotic quantiles can be used for the test. This special test statistic can also detect a change in the regression function. In all other cases the asymptotic distribution depends on unknown features of the data-generating process and a bootstrap procedure is proposed in these cases. The small sample performances of the proposed tests are investigated by means of a simulation study and the tests are applied to a data example.     

Detecting parameter shift in garch models

This paper applies recent theories of testing for parameter constancy to the conditional variance in a GARCH model. The supremum Lagrange multiplier test for conditional Gaussian GARCH models and its robustified variants are discussed. The asymptotic null distribution of the test statistics are derived from the weak convergence of the scores, and the critical values from the hitting probability of squared Bessel process.

Monte Carlo studies on the finite sample size and power performance of the supremum LM tests are conducted. Applications of these tests to S&P 500 indicate that the hypothesis of stable conditional variance parameters can be rejected.     

Detecting parameter shift in garch models

This paper applies recent theories of testing for parameter constancy to the conditional variance in a GARCH model. The supremum Lagrange multiplier test for conditional Gaussian GARCH models and its robustified variants are discussed. The asymptotic null distribution of the test statistics are derived from the weak convergence of the scores, and the critical values from the hitting probability of squared Bessel process.

Monte Carlo studies on the finite sample size and power performance of the supremum LM tests are conducted. Applications of these tests to S&P 500 indicate that the hypothesis of stable conditional variance parameters can be rejected.     

A new test for two-sample location problem based on empirical distribution function

We propose a new test for testing the equality of location parameter of two populations based on empirical distribution function (ECDF). The test statistics is obtained as a power divergence between two ECDFs. The test is shown to be distribution free, and its null distribution is obtained. We conducted empirical power comparison of the proposed test with several other available tests in the literature. We found that the proposed test performs better than its competitors considered here under several population structures. We also used two real datasets to illustrate the procedure.     

Characteristic Function‐based Semiparametric Inference for Skew‐symmetric Models

Skew‐symmetric models offer a very flexible class of distributions for modelling data. These distributions can also be viewed as selection models for the symmetric component of the specified skew‐symmetric distribution. The estimation of the location and scale parameters corresponding to the symmetric component is considered here, with the symmetric component known. Emphasis is placed on using the empirical characteristic function to estimate these parameters. This is made possible by an invariance property of the skew‐symmetric family of distributions, namely that even transformations of random variables that are skew‐symmetric have a distribution only depending on the symmetric density. A distance metric between the real components of the empirical and true characteristic functions is minimized to obtain the estimators. The method is semiparametric, in that the symmetric component is specified, but the skewing function is assumed unknown. Furthermore, the methodology is extended to hypothesis testing. Two tests for a null hypothesis of specific parameter values are considered, as well as a test for the hypothesis that the symmetric component has a specific parametric form. A resampling algorithm is described for practical implementation of these tests. The outcomes of various numerical experiments are presented.     

Smooth Residual Bootstrap for Empirical Processes of Non-parametric Regression Residuals

Abstract.  The aim of this paper is to prove the validity of smooth residual bootstrap versions of procedures that are based on the empirical process of residuals estimated from a non-parametric regression model. From this result, consistency of various model tests in non-parametric regression is deduced, such as goodness-of-fit tests for the regression and variance function, tests for equality of regression functions and tests concerning the error distribution.     

Function-based hypothesis testing in censored two-sample location-scale models

Function-based hypothesis testing in two-sample location-scale models has been addressed for uncensored data using the empirical characteristic function. A test of adequacy in censored two-sample location-scale models is lacking, however. A plug-in empirical likelihood approach is used to introduce a test statistic, which, asymptotically, is not distribution free. Hence for practical situations bootstrap is necessary for performing the test. A multiplier bootstrap and a model appropriate resampling procedure are given to approximate critical values from the null asymptotic distribution. Although minimum distance estimators of the location and scale are deployed for the plug-in, any consistent estimators can be used. Numerical studies are carried out that validate the proposed testing method, and real example illustrations are given.

     

A bivariate regression model for matched paired survival data: local influence and residual analysis

The use of bivariate distributions plays a fundamental role in survival and reliability studies. In this paper, we consider a location scale model for bivariate survival times based on the proposal of a copula to model the dependence of bivariate survival data. For the proposed model, we consider inferential procedures based on maximum likelihood. Gains in efficiency from bivariate models are also examined in the censored data setting. For different parameter settings, sample sizes and censoring percentages, various simulation studies are performed and compared to the performance of the bivariate regression model for matched paired survival data. Sensitivity analysis methods such as local and total influence are presented and derived under three perturbation schemes. The martingale marginal and the deviance marginal residual measures are used to check the adequacy of the model. Furthermore, we propose a new measure which we call modified deviance component residual. The methodology in the paper is illustrated on a lifetime data set for kidney patients.     

A goodness-of-fit test with nuisance parameters: numerical performance

Jurečková and Sen (J. Statist. Plann. Inference 91 (2000) 377–397) proposed goodness-of-fit tests for models admitting nuisance location or nuisance location and scale parameters, based on the difference of two estimators of the location parameter, that are asymptotically first-order equivalent iff the null hypothesis is true. We illustrate here the numerical performance of these tests on simulated data, demonstrating their applicability to practical problems. Comparisons are also made with the well-known Shapiro–Wilk goodness-of-fit test.     

Structural inference of the parameters of the heteroscedastic simultaneous equation model

The structural approach of inference for the parameters of a simultaneous equation model with heteroscedastic error variance is investigated in this paper. The joint and the marginal structural distributions for the coefficients of the exogenous variables and the scale parameters of the error variables, and the marginal likelihood function of the coefficients of the endogenous variables have been derived. The estimates are directly obtainable from the structural distribution and the marginal likelihood function of the parameters. The marginal distribution of a subset of coefficients of exogenous variables provides the basis for making inference for a particular subset of parameter of interest.