Minimum distance lack-of-fit tests for fixed design

This paper discusses a class of tests of lack-of-fit of a parametric regression model when design is non-random and uniform on [0,1]. These tests are based on certain minimized distances between a nonparametric regression function estimator and the parametric model being fitted. We investigate asymptotic null distributions of the proposed tests, their consistency and asymptotic power against a large class of fixed and sequences of local nonparametric alternatives, respectively. The best fitted parameter estimate is seen to be n^1/2-consistent and asymptotically normal. A crucial result needed for proving these results is a central limit lemma for weighted degenerate U statistics where the weights are arrays of some non-random real numbers. This result is of an independent interest and an extension of a result of Hall for non-weighted degenerate U statistics.     

Empirical smoothing lack-of-fit tests for variance function

This paper discusses a nonparametric empirical smoothing lack-of-fit test for the functional form of the variance in regression models. The proposed test can be treated as a nontrivial modification of Zheng's nonparametric smoothing test, Koul and Ni's minimum distance test for the mean function in the classic regression models. The paper establishes the asymptotic normality of the proposed test under the null hypothesis. Consistency at some fixed alternatives and asymptotic power under some local alternatives are also discussed. A simulation study is conducted to assess the finite sample performance of the proposed test. Simulation study also shows that the proposed test is more powerful and computationally more efficient than some existing tests.     

The optimal Lp norm estimator in linear regression models

The least squares estimator is usually applied when estimating the parameters in linear regression models. As this estimator is sensitive to departures from normality in the residual distribution, several alternatives have been proposed. The L_p norm estimators is one class of such alternatives. It has been proposed that the kurtosis of the residual distribution be taken into account when a choice of estimator in the L_p norm class is made (i.e. the choice of p). In this paper, the asymtotic variance of the estimators is used as the criterion in the choice of p. It is shown that when this criterion is applied, other characteristics of the residual distribution than the kurtosis (namely moments of order p-2 and 2p-2) are important.     

Regions of alternatives with high and low power for goodness-of-fit tests

In the present paper we find finite dimensional spaces W of alternatives with high power for a given class of tests and non-parametric alternatives. On the orthogonal complement of W the power function is flat. These methods can be used to reduce the dimension of interesting alternatives. We sketch a device how to calculate (approximately) an alternative with maximum power of a fixed test on a given ball of certain non-parametric alternatives.

The calculations are done within different asymptotic models specified by signal detection tests. Specific tests are Kolmogorov–Smirnov type tests, integral tests (like the Anderson and Darling test) and Rényi tests for hazard based models. The statistical meaning and interpretation of the spaces of alternatives with high power is discussed. These alternatives belong to least favorable directions of a class of statistical functionals which are linear combinations of quantile functions. For various cases their meaning is explained for parametric submodels, in particular for location alternatives.     

A generalization of the bivariate Beta-Binomial distribution

This paper presents a new bivariate discrete distribution that generalizes the bivariate Beta-Binomial distribution. It is generated by Appell hypergeometric function F₁ and can be obtained as a Binomial mixture with an Exton's Generalized Beta distribution. The model has different marginal distributions which are, together with the conditional distributions, more flexible than the Beta-Binomial distribution. It has non-linear regression curves and is useful for random variables with positive correlation. These features make the model very adequate to fit observed data as the two applications included show.     

Testing for No Effect by Cosine Series Methods

The properties of three lack-of-fit tests that are related to non-parametric cosine regression analysis are examined in the context of testing for a constant mean function. Analytic power comparisons of these tests vs a most powerful test are made using intermediate asymptotic relative efficiency. In particular, a data-driven test is produced which is asymptotically as efficient as the most powerful test over a class of alternatives. A small scale simulation experiment is conducted to ascertain the extent that the large sample comparisons are applicable to finite samples.     

Lagged Regression Residuals and Serial-Correlation Tests

A new family of statistics is proposed to test for the presence of serial correlation in linear regression models. The tests are based on partial sums of lagged cross-products of regression residuals that define a class of interesting Gaussian processes. These processes are characterized in terms of regressor functions, the serial-correlation structure, the distribution of the noise process, and the order of the lag of the cross-products of residuals. It is shown that these four factors affect the lagged residual processes independently. Large-sample distributional results are presented for test statistics under the null hypothesis of no serial correlation or for alternatives from a range of interesting hypotheses. Some indication of the circumstances to which the asymptotic results apply in finite-sample situations and of those to which they should be applied with some caution are obtained through a simulation study. Tables of selected quantiles of the proposed tests are also given. The tests are illustrated with two examples taken from the empirical literature. It is also proposed that plots of lagged residual processes be used as diagnostic tools to gain insight into the correlation structure of residuals derived from regression fits.     

Optimal goodness-of-fit tests for recurrent event data

A class of tests for the hypothesis that the baseline intensity belongs to a parametric class of intensities is given in the recurrent event setting. Asymptotic properties of a weighted general class of processes that compare the non-parametric versus parametric estimators for the cumulative intensity are presented. These results are given for a sequence of Pitman alternatives. Test statistics are proposed and methods of obtaining critical values are examined. Optimal choices for the weight function are given for a class of chi-squared tests. Based on Khmaladze’s transformation we propose distributional free tests. These include the types of Kolmogorov–Smirnov and Cramér–von Mises. The tests are used to analyze two different data sets.     

Least absolute value regression: a special case of piecewise linear minimization

The Barrodale and Roberts algorithm for least absolute value (LAV) regression and the algorithm proposed by Bartels and Conn both have the advantage that they are often able to skip across points at which the conventional simplex-method algorithms for LAV regression would be required to carry out an (expensive) pivot operation.

We indicate here that this advantage holds in the Bartels-Conn approach for a wider class of problems: the minimization of piecewise linear functions. We show how LAV regression, restricted LAV regression, general linear programming and least maximum absolute value regression can all be easily expressed as piecewise linear minimization problems.     

Testing for the Equality of Two Nonparametric Regression Curves with Long Memory Errors

This article discusses the problem of testing the equality of two nonparametric regression functions against two-sided alternatives for uniform design on [0,1] with long memory moving average errors. The standard deviations and the long memory parameters are possibly different for the two errors. The article adapts the partial sum process idea used in the independent observations settings to construct the tests and derives their asymptotic null distributions. The article also shows that these tests are consistent for general alternatives and obtains their limiting distributions under a sequence of local alternatives. Since the limiting null distributions of these tests are unknown, we first conducted a Monte Carlo simulation study to obtain a few selected critical values of the proposed tests. Then based on these critical values, another Monte Carlo simulation is conducted to study the finite sample level and power behavior of these tests at some alternatives. The article also contains a simulation study that assesses the effect of estimating the nonparametric regression function on an estimate of the long memory parameter of the errors. It is observed that the estimate based on direct observations is generally preferable over the one based on the estimated nonparametric residuals.     

Distribution-free test in Tobit mean regression model

This paper discusses the problem of fitting a parametric model in Tobit mean regression models. The proposed test is based on the supremum of the Khamaladze-type transformation of a partial sum process of calibrated residuals. The asymptotic null distribution of this transformed process is shown to be the same as that of a time-transformed standard Brownian motion. Consistency of this sequence of tests against some fixed alternatives and asymptotic power under some local nonparametric alternatives are also discussed. Simulation studies are conducted to assess the finite sample performance of the proposed test. The power comparison with some existing tests shows some superiority of the proposed test at the chosen alternatives.     

Distribution-free tests in randomized blocks

Classes of distribution-free tests are proposed for testing homogeneity against order restricted as well as unrestricted alternatives in randomized block designs with multiple observations per cell. Allowing for different interblock scoring schemes, these tests are constructed based on the method of within block rankings. Asymptotic distributions (cell sizes tending to infinity) of these tests are derived under the assumption of homogeneity. The Pitman asymptotic relative efficiencies relative to the least squares statistics are studied. It is shown that when blocks are governed by different distributions, adaptive choice of scores within each block results in asymptotically more efficient tests as compared with methods that ignore such information. Monte Carlo simulations of selected designs indicate that the method of within block rankings is more power robust with respect to differing block distributions.     

Linear rank tests for censored survival data

We describe a class of rank test procedures for the two-sample problem with right censored survival data. The class of tests is directly generalized from the linear rank tests by assigning each observation a rank according to its corresponding Wilcoxon scores. It allows a flexible choice of score functions, in particular, those powerful against scale differences between the two survival distributions. Monte Carlo simulations have shown that some members of this class have great power in detecting crossing-curve alternatives (alternatives where underlying survival curves cross over). The class also contains tests essentially equivalent to the Gehan-Wilcoxon and the logrank tests.     

A class of k-sample distribution-free tests for location against ordered alternatives

This paper introduces a new class of distribution-free tests for testing the homogeneity of several location parameters against ordered alternatives. The proposed class of test statistics is based on a linear combination of two-sample U-statistics based on subsample extremes. The mean and variance of the test statistic are obtained under the null hypothesis as well as under the sequence of local alternatives. The optimal weights are also determined. It is shown via Pitman ARE comparisons that the proposed class of test statistics performs better than its competitor tests in case of heavy-tailed and long-tailed distributions     

Model checks for Cox-type regression models based on optimally weighted martingale residuals

We introduce directed goodness-of-fit tests for Cox-type regression models in survival analysis. “Directed” means that one may choose against which alternatives the tests are particularly powerful. The tests are based on sums of weighted martingale residuals and their asymptotic distributions. We derive optimal tests against certain competing models which include Cox-type regression models with different covariates and/or a different link function. We report results from several simulation studies and apply our test to a real dataset.     

Testing for new is better than used in expectation

A class of tests which are usually believed to be the tests of exponentiality vs. increasing failure rate (IFR) alternatives are shown to be consistent against a class of NBUE alternatives - a much larger class than IFR. Moreover a comparison is made of the Bahadur efficiency of the total time on test statistic W with the Kolmogorov-Smirnov statistic D. It is found that the D-test has larger exact slope at least favorable IFR distributions which are close to the exponential and also at pure NBUE distributions close to the exponential than does the W-test statistic, whereas the reverse is the case at Weibull (8), 6 > 1.     

A TEST OF HOMOGENEITY AGAINST SCALE ALTERNATIVES USING SUBSAMPLE EXTREMA1

In this paper a new class of non-parametric tests for testing homogeneity of several populations against scale alternatives is proposed. For this, independent samples of fixed sizes are drawn from each population and from these samples, all possible sub-samples of the same size are drawn and their maxima and minima are computed. Using these extreme the class of tests is obtained. Tests of this type have been offered for the two-sample slippage problem by Kochar (1978). Under certain conditions, this class of tests is shown to be consistent against ‘difference in scale’ alternatives. The test has been compared with Bhapkar's V-test (1961), Deshpande's D-test (1965), Sugiura's D_rs-test (1965) and with a classical test given by Lehmann (1959, pp. 273–275). It is shown that some members of this proposed class of tests are more efficient than the first three tests in the case of uniform, Laplace and normal distributions, when the number of populations compared is small.     

Testing Independence of Covariates and Errors in Non‐parametric Regression

Consider a non‐parametric regression model Y =m (X )+ϵ , where m is an unknown regression function, Y is a real‐valued response variable, X is a real covariate, and ϵ is the error term. In this article, we extend the usual tests for homoscedasticity by developing consistent tests for independence between X and ϵ . Further, we investigate the local power of the proposed tests using Le Cam's contiguous alternatives. An asymptotic power study under local alternatives along with extensive finite sample simulation study shows that the performance of the new tests is competitive with existing ones. Furthermore, the practicality of the new tests is shown using two real data sets.