Evaluating the power of Minitab's data subsetting lack of fit test in multiple linear regression

Minitab's data subsetting lack of fit test (denoted XLOF) is a combination of Burn and Ryan's test and Utts' test for testing lack of fit in linear regression models. As an alternative to the classical or pure error lack of fit test, it does not require replicates of predictor variables. However, due to the uncertainty about its performance, XLOF still remains unfamiliar to regression users while the well-known classical lack of fit test is not applicable to regression data without replicates. So far this procedure has not been mentioned in any textbooks and has not been included in any other software packages. This study assesses the performance of XLOF in detecting lack of fit in linear regressions without replicates by comparing the power with the classic test. The power of XLOF is simulated using Minitab macros for variables with several forms of curvature. These comparisons lead to pragmatic suggestions on the use of XLOF. The performance of XLOF was shown to be superior to the classical test based on the results. It should be noted that the replicates required for the classical test made itself unavailable for most of the regression data while XLOF can still be as powerful as the classic test even without replicates.     

Comparison of Nonparametric Regression Curves by Spline Smoothing

In this article, procedures are proposed to test the hypothesis of equality of two or more regression functions. Tests are proposed by p-values, first under homoscedastic regression model, which are derived using fiducial method based on cubic spline interpolation. Then, we construct a test in the heteroscedastic case based on Fisher's method of combining independent tests. We study the behaviors of the tests by simulation experiments, in which comparisons with other tests are also given. The proposed tests have good performances. Finally, an application to a data set are given to illustrate the usefulness of the proposed test in practice.     

General lack of fit tests based on families of groupings

Lack of fit tests based on groupings of the observations are developed. These tests are first applied to models with replication. In this case, the classic Fisher test assumes that the true model is contained in the one-way ANOVA model. However, Christensen [(2003). Significantly insignificant F tests. Amer. Statist. 57, 27–32] has noted that small values of the F-statistic may indicate lack of fit due to features which are not part of the proposed model. Such model inadequacy is called within-cluster lack of fit, whereas the standard Fisher lack of fit is called between-cluster lack of fit. Typically, lack of fit exists as a combination of these two pure types, and can be extremely difficult to detect depending on the nature of the mixture. In this paper, the one-way ANOVA model is embedded in larger models using groupings of the observations, which provides tests with good power for detecting all of the above types of model inadequacies, including mixtures. In particular, several such tests are considered, each based on a different grouping of the observations, and the multiple testing approach of Baraud et al. [(2003). Adaptive tests of linear hypotheses by model selection. Ann. Statist. 31, 225–251] is followed. More generally, the preceding testing procedure based on families of groupings is extended to the case of nonreplication. For this case, it is proposed that such families be determined by linear orders on the predictors based on disjoint parallel tubes in predictor space. Test statistics follow the cluster-based regression lack of fit tests presented by Christensen [(1989). Lack of fit based on near or exact replicates. Ann. Statist. 17, 673–683; (1991). Small sample characterizations of near replicate lack of fit tests. J. Amer. Statist. Assoc. 86, 752–756], by considering the groupings as determining special types of clusterings. In order to detect general lack of fit, several such tests are again considered, each based on a different grouping of the observations, and the multiple testing approach given by Baraud et al. [(2003). Adaptive tests of linear hypotheses by model selection. Ann. Statist. 31, 225–251] is followed. Simulation results illustrating the power of the proposed testing procedure are given.     

Model-free predictor tests in survival regression through sufficient dimension reduction

In this article, we test the effects of predictors in survival regression through two well-known sufficient dimension reduction methods. Since the usual sufficient dimension reduction methods do not require pre-specified models, the predictor effect tests can be considered model-free. All of the test statistics have χ ² distributions. Numerical studies of the proposed predictor effect tests in various simulations and real data application are presented.     

Two permutation tests of equality of variances

The F-ratio test for equality of dispersion in two samples is by no means robust, while non-parametric tests either assume a common median, or are not very powerful. Two new permutation tests are presented, which do not suffer from either of these problems. Algorithms for Monte Carlo calculation of P values and confidence intervals are given, and the performance of the tests are studied and compared using Monte Carlo simulations for a range of distributional types. The methods used to speed up Monte Carlo calculations, e.g. stratification, are of wider applicability.     

Combination of multiple scores for nonparametric testing in multivariate linear regression set-up

For the problem of testing absence of x.egression under the p-variate nonparametric linear regression set-up involving m predictors, standard rank test criteria are in the form of a quadratic form in mp linear rank statistics. Different standard tests correspond to different choices of one system of scores for each variable. In this paper we propose two test criteria which are based on simultaneous choice of more than one system of scores for each variable. The criteria are obtained by applying the union-intersection technique in two different ways. It turns out that for either criterion the use of several systems of scores for each variable results in an improvement in the asymptotic power.     

Double samble tests— a distribution free procedure

A method for constructing two-stage (double samble) tests is presented which does not require the evaluation of complicated bivariate distribution function. The procedure results from a modification of Fisher's method for combining independent tests of significance and is distribution free in the way it combines the test results from the two sampies. However, the one sample test statistics for the two samples are assumed to have continuous distributions and may be parametric. A rule is also given or the selection of a particular test out of a family of possible two-stage tests which can be generated by this method. Specific examples are given and comparisons are made with two double sample tests which have previously been presented in the literature.     

Selection of Predictors in Distance-Based Regression

Distance-based regression is a prediction method consisting of two steps: from distances between observations we obtain latent variables which, in turn, are the regressors in an ordinary least squares linear model. Distances are computed from actually observed predictors by means of a suitable dissimilarity function. Being generally nonlinearly related with the response, their selection by the usual F tests is unavailable. In this article, we propose a solution to this predictor selection problem by defining generalized test statistics and adapting a nonparametric bootstrap method to estimate their p-values. We include a numerical example with automobile insurance data.     

Testing parallelism of regression lines against ordered alternatives

For the problem of testing the equality of slopes of several regression lines against the alternative that the slopes are in increasing (decreasing) order of magnitude, two types of tests are proposed. These are the likelihood ratio test and a test that depends on suitable linear combination of one group statistics. Rank analogues of the two tests are also examined.     

Extending the Scope of Inverse Regression Methods in Sufficient Dimension Reduction

In the area of sufficient dimension reduction, two structural conditions are often assumed: the linearity condition that is close to assuming ellipticity of underlying distribution of predictors, and the constant variance condition that nears multivariate normality assumption of predictors. Imposing these conditions are considered as necessary trade-off for overcoming the “curse of dimensionality”. However, it is very hard to check whether these conditions hold or not. When these conditions are violated, some methods such as marginal transformation and re-weighting are suggested so that data fulfill them approximately. In this article, we assume an independence condition between the projected predictors and their orthogonal complements which can ensure the commonly used inverse regression methods to identify the central subspace of interest. The independence condition can be checked by the gridded chi-square test. Thus, we extend the scope of many inverse regression methods and broaden their applicability in the literature. Simulation studies and an application to the car price data are presented for illustration.     

Hierarchical Variable Selection in Polynomial Regression Models

Significance tests on coefficients of lower-order terms in polynomial regression models are affected by linear transformations. For this reason, a polynomial regression model that excludes hierarchically inferior predictors (i.e., lower-order terms) is considered to be not well formulated. Existing variable-selection algorithms do not take into account the hierarchy of predictors and often select as “best” a model that is not hierarchically well formulated. This article proposes a theory of the hierarchical ordering of the predictors of an arbitrary polynomial regression model in m variables, where m is any arbitrary positive integer. Ways of modifying existing algorithms to restrict their search to well-formulated models are suggested. An algorithm that generates all possible well-formulated models is presented.     

Testing the Significance of Categorical Predictor Variables in Nonparametric Regression Models

In this paper we propose a test for the significance of categorical predictors in nonparametric regression models. The test is fully data-driven and employs cross-validated smoothing parameter selection while the null distribution of the test is obtained via bootstrapping. The proposed approach allows applied researchers to test hypotheses concerning categorical variables in a fully nonparametric and robust framework, thereby deflecting potential criticism that a particular finding is driven by an arbitrary parametric specification. Simulations reveal that the test performs well, having significantly better power than a conventional frequency-based nonparametric test. The test is applied to determine whether OECD and non-OECD countries follow the same growth rate model or not. Our test suggests that OECD and non-OECD countries follow different growth rate models, while the tests based on a popular parametric specification and the conventional frequency-based nonparametric estimation method fail to detect any significant difference.     

Lagged Regression Residuals and Serial-Correlation Tests

A new family of statistics is proposed to test for the presence of serial correlation in linear regression models. The tests are based on partial sums of lagged cross-products of regression residuals that define a class of interesting Gaussian processes. These processes are characterized in terms of regressor functions, the serial-correlation structure, the distribution of the noise process, and the order of the lag of the cross-products of residuals. It is shown that these four factors affect the lagged residual processes independently. Large-sample distributional results are presented for test statistics under the null hypothesis of no serial correlation or for alternatives from a range of interesting hypotheses. Some indication of the circumstances to which the asymptotic results apply in finite-sample situations and of those to which they should be applied with some caution are obtained through a simulation study. Tables of selected quantiles of the proposed tests are also given. The tests are illustrated with two examples taken from the empirical literature. It is also proposed that plots of lagged residual processes be used as diagnostic tools to gain insight into the correlation structure of residuals derived from regression fits.     

On a new test for autocorrelation in regression models under nonnormality

A new test for autocorrelation in a general regression model under departures from the assumption of normality is derived by applying a beta distribution and bootstrap approximation, Critical values of the test, can be computed for each given design matrix, irrespective of the form of the underlying error distribution, Monte Carlo simulations are conducted in order to illustrate the performance of the test. Among others, it. is found that the suggested test is more robust and far more powerful than existing nonparametric tests.     

Testing nonparametric statistical functionals with applications to rank tests

The present paper discusses how nonparametric tests can be deduced from statistical functionals. Efficient and asymptotically most powerful maximin tests are derived. Their power function is calculated under implicit alternatives given by the functional for one – and two – sample testing problems. It is shown that the asymptotic power function does not depend on the special implicit direction of the alternatives but only on quantities of the functional. The present approach offers a nonparametric principle how to construct common rank tests as the Wilcoxon test, the log rank test, and the median test from special two-sample functionals. In addition it is shown that studentized permutation tests yield asymptotically valid tests for certain extended null hypotheses given by functionals which are strictly larger than the common i.i.d. null hypothesis. As example tests concerning the von Mises functional and the Wilcoxon two-sample test are treated.     

Robust block bootstrap panel predictability tests*

This article develops two block bootstrap-based panel predictability test procedures that are valid under very general conditions. Some of the allowable features include cross-sectional dependence, heterogeneous predictive slopes, persistent predictors, and complex error dynamics, including cross-unit endogeneity. While the first test procedure tests if there is any predictability at all, the second procedure determines the units for which predictability holds in case of a rejection by the first. A weak unit root framework is adopted to allow persistent predictors, and a novel theory is developed to establish asymptotic validity of the proposed bootstrap. Simulations are used to evaluate the performance of our tests in small samples, and their implementation is illustrated through an empirical application to stock returns.     

Testing for lack of fit in inverse regression—with applications to biophotonic imaging

Summary.  We propose two test statistics for use in inverse regression problems Y = K θ + ɛ , where K is a given linear operator which cannot be continuously inverted. Thus, only noisy, indirect observations Y for the function θ are available. Both test statistics have a counterpart in classical hypothesis testing, where they are called the order selection test and the data-driven Neyman smooth test. We also introduce two model selection criteria which extend the classical Akaike information criterion and Bayes information criterion to inverse regression problems. In a simulation study we show that the inverse order selection and Neyman smooth tests outperform their direct counterparts in many cases. The theory is motivated by data arising in confocal fluorescence microscopy. Here, images are observed with blurring, modelled as convolution, and stochastic error at subsequent times. The aim is then to reduce the signal-to-noise ratio by averaging over the distinct images. In this context it is relevant to decide whether the images are still equal, or have changed by outside influences such as moving of the object table.     

Assessing the fit of finite mixture distributions

Mixture distributions have become a very flexible and common class of distributions, used in many different applications, but hardly any literature can be found on tests for assessing their goodness of fit. We propose two types of smooth tests of goodness of fit for mixture distributions. The first test is a genuine smooth test, and the second test makes explicit use of the mixture structure. In a simulation study the tests are compared to some traditional goodness of fit tests that, however, are not customised for mixture distributions. The first smooth test has overall good power and generally outperforms the other tests. The second smooth test is particularly suitable for assessing the fit of each component distribution separately. The tests are applicable to both continuous and discrete distributions and they are illustrated on three medical data sets.     

Testing hypotheses about the common mean of two normal populations

Two simple tests which allow for unequal sample sizes are considered for testing hypothesis for the common mean of two normal populations. The first test is an exact test of size a based on two available t-statistics based on single samples made exact through random allocation of α among the two available t-tests. The test statistic of the second test is a weighted average of two available t-statistics with random weights. It is shown that the first test is more efficient than the available two t-tests with respect to Bahadur asymptotic relative efficiency. It is also shown that the null distribution of the test statistic in the second test, which is similar to the one based on the normalized Graybill-Deal test statistic, converges to a standard normal distribution. Finally, we compare the small sample properties of these tests, those given in Zhou and Mat hew (1993), and some tests given in Cohen and Sackrowitz (1984) in a simulation study. In this study, we find that the second test performs better than the tests given in Zhou and Mathew (1993) and is comparable to the ones given in Cohen and Sackrowitz (1984) with respect to power..     

STUR过程下危机“传染性”计量检验的有效性研究

文章首先介绍了危机“传染性”计量检验的两种分析框架:基于潜因子的分析模型和结构回归分析模型,同时给出了一些具体的检验方法,主要包括:Forbes和Rigobon的可调节的相关检验和多元“邹”检验,Favero和Giavazzi的“异常点”检验,Pesaran和Pick的阀值检验等。为检验这些方法的有效性,采用随机单位根过程作为经济数据的变迁过程,发现“异常点”检验和阀值检验可以更好地捕捉到危机传染的时间特征。