Goodness‐of‐fit tests for linear regression models with missing response data

The authors show how to test the goodness‐of‐fit of a linear regression model when there are missing data in the response variable. Their statistics are based on the L₂ distance between nonparametric estimators of the regression function and a ‐consistent estimator of the same function under the parametric model. They obtain the limit distribution of the statistics and check the validity of their bootstrap version. Finally, a simulation study allows them to examine the behaviour of their tests, whether the samples are complete or not.     

Box‐Cox transformations in linear models: Large sample theory and tests of normality

The authors provide a rigorous large sample theory for linear models whose response variable has been subjected to the Box‐Cox transformation. They provide a continuous asymptotic approximation to the distribution of estimators of natural parameters of the model. They show, in particular, that the maximum likelihood estimator of the ratio of slope to residual standard deviation is consistent and relatively stable. The authors further show the importance for inference of normality of the errors and give tests for normality based on the estimated residuals. For non‐normal errors, they give adjustments to the log‐likelihood and to asymptotic standard errors.     

Goodness‐of‐Fit Tests for Bivariate and Multivariate Skew‐Normal Distributions

Abstract. Goodness‐of‐fit tests are proposed for the skew‐normal law in arbitrary dimension. In the bivariate case the proposed tests utilize the fact that the moment‐generating function of the skew‐normal variable is quite simple and satisfies a partial differential equation of the first order. This differential equation is estimated from the sample and the test statistic is constructed as an L ₂ ‐type distance measure incorporating this estimate. Extension of the procedure to dimension greater than two is suggested whereas an effective bootstrap procedure is used to study the behaviour of the new method with real and simulated data.     

A parametric bootstrap approach for two-way error component regression models

In this article, the two-way error component regression model is considered. For the nonhomogenous linear hypothesis testing of regression coefficients, a parametric bootstrap (PB) approach is proposed. Simulation results indicate that the PB test, regardless of the sample sizes, maintains the Type I error rates very well and outperforms the existing generalized variable test, which may far exceed the intended significance level when the sample sizes are small or moderate. Real data examples illustrate the proposed approach work quite satisfactorily.     

Exact Goodness‐of‐Fit Testing for the Ising Model

The Ising model is one of the simplest and most famous models of interacting systems. It was originally proposed to model ferromagnetic interactions in statistical physics and is now widely used to model spatial processes in many areas such as ecology, sociology, and genetics, usually without testing its goodness of fit. Here, we propose various test statistics and an exact goodness‐of‐fit test for the finite‐lattice Ising model. The theory of Markov bases has been developed in algebraic statistics for exact goodness‐of‐fit testing using a Monte Carlo approach. However, finding a Markov basis is often computationally intractable. Thus, we develop a Monte Carlo method for exact goodness‐of‐fit testing for the Ising model that avoids computing a Markov basis and also leads to a better connectivity of the Markov chain and hence to a faster convergence. We show how this method can be applied to analyze the spatial organization of receptors on the cell membrane.     

Non‐parametric Copula Estimation Under Bivariate Censoring

In this paper, we consider non‐parametric copula inference under bivariate censoring. Based on an estimator of the joint cumulative distribution function, we define a discrete and two smooth estimators of the copula. The construction that we propose is valid for a large range of estimators of the distribution function and therefore for a large range of bivariate censoring frameworks. Under some conditions on the tails of the distributions, the weak convergence of the corresponding copula processes is obtained in l^∞([0,1]²). We derive the uniform convergence rates of the copula density estimators deduced from our smooth copula estimators. Investigation of the practical behaviour of these estimators is performed through a simulation study and two real data applications, corresponding to different censoring settings. We use our non‐parametric estimators to define a goodness‐of‐fit procedure for parametric copula models. A new bootstrap scheme is proposed to compute the critical values.     

Analysis of directional dependence using asymmetric copula-based regression models

The directional dependence between variables using asymmetric copula regression has drawn much attention in recent years. There are, however, some critical issues which have not been properly addressed in regards to the statistical inference of the directional dependence. For example, the previous use of asymmetric copulas failed to fully capture the dependence patterns between variables, and the method used for the parameter estimation was not optimal. In addition, no method was considered for selecting a suitable asymmetric copula or for computing the general measurements of the directional dependence when there are no closed-form expressions. In this paper, we propose a generalized multiple-step procedure for the full inference of the directional dependence in joint behaviour based on the asymmetric copula regression. The proposed procedure utilizes several novel methodologies that have not been considered in the literature of the analysis of directional dependence. The performance and advantages of the proposed procedure are illustrated using two real data examples, one from biological research on histone genes, and the other from developmental research on attention deficit hyperactivity disorder.     

Goodness of fit tests with interval censored data

Cramér–von Mises type goodness of fit tests for interval censored data case 2 are proposed based on a resampling method called the leveraged bootstrap, and their asymptotic consistency is shown. The proposed tests are computationally efficient, and in fact can be applied to other types of censored data, including right censored data, doubly censored data and (mixture of) case k interval censored data. Some simulation results and an example from AIDS research are presented.     

Two-phase regression and goodness of fit

Analysis of two-phase regression has traditionally been carried out using a variety of likelihood approaches. In this paper we present an alternative procedure based on a goodness of fit criterion.

Exact hypothesis tests for a known switch point are developed. Approximate (conservative) tests for an unknown switch point are also obtained     

Goodness-of-fit tests for parametric models in censored regression

The authors propose a goodness-of-fit test for parametric regression models when the response variable is right-censored. Their test compares an estimation of the error distribution based on parametric residuals to another estimation relying on nonparametric residuals. They call on a bootstrap mechanism in order to approximate the critical values of tests based on Kolmogorov-Smirnov and Cramér-von Mises type statistics. They also present the results of Monte Carlo simulations and use data from a study about quasars to illustrate their work.     

Goodness‐of‐Fit based on Downsampling with Applications to Linear Drift Diffusions

Abstract. A goodness‐of‐fit test for continuous‐time models is developed that examines if the parameter estimates are consistent with another for different sampling frequencies. The test compares parameter estimates obtained from estimating functions for downsamples of the data. We prove asymptotic results for stationary and ergodic processes, and apply the downsampling test to linear drift diffusions. Simulations indicate that the test is quite powerful in detecting non‐Markovian deviations from the linear drift diffusions.     

Interval-valued data regression using partial linear model

Semi-parametric modelling of interval-valued data is of great practical importance, as exampled by applications in economic and financial data analysis. We propose a flexible semi-parametric modelling of interval-valued data by integrating the partial linear regression model based on the Center & Range method, and investigate its estimation procedure. Furthermore, we introduce a test statistic that allows one to decide between a parametric linear model and a semi-parametric model, and approximate its null asymptotic distribution based on wild Bootstrap method to obtain the critical values. Extensive simulation studies are carried out to evaluate the performance of the proposed methodology and the new test. Moreover, several empirical data sets are analysed to document its practical applications.     

The exact risks of some pre-test and stein-type regression estimators umder balanced loss

In regression analysis we are often interested in using an estimator which is “precise” and which simultaneously provides a model with “good fit”, In this paper we consider the risk properties of several estimators of the regression coefficient vector "trader “balanced” loss, This loss function (Zellner, 1994) reflects both of the described attributes. Under a particular form of balanced loss, we derive the predictive risk of the pre-test estimator which results after a test for exact linear restrictions on the coefficient vector. The corresponding risks of Stein-rule and positive-part Stein-rale estimators are also established. The risks based on loss functions which allow only for estimation precision, or only for goodness of fit, are special cases of our results, and we draw appropriate comparisons, In particular, we show that some of the well-known results under (quadratic) precision-only loss are not robust to our generalization of the loss function     

Non‐parametric Regression Tests Using Dimension Reduction Techniques

Abstract. Testing for parametric structure is an important issue in non‐parametric regression analysis. A standard approach is to measure the distance between a parametric and a non‐parametric fit with a squared deviation measure. These tests inherit the curse of dimensionality from the non‐parametric estimator. This results in a loss of power in finite samples and against local alternatives. This article proposes to circumvent the curse of dimensionality by projecting the residuals under the null hypothesis onto the space of additive functions. To estimate this projection, the smooth backfitting estimator is used. The asymptotic behaviour of the test statistic is derived and the consistency of a wild bootstrap procedure is established. The finite sample properties are investigated in a simulation study.     

Testing for a change point in linear regression models

In this paper, the Schwarz Information Criterion (SIC) is proposed to locate a change point in the simple linear regression model, as well as in the multiple linear regression model. The method is then applied to a financial data set, and a change point is successfully detected.     

Asymptotic distribution of regression correlation coefficient for Poisson regression model

This study treats an asymptotic distribution for measures of predictive power for generalized linear models (GLMs). We focus on the regression correlation coefficient (RCC) that is one of the measures of predictive power. The RCC, proposed by Zheng and Agresti is a population value and a generalization of the population value for the coefficient of determination. Therefore, the RCC is easy to interpret and familiar. Recently, Takahashi and Kurosawa provided an explicit form of the RCC and proposed a new RCC estimator for a Poisson regression model. They also showed the validity of the new estimator compared with other estimators. This study discusses the new statistical properties of the RCC for the Poisson regression model. Furthermore, we show an asymptotic normality of the RCC estimator.     

A Copula‐Based Non‐parametric Measure of Regression Dependence

Abstract. This article presents a framework for comparing bivariate distributions according to their degree of regression dependence. We introduce the general concept of a regression dependence order (RDO). In addition, we define a new non‐parametric measure of regression dependence and study its properties. Besides being monotone in the new RDOs, the measure takes on its extreme values precisely at independence and almost sure functional dependence, respectively. A consistent non‐parametric estimator of the new measure is constructed and its asymptotic properties are investigated. Finally, the finite sample properties of the estimate are studied by means of a small simulation study.     

Corrected local polynomial estimation in varying‐coefficient models with measurement errors

The authors study a varying‐coefficient regression model in which some of the covariates are measured with additive errors. They find that the usual local linear estimator (LLE) of the coefficient functions is biased and that the usual correction for attenuation fails to work. They propose a corrected LLE and show that it is consistent and asymptotically normal, and they also construct a consistent estimator for the model error variance. They then extend the generalized likelihood technique to develop a goodness of fit test for the model. They evaluate these various procedures through simulation studies and use them to analyze data from the Framingham Heart Study.