Maximin clusters for nonreplicated multiresponse lack of fit tests

Khuri (Technometrics 27 (1985) 213) and Levy and Neill (Comm. Statist. A 19 (1990) 1987) presented regression lack of fit tests for multiresponse data with replicated observations available at points in the experimental region, thereby extending the classical univariate lack of fit test given by Fisher (J. Roy. Statist. Soc. 85 (1922) 597). In this paper, multivariate tests for lack of fit in a linear multiresponse model are derived for the common circumstance in which replicated observations are not obtained. The tests are based on the union–intersection principle, and provide multiresponse extensions of the univariate tests for between- and within-cluster lack of fit introduced by Christensen (Ann. of Statist. 17 (1989) 673; J. Amer. Statist. Assoc. 86 (1991) 752). Since the properties of these tests depend on the choice of multivariate clusters of the observations, a multiresponse generalization of the maximin power clustering criterion given by Miller, Neill and Sherfey (Ann. of Statist. 26 (1998) 1411; J. Amer. Statist. Assoc. 94 (1999) 610) is also developed.     

Likelihood ratio tests for variance components in linear mixed models

Although the asymptotic distributions of the likelihood ratio for testing hypotheses of null variance components in linear mixed models derived by Stram and Lee [1994. Variance components testing in longitudinal mixed effects model. Biometrics 50, 1171–1177] are valid, their proof is based on the work of Self and Liang [1987. Asymptotic properties of maximum likelihood estimators and likelihood tests under nonstandard conditions. J. Amer. Statist. Assoc. 82, 605–610] which requires identically distributed random variables, an assumption not always valid in longitudinal data problems. We use the less restrictive results of Vu and Zhou [1997. Generalization of likelihood ratio tests under nonstandard conditions. Ann. Statist. 25, 897–916] to prove that the proposed mixture of chi-squared distributions is the actual asymptotic distribution of such likelihood ratios used as test statistics for null variance components in models with one or two random effects. We also consider a limited simulation study to evaluate the appropriateness of the asymptotic distribution of such likelihood ratios in moderately sized samples.     

Generalized Self-Consistency: Multinomial logit model and Poisson likelihood

A generalized self-consistency approach to maximum likelihood estimation (MLE) and model building was developed in Tsodikov [2003. Semiparametric models: a generalized self-consistency approach. J. Roy. Statist. Soc. Ser. B Statist. Methodology 65(3), 759–774] and applied to a survival analysis problem. We extend the framework to obtain second-order results such as information matrix and properties of the variance. Multinomial model motivates the paper and is used throughout as an example. Computational challenges with the multinomial likelihood motivated Baker [1994. The Multinomial–Poisson transformation. The Statist. 43, 495–504] to develop the Multinomial–Poisson (MP) transformation for a large variety of regression models with multinomial likelihood kernel. Multinomial regression is transformed into a Poisson regression at the cost of augmenting model parameters and restricting the problem to discrete covariates. Imposing normalization restrictions by means of Lagrange multipliers [Lang, J., 1996. On the comparison of multinomial and Poisson log-linear models. J. Roy. Statist. Soc. Ser. B Statist. Methodology 58, 253–266] justifies the approach. Using the self-consistency framework we develop an alternative solution to multinomial model fitting that does not require augmenting parameters while allowing for a Poisson likelihood and arbitrary covariate structures. Normalization restrictions are imposed by averaging over artificial “missing data” (fake mixture). Lack of probabilistic interpretation at the “complete-data” level makes the use of the generalized self-consistency machinery essential.     

Adaptive bootstrap tests and its competitors in the c-sample scale problem

This paper deals with a study of different types of tests for the two-sided c-sample scale problem. We consider the classical parametric test of Bartlett [M.S. Bartlett, Properties of sufficiency and statistical tests, Proc. R. Stat. Soc. Ser. A. 160 (1937), pp. 268–282] several nonparametric tests, especially the test of Fligner and Killeen [M.A. Fligner and T.J. Killeen, Distribution-free two-sample tests for scale, J. Amer. Statist. Assoc. 71 (1976), pp. 210–213], the test of Levene [H. Levene, Robust tests for equality of variances, in Contribution to Probability and Statistics, I. Olkin, ed., Stanford University Press, Palo Alto, 1960, pp. 278–292] and a robust version of it introduced by Brown and Forsythe [M.B. Brown and A.B. Forsythe, Robust tests for the equality of variances, J. Amer. Statist. Assoc. 69 (1974), pp. 364–367] as well as two adaptive tests proposed by Büning [H. Büning, Adaptive tests for the c-sample location problem – the case of two-sided alternatives, Comm. Statist.Theory Methods. 25 (1996), pp. 1569–1582] and Büning [H. Büning, An adaptive test for the two sample scale problem, Nr. 2003/10, Diskussionsbeiträge des Fachbereich Wirtschaftswissenschaft der Freien Universität Berlin, Volkswirtschaftliche Reihe, 2003]. which are based on the principle of Hogg [R.V. Hogg, Adaptive robust procedures. A partial review and some suggestions for future applications and theory, J. Amer. Statist. Assoc. 69 (1974), pp. 909–927]. For all the tests we use Bootstrap sampling strategies, too. We compare via Monte Carlo Methods all the tests by investigating level α and power β of the tests for distributions with different strength of tailweight and skewness and for various sample sizes. It turns out that the test of Fligner and Killeen in combination with the bootstrap is the best one among all tests considered.     

Seemingly unrelated reduced-rank regression model

Reduced-rank regression models proposed by Anderson [1951. Estimating linear restrictions on regression coefficients for multivariate normal distributions. Ann. Math. Statist. 22, 327–351] have been used in various applications in social and natural sciences. In this paper we combine the features of these models with another popular, seemingly unrelated regression model proposed by Zellner [1962. An efficient method of estimating seemingly unrelated regressions and tests for aggregation bias. J. Amer. Statist. Assoc. 57, 348–368]. In addition to estimation and inference aspects of the new model, we also discuss an application in the area of marketing.     

Transformations for Testing the Fit of the Inverse-Gaussian Distribution

Abstract

Use of the MVUE for the inverse-Gaussian distribution has been recently proposed by Nguyen and Dinh [Nguyen, T. T., Dinh, K. T. (2003). Exact EDF goodnes-of-fit tests for inverse Gaussian distributions. Comm. Statist. (Simulation and Computation) 32(2):505–516] where a sequential application based on Rosenblatt's transformation [Rosenblatt, M. (1952). Remarks on a multivariate transformation. Ann. Math. Statist. 23:470–472] led the authors to solve the composite goodness-of-fit problem by solving the surrogate simple goodness-of-fit problem, of testing uniformity of the independent transformed variables. In this note, we observe first that the proposal is not new since it was proposed in a rather general setting in O'Reilly and Quesenberry [O'Reilly, F., Quesenberry, C. P. (1973). The conditional probability integral transformation and applications to obtain composite chi-square goodness-of-fit tests. Ann. Statist. I:74–83]. It is shown on the other hand that the results in the paper of Nguyen and Dinh (2003) are incorrect in their Sec. 4, specially the Monte Carlo figures reported. Power simulations are provided here comparing these corrected results with two previously reported goodness-of-fit tests for the inverse-Gaussian; the modified Kolmogorov–Smirnov test in Edgeman et al. [Edgeman, R. L., Scott, R. C., Pavur, R. J. (1988). A modified Kolmogorov-Smirnov test for inverse Gaussian distribution with unknown parameters. Comm. Statist. 17(B): 1203–1212] and the A ² based method in O'Reilly and Rueda [O'Reilly, F., Rueda, R. (1992). Goodness of fit for the inverse Gaussian distribution. T Can. J. Statist. 20(4):387–397]. The results show clearly that there is a large loss of power in the method explored in Nguyen and Dinh (2003) due to an implicit exogenous randomization.     

Intermediate efficiency of some max-type statistics

Asymptotic comparison of two recent tests for constant regression via intermediate efficiency approach is developed here. The following work shows that the constructions proposed by Eubank and Hart (Ann. Statist. 20 (1992) 1412) and Fan and Huang (J. Amer. Statist. Assoc. 96 (2001) 640) are efficient for one type of deviation only, which is the same for both tests. It is also inferred that, for other directions, the second solution outperforms the first one.The approach elaborated in this paper also allows one to calculate the intermediate efficiency of the classic Kolmogorov–Smirnov test, thus supplementing several earlier developments on this statistic.     

Lack of fit tests based on sums of ordered residuals for linear models

Christensen & Lin ( 2015 ) suggested two lack of fit tests to assess the adequacy of a linear model based on partial sums of residuals. In particular, their tests evaluated the adequacy of the mean function. Their tests relied on asymptotic results without requiring small sample normality. We propose four new tests, find their asymptotic distributions, and propose an alternative simulation method for defining tests that is remarkably robust to the distribution of the errors. To assess their strengths and weaknesses, the Christensen & Lin ( 2015 ) tests and the new tests were compared in different scenarios by simulation. In particular, the new tests include two based on partial sums of absolute residuals. Previous partial sums of residuals tests have used signed residuals whose values when summed can cancel each other out. The use of absolute residuals requires small sample normality, but allows detection of lack of fit that was previously not possible with partial sums of residuals.     

Smoothing spline based tests for non-linearity in a partially linear model

This paper deals with testing for non-linearity in a regression model with one possibly non-linear component being estimated non-parametrically using smoothing splines. We propose two new variance–covariance based tests for detecting non-linearity applying a likelihood ratio hypothesis testing approach. The first test is for the inclusion of a possibly non-linear component and the second one is for linearity of a possibly non-linear component. The tests are based on a stochastic model in state space form given by Wahba (J. Roy. Statist. Soc. Ser. B 40 (1978) 364), Wecker and Ansley (J. Amer. Statist. Assoc. 78 (1983) 81) and de Jong and Mazzi (Modeling and smoothing unequally spaced sequence data, University of York and University of British Columbia, Unpublished paper) for which smoothing splines provide an optimal estimate. Pitrun (A smoothing spline approach to non-linear interface for time series, Department of Econometrics and Business Statistics, Monash University, Unpublished Ph.D. thesis) derived the variance–covariance structure of this model, which allows the use of a marginal likelihood approach. This leads naturally to marginal-likelihood based likelihood ratio tests for non-linearity. Small sample properties of the new tests have been investigated via Monte Carlo studies.     

Residual-based CUSUM of squares test for Poisson integer-valued GARCH models

This study considers the problem of testing for a parameter change in integer-valued time series models in which the conditional density of current observations is assumed to follow a Poisson distribution. As a test, we consider the CUSUM of the squares test based on the residuals from INGARCH models and find that the test converges weakly to the supremum of a Brownian bridge. A simulation study demonstrates its superiority to the residual and standardized residual-based CUSUM tests of Kang and Lee [Parameter change test for Poisson autoregressive models. Scand J Statist. 2014;41:1136–1152] and Lee and Lee [CUSUM tests for general nonlinear inter-valued GARCH models: comparison study. Ann Inst Stat Math. 2019;71:1033–1057.] as well as the CUSUM of squares test based on standardized residuals.     

Bounds on posterior expectations for density bounded class with constant bandwidth

We consider a certain (simplified) version of the density bounded class; see Lavine (J. Amer. Statist. Assoc. 86 (1991) 400–403). We find that this class has certain advantages over many other similar classes in terms of elicitation, ease of calculation and other characteristics of interest. Bounds on posterior expectations are considered. In particular, we show how certain bounds may be found in the (multidimensional) normal linear model problem.     

Nonadditivity in loglinear models using φ-divergences and MLEs

In this paper three families of test statistics for testing nonadditivity in loglinear models are presented under the assumption of either Poisson, multinomial, or product-multinomial sampling. These new families are based on the φ-divergence measures. The standard method for testing nonadditivity is used, i.e., the two-stage tests procedure. In this procedure the parameters are first estimated using an additive model and then the estimates are treated as known constants for the second stage of the procedure. These test statistics, which are asymptotically chi-squared, generalize the likelihood ratio test for this problem given by Christensen and Utts (J. Statist. Plann. Inference 33 (1992) 333). An example and a simulation study are included.     

A monte carlo comparison of regression trimmed means

Two proposals are made for constructing adaptive estimators of the parameters in a linear regression model. These estimators are based on regression trimmed means and use an idea of Jaeckel [(1971) Ann Math Statist 42, 1540-1552] and the bootstrap respectively. These adaptive trimmed means as well as some nonadaptive trimmed means are studied by Monte Carlo. A one-step biweight is also included for comparison purposes.     

Testing for coefficient stability of AR(1) model when the null is an integrated or a stationary process

In this paper, we propose a new test for coefficient stability of an AR(1) model against the random coefficient autoregressive model of order 1 neither assuming a stationary nor a non-stationary process under the null hypothesis of a constant coefficient. The proposed test is obtained as a modification of the locally best invariant (LBI) test by Lee [(1998). Coefficient constancy test in a random coefficient autoregressive model. J. Statist. Plann. Inference 74, 93–101]. We examine finite sample properties of the proposed test by Monte Carlo experiments comparing with other existing tests, in particular, the LBI test by McCabe and Tremayne [(1995). Testing a time series for difference stationary. Ann. Statist. 23 (3), 1015–1028], which is for the null of a unit root process against the alternative of a stochastic unit root process.     

Evaluation of three lack of fit tests in linear regression models

A key diagnostic in the analysis of linear regression models is whether the fitted model is appropriate for the observed data. The classical lack of fit test is used for testing the adequacy of a linear regression model when replicates are available. While many efforts have been made in finding alternative lack of fit tests for models without replicates, this paper focuses on studying the efficacy of three tests: the classical lack of fit test, Utts' (1982) test, Burn & Ryan's (1983) test. The powers of these tests are computed for a variety of situations. Comments and conclusions on the overall performance of these tests are made, including recommendations for future studies.     

Data-driven smooth tests for the extreme value distribution

In this paper we present data-driven smooth tests for the extreme value distribution. These tests are based on a general idea of construction of data-driven smooth tests for composite hypotheses introduced by Inglot, T., Kallenberg, W. C. M. and Ledwina, T. [(1997). Data-driven smooth tests for composite hypotheses. Ann. Statist., 25, 1222–1250] and its modification for location-scale family proposed in Janic-Wróblewska, A. [(2004). Data-driven smooth test for a location-scale family. Statistics, in press]. Results of power simulations show that the newly introduced test performs very well for a wide range of alternatives and is competitive with other commonly used tests for the extreme value distribution.     

Asymptotic linearity of serial and nonserial multivariate signed rank statistics

Asymptotic linearity plays a key role in estimation and testing in the presence of nuisance parameters. This property is established, in the very general context of a multivariate general linear model with elliptical VARMA errors, for the serial and nonserial multivariate rank statistics considered in Hallin and Paindaveine (Ann. Statist. 30 (2002a) 1103; Bernoulli 8 (2002b) 787 Ann. Statist. 32 (2004), to appear) and Oja and Paindaveine (J. Statist. Plann. Inference (2004), to appear). These statistics, which are multivariate versions of classical signed rank statistics, involve (i) multivariate signs based either on (pseudo-)Mahalanobis residuals, or on a modified version (absolute interdirections) of Randles's interdirections, and (ii) a concept of ranks based either on (pseudo-)Mahalanobis distances or on lift-interdirections.     

Exact distribution of the MLEs of the parameters and of the quantiles of two-parameter exponential distribution under hybrid censoring

Epstein [Truncated life tests in the exponential case, Ann. Math. Statist. 25 (1954), pp. 555–564] introduced a hybrid censoring scheme (called Type-I hybrid censoring) and Chen and Bhattacharyya [Exact confidence bounds for an exponential parameter under hybrid censoring, Comm. Statist. Theory Methods 17 (1988), pp. 1857–1870] derived the exact distribution of the maximum-likelihood estimator (MLE) of the mean of a scaled exponential distribution based on a Type-I hybrid censored sample. Childs et al. [Exact likelihood inference based on Type-I and Type-II hybrid censored samples from the exponential distribution, Ann. Inst. Statist. Math. 55 (2003), pp. 319–330] provided an alternate simpler expression for this distribution, and also developed analogous results for another hybrid censoring scheme (called Type-II hybrid censoring). The purpose of this paper is to derive the exact bivariate distribution of the MLE of the parameter vector of a two-parameter exponential model based on hybrid censored samples. The marginal distributions are derived and exact confidence bounds for the parameters are obtained. The results are also used to derive the exact distribution of the MLE of the pth quantile, as well as the corresponding confidence bounds. These exact confidence intervals are then compared with parametric bootstrap confidence intervals in terms of coverage probabilities. Finally, we present some numerical examples to illustrate the methods of inference developed here.     

A stratified Warner''s randomized response model

This paper proposes a new stratified randomized response model based on Warner's (J. Amer. Statist. Assoc. 60 (1965) 63) model that has an optimal allocation and large gain in precision. It also presents a drawback of the Hong et al. (Korean J. Appl. Statist. 7 (1994) 141) model under their proportional sampling assumption. It is shown that the proposed model is more efficient than the Hong et al. (Korean J. Appl. Statist. 7 (1994) 141) stratified randomized response model. Additionally, it is shown that the estimator based on the proposed method is more efficient than the Warner (J. Amer. Statist. Assoc. 60 (1965) 63), the Mangat and Singh (Biometrika 77 (1990) 439) and the Mangat (J. Roy. Statist. SQC. Ser. B 56 (1) (1994) 93) estimators under the conditions presented in both the case of completely truthful reporting and that of not completely truthful reporting by the respondents.     

Central limit theorem for the empirical process of a linear sequence with long memory

We discuss the functional central limit theorem (FCLT) for the empirical process of a moving-average stationary sequence with long memory. The cases of one-sided and double-sided moving averages are discussed. In the case of one-sided (causal) moving average, the FCLT is obtained under weak conditions of smoothness of the distribution and the existence of (2+δ)-moment of i.i.d. innovations, by using the martingale difference decomposition due to Ho and Hsing (1996, Ann. Statist. 24, 992–1014). In the case of double-sided moving average, the proof of the FCLT is based on an asymptotic expansion of the bivariate probability density.