Second-Order Covariance Matrix Formula for Heteroskedastic Generalized Linear Models

For the first time, we provide a matrix formula for second-order covariances of maximum likelihood estimates in heteroskedastic generalized linear models, thus generalizing the results of Cordeiro (2004 Cordeiro , G. M. ( 2004 ). Second-order covariance matrix of maximum likelihood estimates in generalized linear models . Statist. Probab. Lett. 66 : 153 – 160 .[Crossref], [Web of Science ®] , [Google Scholar]) and Cordeiro et al. (2006 Cordeiro , G. M. , Barroso , L. P. , Botter , D. A. (2006). Covariance matrix formula for generalized linear models with unknown dispersion. Commun. Statist. Theor. Meth. 35:113–120.[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]) related to the generalized linear models with known and unknown dispersion parameter, respectively. The covariance matrix formula does not involve cumulants of log-likelihood derivatives and can be easily obtained using simple matrix operations. We apply our main result to a simple model. Some simulations show that the second-order covariances can be quite pronounced in small to moderate samples. The usual covariances of the maximum likelihood estimates can be corrected by these second-order covariances.     

Covariance Matrix Formula for Exponential Family Nonlinear Models

This article gives a matrix formula for second-order covariances of maximum likelihood estimators in exponential family nonlinear models, thus generalizing the result of Cordeiro (2004 Cordeiro , G. M. ( 2004 ). Second-order covariance matrix of maximum likelihood estimates in generalized linear models . Statist. Probab. Lett. 66 : 153 – 160 .[Crossref], [Web of Science ®] , [Google Scholar]) valid for generalized linear models with known dispersion parameter. Some simulations show that the second-order covariances for exponential family nonlinear models can be quite pronounced in small to moderate sample sizes.     

Bias Correction in Generalized Nonlinear Models with Dispersion Covariates

We derive general formulae for the second-order biases of maximum likelihood estimates of the parameters in generalized nonlinear models with dispersion covariates. This result generalizes previous work by Botter and Cordeiro (1998 Botter , D. A. , Cordeiro , G. M. ( 1998 ). Improved estimates for generalized linear models with dispersion covariates . J. Statist. Comput. Simul. 62 : 91 – 104 .[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]) and Cordeiro and McCullagh (1991 Cordeiro , G. M. , McCullagh , P. ( 1991 ). Bias correction in generalized linear models . J. Roy Statist. Soc. B 53 : 629 – 643 . [Google Scholar]). The practical use of such bias corrections is illustrated in a simulation study.     

Asymptotic Skewness in Exponential Family Nonlinear Models

In this article, we give an asymptotic formula of order n ^?1/2, where n is the sample size, for the skewness of the distributions of the maximum likelihood estimates of the pa-ra-meters in exponencial family nonlinear models. We generalize the result by Cordeiro and Cordeiro (2001 Cordeiro , H. H. , Cordeiro , G. M. ( 2001 ). Skewness for parameters in generalized linear models . Commun. Statist. Theor. Meth. 30 : 1317 – 1334 .[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]). The formula is given in matrix notation and is very suitable for computer implementation and to obtain closed form expressions for a great variety of models. Some special cases and two applications are discussed.     

Bias-Corrected Maximum Likelihood Estimators in Nonlinear Heteroscedastic Models

Nonlinear heteroscedastic models are widely used in econometrics and statistical applications. We derive matrix formulae for the second-order biases of the maximum likelihood estimators of the parameters in the mean and variance response which generalize previous results by Cook et al. (1986 Cook , D. R. , Tsai , C. L. , Wei , B. C. ( 1986 ). Bias in nonlinear regression . Biometrika 73 : 615 – 623 .[Crossref], [Web of Science ®] , [Google Scholar]) and Cordeiro (1993 Cordeiro , G. M. ( 1993 ). Bartlett corrections and bias correction for two heteroscedastic regression models . Commun. Statist. Theor. Meth. 22 : 169 – 188 .[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]). The biases of the estimators are easily obtained as vectors of regression coefficients from suitable weighted linear regressions. The practical use of such biases is illustrated in a simulation study and in an application to a real data set.     

BARTLETT-TYPE CORRECTIONS FOR TWO-PARAMETER EXPONENTIAL FAMILY MODELS

ABSTRACT

Cordeiro and Ferrari[1] Cordeiro, G.M. and Ferrari, S.L.P. 1991. A Modified Score Test Statistic Having Chi-Squared Distribution to Order n^?1. Biometrika, 78: 573–582. [Web of Science ®] , [Google Scholar] obtained a Bartlett-type correction to the score statistic that is given by a polynomial of second degree in the statistic itself with coefficients that depend on cumulants of log–likelihood derivatives. Although the corrected statistic has good size properties, it is not always a monotone transformation of the original statistic. Recently, some monotone transformations of the score statistic have been proposed as alternatives to the polynomial transformation. In this paper we derive simple formulae for various modified score statistics for testing a scalar parameter in two-parameter exponential models which do not require knowledge of cumulants. The formulae are readily applicable to cover many important and commonly used distributions and involve only trivial operations on certain functions and their derivatives.     

SECOND-ORDER ASYMPTOTICS FOR SCORE TESTS IN HETEROSKEDASTIC t REGRESSION MODELS

ABSTRACT

This paper develops corrected score tests for heteroskedastic t regression models, thus generalizing results by Cordeiro, Ferrari and Paula[1] Cordeiro, G.M., Ferrari, S.L.P. and Paula, G.A. 1993. Improved Score Tests for Generalized Linear Models. Journal of the Royal Statistical Society B, 55: 661–674.  [Google Scholar] and Cribari-Neto and Ferrari[2] Cribari-Neto, F. and Ferrari, S.L.P. 1995. Second-order Asymptotics for Score Tests in Generalised Linear Models. Biometrika, 82: 426–432. [Crossref], [Web of Science ®] , [Google Scholar] for normal regression models and by Ferrari and Arellano-Valle[3] Ferrari, S.L.P. and Arellano-Valle, R. 1996. Modified Likelihood Ratio and Score Tests in Linear Regression Models Using the t Distribution. Brazilian Journal of Probability and Statistics, 10: 15–33.  [Google Scholar] for homoskedastic t regression models. We present, in matrix notation, Bartlett-type correction formulae to improve score tests in this class of models. The corrected score statistics have a chi-squared distribution to order n ^?1, where n is the sample size. We apply our main result to a few special models and present simulation results comparing the performance of the usual score tests and their corrected versions.     

The Identification of Potential Longitudinal Biomarkers and Measurements of Effectiveness for Biomarkers as Surrogates in Multivariate Survival Data

A proposed method based on frailty models is used to identify longitudinal biomarkers or surrogates for a multivariate survival. This method is an extention of earlier models by Wulfsohn and Tsiatis (1997 Wulfsohn , M. S. , Tsiatis , A. A. ( 1997 ). A joint model for survival and longitudinal data measured with error . Biometrics 53 ( 1 ): 330 – 339 .[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]) and Song et al. (2002 Song , X. , Davidian , M. , Tsiatis , A. A. ( 2002 ). A Semiparametric likelihood approach to joint modeling of longitudinal and time-to-event data . Biometrics 58 ( 4 ): 742 – 753 .[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]). In this article, similar to Henderson et al. (2002 Henderson , R. , Diggle , P. J. , Dobson , A. ( 2002 ). Identification and efficacy of longitudinal markers for survival . Biostatistics 3 ( 1 ): 33 – 50 .[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]), a joint likelihood function combines the likelihood functions of the longitudinal biomarkers and the multivariate survival times. We use simulations to explore how the number of individuals, the number of time points per individual and the functional form of the random effects from the longitudianl biomarkers influence the power to detect the association of a longitudinal biomarker and the multivariate survival time. The proposed method is illustrate by using the gastric cancer data.     

A Class of Improved Heteroskedasticity-Consistent Covariance Matrix Estimators

Abstract

The heteroskedasticity-consistent covariance matrix estimator proposed by White [White, H. A. (1980 White, H. A. 1980. Heteroskedasticity-consistent covariance matrix estimator and a direct test for heteroskedasticity. Econometrica, 48: 817–838. [Crossref], [Web of Science ®] , [Google Scholar]). Heteroskedasticity-consistent covariance matrix estimator and a direct test for heteroskedasticity. Econometrica 48:817–838], also known as HC0, is commonly used in practical applications and is implemented into a number of statistical software. Cribari–Neto et al. [Cribari–Neto, F., Ferrari, S. L. P., Cordeiro, G. M. (2000 Cribari–Neto, F., Ferrari, S. L. P. and Cordeiro, G. M. 2000. Improved heteroscedasticity–consistent covariance matrix estimators. Biometrika, 87: 907–918. [Crossref], [Web of Science ®] , [Google Scholar]). Improved heteroscedasticity–consistent covariance matrix estimators. Biometrika 87:907–918] have developed a bias-adjustment scheme that delivers bias-corrected White estimators. There are several variants of the original White estimator that are also commonly used by practitioners. These include the HC1, HC2, and HC3 estimators, which have proven to have superior small-sample behavior relative to White's estimator. This paper defines a general bias-correction mechamism that can be applied not only to White's estimator, but to variants of this estimator as well, such as HC1, HC2, and HC3. Numerical evidence on the usefulness of the proposed corrections is also presented. Overall, the results favor the sequence of improved HC2 estimators.     

Empirical Likelihood Ratio for Linear Transformation Models with Doubly Censored Data

Double censoring arises when T represents an outcome variable that can only be accurately measured within a certain range, [L, U], where L and U are the left- and right-censoring variables, respectively. When L is always observed, we consider the empirical likelihood inference for linear transformation models, based on the martingale-type estimating equation proposed by Chen et al. (2002 Chen , K. , Jin , Z. , Ying , Z. ( 2002 ). Semiparametric analysis of transformation models with censored data . Biometrika 89 : 659 – 668 .[Crossref], [Web of Science ®] , [Google Scholar]). It is demonstrated that both the approach of Lu and Liang (2006 Lu , W. , Liang , Y. ( 2006 ). Empirical likelihood inference for linear transformation models . Journal of Multivariate Analysis 97 : 1586 – 1599 .[Crossref], [Web of Science ®] , [Google Scholar]) and that of Yu et al. (2011 Yu , W. , Sun , Y. , Zheng , M. ( 2011 ). Empirical likelihood method for linear transformation models . Annals of the Institute of Statistical Mathematics 63 : 331 – 346 .[Crossref], [Web of Science ®] , [Google Scholar]) can be extended to doubly censored data. Simulation studies are conducted to investigate the performance of the empirical likelihood ratio methods.     

On Maximum Likelihood Estimation for the Two Parameter Burr XII Distribution

This article considers three related aspects of maximum likelihood estimation of parameters in the two-parameter Burr XII distribution. Specifically, we first provide further clarification to some limiting results in Wingo (1993 Wingo , D. R. ( 1993 ). Maximum likelihood estimation of Burr XII distribution parameters under Type II censoring . Microelectron. Reliab. 33 : 1251 – 1257 .[Crossref], [Web of Science ®] , [Google Scholar]). We then focus on details in a proof of the uniqueness of the maximum likelihood estimators. Finally, we consider using the likelihood approach for data which does not satisfy Wingo's criterion, and show that this results in fitting either a Pareto distribution or an intuitively sensible degenerate distribution to the data. The discussion here is completely general, and not restricted to data obtained under Type II censoring.     

Bayesian Capture-Recapture Analysis: An Application in Modeling Semelparity of a Neotropical Didelphid Marsupial

We develop a series of Bayesian statistical models for estimating survival of a neotropic didelphid marsupial, the Brazilian gracile mouse opossum (Gracilinanus microtarsus). These models are based on the Cormack–Jolly–Seber model (Cormack, 1964 Cormack , R. M. ( 1964 ). Estimates of survival from the sighting of marked animals . Biometrika 51 : 429 – 438 .[Crossref], [Web of Science ®] , [Google Scholar]; Jolly 1965 Jolly , G. M. ( 1965 ). Explicit estimates from capture-recapture data with both death and immigration stochastic model . Biometrika 52 : 225 – 247 .[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]; Seber 1965 Seber , G. A. F. ( 1965 ). A note on the multiple recapture census . Biometrika 52 : 249 – 259 .[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]) with both survival and recapture rates expressed as a function of covariates using a logit link. The proposed models allow taking into account heterogeneity in capture probability caused by the existence of different groups of individuals in the population. The models were applied to two cohorts (Cohort, 2000, 2001) with the first one including 14 and the second one 15 sampling occasions. The best models for each of the cohorts indicate that G. microtarsus is best described as partially semelparous, a condition in which mortality after the first mating is high but graded over time, with a fraction of males surviving for a second breeding season (Boonstra, 2005 Boonstra , R. ( 2005 ). Equipped for life: the adaptive role of the stress axis in male mammals . Journal of Mammalogy 86 : 236 – 247 .[Crossref], [Web of Science ®] , [Google Scholar]).     

Relations for Moments of Progressively Type-II Censored Order Statistics from Log-Logistic Distribution with Applications to Inference

In this article, we establish several recurrence relations for the single and product moments of progressively Type-II right censored order statistics from a log-logistic distribution. The use of these relations in a systematic recursive manner would enable the computation of all the means, variances and covariances of progressively Type-II right censored order statistics from the log-logistic distribution for all sample sizes n, effective sample sizes m, and all progressive censoring schemes (R ₁,…, R _m ). The results established here generalize the corresponding results for the usual order statistics due to Balakrishnan and Malik (1987 Balakrishnan , N. , Malik , H. J. ( 1987 ). Moments of order statistics from truncated log-logistic distribution . J. Statist. Plann. Infer. 17 : 251 – 267 .[Crossref], [Web of Science ®] , [Google Scholar]) and Balakrishnan et al. (1987 Balakrishnan , N. , Malik , H. J. , Puthenpura , S. ( 1987 ). Best linear unbiased estimation of location and scale parameters of the log-logistic distribution . Commun. Statist. Theor. Meth. 16 : 3477 – 3495 .[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]). The moments so determined are then utilized to derive best linear unbiased estimators for the scale- and location-scale log-logistic distributions. A comparison of these estimates with the maximum likelihood estimates is made through Monte Carlo simulation. The best linear unbiased predictors of progressively censored failure times is then discussed briefly. Finally, a numerical example is presented to illustrate all the methods of inference developed here.     

A Broad Class of Partially Specified Autoregressions on Multi-Casting Data

Extending the bifurcating autoregressive (BAR) process (cf. Cowan and Staudte, 1986 Cowan , R. , Staudte , R. G. ( 1986 ). The bifurcating autoregression model in cell lineage studies . Biometrics 42 : 769 – 783 .[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]) to multi-casting (multi-splitting) data, Hwang and Choi (2009 Hwang , S. Y. , Choi , M. S. ( 2009 ). Modeling and large sample estimation for multi-casting autoregression . Statist. Prob. Lett. 79 : 1943 – 1950 .[Crossref], [Web of Science ®] , [Google Scholar]) introduced multi-casting autoregression (MCAR, for short) defined on multi-casting tree structured data. This article is concerned with the case when the MCAR model is partially specified only through conditional mean and variance without directly imposing autoregressive (AR) structure. The resulting class of models will be referred to as P-MCAR (partially specified MCAR). The P-MCAR considerably enlarges the class of multi-casting models including (as special cases) MCAR, random coefficient MCAR, conditionally heteroscedastic multi-casting models and binomial-thinning processes. Moment structures for this broad P-MCAR class are investigated. Least squares (LS) estimation method is discussed and asymptotic relative efficiency (ARE) of the generalized-LS over ordinary-LS is obtained in a closed form. A simulation study is conducted to illustrate results.     

On Testing Sample Selection Bias Under the Multicollinearity Problem

ABSTRACT

This paper reviews and extends the literature on the finite sample behavior of tests for sample selection bias. Monte Carlo results show that, when the “multicollinearity problem” identified by Nawata (1993 Nawata , K. ( 1993 ). A note on the estimation of models with sample-selection biases . Economics Letters 42 : 15 – 24 . [CSA] [CROSSREF] [Crossref], [Web of Science ®] , [Google Scholar]) is severe, (i) the t-test based on the Heckman–Greene variance estimator can be unreliable, (ii) the Likelihood Ratio test remains powerful, and (iii) nonnormality can be interpreted as severe sample selection bias by Maximum Likelihood methods, leading to negative Wald statistics. We also confirm previous findings (Leung and Yu, 1996 Leung , S. F. , Yu , S. ( 1996 ). On the choice between sample selection and two-part models . Journal of Econometrics 72 : 197 – 229 . [CSA] [CROSSREF] [Crossref], [Web of Science ®] , [Google Scholar]) that the standard regression-based t-test (Heckman, 1979 Heckman , J. J. ( 1979 ). Sample selection bias as a specification error . Econometrica 47 : 153 – 161 . [CSA] [Crossref], [Web of Science ®] , [Google Scholar]) and the asymptotically efficient Lagrange Multiplier test (Melino, 1982 Melino , A. ( 1982 ). Testing for sample selection bias . Review of Economic Studies 49 : 151 – 153 . [CSA] [Crossref], [Web of Science ®] , [Google Scholar]), are robust to nonnormality but have very little power.     

An Asymmetric Kernel Estimator of Density Function for Stationary Associated Sequences

Here, we apply the smoothing technique proposed by Chaubey et al. (2007 Chaubey , Y. P. , Sen , A. , Sen , P. K. ( 2007 ). A new smooth density estimator for non-negative random variables. Technical Report No. 1/07. Department of Mathematics and Statistics, Concordia University, Montreal, Canada . [Google Scholar]) for the empirical survival function studied in Bagai and Prakasa Rao (1991 Bagai , I. , Prakasa Rao , B. L. S. ( 1991 ). Estimation of the survival function for stationary associated processes . Statist. Probab. Lett. 12 : 385 – 391 .[Crossref], [Web of Science ®] , [Google Scholar]) for a sequence of stationary non-negative associated random variables.The derivative of this estimator in turn is used to propose a nonparametric density estimator. The asymptotic properties of the resulting estimators are studied and contrasted with some other competing estimators. A simulation study is carried out comparing the recent estimator based on the Poisson weights (Chaubey et al., 2011 Chaubey , Y. P. , Dewan , I. , Li , J. ( 2011 ). Smooth estimation of survival and density functions for a stationary associated process using poisson weights . Statist. Probab. Lett. 81 : 267 – 276 .[Crossref], [Web of Science ®] , [Google Scholar]) showing that the two estimators have comparable finite sample global as well as local behavior.     

Improved Bar-Lev,Bobovitch, and Boukai Randomized Response Models

In this article, two new improved randomized response models have been proposed. The proposed models are found to be more efficient than the recent randomized response model studied by Bar-Lev et al. (2004 Bar-Lev , S. K. , Bobovitch , E. , Boukai , B. ( 2004 ). A note on randomized response models for quantitative data . Metrika 60 : 255 – 260 .[Crossref], [Web of Science ®] , [Google Scholar]). The relative efficiency of the proposed models has been studied with respect to the Bar-Lev et al. (2004 Bar-Lev , S. K. , Bobovitch , E. , Boukai , B. ( 2004 ). A note on randomized response models for quantitative data . Metrika 60 : 255 – 260 .[Crossref], [Web of Science ®] , [Google Scholar]) model under different situations.     

Nonnested Testing for Competing Autoregressive Dynamic Models Estimated by Instrumental Variables

In this work we investigate nonnested tests for two competing univariate dynamic linear models with autoregressive disturbances, where the motivation for instrumental variable estimation is mainly due to the recognized presence of current endogenous variables in the regression function, either in one or both models. As the previous transformation of both models yields regression functions which are nonlinear in the parameters, the attractive Gauss-Newton regression (GNR) approach, firstly advocated by Davidson and Mackinnon (1981 Davidson , R. , Mackinnon , J. G. ( 1981 ). Several tests for model specification in the presence of alternative hypotheses . Econometrica 49 : 781 – 93 .[Crossref], [Web of Science ®] , [Google Scholar]), will be used to obtain the results.     

Likelihood Ratio Order of m-Spacings in Multiple-Outlier Models

This article deals with the multiple-outlier exponential model. The likelihood ratio order between m-spacings of the combined sample is developed, some results extend the conclusions on simple spacings in Wen et al. (2007 Wen , S. , Lu , Q. , Hu , T. ( 2007 ). Likelihood ratio order of spacings of heterogeneous exponential random variables . J. Multivariate Anal. 98 : 743 – 756 .[Crossref], [Web of Science ®] , [Google Scholar]).     

A Comparison of Procedures for Controlling the False Discovery Rate in the Presence of Small Variance Genes: A Simulation Study

The Significance Analysis of Microarrays (SAM; Tusher et al., 2001 Tusher , V. G. , Tibshirani , R. , Chu , G. ( 2001 ). Significance analysis of microarrys applied to the ionizing radiation response . Proceedings of the National Academy of Sciences 98 : 5116 – 5121 .[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]) method is widely used in analyzing gene expression data while controlling the FDR by using resampling-based procedure in the microarray setting. One of the main components of the SAM procedure is the adjustment of the test statistic. The introduction of the fudge factor to the test statistic aims at deflating the large value of test statistics due to the small standard error of gene-expression. Lin et al. (2008 Lin , D. , Shkedy , Z. , Burzykowski , T. , Göhlmann , H. W. H. , De Bondt , A. , Perera , T. , Geerts , T. , Bijnens , L. ( 2008 ). Significance analysis of microarray (SAM) for comparisons of several treatments with one control . Biometric Journal, MCP 50 ( 5 ): 801 – 823 .[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]) pointed out that the fudge factor does not effectively improve the power and the control of the FDR as compared to the SAM procedure without the fudge factor in the presence of small variance genes. Motivated by the simulation results presented in Lin et al. (2008 Lin , D. , Shkedy , Z. , Burzykowski , T. , Göhlmann , H. W. H. , De Bondt , A. , Perera , T. , Geerts , T. , Bijnens , L. ( 2008 ). Significance analysis of microarray (SAM) for comparisons of several treatments with one control . Biometric Journal, MCP 50 ( 5 ): 801 – 823 .[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]), in this article, we extend our study to compare several methods for choosing the fudge factor in the modified t-type test statistics and use simulation studies to investigate the power and the control of the FDR of the considered methods.