Skewness of maximum likelihood estimators in dispersion models

We introduce the dispersion models with a regression structure to extend the generalized linear models, the exponential family nonlinear models (Cordeiro and Paula, 1989) and the proper dispersion models (Jørgensen, 1997a). We provide a matrix expression for the skewness of the maximum likelihood estimators of the regression parameters in dispersion models. The formula is suitable for computer implementation and can be applied for several important submodels discussed in the literature. Expressions for the skewness of the maximum likelihood estimators of the precision and dispersion parameters are also derived. In particular, our results extend previous formulas obtained by Cordeiro and Cordeiro (2001) and Cavalcanti et al. (2009). A simulation study is performed to show the practice importance of our results.     

Inverse probability weighted estimators for single-index models with missing covariates

Abstract

In this article, we consider the inverse probability weighted estimators for a single-index model with missing covariates when the selection probabilities are known or unknown. It is shown that the estimator for the index parameter by using estimated selection probabilities has a smaller asymptotic variance than that with true selection probabilities, thus is more efficient. Therefore, the important Horvitz-Thompson property is verified for the index parameter in single index model. However, this difference disappears for the estimators of the link function. Some numerical examples and a real data application are also conducted to illustrate the performances of the estimators.     

Inverse probability of censoring weighting for visual predictive checks of time-to-event models with time-varying covariates

When constructing models to summarize clinical data to be used for simulations, it is good practice to evaluate the models for their capacity to reproduce the data. This can be done by means of Visual Predictive Checks (VPC), which consist of several reproductions of the original study by simulation from the model under evaluation, calculating estimates of interest for each simulated study and comparing the distribution of those estimates with the estimate from the original study. This procedure is a generic method that is straightforward to apply, in general. Here we consider the application of the method to time-to-event data and consider the special case when a time-varying covariate is not known or cannot be approximated after event time. In this case, simulations cannot be conducted beyond the end of the follow-up time (event or censoring time) in the original study. Thus, the simulations must be censored at the end of the follow-up time. Since this censoring is not random, the standard KM estimates from the simulated studies and the resulting VPC will be biased. We propose to use inverse probability of censoring weighting (IPoC) method to correct the KM estimator for the simulated studies and obtain unbiased VPCs. For analyzing the Cantos study, the IPoC weighting as described here proved valuable and enabled the generation of VPCs to qualify PKPD models for simulations. Here, we use a generated data set, which allows illustration of the different situations and evaluation against the known truth.     

Adaptive estimation for varying coefficient models with nonstationary covariates

In this paper, the adaptive estimation for varying coefficient models proposed by Chen, Wang, and Yao (2015 Chen, Y., Q. Wang, and W. Yao. 2015. Adaptive estimation for varying coefficient models. Journal of Multivariate Analysis 137:17–31.[Crossref], [Web of Science ®] , [Google Scholar]) is extended to allowing for nonstationary covariates. The asymptotic properties of the estimator are obtained, showing different convergence rates for the integrated covariates and stationary covariates. The nonparametric estimator of the functional coefficient with integrated covariates has a faster convergence rate than the estimator with stationary covariates, and its asymptotic distribution is mixed normal. Moreover, the adaptive estimation is more efficient than the least square estimation for non normal errors. A simulation study is conducted to illustrate our theoretical results.     

Statistical estimation for partially linear error-in-variable models with error-prone covariates

Motivated by a heart disease data, we propose a new partially linear error-in-variable models with error-prone covariates, in which mismeasured covariate appears in the noparametric part and the covariates in the parametric part are not observed, but ancillary variables are available. In this case, we first calibrate the linear covariates, and then use the least-square method and the local linear method to estimate parametric and nonparametric components. Also, under certain conditions the asymptotic distributions of proposed estimates are obtained. Simulated and real examples are conducted to illustrate our proposed methodology.     

Goodness-of-fit tests for general linear models with covariates missed at random

In this paper, we consider a model checking problem for general linear models with randomly missing covariates. Two types of score type tests with inverse probability weight, which is estimated by parameter and nonparameter methods respectively, are proposed to this goodness of fit problem. The asymptotic properties of the test statistics are developed under the null and local alternative hypothesis. Simulation study is carried out to present the performance of the sizes and powers of the tests. We illustrate the proposed method with a data set on monozygotic twins.     

Nonparametric estimation of regression models with mixed discrete and continuous covariates by the K-nn method

In this article we consider the problem of estimating a nonparametric conditional mean function with mixed discrete and continuous covariates by the nonparametric k-nearest-neighbor (k-nn) method. We derive the asymptotic normality result of the proposed estimator and use Monte Carlo simulations to demonstrate its finite sample performance. We also provide an illustrative empirical example of our method.     

Robust methods for generalized linear models with nonignorable missing covariates

The EM algorithm is often used for finding the maximum likelihood estimates in generalized linear models with incomplete data. In this article, the author presents a robust method in the framework of the maximum likelihood estimation for fitting generalized linear models when nonignorable covariates are missing. His robust approach is useful for downweighting any influential observations when estimating the model parameters. To avoid computational problems involving irreducibly high‐dimensional integrals, he adopts a Metropolis‐Hastings algorithm based on a Markov chain sampling method. He carries out simulations to investigate the behaviour of the robust estimates in the presence of outliers and missing covariates; furthermore, he compares these estimates to the classical maximum likelihood estimates. Finally, he illustrates his approach using data on the occurrence of delirium in patients operated on for abdominal aortic aneurysm.     

Generation of pseudo random numbers and estimation under Cox models with time-dependent covariates

ABSTRACT

We study the method for generating pseudo random numbers under various special cases of the Cox model with time-dependent covariates when the baseline hazard function may not be constant and the random variable may equal infinity with a positive probability. During our simulation studies in computing the partial likelihood estimates, in between 3% and 20% of the time with a moderate sample size, it happens that the partial likelihood estimate of the regression coefficient is ∞ for the data from the Cox model. We propose a semi-parametric estimator as a modification for such a case. We present simulation results on the asymptotic properties of the semi-parametric estimator.     

Semiparametric inference for survival models with step process covariates

The authors consider Bayesian methods for fitting three semiparametric survival models, incorporating time‐dependent covariates that are step functions. In particular, these are models due to Cox [Cox ( 1972 ) Journal of the Royal Statistical Society, Series B, 34, 187–208], Prentice & Kalbfleisch and Cox & Oakes [Cox & Oakes ( 1984 ) Analysis of Survival Data, Chapman and Hall, London]. The model due to Prentice & Kalbfleisch [Prentice & Kalbfleisch ( 1979 ) Biometrics, 35, 25–39], which has seen very limited use, is given particular consideration. The prior for the baseline distribution in each model is taken to be a mixture of Polya trees and posterior inference is obtained through standard Markov chain Monte Carlo methods. They demonstrate the implementation and comparison of these three models on the celebrated Stanford heart transplant data and the study of the timing of cerebral edema diagnosis during emergency room treatment of diabetic ketoacidosis in children. An important feature of their overall discussion is the comparison of semi‐parametric families, and ultimate criterion based selection of a family within the context of a given data set. The Canadian Journal of Statistics 37: 60–79; © 2009 Statistical Society of Canada     

Bootstrapping unit root tests with covariates

We consider the bootstrap method for the covariates augmented Dickey–Fuller (CADF) unit root test suggested in Hansen (1995 Hansen, B. E. (1995). Rethinking the univariate approach to unit root testing: Using covariates to increase power. \ Econometric Theory 11:1148–1171.[Crossref], [Web of Science ®] , [Google Scholar]) which uses related variables to improve the power of univariate unit root tests. It is shown that there are substantial power gains from including correlated covariates. The limit distribution of the CADF test, however, depends on the nuisance parameter that represents the correlation between the equation error and the covariates. Hence, inference based directly on the CADF test is not possible. To provide a valid inferential basis for the CADF test, we propose to use the parametric bootstrap procedure to obtain critical values, and establish the asymptotic validity of the bootstrap CADF test. Simulations show that the bootstrap CADF test significantly improves the asymptotic and the finite sample size performances of the CADF test, especially when the covariates are highly correlated with the error. Indeed, the bootstrap CADF test offers drastic power gains over the conventional unit root tests. Our testing procedures are applied to the extended Nelson and Plosser data set.     

Bias-corrected estimators for monotone and concave frontier functions

For the estimation of a monotone and concave support-boundary the data envelopment analysis (DEA) estimator is popular. Recently, under the assumption that the density at boundary is bounded away from zero, Gijbels et al. (J. Amer. Statist. Assoc. 94 (445) 220) derives the limit distribution of the DEA estimator and gives a bias-corrected estimator.In this paper, we generalize the results in Gijbels et al. (1999) by allowing the density at boundary to be infinite, bounded away from zero or zero.     

Bias-corrected estimators of scalar skew normal

One problem of skew normal model is the difficulty in estimating the shape parameter, for which the maximum likelihood estimate may be infinite when sample size is moderate. The existing estimators suffer from large bias even for moderate size samples. In this article, we proposed five estimators of the shape parameter for a scalar skew normal model, either by bias correction method or by solving a modified score equation. Simulation studies show that except bootstrap estimator, the proposed estimators have smaller bias compared to those estimators in literature for small and moderate samples.     

A gradient-based algorithm for semiparametric models with missing covariates

In the parametric regression model, the covariate missing problem under missing at random is considered. It is often desirable to use flexible parametric or semiparametric models for the covariate distribution, which can reduce a potential misspecification problem. Recently, a completely nonparametric approach was developed by [H.Y. Chen, Nonparametric and semiparametric models for missing covariates in parameter regression, J. Amer. Statist. Assoc. 99 (2004), pp. 1176–1189; Z. Zhang and H.E. Rockette, On maximum likelihood estimation in parametric regression with missing covariates, J. Statist. Plann. Inference 47 (2005), pp. 206–223]. Although it does not require a model for the covariate distribution or the missing data mechanism, the proposed method assumes that the covariate distribution is supported only by observed values. Consequently, their estimator is a restricted maximum likelihood estimator (MLE) rather than the global MLE. In this article, we show the restricted semiparametric MLE could be very misleading in some cases. We discuss why this problem occurs and suggest an algorithm to obtain the global MLE. Then, we assess the performance of the proposed method via some simulation experiments.     

Non-orthogonal designs for measuring dispersion effects in sequential factor screening experiments using search linear models

“Dispersion” effects are considered in addition to “Location” effects of factors in the inferential procedure of sequential factor screening experiments with m factors each at two levels under search linear models. Search designs in measuring "Dispersion" and "Location" effects of factors are presented for both stage one and stage two of factor screening experiments with 4 ≤ m ≤ 10.     

Marginal methods for clustered longitudinal binary data with incomplete covariates

Many analyses for incomplete longitudinal data are directed to examining the impact of covariates on the marginal mean responses. We consider the setting in which longitudinal responses are collected from individuals nested within clusters. We discuss methods for assessing covariate effects on the mean and association parameters when covariates are incompletely observed. Weighted first and second order estimating equations are constructed to obtain consistent estimates of mean and association parameters when covariates are missing at random. Empirical studies demonstrate that estimators from the proposed method have negligible finite sample biases in moderate samples. An application to the National Alzheimer's Coordinating Center (NACC) Uniform Data Set (UDS) demonstrates the utility of the proposed method.     

Using the EM algorithm for Bayesian variable selection in logistic regression models with related covariates

We develop a Bayesian variable selection method for logistic regression models that can simultaneously accommodate qualitative covariates and interaction terms under various heredity constraints. We use expectation-maximization variable selection (EMVS) with a deterministic annealing variant as the platform for our method, due to its proven flexibility and efficiency. We propose a variance adjustment of the priors for the coefficients of qualitative covariates, which controls false-positive rates, and a flexible parameterization for interaction terms, which accommodates user-specified heredity constraints. This method can handle all pairwise interaction terms as well as a subset of specific interactions. Using simulation, we show that this method selects associated covariates better than the grouped LASSO and the LASSO with heredity constraints in various exploratory research scenarios encountered in epidemiological studies. We apply our method to identify genetic and non-genetic risk factors associated with smoking experimentation in a cohort of Mexican-heritage adolescents.     

Modeling binary responses with stochastic covariates

In a traditional binary regression model, covariates are assumed to be fixed by design. In practice, however, they are most likely to be stochastic and non-normally distributed. We develop modified maximum likelihood estimators for such situations. We show that these estimators are more efficient than the traditional binary regression estimators and robust to data anomalies. We illustrate our results using a real life example.     

Instrumental variable-based empirical likelihood inferences for varying-coefficient models with error-prone covariates

This paper presents the empirical likelihood inferences for a class of varying-coefficient models with error-prone covariates. We focus on the case that the covariance matrix of the measurement errors is unknown and neither repeated measurements nor validation data are available. We propose an instrumental variable-based empirical likelihood inference method and show that the proposed empirical log-likelihood ratio is asymptotically chi-squared. Then, the confidence intervals for the varying-coefficient functions are constructed. Some simulation studies and a real data application are used to assess the finite sample performance of the proposed empirical likelihood procedure.