Parametric bootstrap inferences for unbalanced panel data models

This article presents parametric bootstrap (PB) approaches for hypothesis testing and interval estimation for the regression coefficients of panel data regression models with incomplete panels. Some simulation results are presented to compare the performance of the PB approaches with the approximate inferences. Our studies show that the PB approaches perform satisfactorily for various sample sizes and parameter configurations, and the performance of PB approaches is mostly better than the approximate methods with respect to the coverage probabilities and the Type I error rates. The PB inferences have almost exact coverage probabilities and Type I error rates. Furthermore, the PB procedure can be simply carried out by a few simulation steps, and the derivation is easier to understand and to be extended to the multi-way error component regression models with unbalanced panels. Finally, the proposed approaches are illustrated by using a real data example.     

Parametric bootstrap inferences for the growth curve models with intraclass correlation structure

This paper presents parametric bootstrap (PB) approaches for hypothesis testing and interval estimation of the fixed effects and the variance component in the growth curve models with intraclass correlation structure. The PB pivot variables are proposed based on the sufficient statistics of the parameters. Some simulation results are presented to compare the performance of the proposed approaches with the generalized inferences. Our studies show that the PB approaches perform satisfactorily for various cell sizes and parameter configurations, and tends to outperform the generalized inferences with respect to the coverage probabilities and powers. The PB approaches not only have almost exact coverage probabilities and Type I error rates, but also have the shorter expected lengths and the higher powers. Furthermore, the PB procedure can be simply carried out by a few simulation steps. Finally, the proposed approaches are illustrated by using a real data example.     

Inference in generalized additive mixed modelsby using smoothing splines

Generalized additive mixed models are proposed for overdispersed and correlated data, which arise frequently in studies involving clustered, hierarchical and spatial designs. This class of models allows flexible functional dependence of an outcome variable on covariates by using nonparametric regression, while accounting for correlation between observations by using random effects. We estimate nonparametric functions by using smoothing splines and jointly estimate smoothing parameters and variance components by using marginal quasi-likelihood. Because numerical integration is often required by maximizing the objective functions, double penalized quasi-likelihood is proposed to make approximate inference. Frequentist and Bayesian inferences are compared. A key feature of the method proposed is that it allows us to make systematic inference on all model components within a unified parametric mixed model framework and can be easily implemented by fitting a working generalized linear mixed model by using existing statistical software. A bias correction procedure is also proposed to improve the performance of double penalized quasi-likelihood for sparse data. We illustrate the method with an application to infectious disease data and we evaluate its performance through simulation.     

Parametric simultaneous robust inferences for regression coefficient under generalized linear models

In this article, the parametric robust regression approaches are proposed for making inferences about regression parameters in the setting of generalized linear models (GLMs). The proposed methods are able to test hypotheses on the regression coefficients in the misspecified GLMs. More specifically, it is demonstrated that with large samples, the normal and gamma regression models can be properly adjusted to become asymptotically valid for inferences about regression parameters under model misspecification. These adjusted regression models can provide the correct type I and II error probabilities and the correct coverage probability for continuous data, as long as the true underlying distributions have finite second moments.     

Alternative Confidence Intervals on Variance Components in a Simple Regression Model with a Balanced Two-Fold Nested Error Structure

In applications using a linear regression model with a balanced two-fold nested error structure, interest focuses on inferences concerning variability of the effects associated with the levels of nesting. This article proposes confidence intervals on the variance components associated with the primary and secondary levels in the model. In order to construct the confidence intervals we use a modified large sample method, generalized inference method, and Satterthwaite approximation. Computer simulation is performed to compare the proposed confidence intervals. A numerical example is provided to demonstrate the intervals.     

A Parametric Bootstrap Test for Comparing Heteroscedastic Regression Models

Testing equality of regression coefficients in several regression models is a common problem encountered in many applied fields. This article presents a parametric bootstrap (PB) approach and compares its performance to that of another simulation-based approach, namely, the generalized variable approach. Simulation studies indicate that the PB approach controls the Type I error rates satisfactorily regardless of the number of regression models and sample sizes whereas the generalized variable approach tends to be very liberal as the number of regression models goes up. The proposed PB approach is illustrated using a data set from stability study.     

Inferences on the Among-Group Variance Component in Unbalanced Heteroscedastic One-Fold Nested Design

This article studies the hypothesis testing and interval estimation for the among-group variance component in unbalanced heteroscedastic one-fold nested design. Based on the concepts of generalized p-value and generalized confidence interval, tests and confidence intervals for the among-group variance component are developed. Furthermore, some simulation results are presented to compare the performance of the proposed approach with those of existing approaches. It is found that the proposed approach and one of the existing approaches can maintain the nominal confidence level across a wide array of scenarios, and therefore are recommended to use in practical problems. Finally, a real example is illustrated.     

Inferences on the common mean of several heterogeneous log-normal distributions

We consider the problem of making inferences on the common mean of several heterogeneous log-normal populations. We apply the parametric bootstrap (PB) approach and the method of variance estimate recovery (MOVER) to construct confidence intervals for the log-normal common mean. We then compare the performances of the proposed confidence intervals with the existing confidence intervals via an extensive simulation study. Simulation results show that our proposed MOVER and PB confidence intervals can be recommended generally for different sample sizes and number of populations.     

Estimation of the Variance Function in Heteroscedastic Linear Regression Models

Heteroscedasticity generally exists when a linear regression model is applied to analyzing some real-world problems. Therefore, how to accurately estimate the variance functions of the error term in a heteroscedastic linear regression model is of great importance for obtaining efficient estimates of the regression parameters and making valid statistical inferences. A method for estimating the variance function of heteroscedastic linear regression models is proposed in this article based on the variance-reduced local linear smoothing technique. Some simulations and comparisons with other method are conducted to assess the performance of the proposed method. The results demonstrate that the proposed method can accurately estimate the variance functions and therefore produce more efficient estimates of the regression parameters.     

Discussion on the common threshold of several exponential distributions with different rates

The integration of results of independent studies in order to make inferences about a common threshold is an important problem with many practical applications. In this article, we apply the generalized variable method to make inferences on the common threshold of several exponential distributions when the scale (or rate) parameters are unknown and unequal. The merits of the proposed method are computed numerically and compared with other existing methods. Numerical results of both simulation studies and real data analyses show that the proposed method is applicable and its performance is better than other methods even when sample sizes are small.     

Efficient estimation in partially linear single‐index models for longitudinal data

In this paper, we consider the estimation of both the parameters and the nonparametric link function in partially linear single‐index models for longitudinal data that may be unbalanced. In particular, a new three‐stage approach is proposed to estimate the nonparametric link function using marginal kernel regression and the parametric components with generalized estimating equations. The resulting estimators properly account for the within‐subject correlation. We show that the parameter estimators are asymptotically semiparametrically efficient. We also show that the asymptotic variance of the link function estimator is minimized when the working error covariance matrices are correctly specified. The new estimators are more efficient than estimators in the existing literature. These asymptotic results are obtained without assuming normality. The finite‐sample performance of the proposed method is demonstrated by simulation studies. In addition, two real‐data examples are analyzed to illustrate the methodology.     

On familial Poisson mixed models with multi-dimensional random effects

When a generalized linear mixed model with multiple (two or more) sources of random effects is considered, the inferences may vary depending on the nature of the random effects. In this paper, we consider a familial Poisson mixed model where each of the count responses of a family are influenced by two independent unobservable familial random effects with two distinct components of dispersion. A generalized quasilikelihood (GQL) approach is discussed for the estimation of the dispersion components as well as the regression effects of the model. A simulation study is conducted to examine the relative performance of the GQL approach as opposed to a simpler method of moments. Furthermore, the GQL estimation methodology is illustrated by using health care utilization data that follow a Poisson mixed model with one component of dispersion and by using simulated asthma data that follow a Poisson mixed model with two sources of random effects with two distinct components of dispersion.     

Inference about regression parameters using highly stratified survey count data with over-dispersion and repeated measurements

We study methods to estimate regression and variance parameters for over-dispersed and correlated count data from highly stratified surveys. Our application involves counts of fish catches from stratified research surveys and we propose a novel model in fisheries science to address changes in survey protocols. A challenge with this model is the large number of nuisance parameters which leads to computational issues and biased statistical inferences. We use a computationally efficient profile generalized estimating equation method and compare it to marginal maximum likelihood (MLE) and restricted MLE (REML) methods. We use REML to address bias and inaccurate confidence intervals because of many nuisance parameters. The marginal MLE and REML approaches involve intractable integrals and we used a new R package that is designed for estimating complex nonlinear models that may include random effects. We conclude from simulation analyses that the REML method provides more reliable statistical inferences among the three methods we investigated.     

Parametric Bootstrap Tests for Unbalanced Three-factor Nested Designs under Heteroscedasticity

In this article, we consider the three-factor unbalanced nested design model without the assumption of equal error variance. For the problem of testing “main effects” of the three factors, we propose a parametric bootstrap (PB) approach and compare it with the existing generalized F (GF) test. The Type I error rates of the tests are evaluated using Monte Carlo simulation. Our studies show that the PB test performs better than the generalized F-test. The PB test performs very satisfactorily even for small samples while the GF test exhibits poor Type I error properties when the number of factorial combinations or treatments goes up. It is also noted that the same tests can be used to test the significance of the random effect variance component in a three-factor mixed effects nested model under unequal error variances.     

Estimation using penalized quasilikelihood and quasi-pseudo-likelihood in Poisson mixed models

We consider two estimation schemes based on penalized quasilikelihood and quasi-pseudo-likelihood in Poisson mixed models. The asymptotic bias in regression coefficients and variance components estimated by penalized quasilikelihood (PQL) is studied for small values of the variance components. We show the PQL estimators of both regression coefficients and variance components in Poisson mixed models have a smaller order of bias compared to those for binomial data. Unbiased estimating equations based on quasi-pseudo-likelihood are proposed and are shown to yield consistent estimators under some regularity conditions. The finite sample performance of these two methods is compared through a simulation study.     

Construction of Simultaneous Confidence Intervals for Ratios of Means of Lognormal Distributions

For constructing simultaneous confidence intervals for ratios of means for lognormal distributions, two approaches using a two-step method of variance estimates recovery are proposed. The first approach proposes fiducial generalized confidence intervals (FGCIs) in the first step followed by the method of variance estimates recovery (MOVER) in the second step (FGCIs–MOVER). The second approach uses MOVER in the first and second steps (MOVER–MOVER). Performance of proposed approaches is compared with simultaneous fiducial generalized confidence intervals (SFGCIs). Monte Carlo simulation is used to evaluate the performance of these approaches in terms of coverage probability, average interval width, and time consumption.     

On efficient inferences in familial-longitudinal binary models with two variance components

When a generalized linear mixed model (GLMM) with multiple (two or more) sources of random effects is considered, the inferences may vary depending on the nature of the random effects. For example, the inference in GLMMs with two independent random effects with two distinct components of dispersion will be different from the inference in GLMMs with two random effects in a two factor factorial design set-up. In this paper, we consider a familial-longitudinal model for repeated binary data where the binary response of an individual member of a family at a given time point is assumed to be influenced by the past responses of the member as well as two but independent sources of random family effects. For the estimation of the parameters of the proposed model, we discuss the well-known maximum-likelihood (ML) method as well as a generalized quasi-likelihood (GQL) approach. The main objective of the paper is to examine the relative asymptotic efficiency performance of the ML and GQL estimators for the regression effects, dynamic (longitudinal) dependence and variance parameters of the random family effects from two sources.     

A parametric bootstrap approach for two-way error component regression models

In this article, the two-way error component regression model is considered. For the nonhomogenous linear hypothesis testing of regression coefficients, a parametric bootstrap (PB) approach is proposed. Simulation results indicate that the PB test, regardless of the sample sizes, maintains the Type I error rates very well and outperforms the existing generalized variable test, which may far exceed the intended significance level when the sample sizes are small or moderate. Real data examples illustrate the proposed approach work quite satisfactorily.     

Composite Marginal Likelihoods to the Normal Bradley-Terry Model

Inference in generalized linear mixed models with crossed random effects is often made cumbersome by the high-dimensional intractable integrals involved in the marginal likelihood. This article presents two inferential approaches based on the marginal composite likelihood for the normal Bradley-Terry model. The two approaches are illustrated by a simulation study to evaluate their performance. Thereafter, the asymptotic variances of the estimated variance component are compared.     

Empirical Likelihood Inferences for Semiparametric Varying-Coefficient Partially Linear Models with Longitudinal Data

In this article, empirical likelihood inferences for semiparametric varying-coefficient partially linear models with longitudinal data are investigated. We propose a groupwise empirical likelihood procedure to handle the inter-series dependence of the longitudinal data. By using residual-adjustment, an empirical likelihood ratio function for the nonparametric component is constructed, and a nonparametric version Wilks' phenomenons is proved. Compared with methods based on normal approximations, the empirical likelihood does not require consistent estimators for the asymptotic variance and bias. A simulation study is undertaken to assess the finite sample performance of the proposed confidence regions.