Two-step and likelihood methods for joint models of longitudinal and survival data

We compare the commonly used two-step methods and joint likelihood method for joint models of longitudinal and survival data via extensive simulations. The longitudinal models include LME, GLMM, and NLME models, and the survival models include Cox models and AFT models. We find that the full likelihood method outperforms the two-step methods for various joint models, but it can be computationally challenging when the dimension of the random effects in the longitudinal model is not small. We thus propose an approximate joint likelihood method which is computationally efficient. We find that the proposed approximation method performs well in the joint model context, and it performs better for more “continuous” longitudinal data. Finally, a real AIDS data example shows that patients with higher initial viral load or lower initial CD4 are more likely to drop out earlier during an anti-HIV treatment.     

线性混合效应模型的FIC选择准则

线性混合效应模型在许多科学领域都有重要应用,本文主要研究它的变量选择问题,我们推导了FIC变量选择准则,它通过选择能极小化感兴趣目标量之估计的均方误差的模型而提高估计效率。模拟结果表明本文提出的FIC准则与其他常用的模型选择准则相比具有较大的优势。     

Efficient estimation of variance components in nonparametric mixed-effects models with large samples

Linear mixed-effects (LME) regression models are a popular approach for analyzing correlated data. Nonparametric extensions of the LME regression model have been proposed, but the heavy computational cost makes these extensions impractical for analyzing large samples. In particular, simultaneous estimation of the variance components and smoothing parameters poses a computational challenge when working with large samples. To overcome this computational burden, we propose a two-stage estimation procedure for fitting nonparametric mixed-effects regression models. Our results reveal that, compared to currently popular approaches, our two-stage approach produces more accurate estimates that can be computed in a fraction of the time.     

Approximate F-tests of multiple degree of freedom hypotheses in generalized least squares analyses of unbalanced split-plot experiments

Approximate t-tests of single degree of freedom hypotheses in generalized least squares analyses (GLS) of mixed linear models using restricted maximum likelihood (REML) estimates of variance components have been previously developed by Giesbrecht and Burns (GB), and by Jeske and Harville (JH), using method of moment approximations for the degrees of freedom (df) for the tstatistics. This paper proposes approximate Fstatistics for tests of multiple df hypotheses using one-moment and two-moment approximations which may be viewed as extensions of the GB and JH methods. The paper focuses specifically on tests of hypotheses concerning the main-plot treatment factor in split-plot experiments with missing data. Simulation results indicate usually satisfactory control of Type I error rates.     

Exact Simultaneous Confidence Bands for Quadratic and Cubic Polynomial Regression with Applications in Dose Response Study

Exact simultaneous confidence bands (SCBs) for a polynomial regression model are available only in some special situations. In this paper, simultaneous confidence levels for both hyperbolic and constant width bands for a polynomial function over a given interval are expressed as multidimensional integrals. The dimension of these integrals is equal to the degree of the polynomial. Hence the values can be calculated quickly and accurately via numerical quadrature provided that the degree of the polynomial is small (e.g. 2 or 3). This allows the construction of exact SCBs for quadratic and cubic regression functions over any given interval and for any given design matrix. Quadratic and cubic regressions are frequently used to characterise dose response relationships in addition to many other applications. Comparison between the hyperbolic and constant width bands under both the average width and minimum volume confidence set criteria shows that the constant width band can be much less efficient than the hyperbolic band. For hyperbolic bands, comparison between the exact critical constant and conservative or approximate critical constants indicates that the exact critical constant can be substantially smaller than the conservative or approximate critical constants. Numerical examples from a dose response study are used to illustrate the methods.     

Bias‐reduced marginal Akaike information criteria based on a Monte Carlo method for linear mixed‐effects models

In linear mixed‐effects (LME) models, if a fitted model has more random‐effect terms than the true model, a regularity condition required in the asymptotic theory may not hold. In such cases, the marginal Akaike information criterion (AIC) is positively biased for (?2) times the expected log‐likelihood. The asymptotic bias of the maximum log‐likelihood as an estimator of the expected log‐likelihood is evaluated for LME models with balanced design in the context of parameter‐constrained models. Moreover, bias‐reduced marginal AICs for LME models based on a Monte Carlo method are proposed. The performance of the proposed criteria is compared with existing criteria by using example data and by a simulation study. It was found that the bias of the proposed criteria was smaller than that of the existing marginal AIC when a larger model was fitted and that the probability of choosing a smaller model incorrectly was decreased.     

A computationally efficient method for bootstrapping systems of demand equations: A comparison to traditional techniques

The solution to a Liapunov matrix equation (LME) has been proposed to estimate the parameters of the demand equations derived from the Translog, the Almost Ideal Demand System and the Rotterdam demand models. When compared to traditional scemingly unrelated regression (SUR) methods the LME approach saves both computer time and space, and it provides parameter estimates that are less likely to suffer from round-off error. However, the LME method is difficult to implement without the use of specially written computer programs and, unlike traditional SUR methods, it does not automatically provide an estimate of the covariance of the parameters. This paper solves these two problems, the first by providing a simplified solution to the Liapunov matrix equation which can be written in a few lines of code in computer languages such as SAS PROC MATRIX/IML^TM or GAUSS^TM; the second, by bootstrapping the parameter covariance matrix.     

Likelihood ratio tests in linear mixed models with one variance component

Summary.  We consider the problem of testing null hypotheses that include restrictions on the variance component in a linear mixed model with one variance component and we derive the finite sample and asymptotic distribution of the likelihood ratio test and the restricted likelihood ratio test. The spectral representations of the likelihood ratio test and the restricted likelihood ratio test statistics are used as the basis of efficient simulation algorithms of their null distributions. The large sample χ ² mixture approximations using the usual asymptotic theory for a null hypothesis on the boundary of the parameter space have been shown to be poor in simulation studies. Our asymptotic calculations explain these empirical results. The theory of Self and Liang applies only to linear mixed models for which the data vector can be partitioned into a large number of independent and identically distributed subvectors. One-way analysis of variance and penalized splines models illustrate the results.     

An approximate degrees of freedom test for heteroscedastic two-way ANOVA

Heteroscedastic two-way ANOVA are frequently encountered in real data analysis. In the literature, classical F-tests are often blindly employed although they are often biased even for moderate heteroscedasticity. To overcome this problem, several approximate tests have been proposed in the literature. These tests, however, are either too complicated to implement or do not work well in terms of size controlling. In this paper, we propose a simple and accurate approximate degrees of freedom (ADF) test. The ADF test is shown to be invariant under affine-transformations, different choices of contrast matrix for the same null hypothesis, or different labeling schemes of cell means. Moreover, it can be conducted easily using the usual F-distribution with one unknown degree of freedom estimated from the data. Simulations demonstrate that the ADF test works well in various cell sizes and parameter configurations but the classical F-tests work badly when the cell variance homogeneity assumption is violated. A real data example illustrates the methodologies.     

Alternative GMM estimators for first-order autoregressive panel model: An improving efficiency approach

This article considers first-order autoregressive panel model that is a simple model for dynamic panel data (DPD) models. The generalized method of moments (GMM) gives efficient estimators for these models. This efficiency is affected by the choice of the weighting matrix that has been used in GMM estimation. The non-optimal weighting matrices have been used in the conventional GMM estimators. This led to a loss of efficiency. Therefore, we present new GMM estimators based on optimal or suboptimal weighting matrices. Monte Carlo study indicates that the bias and efficiency of the new estimators are more reliable than the conventional estimators.     

Some asymptotic results for semiparametric nonlinear mixed-effects models with incomplete data

In modeling complex longitudinal data, semiparametric nonlinear mixed-effects (SNLME) models are very flexible and useful. Covariates are often introduced in the models to partially explain the inter-individual variations. In practice, data are often incomplete in the sense that there are often measurement errors and missing data in longitudinal studies. The likelihood method is a standard approach for inference for these models but it can be computationally very challenging, so computationally efficient approximate methods are quite valuable. However, the performance of these approximate methods is often based on limited simulation studies, and theoretical results are unavailable for many approximate methods. In this article, we consider a computationally efficient approximate method for a class of SNLME models with incomplete data and investigate its theoretical properties. We show that the estimates based on the approximate method are consistent and asymptotically normally distributed.     

Laplace approximations for censored linear regression models

We consider approximate Bayesian inference about scalar parameters of linear regression models with possible censoring. A second-order expansion of their Laplace posterior is seen to have a simple and intuitive form for logconcave error densities with nondecreasing hazard functions. The accuracy of the approximations is assessed for normal and Gumbel errors when the number of regressors increases with sample size. Perturbations of the prior and the likelihood are seen to be easily accommodated within our framework. Links with the work of DiCiccio et al. (1990) and Viveros and Sprott (1987) extend the applicability of our results to conditional frequentist inference based on likelihood-ratio statistics.     

一类近似因子模型的GMM估计及其统计性质研究

对于一类异质性误差项存在截面相关性的近似因子模型,本文首先提出了估计共同因子向量和因子载荷矩阵的广义矩估计方法（GMM）,该方法推广了Doz等（2012）的极大似然估计方法;其次,分别研究了模型参数广义矩估计的渐近性质和有限样本的统计性质,在适当的条件下,证明了参数的GMM估计是具有渐近正态分布的一致估计;最后,利用近似因子模型对我国各类上市公司增长性的共同驱动因素及其差异性进行了实证分析。     

Goodness-of-fit tests for parametric models in censored regression

The authors propose a goodness-of-fit test for parametric regression models when the response variable is right-censored. Their test compares an estimation of the error distribution based on parametric residuals to another estimation relying on nonparametric residuals. They call on a bootstrap mechanism in order to approximate the critical values of tests based on Kolmogorov-Smirnov and Cramér-von Mises type statistics. They also present the results of Monte Carlo simulations and use data from a study about quasars to illustrate their work.     

Modeling fetal-growth biometry with Response Modeling Methodology (RMM) and comparison to current models

Monitoring fetal growth via ultrasound requires modeling fetal biometry in terms of gestation age. In this study, we compare Response Modeling Methodology (RMM) to current models, in three stages. First, RMM is used to approximate 47 empirical mean models that have appeared in the literature resulting in models with negligible loss in accuracy (unlike two other commonly applied models). Next, RMM models are fitted to sample averages of the Singaporean population and compared to a formerly published model. A similar simulation-based analysis is performed in the last stage for raw data of the British population. Altogether over 70 comparisons had been performed resulting in RMM consistently delivering better performing models.     

Profile likelihood in directed graphical models from BUGS output

We present a method for using posterior samples produced by the computer program BUGS (Bayesian inference Using Gibbs Sampling) to obtain approximate profile likelihood functions of parameters or functions of parameters in directed graphical models with incomplete data. The method can also be used to approximate integrated likelihood functions. It is easily implemented and it performs a good approximation. The profile likelihood represents an aspect of the parameter uncertainty which does not depend on the specification of prior distributions, and it can be used as a worthwhile supplement to BUGS that enable us to do both Bayesian and likelihood based analyses in directed graphical models.     

A weighted bootstrap approximation for comparing the error distributions in nonparametric regression

Several procedures have been proposed for testing the equality of error distributions in two or more nonparametric regression models. Here we deal with methods based on comparing estimators of the cumulative distribution function (CDF) of the errors in each population to an estimator of the common CDF under the null hypothesis. The null distribution of the associated test statistics has been approximated by means of a smooth bootstrap (SB) estimator. This paper proposes to approximate their null distribution through a weighted bootstrap. It is shown that it produces a consistent estimator. The finite sample performance of this approximation is assessed by means of a simulation study, where it is also compared to the SB. This study reveals that, from a computational point of view, the proposed approximation is more efficient than the one provided by the SB.     

On estimation in conditional heteroskedastic time series models under non-normal distributions

Financial time series data are typically observed to have heavy tails and time-varying volatility. Conditional heteroskedastic models to describe this behaviour have received considerable attention. In the present paper, our purpose is to examine some of these models in a general setting under some non-normal distributions. A likelihood based approach to estimation is used. New comparisons of estimators and their efficiencies are discussed.     

Fractional Brownian motion and long term clinical trial recruitment

Prediction of recruitment in clinical trials has been a challenging task. Many methods have been studied, including models based on Poisson process and its large sample approximation by Brownian motion (BM); however, when the independent incremental structure is violated for BM model, we could use fractional Brownian motion to model and approximate the underlying Poisson processes with random rates. In this paper, fractional Brownian motion (FBM) is considered for such conditions and compared to BM model with illustrated examples from different trials and simulations.     

Solving the Stochastic Growth Model by Linear-Quadratic Approximation and by Value-Function Iteration

This article describes three approximation methods I used to solve the growth model (Model 1) studied by the National Bureau of Economic Research's nonlinear rational-expectations-modeling group project, the results of which were summarized by Taylor and Uhlig (1990). The methods involve computing exact solutions to models that approximate Model 1 in different ways. The first two methods approximate Model 1 about its nonstochastic steady state. The third method works with a version of the model in which the state space has been discretized. A value function iteration method is used to solve that model.