Dirichlet Processes in Nonlinear Mixed Effects Models

In this article, we use two efficient approaches to deal with the difficulty in computing the intractable integrals when implementing Gibbs sampling in the nonlinear mixed effects model (NLMM) based on Dirichlet processes (DP). In the first approach, we compute the Laplace's approximation to the integral for its high accuracy, low cost, and ease of implementation. The second approach uses the no-gaps algorithm of MacEachern and Müller (1998 MacEachern , S. , Müller , P. ( 1998 ). Estimating mixtures of Dirichlet process models . Journal of Computational and Graphical Statistics 7 : 223 – 238 .[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]) to perform Gibbs sampling without evaluating the difficult integral. We apply both approaches to real problems and simulations. Results show that both approaches perform well in density estimation and prediction and are superior to the parametric analysis in that they can detect important model features, such as skewness, long tails, and multimodality, whereas the parametric analysis cannot.     

A Simulation Comparison of Approximate Tests for Fixed Effects in Random Coefficients Growth Curve Models

Often, the response variables on sampling units are observed repeatedly over time. The sampling units may come from different populations, such as treatment groups. This setting is routinely modeled by a random coefficients growth curve model, and the techniques of general linear mixed models are applied to address the primary research aim. An alternative approach is to reduce each subject’s data to summary measures, such as within-subject averages or regression coefficients. One may then test for equality of means of the summary measures (or functions of them) among treatment groups. Here, we compare by simulation the performance characteristics of three approximate tests based on summary measures and one based on the full data, focusing mainly on accuracy of p-values. We find that performances of these procedures can be quite different for small samples in several different configurations of parameter values. The summary-measures approach performed at least as well as the full-data mixed models approach.     

A Class of Pseudolikelihood Ratio Tests for Homogeneity in Exponential Tilt Mixture Models

Mixture models are commonly used in biomedical research to account for possible heterogeneity in population. In this paper, we consider tests for homogeneity between two groups in the exponential tilt mixture models. A novel pairwise pseudolikelihood approach is proposed to eliminate the unknown nuisance function. We show that the corresponding pseudolikelihood ratio test has an asymptotic distribution as a supremum of two squared Gaussian processes under the null hypothesis. To maintain the appeal of simplicity for conventional likelihood ratio tests, we propose two alternative tests, both shown to have a simple asymptotic distribution of under the null. Simulation studies show that the proposed class of pseudolikelihood ratio tests performs well in controlling type I errors and having competitive powers compared with the current tests. The proposed tests are illustrated by an example of partial differential expression detection using microarray data from prostate cancer patients.     

A Simulation-based Goodness-of-fit Test for Random Effects in Generalized Linear Mixed Models

Abstract.  The goodness-of-fit of the distribution of random effects in a generalized linear mixed model is assessed using a conditional simulation of the random effects conditional on the observations. Provided that the specified joint model for random effects and observations is correct, the marginal distribution of the simulated random effects coincides with the assumed random effects distribution. In practice, the specified model depends on some unknown parameter which is replaced by an estimate. We obtain a correction for this by deriving the asymptotic distribution of the empirical distribution function obtained from the conditional sample of the random effects. The approach is illustrated by simulation studies and data examples.     

Testing for Heteroscedasticity and/or Autocorrelation in Longitudinal Mixed Effect Nonlinear Models with AR(1) Errors

The effect of influental observation son the parameter estimates of ordinary least squares regression models has received considerable a t t e n t i o n fn the last decade. However, very little attention has been given to the problem of influential observation sinthea naysis of variace . The purpose of this paper is to show by way of examples that in fluential observations can alter the conclusions of tests of hypotheses in the analysis of variance . Regression diagno stics for identifying both extreme points and out liers can be used toreveal potential data and design problems.     

Bayesian Analysis of Nonlinear Reproductive Dispersion Mixed Models for Longitudinal Data with Nonignorable Missing Covariates

This article proposes a Bayesian approach, which can simultaneously obtain the Bayesian estimates of unknown parameters and random effects, to analyze nonlinear reproductive dispersion mixed models (NRDMMs) for longitudinal data with nonignorable missing covariates and responses. The logistic regression model is employed to model the missing data mechanisms for missing covariates and responses. A hybrid sampling procedure combining the Gibber sampler and the Metropolis-Hastings algorithm is presented to draw observations from the conditional distributions. Because missing data mechanism is not testable, we develop the logarithm of the pseudo-marginal likelihood, deviance information criterion, the Bayes factor, and the pseudo-Bayes factor to compare several competing missing data mechanism models in the current considered NRDMMs with nonignorable missing covaraites and responses. Three simulation studies and a real example taken from the paediatric AIDS clinical trial group ACTG are used to illustrate the proposed methodologies. Empirical results show that our proposed methods are effective in selecting missing data mechanism models.     

Bias-Corrected Maximum Likelihood Estimators in Nonlinear Heteroscedastic Models

Nonlinear heteroscedastic models are widely used in econometrics and statistical applications. We derive matrix formulae for the second-order biases of the maximum likelihood estimators of the parameters in the mean and variance response which generalize previous results by Cook et al. (1986 Cook , D. R. , Tsai , C. L. , Wei , B. C. ( 1986 ). Bias in nonlinear regression . Biometrika 73 : 615 – 623 .[Crossref], [Web of Science ®] , [Google Scholar]) and Cordeiro (1993 Cordeiro , G. M. ( 1993 ). Bartlett corrections and bias correction for two heteroscedastic regression models . Commun. Statist. Theor. Meth. 22 : 169 – 188 .[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]). The biases of the estimators are easily obtained as vectors of regression coefficients from suitable weighted linear regressions. The practical use of such biases is illustrated in a simulation study and in an application to a real data set.     

Admissible Estimation for Linear Combination of Fixed and Random Effects in General Mixed Linear Models

The general mixed linear model can be denoted by y  =  X β +  Z u  +  e , where β is a vector of fixed effects, u is a vector of random effects, and e is a vector of random errors. In this article, the problem of admissibility of Q y and Q y  +  q for estimating linear functions, ? =  L ′β +  M ′ u , of the fixed and random effects is considered, and the necessary and sufficient conditions for Q y (resp. Q y  +  q ) to be admissible in the set of homogeneous (resp. potentially inhomogeneous) linear estimators with respect to the MSE and MSEM criteria are investigated. We provide a straightforward alternative proof to the method that was utilized by Wu (1988 Wu , Q. G. ( 1988 ). Several results on admissibility of a linear estimate of stochastic regression coefficients and parameters . Acta Mathemaica Applicatae Sinica 11 ( 1 ): 95 – 106 . (in Chinese)  [Google Scholar]), Baksalary and Markiewicz (1990 Baksalary , J. K. , Markiewicz , A. ( 1990 ). Admissible linear estimators of an arbitrary vector of parametric functions in the general Gauss–Markov model . J. Stat. Plann. Infer. 26 : 161 – 171 . [Google Scholar]), and Groß and Markiewicz (1999 Groß , J. , Markiewicz , A. ( 1999 ). On admissibility of linear estimators with respect to the mean square error matrix criterion under the general mixed linear model . Statistics 33 : 57 – 71 .[Taylor & Francis Online] , [Google Scholar]). In addition, we derive the corresponding results on the admissibility problem under the generalized MSE criterion.     

空间动态面板模型的时间滞后效应检验

空间面板数据模型由于考虑了经济变量间的空间相关性,其优势日益凸显,已成为计量经济学的热点研究领域。将空间相关性与动态模式同时扩展到面板模型中的空间动态面板模型,不仅考虑了经济变量之间的空间相关性,还考虑了时间上的滞后性,是空间面板模型的发展,增强了模型的解释力。考虑一种带固定个体效应、因变量的时间滞后项、因变量与随机误差项均存在空间自相关性的空间动态面板回归模型,提出了在个体数n和时间数T都很大,且T相对地大于n的条件下空间动态面板模型中时间滞后效应存在性的LM和LR检验方法,其检验方法包括联合检验、一维及二维的边际和条件检验;推导出这些检验在零假设下的极限分布;其极限分布均服从卡方分布。通过模拟试验研究检验统计量的小样本性质,结果显示其具有优良的统计性质。     

Mis-specification Analyses of Nonlinear Wiener Process-based Degradation Models

For some highly reliable products, degradation data have been studied quite extensively to evaluate their reliability characteristics. However, the accuracy of evaluation results depends strongly on the suitability of the proposed degradation model for capturing the degradation over time. If the degradation model is mis-specified, it may result in inaccurate results. In this work, we focus on the issue of model mis-specification between nonlinear Wiener process-based degradation models in which both the product-to-product variability and the temporal uncertainty of the degradation can be considered simultaneously with the nonlinearity in degradation paths. Specifically, a generalized Wiener process-based degradation model is wrongly fitted by its two limiting cases. The effects of model mis-specification in such situations on the MTTF (mean-time-to-failure) of the product are measured with the relative bias and the relative variability. Results from a numerical example concerning fatigue cracks show that the effect of mis-specification is serious under some parameter settings, i.e., the relative bias departs from 0, and the relative variability significantly departs from 1, if the generalized Wiener degradation process is wrongly assumed to be its limiting cases.     

Asymptotic Properties of the MLE in Nonlinear Reproductive Dispersion Models With Stochastic Regressors

Nonlinear reproductive dispersion models with stochastic regressors (NRDMWSR) includes generalized linear models with stochastic regressors (Fahrmer and Kaufmann, 1985 Fahrmer , L. , Kaufmann , H. ( 1985 ). Consistency and asymptotic normality of the maximum likelihood estimator in generalized linear models . Ann. Statist. 13 : 342 – 368 . [Google Scholar]) as a special case. This article presents some mild regularity conditions. On the basis of those mild conditions, the existence, strong consistency, and asymptotic normality of maximum likelihood estimator (MLE) are obtained in NRDMWSR.     

Efficient Estimation of Fixed and Time-varying Covariate Effects in Multiplicative Intensity Models

The proportional hazards assumption of the Cox model does sometimes not hold in practise. An example is a treatment effect that decreases with time. We study a general multiplicative intensity model allowing the influence of each covariate to vary non-parametrically with time. An efficient estimation procedure for the cumulative parameter functions is developed. Its properties are studied using the martingale structure of the problem. Furthermore, we introduce a partly parametric version of the general non-parametric model in which the influence of some of the covariates varies with time while the effects of the remaining covariates are constant. This semiparametric model has not been studied in detail before. An efficient procedure for estimating the parametric as well as the non-parametric components of this model is developed. Again the martingale structure of the model allows us to describe the asymptotic properties of the suggested estimators. The approach is applied to two different data sets, and a Monte Carlo simulation is presented.     

Likelihood-Based Inference for Weak Exogeneity in I(2) Cointegrated VAR Models

This article develops limit theory for likelihood analysis of weak exogeneity in I(2) cointegrated vector autoregressive (VAR) models incorporating deterministic terms. Conditions for weak exogeneity in I(2) VAR models are reviewed, and the asymptotic properties of conditional maximum likelihood estimators and a likelihood-based weak exogeneity test are then investigated. It is demonstrated that weak exogeneity in I(2) VAR models allows us to conduct asymptotic conditional inference based on mixed Gaussian distributions. It is then proved that a log-likelihood ratio test statistic for weak exogeneity in I(2) VAR models is asymptotically χ² distributed. The article also presents an empirical illustration of the proposed test for weak exogeneity using Japan's macroeconomic data.     

Approximate confidence intervals for a linear combination of binomial proportions: A new variant

We propose a new adjustment for constructing an improved version of the Wald interval for linear combinations of binomial proportions, which addresses the presence of extremal samples. A comparative simulation study was carried out to investigate the performance of this new variant with respect to the exact coverage probability, expected interval length, and mesial and distal noncoverage probabilities. Additionally, we discuss the application of a criterion for interpreting interval location in the case of small samples and/or in situations in which extremal observations exist. The confidence intervals obtained from the new variant performed better for some evaluation measures.     

The Use of Working Variables in the Bayesian Modeling of Mean and Dispersion Parameters in Generalized Nonlinear Models with Random Effects

This article is aimed at reviewing a novel Bayesian approach to handle inference and estimation in the class of generalized nonlinear models. These models include some of the main techniques of statistical methodology, namely generalized linear models and parametric nonlinear regression. In addition, this proposal extends to methods for the systematic treatment of variation that is not explicitly predicted within the model, through the inclusion of random effects, and takes into account the modeling of dispersion parameters in the class of two-parameter exponential family. The methodology is based on the implementation of a two-stage algorithm that induces a hybrid approach based on numerical methods for approximating the likelihood to a normal density using a Taylor linearization around the values of current parameters in an MCMC routine.     

Asymptotics of the Lp-Norms of Density Estimators in the Nonlinear Autoregressive Models

This article investigates the asymptotic behavior of the error density function in nonlinear autoregressive stationary time series regression models. For any 1 ? p < ∞, the kernel density estimator of residuals is shown to be consistent for the error estimator concerning the L_p-distance, which extends the result developed by Cheng and Sun (2008 Cheng, F. X. (2005). Asymptotic distributions of error density estimators in first-order autoregression models. Sankhy Ind. J. Statist. 67:553–567. [Google Scholar]) in L₂-norm. Moreover, the result developed in this article is extended the results of Horváth and Zitikis (2003 Horváth, L., Zitikis, R. (2003). Asymptotics of the L_p-norms of density estimators in the first-order autoregressive models. Statist. Probab. Lett. 65:331342.[Crossref], [Web of Science ®] , [Google Scholar]) to nonlinear autoregressive models.     

On the adequacy of variational lower bound functions for likelihood-based inference in Markovian models with missing values

Summary. Variational methods have been proposed for obtaining deterministic lower bounds for log-likelihoods within missing data problems, but with little formal justification or investigation of the worth of the lower bound surfaces as tools for inference. We provide, within a general Markovian context, sufficient conditions under which estimators from the variational approximations are asymptotically equivalent to maximum likelihood estimators, and we show empirically, for the simple example of a first-order autoregressive model with missing values, that the lower bound surface can be very similar in shape to the true log-likelihood in non-asymptotic situations.     

Estimation of Parameters of a Mixed Failure Time Distribution Which is a Mixture of Degenerate (Degenerate at Zero) and I. G. Distribution

The problem of estimation of parameters of a mixture of degenerate (at zero) and exponential distribution is considered by Jayade and Prasad (1990). The sampling scheme proposed in it is extended in this paper to a mixture of degenerate and Inverse Gaussian distribution. The Inverse Gaussian distribution is very relevant for studying reliability and life-testing problems. The inverse Gaussian being the first passage time distribution for Wiener process makes it particularly appropriate for failure or reaction time data analysis.