Some Properties of the Liang-Zeger Method Applied to Clustered Binary Regression

The Generalized Estimating Equation (GEE) method popularized by Liang and Zeger provides a very general method for fitting regression models to observations that occur in clusters. Features of the method are the specification of a 'working correlation' (a guess at the true correlation structure of the data) which is used to improve efficiency in estimating the regression coefficients, and the 'information sandwich' which provides a way of consistently estimating the standard errors of the estimated regression coefficients even if (as we might expect) the working correlation is wrong. This paper develops asymptotic expressions for the bias and efficiency both of the regression coefficient estimates and of the sandwich estimate, and uses them to study the behaviour of the estimates.
It looks at the effect of the choice of the working correlation on the estimate and also examines the effect of different cluster sizes and different degrees of correlation between the covariates. The performance of these methods is found to be excellent, particularly when the degree of correlation in the responses and covariates is small to moderate.     

Parameter estimation for multivariate diffusion processes with the time inhomogeneously positive semidefinite diffusion matrix

Statistical inference for the diffusion coefficients of multivariate diffusion processes has been well established in recent years; however, it is not the case for the drift coefficients. Furthermore, most existing estimation methods for the drift coefficients are proposed under the assumption that the diffusion matrix is positive definite and time homogeneous. In this article, we put forward two estimation approaches for estimating the drift coefficients of the multivariate diffusion models with the time inhomogeneously positive semidefinite diffusion matrix. They are maximum likelihood estimation methods based on both the martingale representation theorem and conditional characteristic functions and the generalized method of moments based on conditional characteristic functions, respectively. Consistency and asymptotic normality of the generalized method of moments estimation are also proved in this article. Simulation results demonstrate that these methods work well.     

Functional response models for intraclass correlation coefficients

Intraclass correlation coefficients (ICC) are employed in a wide range of behavioral, biomedical, psychosocial, and health care related research for assessing reliability of continuous outcomes. The linear mixed-effects model (LMM) is the most popular approach for inference about the ICC. However, since LMM is a normal distribution-based model and non-normal data are the norm rather than the exception in most studies, its applications to real study data always beg the question of inference validity. In this paper, we propose a distribution-free alternative to provide robust inference based on the functional response models. We illustrate the performance of the new approach using both real and simulated data.     

Enriched biplots for canonical correlation analysis

This paper discusses biplots of the between-set correlation matrix obtained by canonical correlation analysis. It is shown that these biplots can be enriched with the representation of the cases of the original data matrices. A representation of the cases that is optimal in the generalized least squares sense is obtained by the superposition of a scatterplot of the canonical variates on the biplot of the between-set correlation matrix. Goodness of fit statistics for all correlation and data matrices involved in canonical correlation analysis are discussed. It is shown that adequacy and redundancy coefficients are in fact statistics that express the goodness of fit of the original data matrices in the biplot. The within-set correlation matrix that is represented in standard coordinates always has a better goodness of fit than the within-set correlation matrix that is represented in principal coordinates. Given certain scalings, the scalar products between variable vectors approximate correlations better than the cosines of angles between variable vectors. Several data sets are used to illustrate the results.     

Generalized simultaneous confidence regions for regression coefficients and their ratios

This study constructs a simultaneous confidence region for two combinations of coefficients of linear models and their ratios based on the concept of generalized pivotal quantities. Many biological studies, such as those on genetics, assessment of drug effectiveness, and health economics, are interested in a comparison of several dose groups with a placebo group and the group ratios. The Bonferroni correction and the plug-in method based on the multivariate-t distribution have been proposed for the simultaneous region estimation. However, the two methods are asymptotic procedures, and their performance in finite sample sizes has not been thoroughly investigated. Based on the concept of generalized pivotal quantity, we propose a Bonferroni correction procedure and a generalized variable (GV) procedure to construct the simultaneous confidence regions. To address a genetic concern of the dominance ratio, we conduct a simulation study to empirically investigate the probability coverage and expected length of the methods for various combinations of sample sizes and values of the dominance ratio. The simulation results demonstrate that the simultaneous confidence region based on the GV procedure provides sufficient coverage probability and reasonable expected length. Thus, it can be recommended in practice. Numerical examples using published data sets illustrate the proposed methods.     

Local Influence in Generalized Estimating Equations

Abstract.  We investigate the influence of subjects or observations on regression coefficients of generalized estimating equations (GEEs) using local influence. The GEE approach does not require the full multivariate distribution of the response vector. We extend the likelihood displacement to a quasi-likelihood displacement, and propose local influence diagnostics under several perturbation schemes. An illustrative example in GEEs is given and we compare the results using the local influence and deletion methods.     

Parametric simultaneous robust inferences for regression coefficient under generalized linear models

In this article, the parametric robust regression approaches are proposed for making inferences about regression parameters in the setting of generalized linear models (GLMs). The proposed methods are able to test hypotheses on the regression coefficients in the misspecified GLMs. More specifically, it is demonstrated that with large samples, the normal and gamma regression models can be properly adjusted to become asymptotically valid for inferences about regression parameters under model misspecification. These adjusted regression models can provide the correct type I and II error probabilities and the correct coverage probability for continuous data, as long as the true underlying distributions have finite second moments.     

Analysis of autoregressive models with symmetric stable innovations

This paper develops algorithms for fitting autoregressive models with symmetric stable innovations using auto-covariation function. A recursive algorithm is proposed for generalized Yule-Walker estimation of autoregressive coefficients and partial auto-covariation function. It also introduces a new information criterion, useful for consistent order selection. Applications of the proposed methods are illustrated using observations simulated from autoregressive models with symmetric stable innovations as well as by analysing a set of real data.     

Fitting generalized linear models to retrospectively sampled clusters with categorical responses

We use simulations based on data on injury severity in car accidents to compare methods for the analysis of very large data sets containing clusters of individuals for which the measured response is polytomous. Retrospective sampling of clusters is used to expedite the analysis of the large data set while at the same time obtaining information about rare, but important, outcomes. An additional complication in the analysis of such data sets is that there can be two types of covariates: those which vary within a cluster and those which vary only among clusters. Weighted generalized estimating equations are developed to obtain consistent estimates of the regression coefficients in a proportional-odds model, along with a weighted robust covariance matrix to estimate the variabilities of these estimated coefficients.     

Covariance structure of wavelet coefficients: theory and models in a Bayesian perspective

We present theoretical results on the random wavelet coefficients covariance structure. We use simple properties of the coefficients to derive a recursive way to compute the within- and across-scale covariances. We point out a useful link between the algorithm proposed and the two-dimensional discrete wavelet transform. We then focus on Bayesian wavelet shrinkage for estimating a function from noisy data. A prior distribution is imposed on the coefficients of the unknown function. We show how our findings on the covariance structure make it possible to specify priors that take into account the full correlation between coefficients through a parsimonious number of hyperparameters. We use Markov chain Monte Carlo methods to estimate the parameters and illustrate our method on bench-mark simulated signals.     

An approximation to the distribution of the product of two dependent correlation coefficients

Many methodological studies depend on the product of two dependent correlation coefficients. However, the behavior of the distribution of the product of two dependent correlation coefficients is not well known. The distribution of sets of correlation coefficients has been well studied, but not the distribution of the product of two dependent correlation coefficients. The present study derives an approximation to the distribution of the product of two dependent correlation coefficients with a closed form, resulting in a Pearson Type I distribution. A simulation study is also conducted to assess the accuracy of the approximation.     

Resampling approaches for common intraclass correlation coefficients

In this paper, we present several resampling methods for interval estimation for the common intraclass correlation coefficients. Comparisons are made on the coverage probabilities and average lengths with confidence intervals estimated by using the generalized pivots. Most of the methods proposed in this article produce confidence intervals with better probabilities and shorter average lengths than that produced by using generalized pivots.     

Comparison of GEE1 and GEE2 estimation applied to clustered logistic regression

Generalized estimating equations (GEE) have become a popular method for marginal regression modelling of data that occur in clusters. Features of the GEE methodology are the use of a ‘working covariance’, an approximation to the underlying covariance, which is used to improve the efficiency in estimating the regression coefficients, and the ‘sandwich’ estimate of variance, which provides a way of consistently estimating their standard errors. These techniques have been extended to include estimating equations for the underlying correlation structure, both to improve the efficiency of the regression coefficient estimates and to provide estimates of correlations between units in a cluster, when these are of interest. If the mean structure is of primary interest, then a simpler set of equations (GEE1) can be used, whereas if the underlying covariance structure is of interest in its own right, the use of the more complex GEE2 estimating equations is often recommended. In this paper, we compare the effect of increasing the complexity of the ‘working covariances’ on the variance of the parameter estimates, as well as the mean-squared error of the ‘sandwich’ estimate of variance. We give asymptotic expressions for these variances and mean-squared error terms. We use these to study the behaviour of different variants of GEE1 and GEE2 when we change the number of clusters, the cluster size, and the within-cluster correlation. We conclude that the extra complexity of the full GEE2 approach is not usually justified if the mean structure is of primary interest.     

基于小波协方差的中国股市波动序列相关性的实证分析

在介绍概率变化协调的相关性度量方法的同时,证明了该方法是传统方法的推广。又依据小波协方差在不同尺度下的分解理论,提出了基于小波协方差的相关性度量方法,并对沪深股市波动序列之间的相关性进行了实证分析。结果表明：沪深股市波动序列在整体上具有正相关性,但在不同尺度下沪深股市波动序列之间的相关性不同,小尺度下相关性小。对投资者而言,最好以小尺度为基准选择分散投资策略。     

Testing equality of correlation coefficients for paired binary data from multiple groups

Paired binary data arise naturally when paired body parts are investigated in clinical trials. One of the widely used models for dealing with this kind of data is the equal correlation coefficients model. Before using this model, it is necessary to test whether the correlation coefficients in each group are actually equal. In this paper, three test statistics (likelihood ratio test, Wald-type test, and Score test) are derived for this purpose. The simulation results show that the Score test statistic maintains type I error rate and has satisfactory power, and therefore is recommended among the three methods. The likelihood ratio test is over conservative in most cases, and the Wald-type statistic is not robust with respect to empirical type I error. Three real examples, including a multi-centre Phase II double-blind placebo randomized controlled trial, are given to illustrate the three proposed test statistics.     

基于分层广义线性模型的非寿险费率厘定精算模型研究

非寿险业务中的损失数据结构日益复杂,呈现异质性与相关性并存的异象。分层广义线性模型能够突破传统费率厘定精算方法仅分析风险个体同一保单年损失数据的局限,可以提高复杂结构损失数据预测的准确性。基于分层广义线性模型等方法,研究具有多年损失数据的非寿险费率厘定问题,并以车险和工伤补偿保险的两组损失数据为例进行实证分析。研究结果表明,相对于GLM而言,考虑随机效应后GLMM的拟合优度大幅改善,GLMM与HGLM可以更有效地反映不同风险个体的差异,并有利于揭示风险个体在多个保险期内损失的异质性与相关性。     

An improved meta-analysis for analyzing cylindrical-type time series data with applications to forecasting problem in environmental study

In this paper, we propose an improved generalized least square (GLS) meta-analysis in a linear-circular regression, and show its utility in the analysis of a certain environmental issue. The existing GLS meta-analysis proposed in Becker and Wu has a serious flaw since information about the covariance among coefficients across studies is not utilized. In our proposed meta-analysis, we take the correlations between adjacent studies into account, and improve the existing GLS meta-analysis. We provide numerical examples to compare the proposed method with several other existing methods by using Akaike's Information Criterion, Bayesian Information Criterion and mean square prediction errors with applications to forecasting problem in Environmental study.     

均值尾部相关系数及其在金融领域的应用

传统尾部相关系数用于刻画变量之间的极值相关性,但这种相关系数存在对相关性信息刻画不完全的问题。为能够捕获更多的非极值相关性信息,本文提出均值尾部相关系数的概念,研究了均值尾部系数同Copula理论之间的关系,并以t Copula为例分析了四种均值尾部相关系数的变化特征。通过将均值尾部相关系数和传统尾部相关系数分别应用于沪深股市的相关性研究,从实证角度验证了这种相关系数的实用价值。     

Kernel partial correlation: a novel approach to capturing conditional independence in graphical models for noisy data

Graphical models capture the conditional independence structure among random variables via existence of edges among vertices. One way of inferring a graph is to identify zero partial correlation coefficients, which is an effective way of finding conditional independence under a multivariate Gaussian setting. For more general settings, we propose kernel partial correlation which extends partial correlation with a combination of two kernel methods. First, a nonparametric function estimation is employed to remove effects from other variables, and then the dependence between remaining random components is assessed through a nonparametric association measure. The proposed approach is not only flexible but also robust under high levels of noise owing to the robustness of the nonparametric approaches.     

Inferences on correlation coefficients: One-sample,independent and correlated cases

This article concerns inference on the correlation coefficients of a multivariate normal distribution. Inferential procedures based on the concepts of generalized variables (GVs) and generalized p$p$-values are proposed for elements of a correlation matrix. For the simple correlation coefficient, the merits of the generalized confidence limits and other approximate methods are evaluated using a numerical study. The study indicates that the proposed generalized confidence limits are uniformly most accurate even for samples as small as three. The results are extended for comparing two independent correlations, overlapping and non-overlapping dependent correlations. For each problem, the properties of the GV approach and other asymptotic methods are evaluated using Monte Carlo simulation. The GV approach produces satisfactory results for all the problems considered. The methods are illustrated using a few practical examples.