Covariance Matrix Estimation via Network Structure

In this article, we employ a regression formulation to estimate the high-dimensional covariance matrix for a given network structure. Using prior information contained in the network relationships, we model the covariance as a polynomial function of the symmetric adjacency matrix. Accordingly, the problem of estimating a high-dimensional covariance matrix is converted to one of estimating low dimensional coefficients of the polynomial regression function, which we can accomplish using ordinary least squares or maximum likelihood. The resulting covariance matrix estimator based on the maximum likelihood approach is guaranteed to be positive definite even in finite samples. Under mild conditions, we obtain the theoretical properties of the resulting estimators. A Bayesian information criterion is also developed to select the order of the polynomial function. Simulation studies and empirical examples illustrate the usefulness of the proposed methods.     

Finite Sample Properties of the Two-Step Empirical Likelihood Estimator

We investigate the finite sample properties of two-step empirical likelihood (EL) estimators. These estimators are shown to have the same third-order bias properties as EL itself. The Monte Carlo study provides evidence that (i) higher order asymptotics fails to provide a good approximation in the sense that the bias of the two-step EL estimators can be substantial and sensitive to the number of moment restrictions and (ii) the two-step EL estimators may have heavy tails.     

Finite Sample Properties of the Two-Step Empirical Likelihood Estimator

ABSTRACT

We investigate the finite sample properties of two-step empirical likelihood (EL) estimators. These estimators are shown to have the same third-order bias properties as EL itself. The Monte Carlo study provides evidence that (i) higher order asymptotics fails to provide a good approximation in the sense that the bias of the two-step EL estimators can be substantial and sensitive to the number of moment restrictions and (ii) the two-step EL estimators may have heavy tails.     

Covariance Matrix Formula for Exponential Family Nonlinear Models

This article gives a matrix formula for second-order covariances of maximum likelihood estimators in exponential family nonlinear models, thus generalizing the result of Cordeiro (2004 Cordeiro , G. M. ( 2004 ). Second-order covariance matrix of maximum likelihood estimates in generalized linear models . Statist. Probab. Lett. 66 : 153 – 160 .[Crossref], [Web of Science ®] , [Google Scholar]) valid for generalized linear models with known dispersion parameter. Some simulations show that the second-order covariances for exponential family nonlinear models can be quite pronounced in small to moderate sample sizes.     

Second-Order Covariance Matrix Formula for Heteroskedastic Generalized Linear Models

For the first time, we provide a matrix formula for second-order covariances of maximum likelihood estimates in heteroskedastic generalized linear models, thus generalizing the results of Cordeiro (2004 Cordeiro , G. M. ( 2004 ). Second-order covariance matrix of maximum likelihood estimates in generalized linear models . Statist. Probab. Lett. 66 : 153 – 160 .[Crossref], [Web of Science ®] , [Google Scholar]) and Cordeiro et al. (2006 Cordeiro , G. M. , Barroso , L. P. , Botter , D. A. (2006). Covariance matrix formula for generalized linear models with unknown dispersion. Commun. Statist. Theor. Meth. 35:113–120.[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]) related to the generalized linear models with known and unknown dispersion parameter, respectively. The covariance matrix formula does not involve cumulants of log-likelihood derivatives and can be easily obtained using simple matrix operations. We apply our main result to a simple model. Some simulations show that the second-order covariances can be quite pronounced in small to moderate samples. The usual covariances of the maximum likelihood estimates can be corrected by these second-order covariances.     

A Class of Improved Heteroskedasticity-Consistent Covariance Matrix Estimators

Abstract

The heteroskedasticity-consistent covariance matrix estimator proposed by White [White, H. A. (1980 White, H. A. 1980. Heteroskedasticity-consistent covariance matrix estimator and a direct test for heteroskedasticity. Econometrica, 48: 817–838. [Crossref], [Web of Science ®] , [Google Scholar]). Heteroskedasticity-consistent covariance matrix estimator and a direct test for heteroskedasticity. Econometrica 48:817–838], also known as HC0, is commonly used in practical applications and is implemented into a number of statistical software. Cribari–Neto et al. [Cribari–Neto, F., Ferrari, S. L. P., Cordeiro, G. M. (2000 Cribari–Neto, F., Ferrari, S. L. P. and Cordeiro, G. M. 2000. Improved heteroscedasticity–consistent covariance matrix estimators. Biometrika, 87: 907–918. [Crossref], [Web of Science ®] , [Google Scholar]). Improved heteroscedasticity–consistent covariance matrix estimators. Biometrika 87:907–918] have developed a bias-adjustment scheme that delivers bias-corrected White estimators. There are several variants of the original White estimator that are also commonly used by practitioners. These include the HC1, HC2, and HC3 estimators, which have proven to have superior small-sample behavior relative to White's estimator. This paper defines a general bias-correction mechamism that can be applied not only to White's estimator, but to variants of this estimator as well, such as HC1, HC2, and HC3. Numerical evidence on the usefulness of the proposed corrections is also presented. Overall, the results favor the sequence of improved HC2 estimators.     

Covariance Matrix Formula for Generalized Linear Models with Unknown Dispersion

In this paper, the existence of the Uniformly Minimum Risk Equivariant (UMRE) estimator of parameters in SURE model under some quadratic losses and matrix losses is studied. The necessary and sufficient conditions for existence of the UMRE estimator of linearly estimable function vectors of regression coefficients under an affine group of transformations are obtained. It is proved that no UMRE estimator of the covariance matrix under any one of two affine groups of transformations exists.     

On Bayes Linear Unbiased Estimator Under the Balanced Loss Function

In this paper, the Bayes linear unbiased estimator (Bayes LUE) is derived under the balanced loss function. Moreover, the superiority of Bayes LUE over ordinary least square estimator is studied under the mean square error matrix criterion and Pitman closeness criterion. Furthermore, we compare Bayes LUE under the balanced loss function with Bayes LUE under the quadratic loss function.     

A New Chart for Monitoring the Covariance Matrix of Bivariate Processes

In this article we consider a control chart based on the sample variances of two quality characteristics. The points plotted on the chart correspond to the maximum value of these two statistics. The main reason to consider the proposed chart instead of the generalized variance | S | chart is its better diagnostic feature, that is, with the new chart it is easier to relate an out-of-control signal to the variables whose parameters have moved away from their in-control values. We study the control chart efficiency considering different shifts in the covariance matrix. In this way, we obtain the average run length (ARL) that measures the effectiveness of a control chart in detecting process shifts. The proposed chart always detects process disturbances faster than the generalized variance | S | chart. The same is observed when the size of the samples is variable, except in a few cases in which the size of the samples switches between small size and very large size.     

An Improved Range Estimator of Sigma for Determining Sample Sizes

The use of a range estimator of the population standard deviation, sigma (σ), for determining sample sizes is discussed in this study. Standardized mean ranges (d_n's), when divided into the ranges of sampling frames, provide estimates of the standard deviation of the population. These estimates can be used for determining sample sizes. The d_n's are provided for seven different distributions for sampling frame sizes that range from 2 to 2000, For each of the seven distributions, functional relationships are developed such that d_n = f(n_SF) where n_SF is the size of the sample frame. From these functions, d_n's can be estimated for sampling frame sizes which are not presented in the study.     

Nonnegative Unbiased Estimation of Scale Parameters and Associated Quantiles Based on a Ranked Set Sample

In this article, we are interested in estimating the scale parameter in location and scale families. It is well known that the best linear unbiased estimator (BLUE) of scale parameter based on a simple random sample (SRS) is nonnegative. However, the BLUE of scale parameter based on a ranked set sample (RSS) can assume negative values. We suggest various modifications of BLUE of scale parameter based on RSS so that the resulting estimators are unbiased as well as nonnegative. Their performances in terms of relative efficiencies are compared and some recommendations are made for normal, logistic, double exponential, two-parameter exponential and Weibull distributions. We also briefly discuss an application of the proposed nonnegative BLUE of scale parameter for quantile estimation for the above populations.     

Bayesian Inference on Multivariate Normal Covariance and Precision Matrices in a Star-Shaped Model with Missing Data

In this article, we study Bayesian estimation for the covariance matrix Σ and the precision matrix Ω (the inverse of the covariance matrix) in the star-shaped model with missing data. Based on a Cholesky-type decomposition of the precision matrix Ω = Ψ′Ψ, where Ψ is a lower triangular matrix with positive diagonal elements, we develop the Jeffreys prior and a reference prior for Ψ. We then introduce a class of priors for Ψ, which includes the invariant Haar measures, Jeffreys prior, and reference prior. The posterior properties are discussed and the closed-form expressions for Bayesian estimators for the covariance matrix Σ and the precision matrix Ω are derived under the Stein loss, entropy loss, and symmetric loss. Some simulation results are given for illustration.     

Joint Central Limit Theorem for Eigenvalue Statistics from Several Dependent Large Dimensional Sample Covariance Matrices with Application

Let X _n = (x _{i j} ) be a k ×n data matrix with complex‐valued, independent and standardized entries satisfying a Lindeberg‐type moment condition. We consider simultaneously R sample covariance matrices , where the Q _r 's are non‐random real matrices with common dimensions p ×k (k ≥p ). Assuming that both the dimension p and the sample size n grow to infinity, the limiting distributions of the eigenvalues of the matrices { B _{n r} } are identified, and as the main result of the paper, we establish a joint central limit theorem (CLT) for linear spectral statistics of the R matrices { B _{n r} }. Next, this new CLT is applied to the problem of testing a high‐dimensional white noise in time series modelling. In experiments, the derived test has a controlled size and is significantly faster than the classical permutation test, although it does have lower power. This application highlights the necessity of such joint CLT in the presence of several dependent sample covariance matrices. In contrast, all the existing works on CLT for linear spectral statistics of large sample covariance matrices deal with a single sample covariance matrix (R = 1).     

Estimating and Testing a Structured Covariance Matrix for Three-Level Multivariate Data

This article considers an approach to estimating and testing a new Kronecker product covariance structure for three-level (multiple time points (p), multiple sites (u), and multiple response variables (q)) multivariate data. Testing of such covariance structure is potentially important for high dimensional multi-level multivariate data. The hypothesis testing procedure developed in this article can not only test the hypothesis for three-level multivariate data, but also can test many different hypotheses, such as blocked compound symmetry, for two-level multivariate data as special cases. The tests are implemented with two real data sets.     

Sample size of 12 per group rule of thumb for a pilot study

When designing a clinical trial an appropriate justification for the sample size should be provided in the protocol. However, there are a number of settings when undertaking a pilot trial when there is no prior information to base a sample size on. For such pilot studies the recommendation is a sample size of 12 per group. The justifications for this sample size are based on rationale about feasibility; precision about the mean and variance; and regulatory considerations. The context of the justifications are that future studies will use the information from the pilot in their design. Copyright © 2005 John Wiley & Sons, Ltd.     

Comparisons Between Local Linear Estimator and Kernel Smooth Estimator for a Smooth Distribution Based on MSE Under Right Censoring

We describe a method for estimating the coefficients in a logistic regression model when the predictors are subject to measurement error and an instrumental variable is present. The proposed method is based upon the theory of factor scores taken from factor analysis. Two versions of the proposed method, a simple one and an extended one, are compared to the methods referred to by Carrol, Ruppert and Stefanski (1995) through simulation studies. Our conclusion is that the simple version performs as well as the methods from Carrol et al. (1995), and the extended version performs betterwith respect to MSE, due to a reduction of bias.     

Sample size determination for 2k-r experiments with a binomial response

This paper provides closed form expressions for the sample size for two-level factorial experiments when the response is the number of defectives. The sample sizes are obtained by approximating the two-sided test for no effect through tests for the mean of a normal distribution, and borrowing the classical sample size solution for that problem. The proposals are appraised relative to the exact sample sizes computed numerically, without appealing to any approximation to the binomial distribution, and the use of the sample size tables provided is illustrated through an example.     

Permutation Test for Equality of Individual an Eigenvalue from a Covariance Matrix in High-Dimension

A test statistic for examining the equality of an individual eigenvalue in two populations of high dimension is proposed. The asymptotic distribution of the proposed statistic is derived and the validity of the permutation test is discussed. Simulations were used to investigate the power of the suggested statistic. The proposed statistic is applied to hand measurement data on white and aboriginal Australians to test the equality of the eigenvalues.     

An Approach to Determine Sample Size and to Allocate Sample Size for a Specific Region in a Multiregional Trial for Survival (Time-to-Event) Data under Accelerated Failure Time Model

For the time-to-event outcome, current methods for sample determination are based on the proportional hazard model. However, if the proportionality assumption fails to capture the relationship between the hazard time and covariates, the proportional hazard model is not suitable to analyze survival data. The accelerated failure time (AFT) model is an alternative method to deal with survival data. In this paper, we address the issue that the relationship between the hazard time and the treatment effect is satisfied with the AFT model to design a multiregional trial. The log-rank test is employed to deal with the heterogeneous effect size among regions. The test statistic for the overall treatment effect is used to determine the total sample size for a multiregional trial, and the proposed criteria are used to rationalize partition sample size to each region.