Estimation of the covariance matrix with two-step monotone missing data

Abstract

We suggest shrinkage based technique for estimating covariance matrix in the high-dimensional normal model with missing data. Our approach is based on the monotone missing scheme assumption, meaning that missing values patterns occur completely at random. Our asymptotic framework allows the dimensionality p grow to infinity together with the sample size, N, and extends the methodology of Ledoit and Wolf (2004) Ledoit, O., Wolf, M. (2004). A well-conditioned estimator for large dimensional covariance matrices. J. Multivariate Anal. 88:365–411.[Crossref], [Web of Science ®] , [Google Scholar] to the case of two-step monotone missing data. Two new shrinkage-type estimators are derived and their dominance properties over the Ledoit and Wolf (2004) Ledoit, O., Wolf, M. (2004). A well-conditioned estimator for large dimensional covariance matrices. J. Multivariate Anal. 88:365–411.[Crossref], [Web of Science ®] , [Google Scholar] estimator are shown under the expected quadratic loss. We perform a simulation study and conclude that the proposed estimators are successful for a range of missing data scenarios.     

A Simple Corrected Score for Logistic Regression with Errors-in-Covariates

We develop a simple corrected score for logistic regression with errors-in-covariates. The new method is an extension of the consistent functional methods proposed by Huang and Wang (2001) and is closely related to the corrected score method by Nakamura (1990 Nakamura, T. (1990). Corrected score function for errors-in-variables models: Methodology and application to generalized linear models. Biometrika. 77:127–137.[Crossref], [Web of Science ®] , [Google Scholar]) and Stefanski (1989 Stefanski, L.A. (1989). Unbiased estimation of a nonlinear function a normal mean with application to measurement error models. Commun. Stat. Ser. A - Theory Methods. 18:4335–4358.[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]). The new method requires that the measurement error distribution is known, but does not require normality. The new method yields a consistent and asymptotically normal estimator under regularity conditions. We examine the finite-sample performance of the new estimator through simulation studies. Finally, we illustrate the new method by applying it to an AIDS study.     

Generalized linear regression models incorporating original outcome distributions

ABSTRACT

In this article, we propose an approach for incorporating continuous and discrete original outcome distributions into the usual exponential family regression models. The new approach is an extension of the works of Suissa (1991 Suissa, S. (1991). Binary methods for continuous outcomes: A parametric alternative. J. Clin. Epidemiol. 44:241–248.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]) and Suissa and Blais (1995 Suissa, S., Blais, L. (1995). Binary regression with continuous outcomes. Stat. Med. 14:247–255.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]), which present methods to estimate the risk of an event defined in a sample subspace of an original continuous outcome variable. Simulation studies are presented in order to illustrate the performance of the developed methodology. Real data sets are analyzed by using the proposed models.     

Note on posterior inference for the Bingham distribution

The properties of high-dimensional Bingham distributions have been studied by Kume and Walker (2014 Kume, A., and S. G. Walker. 2014. On the Bingham distribution with large dimension. Journal of Multivariate Analysis 124:345–52.[Crossref], [Web of Science ®] , [Google Scholar]). Fallaize and Kypraios (2016 Fallaize, C. J., and T. Kypraios. 2016. Exact Bayesian inference for the Bingham distribution. Statistics and Computing 26:349–60.[Crossref], [Web of Science ®] , [Google Scholar]) propose the Bayesian inference for the Bingham distribution and they use developments in Bayesian computation for distributions with doubly intractable normalizing constants (Møller et al. 2006 Møller, J., A. N. Pettitt, R. Reeves, and K. K. Berthelsen. 2006. An efficient Markov chain Monte Carlo method for distributions with intractable normalising constants. Biometrika 93 (2):451–458.[Crossref], [Web of Science ®] , [Google Scholar]; Murray, Ghahramani, and MacKay 2006 Murray, I., Z. Ghahramani, and D. J. C. MacKay. 2006. MCMC for doubly intractable distributions. In Proceedings of the 22nd annual conference on uncertainty in artificial intelligence (UAI-06), 359–66. AUAI Press. [Google Scholar]). However, they rely heavily on two Metropolis updates that they need to tune. In this article, we propose instead a model selection with the marginal likelihood.     

Inference in log-alpha-power and log-skew-normal multivariate models

ABSTRACT

Random vectors with positive components are common in many applied fields, for example, in meteorology, when daily precipitation is measured through a region Marchenko and Genton (2010 Marchenko, Y., Genton, M. (2010). Multivariate log-skew-elliptical distributions with applications to precipitation data. Environmetrics 21:318–340.[Crossref], [Web of Science ®] , [Google Scholar]). Frequently, the log-normal multivariate distribution is used for modeling this type of data. This modeling approach is not appropriate for data with high asymmetry or kurtosis. Consequently, more flexible multivariate distributions than the log-normal multivariate are required. As an alternative to this distribution, we propose the log-alpha-power multivariate and log-skew-normal multivariate models. The first model is an extension for positive data of the fractional order statistics model Durrans (1992 Durrans, S. (1992). Distributions of fractional order statistics in hydrology. Water Resour. Res. 28:1649–1655.[Crossref], [Web of Science ®] , [Google Scholar]). The second one is an extension of the log-skew-normal model studied by Mateu-Figueras and Pawlowsky-Glahn (2007 Mateu-Figueras, G., Pawlowsky-Glahn, V. (2007). The skew-normal distribution on the simplex. Commun. Stat.-Theory Methods 36:1787–1802.[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]). We study parameter estimation for these models by means of pseudo-likelihood and maximum likelihood methods. We illustrate the proposal analyzing a real dataset.     

Group Variable Selection with Oracle Property by Weight-Fused Adaptive Elastic Net Model for Strongly Correlated Data

This paper is the generalization of weight-fused elastic net (Fu and Xu, 2012 Fu, G., Xu, Q. (2012). Grouping variable selection by weight fused elastic net for multi-collinear data. Communications in Statistics-Simulation and Computation 41(2):205–221.[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]), which performs group variable selection by combining weight-fused LASSO(wfLasso) and elastic net (Zou and Hastie, 2005 Zou, H., Hastie, T. (2005). Regularization and variable selection via the elastic net. Journal of the Royal Statistical Society: Series B (Statistical Methodology) 67(2):301–320.[Crossref], [Web of Science ®] , [Google Scholar]) penalties. In this study, the elastic net penalty is replaced by adaptive elastic net penalty (AdaEnet) (Zou and Zhang, 2009 Zou, H., Zhang, H. (2009). On the adaptive elastic-net with a diverging number of parameters. Annals of Statistics 37(4):1733–1751.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]), and a new group variable selection algorithm with oracle property (Fan and Li, 2001 Fan, J., Li, R. (2001). Variable selection via nonconcave penalized likelihood and its oracle properties. Journal of the American Statistical Association 96(456):1348–1360.[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]; Zou, 2006 Zou, H. (2006). The adaptive lasso and its oracle properties. Journal of the American Statistical Association 101(476):1418–1429.[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]) is obtained.     

Baker- Lin-Huang Type Bivariate Distributions Based on Order Statistics

Baker (2008 Baker, R. (2008). An order-statistics-based method for constructing multivariate distributions with fixed marginals. J. Multivariate Anal. 99: 23122327.[Crossref], [Web of Science ®] , [Google Scholar]) introduced a new class of bivariate distributions based on distributions of order statistics from two independent samples of size n. Lin and Huang (2010 Lin, G.D., Huang, J.S. (2010). A note on the maximum correlation for Baker’s bivariate distributions with fixed marginals. J. Multivariate Anal. 101: 22272233.[Crossref], [Web of Science ®] , [Google Scholar]) discovered an important property of Baker’s distribution and showed that the Pearson’s correlation coefficient for this distribution converges to maximum attainable value, i.e., the correlation coefficient of the Fréchet upper bound, as n increases to infinity. Bairamov and Bayramoglu (2013 Bairamov, I., Bayramoglu, K. (2013). From Huang-Kotz distribution to Baker’s distribution. J. Multivariate Anal. 113: 106115.[Crossref], [Web of Science ®] , [Google Scholar]) investigated a new class of bivariate distributions constructed by using Baker’s model and distributions of order statistics from dependent random variables, allowing higher correlation than that of Baker’s distribution. In this article, a new class of Baker’s type bivariate distributions with high correlation are constructed based on distributions of order statistics by using an arbitrary continuous copula instead of the product copula.     

Bootstrap test of hypothesis for the multi-state models in survival analysis

Abstract

In the present paper we develop bootstrap tests of hypothesis, based on simulation, for the transition probability matrix arising in the context of a multi-state model. The bootstrap test statistic is based on the paper of Tattar and Vaman (2008 Tattar, P. N., Vaman, H. J. (2008). Testing transition probability matrix of a multi-state model with censored data. Lifetime Data Anal. 14(2):216–230.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]), which develops a statistic for the testing problems concerning the transition probability matrix of the non homogeneous Markov process.     

Interval Estimation of the Stress-Strength Reliability with Independent Normal Random Variables

This article develops a procedure to obtain highly accurate confidence interval estimates for the stress-strength reliability R = P(X > Y) where X and Y are data from independent normal distributions of unknown means and variances. Our method is based on third-order likelihood analysis and is compared to the conventional first-order likelihood ratio procedure as well as the approximate methods of Reiser and Guttman (1986 Reiser, B., Guttman, I. (1986). Statistical inference for Pr(Y < X): the normal case. Technometrics 28: 253257.[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]) and Guo and Krishnamoorthy (2004 Guo, H., Krishnamoorthy, K. (2004). New approximate inferential methods for the reliability parameter in a stress-strength model: the normal case. Commun. Statist. Theor. Meth. 33: 17151731.[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]). The use of our proposed method is illustrated by an empirical example and its superior accuracy in terms of coverage probability and error rate are examined through Monte Carlo simulation studies.     

Admissibility of a variance estimator in finite population sampling under Warner's randomized response plan with multiple responses

ABSTRACT

Let P be the proportion of individuals in a finite population possessing a sensitive attribute. We consider the problem of unbiased estimation of (i) the variance of a linear unbiased estimator of P and (ii) the population variance P (1—P) for a given probability sampling design under Warner's (1965 Warner, S.L. (1965). Randomized response - A survey technique for eliminating evasive answer bias. J. Amer. Statist. Assoc. 60:63–69.[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]) randomized response (RR) plan when independent responses are obtained from each sampled individual as many times as he/she is selected in the sample and prove the admissibility of a quadratic unbiased estimator for each.     

Operating Characteristics of a Subset Selection Procedure Applied to a Hybrid Randomized Response Model

The operating characteristics (OCs) of a subset ranking and selection procedure are derived for the hybrid randomized response model developed by Jia and McDonald (2009 Jia, F., McDonald, G. (2009). Analyzing hybrid randomized response data with a binomial selection procedure. Commun. Statist. Theor. Meth. 38:784807.[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]). The OCs include the probability of a correct P(CS), the individual selection probability γ_i, and the expected subset size E(S), under the slippage configuration or the equi-spaced configuration. An example comparing failure rates of contraceptive methods is used to illustrate the use of these new results.     

Test for periodicity in restrictive EXPAR models

Abstract

This article is devoted to study the problem of test of periodicity in the restricted exponential autoregressive (EXPAR) model. The local asymptotic normality property, of this model, is shown via the adapted sufficient conditions due to Swensen (1985 Swensen, A.R. (1985). The asymptotic distribution of the likelihood ratio for autoregressive time series with a regression trend. J. Multivariate Anal. 16:54–70.[Crossref], [Web of Science ®] , [Google Scholar]). Using this result, in the case where the innovation density is specified, we obtain a parametric local asymptotic “most stringent” test.     

First- and Second-order Asymptotics for the Tail Distortion Risk Measure of Extreme Risks

The tail distortion risk measure at level p was first introduced in Zhu and Li (2012 Zhu, L., Li, H. (2012). Tail distortion risk and its asymptotic analysis. Insur. Math. Econ. 51(1):115–121.[Crossref], [Web of Science ®] , [Google Scholar]), where the parameter p ∈ (0, 1) indicates the confidence level. They established first-order asymptotics for this risk measure, as p↑1, for the Fréchet case. In this article, we extend their work by establishing both first-order and second-order asymptotics for the Fréchet, Weibull, and Gumbel cases. Numerical studies are also carried out to examine the accuracy of both asymptotics.     

A variance shift model for detection of outliers in the linear mixed measurement error models

ABSTRACT

In this paper, we extend a variance shift model, previously considered in the linear mixed models, to the linear mixed measurement error models using the corrected likelihood of Nakamura (1990 Nakamura, T. (1990). Corrected score function for errors in variables models: methodology and application to generalized linear models. Biometrika 77:127–137.[Crossref], [Web of Science ®] , [Google Scholar]). This model assumes that a single outlier arises from an observation with inflated variance. We derive the score test and the analogue of the likelihood ratio test, to assess whether the ith observation has inflated variance. A parametric bootstrap procedure is implemented to obtain empirical distributions of the test statistics. Finally, results of a simulation study and an example of real data are presented to illustrate the performance of proposed tests.     

A quantile-based study on ageing intensity function

Jiang, Ji, and Xiao (2003 Jiang, R., P. Ji, and X. Xiao. 2003. Aging property of unimodal failure rate models. Reliability Engineering and System Safety 79(1):113–6.[Crossref], [Web of Science ®] , [Google Scholar]) has introduced a quantitative measure known as the ageing intensity function for evaluating the ageing properties of a component/system. In recent years, there has been a great interest on the study of quantile function, an equivalent alternative to the distribution function approach. Unlike the distribution function approach, the quantile method possess some unique properties (see Gilchrist 2000 Gilchrist, W. 2000. Statistical modelling with quantile functions. Boca Raton, Florida: Chapman and Hall/CRC.[Crossref] , [Google Scholar], Nair, Sankaran, and Balakrishnan 2013 Nair N. U., P. G. Sankaran, N. Balakrishnan. 2013. Quantile-based reliability concepts. In: Quantile-Based Reliability Analysis. Statistics for Industry and Technology. New York, NY: Birkhäuser.[Crossref] , [Google Scholar]). Motivated with this, in the present paper we introduce a quantile-based ageing intensity function and study its various ageing properties. We also study some stochastic comparison of random variables based on the proposed measure.     

Designs Robust against Violation of Normality Assumption in the Standard F-test

In this article, designs are found for which the F-test of analysis of variance is insensitive to violation of normality assumption. Atiqullah (1962 Atiquallah, M. (1962). The estimation of residual variance in quadratically balanced least-squares problems and the robustness of the F-test. Biometrika 49: 83–91.[Crossref], [Web of Science ®] , [Google Scholar]) proved that the F-test for treatments adjusting for blocks in the intra-block analysis of a balanced incomplete block design is robust against non-normality in the observations. Here an attempt has been made to identify other designs robust in this sense. In particular, it is observed that for testing relevant hypothesis, a partially balanced incomplete block design in block design setup, under certain conditions, is robust. Robustness of a balanced treatment incomplete block design and a partially balanced treatment incomplete block design (Biswas, 2012 Biswas, A. (2012). Block designs robust against the presence of an aberration in a treatment-control setup. Commun Statist.Theor Methods 41: 920–933.[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]), in treatment-control design setup, is also studied. Moreover, a new measure of robustness is introduced for further study. The performance of the F-test in presence of non-normality in the observations for a quadratically balanced design is also examined.     

On Rates of Convergence for Posterior Distributions Under Misspecification

We extend the approach of Walker (2003 Walker , S. ( 2003 ). On sufficient conditions for Bayesian consistency . Biometrika 90 ( 2 ): 482 – 488 .[Crossref], [Web of Science ®] , [Google Scholar]); (2004 Walker , S. ( 2004 ). New approaches to Bayesian consistency . Ann. Statist. 32 ( 5 ): 2028 – 2043 .[Crossref], [Web of Science ®] , [Google Scholar]) to the case of misspecified models. A sufficient condition for establishing rates of convergence is given based on a key identity involving martingales, which does not require construction of tests. We also show roughly that the result obtained by using tests can also be obtained by our approach, which demonstrates the potential wider applicability of this method.     

The flexible skew Laplace distribution

ABSTRACT

Skew-symmetric distributions have been discussed by several research-ers. In this article we construct a skew-symmetric Laplace distribution, which is the generalization of distribution given by Ali et al. (2009 Ali, M., Pal, M., Woo, J. (2009). Skewed reflected distributions generated by the Laplace kernel. Aust. J. Statist. 38:45–58. [Google Scholar]) and Nekoukhou and Alamatsaz (2012 Nekoukhou, V., Alamatsaz, M.H. (2012). A family of skew-symmetric-Laplace distributions. Statist. Papers. 53(3):685–696.[Crossref], [Web of Science ®] , [Google Scholar]). This new distribution contains more parameters, and this induces flexibility properties, such as unimodality or bimodality. We study on some properties of this distribution. In the last section we also provide an application with a real data. Concerning example has recently been discussed by Nekoukhou et al. (2013 Nekoukhou, V., Alamatsaz, M.H., Aghajani, A.H. (2013). A flexible skew-generalized normal distribution. Commun. Statist. Theory Methods. 42(13):2324–2334.[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]) to apply to their model. We compare the behavior of our distribution to their distribution on this example.     

Quantile Regression with Left-Truncated and Right-Censored Data in a Reproducing Kernel Hilbert Space

Li et al. (2007 Li, Y., Liu, Y., Zhu, J. (2007). Quantile regression in reproducing kernel Hilbert spaces. J. Amer. Statist. Assoc. 102:255–268.[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]) developed an estimation method for quantile functions in a reproducing kernel Hilbert space for complete data, and Park and Kim (2011 Park, J., Kim, J. (2011). Quantile regression with an epsilon-insensitive loss in a reproducing kernel Hilbert space. Statist. Probab. Lett. 81:62–70.[Crossref], [Web of Science ®] , [Google Scholar]) proposed an estimation method using the ε-insensitive loss. This article extends these estimation methods to left-truncated and right-censored data. As a measure of goodness of fit, the check loss and the ε-insensitive loss were used to estimate the quantile function. The ε-insensitive loss can shrink the estimated coefficients toward zero; hence, it can reduce the variability of the estimates. Simulation studies show that the estimated quantile functions based on the ε-insensitive loss perform slightly better when ε is adequately chosen.