Group Variable Selection with Oracle Property by Weight-Fused Adaptive Elastic Net Model for Strongly Correlated Data

This paper is the generalization of weight-fused elastic net (Fu and Xu, 2012 Fu, G., Xu, Q. (2012). Grouping variable selection by weight fused elastic net for multi-collinear data. Communications in Statistics-Simulation and Computation 41(2):205–221.[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]), which performs group variable selection by combining weight-fused LASSO(wfLasso) and elastic net (Zou and Hastie, 2005 Zou, H., Hastie, T. (2005). Regularization and variable selection via the elastic net. Journal of the Royal Statistical Society: Series B (Statistical Methodology) 67(2):301–320.[Crossref], [Web of Science ®] , [Google Scholar]) penalties. In this study, the elastic net penalty is replaced by adaptive elastic net penalty (AdaEnet) (Zou and Zhang, 2009 Zou, H., Zhang, H. (2009). On the adaptive elastic-net with a diverging number of parameters. Annals of Statistics 37(4):1733–1751.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]), and a new group variable selection algorithm with oracle property (Fan and Li, 2001 Fan, J., Li, R. (2001). Variable selection via nonconcave penalized likelihood and its oracle properties. Journal of the American Statistical Association 96(456):1348–1360.[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]; Zou, 2006 Zou, H. (2006). The adaptive lasso and its oracle properties. Journal of the American Statistical Association 101(476):1418–1429.[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]) is obtained.     

An objective Bayesian estimation in a two-period crossover design

Two-period crossover design is one of the commonly used designs in clinical trials. But, the estimation of treatment effect is complicated by the possible presence of carryover effect. It is known that ignoring the carryover effect when it exists can lead to poor estimates of the treatment effect. The classical approach by Grizzle (1965 Grizzle, J.E. (1965). The two-period change-over design and its use in clinical trials. Biometrics 21:467–480. See Grizzle (1974) for corrections.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]) consists of two stages. First, a preliminary test is conducted on carryover effect. If the carryover effect is significant, analysis is based only on data from period one; otherwise, analysis is based on data from both periods. A Bayesian approach with improper priors was proposed by Grieve (1985 Grieve, A.P. (1985). A Bayesian analysis of the two-period crossover design for clinical trials. Biometrics 41:979–990.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]) which uses a mixture of two models: a model with carryover effect and another without. The indeterminacy of the Bayes factor due to the arbitrary constant in the improper prior was addressed by assigning a minimally discriminatory value to the constant. In this article, we present an objective Bayesian estimation approach to the two-period crossover design which is also based on a mixture model, but using the commonly recommended Zellner–Siow g-prior. We provide simulation studies and a real data example and compare the numerical results with Grizzle (1965 Grizzle, J.E. (1965). The two-period change-over design and its use in clinical trials. Biometrics 21:467–480. See Grizzle (1974) for corrections.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar])’s and Grieve (1985 Grieve, A.P. (1985). A Bayesian analysis of the two-period crossover design for clinical trials. Biometrics 41:979–990.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar])’s approaches.     

On Fitting Transformation Model to Survey Data

In this article, we consider fitting a semiparametric linear model to survey data with censored observations. The specific goal of the paper is to extend the methods of Cheng et al. (1995 Cheng, S.C., Wei, L.J., Ying, Z. (1995). Analysis of transformation models with censored data. Biometrika 82(4):835–845.[Crossref], [Web of Science ®] , [Google Scholar]) and Chen et al. (2002 Chen, K., Jin, Z. Ying, Z. (2002). Semiparametric analysis of transformation models with censored data. Biometrika 89:659–668.[Crossref], [Web of Science ®] , [Google Scholar]) to the case when the sample has been drawn from a population using a complex sampling design. Similar to the approach of Lin (2000 Lin, D.Y. (2000). On fitting Cox’s proportional hazards models to survey data. Biometrika 87:37–47.[Crossref], [Web of Science ®] , [Google Scholar]), we regard the survey population as a random sample from an infinite universe and accounts for this randomness in the statistical inference. A simulation study is conducted to investigate the performance of the proposed estimators.     

Test for periodicity in restrictive EXPAR models

Abstract

This article is devoted to study the problem of test of periodicity in the restricted exponential autoregressive (EXPAR) model. The local asymptotic normality property, of this model, is shown via the adapted sufficient conditions due to Swensen (1985 Swensen, A.R. (1985). The asymptotic distribution of the likelihood ratio for autoregressive time series with a regression trend. J. Multivariate Anal. 16:54–70.[Crossref], [Web of Science ®] , [Google Scholar]). Using this result, in the case where the innovation density is specified, we obtain a parametric local asymptotic “most stringent” test.     

Bootstrap test of hypothesis for the multi-state models in survival analysis

Abstract

In the present paper we develop bootstrap tests of hypothesis, based on simulation, for the transition probability matrix arising in the context of a multi-state model. The bootstrap test statistic is based on the paper of Tattar and Vaman (2008 Tattar, P. N., Vaman, H. J. (2008). Testing transition probability matrix of a multi-state model with censored data. Lifetime Data Anal. 14(2):216–230.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]), which develops a statistic for the testing problems concerning the transition probability matrix of the non homogeneous Markov process.     

Baker- Lin-Huang Type Bivariate Distributions Based on Order Statistics

Baker (2008 Baker, R. (2008). An order-statistics-based method for constructing multivariate distributions with fixed marginals. J. Multivariate Anal. 99: 23122327.[Crossref], [Web of Science ®] , [Google Scholar]) introduced a new class of bivariate distributions based on distributions of order statistics from two independent samples of size n. Lin and Huang (2010 Lin, G.D., Huang, J.S. (2010). A note on the maximum correlation for Baker’s bivariate distributions with fixed marginals. J. Multivariate Anal. 101: 22272233.[Crossref], [Web of Science ®] , [Google Scholar]) discovered an important property of Baker’s distribution and showed that the Pearson’s correlation coefficient for this distribution converges to maximum attainable value, i.e., the correlation coefficient of the Fréchet upper bound, as n increases to infinity. Bairamov and Bayramoglu (2013 Bairamov, I., Bayramoglu, K. (2013). From Huang-Kotz distribution to Baker’s distribution. J. Multivariate Anal. 113: 106115.[Crossref], [Web of Science ®] , [Google Scholar]) investigated a new class of bivariate distributions constructed by using Baker’s model and distributions of order statistics from dependent random variables, allowing higher correlation than that of Baker’s distribution. In this article, a new class of Baker’s type bivariate distributions with high correlation are constructed based on distributions of order statistics by using an arbitrary continuous copula instead of the product copula.     

A MONTE CARLO COMPARISON OF VARIOUS ASYMPTOTIC APPROXIMATIONS TO THE DISTRIBUTION OF INSTRUMENTAL VARIABLES ESTIMATORS

ABSTRACT

We examine empirical relevance of three alternative asymptotic approximations to the distribution of instrumental variables estimators by Monte Carlo experiments. We find that conventional asymptotics provides a reasonable approximation to the actual distribution of instrumental variables estimators when the sample size is reasonably large. For most sample sizes, we find Bekker[11] Bekker, P. A. 1994. Alternative Approximations to the Distributions of Instrumental Variable Estimators. Econometrica, 62: 657–681. [Crossref], [Web of Science ®] , [Google Scholar] asymptotics provides reasonably good approximation even when the first stage R ² is very small. We conclude that reporting Bekker[11] Bekker, P. A. 1994. Alternative Approximations to the Distributions of Instrumental Variable Estimators. Econometrica, 62: 657–681. [Crossref], [Web of Science ®] , [Google Scholar] confidence interval would suffice for most microeconometric (cross-sectional) applications, and the comparative advantage of Staiger and Stock[5] Staiger, D. and Stock, J. H. 1997. Instrumental Variables Regression with Weak Instruments. Econometrica, 65: 556–586. [Crossref], [Web of Science ®] , [Google Scholar] asymptotic approximation is in applications with sample sizes typical in macroeconometric (time series) applications.     

Designs Robust against Violation of Normality Assumption in the Standard F-test

In this article, designs are found for which the F-test of analysis of variance is insensitive to violation of normality assumption. Atiqullah (1962 Atiquallah, M. (1962). The estimation of residual variance in quadratically balanced least-squares problems and the robustness of the F-test. Biometrika 49: 83–91.[Crossref], [Web of Science ®] , [Google Scholar]) proved that the F-test for treatments adjusting for blocks in the intra-block analysis of a balanced incomplete block design is robust against non-normality in the observations. Here an attempt has been made to identify other designs robust in this sense. In particular, it is observed that for testing relevant hypothesis, a partially balanced incomplete block design in block design setup, under certain conditions, is robust. Robustness of a balanced treatment incomplete block design and a partially balanced treatment incomplete block design (Biswas, 2012 Biswas, A. (2012). Block designs robust against the presence of an aberration in a treatment-control setup. Commun Statist.Theor Methods 41: 920–933.[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]), in treatment-control design setup, is also studied. Moreover, a new measure of robustness is introduced for further study. The performance of the F-test in presence of non-normality in the observations for a quadratically balanced design is also examined.     

Inference in log-alpha-power and log-skew-normal multivariate models

ABSTRACT

Random vectors with positive components are common in many applied fields, for example, in meteorology, when daily precipitation is measured through a region Marchenko and Genton (2010 Marchenko, Y., Genton, M. (2010). Multivariate log-skew-elliptical distributions with applications to precipitation data. Environmetrics 21:318–340.[Crossref], [Web of Science ®] , [Google Scholar]). Frequently, the log-normal multivariate distribution is used for modeling this type of data. This modeling approach is not appropriate for data with high asymmetry or kurtosis. Consequently, more flexible multivariate distributions than the log-normal multivariate are required. As an alternative to this distribution, we propose the log-alpha-power multivariate and log-skew-normal multivariate models. The first model is an extension for positive data of the fractional order statistics model Durrans (1992 Durrans, S. (1992). Distributions of fractional order statistics in hydrology. Water Resour. Res. 28:1649–1655.[Crossref], [Web of Science ®] , [Google Scholar]). The second one is an extension of the log-skew-normal model studied by Mateu-Figueras and Pawlowsky-Glahn (2007 Mateu-Figueras, G., Pawlowsky-Glahn, V. (2007). The skew-normal distribution on the simplex. Commun. Stat.-Theory Methods 36:1787–1802.[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]). We study parameter estimation for these models by means of pseudo-likelihood and maximum likelihood methods. We illustrate the proposal analyzing a real dataset.     

On some dynamic generalized information measures for bivariate lifetimes

Several generalizations to the concept of Kullback-Leibler divergence measure and Kerridge inaccuracy measure are available in the literature. In a recent paper Kundu (Metrika, 78:415–435, 2015 Kundu, C. 2015. Generalized measures of information for truncated random variables. Metrika 78:415–35.[Crossref], [Web of Science ®] , [Google Scholar]) considered a generalized K-L divergence measure of order (α, β). Nath (Metrika, 13:123–135, 1968 Nath, P. 1968. Inaccuracy and coding theory. Metrika 13:123–35.[Crossref] , [Google Scholar]) has also proposed generalized inaccuracy measure of order α. Here we address the question of extending these measures to higher dimensions with reference to residual lifetimes. In the present work, the generalized divergence and inaccuracy measures are extended for conditional lifetimes of two components having possibly different ages. Several properties, including monotonicity, and bounds of these measures are obtained for conditional random variables. Moreover, we study the effect of (increasing) monotone transformation on these generalized measures.     

Alternative Approximations to Value-At-Risk: A Comparison

This article compares three value-at-risk (VaR) approximation methods suggested in the literature: Cornish and Fisher (1937 Cornish, E.A., Fisher, R.A. (1937). Moments and cumulants in the specification of distributions. Revue de l’Institut International de Statistique 5:307–320.[Crossref] , [Google Scholar]), Sillitto (1969 Sillitto, G.P. (1969). Derivation of approximants to the inverse distribution function of a continuous univariate population from the order statistics of a sample. Biometrika 56:641–650.[Crossref], [Web of Science ®] , [Google Scholar]), and Liu (2010 Liu, W.-H. (2010). Estimation and testing of portfolio value-at-risk based on L-comoment matrices. Journal of Futures Markets 30:897–908.[Crossref], [Web of Science ®] , [Google Scholar]). Simulation results are obtained for three families of distributions: student-t, skewed-normal, and skewed-t. We recommend the Sillitto approximation as the best method to evaluate the VaR when the financial return has an unknown, skewed, and heavy-tailed distribution.     

A Simple Corrected Score for Logistic Regression with Errors-in-Covariates

We develop a simple corrected score for logistic regression with errors-in-covariates. The new method is an extension of the consistent functional methods proposed by Huang and Wang (2001) and is closely related to the corrected score method by Nakamura (1990 Nakamura, T. (1990). Corrected score function for errors-in-variables models: Methodology and application to generalized linear models. Biometrika. 77:127–137.[Crossref], [Web of Science ®] , [Google Scholar]) and Stefanski (1989 Stefanski, L.A. (1989). Unbiased estimation of a nonlinear function a normal mean with application to measurement error models. Commun. Stat. Ser. A - Theory Methods. 18:4335–4358.[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]). The new method requires that the measurement error distribution is known, but does not require normality. The new method yields a consistent and asymptotically normal estimator under regularity conditions. We examine the finite-sample performance of the new estimator through simulation studies. Finally, we illustrate the new method by applying it to an AIDS study.     

Reliability characteristics of Farlie–Gumbel–Morgenstern family of bivariate distributions

Abstract

In this paper, we study the Farlie–Gumbel–Morgenstern family of bivariate distributions from a reliability point of view. The properties of this family of distributions and the association between the two variables are investigated by studying the local dependence function and the association measure defined by Clayton (1978 Clayton, D.G. (1978). A model for association in bivariate life tables and its applications in epidemiological studies of familial tendency in chronic disease incidence. Biometrika 65:141–151.[Crossref], [Web of Science ®] , [Google Scholar]). We also study the effect of the association parameter on the hazard components, the failure rate of the series system, and the regression mean residual life of a parallel system. Stochastic comparisons with respect to the association parameter are also studied. Some examples are provided to illustrate the results.     

Quantile-based Chernoff distance for truncated random variables

Several probability distributions such as power-Pareto distribution (see Gilchrist 2000 Gilchrist, W. 2000. Statistical modelling with quantile functions. Boca Raton, FL: Chapman and Hall/CRC.[Crossref] , [Google Scholar] and Hankin and Lee 2006 Hankin, R. K. S., and A. Lee. 2006. A new family of non-negative distributions. Australian and New Zealand Journal of Statistics 48:67–78.[Crossref], [Web of Science ®] , [Google Scholar]), various forms of lambda distributions (see Ramberg and Schmeiser 1974 Ramberg, J. S., and B. W. Schmeiser. 1974. An appropriate method for generating asymmetric random variables. Communications of the ACM 17:78–82.[Crossref], [Web of Science ®] , [Google Scholar] and Freimer et al. 1988 Freimer, M., S. Mudholkar, G. Kollia, and C. T. Lin. 1988. A study of the generalized lambda family. Communications in Statistics - Theory and Methods 17:3547–67.[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]), Govindarajulu distribution (see Nair, Sankaran, and Vineshkumar 2012 Nair, U. N., P. G. Sankaran, and B. Vineshkumar. 2012. The Govindarajulu distribution: some properties and applications. Communications in Statistics—Theory and Methods 41:4391–406.[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]), etc., do not have manageable distribution functions, though they have tractable quantile functions. Hence, analytical study of the properties of Chernoff distance of two random variables associated with these distributions via traditional distribution function-based tool becomes difficult. To make this simple, in this paper, we introduce quantile-based Chernoff distance for (left or right) truncated random variables and study its various properties. Some useful bounds as well as characterization results are obtained.     

An adaptive multivariate CUSUM control chart for signaling a range of location shifts

ABSTRACT

In this work, we proposed an adaptive multivariate cumulative sum (CUSUM) statistical process control chart for signaling a range of location shifts. This method was based on the multivariate CUSUM control chart proposed by Pignatiello and Runger (1990 Pignatiello, J.J., Runger, G.C. (1990). Comparisons of multivariate CUSUM charts. J. Qual. Technol. 22(3):173–186.[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]), but we adopted the adaptive approach similar to that discussed by Dai et al. (2011 Dai, Y., Luo, Y., Li, Z., Wang, Z. (2011). A new adaptive CUSUM control chart for detecting the multivariate process mean. Qual. Reliab. Eng. Int. 27(7):877–884.[Crossref], [Web of Science ®] , [Google Scholar]), which was based on a different CUSUM method introduced by Crosier (1988 Crosier, R.B. (1988). Multivariate generalizations of cumulative sum quality-control schemes. Technometrics 30(3):291–303.[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]). The reference value in this proposed procedure was changed adaptively in each run, with the current mean shift estimated by exponentially weighted moving average (EWMA) statistic. By specifying the minimal magnitude of the mean shift, our proposed control chart achieved a good overall performance for detecting a range of shifts rather than a single value. We compared our adaptive multivariate CUSUM method with that of Dai et al. (2001 Dai, Y., Luo, Y., Li, Z., Wang, Z. (2011). A new adaptive CUSUM control chart for detecting the multivariate process mean. Qual. Reliab. Eng. Int. 27(7):877–884.[Crossref], [Web of Science ®] , [Google Scholar]) and the non adaptive versions of these two methods, by evaluating both the steady state and zero state average run length (ARL) values. The detection efficiency of our method showed improvements over the comparative methods when the location shift is unknown but falls within an expected range.     

Inferences on partial linear models with right censored data by empirical likelihood

ABSTRACT

This article considers inference for partial linear models with right censored data. We use empirical likelihood based on the Buckley and James (1979 Buckley, J., James, I. (1979). Linear regression with censored data. Biometrika 66:429–436.[Crossref], [Web of Science ®] , [Google Scholar]) estimating equation to derive the confidence region for the regression parameter. We introduce an adjusted empirical likelihood ratio statistic for the parameter of interest and show that its limiting distribution is standard chi-square. A simulation is carried out to compare our method with the synthetic data approach in Wang and Li (2002 Wang, Q.-H., Li, G. (2002). Empirical Likelihood Semiparametric Regression Analysis under Random Censorship. J. Multivariate Anal. 83:469–486.[Crossref], [Web of Science ®] , [Google Scholar]).     

Convergence of weighted sums for sequences of pairwise NQD random variables

ABSTRACT

The authors discuss the convergence for weighted sums of pairwise negatively quadrant dependent (NQD) random variables and obtain some new results which extend and improve the result of Bai and Cheng (2000) Bai, Z.D., Cheng, P.E. (2000). Marcinkiewicz strong laws for linear statistics. Stat. Probab. Lett. 46:105–112.[Crossref], [Web of Science ®] , [Google Scholar]. In addition, we relax some restrictions of the conditions in their result. Some new methods are used in this article which differ from that of Bai and Cheng (2000) Bai, Z.D., Cheng, P.E. (2000). Marcinkiewicz strong laws for linear statistics. Stat. Probab. Lett. 46:105–112.[Crossref], [Web of Science ®] , [Google Scholar].     

On goodness-of-fit tests for Aalen's additive model based on left-truncated right-censored or doubly censored data

ABSTRACT

Gandy and Jensen (2005 Gandy, A., Jensen, U. (2005). On goodness-of-fit tests for Aalen's additive risk model. Scan. J. Stat. 32:425–445.[Crossref], [Web of Science ®] , [Google Scholar]) proposed goodness-of-fit tests for Aalen's additive risk model. In this article, we demonstrate that the approach of Gandy and Jensen (2005 Gandy, A., Jensen, U. (2005). On goodness-of-fit tests for Aalen's additive risk model. Scan. J. Stat. 32:425–445.[Crossref], [Web of Science ®] , [Google Scholar]) can be applied to left-truncated right-censored (LTRC) data and doubly censored data. A simulation study is conducted to investigate the performance of the proposed tests. The proposed tests are illustrated using heart transplant data.     

RAO'S STATISTIC FOR THE ANALYSIS OF UNIFORM ASSOCIATION IN CROSS-CLASSIFICATIONS

In this paper we introduce a new measure for the analysis of association in cross-classifications having ordered categories. Association is measured in terms of the odd-ratios in 2 × 2 subtables formed from adjacent rows and adjacent columns. We focus our attention in the uniform association model. Our measure is based in the family of divergences introduced by Burbea and Rao [1] Burbea, J. and Rao, C. R. 1982a. On the convexity of some divergence measures based on entropy functions. IEEE Transactions on Information Theory, 28: 489–495. [Crossref], [Web of Science ®] , [Google Scholar]. Some well-known sets of data are reanalyzed and a simulation study is presented to analyze the behavior of the new families of test statistics introduced in this paper.     

POOLED SLICING METHODS VERSUS SLICING METHODS

We consider the semiparametric regression model introduced by [1] Duan, N. and Li, K. C. 1991. Slicing regression: a link-free regression method. The Annals of Statistics, 19: 505–530. [Crossref], [Web of Science ®] , [Google Scholar]. The dependent variable y is linked to the index x′ β through an unknown link function. [1] Duan, N. and Li, K. C. 1991. Slicing regression: a link-free regression method. The Annals of Statistics, 19: 505–530. [Crossref], [Web of Science ®] , [Google Scholar] and [2] Li, K. C. 1991. Sliced inverse regression for dimension reduction, with discussions. Journal of the American Statistical Association, 86: 316–342. [Taylor & Francis Online], [Web of Science ®] , [Google Scholar] present Slicing methods (the Sliced Inverse Regression methods SIR-I, SIR-II and SIR_α) in order to estimate the direction of the unknown slope parameter β. These methods are computationally simple and fast but depend on the choice of an arbitrary slicing fixed by the user. When the sample size is small, the number and the position of slices have an influence on the estimated direction. In this paper, we suggest to use the corresponding Pooled Slicing methods: PSIR-I (proposed by [3] Aragon, Y. and Saracco, J. 1997. Sliced Inverse Regression (SIR): an appraisal of small sample alternatives to slicing. Computational Statistics, 12: 109–130. [Web of Science ®] , [Google Scholar]), PSIR-II and PSIR_α. These methods combine the results from a number of slicings. We compare the sample behaviour of Slicing and Pooled Slicing methods on simulations. We also propose a practical choice of α in SIR_α and PSIR_α methods.