Test for comparing complete expectations of life of two groups

Abstract

Complete expectation of life of an individual gives an intuitive and interesting perspective on the ageing process and is an important concept in the insurance sector for determination of premium. We propose a new test for testing equality of complete expectations of life of two groups/populations. Power of the new test is calculated through simulations and compared with the power of the tests given by Berger, Boos, and Guess (1988 Berger, R. L., D. D. Boos, and F. M. Guess. 1988. Tests and confidence sets for comparing two mean residual life functions. Biometrics 44 (1):103–15.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]) and Aly (1997 Aly, E. E. A. A. 1997. Nonparametric tests for comparing two mean residual life functions. Lifetime Data Analysis 3 (4):353–66.[Crossref], [PubMed] , [Google Scholar]). It is observed that the proposed test statistic is more powerful than the competing tests for the cases considered in this paper. A real life illustration is included.     

A finite-sample sensitivity analysis of the Dickey–Fuller test under local-to-unity detrending

In recent research, Elliott et al. (1996) Elliott, G. 1996. Efficient tests for an autoregressive unit root. Econometrica, 64: 813–836. [Crossref], [Web of Science ®] [Google Scholar] have shown the use of local-to-unity detrending via generalized least squares (GLS) to substantially increase the power of the Dickey–Fuller (1979) unit root test. In this paper the relationship between the extent of detrending undertaken, determined by the detrending parameter &art1;, and the power of the resulting GLS-based Dickey–Fuller (DF-GLS) test is examined. Using Monte Carlo simulation it is shown that the values of &art1; suggested by Elliott et al. (1996) Elliott, G. 1996. Efficient tests for an autoregressive unit root. Econometrica, 64: 813–836. [Crossref], [Web of Science ®] [Google Scholar] on the basis of a limiting power function seldom maximize the power of the DF-GLS test for the finite samples encountered in applied research. This result is found to hold for the DF-GLS test including either an intercept or an intercept and a trend term. An empirical examination of the order of integration of the UK household savings ratio illustrates these findings, with the unit root hypothesis rejected using values of &art1; other than that proposed by Elliott et al. (1996) Elliott, G. 1996. Efficient tests for an autoregressive unit root. Econometrica, 64: 813–836. [Crossref], [Web of Science ®] [Google Scholar].     

Use of scrambled response for estimating mean of the sensitivity variable

Abstract

In this article, we propose new efficient and more generalized difference-cum-exponential type estimator and generalized-difference-cum-generalized exponential type estimators for estimating the mean of sensitivity variable using the auxiliary information. We also discuss theoretically that proposed generalized estimators are more efficient than Sousa et al. (2010 Sousa, R., J. Shabbir, P. C. Real, and S. Gupta. 2010. Ratio estimation of the mean of a sensitive variable in the presence of auxiliary information. Journal of Statistical Theory and Practice 4 (3):495–507.[Taylor & Francis Online] , [Google Scholar]), Gupta et al. (2012 Gupta, S., J. Shabbir, R. Sousa, and P. C. Real. 2012. Estimation of the mean of a sensitive variable in the presence of auxiliary information. Communications in Statistics-Theory and Methods 41:1–12.[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]) and Koyuncu, Gupta, and Sousa (2014 Koyuncu, N., S. Gupta, and R. Sousa. 2014. Exponential-type estimators of the mean of a sensitive variable in the presence of non sensitive auxiliary information. Communications in Statistics-Simulation and Computation 43 (7):1583–94. doi: 10.1080/03610918.2012.737492.[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]) estimators. Results from a real life application and simulation study are presented to demonstrate the performance of the proposed mean estimators in relation to some of the existing mean estimators.     

Testing economic “genetic pleiotropy” for Box-Cox linear model

Abstract

Genetic pleiotropy occurs when a single gene influences two or more seemingly unrelated phenotypic traits. It is significant to detect pleiotropy and understand its causes. However, most current statistical methods to discover pleiotropy mainly test the null hypothesis that none of the traits is associated with a variant, which departures from the null to test just one associated trait or k associated traits. Schaid et al. (2016 Schaid, D. J., X. Tong, B. Larrabee, R. B. Kennedy, G. A. Poland, and J. P. Sinnwell. 2016. Statistical methods for testing genetic pleiotropy. Genetics 204 (2):483–97. doi:10.1534/genetics.116.189308.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]) first proposed a sequential testing framework to analyze pleiotropy based on a linear model and a multivariate normal distribution. In this paper, we analyze the Economic pleiotropy which occurs when an economic action or policy influences two or more economic phenomena. In this paper, we extend the linear model to Box-Cox transformation model and proposed a new decision method. It improves the efficiency of hypothesis test and controls the Type I error. We then apply the method using economic data to multivariate sectoral employments in response to governmental expenditures and provide a quantitative assessment and some insights of different impacts from economic policy.     

An efficient integrated nonparametric entropy estimator of serial dependence

ABSTRACT

We propose an efficient numerical integration-based nonparametric entropy estimator for serial dependence and show that the new entropy estimator has a smaller asymptotic variance than Hong and White’s (2005 Hong, Y., White, H. (2005). Asymptotic distribution theory for nonparametric entropy measures of serial dependence. Econometrica 73:837–901.[Crossref], [Web of Science ®] , [Google Scholar]) sample average-based estimator. This delivers an asymptotically more efficient test for serial dependence. In particular, the uniform kernel gives the smallest asymptotic variance for the numerical integration-based entropy estimator over a class of positive kernel functions. Moreover, the naive bootstrap can be used to obtain accurate inferences for our test, whereas it is not applicable to Hong and White’s (2005 Hong, Y., White, H. (2005). Asymptotic distribution theory for nonparametric entropy measures of serial dependence. Econometrica 73:837–901.[Crossref], [Web of Science ®] , [Google Scholar]) sample averaging approach. A simulation study confirms the merits of our approach.     

Nonparametric Knn estimation with monotone constraints

ABSTRACT

The K-nearest-neighbor (Knn) method is known to be more suitable in fitting nonparametrically specified curves than the kernel method (with a globally fixed smoothing parameter) when data sets are highly unevenly distributed. In this paper, we propose to estimate a nonparametric regression function subject to a monotonicity restriction using the Knn method. We also propose using a new convergence criterion to measure the closeness between an unconstrained and the (monotone) constrained Knn-estimated curves. This method is an alternative to the monotone kernel methods proposed by Hall and Huang (2001 Hall, P., Huang, L.-S. (2001). Nonparametric kernel regression subject to monotonicity constraints. The Annals of Statistics 29:624–647.[Crossref], [Web of Science ®] , [Google Scholar]), and Du et al. (2013 Du, P., Parmeter, C. F., Racine, J. S. (2013). Nonparametric kernel regression with multiple predictors and multiple shape constraints. Statistic Sinica 23:1347–1371.[Web of Science ®] , [Google Scholar]). We use a bootstrap procedure for testing the validity of the monotone restriction. We apply our method to the “Job Market Matching” data taken from Gan and Li (2016 Gan, L., Li, Q. (2016). Efficiency of thin and thick market. Journal of Econometrics 192(1):40–54.[Crossref], [Web of Science ®] , [Google Scholar]) and find that the unconstrained/constrained Knn estimators work better than kernel estimators for this type of highly unevenly distributed data.     

Optimal nonparametric estimator of the area under ROC curve based on clustered data

Abstract

In diagnostic trials, clustered data are obtained when several subunits of the same patient are observed. Intracluster correlations need to be taken into account when analyzing such clustered data. A nonparametric method has been proposed by Obuchowski (1997 Obuchowski, N. A. 1997. Nonparametric analysis of clustered ROC curve data. Biometrics 53 (2):567–78.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]) to estimate the Receiver Operating Characteristic curve area (AUC) for such clustered data. However, Obuchowski’s estimator is not efficient as it gives equal weight to all pairwise rankings within and between cluster. In this paper, we propose a more efficient nonparametric AUC estimator with two sets of optimal weights. Simulation results show that the loss of efficiency of Obuchowski’s estimator for a single AUC or the AUC difference can be substantial when there is a moderate intracluster test correlation and the cluster size is large. The efficiency gain of our weighted AUC estimator for a single AUC or the AUC difference is further illustrated using the data from a study of screening tests for neonatal hearing.     

Weighting variables in Kohonen competitive learning algorithms

This paper presents a new variable weight method, called the singular value decomposition (SVD) approach, for Kohonen competitive learning (KCL) algorithms based on the concept of Varshavsky et al. [18 R. Varshavsky, A. Gottlieb, M. Linial, and D. Horn, Novel unsupervised feature filtering of bilogical data, Bioinformatics 22 (2006), pp. 507–513.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]]. Integrating the weighted fuzzy c-means (FCM) algorithm with KCL, in this paper, we propose a weighted fuzzy KCL (WFKCL) algorithm. The goal of the proposed WFKCL algorithm is to reduce the clustering error rate when data contain some noise variables. Compared with the k-means, FCM and KCL with existing variable-weight methods, the proposed WFKCL algorithm with the proposed SVD's weight method provides a better clustering performance based on the error rate criterion. Furthermore, the complexity of the proposed SVD's approach is less than Pal et al. [17 S.K. Pal, R.K. De, and J. Basak, Unsupervised feature evaluation: a neuro-fuzzy approach, IEEE. Trans. Neural Netw. 11 (2000), pp. 366–376.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]], Wang et al. [19 X.Z. Wang, Y.D. Wang, and L.J. Wang, Improving fuzzy c-means clustering based on feature-weight learning, Pattern Recognit. Lett. 25 (2004), pp. 1123–1132.[Crossref], [Web of Science ®] , [Google Scholar]] and Hung et al. [9 W. -L. Hung, M. -S. Yang, and D. -H. Chen, Bootstrapping approach to feature-weight selection in fuzzy c-means algorithms with an application in color image segmentation, Pattern Recognit. Lett. 29 (2008), pp. 1317–1325.[Crossref], [Web of Science ®] , [Google Scholar]].     

Symmetric quantiles and their applications

To develop estimators with stronger efficiencies than the trimmed means which use the empirical quantile, Kim (1992) Kim, S. J. 1992. The metrically trimmed means as a robust estimator of location. Annals of Statistics, 20: 1534–1547. [Crossref], [Web of Science ®] [Google Scholar] and Chen & Chiang (1996) Chen, L. A. and Chiang, Y. C. 1996. Symmetric type quantile and trimmed means for location and linear regression model. Journal of Nonparametric Statistics, 7: 171–185. [Taylor & Francis Online] [Google Scholar], implicitly or explicitly used the symmetric quantile, and thus introduced new trimmed means for location and linear regression models, respectively. This study further investigates the properties of the symmetric quantile and extends its application in several aspects. (a) The symmetric quantile is more efficient than the empirical quantiles in asymptotic variances when quantile percentage α is either small or large. This reveals that for any proposal involving the α th quantile of small or large α s, the symmetric quantile is the right choice; (b) a trimmed mean based on it has asymptotic variance achieving a Cramer-Rao lower bound in one heavy tail distribution; (c) an improvement of the quantiles-based control chart by Grimshaw & Alt (1997) Grimshaw, S. D. and Alt, F. B. 1997. Control charts for quantile function values. Journal of Quality Technology, 29: 1–7. [Taylor & Francis Online] [Google Scholar] is discussed; (d) Monte Carlo simulations of two new scale estimators based on symmetric quantiles also support this new quantile.     

Stein-like 2SLS estimator

ABSTRACT

Maasoumi (1978 Maasoumi, E. (1978). A modified Stein-like estimator for the reduced form coefficients of simultaneous equations. Econometrica 46:695–703.[Crossref], [Web of Science ®] , [Google Scholar]) proposed a Stein-like estimator for simultaneous equations and showed that his Stein shrinkage estimator has bounded finite sample risk, unlike the three-stage least square estimator. We revisit his proposal by investigating Stein-like shrinkage in the context of two-stage least square (2SLS) estimation of a structural parameter. Our estimator follows Maasoumi (1978 Maasoumi, E. (1978). A modified Stein-like estimator for the reduced form coefficients of simultaneous equations. Econometrica 46:695–703.[Crossref], [Web of Science ®] , [Google Scholar]) in taking a weighted average of the 2SLS and ordinary least square estimators, with the weight depending inversely on the Hausman (1978 Hausman, J. A. (1978). Specification tests in econometrics. Econometrica 46:1251–1271.[Crossref], [Web of Science ®] , [Google Scholar]) statistic for exogeneity. Using a local-to-exogenous asymptotic theory, we derive the asymptotic distribution of the Stein estimator and calculate its asymptotic risk. We find that if the number of endogenous variables exceeds 2, then the shrinkage estimator has strictly smaller risk than the 2SLS estimator, extending the classic result of James and Stein (1961 James W, ., Stein, C. M. (1961). Estimation with quadratic loss. Proceedings of the Fourth Berkeley Symposium on Mathematical Statistics and Probability 1:361–380. [Google Scholar]). In a simple simulation experiment, we show that the shrinkage estimator has substantially reduced finite sample median squared error relative to the standard 2SLS estimator.     

Robust cointegration testing in the presence of weak trends,with an application to the human origin of global warming

Standard tests for the rank of cointegration of a vector autoregressive process present distributions that are affected by the presence of deterministic trends. We consider the recent approach of Demetrescu et al. (2009 Demetrescu, M., Lütkepohl, H., Saikkonen, P. (2009). Testing for the cointegrating rank of a vector autoregressive process with an uncertain deterministic trend term. Econometrics Journal 12:414–35.[Crossref], [Web of Science ®] , [Google Scholar]) who recommend testing a composite null. We assess this methodology in the presence of trends (linear or broken) whose magnitude is small enough not to be always detectable at conventional significance levels. We model them using local asymptotics and derive the properties of the test statistics. We show that whether the trend is orthogonal to the cointegrating vector has a major impact on the distributions but that the test combination approach remains valid. We apply of the methodology to the study of cointegration properties between global temperatures and the radiative forcing of human gas emissions. We find new evidence of Granger Causality.     

Heavy traffic analysis of roving server networks

This article studies the heavy-traffic (HT) behavior of queueing networks with a single roving server. External customers arrive at the queues according to independent renewal processes and after completing service, a customer either leaves the system or is routed to another queue. This type of customer routing in queueing networks arises very naturally in many application areas (in production systems, computer- and communication networks, maintenance, etc.). In these networks, the single most important characteristic of the system performance is oftentimes the path time, i.e., the total time spent in the system by an arbitrary customer traversing a specific path. The current article presents the first HT asymptotic for the path-time distribution in queueing networks with a roving server under general renewal arrivals. In particular, we provide a strong conjecture for the system’s behavior under HT extending the conjecture of Coffman et al.^{[8 Coffman, Jr, E. G.; Puhalskii, A. A.; Reiman, M. I,. Polling systems with zero switchover times: A heavy-traffic averaging principle. Ann. App. Prob. 1995, 5(3), 681–719.[Crossref], [Web of Science ®] [Google Scholar],9 Coffman, Jr., E. G.; Puhalskii, A. A.; Reiman, M. I,. Polling systems in heavy-traffic: A Bessel process limit. Math. Oper. Res. 1998, 23, 257–304.[Crossref], [Web of Science ®] [Google Scholar]]} to the roving server setting of the current article. By combining this result with novel light-traffic asymptotics, we derive an approximation of the mean path time for arbitrary values of the load and renewal arrivals. This approximation is not only highly accurate for a wide range of parameter settings, but is also exact in various limiting cases.     

Estimation and identification of change points in panel models with nonstationary or stationary regressors and error term

This article studies the estimation of change point in panel models. We extend Bai (2010 Bai, J. (2010). Common breaks in means and variances for panel data. Journal of Econometrics 157:78–92.[Crossref], [Web of Science ®] , [Google Scholar]) and Feng et al. (2009 Feng, Q., Kao, C., Lazarová, S. (2009). Estimation and Identification of Change Points in Panel Models, Working paper, Syracuse University. [Google Scholar]) to the case of stationary or nonstationary regressors and error term, and whether the change point is present or not. We prove consistency and derive the asymptotic distributions of the Ordinary Least Squares (OLS) and First Difference (FD) estimators. We find that the FD estimator is robust for all cases considered.     

Learning-based EM algorithm for normal-inverse Gaussian mixture model with application to extrasolar planets

Karlis and Santourian [14 D. Karlis and A. Santourian, Model-based clustering with non-elliptically contoured distribution, Stat. Comput. 19 (2009), pp. 73–83. doi: 10.1007/s11222-008-9072-0[Crossref], [Web of Science ®] , [Google Scholar]] proposed a model-based clustering algorithm, the expectation–maximization (EM) algorithm, to fit the mixture of multivariate normal-inverse Gaussian (NIG) distribution. However, the EM algorithm for the mixture of multivariate NIG requires a set of initial values to begin the iterative process, and the number of components has to be given a priori. In this paper, we present a learning-based EM algorithm: its aim is to overcome the aforementioned weaknesses of Karlis and Santourian's EM algorithm [14 D. Karlis and A. Santourian, Model-based clustering with non-elliptically contoured distribution, Stat. Comput. 19 (2009), pp. 73–83. doi: 10.1007/s11222-008-9072-0[Crossref], [Web of Science ®] , [Google Scholar]]. The proposed learning-based EM algorithm was first inspired by Yang et al. [24 M.-S. Yang, C.-Y. Lai, and C.-Y. Lin, A robust EM clustering algorithm for Gaussian mixture models, Pattern Recognit. 45 (2012), pp. 3950–3961. doi: 10.1016/j.patcog.2012.04.031[Crossref], [Web of Science ®] , [Google Scholar]]: the process of how they perform self-clustering was then simulated. Numerical experiments showed promising results compared to Karlis and Santourian's EM algorithm. Moreover, the methodology is applicable to the analysis of extrasolar planets. Our analysis provides an understanding of the clustering results in the ln?P?ln?M and ln?P?e spaces, where M is the planetary mass, P is the orbital period and e is orbital eccentricity. Our identified groups interpret two phenomena: (1) the characteristics of two clusters in ln?P?ln?M space might be related to the tidal and disc interactions (see [9 I.G. Jiang, W.H. Ip, and L.C. Yeh, On the fate of close-in extrasolar planets, Astrophys. J. 582 (2003), pp. 449–454. doi: 10.1086/344590[Crossref], [Web of Science ®] , [Google Scholar]]); and (2) there are two clusters in ln?P?e space.     

Log-epsilon-skew normal: A generalization of the log-normal distribution

Abstract

The log-normal distribution is widely used to model non-negative data in many areas of applied research. In this paper, we introduce and study a family of distributions with non-negative reals as support and termed the log-epsilon-skew normal (LESN) which includes the log-normal distributions as a special case. It is related to the epsilon-skew normal developed in Mudholkar and Hutson (2000 Mudholkar, G. S., and A. D. Hutson. 2000. The epsilon-skew-normal distribution for analyzing near-normal data. Journal of Statistical Planning and Inference 83 (2):291–309. doi:10.1016/S0378-3758(99)00096-8.[Crossref], [Web of Science ®] , [Google Scholar]) the way the log-normal is related to the normal distribution. We study its main properties, hazard function, moments, skewness and kurtosis coefficients, and discuss maximum likelihood estimation of model parameters. We summarize the results of a simulation study to examine the behavior of the maximum likelihood estimates, and we illustrate the maximum likelihood estimation of the LESN distribution parameters to two real world data sets.     

On high-dimensional tests for mutual independence based on Pearson’s correlation coefficient

Abstract

This paper investigates a class of statistics based on Pearson’s correlation coefficient for testing the mutual independence of a random vector in high dimensions. Two existing statistics, proposed by Schott (2005 Schott, J. R. 2005. Testing for complete independence in high dimensions. Biometrika 92 (4):951–6. doi:10.1093/biomet/92.4.951.[Crossref], [Web of Science ®] , [Google Scholar]) and Mao (2014 Mao, G. 2014. A new test of independence for high-dimensional data. Statistics & Probability Letters 93:14–8. doi:10.1016/j.spl.2014.05.024.[Crossref], [Web of Science ®] , [Google Scholar]) respectively, are special cases of the class. A generic testing theory for the class of statistics is developed, which clarifies under what conditions the class of statistics can be employed for the testing purpose. By virtue of the theory, three new tests are introduced, and related statistical properties are discussed. To examine our theoretical findings and check the performance of the new tests, simulation studies are applied. The simulation results justify the theoretical findings and show that the newly introduced tests perform well, as long as both the dimension and the sample size of the data are moderately large.     

Survival analysis for a new compounded bivariate failure time distribution in shock and competing risk models via an EM algorithm

Abstract

In this paper, two bivariate models based on the proposed methods of Marshall and Olkin are introduced. In the first model, the new bivariate distribution is presented based on the proposed method of Marshall and Olkin (1967 Marshall, A. W., and I. Olkin. 1967. A multivariate exponential distribution. Journal of the American Statistical Association 62 (317):30–44. doi: 10.2307/2282907.[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]) which has natural interpretations, and it can be applied in fatal shock models or in competing risks models. In the second model, the proposed method of Marshall and Olkin (1997 Marshall, A. W., and I. Olkin. 1997. A new method of adding a parameter to a family of distributions with application to the exponential and weibull families. Biometrika 84 (3):641–52. doi: 10.1093/biomet/84.3.641.[Crossref], [Web of Science ®] , [Google Scholar]) is generalized to bivariate case and a new bivariate distribution is introduced. We call these new distributions as the bivariate Gompertz (BGP) distribution and bivariate Gompertz-geometric (BGPG) distribution, respectively. Moreover, the BGP model can be obtained as a special case of the BGPG model. Then, we present various properties of the new bivariate models. In this regard, the joint and conditional density functions, the joint cumulative distribution function can be obtained in compact forms. Also, the aging properties and the bivariate hazard gradient are discussed. This model has five unknown parameters and the maximum likelihood estimators cannot be obtained in explicit form. We propose to use the EM algorithm to compute the maximum likelihood estimators of the unknown parameters, and it is computationally quite tractable. Also, Monte Carlo simulations are performed to investigate the effectiveness of the proposed algorithm. Finally, we analyze three real data sets for illustrative purposes.     

Buffered Autoregressive Models With Conditional Heteroscedasticity: An Application to Exchange Rates

This article introduces a new model called the buffered autoregressive model with generalized autoregressive conditional heteroscedasticity (BAR-GARCH). The proposed model, as an extension of the BAR model in Li et al. (2015 Li, G.D., Guan, B., Li, W.K., and Yu, P. L.H. (2015), “Hysteretic Autoregressive Time Series Models,” Biometrika, 102, 717–723.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]), can capture the buffering phenomena of time series in both the conditional mean and variance. Thus, it provides us a new way to study the nonlinearity of time series. Compared with the existing AR-GARCH and threshold AR-GARCH models, an application to several exchange rates highlights the importance of the BAR-GARCH model.     

Adaptive estimation for varying coefficient models with nonstationary covariates

In this paper, the adaptive estimation for varying coefficient models proposed by Chen, Wang, and Yao (2015 Chen, Y., Q. Wang, and W. Yao. 2015. Adaptive estimation for varying coefficient models. Journal of Multivariate Analysis 137:17–31.[Crossref], [Web of Science ®] , [Google Scholar]) is extended to allowing for nonstationary covariates. The asymptotic properties of the estimator are obtained, showing different convergence rates for the integrated covariates and stationary covariates. The nonparametric estimator of the functional coefficient with integrated covariates has a faster convergence rate than the estimator with stationary covariates, and its asymptotic distribution is mixed normal. Moreover, the adaptive estimation is more efficient than the least square estimation for non normal errors. A simulation study is conducted to illustrate our theoretical results.