Learning-based EM algorithm for normal-inverse Gaussian mixture model with application to extrasolar planets

Karlis and Santourian [14 D. Karlis and A. Santourian, Model-based clustering with non-elliptically contoured distribution, Stat. Comput. 19 (2009), pp. 73–83. doi: 10.1007/s11222-008-9072-0[Crossref], [Web of Science ®] , [Google Scholar]] proposed a model-based clustering algorithm, the expectation–maximization (EM) algorithm, to fit the mixture of multivariate normal-inverse Gaussian (NIG) distribution. However, the EM algorithm for the mixture of multivariate NIG requires a set of initial values to begin the iterative process, and the number of components has to be given a priori. In this paper, we present a learning-based EM algorithm: its aim is to overcome the aforementioned weaknesses of Karlis and Santourian's EM algorithm [14 D. Karlis and A. Santourian, Model-based clustering with non-elliptically contoured distribution, Stat. Comput. 19 (2009), pp. 73–83. doi: 10.1007/s11222-008-9072-0[Crossref], [Web of Science ®] , [Google Scholar]]. The proposed learning-based EM algorithm was first inspired by Yang et al. [24 M.-S. Yang, C.-Y. Lai, and C.-Y. Lin, A robust EM clustering algorithm for Gaussian mixture models, Pattern Recognit. 45 (2012), pp. 3950–3961. doi: 10.1016/j.patcog.2012.04.031[Crossref], [Web of Science ®] , [Google Scholar]]: the process of how they perform self-clustering was then simulated. Numerical experiments showed promising results compared to Karlis and Santourian's EM algorithm. Moreover, the methodology is applicable to the analysis of extrasolar planets. Our analysis provides an understanding of the clustering results in the ln?P?ln?M and ln?P?e spaces, where M is the planetary mass, P is the orbital period and e is orbital eccentricity. Our identified groups interpret two phenomena: (1) the characteristics of two clusters in ln?P?ln?M space might be related to the tidal and disc interactions (see [9 I.G. Jiang, W.H. Ip, and L.C. Yeh, On the fate of close-in extrasolar planets, Astrophys. J. 582 (2003), pp. 449–454. doi: 10.1086/344590[Crossref], [Web of Science ®] , [Google Scholar]]); and (2) there are two clusters in ln?P?e space.     

Local influence diagnostics for generalized linear mixed models with overdispersion

Since the seminal paper by Cook and Weisberg [9 R.D. Cook and S. Weisberg, Residuals and Influence in Regression, Chapman &; Hall, London, 1982. [Google Scholar]], local influence, next to case deletion, has gained popularity as a tool to detect influential subjects and measurements for a variety of statistical models. For the linear mixed model the approach leads to easily interpretable and computationally convenient expressions, not only highlighting influential subjects, but also which aspect of their profile leads to undue influence on the model's fit [17 E. Lesaffre and G. Verbeke, Local influence in linear mixed models, Biometrics 54 (1998), pp. 570–582. doi: 10.2307/3109764[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]]. Ouwens et al. [24 M.J.N.M. Ouwens, F.E.S. Tan, and M.P.F. Berger, Local influence to detect influential data structures for generalized linear mixed models, Biometrics 57 (2001), pp. 1166–1172. doi: 10.1111/j.0006-341X.2001.01166.x[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]] applied the method to the Poisson-normal generalized linear mixed model (GLMM). Given the model's nonlinear structure, these authors did not derive interpretable components but rather focused on a graphical depiction of influence. In this paper, we consider GLMMs for binary, count, and time-to-event data, with the additional feature of accommodating overdispersion whenever necessary. For each situation, three approaches are considered, based on: (1) purely numerical derivations; (2) using a closed-form expression of the marginal likelihood function; and (3) using an integral representation of this likelihood. Unlike when case deletion is used, this leads to interpretable components, allowing not only to identify influential subjects, but also to study the cause thereof. The methodology is illustrated in case studies that range over the three data types mentioned.     

Buffered Autoregressive Models With Conditional Heteroscedasticity: An Application to Exchange Rates

This article introduces a new model called the buffered autoregressive model with generalized autoregressive conditional heteroscedasticity (BAR-GARCH). The proposed model, as an extension of the BAR model in Li et al. (2015 Li, G.D., Guan, B., Li, W.K., and Yu, P. L.H. (2015), “Hysteretic Autoregressive Time Series Models,” Biometrika, 102, 717–723.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]), can capture the buffering phenomena of time series in both the conditional mean and variance. Thus, it provides us a new way to study the nonlinearity of time series. Compared with the existing AR-GARCH and threshold AR-GARCH models, an application to several exchange rates highlights the importance of the BAR-GARCH model.     

Adaptive estimation for varying coefficient models with nonstationary covariates

In this paper, the adaptive estimation for varying coefficient models proposed by Chen, Wang, and Yao (2015 Chen, Y., Q. Wang, and W. Yao. 2015. Adaptive estimation for varying coefficient models. Journal of Multivariate Analysis 137:17–31.[Crossref], [Web of Science ®] , [Google Scholar]) is extended to allowing for nonstationary covariates. The asymptotic properties of the estimator are obtained, showing different convergence rates for the integrated covariates and stationary covariates. The nonparametric estimator of the functional coefficient with integrated covariates has a faster convergence rate than the estimator with stationary covariates, and its asymptotic distribution is mixed normal. Moreover, the adaptive estimation is more efficient than the least square estimation for non normal errors. A simulation study is conducted to illustrate our theoretical results.     

Test for comparing complete expectations of life of two groups

Abstract

Complete expectation of life of an individual gives an intuitive and interesting perspective on the ageing process and is an important concept in the insurance sector for determination of premium. We propose a new test for testing equality of complete expectations of life of two groups/populations. Power of the new test is calculated through simulations and compared with the power of the tests given by Berger, Boos, and Guess (1988 Berger, R. L., D. D. Boos, and F. M. Guess. 1988. Tests and confidence sets for comparing two mean residual life functions. Biometrics 44 (1):103–15.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]) and Aly (1997 Aly, E. E. A. A. 1997. Nonparametric tests for comparing two mean residual life functions. Lifetime Data Analysis 3 (4):353–66.[Crossref], [PubMed] , [Google Scholar]). It is observed that the proposed test statistic is more powerful than the competing tests for the cases considered in this paper. A real life illustration is included.     

Inference on locally ordered breaks in multiple regressions

We consider issues related to inference about locally ordered breaks in a system of equations, as originally proposed by Qu and Perron (2007 Qu, Z., Perron, P. (2007). Estimating and testing structural changes in multivariate regressions. Econometrica 75:459–502.[Crossref], [Web of Science ®] , [Google Scholar]). These apply when break dates in different equations within the system are not separated by a positive fraction of the sample size. This allows constructing joint confidence intervals of all such locally ordered break dates. We extend the results of Qu and Perron (2007 Qu, Z., Perron, P. (2007). Estimating and testing structural changes in multivariate regressions. Econometrica 75:459–502.[Crossref], [Web of Science ®] , [Google Scholar]) in several directions. First, we allow the covariates to be any mix of trends and stationary or integrated regressors. Second, we allow for breaks in the variance-covariance matrix of the errors. Third, we allow for multiple locally ordered breaks, each occurring in a different equation within a subset of equations in the system. Via some simulation experiments, we show first that the limit distributions derived provide good approximations to the finite sample distributions. Second, we show that forming confidence intervals in such a joint fashion allows more precision (tighter intervals) compared to the standard approach of forming confidence intervals using the method of Bai and Perron (1998 Bai, J., Perron, P. (1998). Estimating and testing linear models with multiple structural changes. Econometrica 66:47–78.[Crossref], [Web of Science ®] , [Google Scholar]) applied to a single equation. Simulations also indicate that using the locally ordered break confidence intervals yields better coverage rates than using the framework for globally distinct breaks when the break dates are separated by roughly 10% of the total sample size.     

Estimation of nonseparable models with censored dependent variables and endogenous regressors

In this article we develop a nonparametric estimator for the local average response of a censored dependent variable to endogenous regressors in a nonseparable model where the unobservable error term is not restricted to be scalar and where the nonseparable function need not be monotone in the unobservables. We formalize the identification argument put forward in Altonji, Ichimura, and Otsu (2012 Altonji, J. G., Ichimura, H., Otsu, T. (2012). Estimating derivatives in nonseparable models with limited dependent variables. Econometrica 80:1701–1719.[Crossref], [Web of Science ®] , [Google Scholar]), construct a nonparametric estimator, characterize its asymptotic property, and conduct a Monte Carlo investigation to study its small sample properties. Identification is constructive and is achieved through a control function approach. We show that the estimator is consistent and asymptotically normally distributed. The Monte Carlo results are encouraging.     

On generalized exponential chain ratio estimators under stratified two-phase random sampling

Sanaullah et al. (2014 Sanaullah, A., Ali, H.M., Noor ul Amin, M., Hanif, M. (2014). Generalized exponential chain ratio estimators under stratified two-phase random sampling. Appl. Math. Comput. 226:541–547.[Crossref], [Web of Science ®] , [Google Scholar]) have suggested generalized exponential chain ratio estimators under stratified two-phase sampling scheme for estimating the finite population mean. However, the bias and mean square error (MSE) expressions presented in that work need some corrections, and consequently the study based on efficiency comparison also requires corrections. In this article, we revisit Sanaullah et al. (2014 Sanaullah, A., Ali, H.M., Noor ul Amin, M., Hanif, M. (2014). Generalized exponential chain ratio estimators under stratified two-phase random sampling. Appl. Math. Comput. 226:541–547.[Crossref], [Web of Science ®] , [Google Scholar]) estimator and provide the correct bias and MSE expressions of their estimator. We also propose an estimator which is more efficient than several competing estimators including the classes of estimators in Sanaullah et al. (2014 Sanaullah, A., Ali, H.M., Noor ul Amin, M., Hanif, M. (2014). Generalized exponential chain ratio estimators under stratified two-phase random sampling. Appl. Math. Comput. 226:541–547.[Crossref], [Web of Science ®] , [Google Scholar]). Three real datasets are used for efficiency comparisons.     

Weighted simulated integrated conditional moment tests for parametric conditional distributions of stationary time series processes

In this article, we propose a weighted simulated integrated conditional moment (WSICM) test of the validity of parametric specifications of conditional distribution models for stationary time series data, by combining the weighted integrated conditional moment (ICM) test of Bierens (1984 Bierens, H. J. (1984). Model specification testing of time series regressions. Journal of Econometrics 26:323–353.[Crossref], [Web of Science ®] , [Google Scholar]) for time series regression models with the simulated ICM test of Bierens and Wang (2012 Bierens, H. J., Wang, L. (2012). Integrated conditional moment tests for parametric conditional distributions. Econometric Theory 28:328–362.[Crossref], [Web of Science ®] , [Google Scholar]) of conditional distribution models for cross-section data. To the best of our knowledge, no other consistent test for parametric conditional time series distributions has been proposed yet in the literature, despite consistency claims made by some authors.     

Nonparametric test for stratum effects in the cox model with interval-censored data

The testing of the stratum effects in the Cox model is an important and commonly asked question in medical research as well as in many other fields. In this paper, we will discuss the problem where one observes interval-censored failure time data and generalize the procedure given in Sun and Yang (2000 Sun, J., and I. Yang. 2000. Nonparametric test for stratum effects in the cox model. Lifetime Data Analysis 6:321–30.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]) for right-censored data. The asymptotic distribution of the new test statistic is established and the simulation study conducted for the evaluation of the finite sample properties of the method suggests that the generalized procedure seems to work well for practical situations. An application is provided.     

A nonparametric specification test for the volatility functions of diffusion processes

This paper develops a new test for the parametric volatility function of a diffusion model based on nonparametric estimation techniques. The proposed test imposes no restriction on the functional form of the drift function and has an asymptotically standard normal distribution under the null hypothesis of correct specification. It is consistent against any fixed alternatives and has nontrivial asymptotic power against a class of local alternatives with proper rates. Monte Carlo simulations show that the test performs well in finite samples and generally has better power performance than the nonparametric test of Li (2007 Li, F. (2007). Testing the parametric specification of the diffusion function in a diffusion process. Econometric Theory 23(2):221–250.[Crossref], [Web of Science ®] , [Google Scholar]) and the stochastic process-based tests of Dette and Podolskij (2008 Dette, H., Podolskij, M. (2008). Testing the parametric form of the volatility in continuous time diffusion models–a stochastic process approach. Journal of Econometrics 143(1):56–73.[Crossref], [Web of Science ®] , [Google Scholar]). When applying the test to high frequency data of EUR/USD exchange rate, the empirical results show that the commonly used volatility functions fit more poorly when the data frequency becomes higher, and the general volatility functions fit relatively better than the constant volatility function.     

An objective Bayesian estimation in a two-period crossover design

Two-period crossover design is one of the commonly used designs in clinical trials. But, the estimation of treatment effect is complicated by the possible presence of carryover effect. It is known that ignoring the carryover effect when it exists can lead to poor estimates of the treatment effect. The classical approach by Grizzle (1965 Grizzle, J.E. (1965). The two-period change-over design and its use in clinical trials. Biometrics 21:467–480. See Grizzle (1974) for corrections.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]) consists of two stages. First, a preliminary test is conducted on carryover effect. If the carryover effect is significant, analysis is based only on data from period one; otherwise, analysis is based on data from both periods. A Bayesian approach with improper priors was proposed by Grieve (1985 Grieve, A.P. (1985). A Bayesian analysis of the two-period crossover design for clinical trials. Biometrics 41:979–990.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]) which uses a mixture of two models: a model with carryover effect and another without. The indeterminacy of the Bayes factor due to the arbitrary constant in the improper prior was addressed by assigning a minimally discriminatory value to the constant. In this article, we present an objective Bayesian estimation approach to the two-period crossover design which is also based on a mixture model, but using the commonly recommended Zellner–Siow g-prior. We provide simulation studies and a real data example and compare the numerical results with Grizzle (1965 Grizzle, J.E. (1965). The two-period change-over design and its use in clinical trials. Biometrics 21:467–480. See Grizzle (1974) for corrections.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar])’s and Grieve (1985 Grieve, A.P. (1985). A Bayesian analysis of the two-period crossover design for clinical trials. Biometrics 41:979–990.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar])’s approaches.     

Characterization results based on dynamic Tsallis cumulative residual entropy

In this article, the concept of cumulative residual entropy (CRE) given by Rao et al. (2004 Rao, M., Chen, Y., Vemuri, B.C., Wang, F. (2004). Cumulative residual entropy: A new measure of information. IEEE Trans. Inf. Theory 50:1220–1228.[Crossref], [Web of Science ®] , [Google Scholar]) is extended to Tsallis entropy function and dynamic version, both residual and past of it. We study some properties and characterization results for these generalized measures. In addition, we provide some characterization results of the first-order statistic based on the Tsallis survival entropy.     

On weighted cumulative residual entropy

In analogy with the weighted Shannon entropy proposed by Belis and Guiasu (1968 Belis, M., Guiasu, S. (1968). A quantitative-qualitative measure of information in cybernetic systems. IEEE Trans. Inf. Th. IT-4:593–594.[Crossref], [Web of Science ®] , [Google Scholar]) and Guiasu (1986 Guiasu, S. (1986). Grouping data by using the weighted entropy. J. Stat. Plann. Inference 15:63–69.[Crossref], [Web of Science ®] , [Google Scholar]), we introduce a new information measure called weighted cumulative residual entropy (WCRE). This is based on the cumulative residual entropy (CRE), which is introduced by Rao et al. (2004 Rao, M., Chen, Y., Vemuri, B.C., Wang, F. (2004). Cumulative residual entropy: a new measure of information. IEEE Trans. Info. Theory 50(6):1220–1228.[Crossref], [Web of Science ®] , [Google Scholar]). This new information measure is “length-biased” shift dependent that assigns larger weights to larger values of random variable. The properties of WCRE and a formula relating WCRE and weighted Shannon entropy are given. Related studies of reliability theory is covered. Our results include inequalities and various bounds to the WCRE. Conditional WCRE and some of its properties are discussed. The empirical WCRE is proposed to estimate this new information measure. Finally, strong consistency and central limit theorem are provided.     

On dynamic weighted survival entropy of order α

Recently, Abbasnejad et al. (2010 Abbasnejad, M., Arghami, N.R., Morgenthaler, S., Mohtashami Borzadaran, G.R. (2010). On the dynamic survival entropy. Stat. Probab. Lett. 80:1962–1971.[Crossref], [Web of Science ®] , [Google Scholar]) proposed a measure of uncertainty based on survival function, called the survival entropy of order α. A dynamic form of the survival entropy of order α is also proposed by them. In this paper, we derive the weighted form of these measures. The properties of the new measures are also discussed.     

A Bayesian control chart for a common coefficient of variation

By using the medical data analyzed by Kang et al. (2007 Kang, C.W., Lee, M.S., Seong, Y.J., Hawkins, D.M. (2007). A control chart for the coefficient of variation. J. Qual. Technol. 39(2):151–158.[Taylor &; Francis Online], [Web of Science ®] , [Google Scholar]), a Bayesian procedure is applied to obtain control limits for the coefficient of variation. Reference and probability matching priors are derived for a common coefficient of variation across the range of sample values. By simulating the posterior predictive density function of a future coefficient of variation, it is shown that the control limits are effectively identical to those obtained by Kang et al. (2007 Kang, C.W., Lee, M.S., Seong, Y.J., Hawkins, D.M. (2007). A control chart for the coefficient of variation. J. Qual. Technol. 39(2):151–158.[Taylor &; Francis Online], [Web of Science ®] , [Google Scholar]) for the specific dataset they used. This article illustrates the flexibility and unique features of the Bayesian simulation method for obtaining posterior distributions, predictive intervals, and run-lengths in the case of the coefficient of variation. A simulation study shows that the 95% Bayesian confidence intervals for the coefficient of variation have the correct frequentist coverage.     

A new efficient unrelated randomized response model

The present paper suggests an interesting and useful ramification of the unrelated randomized response model due to Pal and Singh (2012 Pal, S., and S. Singh. 2012. A new unrelated question randomized response model. Statistics 46 (1):99–109.[Taylor &; Francis Online], [Web of Science ®] , [Google Scholar]) [A new unrelated question randomized response model. Statistics 46 (1), 99–109] that can be used for any sampling scheme. We have shown theoretically and numerically that the proposed model is more efficient than Pal and Singh (2012 Pal, S., and S. Singh. 2012. A new unrelated question randomized response model. Statistics 46 (1):99–109.[Taylor &; Francis Online], [Web of Science ®] , [Google Scholar]) model.     

On extreme order statistics from heterogeneous beta distributions with applications

This paper treats the problem of stochastic comparisons for the extreme order statistics arising from heterogeneous beta distributions. Some sufficient conditions involved in majorization-type partial orders are provided for comparing the extreme order statistics in the sense of various magnitude orderings including the likelihood ratio order, the reversed hazard rate order, the usual stochastic order, and the usual multivariate stochastic order. The results established here strengthen and extend those including Kochar and Xu (2007 Kochar, S.C., Xu, M. (2007). Stochastic comparisons of parallel systems when components have proportional hazard rates. Probab. Eng. Inf. Sci. 21:597–609.[Crossref], [Web of Science ®] , [Google Scholar]), Mao and Hu (2010 Mao, T., Hu, T. (2010). Equivalent characterizations on orderings of order statistics and sample ranges. Probab. Eng. Inf. Sci. 24:245–262.[Crossref], [Web of Science ®] , [Google Scholar]), Balakrishnan et al. (2014 Balakrishnan, N., Barmalzan, G., Haidari, A. (2014). On usual multivariate stochastic ordering of order statistics from heterogeneous beta variables. J. Multivariate Anal. 127:147–150.[Crossref], [Web of Science ®] , [Google Scholar]), and Torrado (2015 Torrado, N. (2015). On magnitude orderings between smallest order statistics from heterogeneous beta distributions. J. Math. Anal. Appl. 426:824–838.[Crossref], [Web of Science ®] , [Google Scholar]). A real application in system assembly and some numerical examples are also presented to illustrate the theoretical results.     

Linear transformation models for survival analysis with tumor growth information in cancer screening study

The complication in analyzing tumor data is that the tumors detected in a screening program tend to be slowly progressive tumors, which is the so-called left-truncated sampling that is inherent in screening studies. Under the assumption that all subjects have the same tumor growth function, Ghosh (2008 Ghosh, D. (2008). Proportional hazards regression for cancer studies. Biometrics 64:141–148.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]) developed estimation procedures for the Cox proportional hazards model. Shen (2011a Shen, P.-S. (2011a). Proportional hazards regression for cancer screening data. J. Stat. Comput. Simul. 18:367–377.[Taylor &; Francis Online], [Web of Science ®] , [Google Scholar]) demonstrated that Ghosh (2008 Ghosh, D. (2008). Proportional hazards regression for cancer studies. Biometrics 64:141–148.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar])'s approach can be extended to the case when each subject has a specific growth function. In this article, under linear transformation model, we present a general framework to the analysis of data from cancer screening studies. We developed estimation procedures under linear transformation model, which includes Cox's model as a special case. A simulation study is conducted to demonstrate the potential usefulness of the proposed estimators.     

Optimal allocations of coverage limits for two independent random losses of insurance policy

This article recasts the optimal allocations of coverage limits for two independent random losses. Under some regularity conditions on the two concerned probability density functions, we build the sufficient and necessary condition for the existence of the optimal allocation of coverage limits, and derive the optimal allocation whenever they do exist. The results supplement Lu and Meng (2011 Lu, Z.Y., Meng, L.L. (2011). Stochastic comparisons for allocations of upper limits and deductibles with applications. Insur.: Math. Econ. 48:338–343.[Crossref], [Web of Science ®] , [Google Scholar], Proposition 5.2) and Hu and Wang (2014 Hu, S., Wang, R. (2014). Stochastic comparisons and optimal allocation for policy limits and deductibles. Commun. Stat. – Theory Methods 43:151–164.[Taylor &; Francis Online], [Web of Science ®] , [Google Scholar], Theorem 5.1).