EM-based algorithms for autoregressive models with t-distributed innovations

This paper considers the estimation of parameters of AR(p) models for time series with t-distribution via EM-based algorithms. The paper develops asymptotic properties for the estimation to show that the estimators are efficient. Also testing theory for the estimators is considered. The robustness of the estimators and various tests to deviations from an assumed model is investigated. The study shows that the algorithms have equal estimation efficiency even if the error distribution is miss-specified or perturbed by outliers. Interestingly, the estimators from these algorithms performed better than that of the Modified Maximum Likelihood (MML) considered in Tiku et al. (2000 Tiku, M. L., Wong, W. K., Vaughan, D. C., Bian, G. (2000). Time series models in non-normal situations: Symmetric innovations. Journal of Time Series Analysis, 21: 571–596. [Google Scholar]).     

NONNORMAL REGRESSION. II. SYMMETRIC DISTRIBUTIONS

Salient features of a family of short-tailed symmetric distributions, introduced recently by Tiku and Vaughan [1] Tiku, M. L. and Vaughan, D. C. 1999. “A family of short-tailed symmetric distributions”. In Technical Report Canada: McMaster University.  [Google Scholar], are enunciated. Assuming the error distribution to be one of this family, the methodology of modified likelihood is used to derive MML estimators of parameters in a linear regression model. The estimators are shown to be efficient, and robust to inliers. This paper is essentially the first to achieve robustness to inliers. The methodology is extended to long-tailed symmetric distributions and the resulting estimators are shown to be efficient, and robust to outliers. This paper should be read in conjunction with Islam et al. [2] Islam, Q., Tiku, M. L. and Yildirim, F. 2001. Nonnormal regression, Part I: Skew distributions. Commun. Stat.—Theory Meth., to appear [Google Scholar]who develop modified likelihood methodology for skew distributions in the context of linear regression.     

SECOND-ORDER ASYMPTOTICS FOR SCORE TESTS IN HETEROSKEDASTIC t REGRESSION MODELS

ABSTRACT

This paper develops corrected score tests for heteroskedastic t regression models, thus generalizing results by Cordeiro, Ferrari and Paula[1] Cordeiro, G.M., Ferrari, S.L.P. and Paula, G.A. 1993. Improved Score Tests for Generalized Linear Models. Journal of the Royal Statistical Society B, 55: 661–674.  [Google Scholar] and Cribari-Neto and Ferrari[2] Cribari-Neto, F. and Ferrari, S.L.P. 1995. Second-order Asymptotics for Score Tests in Generalised Linear Models. Biometrika, 82: 426–432. [Crossref], [Web of Science ®] , [Google Scholar] for normal regression models and by Ferrari and Arellano-Valle[3] Ferrari, S.L.P. and Arellano-Valle, R. 1996. Modified Likelihood Ratio and Score Tests in Linear Regression Models Using the t Distribution. Brazilian Journal of Probability and Statistics, 10: 15–33.  [Google Scholar] for homoskedastic t regression models. We present, in matrix notation, Bartlett-type correction formulae to improve score tests in this class of models. The corrected score statistics have a chi-squared distribution to order n ^?1, where n is the sample size. We apply our main result to a few special models and present simulation results comparing the performance of the usual score tests and their corrected versions.     

Marginal correlation from an extended random-effects model for repeated and overdispersed counts

Vangeneugden et al. [15 Vangeneugden, T., Molenberghs, G., Laenen, A., Geys, H., Beunckens, C. and Sotto, C. 2007. Marginal correlation in longitudinal binary data based on generalized linear mixed models, Tech. Rep., Hasselt University. submitted for publication [Google Scholar]] derived approximate correlation functions for longitudinal sequences of general data type, Gaussian and non-Gaussian, based on generalized linear mixed-effects models (GLMM). Their focus was on binary sequences, as well as on a combination of binary and Gaussian sequences. Here, we focus on the specific case of repeated count data, important in two respects. First, we employ the model proposed by Molenberghs et al. [13 Molenberghs, G., Verbeke, G. and Demétrio, C. G.B. 2007. An extended random-effects approach to modeling repeated, overdispersed count data. Lifetime Data Anal., 13: 513–531. [Crossref], [PubMed], [Web of Science ®] [Google Scholar]], which generalizes at the same time the Poisson-normal GLMM and the conventional overdispersion models, in particular the negative-binomial model. The model flexibly accommodates data hierarchies, intra-sequence correlation, and overdispersion. Second, means, variances, and joint probabilities can be expressed in closed form, allowing for exact intra-sequence correlation expressions. Next to the general situation, some important special cases such as exchangeable clustered outcomes are considered, producing insightful expressions. The closed-form expressions are contrasted with the generic approximate expressions of Vangeneugden et al. [15 Vangeneugden, T., Molenberghs, G., Laenen, A., Geys, H., Beunckens, C. and Sotto, C. 2007. Marginal correlation in longitudinal binary data based on generalized linear mixed models, Tech. Rep., Hasselt University. submitted for publication [Google Scholar]]. Data from an epileptic-seizures trial are analyzed and correlation functions derived. It is shown that the proposed extension strongly outperforms the classical GLMM.     

Estimation of the Bias of the Maximum Likelihood Estimators in an Extreme Value Context

Interest is centered on the maximum likelihood (ML) estimators of the parameters of the Generalized Pareto Distribution in an extreme value context. Our aim consists of reducing the bias of these estimates for which no explicit expression is available. To circumvent this difficulty, we prove that these estimators are asymptotically equivalent to one-step estimators introduced by Beirlant et al. (2010 Beirlant , J. , Guillou , A. , Toulemonde , G. ( 2010 ). Peaks-over-threshold modeling under random censoring . Commun. Statist. Theor. Meth.  [Google Scholar]) in a right-censoring context. Then, using this equivalence property, we estimate the bias of these one-step estimators to approximate the asymptotic bias of the ML-estimators. Finally, a small simulation study and an application to a real data set are provided to illustrate that these new estimators actually exhibit reduced bias.     

ESTIMATION OF PARAMETERS IN ARFIMA PROCESSES: A SIMULATION STUDY

It is known that, in the presence of short memory components, the estimation of the fractional parameter d in an Autoregressive Fractionally Integrated Moving Average, ARFIMA(p, d, q), process has some difficulties (see [1] Smith, J., Taylor, N. and Yadav, S. 1997. Comparing the bias and misspecification in ARFIMA models. Journal of Time Series Analysis, 18(5): 507–527. [Crossref] , [Google Scholar]). In this paper, we continue the efforts made by Smith et al. [1] Smith, J., Taylor, N. and Yadav, S. 1997. Comparing the bias and misspecification in ARFIMA models. Journal of Time Series Analysis, 18(5): 507–527. [Crossref] , [Google Scholar] and Beveridge and Oickle [2] Beveridge, S. and Oickle, C. 1993. Estimating fractionally integrated time series models. Economics Letters, 43: 137–142.  [Google Scholar] by conducting a simulation study to evaluate the convergence properties of the iterative estimation procedure suggested by Hosking [3] Hosking, J. 1981. Fractional differencing. Biometrika, 68(1): 165–176. [Crossref], [Web of Science ®] , [Google Scholar]. In this context we consider some semiparametric approaches and a parametric method proposed by Fox-Taqqu[4] Fox, R. and Taqqu, M. S. 1986. Large-sample properties of parameter estimates for strongly dependent stationary gaussian time series. The Annals of Statistics, 14(2): 517–532. [Crossref], [Web of Science ®] , [Google Scholar]. We also investigate the method proposed by Robinson [5] Robinson, P. M. 1995a. Log-periodogram regression of time series with long range dependence. The Annals of Statistics, 23(3): 1048–1072. [Crossref], [Web of Science ®] , [Google Scholar] and a modification using the smoothed periodogram function.     

Performance of Some Ridge Parameters for Probit Regression: With Application to Swedish Job Search Data

In ridge regression, the estimation of the ridge parameter is an important issue. This article generalizes some methods for estimating the ridge parameter for probit ridge regression (PRR) model based on the work of Kibria et al. (2011 Kibria, B. M. G., Månsson, K. and Shukur, G. 2011. Performance of some logistic ridge regression parameters. Computational Economics, DOI: 10.1007/s10614-011-9275-x [Google Scholar]). The performance of these new estimators is judged by calculating the mean squared error (MSE) using Monte Carlo simulations. In the design of the experiment, we chose to vary the sample size and the number of regressors. Furthermore, we generate explanatory variables that are linear combinations of other regressors, which is a common situation in economics. In an empirical application regarding Swedish job search data, we also illustrate the benefits of the new method.     

Statistical Analysis of the Log-Normal Distribution under Type-II Progressive Hybrid Censoring Schemes

In this article, we obtain the maximum likelihood estimators (MLEs) and approximate maximum likelihood estimators (AMLEs) of the parameters, from a two-parameter log-normal distribution based on the adaptive Type-II progressive hybrid censoring scheme, which was introduced by Ng et al. (2009 Ng , H. K. T. , Kundu , D. , Chan , P. S. ( 2009 ). Statistical analysis of exponential lifetimes under an adaptive Type-II progressively censoring scheme . Naval Research Logistics 56 : 687 – 698 .[Crossref], [Web of Science ®] , [Google Scholar]) for life testing or reliability experiment. In order to compare the results, we calculate corresponding estimators of the Type-II progressive hybrid censoring scheme. In particular, we provide computational formulas of the expected total test time and the expected number of failures for each scheme. We also compute the observed Fisher information matrix and use them to obtain the asymptotic confidence intervals. A simulation study carries out to evaluate the bias and mean square error of the MLEs and AMLEs from the two above-mentioned schemes. Finally, we present a numerical example to illustrate the methods of inference discussed here.     

More on the Kronecker Structured Covariance Matrix

In this article, the multivariate normal distribution with a Kronecker product structured covariance matrix is studied. Particularly focused is the estimation of a Kronecker structured covariance matrix of order three, the so called double separable covariance matrix. The suggested estimation generalizes the procedure proposed by Srivastava et al. (2008 Srivastava , M. , von Rosen , T. , von Rosen , D. ( 2008 ). Models with a Kronecker product covariance structure: Estimation and testing Mathemat. Meth. Statist. 17 : 357 – 370 .[Crossref] , [Google Scholar]) for a separable covariance matrix. The restrictions imposed by separability and double separability are also discussed.     

Tail Behavior and Extremes of Short-Tailed Symmetric Distribution

Tiku and Vaughan (1999 Tiku , M. L. , Vaughan , D. C. ( 1999 ). A Family of Short-tailed Symmetric Distributions. Technical Report, McMaster University, Canada . [Google Scholar]) introduced a short-tailed symmetric family recently. In the article, the tail properties of the short-tailed symmetric distribution are studied and the asymptotic distribution of the maximum of i.i.d. random variables obeying the short-tailed distribution is gained.     

Geometric View of Measurement Errors

The slope of the best fit line from minimizing the sum of the squared oblique errors is the root of a polynomial of degree four. This geometric view of measurement errors is used to give insight into the performance of various slope estimators for the measurement error model including an adjusted fourth moment estimator introduced by Gillard and Iles (2005 Gillard , J. , Iles , T. ( 2005 ). Method of moments estimation in linear regression with errors in both variables, Cardiff University School of Mathematics Technical Report, Cardiff, Wales, UK . [Google Scholar]) to remove the jump discontinuity in the estimator of Copas (1972 Copas , J. ( 1972 ). The likelihood surface in the linear functional relationship problem . Journal of the Royal Statistical Society. Series B (Methodological) 34 : 274 – 278 . [Google Scholar]). The polynomial of degree four is associated with a minimun deviation estimator. A simulation study compares these estimators showing improvement in bias and mean squared error.     

Some Classes of Estimators for the Population Median Using Auxiliary Information

This article considers some classes of estimators of the population median of the study variable using information on an auxiliary variable with their properties under large sample approximation. Asymptotic optimum estimator (AOE) in each class of estimators has been investigated along with the approximate mean square error formulae. It has been shown that the proposed classes of estimators are better than these considered by Gross (1980 Gross , T. S. ( 1980 ). Median estimation in sample surveys. Proc. Surv. Res. Meth. Sect. Amer. Statist. Assoc. 181–184 . [Google Scholar]), Kuk and Mak (1989 Kuk , A. Y. C. , Mak , T. K. ( 1989 ). Median estimation in the presence of auxiliary information . J. Roy. Statist. Soc. Ser. B51 : 261 – 269 . [Google Scholar]), Singh et al. (2003a Singh , H. P. , Singh , S. , Joarder , A. H. ( 2003a ). Estimation of population median when mode of an auxiliary variable is known . J. Statist. Res. 37 ( 1 ): 57 – 63 . [Google Scholar]), and Al and Cingi (2009 Al , S. , Cingi , H. ( 2009 ). New estimators for the population median in simple random sampling. Tenth Islamic Countries Conference on Statistical Sciences, held in New Cairo, Egypt . [Google Scholar]). An empirical study is carried out to judge the merits of the suggested class of estimators over other existing estimators.     

Comparison of Frailty Models for Acute Leukemia Data under Gompertz Baseline Distribution

In this article, we consider two different shared frailty regression models under the assumption of Gompertz as baseline distribution. Mostly assumption of gamma distribution is considered for frailty distribution. To compare the results with gamma frailty model, we consider the inverse Gaussian shared frailty model also. We compare these two models to a real life bivariate survival data set of acute leukemia remission times (Freireich et al., 1963 Freireich, E.J., Gehan, E., Frei, E., Schroeder, L.R., Wolman, I.J., Anbari, R., Burgert, E.O., Mills, S.D., Pinkel, D., Selawry, O.S., Moon, J.H., Gendel, B.R., Spurr, C.L., Storrs, R., Haurani, F., Hoogstraten, B., Lee, S. (1963). The effect of 6-mercaptopurine on the duration of steroid-induced remissions in acute leukemia: a model for evaluation of other potentially useful therapy. Blood 21:699–716.[Web of Science ®] , [Google Scholar]). Analysis is performed using Markov Chain Monte Carlo methods. Model comparison is made using Bayesian model selection criterion and a well-fitted model is suggested for the acute leukemia data.     

On generalized exponential chain ratio estimators under stratified two-phase random sampling

Sanaullah et al. (2014 Sanaullah, A., Ali, H.M., Noor ul Amin, M., Hanif, M. (2014). Generalized exponential chain ratio estimators under stratified two-phase random sampling. Appl. Math. Comput. 226:541–547.[Crossref], [Web of Science ®] , [Google Scholar]) have suggested generalized exponential chain ratio estimators under stratified two-phase sampling scheme for estimating the finite population mean. However, the bias and mean square error (MSE) expressions presented in that work need some corrections, and consequently the study based on efficiency comparison also requires corrections. In this article, we revisit Sanaullah et al. (2014 Sanaullah, A., Ali, H.M., Noor ul Amin, M., Hanif, M. (2014). Generalized exponential chain ratio estimators under stratified two-phase random sampling. Appl. Math. Comput. 226:541–547.[Crossref], [Web of Science ®] , [Google Scholar]) estimator and provide the correct bias and MSE expressions of their estimator. We also propose an estimator which is more efficient than several competing estimators including the classes of estimators in Sanaullah et al. (2014 Sanaullah, A., Ali, H.M., Noor ul Amin, M., Hanif, M. (2014). Generalized exponential chain ratio estimators under stratified two-phase random sampling. Appl. Math. Comput. 226:541–547.[Crossref], [Web of Science ®] , [Google Scholar]). Three real datasets are used for efficiency comparisons.     

Minimum Divergence,Generalized Empirical Likelihoods,and Higher Order Expansions

This article studies the minimum divergence (MD) class of estimators for econometric models specified through moment restrictions. We show that MD estimators can be obtained as solutions to a tractable lower dimensional optimization problem. This problem is similar to the one solved by the generalized empirical likelihood estimators of Newey and Smith (2004 Newey , W. K. , Smith , R. J. ( 2004 ). Higher order properties of GMM and Generalized Empirical Likelihood estimators . Econometrica 72 : 219 – 255 .[Crossref], [Web of Science ®] , [Google Scholar]), but it is equivalent to it only for a subclass of divergences. The MD framework provides a coherent testing theory: tests for overidentification and parametric restrictions in this framework can be interpreted as semiparametric versions of Pearson-type goodness of fit tests. The higher order properties of MD estimators are also studied and it is shown that MD estimators that have the same higher order bias as the empirical likelihood (EL) estimator also share the same higher order mean square error and are all higher order efficient. We identify members of the MD class that are not only higher order efficient, but also, unlike the EL estimator, well behaved when the moment restrictions are misspecified.     

Selection of Binary Variables and Classification by Boosting

We adopt boosting for classification and selection of high-dimensional binary variables for which classical methods based on normality and non singular sample dispersion are inapplicable. Boosting seems particularly well suited for binary variables. We present three methods of which two combine boosting with the relatively classical variable selection methods developed in Wilbur et al. (2002 Wilbur , J. D. , Ghosh , J. K. , Nakatsu , C. H. , Brouder , S. M. , Doerge , R. W. ( 2002 ). Variable selection in high-dimensional multivariate binary data with application to the analysis of microbial community DNA fingerprints . Biometrics 58 : 378 – 386 . [Google Scholar]). Our primary interest is variable selection in classification with small misclassification error being used as validation of proposed method for variable selection. Two of the new methods perform uniformly better than Wilbur et al. (2002 Wilbur , J. D. , Ghosh , J. K. , Nakatsu , C. H. , Brouder , S. M. , Doerge , R. W. ( 2002 ). Variable selection in high-dimensional multivariate binary data with application to the analysis of microbial community DNA fingerprints . Biometrics 58 : 378 – 386 . [Google Scholar]) in one set of simulated and three real life examples.     

Population Attributable Fraction as a Measure of Heritability in Dichotomous Twin Data

In many genetic analyses of dichotomous twin data, odds ratios have been used to test hypotheses on heritability and shared common environment effects of a given disease (Lichtenstein et al., 2000 Lichtenstein , P. , Holm , N. , Verkasalo , P. , Iliadou , A. , Kaprio , J. , Koskenvuo , M. , Pukkala , E. , Skytthe , A. , Hemminki , K. ( 2000 ). Environmental and heritable factors in the causation of cancer . New England Journal of Medicine 343 : 78 – 85 .[Crossref], [Web of Science ®] , [Google Scholar]; Ahlbom et al., 1997 Ahlbom , A. , Lichtenstein , P. , Malmström , H. , Feychting , M. , Hemminki , K. , Pedersen , N. L. ( 1997 ). Cancer in twins: genetic and nongenetic familial risk factors . Journal of the National Cancer Institute 89 : 287 – 93 . [Google Scholar]; Ramakrishnan et al., 1992 Ramakrishnan , V. , Goldberg , J. , Henderson , W. , Elsen , S. , True , W. , Lyons , M. , Tsuang , M. ( 1992 ). Elementary methods for the analysis of dichotomous outcomes in unselected samples of twins . Genetic Epidemiology 9 : 273 – 287 . [Google Scholar], 4). However, estimates of these two effects have not been dealt with in the literature. In epidemiology, the attributable fraction (AF), a function of the odds ratio and the prevalence of the risk factor has been used to describe the contribution of a risk factor to a disease in a given population (Leviton, 1973 Leviton , A. ( 1973 ). Definitions of attributable risk . American Journal of Epidemiology 98 : 231 . [Google Scholar]). In this article, we adapt the AF to quantify the heritability and the shared common environment. Twin data on cancer, gallstone disease and phobia are used to illustrate the applicability of the AF estimate as a measure of heritability.     

An Improved Class of Estimators in Two-Phase Sampling Using Two Auxiliary Variables

This article suggests an improved class of estimators under the general framework of two-phase sampling scheme in presence of two auxiliary variables. This class includes a large number of estimators (Chand, 1975 Chand , L. ( 1975 ). Some Ratio-Type Estimator Based on Two or More Auxiliary Variables. Unpublished Ph.D. dissertation, Iowa State University, Iowa . [Google Scholar]; Kiregyera, 1980 Kiregyera , B. ( 1980 ). A chain ratio-type estimator in finite population double sampling using two auxiliary variables . Metrika 27 : 217 – 223 .[Crossref] , [Google Scholar], 3; Mukharjee et al., 1987 Mukharjee , R. , Rao , T. J. , Vijayan , K. ( 1987 ). Regression-type estimators using multiple auxiliary information . Aust. J. Statist. 29 : 244 – 254 . [Google Scholar]) and also the class of estimators suggested by Sahoo et al. (1993 Sahoo , J. , Sahoo , L. N. , Mohanty , S. ( 1993 ). A regression approach to estimation in two phase sampling using two auxiliary variables . Curr. Sci. 65 ( 1 ): 73 – 75 . [Google Scholar]).     

Statistical Properties of Threshold Models

This article focuses the attention on the Self Exciting Threshold Autoregressive Moving Average model (SETARMA) proposed in Tong (1983 Tong , H. ( 1983 ). Threshold Models in Nonlinear Time Series Analysis . London : Springer-Verlag .[Crossref] , [Google Scholar]). The stochastic structure of the model is discussed and different specifications are presented. Starting from one of them, we give sufficient conditions for the weak stationarity of the model that are discussed and critically compared to other results given in literature. In particular, after showing that the SETARMA model belongs to the class of the Random Coefficients Autoregressive models, widely discussed in Nicholls and Quinn (1982 Nicholls , D. F. , Quinn , B. G. (1982). Random Coefficients Autoregressive Models. An Introduction . New York : Springer-Verlag.[Crossref] , [Google Scholar]), we give some issues on the weak stationarity of its stochastic structure that are more general than those given in the existing literature and appear not affected by the moving average component.     

A Marginalized Combined Gamma Frailty and Normal Random-effects Model for Repeated,Overdispersed, Time-to-event Outcomes

This article proposes a marginalized model for repeated or otherwise hierarchical, overdispersed time-to-event outcomes, adapting the so-called combined model for time-to-event outcomes of Molenberghs et al. (in press Molenberghs, G., Verbeke, G., Efendi, A., Braekers, R., Demétrio, C. G.B. (in press). A combined gamma frailty and normal random-effects model for repeated, overdispersed time-to-event data. In press. [Google Scholar]), who combined gamma and normal random effects. The two sets of random effects are used to accommodate simultaneously correlation between repeated measures and overdispersion. The proposed version allows for a direct marginal interpretation of all model parameters. The outcomes are allowed to be censored. Two estimation methods are proposed: full likelihood and pairwise likelihood. The proposed model is applied to data from a so-called comet assay and to data from recurrent asthma attacks in children. Both estimation methods perform very well. From simulation results, it follows that the marginalized combined model behaves similarly to the ordinary combined model in terms of point estimation and precision. It is also observed that the pairwise likelihood required more computation time on the one hand but is less sensitive to starting values and stabler in terms of bias with increasing sample size and censoring percentage than full likelihood, on the other, leaving room for both in practice.