Moments of Mixture Periodic Autoregressive Models

This article deals with the study of some properties of a mixture periodically correlated autoregressive (MPAR _S ) time series model, which extends the mixture time invariant parameter autoregressive (MAR) model, that has recently received a considerable interest from many economic time series analysts, to mixture periodic parameter autoregressive model. The aim behind this extension is to make the model able to capture, in addition to all features captured by the classical MAR model, the periodicity feature exhibited by the autocovariance structure of many encountered financial and environmental time series with eventual multimodal distributions. Our main contribution here is obtaining of the second moment periodically stationary condition for a MPAR _S (K; 2,…, 2) model, furthermore the closed-form of the second moment is obtained.     

On Mixture Periodic Vector Autoregressive Models

This article deals with the study of some properties of a mixture periodically correlated n-variate vector autoregressive (MPVAR) time series model, which extends the mixture time invariant parameter n-vector autoregressive (MVAR) model that has been recently studied by Fong et al. (2007 Fong, P.W., Li, W.K., Yau, C.W., Wong, C.S. (2007). On a mixture vector autoregressive model. The Canadian Journal of Statistics 35:135–150.[Crossref], [Web of Science ®] , [Google Scholar]). Our main contributions here are, on the one side, the obtaining of the second moment periodically stationary condition for a n-variate MPVAR_S(n; K; 2, …, 2) model; furthermore, the closed-form of the second moment is obtained and, on the other side, the estimation, via the Expectation-Maximization (EM) algorithm, of the coefficient matrices and the error variance matrix.     

Heteroscedastic Weibull-Normal Mixture Models: A Bayesian Approach

In this article, we propose Bayesian methodology to obtain parameter estimates of the mixture of distributions belonging to the normal and biparametric Weibull families, modeling the mean and the variance parameters. Simulated studies and applications show the performance of the proposed models.     

A Multi-Stage Two-Machines Replacement Strategy Using Mixture Models,Bayesian Inference,and Stochastic Dynamic Programming

If at least one out of two serial machines that produce a specific product in manufacturing environments malfunctions, there will be non conforming items produced. Determining the optimal time of the machines' maintenance is the one of major concerns. While a convenient common practice for this kind of problem is to fit a single probability distribution to the combined defect data, it does not adequately capture the fact that there are two different underlying causes of failures. A better approach is to view the defects as arising from a mixture population: one due to the first machine failures and the other due to the second one. In this article, a mixture model along with both Bayesian inference and stochastic dynamic programming approaches are used to find the multi-stage optimal replacement strategy. Using the posterior probability of the machines to be in state λ₁, λ₂ (the failure rates of defective items produced by machine 1 and 2, respectively), we first formulate the problem as a stochastic dynamic programming model. Then, we derive some properties for the optimal value of the objective function and propose a solution algorithm. At the end, the application of the proposed methodology is demonstrated by a numerical example and an error analysis is performed to evaluate the performances of the proposed procedure. The results of this analysis show that the proposed method performs satisfactorily when a different number of observations on the times between productions of defective products is available.     

Optimum Mixture Design Using Deficiency Criterion

In a mixture experiment the measured response is assumed to depend only on the relative proportion of ingredients or components present in the mixture. Scheffe (1958 Scheffe , H. ( 1958 ). Experiments with mixtures . J. R. Statist. Soc. B 20 : 344 – 360 . [Google Scholar], 1963 Scheffe , H. ( 1963 ). Simplex – centroid design for experiments with mixtures . J. R. Statist. Soc. B 25 : 235 – 263 . [Google Scholar]) first systematically considered this problem and introduced different models and designs suitable in such situations. Optimum designs for the estimation of parameters of different mixture models are available in the literature. The problem of estimating the optimum proportion of mixture components is of great practical importance. Pal and Mandal (2006 Pal , M. , Mandal , N. K. ( 2006 ). Optimum designs for optimum mixtures . Statist. Probab. Lett. 76 ( 13 ): 1369 – 1379 .[Crossref], [Web of Science ®] , [Google Scholar], 2007 Pal , M. , Mandal , N. K. (2007). Optimum mixture design via equivalence theory. communicated. JCISS 32:107–126. [Google Scholar]) attempted to find a solution to this problem by adopting a pseudo-Bayesian approach and using the trace criterion. Subsequently, Pal and Mandal (2008 Pal , M. , Mandal , N. K. ( 2008 ). Minimax designs for optimum mixtures . To appear in Statist. Probab. Lett.  [Google Scholar]) solved the problem using minimax criterion. In this article, the deficiency criterion due to Chatterjee and Mandal (1981 Chatterjee , S. K. , Mandal , N. K. ( 1981 ). Response surface designs for estimating the optimal point . Calcutta Statist. Assoc. Bull. . 30 : 145 – 169 .[Crossref] , [Google Scholar]) has been used as a measure for comparing the performance of competing designs.     

Trajectory Modeling of Longitudinal Binary Data: Application of the EM Algorithm for Mixture Models

A developmental trajectory describes the course of behavior over time. Identifying multiple trajectories within an overall developmental process permits a focus on subgroups of particular interest. We introduce a framework for identifying trajectories by using the Expectation-Maximization (EM) algorithm to fit semiparametric mixtures of logistic distributions to longitudinal binary data. For performance comparison, we consider full maximization algorithms (PROC TRAJ in SAS), standard EM, and two other EM-based algorithms for speeding up convergence. Simulation shows that EM methods produce more accurate parameter estimates. The EM methodology is illustrated with a longitudinal dataset involving adolescents smoking behaviors.     

Optimum Designs for Parameter Estimation in Linear Mixture Models with Synergistic Effects

In this article, we derive optimum designs for parameter estimation in a mixture experiment when the response function is linear in the mixing components with some synergistic effects. The D- and A-optimality criteria have been used for the purpose. The Equivalence Theorem has been used to check for the optimality of the proposed designs.     

Convergence Rate of Strong Consistency of the Maximum Likelihood Estimator in Exponential Family Nonlinear Models

This article proposes some regularity conditions. On the basis of the proposed regularity conditions, we show the strong consistency of the maximum likelihood estimator (MLE) in exponential family nonlinear models (EFNM) and give its convergence rate. In an important case, we obtain the convergence rate O(n ^?1/2(log log n)^1/2)—the rate as that in the Law of the Iterated Logarithm (LIL) for iid partial sums and thus cannot be improved anymore.     

On Mixture Double Autoregressive Time Series Models

This article proposes a mixture double autoregressive model by introducing the flexibility of mixture models to the double autoregressive model, a novel conditional heteroscedastic model recently proposed in the literature. To make it more flexible, the mixing proportions are further assumed to be time varying, and probabilistic properties including strict stationarity and higher order moments are derived. Inference tools including the maximum likelihood estimation, an expectation–maximization (EM) algorithm for searching the estimator and an information criterion for model selection are carefully studied for the logistic mixture double autoregressive model, which has two components and is encountered more frequently in practice. Monte Carlo experiments give further support to the new models, and the analysis of an empirical example is also reported.     

Examples of Uncorrelated Dependent Random Variables Using a Bivariate Mixture

A particular mixture of bivariate distributions is used to present examples of dependent uncorrelated random variables and independent random variables. A necessary and sufficient condition for the independence for such a bivariate distribution is given.     

Hidden Markov Mixture Autoregressive Models: Stability and Moments

This article introduces a parsimonious structure for mixture of autoregressive models, where the weighting coefficients are determined through latent random variables, as functions of all past observations. These latent variables follow a Markov model. We propose a dynamic programming algorithm for forecasting, which reduces the volume of calculations. We also derive limiting behavior of unconditional first moment of the process and an appropriate upper bound for the limiting value of the variance. Further more, we show convergence and stability of the second moment. Finally, we illustrate the efficacy of the proposed model by simulation.     

Testing for Homogeneity in Mixture Using Weighted Relative Entropy

In this article, we propose a test for homogeneity based on Kullback–Leibler information (also known as relative entropy). Though widely used in hypothesis testing problems, Kullback–Leibler information is not desirable to many researchers in the context of mixture because of its complicated form. In this article, a weighted relative entropy test (WE test), which has closed form expression in terms of the parameter estimators, is proposed. Theoretical results show that this test is consistent. Some simulation results demonstrate that the WE test is better than some leading tests when the mixture components come from normal distribution, and is competitive with them in the Poisson case. The usage of the test is illustrated in an example with data about acidity index of lakes.     

Models for longitudinal data with censored changepoints

Summary.  In longitudinal studies of biological markers, different individuals may have different underlying patterns of response. In some applications, a subset of individuals experiences latent events, causing an instantaneous change in the level or slope of the marker trajectory. The paper presents a general mixture of hierarchical longitudinal models for serial biomarkers. Interest centres both on the time of the event and on levels of the biomarker before and after the event. In observational studies where marker series are incomplete, the latent event can be modelled by a survival distribution. Risk factors for the occurrence of the event can be investigated by including covariates in the survival distribution. A combination of Gibbs, Metropolis–Hastings and reversible jump Markov chain Monte Carlo sampling is used to fit the models to serial measurements of forced expiratory volume from lung transplant recipients.     

Testing Homogeneity in Gamma Mixture Models

This paper characterizes the asymptotic behaviour of the likelihood ratio test statistic (LRTS) for testing homogeneity (i.e. no mixture) against gamma mixture alternatives. Under the null hypothesis, the LRTS is shown to be asymptotically equivalent to the square of Davies's Gaussian process test statistic and diverges at a log n rate to infinity in probability. Based on the asymptotic analysis, we propose and demonstrate a computationally efficient method to simulate the null distributions of the LRTS for small to moderate sample sizes.     

Convergence of Discount Time Series Dynamic Linear Models

This article studies the limiting behavior of multiple discount time series dynamic linear models (TSDLMs). It is shown that, under mild conditions, all discount TSDLMs converge to the constant (time-invariant) TSDLM. In particular, the limiting posterior precision matrix of the superposition of multiple discount TSDLMs is explored. For non seasonal models, the elements of the limiting posterior precision of the states are given in a recurrence relationship, while for seasonal models the solution of a linear system provides the elements of the respective limiting precision matrix. The proposed methodology uses canonical Jordan forms and it is illustrated with a detailed example of simulated data featuring both trend and seasonal time series.     

EM Estimation for Finite Mixture Models with Known Mixture Component Size

We consider the use of an EM algorithm for fitting finite mixture models when mixture component size is known. This situation can occur in a number of settings, where individual membership is unknown but aggregate membership is known. When the mixture component size, i.e., the aggregate mixture component membership, is known, it is common practice to treat only the mixing probability as known. This approach does not, however, entirely account for the fact that the number of observations within each mixture component is known, which may result in artificially incorrect estimates of parameters. By fully capitalizing on the available information, the proposed EM algorithm shows robustness to the choice of starting values and exhibits numerically stable convergence properties.     

Semiparametric Likelihood Based Method for Goodness of Fit Tests and Estimation in Upgraded Mixture Models

We use Owen's (1988, 1990) empirical likelihood method in upgraded mixture models. Two groups of independent observations are available. One is z ₁, ..., z _n which is observed directly from a distribution F ( z ). The other one is x ₁, ..., x _m which is observed indirectly from F ( z ), where the x _i s have density ∫ p ( x | z ) dF ( z ) and p ( x | z ) is a conditional density function. We are interested in testing H ₀: p ( x | z ) = p ( x | z ; θ ), for some specified smooth density function. A semiparametric likelihood ratio based statistic is proposed and it is shown that it converges to a chi-squared distribution. This is a simple method for doing goodness of fit tests, especially when x is a discrete variable with finitely many values. In addition, we discuss estimation of θ and F ( z ) when H ₀ is true. The connection between upgraded mixture models and general estimating equations is pointed out.     

Assessing Placebo Response Using Bayesian Hierarchical Survival Models

The National Institute of Mental Health (NIMH) Collaborative Study of Long-Term Maintenance Drug Therapy in Recurrent Affective Illness was a multicenter randomized controlled clinical trial designed to determine the efficacy of a pharmacotherapy for the prevention of the recurrence of unipolar affective disorders. The outcome of interest in this study was the time until the recurrence of a depressive episode. The data show much heterogeneity between centers for the placebo group. The aim of this paper is to use Bayesian hierarchical survival models to investigate the heterogeneity of placebo effects among centers in the NIMH study. This heterogeneity is explored in terms of the marginal posterior distributions of parameters of interest and predictive distributions of future observations. The Gibbs sampling algorithm is used to approximate posterior and predictive distributions. Sensitivity of results to the assumption of a constant hazard survival distribution at the first stage of the hierarchy is examined by comparing results derived from a two component exponential mixture and a two component exponential changepoint model to the results derived from an exponential model. The second component of the mixture and changepoint models is assumed to be a surviving fraction. For each of these first stage parametric models sensitivity of results to second stage prior distributions is also examined. This revised version was published online in July 2006 with corrections to the Cover Date.     

Mixture of Distributions in the Biparametric Exponential Family: A Bayesian Approach

In this article we propose mixture of distributions belonging to the biparametric exponential family, considering joint modeling of the mean and variance (or dispersion) parameters. As special cases we consider mixtures of normal and gamma distributions. A novel Bayesian methodology, using Markov Chain Monte Carlo (MCMC) methods, is proposed to obtain the posterior summaries of interest. We include simulations and real data examples to illustrate de performance of the proposal.     

Using Multinomial Mixture Models to Cluster Internet Traffic

The paper considers the clustering of two large sets of Internet traffic data consisting of information measured from headers of transmission control protocol packets collected on a busy arc of a university network connecting with the Internet. Packets are grouped into 'flows' thought to correspond to particular movements of information between one computer and another. The clustering is based on representing the flows as each sampled from one of a finite number of multinomial distributions and seeks to identify clusters of flows containing similar packet‐length distributions. The clustering uses the EM algorithm, and the data‐analytic and computational details are given.