Modelling multi-stage processes through multivariate distributions

A new model combining parametric and semi-parametric approaches and following the lines of a semi-Markov model is developed for multi-stage processes. A Bivariate sojourn time distribution derived from the bivariate exponential distribution of Marshall & Olkin (1967) is adopted. The results compare favourably with the usual semi-parametric approaches that have been in use. Our approach also has several advantages over the models in use including its amenability to statistical inference. For example, the tests for symmetry and also for independence of the marginals of the sojourn time distributions, which were not available earlier, can now be conveniently derived and are enhanced in elegant forms. A unified Goodness-of-Fit test procedure for our proposed model is also presented. An application to the human resource planning involving real-life data from University of Nigeria is given.     

Smoothed nonparametric estimation in window censored semi-Markov processes

Consider a process that jumps among a finite set of states, with random times spent in between. In semi-Markov processes transitions follow a Markov chain and the sojourn distributions depend only on the connecting states. Suppose that the process started far in the past, achieving stationary. We consider non-parametric estimation by modelling the log-hazard of the sojourn times through linear splines; and we obtain maximum penalized likelihood estimators when data consist of several i.i.d. windows. We prove consistency using Grenander's method of sieves.     

Large Deviations for Empirical Estimators of the Stationary Distribution of a Semi-Markov Process with Finite State Space

We prove the large deviation principle for empirical estimators of stationary distributions of semi-Markov processes with finite state space, irreducible embedded Markov chain, and finite mean sojourn time in each state. We consider on/off Gamma sojourn processes as an illustrative example, and, in particular, continuous time Markov chains with two states. In the second case, we compare the rate function in this article with the known rate function concerning another family of empirical estimators of the stationary distribution.     

Nonparametric inference and uniqueness for periodically observed progressive disease models

In many studies examining the progression of HIV and other chronic diseases, subjects are periodically monitored to assess their progression through disease states. This gives rise to a specific type of panel data which have been termed “chain-of-events data”; e.g. data that result from periodic observation of a progressive disease process whose states occur in a prescribed order and where state transitions are not observable. Using a discrete time semi-Markov model, we develop an algorithm for nonparametric estimation of the distribution functions of sojourn times in a J state progressive disease model. Issues of uniqueness for chain-of-events data are not well-understood. Thus, a main goal of this paper is to determine the uniqueness of the nonparametric estimators of the distribution functions of sojourn times within states. We develop sufficient conditions for uniqueness of the nonparametric maximum likelihood estimator, including situations where some but not all of its components are unique. We illustrate the methods with three examples.     

Flowgraph Models for Generalized Phase Type Distributions Having Non-Exponential Waiting Times

ABSTRACT. Aalen (1995) introduced phase type distributions based on Markov processes for modelling disease progression in survival analysis. For tractability and to maintain the Markov property, these use exponential waiting times for transitions between states. This article extends the work of Aalen (1995) by generalizing these models to semi-Markov processes with non-exponential waiting times. The generalization allows more realistic modelling of the stages of a disease where the Markov property and exponential waiting times may not hold. Flowgraph models are introduced to provide a closed form for the distributions in situations involving non-exponential waiting times. Flowgraph models work where traditional methods of stochastic processes are intractable. Saddlepoint approximations are used in the analysis. Together, generalized phase type distributions, flowgraphs, and saddlepoint approximations create exciting and innovative prospects for the analysis of survival data.     

On measuring sensitivity to parametric model misspecification

In settings where parametric inference is inconsistent under model misspecification, the discrepancy between correct and misspecified inferences is compared with the discrepancy between correct and misspecified models. To make the comparison tractable, large sample and small misspecification approximations are employed. The ratio of the approximate discrepancy between inferences to the approximate discrepancy between models is regarded as a relative measure of sensitivity to model misspecification. The maximum ratio over a family of correct distributions is determined as a measure of worst case sensitivity. As well, the distribution producing this maximum can be examined, to see how a particular combination of a parametric family and estimand is susceptible to model misspecifications.     

Approximation of power in multivariate analysis

We consider the calculation of power functions in classical multivariate analysis. In this context, power can be expressed in terms of tail probabilities of certain noncentral distributions. The necessary noncentral distribution theory was developed between the 1940s and 1970s by a number of authors. However, tractable methods for calculating the relevant probabilities have been lacking. In this paper we present simple yet extremely accurate saddlepoint approximations to power functions associated with the following classical test statistics: the likelihood ratio statistic for testing the general linear hypothesis in MANOVA; the likelihood ratio statistic for testing block independence; and Bartlett's modified likelihood ratio statistic for testing equality of covariance matrices.     

Fitting with Matrix-Exponential Distributions

Abstract

It is well known that general phase-type distributions are considerably overparameterized, that is, their representations often require many more parameters than is necessary to define the distributions. In addition, phase-type distributions, even those defined by a small number of parameters, may have representations of high order. These two problems have serious implications when using phase-type distributions to fit data. To address this issue we consider fitting data with the wider class of matrix-exponential distributions. Representations for matrix-exponential distributions do not need to have a simple probabilistic interpretation, and it is this relaxation which ensures that the problems of overparameterization and high order do not present themselves. However, when using matrix-exponential distributions to fit data, a problem arises because it is unknown, in general, when their representations actually correspond to a distribution. In this paper we develop a characterization for matrix-exponential distributions and use it in a method to fit data using maximum likelihood estimation. The fitting algorithm uses convex semi-infinite programming combined with a nonlinear search.     

Reliability of Supply Between Production Lines

ABSTRACT

We compare four strategies for ensuring a reliable just-in-time supply from a seat production line, which is prone to machine failure, to a car assembly line, which is assumed to operate at a constant speed over single shifts. The strategies are as follows: holding buffer stock; duplication of the least reliable machine; duplication of the production line as a stand-by; and running two production lines concurrently. Times between machine failures are assumed to have independent exponential distributions. A general distribution of repair times is allowed for by using phase-type representations. We show the stationary distribution for these models, and compare stationary distributions with average times within levels over shifts conditional on all machines working at the start of a shift. We compute moments of sojourn times within an arbitrary subset of states, which are relevant when cost is a non-linear function of downtime. We use first passage time results to obtain probabilities of line failure within a shift, and use these results to compare the four strategies.     

Robust Bayesian synthetic likelihood via a semi-parametric approach

Bayesian synthetic likelihood (BSL) is now a well-established method for performing approximate Bayesian parameter estimation for simulation-based models that do not possess a tractable likelihood function. BSL approximates an intractable likelihood function of a carefully chosen summary statistic at a parameter value with a multivariate normal distribution. The mean and covariance matrix of this normal distribution are estimated from independent simulations of the model. Due to the parametric assumption implicit in BSL, it can be preferred to its nonparametric competitor, approximate Bayesian computation, in certain applications where a high-dimensional summary statistic is of interest. However, despite several successful applications of BSL, its widespread use in scientific fields may be hindered by the strong normality assumption. In this paper, we develop a semi-parametric approach to relax this assumption to an extent and maintain the computational advantages of BSL without any additional tuning. We test our new method, semiBSL, on several challenging examples involving simulated and real data and demonstrate that semiBSL can be significantly more robust than BSL and another approach in the literature.     

A semi-Markov multistate model for estimation of the mean quality-adjusted survival for non-progressive processes

We discuss the estimation of the expected value of the quality-adjusted survival, based on multistate models. We generalize an earlier work, considering the sojourn times in health states are not identically distributed, for a given vector of covariates. Approaches based on semiparametric and parametric (exponential and Weibull distributions) methodologies are considered. A simulation study is conducted to evaluate the performance of the proposed estimator and the jackknife resampling method is used to estimate the variance of such estimator. An application to a real data set is also included.     

An EM and a Stochastic Version of the EM Algorithm for Nonparametric Hidden Semi-Markov Models

The Hidden semi-Markov models (HSMMs) were introduced to overcome the constraint of a geometric sojourn time distribution for the different hidden states in the classical hidden Markov models. Several variations of HSMMs were proposed that model the sojourn times by a parametric or a nonparametric family of distributions. In this article, we concentrate our interest on the nonparametric case where the duration distributions are attached to transitions and not to states as in most of the published papers in HSMMs. Therefore, it is worth noticing that here we treat the underlying hidden semi-Markov chain in its general probabilistic structure. In that case, Barbu and Limnios (2008 Barbu , V. , Limnios , N. ( 2008 ). Semi-Markov Chains and Hidden Semi-Markov Models Toward Applications: Their Use in Reliability and DNA Analysis . New York : Springer . [Google Scholar]) proposed an Expectation–Maximization (EM) algorithm in order to estimate the semi-Markov kernel and the emission probabilities that characterize the dynamics of the model. In this article, we consider an improved version of Barbu and Limnios' EM algorithm which is faster than the original one. Moreover, we propose a stochastic version of the EM algorithm that achieves comparable estimates with the EM algorithm in less execution time. Some numerical examples are provided which illustrate the efficient performance of the proposed algorithms.     

Estimation in a model for a semi-Markov process with covariates under right-censoring

A semi-Markov model with covariates is proposed for a multi-state process with a finite number of states such that the transition probabilities between the states and the distribution functions of the duration times between the occurrence of two states depend on a discrete covariate. The hazard rates for the time elapsed between two successive states depend on the covariate through a proportional hazards model involving a set of regression parameters, while the transition probabilities depend on the covariate in an unspecified way. We propose estimators for these parameters and for the cumulative hazard functions of the sojourn times. A difficulty comes from the fact that when a sojourn time in a state is right-censored, the next state is unknown. We prove that our estimators are consistent and asymptotically Gaussian under the model constraints.     

A two-sample empirical likelihood ratio test based on samples entropy

Powerful entropy-based tests for normality, uniformity and exponentiality have been well addressed in the statistical literature. The density-based empirical likelihood approach improves the performance of these tests for goodness-of-fit, forming them into approximate likelihood ratios. This method is extended to develop two-sample empirical likelihood approximations to optimal parametric likelihood ratios, resulting in an efficient test based on samples entropy. The proposed and examined distribution-free two-sample test is shown to be very competitive with well-known nonparametric tests. For example, the new test has high and stable power detecting a nonconstant shift in the two-sample problem, when Wilcoxon’s test may break down completely. This is partly due to the inherent structure developed within Neyman-Pearson type lemmas. The outputs of an extensive Monte Carlo analysis and real data example support our theoretical results. The Monte Carlo simulation study indicates that the proposed test compares favorably with the standard procedures, for a wide range of null and alternative distributions.     

Likelihood Asymptotics

The paper gives an overview of modern likelihood asymptotics with emphasis on results and applicability. Only parametric inference in well-behaved models is considered and the theory discussed leads to highly accurate asymptotic tests for general smooth hypotheses. The tests are refinements of the usual asymptotic likelihood ratio tests, and for one-dimensional hypotheses the test statistic is known as r *, introduced by Barndorff-Nielsen. Examples illustrate the applicability and accuracy as well as the complexity of the required computations. Modern likelihood asymptotics has developed by merging two lines of research: asymptotic ancillarity is the basis of the statistical development, and saddlepoint approximations or Laplace-type approximations have simultaneously developed as the technical foundation. The main results and techniques of these two lines will be reviewed, and a generalization to multi-dimensional tests is developed. In the final part of the paper further problems and ideas are presented. Among these are linear models with non-normal error, non-parametric linear models obtained by estimation of the residual density in combination with the present results, and the generalization of the results to restricted maximum likelihood and similar structured models.     

Finite mixtures of multivariate Poisson distributions with application

In the present paper we examine finite mixtures of multivariate Poisson distributions as an alternative class of models for multivariate count data. The proposed models allow for both overdispersion in the marginal distributions and negative correlation, while they are computationally tractable using standard ideas from finite mixture modelling. An EM type algorithm for maximum likelihood (ML) estimation of the parameters is developed. The identifiability of this class of mixtures is proved. Properties of ML estimators are derived. A real data application concerning model based clustering for multivariate count data related to different types of crime is presented to illustrate the practical potential of the proposed class of models.     

Estimation of the mean quality-adjusted survival using a multistate model for the sojourn times

In clinical trials, it may be of interest taking into account physical and emotional well-being in addition to survival when comparing treatments. Quality-adjusted survival time has the advantage of incorporating information about both survival time and quality-of-life. In this paper, we discuss the estimation of the expected value of the quality-adjusted survival, based on multistate models for the sojourn times in health states. Semiparametric and parametric (with exponential distribution) approaches are considered. A simulation study is presented to evaluate the performance of the proposed estimator and the jackknife resampling method is used to compute bias and variance of the estimator.     

A semiparametric maximum likelihood ratio test for the change point in copula models

In the present paper, a semiparametric maximum-likelihood-type test statistic is proposed and proved to have the same limit null distribution as the classical parametric likelihood one. Under some mild conditions, the limiting law of the proposed test statistic, suitably normalized and centralized, is shown to be double exponential, under the null hypothesis of no change in the parameter of copula models. We also discuss the Gaussian-type approximations for the semiparametric likelihood ratio. The asymptotic distribution of the proposed statistic under specified alternatives is shown to be normal, and an approximation to the power function is given. Simulation results are provided to illustrate the finite sample performance of the proposed statistical tests based on the double exponential and Gaussian-type approximations.     

Quantile smoothing in financial time series

Various parametric models have been designed to analyze volatility in time series of financial market data. For maximum likelihood estimation these parametric methods require the assumption of a known conditional distribution. In this paper we examine the conditional distribution of daily DAX returns with the help of nonparametric methods. We use kernel estimators for conditional quantiles resulting from a kernel estimation of conditional distributions. This work was financially supported by the Deutsche Forschungsgemeinschaft     

ASYMPTOTIC DISTRIBUTIONS OF SEMIPARAMETRIC MAXIMUM LIKELIHOOD ESTIMATORS WITH ESTIMATING EQUATIONS FOR GROUP-CENSORED DATA

Semiparametric maximum likelihood estimation with estimating equations (SMLE) is more flexible than traditional methods; it has fewer restrictions on distributions and regression models. The required information about distribution and regression structures is incorporated in estimating equations of the SMLE to improve the estimation quality of non‐parametric methods. The likelihood of SMLE for censored data involves complicated implicit functions without closed‐form expressions, and the first derivatives of the log‐profile‐likelihood cannot be expressed as summations of independent and identically distributed random variables; it is challenging to derive asymptotic properties of the SMLE for censored data. For group‐censored data, the paper shows that all the implicit functions are well defined and obtains the asymptotic distributions of the SMLE for model parameters and lifetime distributions. With several examples the paper compares the SMLE, the regular non‐parametric likelihood estimation method and the parametric MLEs in terms of their asymptotic efficiencies, and illustrates application of SMLE. Various asymptotic distributions of the likelihood ratio statistics are derived for testing the adequacy of estimating equations and a partial set of parameters equal to some known values.