Estimating parametric semi-Markov models from panel data using phase-type approximations

Inference for semi-Markov models under panel data presents considerable computational difficulties. In general the likelihood is intractable, but a tractable likelihood with the form of a hidden Markov model can be obtained if the sojourn times in each of the states are assumed to have phase-type distributions. However, using phase-type distributions directly may be undesirable as they require estimation of parameters which may be poorly identified. In this article, an approach to fitting semi-Markov models with standard parametric sojourn distributions is developed. The method involves establishing a family of Coxian phase-type distribution approximations to the parametric distribution and merging approximations for different states to obtain an approximate semi-Markov process with a tractable likelihood. Approximations are developed for Weibull and Gamma distributions and demonstrated on data relating to post-lung-transplantation patients.     

Matrix‐Exponential Distributions: Calculus and Interpretations via Flows

By considering randomly stopped deterministic flow models, we develop an intuitively appealing way to generate probability distributions with rational Laplace–Stieltjes transforms on [0,∞). That approach includes and generalizes the formalism of PH-distributions. That generalization results in the class of matrix-exponential probability distributions. To illustrate the novel way of thinking that is required to use these in stochastic models, we retrace the derivations of some results from matrix-exponential renewal theory and prove a new extension of a result from risk theory. Essentially the flow models allows for keeping track of the dynamics of a mechanism that generates matrix-exponential distributions in a similar way to the probabilistic arguments used for phase-type distributions involving transition rates. We also sketch a generalization of the Markovian arrival process (MAP) to the setting of matrix-exponential distribution. That process is known as the Rational arrival process (RAP).     

On the use of functional calculus for phase-type and related distributions

The area of phase-type distributions is renowned for its ability to obtain closed form formulas or algorithmically exact solutions to many complex stochastic models. The method of functional calculus will provide an additional tool along these lines for establishing results in terms of functions of matrices. Functional calculus, which is a branch of operator theory frequently associated with complex analysis, can be applied to phase-type and matrix-exponential distributions in a rather straightforward way. In this article we provide a number of examples of how to execute the formal arguments.     

Bivariate distributions with transmuted conditionals: Models and applications

Abstract

The class of transmuted distributions has received a lot of attention in the recent statistical literature. In this paper, we propose a rich family of bivariate distribution whose conditionals are transmuted distributions. The new family of distributions depends on the two baseline distributions and three dependence parameters. Apart from the general properties, we also study the distribution of the concomitance of order statistics. We study specific bivariate models. Estimation methodologies are proposed. A simulation study is conducted. The usefulness of this family is established by fitting well analyzed real life time data.     

Random effects in generalized linear models and the em algoritham

Nelder and Wedderburn (1972) gave a practical fitting procedure that encompassed a more gencral family of data distributions than the Gaussian distribution and provided an easily understood conceptual framework. In extending the framework to more than one error structure the technical difficulties of the fitting procedure have tended to cloud the concepts. Here we show that a simple extension to the fitting procedure is possible and thus pave the way for a fuller examimtion of mixed effects models in generalized linear model distributions. It is clear that we should not, and do not have to, confine ourselves to fitting random effects using the Gaussian distribiition. In addition, in, some quite general mixing distribution problems the application of the EM algorithm to the complete data likelihood leads to iterative schemes that maximize the marginal likelihood of the observed data variable.     

Reliability of Supply Between Production Lines

ABSTRACT

We compare four strategies for ensuring a reliable just-in-time supply from a seat production line, which is prone to machine failure, to a car assembly line, which is assumed to operate at a constant speed over single shifts. The strategies are as follows: holding buffer stock; duplication of the least reliable machine; duplication of the production line as a stand-by; and running two production lines concurrently. Times between machine failures are assumed to have independent exponential distributions. A general distribution of repair times is allowed for by using phase-type representations. We show the stationary distribution for these models, and compare stationary distributions with average times within levels over shifts conditional on all machines working at the start of a shift. We compute moments of sojourn times within an arbitrary subset of states, which are relevant when cost is a non-linear function of downtime. We use first passage time results to obtain probabilities of line failure within a shift, and use these results to compare the four strategies.     

A Starship Estimation Method for the Generalized λ Distributions

A development of the 'starship' method (Owen, 1988), a computer intensive estimation method, is presented for two forms of generalized λ distributions (gλd). The method can be used for the full parameter space and is flexible, allowing choice of both the form of the generalized λ distribution and of the nature of fit required. Some examples of its use in fitting data and approximating distributions are given. Some simulation studies explore the sampling distribution of the parameter estimates produced by this method for selected values of the parameters and consider comparisons with two other methods, for one of the gλd distributional forms, not previously so investigated. In the forms and parameter regions available to the other methods, it is demonstrated that the starship compares favourably. Although the differences between the methods, where available, tend to disappear with largersamples, the parameter coverage, flexibility and adaptability of the starship method make it attractive. However, the paper also demonstrates that care is needed when fitting and using such quantile-defined distributional families that are rich in shape, but have complex properties.     

Matrix-analytic Models and their Analysis

We survey phase-type distributions and Markovian point processes, aspects of how to use such models in applied probability calculations and how to fit them to observed data. A phase-type distribution is defined as the time to absorption in a finite continuous time Markov process with one absorbing state. This class of distributions is dense and contains many standard examples like all combinations of exponential in series/parallel. A Markovian point process is governed by a finite continuous time Markov process (typically ergodic), such that points are generated at a Poisson intensity depending on the underlying state and at transitions; a main special case is a Markov-modulated Poisson process. In both cases, the analytic formulas typically contain matrix-exponentials, and the matrix formalism carried over when the models are used in applied probability calculations as in problems in renewal theory, random walks and queueing. The statistical analysis is typically based upon the EM algorithm, viewing the whole sample path of the background Markov process as the latent variable.     

Bayesian estimation for the M/G/1 queue using a phase-type approximation

This article deals with Bayesian inference and prediction for M/G/1 queueing systems. The general service time density is approximated with a class of Erlang mixtures which are phase-type distributions. Given this phase-type approximation, an explicit evaluation of measures such as the stationary queue size, waiting time and busy period distributions can be obtained. Given arrival and service data, a Bayesian procedure based on reversible jump Markov Chain Monte Carlo methods is proposed to estimate system parameters and predictive distributions.     

On the robustness properties for maximum likelihood estimators of parameters in exponential power and generalized T distributions*

Abstract

Examining the robustness properties of maximum likelihood (ML) estimators of parameters in exponential power and generalized t distributions has been considered together. The well-known asymptotic properties of ML estimators of location, scale and added skewness parameters in these distributions are studied. The ML estimators for location, scale and scale variant (skewness) parameters are represented as an iterative reweighting algorithm (IRA) to compute the estimates of these parameters simultaneously. The artificial data are generated to examine performance of IRA for ML estimators of parameters simultaneously. We make a comparison between these two distributions to test the fitting performance on real data sets. The goodness of fit test and information criteria approve that robustness and fitting performance should be considered together as a key for modeling issue to have the best information from real data sets.     

A new Lindley distribution with location parameter

Abstract

The Lindley distribution has been used recently for modeling lifetime data and studying some stress-strength problems. In this paper, a new three-parameter Lindley distribution is introduced. The added location parameter offers more flexibility in fitting some real data against other common distributions. Several statistical and reliability properties are discussed. A simulation study has been carried to examine the MSE, bias, and coverage probability for the parameters. A real data set is used to illustrate the flexibility of the proposed distribution.     

Bivariate inverse Weibull distribution

ABSTRACT

Recently it is observed that the inverse Weibull (IW) distribution can be used quite effectively to analyse lifetime data in one dimension. The main aim of this paper is to define a bivariate inverse Weibull (BIW) distribution so that the marginals have IW distributions. It is observed that the joint probability density function and the joint cumulative distribution function can be expressed in compact forms. Several properties of this distribution such as marginals, conditional distributions and product moments have been discussed. We obtained the maximum likelihood estimates for the unknown parameters of this distribution and their approximate variance– covariance matrix. We perform some simulations to see the performances of the maximum likelihood estimators. One data set has been re-analysed and it is observed that the bivariate IW distribution provides a better fit than the bivariate exponential distribution.     

A new extended generalized Gompertz distribution with statistical properties and simulations

Abstract

Statistical distributions are very useful in describing and predicting real world phenomena. In many applied areas there is a clear need for the extended forms of the well-known distributions. Generally, the new distributions are more flexible to model real data that present a high degree of skewness and kurtosis. The choice of the best-suited statistical distribution for modeling data is very important.

In this article, we proposed an extended generalized Gompertz (EGGo) family of EGGo. Certain statistical properties of EGGo family including distribution shapes, hazard function, skewness, limit behavior, moments and order statistics are discussed. The flexibility of this family is assessed by its application to real data sets and comparison with other competing distributions. The maximum likelihood equations for estimating the parameters based on real data are given. The performances of the estimators such as maximum likelihood estimators, least squares estimators, weighted least squares estimators, Cramer-von-Mises estimators, Anderson-Darling estimators and right tailed Anderson-Darling estimators are discussed. The likelihood ratio test is derived to illustrate that the EGGo distribution is better than other nested models in fitting data set or not. We use R software for simulation in order to perform applications and test the validity of this model.     

Modeling probability density through ultraspherical polynomial transformations

We present a method for fitting parametric probability density models using an integrated square error criterion on a continuum of weighted Lebesgue spaces formed by ultraspherical polynomials. This approach is inherently suitable for creating mixture model representations of complex distributions and allows fully autonomous cluster analysis of high-dimensional datasets. The method is also suitable for extremely large sets, allowing post facto model selection and analysis even in the absence of the original data. Furthermore, the fitting procedure only requires the parametric model to be pointwise evaluable, making it trivial to fit user-defined models through a generic algorithm.     

Generalized Poisson–Lindley Distribution

An extended version of the compound Poisson distribution is obtained by compounding the Poisson distribution with the generalized Lindley distribution. Estimation of the parameters is discussed using the method of moments and maximum likelihood estimators. Examples are given of the fitting of this distribution to data, and the fit is compared with that obtained using other distributions.     

A cold standby repairable system with the repairman having multiple vacations and operational,repair, and vacation times following phase-type distributions

ABSTRACT

This paper studies a cold standby repairable system with two identical components and one repairman having multiple vacations applying matrix-analytic methods. The lifetime of the component follows a phase-type distribution. The repair times and the vacation times of the repairman are governed by different phase-type distributions, respectively. For this system, the Markov process governing the system is constructed. The system is studied in a transient and stationary regime, the availability, the reliability, the rates of occurrence of the different types of failures, and the working probability of the repairman are calculated, respectively. A numerical application is performed to illustrate the calculations.     

Generalized Gumbel distribution

A generalization of the Gumbel distribution is presented to deal with general situations in modeling univariate data with broad range of skewness in the density function. This generalization is derived by considering a logarithmic transformation of an odd Weibull random variable. As a result, the generalized Gumbel distribution is not only useful for testing goodness-of-fit of Gumbel and reverse-Gumbel distributions as submodels, but it is also convenient for modeling and fitting a wide variety of data sets that are not possible to be modeled by well-known distributions. Skewness and kurtosis shapes of the generalized Gumbel distribution are illustrated by constructing the Galton’s skewness and Moor’s kurtosis plane. Parameters are estimated by using maximum likelihood method in two different ways due to the fact that the reverse transformation of the proposed distribution does not change its density function. In order to illustrate the flexibility of this generalization, wave and surge height data set is analyzed, and the fitness is compared with Gumbel and generalized extreme value distributions.     

Bayesian inference for zero-and-one-inflated geometric distribution regression model using Pólya-Gamma latent variables

Abstract

In the fields of internet financial transactions and reliability engineering, there could be more zero and one observations simultaneously. In this paper, considering that it is beyond the range where the conventional model can fit, zero-and-one-inflated geometric distribution regression model is proposed. Ingeniously introducing Pólya-Gamma latent variables in the Bayesian inference, posterior sampling with high-dimensional parameters is converted to latent variables sampling and posterior sampling with lower-dimensional parameters, respectively. Circumventing the need for Metropolis-Hastings sampling, the sample with higher sampling efficiency is obtained. A simulation study is conducted to assess the performance of the proposed estimation for various sample sizes. Finally, a doctoral dissertation data set is analyzed to illustrate the practicability of the proposed method, research shows that zero-and-one-inflated geometric distribution regression model using Pólya-Gamma latent variables can achieve better fitting results.     

On the exact distribution of the MLEs based on Type-II progressively hybrid censored data from exponential distributions

ABSTRACT

Distributions of the maximum likelihood estimators (MLEs) in Type-II (progressive) hybrid censoring based on two-parameter exponential distributions have been obtained using a moment generating function approach. Although resulting in explicit expressions, the representations are complicated alternating sums. Using the spacings-based approach of Cramer and Balakrishnan [On some exact distributional results based on Type-I progressively hybrid censored data from exponential distributions. Statist Methodol. 2013;10:128–150], we derive simple expressions for the exact density and distribution functions of the MLEs in terms of B-spline functions. These representations can be easily implemented on a computer and provide an efficient method to compute density and distribution functions as well as moments of Type-II (progressively) hybrid censored order statistics.     

Generalized skew-normal models: properties and inference

In this article, we introduce a new family of asymmetric distributions, which depends on two parameters namely, α and β, and in the special case where β = 0, the skew-normal (SN) distribution considered by Azzallini [Azzalini, A., 1985, A class of distributions which includes the normal ones. Scandinavian Journal of Statistics, 12, 171–178.] is obtained. Basic properties such as a stochastic representation and the derivation of maximum likelihood and moment estimators are studied. The asymptotic behaviour of both types of estimators is also investigated. Results of a small-scale simulation study is provided illustrating the usefulness of the new model. An application to a real data set is reported showing that it can present better fit than the SN distribution.