Implementing particle swarm optimization algorithm to estimate the mixture of two Weibull parameters with censored data

We present the maximum likelihood estimation (MLE) via particle swarm optimization (PSO) algorithm to estimate the mixture of two Weibull parameters with complete and multiple censored data. A simulation study is conducted to assess the performance of the MLE via PSO algorithm, quasi-Newton method and expectation-maximization (EM) algorithm for different parameter settings and sample sizes in both uncensored and censored cases. The simulation results showed that the PSO algorithm outperforms the quasi-Newton method and the EM algorithm in most cases regarding bias and root mean square errors. Two numerical examples are used to demonstrate the performance of our proposed method.     

Percentage points of the statistics for testing hypotheses on mean vectors of multivariate normal distributions with missing observations

A problem of testing of hypotheses on the mean vector of a multivariate normal distribution with unknown and positive definite covariance matrix is considered when a sample with a special, though not unusual, pattern of missing observations from that population is available. The approximate percentage points of the test statistic are obtained and their accuracy has been checked by comparing them with some exact percentage points which are calculated for complete samples and some special incomplete samples. The approximate percentage points are in good agreement with exact percentage points. The above work is extended to the problem of testing the hypothesis of equality of two mean vectors of two multivariate normal distributions with the same, unknown covariance matrix     

EM algorithm for mixture of skew-normal distributions fitted to grouped data

Grouped data are frequently used in several fields of study. In this work, we use the expectation-maximization (EM) algorithm for fitting the skew-normal (SN) mixture model to the grouped data. Implementing the EM algorithm requires computing the one-dimensional integrals for each group or class. Our simulation study and real data analyses reveal that the EM algorithm not only always converges but also can be implemented in just a few seconds even when the number of components is large, contrary to the Bayesian paradigm that is computationally expensive. The accuracy of the EM algorithm and superiority of the SN mixture model over the traditional normal mixture model in modelling grouped data are demonstrated through the simulation and three real data illustrations. For implementing the EM algorithm, we use the package called ForestFit developed for R environment available at https://cran.r-project.org/web/packages/ForestFit/index.html.     

A comparison of the classical and the linear programming approaches to the classification problem in discriminant analysis

Several mathematical programming approaches to the classification problem in discriminant analysis have recently been introduced. This paper empirically compares these newly introduced classification techniques with Fisher's linear discriminant analysis (FLDA), quadratic discriminant analysis (QDA), logit analysis, and several rank-based procedures for a variety of symmetric and skewed distributions. The percent of correctly classified observations by each procedure in a holdout sample indicate that while under some experimental conditions the linear programming approaches compete well with the classical procedures, overall, however, their performance lags behind that of the classical procedures.     

A competing risks derivation of a mixture model for the analysis of survival data

Boag (1949) and Berkson and Gage (1952) proposed a mixture model for the analysis of survival time data when aproportion of treated patients are cured. This paper presents a derivation of the Boag/Berkson-Gage mixture model as well as a eneralization of the model based on the theory of competing risks. The assumptions underlying the model are stated and discussed and a general likelihood function is obtained. Use of the model is illustrated ith data from the Stanford Heart Transplant Program.     

Asymptotic properties of the ols and grls estimator for the replicated functional relationship model

For the simple linear functional relationship model with replication, the asymptotic properties of the ordinary (OLS) and grouping least squares (GRLS) estimator of the slope are investi- gated under the assumption of normally distributed errors with unknown covariance matrix. The relative performance of the OLS and GRLS estimator is compared in terms of the asymptotic mean square error, and a set of critical parameters are identified for determining the dominance of one estimator over the other. It is also shown that the GRLS estimator is asymptoticallyequivalent to the maximum likelihood (ML) estimator under the given assumptions.     

A comparison of the parameter estimation methods for bimodal mixture Weibull distribution with complete data

Bimodal mixture Weibull distribution being a special case of mixture Weibull distribution has been used recently as a suitable model for heterogeneous data sets in many practical applications. The bimodal mixture Weibull term represents a mixture of two Weibull distributions. Although many estimation methods have been proposed for the bimodal mixture Weibull distribution, there is not a comprehensive comparison. This paper presents a detailed comparison of five kinds of numerical methods, such as maximum likelihood estimation, least-squares method, method of moments, method of logarithmic moments and percentile method (PM) in terms of several criteria by simulation study. Also parameter estimation methods are applied to real data.     

A finite mixture approach to joint clustering of individuals and multivariate discrete outcomes

In this work, we modify finite mixtures of factor analysers to provide a method for simultaneous clustering of subjects and multivariate discrete outcomes. The joint clustering is performed through a suitable reparameterization of the outcome (column)-specific parameters. We develop an expectation–maximization-type algorithm for maximum likelihood parameter estimation where the maximization step is divided into orthogonal sub-blocks that refer to row and column-specific parameters, respectively. Model performance is evaluated via a simulation study with varying sample size, number of outcomes and row/column-specific clustering (partitions). We compare the performance of our model with the performance of standard model-based biclustering approaches. The proposed method is also demonstrated on a benchmark data set where a multivariate binary response is considered.     

Probit and logistic discriminant functions

Most discriminant functions refer to qualitatively district groups. Talis et al. (1975) introduced the probit discriminant function for distinguishing between two ordered groups. They showed how to estimate this function for mixture sampling and continuous predictor variables. Here an estimation system is given for the more common separate sampling which is applicable to continuous and/or discrete predictor variables. When used solely with continuous variables) this method of estimation is more robust than Tallis!

The relationship of probit and logistic discrimination is discussed.     

Bayesian analysis of mixture modelling using the multivariate t distribution

A finite mixture model using the multivariate t distribution has been shown as a robust extension of normal mixtures. In this paper, we present a Bayesian approach for inference about parameters of t-mixture models. The specifications of prior distributions are weakly informative to avoid causing nonintegrable posterior distributions. We present two efficient EM-type algorithms for computing the joint posterior mode with the observed data and an incomplete future vector as the sample. Markov chain Monte Carlo sampling schemes are also developed to obtain the target posterior distribution of parameters. The advantages of Bayesian approach over the maximum likelihood method are demonstrated via a set of real data.     

Testing goodness of fit in terms of the mean residhal life function

A test based on empirical distribution function had been proposed for testing the goodness of fit of an assigned mean residual life function against a one sided alternative. The test statistic has been shown to be consistent and has an asymptotic normal distribution. The test performance is good in the asymptotic relative efficiency sense.     

A mixture of the manova and gmanova models

A mixture of the MANOVA and GMANOVA models is presented. The expected value of the response matrix in this model is the sum of two matrix components. The first component represents the GMANOVA portion and the second component represents the MANOVA portion. Maximum likelihood estimators are derived for the parameters in this model, and goodness-of-fit tests are constructed for fuller models via the likelihood ration criterion. Finally, likelihood ration tests for general liinear hypotheses are developed and a numerical example is presented.     

A note comparing component-slope,Scheffé and Cox parameterizations of the linear mixture experiment model

A mixture experiment involves combining two or more components in various proportions and collecting data on one or more responses. A linear mixture model may adequately represent the relationship between a response and mixture component proportions and be useful in screening the mixture components. The Scheffé and Cox parameterizations of the linear mixture model are commonly used for analyzing mixture experiment data. With the Scheffé parameterization, the fitted coefficient for a component is the predicted response at that pure component (i.e. single-component mixture). With the Cox parameterization, the fitted coefficient for a mixture component is the predicted difference in response at that pure component and at a pre-specified reference composition. This article presents a new component-slope parameterization, in which the fitted coefficient for a mixture component is the predicted slope of the linear response surface along the direction determined by that pure component and at a pre-specified reference composition. The component-slope, Scheffé, and Cox parameterizations of the linear mixture model are compared and their advantages and disadvantages are discussed.     

On the Hypothesis of No Interaction on a Linear Scale in Contingency Tables

The purpose of this paper is to review briefly the three main formulations of no Interaction hypotheses in contingency tables and to consider the formulation on a linear scale in some detail.More specifically we (i) present a situation in 2×2 tables where such a formulation may be more appropriate than others, (ii) study the geometry for this problem, (iii) give contrast-type or parametric ANOVA type formulations in the general n-dimensional tables, (iv) discuss estimation and testing procedures and (v) consider collapsibility of contingency tables in relation to the hypotheses of no interaction on a linear scale.     

Design and analysis of two-phase studies with binary outcome applied to Wilms tumour prognosis

Two-phase stratified sampling is used to select subjects for the collection of additional data, e.g. validation data in measurement error problems. Stratification jointly by outcome and covariates, with sampling fractions chosen to achieve approximately equal numbers per stratum at the second phase of sampling, enhances efficiency compared with stratification based on the outcome or covariates alone. Nonparametric maximum likelihood may result in substantially more efficient estimates of logistic regression coefficients than weighted or pseudolikelihood procedures. Software to implement all three procedures is available. We demonstrate the practical importance of these design and analysis principles by an analysis of, and simulations based on, data from the US National Wilms Tumor Study.     

Estimation with incomplete data: An improved computational method and the analysis of nested data

Maximum likelihood estimation with incomplete normal nrocedure and (ii.)allows tor a Simple MLI.I v=n,ce nf noofori TiVplilinndv Closed form solutions are described for the general nested case.Exact, ssample, moments are given for the two group case Some. computational comparisions are made with the earlier ESTMAT algorithm.     

Efficiency of schemes of sampling from the inverse gaussian-weibull mixture model

The objective of this paper is to study the efficiency of sampling schemes suggested by Hosmer(1973), termed models Ml and M2, relative to the regular random sampling, termed model MO, when samples are drawn from a population having the Inverse Gaussian-Weibull (IG-W) mixture distribution.

It has been shown that whether the efficiency is based on relative variances of the maximum likelihood estimates (ML,E's) of the components of the vector of parameters or on the generalized variances of the MLE's of that vector, Hosmer's models Ml or M2 perform better than model MO.     

Approximate Bayes estimation of the parameters and reliability function of a mixture of two inverse Weibull distributions under Type-2 censoring

The main goal of this paper is to develop the approximate Bayes estimation of the five-dimensional vector of the parameters and reliability function of a mixture of two inverse Weibull distributions (MTIWD) under Type-2 censoring. Usually, the posterior distribution is complicated under the scheme of Type-2 censoring and the integrals that are involved cannot be obtained in a simple explicit form. In this study, we use Lindley's [Approximate Bayesian method, Trabajos Estadist. 31 (1980), pp. 223–237] approximate form of Bayes estimation in the case of an MTIWD under Type-2 censoring. Later, we calculate the estimated risks (ERs) of the Bayes estimates and compare them with the corresponding ERs of the maximum-likelihood estimates through Monte Carlo simulation. Finally, we analyse a real data set using the findings.     

Multivariate discrete exponential family of distributions and their properties

The paper generalizes the univariate discrete exponential family of distributions to the multivariate situation, and this generalization includes the multivariate power series distributions, the multivariate Lagrangian distributions, and the modified multivariate power-series distributions. This provides a unified approach for the study of these three classes of distributions. We obtain recurrence relations for moments and cumulants, and the maximum likelihood estimation for the discrete exponential family. These results are applied to some multivariate discrete distributions like the Lagrangian Poisson, Lagrangian (negative) multinomial, logarithmic series distributions and multivariate Lagrangian negative binomial distribution.