Analysis of covariance under inverse Gaussian model

This paper considers the problem of analysis of covariance (ANCOVA) under the assumption of inverse Gaussian distribution for response variable. We develop the essential methodology for estimating the model parameters via maximum likelihood method. The general form of the maximum likelihood estimator is obtained in color closed form. Adjusted treatment effects and adjusted covariate effects are given, too. We also provide the asymptotic distribution of the proposed estimators. A simulation study and a real world application are also performed to illustrate and evaluate the proposed methodology.     

A permutation-based Bayesian approach for inverse covariance estimation

Abstract

Covariance estimation and selection for multivariate datasets in a high-dimensional regime is a fundamental problem in modern statistics. Gaussian graphical models are a popular class of models used for this purpose. Current Bayesian methods for inverse covariance matrix estimation under Gaussian graphical models require the underlying graph and hence the ordering of variables to be known. However, in practice, such information on the true underlying model is often unavailable. We therefore propose a novel permutation-based Bayesian approach to tackle the unknown variable ordering issue. In particular, we utilize multiple maximum a posteriori estimates under the DAG-Wishart prior for each permutation, and subsequently construct the final estimate of the inverse covariance matrix. The proposed estimator has smaller variability and yields order-invariant property. We establish posterior convergence rates under mild assumptions and illustrate that our method outperforms existing approaches in estimating the inverse covariance matrices via simulation studies.     

Gaussian mixture analysis of covariance

ABSTRACT

In many real-world applications, the traditional theory of analysis of covariance (ANCOVA) leads to inadequate and unreliable results because of violation of the response variable observations from the essential Gaussian assumption that may be due to the heterogeneity of population, the presence of outlier or both of them. In this paper, we develop a Gaussian mixture ANCOVA model for modelling heterogeneous populations with a finite number of subpopulation. We provide the maximum likelihood estimates of the model parameters via an EM algorithm. We also drive the adjusted effects estimators for treatments and covariates. The Fisher information matrix of the model and asymptotic confidence intervals for the parameter are also discussed. We performed a simulation study to assess the performance of the proposed model. A real-world example is also worked out to explained the methodology.     

Bayesian estimation of renewal function for inverse Gaussian renewal process

Two approximation methods are used to obtain the Bayes estimate for the renewal function of inverse Gaussian renewal process. Both approximations use a gamma-type conditional prior for the location parameter, a non-informative marginal prior for the shape parameter, and a squared error loss function. Simulations compare the accuracy of the estimators and indicate that the Tieney and Kadane (T–K)-based estimator out performs Maximum Likelihood (ML)- and Lindley (L)-based estimator. Computations for the T–K-based Bayes estimate employ the generalized Newton's method as well as a recent modified Newton's method with cubic convergence to maximize modified likelihood functions. The program is available from the author.     

Bayesian and likelihood inference for cure rates based on defective inverse Gaussian regression models

Failure time models are considered when there is a subpopulation of individuals that is immune, or not susceptible, to an event of interest. Such models are of considerable interest in biostatistics. The most common approach is to postulate a proportion p of immunes or long-term survivors and to use a mixture model [5]. This paper introduces the defective inverse Gaussian model as a cure model and examines the use of the Gibbs sampler together with a data augmentation algorithm to study Bayesian inferences both for the cured fraction and the regression parameters. The results of the Bayesian and likelihood approaches are illustrated on two real data sets.     

Bayesian analysis of joint mean and covariance models for longitudinal data

Efficient estimation of the regression coefficients in longitudinal data analysis requires a correct specification of the covariance structure. If misspecification occurs, it may lead to inefficient or biased estimators of parameters in the mean. One of the most commonly used methods for handling the covariance matrix is based on simultaneous modeling of the Cholesky decomposition. Therefore, in this paper, we reparameterize covariance structures in longitudinal data analysis through the modified Cholesky decomposition of itself. Based on this modified Cholesky decomposition, the within-subject covariance matrix is decomposed into a unit lower triangular matrix involving moving average coefficients and a diagonal matrix involving innovation variances, which are modeled as linear functions of covariates. Then, we propose a fully Bayesian inference for joint mean and covariance models based on this decomposition. A computational efficient Markov chain Monte Carlo method which combines the Gibbs sampler and Metropolis–Hastings algorithm is implemented to simultaneously obtain the Bayesian estimates of unknown parameters, as well as their standard deviation estimates. Finally, several simulation studies and a real example are presented to illustrate the proposed methodology.     

Robust Bayesian analysis for parallel system with masked data under inverse Weibull lifetime distribution

Abstract

This paper considers the statistical analysis of masked data in a parallel system with inverse Weibull distributed components under type II censoring. Based on Gamma conjugate prior, the Bayesian estimation as well as the hierarchical Bayesian estimation for the parameters and the reliability function of system are obtained by using the Bayesian theory and the hierarchical Bayesian method. Finally, Monte Carlo simulations are provided to compare the performances of the estimates under different masking probabilities and effective sample sizes.     

Performance of ridge estimator in inverse Gaussian regression model

The presence of multicollinearity among the explanatory variables has undesirable effects on the maximum likelihood estimator (MLE). Ridge estimator (RE) is a widely used estimator in overcoming this issue. The RE enjoys the advantage that its mean squared error (MSE) is less than that of MLE. The inverse Gaussian regression (IGR) model is a well-known model in the application when the response variable positively skewed. The purpose of this paper is to derive the RE of the IGR under multicollinearity problem. In addition, the performance of this estimator is investigated under numerous methods for estimating the ridge parameter. Monte Carlo simulation results indicate that the suggested estimator performs better than the MLE estimator in terms of MSE. Furthermore, a real chemometrics dataset application is utilized and the results demonstrate the excellent performance of the suggested estimator when the multicollinearity is present in IGR model.     

Bayesian deconvolution of oil well test data using Gaussian processes

We use Bayesian methods to infer an unobserved function that is convolved with a known kernel. Our method is based on the assumption that the function of interest is a Gaussian process and, assuming a particular correlation structure, the resulting convolution is also a Gaussian process. This fact is used to obtain inferences regarding the unobserved process, effectively providing a deconvolution method. We apply the methodology to the problem of estimating the parameters of an oil reservoir from well-test pressure data. Here, the unknown process describes the structure of the well. Applications to data from Mexican oil wells show very accurate results.     

Mixture inverse Gaussian for unobserved heterogeneity in the autoregressive conditional duration model

In this paper, we assume that the duration of a process has two different intrinsic components or phases which are independent. The first is the time it takes for a trade to be initiated in the market (for example, the time during which agents obtain knowledge about the market in which they are operating and accumulate information, which is coherent with Brownian motion) and the second is the subsequent time required for the trade to develop into a complete duration. Of course, if the first time is zero then the trade is initiated immediately and no initial knowledge is required. If we assume a specific compound Bernoulli distribution for the first time and an inverse Gaussian distribution for the second, the resulting convolution model has a mixture of an inverse Gaussian distribution with its reciprocal, which allows us to specify and test the unobserved heterogeneity in the autoregressive conditional duration (ACD) model.

Our proposals make it possible not only to capture various density shapes of the durations but also easily to accommodate the behaviour of the tail of the distribution and the non monotonic hazard function. The proposed model is easy to fit and characterizes the behaviour of the conditional durations reasonably well in terms of statistical criteria based on point and density forecasts.     

Sensitivity Analysis in Gaussian Bayesian Networks Using a Divergence Measure

This article develops a method for computing the sensitivity analysis in a Gaussian Bayesian network. The measure presented is based on the Kullback–Leibler divergence and is useful to evaluate the impact of prior changes over the posterior marginal density of the target variable in the network. We find that some changes do not disturb the posterior marginal density of interest. Finally, we describe a method to compare different sensitivity measures obtained depending on where the inaccuracy was. An example is used to illustrate the concepts and methods presented.     

Bayesian covariance estimation and inference in latent Gaussian process models

This paper describes inference methods for functional data under the assumption that the functional data of interest are smooth latent functions, characterized by a Gaussian process, which have been observed with noise over a finite set of time points. The methods we propose are completely specified in a Bayesian environment that allows for all inferences to be performed through a simple Gibbs sampler. Our main focus is in estimating and describing uncertainty in the covariance function. However, these models also encompass functional data estimation, functional regression where the predictors are latent functions, and an automatic approach to smoothing parameter selection. Furthermore, these models require minimal assumptions on the data structure as the time points for observations do not need to be equally spaced, the number and placement of observations are allowed to vary among functions, and special treatment is not required when the number of functional observations is less than the dimensionality of those observations. We illustrate the effectiveness of these models in estimating latent functional data, capturing variation in the functional covariance estimate, and in selecting appropriate smoothing parameters in both a simulation study and a regression analysis of medfly fertility data.     

Modeling bivariate survival data using shared inverse Gaussian frailty model

ABSTRACT

The shared frailty models are often used to model heterogeneity in survival analysis. The most common shared frailty model is a model in which hazard function is a product of a random factor (frailty) and the baseline hazard function which is common to all individuals. There are certain assumptions about the baseline distribution and the distribution of frailty. In this paper, we consider inverse Gaussian distribution as frailty distribution and three different baseline distributions, namely the generalized Rayleigh, the weighted exponential, and the extended Weibull distributions. With these three baseline distributions, we propose three different inverse Gaussian shared frailty models. We also compare these models with the models where the above-mentioned distributions are considered without frailty. We develop the Bayesian estimation procedure using Markov Chain Monte Carlo (MCMC) technique to estimate the parameters involved in these models. We present a simulation study to compare the true values of the parameters with the estimated values. A search of the literature suggests that currently no work has been done for these three baseline distributions with a shared inverse Gaussian frailty so far. We also apply these three models by using a real-life bivariate survival data set of McGilchrist and Aisbett (1991 McGilchrist, C.A., Aisbett, C.W. (1991). Regression with frailty in survival analysis. Biometrics 47:461–466.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]) related to the kidney infection data and a better model is suggested for the data using the Bayesian model selection criteria.     

Power of analysis of covariance tests under conditional specification

The procedure-wise power functions of two strategies for balanced single-factor analysis of covariance in the presence of possibly unequal regression slopes are evaluated and illustrated. The strategies differ in the action to be taken following a re-^ jection by the preliminary test for equal slopes. The first strategy simply discards the covariate and respecifies the model as the one-way ANOVA model for testing factor effects. The second leaves the unequal slopes covariance model intact, but respecifies the factor effects hypothesis to address the factor level means adjusted to the sample average of the covariate. One additional strategy, that of testing factor effects only if the preliminary slopes test does not reject, is included for comparison purposes. Computation of the power functions requires extensive use of the results obtained in Hawkins and Han (1986) concerning the bivariate distributions of certain ratios of independent noncentral chi-square random variables.     

Sensitivity analysis in covariance structure analysis with equality constraints

Influence functions are derived for covariance structure analysis with equality constraints, where the parameters are estimated by minimizing a discrepancy function between the assumed covariance matrix and the sample covariance matrix. As a special case maximum likelihood exploratory factor analysis is studied precisely with a numerical example. Comparison is made with the the results of Tanaka and Odaka (1989), who have proposed a sensitivity analysis procedure in maximum likelihood exploratory factor analysis using the perturbation expansion of a certain function of eigenvalues and eigenvectors of a real symmetric matrix. Also the present paper gives a generalization of Tanaka, Watadani and Moon (1991) to the case with equality constraints.     

Bayesian inference for non-stationary spatial covariance structure via spatial deformations

Summary. In geostatistics it is common practice to assume that the underlying spatial process is stationary and isotropic, i.e. the spatial distribution is unchanged when the origin of the index set is translated and under rotation about the origin. However, in environmental problems, such assumptions are not realistic since local influences in the correlation structure of the spatial process may be found in the data. The paper proposes a Bayesian model to address the anisot- ropy problem. Following Sampson and Guttorp, we define the correlation function of the spatial process by reference to a latent space, denoted by D , where stationarity and isotropy hold. The space where the gauged monitoring sites lie is denoted by G . We adopt a Bayesian approach in which the mapping between G and D is represented by an unknown function d (·). A Gaussian process prior distribution is defined for d (·). Unlike the Sampson–Guttorp approach, the mapping of both gauged and ungauged sites is handled in a single framework, and predictive inferences take explicit account of uncertainty in the mapping. Markov chain Monte Carlo methods are used to obtain samples from the posterior distributions. Two examples are discussed: a simulated data set and the solar radiation data set that also was analysed by Sampson and Guttorp.     

Goodness of fit for the inverse Gaussian distribution

For testing the fit of the inverse Gaussian distribution with unknown parameters, the empirical distribution-function statistic A² is studied. Two procedures are followed in constructing the test statistic; they yield the same asymptotic distribution. In the first procedure the parameters in the distribution function are directly estimated, and in the second the distribution function is estimated by its Rao-Blackwell distribution estimator. A table is given for the asymptotic critical points of A². These are shown to depend only on the ratio of the unknown parameters. An analysis is provided of the effect of estimating the ratio to enter the table for A². This analysis enables the proposal of the complete operating procedure, which is sustained by a Monte Carlo study.     

Inverse Gaussian process models for bivariate degradation analysis: A Bayesian perspective

This article conducts a Bayesian analysis for bivariate degradation models based on the inverse Gaussian (IG) process. Assume that a product has two quality characteristics (QCs) and each of the QCs is governed by an IG process. The dependence of the QCs is described by a copula function. A bivariate simple IG process model and three bivariate IG process models with random effects are investigated by using Bayesian method. In addition, a simulation example is given to illustrate the effectiveness of the proposed methods. Finally, an example about heavy machine tools is presented to validate the proposed models.     

Estimation of critical points in the mixture inverse Gaussian model

The maximum likelihood estimation for the critical points of the failure rate and the mean residual life function are presented in the case of mixture inverse Gaussian model. Several important data sets are analyzed from this point of view. For each of the data sets, Bootstrapping is used to construct confidence intervals of the critical points.