Mis-specification analyses of gamma and Wiener degradation processes

Degradation models are widely used these days to assess the lifetime information of highly reliable products if there exist some quality characteristics (QC) whose degradation over time can be related to the reliability of the product. In this study, motivated by a laser data, we investigate the mis-specification effect on the prediction of product's MTTF (mean-time-to-failure) when the degradation model is wrongly fitted. More specifically, we derive an expression for the asymptotic distribution of quasi-MLE (QMLE) of the product's MTTF when the true model comes from gamma degradation process, but is wrongly assumed to be Wiener degradation process. The penalty for the model mis-specification can then be addressed sequentially. The result demonstrates that the effect on the accuracy of the product's MTTF prediction strongly depends on the ratio of critical value to the scale parameter of the gamma degradation process. The effects on the precision of the product's MTTF prediction are observed to be serious when the shape and scale parameters of the gamma degradation process are large. We then carry out a simulation study to evaluate the penalty of the model mis-specification, using which we show that the simulation results are quite close to the theoretical ones even when the sample size and termination time are not large. For the reverse mis-specification problem, i.e., when the true degradation is a Wiener process, but is wrongly assumed to be a gamma degradation process, we carry out a Monte Carlo simulation study to examine the effect of the corresponding model mis-specification. The obtained results reveal that the effect of this model mis-specification is negligible.     

A hierarchical approach to the study of the exponential failure model

The exponential failure model is studied from the hierarchical point of view. The parameter of the exponential is considered as a random variable with a gamma function as a prior. Futhermore, the scale parameter of the gamma prior isassumed to be a random variable with known hyperprior. Under these assumptions estimators are derived for the exponential parameter and reliability function. Monte Carlo simulation is utilized to compare the various estimators.     

Failure Time of Non Homogeneous Gamma Process

We consider the non homogeneous gamma process as a degradation model. The hitting time of a deterministic or random level is studied here. We provide its distribution (both cdf and pdf) explicitly in the first case and in the second case when the threshold is exponentially or gamma distributed. The general case for a random threshold can be approximated by considering mixtures of Erlang distributions. Aging properties are also discussed in this article.     

Combining estimating functions for volatility

Accurate estimates of volatility are needed in risk management. Generalized autoregressive conditional heteroscedastic (GARCH) models and random coefficient autoregressive (RCA) models have been used for volatility modelling. Following Heyde [1997. Quasi-likelihood and its Applications. Springer, New York], volatility estimates are obtained by combining two different estimating functions. It turns out that the combined estimating function for the parameter in autoregressive processes with GARCH errors and RCA models contains maximum information. The combination of the least squares (LS) estimating function and the least absolute deviation (LAD) estimating function with application to GARCH model error identification is discussed as an application.     

Nonparametric estimation of the shape function in a Gamma process for degradation data

The author considers estimation under a Gamma process model for degradation data. The setting for degradation data is one in which n independent units, each with a Gamma process with a common shape function and scale parameter, are observed at several possibly different times. Covariates can be incorporated into the model by taking the scale parameter as a function of the covariates. The author proposes using the maximum pseudo‐likelihood method to estimate the unknown parameters. The method requires usage of the Pool Adjacent Violators Algorithm. Asymptotic properties, including consistency, convergence rate and asymptotic distribution, are established. Simulation studies are conducted to validate the method and its application is illustrated by using bridge beams data and carbon‐film resistors data. The Canadian Journal of Statistics 37: 102‐118; 2009 © 2009 Statistical Society of Canada     

Characterization of a mixture of gamma distributions via conditional finite moments

A necessary and sufficient condition that a continuous, positive random variable follow a gamma distribution is given in terms of any one of its conditional finite moments and an expression involving its failure rate. The results are then used to develop a characterization for a mixture of two gamma distributions. The general results about characterization of a mixture of gamma distributions yield several special cases that have appeared separately in recent literature, including characterization of a single exponential distribution, characterization of a single gamma distribution (in terms of either first or second moments) and a sufficient condition for a mixture of two exponential distributions (in terms of first moments). The condition in this last result is shown to be necessary also. Numerous other cases are possible, using different choices for distribution parameters along with a selection of the mixing parameter, for either individual or mixtures of distributions. Various characterizations can be expressed using higher order moments, too.     

On the likelihood function of small time variance Gamma Lévy processes

We investigate the likelihood function of small generalized Laplace laws and variance gamma Lévy processes in the short time framework. We prove the local asymptotic normality property in statistical inference for the variance gamma Lévy process under high-frequency sampling with its associated optimal convergence rate and Fisher information matrix. The location parameter is required to be given in advance for this purpose, while the remaining three parameters are jointly well behaved with an invertible Fisher information matrix. The results are discussed with relation to equivalent formulations of the variance gamma Lévy process, that is, as a time-changed Brownian motion and as a difference of two independent gamma processes.     

A Hausman test for Brownian motion

New tests are proposed for the specification of the intraday price process of a risky asset, based on open, high, low, and close prices. Under the null of a Brownian process we derive two stochastically independent, unbiased volatility estimators. For a Hausman specification test we prove its equivalence with an F-test, consider its robustness against variation in drift and volatility, and analyze the power against an Ornstein–Uhlenbeck process, as well as a random walk with alternative distributions.     

Efficient volatility estimation in a two-factor model

We statistically analyze a multivariate Heath-Jarrow-Morton diffusion model with stochastic volatility. The volatility process of the first factor is left totally unspecified while the volatility of the second factor is the product of an unknown process and an exponential function of time to maturity. This exponential term includes some real parameter measuring the rate of increase of the second factor as time goes to maturity. From historical data, we efficiently estimate the time to maturity parameter in the sense of constructing an estimator that achieves an optimal information bound in a semiparametric setting. We also nonparametrically identify the paths of the volatility processes and achieve minimax bounds. We address the problem of degeneracy that occurs when the dimension of the process is greater than two, and give in particular optimal limit theorems under suitable regularity assumptions on the drift process. We consistently analyze the numerical behavior of our estimators on simulated and real datasets of prices of forward contracts on electricity markets.     

On second-order improved estimation of a gamma scale parameter

This paper concludes our comprehensive study on point estimation of model parameters of a gamma distribution from a second-order decision theoretic point of view. It should be noted that efficient estimation of gamma model parameters for samples ‘not large’ is a challenging task since the exact sampling distributions of the maximum likelihood estimators and its variants are not known. Estimation of a gamma scale parameter has received less attention from the earlier researchers compared to shape parameter estimation. What we have observed here is that improved estimation of the shape parameter does not necessarily lead to improved scale estimation if a natural moment condition (which is also the maximum likelihood restriction) is satisfied. Therefore, this work deals with the gamma scale parameter estimation as a separate new problem, not as a by-product of the shape parameter estimation, and studies several estimators in terms of second-order risk.     

Convergence analysis of parametric identification methods for jump processes

The asymptotic properties of recursive estimate for the parameter of the signal process of a jump process are investigated. When increasing the observation period, conditions are proposed that guarantee the consistency and asymptotic normality of the estimate. An estimate of the unknown parameter for the random intensity of an extended gamma process model is discussed by way of example.     

Fourth-order kernel method for simple linear degradation model

Degradation analysis is a useful technique when life tests result in few or even no failures. The degradation measurements are recorded over time and the estimation of time-to-failure distribution plays a vital role in degradation analysis. The parametric method to estimate the time-to-failure distribution assumed a specific parametric model with known shape for the random effects parameter. To avoid any assumption about the model shape, a nonparametric method can be used. In this paper, we suggest to use the nonparametric fourth-order kernel method to estimate the time-to-failure distribution and its percentiles for the simple linear degradation model. The performances of the proposed method are investigated and compared with the classical kernel; maximum likelihood and ordinary least squares methods via simulation technique. The numerical results show the good performance of the fourth-order kernel method and demonstrate its superiority over the parametric method when there is no information about the shape of the random effect parameter distribution.     

Comparison of asymmetric stochastic volatility models under different correlation structures

This paper conducts simulation-based comparison of several stochastic volatility models with leverage effects. Two new variants of asymmetric stochastic volatility models, which are subject to a logarithmic transformation on the squared asset returns, are proposed. The leverage effect is introduced into the model through correlation either between the innovations of the observation equation and the latent process, or between the logarithm of squared asset returns and the latent process. Suitable Markov Chain Monte Carlo algorithms are developed for parameter estimation and model comparison. Simulation results show that our proposed formulation of the leverage effect and the accompanying inference methods give rise to reasonable parameter estimates. Applications to two data sets uncover a negative correlation (which can be interpreted as a leverage effect) between the observed returns and volatilities, and a negative correlation between the logarithm of squared returns and volatilities.     

Markov-Switching and Stochastic Volatility Diffusion Models of Short-Term Interest Rates

This article empirically compares the Markov-switching and stochastic volatility diffusion models of the short rate. The evidence supports the Markov-switching diffusion model. Estimates of the elasticity of volatility parameter for single-regime models unanimously indicate an explosive volatility process, whereas the Markov-switching models estimates are reasonable. Itis found that either Markov switching or stochastic volatility, but not both, is needed to adequately fit the data. A robust conclusion is that volatility depends on the level of the short rate. Finally, the Markov-switching model is the best for forecasting. A technical contribution of this article is a presentation of quasi-maximum likelihood estimation techniques for the Markov-switching stochastic-volatility model.     

A note on characterizations of the bivariate gamma distribution

Given two independent non-degenerate positive random variables X and Y, Lukacs (1955) proved that X/(X+Y) and X+Y are independent if and only if X and Y are gammally distributed with the same scale parameter.In this work, properties of bivariate gamma distribution are studied. Certain regression version of Lukacs's theorem are given for the bivariate case. Furthermore, characterization of bivariate gamma distribution by the conditions of constancy regression of quadratic statistics is also given.     

Bayesian estimation of reliability using time-to-failure distribution of parametric degradation models

This paper focusses on computing the Bayesian reliability of components whose performance characteristics (degradation – fatigue and cracks) are observed during a specified period of time. Depending upon the nature of degradation data collected, we fit a monotone increasing or decreasing function for the data. Since the components are supposed to have different lifetimes, the rate of degradation is assumed to be a random variable. At a critical level of degradation, the time to failure distribution is obtained. The exponential and power degradation models are studied and exponential density function is assumed for the random variable representing the rate of degradation. The maximum likelihood estimator and Bayesian estimator of the parameter of exponential density function, predictive distribution, hierarchical Bayes approach and robustness of the posterior mean are presented. The Gibbs sampling algorithm is used to obtain the Bayesian estimates of the parameter. Illustrations are provided for the train wheel degradation data.     

Residual life estimation based on bivariate non-stationary gamma degradation process

Due to the growing importance in maintenance scheduling, the issue of residual life (RL) estimation for some high reliable products based on degradation data has been studied quite extensively. However, most of the existing work only deals with one-dimensional degradation data, which may not be realistic in some cases. Here, an adaptive method of RL estimation is developed based on two-dimensional degradation data. It is assumed that a product has two performance characteristics (PCs) and that the degradation of each PC over time is governed by a non-stationary gamma degradation process. From a practical consideration, it is further assumed that these two PCs are dependent and that their dependency can be characterized by a copula function. As the likelihood function in such a situation is complicated and computationally quite intensive, a two-stage method is used to estimate the unknown parameters of the model. Once new degradation information of the product being monitored becomes available, random effects are first updated by using the Bayesian method. Following that, the RL at current time is estimated accordingly. As the degradation data information accumulates, the RL can be re-estimated in an adaptive manner. Finally, a numerical example about fatigue cracks is presented in order to illustrate the proposed model and the developed inferential method.     

中国城市生猪规模养殖模式的生产率变动分析

运用基于两阶段DEA的Malmquist生产率指数模型,分析2001—2008年中国城市生猪规模养殖模式的全要素生产率指数,得出结论：全国城市TFP增长率总体上呈＂V＂状,平均增长率为负;技术进步效率退化是造成生产率负增长的主要因素;产业风险是造成生产率剧烈波动的根本原因。提出建议：因地制宜,合理布局;品种引进,品种选育;技术培训,科学饲养;生猪保险,生猪期货。     

Estimation of the parameters of the gamma distribution by means of a maximal invariant

The use of a scale invariance criterion allows estimation of the shape parameter of the two parameter gamma distribution without estimating the scale parameter. Simulation experiments are used to show that the resulting estimators of both parameters are better than the usual maximum likelihood estimators in terms of both bias and mean square error. Approximately unbiased versions of the maximal invariant based estimators are derived and are shown to be as good as approximately unbiased versions of the usual maximum likelihood estimators     

A Markov Chain Monte Carlo version of the genetic algorithm Differential Evolution: easy Bayesian computing for real parameter spaces

Differential Evolution (DE) is a simple genetic algorithm for numerical optimization in real parameter spaces. In a statistical context one would not just want the optimum but also its uncertainty. The uncertainty distribution can be obtained by a Bayesian analysis (after specifying prior and likelihood) using Markov Chain Monte Carlo (MCMC) simulation. This paper integrates the essential ideas of DE and MCMC, resulting in Differential Evolution Markov Chain (DE-MC). DE-MC is a population MCMC algorithm, in which multiple chains are run in parallel. DE-MC solves an important problem in MCMC, namely that of choosing an appropriate scale and orientation for the jumping distribution. In DE-MC the jumps are simply a fixed multiple of the differences of two random parameter vectors that are currently in the population. The selection process of DE-MC works via the usual Metropolis ratio which defines the probability with which a proposal is accepted. In tests with known uncertainty distributions, the efficiency of DE-MC with respect to random walk Metropolis with optimal multivariate Normal jumps ranged from 68% for small population sizes to 100% for large population sizes and even to 500% for the 97.5% point of a variable from a 50-dimensional Student distribution. Two Bayesian examples illustrate the potential of DE-MC in practice. DE-MC is shown to facilitate multidimensional updates in a multi-chain “Metropolis-within-Gibbs” sampling approach. The advantage of DE-MC over conventional MCMC are simplicity, speed of calculation and convergence, even for nearly collinear parameters and multimodal densities.