Global sensitivity analysis with dependence measures

Global sensitivity analysis with variance-based measures suffers from several theoretical and practical limitations, since they focus only on the variance of the output and handle multivariate variables in a limited way. In this paper, we introduce a new class of sensitivity indices based on dependence measures which overcomes these insufficiencies. Our approach originates from the idea to compare the output distribution with its conditional counterpart when one of the input variables is fixed. We establish that this comparison yields previously proposed indices when it is performed with Csiszár f-divergences, as well as sensitivity indices which are well-known dependence measures between random variables. This leads us to investigate completely new sensitivity indices based on recent state-of-the-art dependence measures, such as distance correlation and the Hilbert–Schmidt independence criterion. We also emphasize the potential of feature selection techniques relying on such dependence measures as alternatives to screening in high dimension.     

Sensitivity analysis of reliability functions of the exponential power series lifetime distribution

ABSTRACT

Hazard rate functions are often used in modeling of lifetime data. The Exponential Power Series (EPS) family has a monotone hazard rate function. In this article, the influence of input factors such as time and parameters on the variability of hazard rate function is assessed by local and global sensitivity analysis. Two different indices based on local and global sensitivity indices are presented. The simulation results for two datasets show that the hazard rate functions of the EPS family are sensitive to input parameters. The results also show that the hazard rate function of the EPS family is more sensitive to the exponential distribution than power series distributions.     

Approximate conditional inference and the linear functional model

Approximate conditional inference is developed for the slope parameter of the linear functional model with two variables. It is shown that the model can be transformed so that the slope parameter becomes an angle and nuisance parameters are radial distances. If the nuisance parameters are known an exact confidence interval based on a location-type conditional distribution is available for the angle. More gen¬erally, confidence distributions are used to average the conditional distribution over the nuisance parameters yielding an approximate conditional confidence interval that reflects the precision indicated by the data. An example is analyzed.     

Bayesian Accelerated Life Testing under Competing Weibull Causes of Failure

Consider a J-component series system which is put on Accelerated Life Test (ALT) involving K stress variables. First, a general formulation of ALT is provided for log-location-scale family of distributions. A general stress translation function of location parameter of the component log-lifetime distribution is proposed which can accommodate standard ones like Arrhenius, power-rule, log-linear model, etc., as special cases. Later, the component lives are assumed to be independent Weibull random variables with a common shape parameter. A full Bayesian methodology is then developed by letting only the scale parameters of the Weibull component lives depend on the stress variables through the general stress translation function. Priors on all the parameters, namely the stress coefficients and the Weibull shape parameter, are assumed to be log-concave and independent of each other. This assumption is to facilitate Gibbs sampling from the joint posterior. The samples thus generated from the joint posterior is then used to obtain the Bayesian point and interval estimates of the system reliability at usage condition.     

On the estimation of the parameters of the von mises distribution

The usual maximum likelihood estimators of the parameters of the von Mises distribution are shown to perform badly in small samples. In view of this and the fact that these estimators require a large amount of computation, alternative, simpler estimators are proposed. It is shown that these estimators are at least comparable to the traditional estimators and are, in many cases, superior to them. We also apply the procedure of jackknifing to the maximum likelihood estimator of the concentration parameter of the von Mises distribution and compare the properties of the jackknifed estimator with the other estimators considered in this paper.     

Maximum Likelihood Estimation for the 4-Parameter Beta Distribution

This paper addresses the problem of obtaining maximum likelihood estimates for the parameters of the Pearson Type I distribution (beta distribution with unknown end points and shape parameters). Since they do not seem to have appeared in the literature, the likelihood equations and the information matrix are derived. The regularity conditions which ensure asymptotic normality and efficiency are examined, and some apparent conflicts in the literature are noted. To ensure regularity, the shape parameters must be greater than two, giving an (assymmetrical) bell-shaped distribution with high contact in the tails. A numerical investigation was carried out to explore the bias and variance of the maximum likelihood estimates and their dependence on sample size. The numerical study indicated that only for large samples (n ≥ 1000) does the bias in the estimates become small and does the Cramér-Rao bound give a good approximation for their variance. The likelihood function has a global maximum which corresponds to parameter estimates that are inadmissable. Useful parameter estimates can be obtained at a local maximum, which is sometimes difficult to locate when the sample size is small.     

Innovative methods for modeling of scale invariant processes

This paper presents some innovative methods for modeling discrete scale invariant (DSI) processes and evaluation of corresponding parameters. For the case where the absolute values of the increments of DSI processes are in general increasing, we consider some moving sample variance of the increments and present some heuristic algorithm to characterize successive scale intervals. This enables us to estimate scale parameter of such DSI processes. To present some superior structure for the modeling of DSI processes, we consider the possibility that the variations inside the prescribed scale intervals show some further self-similar behavior. Such consideration enables us to provide more efficient estimators for Hurst parameters. We also present two competitive estimation methods for the Hurst parameters of self-similar processes with stationary increments and prove their efficiency. Using simulated samples of some simple fractional Brownian motion, we show that our estimators of Hurst parameter are more efficient as compared with the celebrated methods of convex rearrangement and quadratic variation. Finally we apply the proposed methods to evaluate DSI behavior of the S&P500 indices in some period.     

Quasi-Likelihood Regression with Multiple Indices and Smooth Link and Variance Functions

Abstract.  A flexible semi-parametric regression model is proposed for modelling the relationship between a response and multivariate predictor variables. The proposed multiple-index model includes smooth unknown link and variance functions that are estimated non-parametrically. Data-adaptive methods for automatic smoothing parameter selection and for the choice of the number of indices M are considered. This model adapts to complex data structures and provides efficient adaptive estimation through the variance function component in the sense that the asymptotic distribution is the same as if the non-parametric components are known. We develop iterative estimation schemes, which include a constrained projection method for the case where the regression parameter vectors are mutually orthogonal. The proposed methods are illustrated with the analysis of data from a growth bioassay and a reproduction experiment with medflies. Asymptotic properties of the estimated model components are also obtained.     

A Bayesian Approach for Multiple Response Surface Optimization in the Presence of Noise Variables

An approach for the multiple response robust parameter design problem based on a methodology by Peterson (2000) is presented. The approach is Bayesian, and consists of maximizing the posterior predictive probability that the process satisfies a set of constraints on the responses. In order to find a solution robust to variation in the noise variables, the predictive density is integrated not only with respect to the response variables but also with respect to the assumed distribution of the noise variables. The maximization problem involves repeated Monte Carlo integrations, and two different methods to solve it are evaluated. A Matlab code was written that rapidly finds an optimal (robust) solution in case it exists. Two examples taken from the literature are used to illustrate the proposed method.     

Exact inferences of the two-parameter exponential distribution and Pareto distribution with censored data

We develop an exact inference for the location and the scale parameters of the two-exponential distribution and the Pareto distribution based on their maximum-likelihood estimators from the doubly Type-II and the progressive Type-II censored sample. Based on some pivotal quantities, exact confidence intervals and tests of hypotheses are constructed. Exact distributions of the pivotal quantities are expressed as mixtures of linear combinations and of ratios of linear combinations of standard exponential random variables, which facilitates the computation of quantiles of these pivotal quantities. We also provide a bootstrap method for constructing a confidence interval. Some simulation studies are carried out to assess their performances. Using the exact distribution of the scale parameter, we establish an acceptance sampling procedure based on the lifetime of the unit. Some numerical results are tabulated for the illustration. One biometrical example is also given to illustrate the proposed methods.     

Alpha power Weibull distribution: Properties and applications

In this paper, a new lifetime distribution is defined and studied. We refer to the new distribution as alpha power Weibull distribution. The importance of the new distribution comes from its ability to model monotone and non monotone failure rate functions, which are quite common in reliability studies. Various properties of the proposed distribution are obtained including moments, quantiles, entropy, order statistics, mean residual life function, and stress-strength parameter. The maximum likelihood estimation method is used to estimate the parameters. Two real data sets are used to illustrate the importance of the proposed distribution.     

Reliability of global sensitivity indices

Uncertainty and sensitivity analysis is an essential ingredient of model development and applications. For many uncertainty and sensitivity analysis techniques, sensitivity indices are calculated based on a relatively large sample to measure the importance of parameters in their contributions to uncertainties in model outputs. To statistically compare their importance, it is necessary that uncertainty and sensitivity analysis techniques provide standard errors of estimated sensitivity indices. In this paper, a delta method is used to analytically approximate standard errors of estimated sensitivity indices for a popular sensitivity analysis method, the Fourier amplitude sensitivity test (FAST). Standard errors estimated based on the delta method were compared with those estimated based on 20 sample replicates. We found that the delta method can provide a good approximation for the standard errors of both first-order and higher-order sensitivity indices. Finally, based on the standard error approximation, we also proposed a method to determine a minimum sample size to achieve the desired estimation precision for a specified sensitivity index. The standard error estimation method presented in this paper can make the FAST analysis computationally much more efficient for complex models.     

Structural inference of the parameters of the heteroscedastic simultaneous equation model

The structural approach of inference for the parameters of a simultaneous equation model with heteroscedastic error variance is investigated in this paper. The joint and the marginal structural distributions for the coefficients of the exogenous variables and the scale parameters of the error variables, and the marginal likelihood function of the coefficients of the endogenous variables have been derived. The estimates are directly obtainable from the structural distribution and the marginal likelihood function of the parameters. The marginal distribution of a subset of coefficients of exogenous variables provides the basis for making inference for a particular subset of parameter of interest.     

E-Bayesian estimation and its E-posterior risk of the exponential distribution parameter based on complete and type I censored samples

Abstract

This article studies E-Bayesian estimation and its E-posterior risk, for failure rate derived from exponential distribution, in the case of the two hyper parameters. In order to measure the estimated risk, the definition of E-posterior risk (expected posterior risk) is proposed based on the definition of E-Bayesian estimation. Moreover, under the different prior distributions of hyper parameters, the formulas of E-Bayesian estimation and formulas of E-posterior risk are given respectively, these estimations are derived based on a conjugate prior distribution for the unknown parameter under the squared error loss function. Monte Carlo simulations are performed to compare the performances of the proposed methods of estimation and a real data set have been analyzed for illustrative purposes, results are compared on the basis of E-posterior risk.     

HEAVY-TAILED-DISTRIBUTED THRESHOLD STOCHASTIC VOLATILITY MODELS IN FINANCIAL TIME SERIES

To capture mean and variance asymmetries and time‐varying volatility in financial time series, we generalize the threshold stochastic volatility (THSV) model and incorporate a heavy‐tailed error distribution. Unlike existing stochastic volatility models, this model simultaneously accounts for uncertainty in the unobserved threshold value and in the time‐delay parameter. Self‐exciting and exogenous threshold variables are considered to investigate the impact of a number of market news variables on volatility changes. Adopting a Bayesian approach, we use Markov chain Monte Carlo methods to estimate all unknown parameters and latent variables. A simulation experiment demonstrates good estimation performance for reasonable sample sizes. In a study of two international financial market indices, we consider two variants of the generalized THSV model, with US market news as the threshold variable. Finally, we compare models using Bayesian forecasting in a value‐at‐risk (VaR) study. The results show that our proposed model can generate more accurate VaR forecasts than can standard models.     

Unimodality of the pareto distribution likelihood function for multicensored samples and implications for estimation

This paper discusses maximum likelihood parameter estimation in the Pareto distribution for multicensored samples. In particu-

lar, the modality of the associated conditional log-likelihood function is investigated in order to resolve questions concerninc

the existence and uniqurneas of the lnarimum likelihood estimates.For the cases with one parameter known, the maximum likelihood

estimates of the remaining unknown parameters are shown to exist and to be unique. When both parameters are unknown, the maximum likelihood estimates may or may not exist and be unique. That is, their existence and uniqueness would seem to depend solely upon the information inherent in the sample data. In viav of the possible nonexistence and/or non-uniqueness of the maximum likelihood estimates when both parameters are unknown, alternatives to standard iterative numerical methods are explored.     

A new Lindley distribution with location parameter

Abstract

The Lindley distribution has been used recently for modeling lifetime data and studying some stress-strength problems. In this paper, a new three-parameter Lindley distribution is introduced. The added location parameter offers more flexibility in fitting some real data against other common distributions. Several statistical and reliability properties are discussed. A simulation study has been carried to examine the MSE, bias, and coverage probability for the parameters. A real data set is used to illustrate the flexibility of the proposed distribution.     

A Conway Maxwell Poisson type generalization of the negative hypergeometric distribution

Abstract

Negative hypergeometric distribution arises as a waiting time distribution when we sample without replacement from a finite population. It has applications in many areas such as inspection sampling and estimation of wildlife populations. However, as is well known, the negative hypergeometric distribution is over-dispersed in the sense that its variance is greater than the mean. To make it more flexible and versatile, we propose a modified version of negative hypergeometric distribution called COM-Negative Hypergeometric distribution (COM-NH) by introducing a shape parameter as in the COM-Poisson and COMP-Binomial distributions. It is shown that under some limiting conditions, COM-NH approaches to a distribution that we call the COM-Negative binomial (COMP-NB), which in turn, approaches to the COM Poisson distribution. For the proposed model, we investigate the dispersion characteristics and shape of the probability mass function for different combinations of parameters. We also develop statistical inference for this model including parameter estimation and hypothesis tests. In particular, we investigate some properties such as bias, MSE, and coverage probabilities of the maximum likelihood estimators for its parameters by Monte Carlo simulation and likelihood ratio test to assess shape parameter of the underlying model. We present illustrative data to provide discussion.     

Statistical inference for Sobol pick-freeze Monte Carlo method

Many mathematical models involve input parameters, which are not precisely known. Global sensitivity analysis aims to identify the parameters whose uncertainty has the largest impact on the variability of a quantity of interest (output of the model). One of the statistical tools used to quantify the influence of each input variable on the output is the Sobol sensitivity index. We consider the statistical estimation of this index from a finite sample of model outputs. We study asymptotic and non-asymptotic properties of two estimators of Sobol indices. These properties are applied to significance tests and estimation by confidence intervals.     

Bayesian Inference and Prediction Analysis of the Power Law Process Based on a Gamma Prior Distribution

Under a Gamma prior distribution, the importance sampling (IS) technique is applied to the Bayesian analysis of the Power Law Process (PLP). Samples of important parameters in the PLP are obtained from IS. Based on these samples, not only the posterior analyses of parameters and some functions of the parameter in the PLP can be performed conveniently, but also single-sample and two-sample predictions are constructed easily by the transformation formula of double integral. The sensitivity of the posterior mean of the parameter functions in the PLP is studied with respect to the prior moments in the Gamma prior distribution, and it can guide the selections of the prior moments. After some numerical experiments illustrate the rationality and feasibility of the proposed methods, an engineering example demonstrates its application.