On some reliability aspects of Pearson family of distributions

We characterize the Pearson family of distributions by finding a relationship between the failure rate and the higher order moments of residual life. We also present a characterization theorem of IFR(DFR) class of distributions in the Pearson family.     

基于Pearson Ⅳ分布的VaR与CVaR估计

基于GARCH模型,用Pearson Ⅳ分布拟合标准残差,给出一种更为精确的VaR和CVaR计算方法.重点研究在Norm-GARCH、t-GARCH与GED-GARCH模型下,用原分布和Pearson Ⅳ分布计算VaR的比较,结果表明,用Pearson Ⅳ分布计算VaR都能得到比原分布更小的失败率,且在三种模型之下用Pearson Ⅳ分布计算VaR结果很接近,都能通过检验,所以选择最简单的Norm-GARCH模型就可以;基于此,研究在Norm-GARCH模型下,用正态分布和Pearson Ⅳ分布计算CVaR,并与VaR进行比较,结果表明,用Pearson Ⅳ分布计算VaR和CVaR的失败率都远远小于由正态分布所得到的失败率,特别在VaR估计失效的交易日里,用Pearson Ⅳ分布得到的CVaR均值与实际损失均值非常接近.因此,Pearson Ⅳ分布能很好地刻画金融数据的特征,相对其他分布而言是一个很好的选择.     

Failure probability estimation under additional subsystem information with application to semiconductor burn-in

In the classical approach to qualitative reliability demonstration, system failure probabilities are estimated based on a binomial sample drawn from the running production. In this paper, we show how to take account of additional available sampling information for some or even all subsystems of a current system under test with serial reliability structure. In that connection, we present two approaches, a frequentist and a Bayesian one, for assessing an upper bound for the failure probability of serial systems under binomial subsystem data. In the frequentist approach, we introduce (i) a new way of deriving the probability distribution for the number of system failures, which might be randomly assembled from the failed subsystems and (ii) a more accurate estimator for the Clopper–Pearson upper bound using a beta mixture distribution. In the Bayesian approach, however, we infer the posterior distribution for the system failure probability on the basis of the system/subsystem testing results and a prior distribution for the subsystem failure probabilities. We propose three different prior distributions and compare their performances in the context of high reliability testing. Finally, we apply the proposed methods to reduce the efforts of semiconductor burn-in studies by considering synergies such as comparable chip layers, among different chip technologies.     

A CLOSED-FORM EXPRESSION FOR THE PEARSON TYPE IV DISTRIBUTION FUNCTION

A closed-form expression is presented for the probability integral of the Pearson Type IV distribution, and a corresponding method of evaluation is given. This analysis addresses a long-standing gap in the theory of the Pearson system of distributions. In addition, a simple derivation is given of an expression for the normalizing constant in the Type IV integral.     

Some properties of the tukey g and h family of distributions

The g and h family of distributions, introduced by J.W. Tukey, is generated by a single transformation of the standard normal which allows for symmetry and heavier tails. Selected percentage points are tabulated, and a closed-form solution for the moments, when they exist, is found. A comparison is made with the Pearson system of distributions. The g and h distributions cover most of the Pearson family to an adequate approximation, when the first four moments exist, and also generate a variety of other types of distributions. Selected distributions graphically illustrate the great variety of possible shapes.     

Estimating the correlation coefficient in the presence of correlated observations from a bivariate normal population

Estimation of the correlation coefficient between two variates (p) in the presence of correlated observations from a bivar iate normal population is considered The estimated maximum likelihood estimator (EMLE), an estimate based on the maximum likelihood estimator (MLE), is proposed and studied for the estimation of p For the large sample case , approximate expressions foi the variance and the bias of the Pearson estimate of the correlation coefficient are derived. These expressions suggests that the Pearson’s estimator possesses high mean square error (MSE) in estimating ρ in comparison to the MLE The MSE is particularly high when the observations within clusters aie highly correlated. The Pearson’s estimate, the MLE, and the EMLE aie evaluated in a simulation study This study shows that the proposed EMLE pefoims bettei than the Pearson’s correlation coefficient except when the number of clusters is small.     

The Pearson Diffusions: A Class of Statistically Tractable Diffusion Processes

Abstract.  The Pearson diffusions form a flexible class of diffusions defined by having linear drift and quadratic squared diffusion coefficient. It is demonstrated that for this class explicit statistical inference is feasible. A complete model classification is presented for the ergodic Pearson diffusions. The class of stationary distributions equals the full Pearson system of distributions. Well-known instances are the Ornstein–Uhlenbeck processes and the square root (CIR) processes. Also diffusions with heavy-tailed and skew marginals are included. Explicit formulae for the conditional moments and the polynomial eigenfunctions are derived. Explicit optimal martingale estimating functions are found. The discussion covers GMM, quasi-likelihood, non-linear weighted least squares estimation and likelihood inference too. The analytical tractability is inherited by transformed Pearson diffusions, integrated Pearson diffusions, sums of Pearson diffusions and Pearson stochastic volatility models. For the non-Markov models, explicit optimal prediction-based estimating functions are found. The estimators are shown to be consistent and asymptotically normal.     

On influence diagnostic in univariate elliptical linear regression models

We discuss in this paper the assessment of local influence in univariate elliptical linear regression models. This class includes all symmetric continuous distributions, such as normal, Student-t, Pearson VII, exponential power and logistic, among others. We derive the appropriate matrices for assessing the local influence on the parameter estimates and on predictions by considering as influence measures the likelihood displacement and a distance based on the Pearson residual. Two examples with real data are given for illustration.     

CSISZAR DIVERGENCE FROM CONSTANT FAILURE RATE MODEL FOR GROUPED DATA

We propose a measure of divergence in failure rates of a system from the constant failure rate model for a grouped data situation. We use this measure to compare the divergences of several systems from the constant failure rate model and find the asymptotic distributions of the test statistics. Several applications are discussed to illustrate the procedure. In the context of testing the goodness-of-fit with the constant failure rate model, we conduct a simulation study which shows that this procedure compares favorably with the Pearson chi-square test and the likelihood ratio test procedures.     

Computational Examples of a New Method for Distribution Selection in the Pearson System

A considerable problem in statistics and risk management is finding distributions that capture the complex behaviour exhibited by financial data. The importance of higher order moments in decision making has been well recognized and there is increasing interest in modelling with distributions that are able to account for these effects. The Pearson system can be used to model a wide scale of distributions with various skewness and kurtosis. This paper provides computational examples of a new easily implemented method for selecting probability density functions from the Pearson family of distributions. We apply this method to daily, monthly, and annual series using a range of data from commodity markets to macroeconomic variables.     

Identification of Multiple Outliers in Logistic Regression

The use of logistic regression modeling has seen a great deal of attention in the literature in recent years. This includes all aspects of the logistic regression model including the identification of outliers. A variety of methods for the identification of outliers, such as the standardized Pearson residuals, are now available in the literature. These methods, however, are successful only if the data contain a single outlier. In the presence of multiple outliers in the data, which is often the case in practice, these methods fail to detect the outliers. This is due to the well-known problems of masking (false negative) and swamping (false positive) effects. In this article, we propose a new method for the identification of multiple outliers in logistic regression. We develop a generalized version of standardized Pearson residuals based on group deletion and then propose a technique for identifying multiple outliers. The performance of the proposed method is then investigated through several examples.     

Simple correspondence analysis using adjusted residuals

Correspondence analysis is a versatile statistical technique that allows the user to graphically identify the association that may exist between variables of a contingency table. For two categorical variables, the classical approach involves applying singular value decomposition to the Pearson residuals of the table. These residuals allow for one to use a simple test to determine those cells that deviate from what is expected under independence. However, the assumptions concerning these residuals are not always satisfied and so such results can lead to questionable conclusions.One may consider instead, an adjustment of the Pearson residual, which is known to have properties associated with the standard normal distribution. This paper explores the application of these adjusted residuals to correspondence analysis and determines how they impact upon the configuration of points in the graphical display.     

A Single Form for t-Distributions and Symmetric Beta Distributions

A single parametric form is given for the symmetric distributions in the Pearson system with finite variance. In effect, these are Student's t-distributions with ν > 2 and all centered symmetric beta distributions. A different parametrization allows the inclusion of the t-distributions with ν ≤2 at the expense of symmetric beta distributions with a low shape parameter.     

On the influence of misclassified data on results of goodness of fit testing

In this paper we focus on the chi-square test of goodness of fit, which compares an observed discrete distribution to an expected known one. We show that the results of this test, using the common Pearson statistic, are very sensitive to misclassified observations between two or more categories. We also propose a general rule of thumb for analysing data set stability with respect to such classification errors. Practical analysis of a real example illustrates our purpose.     

Adjusted Pearson residuals in beta regression models

In this paper, matrix formulae of order n^?1, where n is the sample size, for the first two moments of Pearson residuals are obtained in beta regression models. Adjusted Pearson residuals are also obtained, having, to this order, expected value zero and variance one. Monte Carlo simulation results are presented illustrating the behaviour of both adjusted and unadjusted residuals.     

Adjusted Pearson residuals in exponential family nonlinear models

In this paper, we give matrix formulae of order 𝒪(n ^?1), where n is the sample size, for the first two moments of Pearson residuals in exponential family nonlinear regression models [G.M. Cordeiro and G.A. Paula, Improved likelihood ratio statistic for exponential family nonlinear models, Biometrika 76 (1989), pp. 93–100.]. The formulae are applicable to many regression models in common use and generalize the results by Cordeiro [G.M. Cordeiro, On Pearson's residuals in generalized linear models, Statist. Prob. Lett. 66 (2004), pp. 213–219.] and Cook and Tsai [R.D. Cook and C.L. Tsai, Residuals in nonlinear regression, Biometrika 72(1985), pp. 23–29.]. We suggest adjusted Pearson residuals for these models having, to this order, the expected value zero and variance one. We show that the adjusted Pearson residuals can be easily computed by weighted linear regressions. Some numerical results from simulations indicate that the adjusted Pearson residuals are better approximated by the standard normal distribution than the Pearson residuals.     

Comparison of Some Mrpp and Standard Rank Tests for Two Unequal Samples

MRPP rank tests for two subgroups of unequal size are studied in detail. Based on the Pearson criteria, appropriate Pearson curves are suggested for their approximate distributions. On the basis ot extensive simulations, empirical powers of these tests are compared among themselves and with some standard nonparametric tests for several underlying populations.     

Description of a subfamily of the discrete pearson system as generalized-binomial distributions

In this paper we prove that a subfamily of distributions of the discrete Pearson, system, containing the Pólya distribution without replacement and hence the hypergeometric distribution, can be described as generalized-binomial distributions, i.e., the distribution of the number of successes which occur in independent trials. It is also shown that the probability of success will necessarily be different in each trial, with the exception of deterministic ones. As a consequence, all the properties of the generalized-binomial distribution will apply to this subfamily. Thus, applications to hypothesis testing and confidence intervals in the Pólya distribution are considered.     

Simulating dependent discrete data

This article describes a method for simulating n-dimensional multivariate non-normal data, with emphasis on count-valued data. Dependence is characterized by either Pearson correlations or Spearman correlations. The simulation is accomplished by simulating a vector of correlated standard normal variates. The elements of this vector are then transformed to achieve the target marginal distributions. We prove that the method corresponds to simulating data from a multivariate Gaussian copula. The simulation method does not restrict pairwise dependence beyond the limits imposed by the marginal distributions and can achieve any Pearson or Spearman correlation within those limits. Two examples are included. In the first example, marginal means, variances, Pearson correlations, and Spearman correlations are estimated from the epileptic seizure data set of Diggle et al. [P. Diggle, P. Heagerty, K.Y. Liang, and S. Zeger, Analysis of Longitudinal Data, Oxford University Press, Oxford, 2002]. Data with these means and variances are simulated to first achieve the estimated Pearson correlations and then achieve the estimated Spearman correlations. The second example is of a hypothetical time series of Poisson counts with seasonal mean ranging between 1 and 9 and an autoregressive(1) dependence structure.