The Johnson System of Frequency Curves—Historical,Graphical, and Limiting Perspectives

Abstract

The idea of transforming one random variate to another with a more convenient density has been developed in the first half of the 20th century. In his thesis, Norman L. Johnson (1917–2004) developed a pioneering system of transformations of the standard normal distribution which gained substantial popularity in the second half of the 20th century and beyond. In Johnson’s 1949 Johnson, N. L. (1949), “Systems of Frequency Curves Generated by Methods of Translation,” Biometrika, 36, 149–176.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar] Biometrika paper entitled Systems of frequency curves generated by methods of translation, summarizing that thesis, one of his primary interests was the behavior of the shape of the probability density functions as their parameter values change. Herein, we attempt to further elucidate this behavior through a series of geometric expositions of that transformation process. In these expositions insight is obtained into the behavior of Johnson’s density functions, and their skewness and kurtosis, as they converge to their limiting distributions, a topic which received little attention.     

On using percentiles to fit data by a johnson distribution

The well-known Johnson system of distributions was developed by N. L. Johnson (1949). Slifker and Shapiro (1980) presented a criterion for choosing a member from the three distributional classes (S_B,S_L, and S_v) in the Johnson system to fit a set of data. The criterion is based on the value of a quantile ratio which depends on a specified positive z value and the parameters of the distribution. In this paper, we present some properties of the quantile ratio for various distributions and for some selected z values. Some comments are made on using the criterion for selecting a Johnson distribution to fit empirical data.     

On least absolute values estimation

The resistance of least absolute values (L₁) estimators to outliers and their robustness to heavy-tailed distributions make these estimators useful alternatives to the usual least squares estimators. The recent development of efficient algorithms for L₁ estimation in linear models has permitted their use in practical data analysis. Although in general the L₁ estimators are not unique, there are a number of properties they all share. The set of all L₁ estimators for a given model and data set can be characterized as the convex hull of some extreme estimators. Properties of the extreme estimators and of the L₁-estimate set are considered.     

Solutions to Johnson's SB and SU

Simple iterative and exact solutions are described depending on symmetric percentage points for the Johnson translation system of distributions. A condition is given for a zero skewness parameter.     

Dependence Structure of Spacings of Order Statistics

Let X_1:n ≤ X_2:n ≤···≤ X_n:n denote the order statistics of a sample of n independent random variables X₁, X₂,…, X_n, all identically distributed as some X. It is shown that if X has a log-convex [log-concave] density function, then the general spacing vector (X_k1:n, X_k2:n ? X_k1:n,…, X_kr:n ? X_kr?1:n) is MTP₂ [S-MRR₂] whenever 1 ≤ k₁ < k₂ <···< k_r ≤ n and 1 ≤ r ≤ n. Multivariate likelihood ratio ordering of such general spacing vectors corresponding to two random samples is also considered. These extend some of the results in the literature for usual spacing vectors.     

Recurrence relations for the minimum variance unbiased estimator of the probability function of the R distribution

We obtain a new technique to calculate the value of the minimum variance unbiased estimator (MVUE) of the probability function (p.f.) of the R distribution. This technique is based on an investigation of the ratios of r numbers. A recurrence relation for the MVUE of the p.f. of the R distribution is derived. It is interesting that the derived relation does not depend on the r numbers but depends on the ratios of the r numbers. The new method is efficient, convenient and accurate.     

On L 1-consistency of kernel-type density estimator for stationary markov processes

A convergence result for kernel type density estimators, proved by Devroye and Gyrofi (1985), is extended to stationary Markov processess satisfying (G ₂-condition introduced by Rosenblatt (1970).     

A MORE GENERAL CRITERION FOR SUBSET SELECTION IN MULTIPLE LINEAR REGRESSION

ABSTRACT

In this article, we propose a more general criterion called S_p -criterion, for subset selection in the multiple linear regression Model. Many subset selection methods are based on the Least Squares (LS) estimator of β, but whenever the data contain an influential observation or the distribution of the error variable deviates from normality, the LS estimator performs ‘poorly’ and hence a method based on this estimator (for example, Mallows’ C_p -criterion) tends to select a ‘wrong’ subset. The proposed method overcomes this drawback and its main feature is that it can be used with any type of estimator (either the LS estimator or any robust estimator) of β without any need for modification of the proposed criterion. Moreover, this technique is operationally simple to implement as compared to other existing criteria. The method is illustrated with examples.     

The optimal Lp norm estimator in linear regression models

The least squares estimator is usually applied when estimating the parameters in linear regression models. As this estimator is sensitive to departures from normality in the residual distribution, several alternatives have been proposed. The L_p norm estimators is one class of such alternatives. It has been proposed that the kurtosis of the residual distribution be taken into account when a choice of estimator in the L_p norm class is made (i.e. the choice of p). In this paper, the asymtotic variance of the estimators is used as the criterion in the choice of p. It is shown that when this criterion is applied, other characteristics of the residual distribution than the kurtosis (namely moments of order p-2 and 2p-2) are important.     

A Note on Criterion-Robust Optimal Designs for Model Discrimination and Parameter Estimation in Polynomial Regression Models

Consider the problem of discriminating between the polynomial regression models on [?1, 1] and estimating parameters in the models. Zen and Tsai (2002 Zen , M. M. , Tsai , M. H. ( 2002 ). Some criterion-robust optimal designs for the dual problem of model discrimination and parameter estimation . Sankhya Ind. J. Statist. 64 : (Series B, Pt. 3) : 322 – 338 . [Google Scholar]) proposed a multiple-objective optimality criterion, M _γ-criterion, which uses weight γ (0 ≤ γ ≤ 1) for model discrimination and α = β = (1 ? γ)/2 for parameter estimation in each model. In this article, we generalize it to a wider setup with different values of α and β. For instance, α = 2 β suggests that the “smaller” model is more likely to be the true model. Using similar techniques, the corresponding criterion-robust optimal design is investigated. A study for the original criterion-robust optimal design with α = β, through M-efficiency, shows that it is good enough for any wider setup.     

Stochastic Comparisons and Dependence of Spacings from Two Samples of Exponential Random Variables

Let X ₁,X ₂,…,X _n be independent exponential random variables such that X _i has hazard rate λ for i = 1,…,p and X _j has hazard rate λ* for j = p + 1,…,n, where 1 ≤ p < n. Denote by D _i:n (λ, λ*) = X _i:n  ? X _i?1:n the ith spacing of the order statistics X _1:n  ≤ X _2:n  ≤ ··· ≤ X _n:n , i = 1,…,n, where X _0:n ≡ 0. It is shown that the spacings (D _1,n ,D _2,n ,…,D _n:n ) are MTP₂, strengthening one result of Khaledi and Kochar (2000), and that (D _1:n (λ₂, λ*),…,D _n:n (λ₂, λ*)) ≤ _lr (D _1:n (λ₁, λ*),…,D _n:n (λ₁, λ*)) for λ₁ ≤ λ* ≤ λ₂, where ≤ _lr denotes the multivariate likelihood ratio order. A counterexample is also given to show that this comparison result is in general not true for λ* < λ₁ < λ₂.     

Constructions of partially efficiency-balanced designs and their analysis

Partially Efficiency-Balanced (PEB) designs were introduced by Puri and Nigam $year:1977. These designs may be particularly useful for bio-assays and factorial experiments and have a very simple analysis. In the present paper, we give several new systematic procedures of constructing PEB designs with varying replications. A number of practical series of PEB designs are presented. We shall also pre- sent the methods of analysing these designs produced here.     

Least absolute value regression: a special case of piecewise linear minimization

The Barrodale and Roberts algorithm for least absolute value (LAV) regression and the algorithm proposed by Bartels and Conn both have the advantage that they are often able to skip across points at which the conventional simplex-method algorithms for LAV regression would be required to carry out an (expensive) pivot operation.

We indicate here that this advantage holds in the Bartels-Conn approach for a wider class of problems: the minimization of piecewise linear functions. We show how LAV regression, restricted LAV regression, general linear programming and least maximum absolute value regression can all be easily expressed as piecewise linear minimization problems.     

Attribute Charts for Zero-Inflated Processes

The classical Shewhart c-chart and p-chart which are constructed based on the Poisson and binomial distributions are inappropriate in monitoring zero-inflated counts. They tend to underestimate the dispersion of zero-inflated counts and subsequently lead to higher false alarm rate in detecting out-of-control signals. Another drawback of these charts is that their 3-sigma control limits, evaluated based on the asymptotic normality assumption of the attribute counts, have a systematic negative bias in their coverage probability. We recommend that the zero-inflated models which account for the excess number of zeros should first be fitted to the zero-inflated Poisson and binomial counts. The Poisson parameter λ estimated from a zero-inflated Poisson model is then used to construct a one-sided c-chart with its upper control limit constructed based on the Jeffreys prior interval that provides good coverage probability for λ. Similarly, the binomial parameter p estimated from a zero-inflated binomial model is used to construct a one-sided np-chart with its upper control limit constructed based on the Jeffreys prior interval or Blyth–Still interval of the binomial proportion p. A simple two-of-two control rule is also recommended to improve further on the performance of these two proposed charts.     

A program to calculate bootstrap confidence intervals for the process capability index Cpk

Franklin and Wasserman (1991) introduced the use of Bootstrap sampling procedures for deriving nonparametric confidence intervals for the process capability index, C_pk, which are applicable for instances when at least twenty data points are available. This represents a significant reduction in the usually recommended sample requirement of 100 observations (see Gunther 1989). To facilitate and encourage the use of these procedures. a FORTRAN program is provided for computation of confidence intervals for C_pk. Three methods are provided for this calculation including the standard method, the percentile confidence interval, and the biased - corrected percentile confidence interval.     

On perturbations of Stein operator

In this article, we obtain a Stein operator for the sum of n independent random variables (rvs) which is shown as the perturbation of the negative binomial (NB) operator. Comparing the operator with NB operator, we derive the error bounds for total variation distance by matching parameters. Also, three-parameter approximation for such a sum is considered and is shown to improve the existing bounds in the literature. Finally, an application of our results to a function of waiting time for (k₁, k₂)-events is given.     

On multivariate weighted distributions

The concept of weighted distributions is well-known in the literature concerning observational studies and surveys in research related to forestry, ecology, bio-medicine and many other areas (cf. Rao (1965)). This paper extends the idea of weighted distributions to multivariate case. A few multivariate orderings have been defined and some partial ordering results are presented. Some results regarding multivariate positive and negative dependence are also discussed. Multivariate weighted distributions - joint, marginal and conditional have been defined and some important results concerning them are presented along with an illustration. The Multivariate Poisson Negative Hypergeometric Distribution has been derived.     

On the increasing failure rate criteria

We introduce the t₀ -increasing failure rate (IFR-t₀) class, where the failure rate at age x+t₀is greater then or equal to the failure rate at age x for x≥0. The dual class of t₀- decreasing failure rate (DER-t₀) is defined analogoualy.The relation between the IFR -t₀class and other classes of life distributions is studied. Preservation and nonpreservation properties of the IFR-t₀ and the DFR-t₀ classes under various reliablity operation are presented. The concet of stochastic comparison is utilized to cheracterized the IFR-t ₀ class and to suggest other classes of life distributions for aging.     

Remarks on the L1 distance in statistical data analysis

We propose the L₁ distance between the distribution of a binned data sample and a probability distribution from which it is hypothetically drawn as a statistic for testing agreement between the data and a model. We study the distribution of this distance for N-element samples drawn from k bins of equal probability and derive asymptotic formulae for the mean and dispersion of L₁ in the large-N limit. We argue that the L₁ distance is asymptotically normally distributed, with the mean and dispersion being accurately reproduced by asymptotic formulae even for moderately large values of N and k.     

Admissibility in factorial designs

The notion of admissibility in factorial designs has been introduced. It has been shown that factorial designs which are binary and have a C-matrix with property A are admissible.