ASYMPTOTIC DISTRIBUTION OF THE LARGEST EIGENVALUE

ABSTRACT

This paper studies the asymptotic distribution of the largest eigenvalue of the sample covariance matrix. The multivariate distribution for the population is assumed to be elliptical with finite kurtosis 3κ. An expression as an expectation is obtained for the distribution function of the largest eigenvalue regardless of the multiplicity, m, of the population's largest eigenvalue. The asymptotic distribution function and density function are evaluated numerically for m = 2,3,4,5. The bootstrap of the average of the m largest eigenvalues is shown to be consistent for any underlying distribution with finite fourth-order cumulants.     

Estimating kurtosis and confidence intervals for the variance under nonnormality

Exact confidence intervals for variances rely on normal distribution assumptions. Alternatively, large-sample confidence intervals for the variance can be attained if one estimates the kurtosis of the underlying distribution. The method used to estimate the kurtosis has a direct impact on the performance of the interval and thus the quality of statistical inferences. In this paper the author considers a number of kurtosis estimators combined with large-sample theory to construct approximate confidence intervals for the variance. In addition, a nonparametric bootstrap resampling procedure is used to build bootstrap confidence intervals for the variance. Simulated coverage probabilities using different confidence interval methods are computed for a variety of sample sizes and distributions. A modification to a conventional estimator of the kurtosis, in conjunction with adjustments to the mean and variance of the asymptotic distribution of a function of the sample variance, improves the resulting coverage values for leptokurtically distributed populations.     

A note on the asymptotic distribution of the process capability index C pmk

Process capability indices have been widely used to evaluate the process performance to the continuous improvement of quality and productivity. The distribution of the estimator of the process capability index C _pmk is very complicated and the asymptotic distribution is proposed by Chen and Hsu [The asymptotic distribution of the processes capability index C _pmk , Comm. Statist. Theory Methods 24(5) (1995), pp. 1279–1291]. However, we found a critical error for the asymptotic distribution when the population mean is not equal to the midpoint of the specification limits. In this paper, a correct version of the asymptotic distribution is given. An asymptotic confidence interval of C _pmk by using the correct version of asymptotic distribution is proposed and the lower bound can be used to test if the process is capable. A simulation study of the coverage probability of the proposed confidence interval is shown to be satisfactory. The relation of six sigma technique and the index C _pmk is also discussed in this paper. An asymptotic testing procedure to determine if a process is capable based on the index of C _pmk is also given in this paper.     

Meta-analysis,pretest, and shrinkage estimation of kurtosis parameters

An asymptotic theory for the improved estimation of kurtosis parameter vector is developed for multi-sample case using uncertain prior information (UPI) that several kurtosis parameters are the same. Meta-analysis is performed to obtain pooled estimator, as it is a statistical methodology for pooling quantitative evidence. Pooled estimator is a good choice when assumption of homogeneity holds but it becomes inconsistent as assumption violates, therefore pretest and Stein-type shrinkage estimators are proposed as they combine sample and nonsample information in a superior way. Asymptotic properties of suggested estimators are discussed and their risk comparisons are also mentioned.     

Sensitivity of normal-based triple sampling sequential point estimation to the normality assumption

This paper discusses the sensitivity of the sequential normal-based triple sampling procedure for estimating the population mean to departures from normality. We assume that the underlying population has finite absolute sixth moment and find that asymptotically the behavior of the estimator and of the sample size depend on the skewness and kurtosis of the underlying distribution when using a squared error loss function with linear sampling cost. These results enable the effects of non-normality easily to be assessed both qualitatively and quantitatively. We supplement our asymptotic results with a simulation experiment to study the performance of the estimator and the sample size in a range of conditions.     

Maximum Likelihood Estimation in the Bivariate Binomial (0,1) Distribution:Application TO 2×2 Tables

We consider a 2×2 contingency table, with dichotomized qualitative characters (A,A) and (B,B), as a sample of size n drawn from a bivariate binomial (0,1) distribution. Maximum likelihood estimates p?₁p?₂ and p? are derived for the parameters of the two marginals p₁p₂ and the coefficient of correlation. It is found that p? is identical to Pearson's (1904)?=(χ²/n)½, where ?² is Pearson's usual chi-square for the 2×2 table. The asymptotic variance-covariance matrix of p?_lp?₂and p is also derived.     

A powerful and interpretable alternative to the Jarque–Bera test of normality based on 2nd-power skewness and kurtosis,using the Rao's score test on the APD family

We introduce the 2nd-power skewness and kurtosis, which are interesting alternatives to the classical Pearson's skewness and kurtosis, called 3rd-power skewness and 4th-power kurtosis in our terminology. We use the sample 2nd-power skewness and kurtosis to build a powerful test of normality. This test can also be derived as Rao's score test on the asymmetric power distribution, which combines the large range of exponential tail behavior provided by the exponential power distribution family with various levels of asymmetry. We find that our test statistic is asymptotically chi-squared distributed. We also propose a modified test statistic, for which we show numerically that the distribution can be approximated for finite sample sizes with very high precision by a chi-square. Similarly, we propose a directional test based on sample 2nd-power kurtosis only, for the situations where the true distribution is known to be symmetric. Our tests are very similar in spirit to the famous Jarque–Bera test, and as such are also locally optimal. They offer the same nice interpretation, with in addition the gold standard power of the regression and correlation tests. An extensive empirical power analysis is performed, which shows that our tests are among the most powerful normality tests. Our test is implemented in an R package called PoweR.     

On order statistics from thelog-logistic distribution and their properties

The aim of this paper is to derive the exact forms of the p.d.f. and the moments of the rth order statistics in a sample of size n from the Log-logistic (L_l ) distribution. Measures of skewness and kurtosis are tabulated. The recurrence relations between the moments of all order statistics and an expression of the covariance between any two order statistics, x_i and x_jand the distribution of the ratio of X_i to x_j are derived.     

A hypothesis testing procedure for the evaluation on the lifetime performance index of products with Burr XII distribution under progressive type I interval censoring

ABSTRACT

It is a very important topic these days to assessing the lifetime performance of products in manufacturing or service industries. Lifetime performance indices C_L is used to measure the larger-the-better type quality characteristics to evaluate the process performance for the improvement of quality and productivity. The lifetimes of products are assumed to have Burr XII distribution. The maximum likelihood estimator is used to estimate the lifetime performance index based on the progressive type I interval censored sample. The asymptotic distribution of this estimator is also developed. We use this estimator to build the new hypothesis testing algorithmic procedure with respect to a lower specification limit. Finally, two practical examples are given to illustrate the use of this testing algorithmic procedure to determine whether the process is capable.     

Robust M-estimators of scale: Minimax bias versus maximal variance

In the location-scale estimation problem, we study robustness properties of M-estimators of the scale parameter under unknown ?-contamination of a fixed symmetric unimodal error distribution F₀. Within a general class of M-estimators, the estimator with minimax asymptotic bias is shown to lie within the subclass of α-interquantile ranges of the empirical distribution symmetrized about the sample median. Our main result is that as ? → 0, the limiting minimax asymptotic bias estimator is sometimes (e.g., when F_o is Cauchy), but not always, the median absolute deviation about the median. It is also shown that contamination in the neighbourhood of a discontinuity of the influence function of a minimax bias estimator can sometimes inflate the asymptotic variance beyond that achieved by placing all the ?-contamination at infinity. This effect is quantified by a new notion of asymptotic efficiency that takes into account the effect of infinitesimal contamination of the parametric model for the error distribution.     

Uniform convergence of an empirical cdf based on a relatively small number of order statistics

An empirical distribution function F_m, defined on a subset of order statistics of a random sample of size n taken from the distribution of a random variable with continuous distribution function F, is shown to converge uniformly with probability one to F. Small sample distributions of the one and two sided deviations and the asymptotic normality of the standardized F_m are established. The relative efficiency of F_m as compared to the classical empirical distribution function is calculated and tabled. for n = 10, 20, 50, 100, 200.     

The Kumaraswamy Gumbel distribution

The Gumbel distribution is perhaps the most widely applied statistical distribution for problems in engineering. We propose a generalization—referred to as the Kumaraswamy Gumbel distribution—and provide a comprehensive treatment of its structural properties. We obtain the analytical shapes of the density and hazard rate functions. We calculate explicit expressions for the moments and generating function. The variation of the skewness and kurtosis measures is examined and the asymptotic distribution of the extreme values is investigated. Explicit expressions are also derived for the moments of order statistics. The methods of maximum likelihood and parametric bootstrap and a Bayesian procedure are proposed for estimating the model parameters. We obtain the expected information matrix. An application of the new model to a real dataset illustrates the potentiality of the proposed model. Two bivariate generalizations of the model are proposed.     

THE EFFECTS OF CORRELATION AMONG OBSERVATIONS ON THE ACCURACY OF APPROXIMATING THE DISTRIBUTION OF SAMPLE MEAN BY ITS ASYMPTOTIC DISTRIBUTION1

In this paper, we investigate the effects of correlation among observations on the accuracy of approximating the distribution of sample mean by its asymptotic distribution. The accuracy is investigated by the Berry-Esseen bound (BEB), which gives an upper bound on the error of approximation of the distribution function of the sample mean from its asymptotic distribution for independent observations. For a given sample size (n₀) the BEB is obtained when the observations are independent. Let this be BEB. We then find the sample size (n_*) required to have BEB below BEB₀, when the observations are dependent. Comparison of n_* with n₀ reveals the effects of correlation among observations on the accuracy of the asymptotic distribution as an approximation. It is shown that the effects of correlation among observations are not appreciable if the correlation is moderate to small but it can be severe for extreme correlations.     

Homogeneity test based on ranked set samples

Abstract

The homogeneity hypothesis is investigated in a location family of distributions. A moment-based test is introduced based on data collected from a ranked set sampling scheme. The asymptotic distribution of the proposed test statistic is determined and the performance of the test is studied via simulation. Furthermore, for small sample sizes, the bootstrap procedure is used to distinguish the homogeneity of data. An illustrative example is also presented to explain the proposed procedures in this paper.     

Recurrence formula on the joint distribution of sample skewness and kurtosis under normality

Abstract

Two recurrence relations with respect to sample size are given concerning the joint distribution of skewness and kurtosis of random observations from a normal population: one between the probability density functions and the other between the product moments. As a consequence, the latter yields a recurrence formula for the moments of sample kurtosis. The exact moments of Jarque-Bera statistic is also given.     

The optimal Lp norm estimator in linear regression models

The least squares estimator is usually applied when estimating the parameters in linear regression models. As this estimator is sensitive to departures from normality in the residual distribution, several alternatives have been proposed. The L_p norm estimators is one class of such alternatives. It has been proposed that the kurtosis of the residual distribution be taken into account when a choice of estimator in the L_p norm class is made (i.e. the choice of p). In this paper, the asymtotic variance of the estimators is used as the criterion in the choice of p. It is shown that when this criterion is applied, other characteristics of the residual distribution than the kurtosis (namely moments of order p-2 and 2p-2) are important.     

Uniform robustness against nonnormality of the t and f tests

The size of the two-sample t test is generally thought to be robust against nonnormal distributions if the sample sizes are large. This belief is based on central limit theory, and asymptotic expansions of the moments of the t statistic suggest that robustness may be improved for moderate sample sizes if the variance, skewness, and kurtosis of the distributions are matched, particularly if the sample sizes are also equal.

It is shown that asymptotic arguments such as these can be misleading and that, in fact, the size of the t test can be as large as unity if the distributions are allowed to be completely arbitrary. Restricting the distributions to be identical or symmetric (but otherwise arbitrary) does not guarantee that the size can be controlled either, but controlling the tail-heaviness of the distributions does. The last result is proved more generally for the k-sample F test.     

Effect of Violation of the Normal Assumption on MI and ML Estimators in the Analysis of Incomplete Data

Asymptotic distributions of normal-theory-based ML/MI estimators are studied in a simple regression model under general distributions with MAR missing data. The asymptotic variance of the ML/MI estimator of residuals’ variance is explicitly derived, from which it follows that the kurtosis of the error distribution primarily affects the asymptotic variance. Results of numerical simulations conducted to study finite sample properties of the estimators, conformed largely to the asymptotic results, and they also indicated interesting findings particularly for small samples, which do not follow from the asymptotic property. It is concluded that the ML estimators perform best in the situation studied here.     

Skewness,kurtosis, and black-scholes option mispricing

The Black-Scholes option pricing model assumes that (instantaneous) common stock returns are normally distributed. However, the observed distribution exhibits deviations from normality; in particular skewness and kurtosis. We attribute these deviations to gross data errors. Using options' transactions data, we establish that the sample standard deviation, sample skewness, and sample kurtosis contribute to the Black-Scholes model's observed mispricing of a sample from the Berkeley Options Data Base of 2323 call options written on 88 common stocks paying no dividends during the options'life. Following Huber's statement that the primary case for robust statistics is when the shape of the observed distribution deviates slightly from the assumed distribution (usually the Gaussian), we show that robust volatility estimators eliminate the mispricing with respect to sample skewness and sample kurtosis, and significantly improve the Black-Scholes model's pricing performance with respect to estimated volatility.