Testing for normality in linear regression models

The importance of the normal distribution for fitting continuous data is well known. However, in many practical situations data distribution departs from normality. For example, the sample skewness and the sample kurtosis are far away from 0 and 3, respectively, which are nice properties of normal distributions. So, it is important to have formal tests of normality against any alternative. D'Agostino et al. [A suggestion for using powerful and informative tests of normality, Am. Statist. 44 (1990), pp. 316–321] review four procedures Z ²(g ₁), Z ²(g ₂), D and K ² for testing departure from normality. The first two of these procedures are tests of normality against departure due to skewness and kurtosis, respectively. The other two tests are omnibus tests. An alternative to the normal distribution is a class of skew-normal distributions (see [A. Azzalini, A class of distributions which includes the normal ones, Scand. J. Statist. 12 (1985), pp. 171–178]). In this paper, we obtain a score test (W) and a likelihood ratio test (LR) of goodness of fit of the normal regression model against the skew-normal family of regression models. It turns out that the score test is based on the sample skewness and is of very simple form. The performance of these six procedures, in terms of size and power, are compared using simulations. The level properties of the three statistics LR, W and Z ²(g ₁) are similar and close to the nominal level for moderate to large sample sizes. Also, their power properties are similar for small departure from normality due to skewness (γ₁≤0.4). Of these, the score test statistic has a very simple form and computationally much simpler than the other two statistics. The LR statistic, in general, has highest power, although it is computationally much complex as it requires estimates of the parameters under the normal model as well as those under the skew-normal model. So, the score test may be used to test for normality against small departure from normality due to skewness. Otherwise, the likelihood ratio statistic LR should be used as it detects general departure from normality (due to both skewness and kurtosis) with, in general, largest power.     

An alternative and generalized excess measure and its advantages

In this paper an alternative measure for the excess, called standard archα _s , is introduced. It is only an affine transformation of the classical kurtosis, but has many advantages. It can be defined as the double relative asymptotic variance of the standard deviation and can be generalized as the double relative asymptotic variance of any other scale estimator. The inequalities between skewness and kurtosis given inTeuscher andGuiard (1995) are transformed to the corresponding inequalities between skewness and standard arch.     

THE RELATIONSHIPS BETWEEN SKEWNESS AND KURTOSIS

Theoretical considerations of kurtosis, whether of partial orderings of distributions with respect to kurtosis or of measures of kurtosis, have tended to focus only on symmetric distributions. With reference to historical points and recent work on skewness and kurtosis, this paper defines anti-skewness and uses it as a tool to discuss the concept of kurtosis in asymmetric univariate distributions. The discussion indicates that while kurtosis is best considered as a property of symmetrised versions of distributions, symmetrisation does not simply remove skewness. Skewness, anti-skewness and kurtosis are all inter-related aspects of shape. The Tukey g and h family and the Johnson Su family are considered as examples.     

A New Measure of Kurtosis Adjusted for Skewness

Studies of kurtosis often concentrate on only symmetric distributions. This paper identifies a process through which the standardized measure of kurtosis based on the fourth moment about the mean can be written in terms of two parts: (i) an irreducible component, about L₄, which can be seen to occur naturally in the analysis of fourth moments; (ii) terms that depend only on moments of lower order, in particular including the effects of asymmetry attached to the third moment about the mean. This separation of the effect of skewness allows definition of an improved measure of kurtosis. This paper calculates and discusses examples of the new measure of kurtosis for a range of standard distributions.     

Kurtosis of the logistic-exponential survival distribution

ABSTRACT

In this article, the kurtosis of the logistic-exponential distribution is analyzed. All the moments of this survival distribution are finite, but do not possess closed-form expressions. The standardized fourth central moment, known as Pearson’s coefficient of kurtosis and often used to describe the kurtosis of a distribution, can thus also not be expressed in closed form for the logistic-exponential distribution. Alternative kurtosis measures are therefore considered, specifically quantile-based measures and the L-kurtosis ratio. It is shown that these kurtosis measures of the logistic-exponential distribution are invariant to the values of the distribution’s single shape parameter and hence skewness invariant.     

Behaviour of skewness, kurtosis and normality tests in long memory data

We establish the limiting distributions for empirical estimators of the coefficient of skewness, kurtosis, and the Jarque–Bera normality test statistic for long memory linear processes. We show that these estimators, contrary to the case of short memory, are neither ${\sqrt{n}}We establish the limiting distributions for empirical estimators of the coefficient of skewness, kurtosis, and the Jarque–Bera normality test statistic for long memory linear processes. We show that these estimators, contrary to the case of short memory, are neither ?n{\sqrt{n}}-consistent nor asymptotically normal. The normalizations needed to obtain the limiting distributions depend on the long memory parameter d. A direct consequence is that if data are long memory then testing normality with the Jarque–Bera test by using the chi-squared critical values is not valid. Therefore, statistical inference based on skewness, kurtosis, and the Jarque–Bera normality test, needs a rescaling of the corresponding statistics and computing new critical values of their nonstandard limiting distributions.     

Parameter measures of skewness

Several different measures of skewness are commonly used in place of γ₁, the third central moment divided by the cube of the standard deviation. The numerical values of these measures are compared in this paper for members of the gamma, lognormal or Weibull family of distributions and shown to vary considerably in most cases even when skewness and kurtosis are moderate.     

Bimodal skew-symmetric normal distribution

ABSTRACT

We introduce a new parsimonious bimodal distribution, referred to as the bimodal skew-symmetric Normal (BSSN) distribution, which is potentially effective in capturing bimodality, excess kurtosis, and skewness. Explicit expressions for the moment-generating function, mean, variance, skewness, and excess kurtosis were derived. The shape properties of the proposed distribution were investigated in regard to skewness, kurtosis, and bimodality. Maximum likelihood estimation was considered and an expression for the observed information matrix was provided. Illustrative examples using medical and financial data as well as simulated data from a mixture of normal distributions were worked.     

A Monte Carlo comparison of Jarque–Bera type tests and Henze–Zirkler test of multivariate normality

In the paper, tests for multivariate normality (MVN) of Jarque-Bera type, based on skewness and kurtosis, have been considered. Tests proposed by Mardia and Srivastava, and the combined tests based on skewness and kurtosis defined by Jarque and Bera have been taken into account. In the Monte Carlo simulations, for each combination of p = 2, 3, 4, 5 number of traits and n = 10(5)50(10)100 sample sizes 10,000 runs have been done to calculate empirical Type I errors of tests under consideration, and empirical power against different alternative distributions. Simulation results have been compared to the Henze–Zirkler’s test. It should be stressed that no test yet proposed is uniformly better than all the others in every combination of conditions examined.     

Distributional properties of simpson's index of diversity

Closed expressions for the first four moments of Simpson's index of diversity are derived using techniaues suggested by Haldane (1937). As the samole size increases the behavior of the skewness and kurtosis is studied for several Dopulations with varying degrees of diversity, If the populationproportions decrease accordinq to a geometric progression, graphs of β₁and β₂ indicate that convergence to normality in general is more rapid for populations which are less diverse.     

Practical implications of higher moments in risk management

In this paper the out-of-sample prediction of Value-at-Risk by means of models accounting for higher moments is studied. We consider models differing in terms of skewness and kurtosis and, in particular, the GARCHDSK model, which allows for constant and dynamic skewness and kurtosis. The issue of VaR prediction performance is approached first from a purely statistical viewpoint, studying the properties concerning correct coverage rates and independence of VaR violations. Then, financial implications of different VaR models, in terms of market risk capital requirements, as defined by the Basel Accord, are considered. Our results, based on the analysis of eight international stock indexes, highlight the presence of conditional skewness and kurtosis, in some case time-varying, and point out that asymmetry plays a significant role in risk management.     

A tool for systematically comparing the power of tests for normality

In this article, we describe a new approach to compare the power of different tests for normality. This approach provides the researcher with a practical tool for evaluating which test at their disposal is the most appropriate for their sampling problem. Using the Johnson systems of distribution, we estimate the power of a test for normality for any mean, variance, skewness, and kurtosis. Using this characterization and an innovative graphical representation, we validate our method by comparing three well-known tests for normality: the Pearson χ² test, the Kolmogorov–Smirnov test, and the D'Agostino–Pearson K ² test. We obtain such comparison for a broad range of skewness, kurtosis, and sample sizes. We demonstrate that the D'Agostino–Pearson test gives greater power than the others against most of the alternative distributions and at most sample sizes. We also find that the Pearson χ² test gives greater power than Kolmogorov–Smirnov against most of the alternative distributions for sample sizes between 18 and 330.     

A monte carlo study on the robustness of the two-sample sequential t test

The robustness of the two-sample sequentla1 t test was studied against departures from normality and equality of variances The effect of skewness and kurtosis of the underlying distribution on the test 1s relatively mild but the effect of heteroscedasticity serious.     

Asymptotic approach for a renewal-reward process with a general interference of chance

ABSTRACT

In this study, a renewal-reward process with a discrete interference of chance is constructed and considered. Under weak conditions, the ergodicity of the process X(t) is proved and exact formulas for the ergodic distribution and its moments are found. Within some assumptions for the discrete interference of chance in general form, two-term asymptotic expansions for all moments of the ergodic distribution are obtained. Additionally, kurtosis coefficient, skewness coefficient, and coefficient of variation of the ergodic distribution are computed. As a special case, a semi-Markovian inventory model of type (s, S) is investigated.     

The generalized T Birnbaum–Saunders family

In this work, we generalize the Birnbaum–Saunders distribution using the generalized t distribution alternatively to the normal distribution. The newly defined family is positively skewed and contains distributions with different kurtosis and skewness. We study its properties and special cases and demonstrate its use on some real data sets considering the maximum-likelihood estimation procedure.     

Estimation and comparison of lognormal parameters in the presence of censored data

It is assumed that k(k?>?2) independent samples of sizes n _i (i?=?1, …, k) are available from k lognormal distributions. Four hypothesis cases (H ₁ – H ₄) are defined. Under H ₁, all k median parameters as well as all k skewness parameters are equal; under H ₂, all k skewness parameters are equal but not all k median parameters are equal; under H ₃, all k median parameters are equal but not all k skewness parameters are equal; under H ₄, neither the k median parameters nor the k skewness parameters are equal. The Expectation Maximization (EM) algorithm is used to obtain the maximum likelihood (ML) estimates of the lognormal parameters in each of these four hypothesis cases. A (2k???1) degree polynomial is solved at each step of the EM algorithm for the H ₃ case. A two-stage procedure for testing the equality of the medians either under skewness homogeneity or under skewness heterogeneity is also proposed and discussed. A simulation study was performed for the case k?=?3.     

Recurrence formula on the joint distribution of sample skewness and kurtosis under normality

Abstract

Two recurrence relations with respect to sample size are given concerning the joint distribution of skewness and kurtosis of random observations from a normal population: one between the probability density functions and the other between the product moments. As a consequence, the latter yields a recurrence formula for the moments of sample kurtosis. The exact moments of Jarque-Bera statistic is also given.     

A new generalized normal distribution: Properties and applications

Abstract

The most commonly studied generalized normal distribution is the well-known skew-normal by Azzalini. In this paper, a new generalized normal distribution is defined and studied. The distribution is unimodal and it can be skewed right or left. The relationships between the parameters and the mean, variance, skewness, and kurtosis are discussed. It is observed that the new distribution has a much wider range of skewness and kurtosis than the skew-normal distribution. The method of maximum likelihood is proposed to estimate the distribution parameters. Two real data sets are applied to illustrate the flexibility of the distribution.     

Bias-reduced estimates for skewness, kurtosis, L-skewness and L-kurtosis

Estimates based on L-moments are less non-robust than estimates based on ordinary moments because the former are linear combinations of order statistics for all orders, whereas the later take increasing powers of deviations from the mean as the order increases. Estimates based on L-moments can also be more efficient than maximum likelihood estimates. Similarly, L-skewness and L-kurtosis are less non-robust and more informative than the traditional measures of skewness and kurtosis. Here, we give nonparametric bias-reduced estimates of both types of skewness and kurtosis. Their asymptotic computational efficiency is infinitely better than that of corresponding bootstrapped estimates.     

Brownian–Laplace Motion and Its Use in Financial Modelling

Brownian-Laplace motion is a Lévy process which has both continuous (Brownian) and discontinuous (Laplace motion) components. The increments of the process follow a generalized normal Laplace (GNL) distribution which exhibits positive kurtosis and can be either symmetrical or exhibit skewness. The degree of kurtosis in the increments increases as the time between observations decreases. This and other properties render Brownian-Laplace motion a good candidate model for the motion of logarithmic stock prices. An option pricing formula for European call options is derived and it is used to calculate numerically the value of such an option both using nominal parameter values (to explore its dependence upon them) and those obtained as estimates from real stock price data.