Heteroscedastic and heavy-tailed regression with mixtures of skew Laplace normal distributions

Joint modelling skewness and heterogeneity is challenging in data analysis, particularly in regression analysis which allows a random probability distribution to change flexibly with covariates. This paper, based on a skew Laplace normal (SLN) mixture of location, scale, and skewness, introduces a new regression model which provides a flexible modelling of location, scale and skewness parameters simultaneously. The maximum likelihood (ML) estimators of all parameters of the proposed model via the expectation-maximization (EM) algorithm as well as their asymptotic properties are derived. Numerical analyses via a simulation study and a real data example are used to illustrate the performance of the proposed model.     

A new extended generalized Gompertz distribution with statistical properties and simulations

Abstract

Statistical distributions are very useful in describing and predicting real world phenomena. In many applied areas there is a clear need for the extended forms of the well-known distributions. Generally, the new distributions are more flexible to model real data that present a high degree of skewness and kurtosis. The choice of the best-suited statistical distribution for modeling data is very important.

In this article, we proposed an extended generalized Gompertz (EGGo) family of EGGo. Certain statistical properties of EGGo family including distribution shapes, hazard function, skewness, limit behavior, moments and order statistics are discussed. The flexibility of this family is assessed by its application to real data sets and comparison with other competing distributions. The maximum likelihood equations for estimating the parameters based on real data are given. The performances of the estimators such as maximum likelihood estimators, least squares estimators, weighted least squares estimators, Cramer-von-Mises estimators, Anderson-Darling estimators and right tailed Anderson-Darling estimators are discussed. The likelihood ratio test is derived to illustrate that the EGGo distribution is better than other nested models in fitting data set or not. We use R software for simulation in order to perform applications and test the validity of this model.     

Slashed generalized Rayleigh distribution

We introduce a new family of distributions suitable for fitting positive data sets with high kurtosis which is called the Slashed Generalized Rayleigh Distribution. This distribution arises as the quotient of two independent random variables, one being a generalized Rayleigh distribution in the numerator and the other a power of the uniform distribution in the denominator. We present properties and carry out estimation of the model parameters by moment and maximum likelihood (ML) methods. Finally, we conduct a small simulation study to evaluate the performance of ML estimators and analyze real data sets to illustrate the usefulness of the new model.     

Parameter estimation for mixtures of skew Laplace normal distributions and application in mixture regression modeling

In this article, we propose mixtures of skew Laplace normal (SLN) distributions to model both skewness and heavy-tailedness in the neous data set as an alternative to mixtures of skew Student-t-normal (STN) distributions. We give the expectation–maximization (EM) algorithm to obtain the maximum likelihood (ML) estimators for the parameters of interest. We also analyze the mixture regression model based on the SLN distribution and provide the ML estimators of the parameters using the EM algorithm. The performance of the proposed mixture model is illustrated by a simulation study and two real data examples.     

Robust Estimators for the Parameters of Multivariate Lognormal Distribution

Abstract

In this paper, we introduce a class of location and scale estimators for the p-variate lognormal distribution. These estimators are obtained by applying a log transform to the data, computing robust Fisher consistent estimators for the obtained Gaussian data and transforming those estimators for the lognormal using the relationship between the parameters of both distributions. We prove some of the properties of these estimators, such as Fisher consistency, robustness and asymptotic normality.     

An application of ranked set sampling when observations from several distributions are to be included in the sample

ABSTRACT

In this article, we propose a method to estimate the common location and common scale parameters of several distributions using suitably defined ranked set sampling. Efficiency comparison of the obtained estimators with some of the standard estimators is made. Illustration of the results to real life data sets is also described.     

The alpha–beta skew normal distribution: properties and applications

This paper introduces a new class of skew distributions by extending the alpha skew normal distribution proposed by Elal-Olivero [Elal-Olivero, D. Alpha-skew-normal distribution. Proyecciones. 2010;29:224–240]. Statistical properties of the new family are studied in details. In particular, explicit expressions for the moments and the shape parameters including the skewness and the kurtosis coefficients and the moment generating function are derived. The problem of estimating parameters on the basis of a random sample coming from the new class of distribution is considered. To examine the performance of the obtained estimators, a Monte Carlo simulation study is conducted. Flexibility and usefulness of the proposed family of distributions are illustrated by analysing three real data sets.     

The skew generalized t distribution as the scale mixture of a skew exponential power distribution and its applications in robust estimation

In this paper, we consider the family of skew generalized t (SGT) distributions originally introduced by Theodossiou [P. Theodossiou, Financial data and the skewed generalized t distribution, Manage. Sci. Part 1 44 (12) ( 1998), pp. 1650–1661] as a skew extension of the generalized t (GT) distribution. The SGT distribution family warrants special attention, because it encompasses distributions having both heavy tails and skewness, and many of the widely used distributions such as Student's t, normal, Hansen's skew t, exponential power, and skew exponential power (SEP) distributions are included as limiting or special cases in the SGT family. We show that the SGT distribution can be obtained as the scale mixture of the SEP and generalized gamma distributions. We investigate several properties of the SGT distribution and consider the maximum likelihood estimation of the location, scale, and skewness parameters under the assumption that the shape parameters are known. We show that if the shape parameters are estimated along with the location, scale, and skewness parameters, the influence function for the maximum likelihood estimators becomes unbounded. We obtain the necessary conditions to ensure the uniqueness of the maximum likelihood estimators for the location, scale, and skewness parameters, with known shape parameters. We provide a simple iterative re-weighting algorithm to compute the maximum likelihood estimates for the location, scale, and skewness parameters and show that this simple algorithm can be identified as an EM-type algorithm. We finally present two applications of the SGT distributions in robust estimation.     

A Generalization of the Univariate Slash by a Scale-Mixtured Exponential Power Distribution

A generalization of the slash distribution is derived using the scale mixture of the exponential power distribution. The newly defined family of distributions provides a rich flexibility on the tail heaviness and yields alternative robust estimators of location and scale in non normal situations. In order to investigate asymptotically the bias properties of the estimators, a simulation study is performed. The performance of the estimators on two well-known real data sets is also illustrated.     

On the Computation and Finite Sample Behavior of the Constrained M-Estimates for Multivariate Location and Scatter

Abstract

Constrained M (CM) estimates of multivariate location and scatter [Kent, J. T., Tyler, D. E. (1996). Constrained M-estimation for multivariate location and scatter. Ann. Statist. 24:1346–1370] are defined as the global minimum of an objective function subject to a constraint. These estimates combine the good global robustness properties of the S estimates and the good local robustness properties of the redescending M estimates. The CM estimates are not explicitly defined. Numerical methods have to be used to compute the CM estimates. In this paper, we give an algorithm to compute the CM estimates. Using the algorithm, we give a small simulation study to demonstrate the capability of the algorithm finding the CM estimates, and also to explore the finite sample behavior of the CM estimates. We also use the CM estimators to estimate the location and scatter parameters of some multivariate data sets to see the performance of the CM estimates dealing with the real data sets that may contain outliers.     

On the Estimation of Parameters of Kumaraswamy-G Distributions

Cordeiro and de Castro proposed a new family of generalized distributions based on the Kumaraswamy distribution (denoted as Kw-G). Nadarajah et al. showed that the density function of the new family of distributions can be expressed as a linear combination of the density of exponentiated family of distributions. They derived some properties of Kw-G distributions and discussed estimation of parameters using the maximum likelihood (ML) method. Cheng and Amin and Ranneby introduced a new method of estimating parameters based on Kullback–Leibler divergence (the maximum spacing (MSP) method). In this article, the estimates of parameters of Kw-G distributions are obtained using the MSP method. For some special Kw-G distributions, the new estimators are compared with ML estimators. It is shown by simulations and a real data application that MSP estimators have better properties than ML estimators.     

Marshall–Olkin distribution: parameter estimation and application to cancer data

In this study, as alternatives to the maximum likelihood (ML) and the frequency estimators, we propose robust estimators for the parameters of Zipf and Marshall–Olkin Zipf distributions. A small simulation study is given to illustrate the performance of the proposed estimators. We apply the proposed estimators to a real data set from cancer research to illustrate the performance of the proposed estimators over the ML, moments and frequency estimators. We observe that the robust estimators have superiority over the frequency estimators based on classical sample mean.     

Gamma mixture of generalized error distribution

Abstract

A new symmetric heavy-tailed distribution, namely gamma mixture of generalized error distribution is defined by scaling generalized error distribution with gamma distribution, its probability density function, k-moment, skewness and kurtosis are derived. After tedious calculation, we also give the Fisher information matrix, moment estimators and maximum likelihood estimators for the parameters of gamma mixture of generalized error distribution. In order to evaluate the effectiveness of the point estimators and the stability of Fisher information matrix, extensive simulation experiments are carried out in three groups of parameters. Additionally, the new distribution is applied to Apple Inc. stock (AAPL) data and compared with normal distribution, F-S skewed standardized t distribution and generalized error distribution. It is found that the new distribution has better fitting effect on the data under the Akaike information criterion (AIC). To a certain extent, our results enrich the probability distribution theory and develop the scale mixture distribution, which will provide help and reference for financial data analysis.     

The Two-Piece Normal-Laplace Distribution

This article considers the two-piece normal-Laplace (TPNL) distribution, a split skew distribution consisting of a normal part, and a Laplace part. The distribution is indexed by three parameters, representing location, scale, and shape. As illustrated with several examples, the TPNL family of distributions provides a useful alternative to other families of asymmetric distributions on the real line. However, because the likelihood function is not well behaved, standard theory of maximum-likelihood (ML) estimation does not apply to the TPNL family. In particular, the likelihood function can have multiple local maxima. We provide a procedure for computing ML estimators, and prove consistency and asymptotic normality of ML estimators, using non standard methods.     

Bounded risk estimation of linear combinations of the location and scale parameters in exponential distributions under two-stage sampling

Two-stage sampling is proposed for estimating linear combinations of the location and scale parameters of exponential distributions with bounded quadratic risk functions. Exact formulae for the expected values and risks of the estimators are derived, and the performance of estimators is studied. Illustrations with real data are included.     

Shrinkage estimation of location parameters in a multivariate skew-normal distribution

Abstract

This paper studies decision theoretic properties of Stein type shrinkage estimators in simultaneous estimation of location parameters in a multivariate skew-normal distribution with known skewness parameters under a quadratic loss. The benchmark estimator is the best location equivariant estimator which is minimax. A class of shrinkage estimators improving on the best location equivariant estimator is constructed when the dimension of the location parameters is larger than or equal to four. An empirical Bayes estimator is also derived, and motivated from the Bayesian procedure, we suggest a simple skew-adjusted shrinkage estimator and show its dominance property. The performances of these estimators are investigated by simulation.     

Problems with Maximum Likelihood Estimation and the 3 Parameter Gamma Distribution

The three parameters involved are scale a , shape 𝜌 , and location s . Maximum likelihood estimators are (\hata, \hat\rho, \hats) . Using recent work on the second order variances, skewness, and kurtosis we establish the facts, that if the location parameter s is to be estimated, then the asymptotic variances only exist if 𝜌 >2, asymptotic skewness only exists if 𝜌 >3, and 2nd order variances and third order fourth central moments only exist if 𝜌 >4. The result of these limitations is that in general very large sample sizes may be needed to avoid inference problems. We also include new continued fractions for the asymptotic covariances of the maximum likelihood estimators considered.     

Statistical inference for α-series process with the inverse Gaussian distribution

Statistical inferences for the geometric process (GP) are derived when the distribution of the first occurrence time is assumed to be inverse Gaussian (IG). An α-series process, as a possible alternative to the GP, is introduced since the GP is sometimes inappropriate to apply some reliability and scheduling problems. In this study, statistical inference problem for the α-series process is considered where the distribution of first occurrence time is IG. The estimators of the parameters α, μ, and σ² are obtained by using the maximum likelihood (ML) method. Asymptotic distributions and consistency properties of the ML estimators are derived. In order to compare the efficiencies of the ML estimators with the widely used nonparametric modified moment (MM) estimators, Monte Carlo simulations are performed. The results showed that the ML estimators are more efficient than the MM estimators. Moreover, two real life datasets are given for application purposes.     

Properties of maximum likelihood estimators of variance components in the one-way classification,balanced data

We studied properties of maximum likelihood estimators (MLEs) of the variance components obtained from balanced data of the one-way classification. Exact and asymptotic expected values and variances of these MLEs were derived under the usual normality assumptions. Numerical studies illustrate these expected values and variances, and also illustrate the probability of obtaining a negative solution to the maximum likelihood (ML) equation for the between-class variance component. Simulations were used to study the robustness of the ML estimators under non-normal distributions.     

Non-parametric estimation of copula based mutual information

Abstract

Mutual information is a measure for investigating the dependence between two random variables. The copula based estimation of mutual information reduces the complexity because it is depend only on the copula density. We propose two estimators and discuss the asymptotic properties. To compare the performance of the estimators a simulation study is carried out. The methods are illustrated using real data sets.