Bias-reduced estimates for skewness, kurtosis, L-skewness and L-kurtosis

Estimates based on L-moments are less non-robust than estimates based on ordinary moments because the former are linear combinations of order statistics for all orders, whereas the later take increasing powers of deviations from the mean as the order increases. Estimates based on L-moments can also be more efficient than maximum likelihood estimates. Similarly, L-skewness and L-kurtosis are less non-robust and more informative than the traditional measures of skewness and kurtosis. Here, we give nonparametric bias-reduced estimates of both types of skewness and kurtosis. Their asymptotic computational efficiency is infinitely better than that of corresponding bootstrapped estimates.     

The skew generalized t distribution as the scale mixture of a skew exponential power distribution and its applications in robust estimation

In this paper, we consider the family of skew generalized t (SGT) distributions originally introduced by Theodossiou [P. Theodossiou, Financial data and the skewed generalized t distribution, Manage. Sci. Part 1 44 (12) ( 1998), pp. 1650–1661] as a skew extension of the generalized t (GT) distribution. The SGT distribution family warrants special attention, because it encompasses distributions having both heavy tails and skewness, and many of the widely used distributions such as Student's t, normal, Hansen's skew t, exponential power, and skew exponential power (SEP) distributions are included as limiting or special cases in the SGT family. We show that the SGT distribution can be obtained as the scale mixture of the SEP and generalized gamma distributions. We investigate several properties of the SGT distribution and consider the maximum likelihood estimation of the location, scale, and skewness parameters under the assumption that the shape parameters are known. We show that if the shape parameters are estimated along with the location, scale, and skewness parameters, the influence function for the maximum likelihood estimators becomes unbounded. We obtain the necessary conditions to ensure the uniqueness of the maximum likelihood estimators for the location, scale, and skewness parameters, with known shape parameters. We provide a simple iterative re-weighting algorithm to compute the maximum likelihood estimates for the location, scale, and skewness parameters and show that this simple algorithm can be identified as an EM-type algorithm. We finally present two applications of the SGT distributions in robust estimation.     

Robust mixture modeling using multivariate skew <Emphasis Type="Italic">t</Emphasis> distributions

This paper presents a robust mixture modeling framework using the multivariate skew t distributions, an extension of the multivariate Student’s t family with additional shape parameters to regulate skewness. The proposed model results in a very complicated likelihood. Two variants of Monte Carlo EM algorithms are developed to carry out maximum likelihood estimation of mixture parameters. In addition, we offer a general information-based method for obtaining the asymptotic covariance matrix of maximum likelihood estimates. Some practical issues including the selection of starting values as well as the stopping criterion are also discussed. The proposed methodology is applied to a subset of the Australian Institute of Sport data for illustration.     

Estimation and comparison of lognormal parameters in the presence of censored data

It is assumed that k(k?>?2) independent samples of sizes n _i (i?=?1, …, k) are available from k lognormal distributions. Four hypothesis cases (H ₁ – H ₄) are defined. Under H ₁, all k median parameters as well as all k skewness parameters are equal; under H ₂, all k skewness parameters are equal but not all k median parameters are equal; under H ₃, all k median parameters are equal but not all k skewness parameters are equal; under H ₄, neither the k median parameters nor the k skewness parameters are equal. The Expectation Maximization (EM) algorithm is used to obtain the maximum likelihood (ML) estimates of the lognormal parameters in each of these four hypothesis cases. A (2k???1) degree polynomial is solved at each step of the EM algorithm for the H ₃ case. A two-stage procedure for testing the equality of the medians either under skewness homogeneity or under skewness heterogeneity is also proposed and discussed. A simulation study was performed for the case k?=?3.     

The largest SNR distribution

The probability distribution of the maximum of normalized SNRs (signal-to-noise ratios) is studied for wireless systems with multiple branches. Explicit expressions and bounds are derived for the cumulative distribution function, probability density function, hazard rate function, moment generating function, nth moment, variance, skewness, kurtosis, mean deviation, Shannon entropy, order statistics and the asymptotic distribution of the extreme order statistics. Estimation procedures are derived by the methods of moments and maximum likelihood. An application is illustrated with respect to performance assessment of wireless systems.     

Maximum Likelihood Estimation for the 4-Parameter Beta Distribution

This paper addresses the problem of obtaining maximum likelihood estimates for the parameters of the Pearson Type I distribution (beta distribution with unknown end points and shape parameters). Since they do not seem to have appeared in the literature, the likelihood equations and the information matrix are derived. The regularity conditions which ensure asymptotic normality and efficiency are examined, and some apparent conflicts in the literature are noted. To ensure regularity, the shape parameters must be greater than two, giving an (assymmetrical) bell-shaped distribution with high contact in the tails. A numerical investigation was carried out to explore the bias and variance of the maximum likelihood estimates and their dependence on sample size. The numerical study indicated that only for large samples (n ≥ 1000) does the bias in the estimates become small and does the Cramér-Rao bound give a good approximation for their variance. The likelihood function has a global maximum which corresponds to parameter estimates that are inadmissable. Useful parameter estimates can be obtained at a local maximum, which is sometimes difficult to locate when the sample size is small.     

A simple approach to the estimation of Tukey's gh distribution

ABSTRACT

The Tukey's gh distribution is widely used in situations where skewness and elongation are important features of the data. As the distribution is defined through a quantile transformation of the normal, the likelihood function cannot be written in closed form and exact maximum likelihood estimation is unfeasible. In this paper we exploit a novel approach based on a frequentist reinterpretation of Approximate Bayesian Computation for approximating the maximum likelihood estimates of the gh distribution. This method is appealing because it only requires the ability to sample the distribution. We discuss the choice of the input parameters by means of simulation experiments and provide evidence of superior performance in terms of Root-Mean-Square-Error with respect to the standard quantile estimator. Finally, we give an application to operational risk measurement.     

Maximum likelihood estimator in a multi-phase random regression model

We consider a random regression model with several-fold change-points. The results for one change-point are generalized. The maximum likelihood estimator of the parameters is shown to be consistent, and the asymptotic distribution for the estimators of the coefficients is shown to be Gaussian. The estimators of the change-points converge, with n ^?1 rate, to the vector whose components are the left end points of the maximizing interval with respect to each change-point. The likelihood process is asymptotically equivalent to the sum of independent compound Poisson processes.     

Bias reduction of maximum likelihood estimates for a modified skew-normal distribution

ABSTRACT

This paper presents a modified skew-normal (SN) model that contains the normal model as a special case. Unlike the usual SN model, the Fisher information matrix of the proposed model is always non-singular. Despite of this desirable property for the regular asymptotic inference, as with the SN model, in the considered model the divergence of the maximum likelihood estimator (MLE) of the skewness parameter may occur with positive probability in samples with moderate sizes. As a solution to this problem, a modified score function is used for the estimation of the skewness parameter. It is proved that the modified MLE is always finite. The quasi-likelihood approach is considered to build confidence intervals. When the model includes location and scale parameters, the proposed method is combined with the unmodified maximum likelihood estimates of these parameters.     

Computation of the asymptotic null distribution of goodness-of-fit tests for multi-state models

We develop an improved approximation to the asymptotic null distribution of the goodness-of-fit tests for panel observed multi-state Markov models (Aguirre-Hernandez and Farewell, Stat Med 21:1899–1911, 2002) and hidden Markov models (Titman and Sharples, Stat Med 27:2177–2195, 2008). By considering the joint distribution of the grouped observed transition counts and the maximum likelihood estimate of the parameter vector it is shown that the distribution can be expressed as a weighted sum of independent c²₁{\chi^2_1} random variables, where the weights are dependent on the true parameters. The performance of this approximation for finite sample sizes and where the weights are calculated using the maximum likelihood estimates of the parameters is considered through simulation. In the scenarios considered, the approximation performs well and is a substantial improvement over the simple χ ² approximation.     

Nonnull asymptotic distributions of the LR,Wald, score and gradient statistics in generalized linear models with dispersion covariates

The class of generalized linear models with dispersion covariates, which allows us to jointly model the mean and dispersion parameters, is a natural extension to the classical generalized linear models. In this paper, we derive the asymptotic expansions under a sequence of Pitman alternatives (up to order n ^?1/2) for the nonnull distribution functions of the likelihood ratio, Wald, Rao score and gradient statistics in this class of models. The asymptotic distributions of these statistics are obtained for testing a subset of regression parameters and for testing a subset of dispersion parameters. Based on these nonnull asymptotic expansions, the power of all four tests, which are equivalent to first order, are compared. Furthermore, we consider Monte Carlo simulations in order to compare the finite-sample performance of these tests in this class of models. We present two empirical applications to two real data sets for illustrative purposes.     

La méthode de vraisemblance pour les processus linéaires spatiaux définis sur un treillis triangulaire

Spatial linear processes {X_s, s ? T} where T is a triangular lattice in R² are considered. Special attention is given to the class of spatial moving-average processes. Precisely, for each site s T, the variable X_s is defined as a linear combination of real-valued random shocks located at the vertices of regular concentric hexagons centered at s. For Gaussian random shocks, the process is also Gaussian, and estimates of its parameters are obtained by maximizing the exact likelihood. For non-Gaussian random shocks, the exact likelihood is difficult to obtain; however, the Gaussian likelihood is still used giving the pseudo-Gaussian likelihood estimates. The behaviour of these estimates is analyzed through the study of asymptotic properties and some simulation experiments based on an isotropic model defined with one coefficient.     

LEVERAGE ADJUSTMENTS FOR DISPERSION MODELLING IN GENERALIZED NONLINEAR MODELS

For normal linear models, it is generally accepted that residual maximum likelihood estimation is appropriate when covariance components require estimation. This paper considers generalized linear models in which both the mean and the dispersion are allowed to depend on unknown parameters and on covariates. For these models there is no closed form equivalent to residual maximum likelihood except in very special cases. Using a modified profile likelihood for the dispersion parameters, an adjusted score vector and adjusted information matrix are found under an asymptotic development that holds as the leverages in the mean model become small. Subsequently, the expectation of the fitted deviances is obtained directly to show that the adjusted score vector is unbiased at least to O(1/n) . Exact results are obtained in the single‐sample case. The results reduce to residual maximum likelihood estimation in the normal linear case.     

An Asymptotic Linear Representation for the Breslow Estimator

We provide an asymptotic linear representation for the Breslow estimator of the baseline cumulative hazard function in the Cox model. Our representation consists of an average of independent random variables and a term involving the difference between the maximum partial likelihood estimator and the underlying regression parameter. The order of the remainder term is arbitrarily close to n ^?1.     

MAXIMUM LIKELIHOOD ESTIMATION IN LINEAR MODELS WITH EQUI-CORRELATED RANDOM ERRORS

Necessary and sufficient conditions for the existence of maximum likelihood estimators of unknown parameters in linear models with equi‐correlated random errors are presented. The basic technique we use is that these models are, first, orthogonally transformed into linear models with two variances, and then the maximum likelihood estimation problem is solved in the environment of transformed models. Our results generalize a result of Arnold, S. F. (1981) [The theory of linear models and multivariate analysis. Wiley, New York]. In addition, we give necessary and sufficient conditions for the existence of restricted maximum likelihood estimators of the parameters. The results of Birkes, D. & Wulff, S. (2003) [Existence of maximum likelihood estimates in normal variance‐components models. J Statist Plann. Inference. 113 , 35–47] are compared with our results and differences are pointed out.     

Parameter Estimation for Bivariate Shock Models with Singular Distribution for Censored Data with Concomitant Order Statistics

When two‐component parallel systems are tested, the data consist of Type‐II censored data X_(i), i= 1, n, from one component, and their concomitants Y _[i] randomly censored at X_(r), the stopping time of the experiment. Marshall & Olkin's (1967) bivariate exponential distribution is used to illustrate statistical inference procedures developed for this data type. Although this data type is motivated practically, the likelihood is complicated, and maximum likelihood estimation is difficult, especially in the case where the parameter space is a non‐open set. An iterative algorithm is proposed for finding maximum likelihood estimates. This article derives several properties of the maximum likelihood estimator (MLE) including existence, uniqueness, strong consistency and asymptotic distribution. It also develops an alternative estimation method with closed‐form expressions based on marginal distributions, and derives its asymptotic properties. Compared with variances of the MLEs in the finite and large sample situations, the alternative estimator performs very well, especially when the correlation between X and Y is small.     

Asymptotic Skewness in Exponential Family Nonlinear Models

In this article, we give an asymptotic formula of order n ^?1/2, where n is the sample size, for the skewness of the distributions of the maximum likelihood estimates of the pa-ra-meters in exponencial family nonlinear models. We generalize the result by Cordeiro and Cordeiro (2001 Cordeiro , H. H. , Cordeiro , G. M. ( 2001 ). Skewness for parameters in generalized linear models . Commun. Statist. Theor. Meth. 30 : 1317 – 1334 .[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]). The formula is given in matrix notation and is very suitable for computer implementation and to obtain closed form expressions for a great variety of models. Some special cases and two applications are discussed.     

Recurrence relations for single and product moments of progressively Type-II censored order statistics from generalized logistic distribution with applications to inference

In this article, we establish several recurrence relations for the single and product moments of progressively Type-II right censored order statistics from a generalized logistic distribution. The use of these relations in a systematic manner allow us to compute all the means, variances, and covariances of progressively Type-II right censored order statistics from the generalized logistic distribution for all sample sizes n, effective sample sizes m, and all progressive censoring schemes (R₁, …, R_m). These moments are then utilized to derive best linear unbiased estimators of the scale and location-scale parameters of the generalized logistic distribution. A comparison of these estimators with the maximum likelihood estimates is then made through Monte Carlo simulations. Finally, the best linear unbiased predictors of censored failure times is discussed briefly.     

Unimodality of the pareto distribution likelihood function for multicensored samples and implications for estimation

This paper discusses maximum likelihood parameter estimation in the Pareto distribution for multicensored samples. In particu-

lar, the modality of the associated conditional log-likelihood function is investigated in order to resolve questions concerninc

the existence and uniqurneas of the lnarimum likelihood estimates.For the cases with one parameter known, the maximum likelihood

estimates of the remaining unknown parameters are shown to exist and to be unique. When both parameters are unknown, the maximum likelihood estimates may or may not exist and be unique. That is, their existence and uniqueness would seem to depend solely upon the information inherent in the sample data. In viav of the possible nonexistence and/or non-uniqueness of the maximum likelihood estimates when both parameters are unknown, alternatives to standard iterative numerical methods are explored.