Estimation for a four parameter generalized extreme value distribution

Estimation is considered for a class of models which are simple extensions of the generalized extreme value (GEV) distribution, suitable for introducing time dependence into models which are otherwise only spatially dependent. Maximum likelihood estimation and the method of probability weighted moment estimation are identified as most useful for fitting these models. The relative merits of these methods, and others, is discussed in the context of estimation for the GEV distribution, with particular reference to the non - regularity of the GEV distribution for particular parameter values. In the case of maximum likelihood estimation, first and second derivatives of the log likelihood are evaluated for the models.     

Bias-corrected maximum likelihood estimation of the parameters of the generalized Pareto distribution

ABSTRACT

We derive analytic expressions for the biases, to O(n^?1), of the maximum likelihood estimators of the parameters of the generalized Pareto distribution. Using these expressions to bias-correct the estimators in a selective manner is found to be extremely effective in terms of bias reduction, and can also result in a small reduction in relative mean squared error (MSE). In terms of remaining relative bias, the analytic bias-corrected estimators are somewhat less effective than their counterparts obtained by using a parametric bootstrap bias correction. However, the analytic correction out-performs the bootstrap correction in terms of remaining %MSE. It also performs credibly relative to other recently proposed estimators for this distribution. Taking into account the relative computational costs, this leads us to recommend the selective use of the analytic bias adjustment for most practical situations.     

Comparisons of several Pareto distributions based on record values

In order to avoid wrong conclusions in any further analysis, it is of importance to conduct a formal comparison for characteristic quantities of the distributions. These characteristic quantities we are familiar with include mean, quantity and reliability function, and so on. In this paper, we consider two tests aiming at the comparisons for function of parameters in Pareto distribution based on record values. They are generalized p-value-based test and parametric bootstrap-based test, respectively. The resulting procedures are easy to compute and are applicable to small samples. A simulation study is conducted to investigate and compare the performance of the proposed tests. A phenomenon we note is that generalized p-value-based test almost uniformly outperforms the parametric bootstrap-based test.     

Bias Correction in the Type I Generalized Logistic Distribution

Four strategies for bias correction of the maximum likelihood estimator of the parameters in the Type I generalized logistic distribution are studied. First, we consider an analytic bias-corrected estimator, which is obtained by deriving an analytic expression for the bias to order n ^?1; second, a method based on modifying the likelihood equations; third, we consider the jackknife bias-corrected estimator; and fourth, we consider two bootstrap bias-corrected estimators. All bias correction estimators are compared by simulation. Finally, an example with a real data set is also presented.     

Pseudo‐R2 statistics under complex sampling

Model summaries based on the ratio of fitted and null likelihoods have been proposed for generalised linear models, reducing to the familiar R² coefficient of determination in the Gaussian model with identity link. In this note I show how to define the Cox–Snell and Nagelkerke summaries under arbitrary probability sampling designs, giving a design‐consistent estimator of the population model summary. It is also shown that for logistic regression models under case–control sampling the usual Cox–Snell and Nagelkerke R² are not design‐consistent, but are systematically larger than would be obtained with a cross‐sectional or cohort sample from the same population, even in settings where the weighted and unweighted logistic regression estimators are similar or identical. Implementation of the new estimators is straightforward and code is provided in R.     

The Kumaraswamy GEV distribution

The popular generalized extreme value (GEV) distribution has not been a flexible model for extreme values in many areas. We propose a generalization – referred to as the Kumaraswamy GEV distribution – and provide a comprehensive treatment of its mathematical properties. We estimate its parameters by the method of maximum likelihood and provide the observed information matrix. An application to some real data illustrates flexibility of the new model. Finally, some bivariate generalizations of the model are proposed.     

Asymptotic Normality of Extreme Quantile Estimators Based on the Peaks-Over-Threshold Approach

The POT (Peaks-Over-Threshold) approach consists of using the generalized Pareto distribution (GPD) to approximate the distribution of excesses over thresholds. In this article, we establish the asymptotic normality of the well-known extreme quantile estimators based on this POT method, under very general assumptions. As an illustration, from this result, we deduce the asymptotic normality of the POT extreme quantile estimators in the case where the maximum likelihood (ML) or the generalized probability-weighted moments (GPWM) methods are used. Simulations are provided in order to compare the efficiency of these estimators based on ML or GPWM methods with classical ones proposed in the literature.     

Extreme value index estimator using maximum likelihood and moment estimation

ABSTRACT

When a distribution function is in the max domain of attraction of an extreme value distribution, its tail can be well approximated by a generalized Pareto distribution. Based on this fact we use a moment estimation idea to propose an adapted maximum likelihood estimator for the extreme value index, which can be understood as a combination of the maximum likelihood estimation and moment estimation. Under certain regularity conditions, we derive the asymptotic normality of the new estimator and investigate its finite sample behavior by comparing with several classical or competitive estimators. A simulation study shows that the new estimator is competitive with other estimators in view of average bias, average MSE, and coefficient of variance of the new device for the optimal selection of the threshold.     

Some Second-Order Asymptotics for Extreme Value Linear Regression Models

ABSTRACT

In this article we derive finite-sample corrections in matrix notation for likelihood ratio and score statistics in extreme-value linear regression models. We consider three corrected score tests that perform better than the usual score test. We also derive general formulae for second-order biases of maximum likelihood estimates of the linear parameters. Some simulations are performed to compare the likelihood ratio and score statistics with their modified versions and to illustrate the bias correction.     

A Bayesian approach to zero-inflated data in extremes

Abstract

The generalized extreme value (GEV) distribution is known as the limiting result for the modeling of maxima blocks of size n, which is used in the modeling of extreme events. However, it is possible for the data to present an excessive number of zeros when dealing with extreme data, making it difficult to analyze and estimate these events by using the usual GEV distribution. The Zero-Inflated Distribution (ZID) is widely known in literature for modeling data with inflated zeros, where the inflator parameter w is inserted. The present work aims to create a new approach to analyze zero-inflated extreme values, that will be applied in data of monthly maximum precipitation, that can occur during months where there was no precipitation, being these computed as zero. An inference was made on the Bayesian paradigm, and the parameter estimation was made by numerical approximations of the posterior distribution using Markov Chain Monte Carlo (MCMC) methods. Time series of some cities in the northeastern region of Brazil were analyzed, some of them with predominance of non-rainy months. The results of these applications showed the need to use this approach to obtain more accurate and with better adjustment measures results when compared to the standard distribution of extreme value analysis.     

Testing Homogeneity of Inverse Gaussian Scale Parameters Based on Generalized Likelihood Ratio

This article presents a new procedure for testing homogeneity of scale parameters from k independent inverse Gaussian populations. Based on the idea of generalized likelihood ratio method, a new generalized p-value is derived. Some simulation results are presented to compare the performance of the proposed method and existing methods. Numerical results show that the proposed test has good size and power performance.     

Design considerations for small experiments and simple logistic regression

Inference for a generalized linear model is generally performed using asymptotic approximations for the bias and the covariance matrix of the parameter estimators. For small experiments, these approximations can be poor and result in estimators with considerable bias. We investigate the properties of designs for small experiments when the response is described by a simple logistic regression model and parameter estimators are to be obtained by the maximum penalized likelihood method of Firth [Firth, D., 1993, Bias reduction of maximum likelihood estimates. Biometrika, 80, 27–38]. Although this method achieves a reduction in bias, we illustrate that the remaining bias may be substantial for small experiments, and propose minimization of the integrated mean square error, based on Firth's estimates, as a suitable criterion for design selection. This approach is used to find locally optimal designs for two support points.     

Bias Reduction for the Maximum Likelihood Estimator of the Parameters of the Generalized Rayleigh Family of Distributions

We derive analytic expressions for the biases, to O(n^{? 1}), of the maximum likelihood estimators of the parameters of the generalized Rayleigh distribution family. Using these expressions to bias-correct the estimators is found to be extremely effective in terms of bias reduction, and generally results in a small reduction in relative mean squared error. In general, the analytic bias-corrected estimators are also found to be superior to the alternative of bias-correction via the bootstrap.     

Spatial modeling of extreme rainfall in northeast Thailand

It is well recognized that the generalized extreme value (GEV) distribution is widely used for any extreme events. This notion is based on the study of discrete choice behavior; however, there is a limit for predicting the distribution at ungauged sites. Hence, there have been studies on spatial dependence within extreme events in continuous space using recorded observations. We model the annual maximum daily rainfall data consisting of 25 locations for the period from 1982 to 2013. The spatial GEV model that is established under observations is assumed to be mutually independent because there is no spatial dependency between the stations. Furthermore, we divide the region into two regions for a better model fit and identify the best model for each region. We show that the regional spatial GEV model reflects the spatial pattern well compared with the spatial GEV model over the entire region as the local GEV distribution. The advantage of spatial extreme modeling is that more robust return levels and some indices of extreme rainfall can be obtained for observed stations as well as for locations without observed data. Thus, the model helps to determine the effects and assessment of vulnerability due to heavy rainfall in northeast Thailand.     

Estimation of a nonlinear discriminant function from a mixture of two GEV distributions

In this paper, the identifiability of finite mixture of generalized extreme value (GEV) distributions is proved. Next, a procedure for finding maximum likelihood estimates (MLEs) of the parameters of a finite mixture of two generalized extreme value (MGEV) distributions is presented by using classified and unclassified observations. Then, a nonlinear discriminant function for a mixture of two GEV distributions is derived and the performance of the corresponding estimated discriminant function is investigated through a series of simulation experiments. Finally, the methodology is applied to real data.     

A comparison of L-, LQ-, TL-moment and maximum likelihood high quantile estimates of the GPD and GEV distribution

In this article, L-moments, LQ-moments and TL-moments of the generalized Pareto and generalized extreme-value distributions are derived up to the fourth order. The first three L-, LQ- and TL-moments are used to obtain estimators of their parameters. Performing a simulation study, high-quantile estimates based on L-, LQ-, and TL-moments are compared to the maximum likelihood estimate with respect to their sample mean squared error. This consists of identifying an optimal combination of parameters α and p both considered in the range [0, 0.5] for estimating quantiles by LQ-moments. The results show L-moment and maximum likelihood methods outperform other methods.     

A comparative review of generalizations of the Gumbel extreme value distribution with an application to wind speed data

ABSTRACT

The generalized extreme value distribution and its particular case, the Gumbel extreme value distribution, are widely applied for extreme value analysis. The Gumbel distribution has certain drawbacks because it is a non-heavy-tailed distribution and is characterized by constant skewness and kurtosis. The generalized extreme value distribution is frequently used in this context because it encompasses the three possible limiting distributions for a normalized maximum of infinite samples of independent and identically distributed observations. However, the generalized extreme value distribution might not be a suitable model when each observed maximum does not come from a large number of observations. Hence, other forms of generalizations of the Gumbel distribution might be preferable. Our goal is to collect in the present literature the distributions that contain the Gumbel distribution embedded in them and to identify those that have flexible skewness and kurtosis, are heavy-tailed and could be competitive with the generalized extreme value distribution. The generalizations of the Gumbel distribution are described and compared using an application to a wind speed data set and Monte Carlo simulations. We show that some distributions suffer from overparameterization and coincide with other generalized Gumbel distributions with a smaller number of parameters, that is, are non-identifiable. Our study suggests that the generalized extreme value distribution and a mixture of two extreme value distributions should be considered in practical applications.     

Improved likelihood inference for the shape parameter in Weibull regression

We obtain adjustments to the profile likelihood function in Weibull regression models with and without censoring. Specifically, we consider two different modified profile likelihoods: (i) the one proposed by Cox and Reid [Cox, D.R. and Reid, N., 1987, Parameter orthogonality and approximate conditional inference. Journal of the Royal Statistical Society B, 49, 1–39.], and (ii) an approximation to the one proposed by Barndorff–Nielsen [Barndorff–Nielsen, O.E., 1983, On a formula for the distribution of the maximum likelihood estimator. Biometrika, 70, 343–365.], the approximation having been obtained using the results by Fraser and Reid [Fraser, D.A.S. and Reid, N., 1995, Ancillaries and third-order significance. Utilitas Mathematica, 47, 33–53.] and by Fraser et al. [Fraser, D.A.S., Reid, N. and Wu, J., 1999, A simple formula for tail probabilities for frequentist and Bayesian inference. Biometrika, 86, 655–661.]. We focus on point estimation and likelihood ratio tests on the shape parameter in the class of Weibull regression models. We derive some distributional properties of the different maximum likelihood estimators and likelihood ratio tests. The numerical evidence presented in the paper favors the approximation to Barndorff–Nielsen's adjustment.     

Bias correction in logistic regression with missing categorical covariates

Logistic regression plays an important role in many fields. In practice, we often encounter missing covariates in different applied sectors, particularly in biomedical sciences. Ibrahim (1990) proposed a method to handle missing covariates in generalized linear model (GLM) setup. It is well known that logistic regression estimates using small or medium sized missing data are biased. Considering the missing data that are missing at random, in this paper we have reduced the bias by two methods; first we have derived a closed form bias expression using Cox and Snell (1968), and second we have used likelihood based modification similar to Firth (1993). Here we have analytically shown that the Firth type likelihood modification in Ibrahim led to the second order bias reduction. The proposed methods are simple to apply on an existing method, need no analytical work, with the exception of a little change in the optimization function. We have carried out extensive simulation studies comparing the methods, and our simulation results are also supported by a real world data.