Goodness of fit of generalized linear models to sparse data

We derive approximations to the first three moments of the conditional distribution of the deviance statistic, for testing the goodness of fit of generalized linear models with non-canonical links, by using an estimating equations approach, for data that are extensive but sparse. A supplementary estimating equation is proposed from which the modified deviance statistic is obtained. An application of a modified deviance statistic is shown to binomial and Poisson data. We also conduct a performance study of the modified Pearson statistic derived by Farrington and the modified deviance statistic derived in this paper, in terms of size and power, through a small scale simulation experiment. Both statistics are shown to perform well in terms of size. The deviance statistic, however, shows an advantage of power. Two examples are given.     

Applied state space modelling of non-Gaussian time series using integration-based Kalman filtering

The main topic of the paper is on-line filtering for non-Gaussian dynamic (state space) models by approximate computation of the first two posterior moments using efficient numerical integration. Based on approximating the prior of the state vector by a normal density, we prove that the posterior moments of the state vector are related to the posterior moments of the linear predictor in a simple way. For the linear predictor Gauss-Hermite integration is carried out with automatic reparametrization based on an approximate posterior mode filter. We illustrate how further topics in applied state space modelling, such as estimating hyperparameters, computing model likelihoods and predictive residuals, are managed by integration-based Kalman-filtering. The methodology derived in the paper is applied to on-line monitoring of ecological time series and filtering for small count data.     

A fractionally integrated Wishart stochastic volatility model

There has recently been growing interest in modeling and estimating alternative continuous time multivariate stochastic volatility models. We propose a continuous time fractionally integrated Wishart stochastic volatility (FIWSV) process, and derive the conditional Laplace transform of the FIWSV model in order to obtain a closed form expression of moments. A two-step procedure is used, namely estimating the parameter of fractional integration via the local Whittle estimator in the first step, and estimating the remaining parameters via the generalized method of moments in the second step. Monte Carlo results for the procedure show a reasonable performance in finite samples. The empirical results for the S&P 500 and FTSE 100 indexes show that the data favor the new FIWSV process rather than the one-factor and two-factor models of the Wishart autoregressive process for the covariance structure.     

A generalized polynomial-logistic distribution and applications

ABSTRACT

In the present article we introduce a new class of distributions which nests the classical Logistic distribution and offers additional flexibility when data fitting is chased. We provide exact expressions for its moments and absolute moments, investigate its ageing properties, and discuss several techniques for estimating its parameters. Finally, we use the new family to build a parametric model that describes accurately the Euro/CAD exchange reference rates for the period 1/4/1999–12/31/2011.     

The exponentiated generalized gamma distribution with application to lifetime data

A four-parameter extension of the generalized gamma distribution capable of modelling a bathtub-shaped hazard rate function is defined and studied. The beauty and importance of this distribution lies in its ability to model monotone and non-monotone failure rate functions, which are quite common in lifetime data analysis and reliability. The new distribution has a number of well-known lifetime special sub-models, such as the exponentiated Weibull, exponentiated generalized half-normal, exponentiated gamma and generalized Rayleigh, among others. We derive two infinite sum representations for its moments. We calculate the density of the order statistics and two expansions for their moments. The method of maximum likelihood is used for estimating the model parameters and the observed information matrix is obtained. Finally, a real data set from the medical area is analysed.     

The Kumaraswamy modified Weibull distribution: theory and applications

A five-parameter extension of the Weibull distribution capable of modelling a bathtub-shaped hazard rate function is introduced and studied. The beauty and importance of the new distribution lies in its ability to model both monotone and non-monotone failure rates that are quite common in lifetime problems and reliability. The proposed distribution has a number of well-known lifetime distributions as special sub-models, such as the Weibull, extreme value, exponentiated Weibull, generalized Rayleigh and modified Weibull (MW) distributions, among others. We obtain quantile and generating functions, mean deviations, Bonferroni and Lorenz curves and reliability. We provide explicit expressions for the density function of the order statistics and their moments. For the first time, we define the log-Kumaraswamy MW regression model to analyse censored data. The method of maximum likelihood is used for estimating the model parameters and the observed information matrix is determined. Two applications illustrate the potentiality of the proposed distribution.     

Semiparametric estimation for the dispersion parameter in the analysis of over- or underdispersed count data

This paper investigates several semiparametric estimators of the dispersion parameter in the analysis of over- or underdispersed count data when there is no likelihood available. In the context of estimating the dispersion parameter, we consider the double-extended quasi-likelihood (DEQL), the pseudo-likelihood and the optimal quadratic estimating (OQE) equations method and compare them with the maximum likelihood method, the method of moments and the extended quasi-likelihood through simulation study. The simulation study shows that the estimator based on the DEQL has superior bias and efficiency property for moderate and large sample size, and for small sample size the estimator based on the OQE equations outperforms the other estimators. Three real-life data sets arising in biostatistical practices are analyzed, and the findings from these analyses are quite similar to what are found from the simulation study.     

Estimation of product moments of a stationary stochastic process with application to estimation of cumulants and cumulant spectral densities

Inference concerning the structure of stationary stochastic processes can be investigated by looking at properties of various cumulant spectral densities of order two and higher. However, except for cases when cumulants and product moments are identical, estimation of higher-order cumulant spectral densities has been restricted by the dependence of higher-order cumulants on lower-order product moments. By first estimating product moments and then using an identity between product moments and cumulants, asymptotically unbiased and consistent estimates of cumulants are obtained. This in turn leads to asymptotically unbiased and consistent estimators of higher-order cumulant spectral densities. In addition, asymptotic normality of product-moment estimators is exhibited under weak dependence.     

The Kumaraswamy Burr XII distribution: theory and practice

For the first time, a five-parameter distribution, called the Kumaraswamy Burr XII (KwBXII) distribution, is defined and studied. The new distribution contains as special models some well-known distributions discussed in lifetime literature, such as the logistic, Weibull and Burr XII distributions, among several others. We obtain the complete moments, incomplete moments, generating and quantile functions, mean deviations, Bonferroni and Lorenz curves and reliability of the KwBXII distribution. We provide two representations for the moments of the order statistics. The method of maximum likelihood and a Bayesian procedure are adopted for estimating the model parameters. For different parameter settings and sample sizes, various simulation studies are performed and compared to the performance of the KwBXII distribution. Three applications to real data sets demonstrate the usefulness of the proposed distribution and that it may attract wider applications in lifetime data analysis.     

Estimating stellar-oscillation-related parameters and their uncertainties with the moment method

Summary.  The moment method is a well-known astronomical mode identification technique in asteroseismology which uses a time series of the first three moments of a spectral line to estimate the discrete oscillation mode parameters l and m . The method, in contrast with many other mode identification techniques, also provides estimates of other important continuous parameters such as the inclination angle α and the rotational velocity v _e. We developed a statistical formalism for the moment method based on so-called generalized estimating equations. This formalism allows an estimation of the uncertainty of the continuous parameters, taking into account that the different moments of a line profile are correlated and that the uncertainty of the observed moments also depends on the model parameters. Furthermore, we set up a procedure to take into account the mode uncertainty, i.e. the fact that often several modes ( l ,  m ) can adequately describe the data. We also introduce a new lack-of-fit function which works at least as well as a previous discriminant function, and which in addition allows us to identify the sign of the azimuthal order m . We applied our method to star HD181558 by using several numerical methods, from which we learned that numerically solving the estimating equations is an intensive task. We report on the numerical results, from which we gain insight in the statistical uncertainties of the physical parameters that are involved in the moment method.     

Alternative parameter estimators based upon grouped data

The problem of estimating population parameters based upon grouped data is considered and several alternative estimation schemes such as the method of scoring, least lines, least squares, minimum chi square, and a method of approximating method of moments and maximum likelihood estimators are considered. These estimators are compared with maximum likelihood and method of moments estimators based upon individual observations using a Monte Carlo study where the parent population is characterized by a gamma distribution. An application of these techniques to fitting a gamma distribution to 1970-74 census income data is considered.     

Bayesian,MLE, and GMM Estimation of a Spot Rate Model

ABSTRACT

We develop Markov chain Monte Carlo algorithms for estimating the parameters of the short-term interest rate model. Using Monte Carlo experiments we compare the Bayes estimators with the maximum likelihood and generalized method of moments estimators. We estimate the model using the Japanese overnight call rate data.     

Parameter estimation of the generalized Pareto distribution—Part I

The generalized Pareto distribution (GPD) has been widely used in the extreme value framework. The success of the GPD when applied to real data sets depends substantially on the parameter estimation process. Several methods exist in the literature for estimating the GPD parameters. Mostly, the estimation is performed by maximum likelihood (ML). Alternatively, the probability weighted moments (PWM) and the method of moments (MOM) are often used, especially when the sample sizes are small. Although these three approaches are the most common and quite useful in many situations, their extensive use is also due to the lack of knowledge about other estimation methods. Actually, many other methods, besides the ones mentioned above, exist in the extreme value and hydrological literatures and as such are not widely known to practitioners in other areas. This paper is the first one of two papers that aim to fill in this gap. We shall extensively review some of the methods used for estimating the GPD parameters, focusing on those that can be applied in practical situations in a quite simple and straightforward manner.     

Estimation of the location and scale parameters of the extreme value distmbution based on multiply type-II censored samples

In this paper, we consider the problem of estimating the location and scale parameters of an extreme value distribution based on multiply Type-II censored samples. We first describe the best linear unbiased estimators and the maximum likelihood estimators of these parameters. After observing that the best linear unbiased estimators need the construction of some tables for its coefficients and that the maximum likelihood estimators do not exist in an explicit algebraic form and hence need to be found by numerical methods, we develop approximate maximum likelihood estimators by appropriately approximating the likelihood equations. In addition to being simple explicit estimators, these estimators turn out to be nearly as efficient as the best linear unbiased estimators and the maximum likelihood estimators. Next, we derive the asymptotic variances and covariance of these estimators in terms of the first two single moments and the product moments of order statistics from the standard extreme value distribution. Finally, we present an example in order to illustrate all the methods of estimation of parameters discussed in this paper.     

Modeling censored data using modified lambda family

In the present article we propose the modified lambda family (MLF) which is the Freimer, Mudholkar, Kollia, and Lin (FMKL) parametrization of generalized lambda distribution (GLD) as a model for censored data. The expressions for probability weighted moments of MLF are derived and used to estimate the parameters of the distribution. We modified the estimation technique using probability weighted moments. It is shown that the distribution provides reasonable fit to a real censored data.     

Poisson–exponential distribution: different methods of estimation

In this study, we present different estimation procedures for the parameters of the Poisson–exponential distribution, such as the maximum likelihood, method of moments, modified moments, ordinary and weighted least-squares, percentile, maximum product of spacings, Cramer–von Mises and the Anderson–Darling maximum goodness-of-fit estimators and compare them using extensive numerical simulations. We showed that the Anderson–Darling estimator is the most efficient for estimating the parameters of the proposed distribution. Our proposed methodology was also illustrated in three real data sets related to the minimum, average and the maximum flows during October at São Carlos River in Brazil demonstrating that the PE distribution is a simple alternative to be used in hydrological applications.     

Analysis of longitudinal data unbalanced over time

Summary.  The paper considers modelling, estimating and diagnostically verifying the response process generating longitudinal data, with emphasis on association between repeated meas-ures from unbalanced longitudinal designs. Our model is based on separate specifications of the moments for the mean, standard deviation and correlation, with different components possibly sharing common parameters. We propose a general class of correlation structures that comprise random effects, measurement errors and a serially correlated process. These three elements are combined via flexible time-varying weights, whereas the serial correlation can depend flexibly on the mean time and lag. When the measurement schedule is independent of the response process, our estimation procedure yields consistent and asymptotically normal estimates for the mean parameters even when the standard deviation and correlation are misspecified, and for the standard deviation parameters even when the correlation is misspecified. A generic diagnostic method is developed for verifying the models for the mean, standard deviation and, in particular, the correlation, which is applicable even when the data are severely unbalanced. The methodology is illustrated by an analysis of data from a longitudinal study that was designed to characterize pulmonary growth in girls.     

Mean-Squared errors of small area estimators under a multivariate linear model for repeated measures data

In this paper, we discuss the derivation of the first and second moments for the proposed small area estimators under a multivariate linear model for repeated measures data. The aim is to use these moments to estimate the mean-squared errors (MSE) for the predicted small area means as a measure of precision. At the first stage, we derive the MSE when the covariance matrices are known. At the second stage, a method based on parametric bootstrap is proposed for bias correction and for prediction error that reflects the uncertainty when the unknown covariance is replaced by its suitable estimator.     

Parameter estimation of the generalized Pareto distribution—Part II

This is the second part of a paper which focuses on reviewing methods for estimating the parameters of the generalized Pareto distribution (GPD). The GPD is a very important distribution in the extreme value context. It is commonly used for modeling the observations that exceed very high thresholds. The ultimate success of the GPD in applications evidently depends on the parameter estimation process. Quite a few methods exist in the literature for estimating the GPD parameters. Estimation procedures, such as the maximum likelihood (ML), the method of moments (MOM) and the probability weighted moments (PWM) method were described in Part I of the paper. We shall continue to review methods for estimating the GPD parameters, in particular methods that are robust and procedures that use the Bayesian methodology. As in Part I, we shall focus on those that are relatively simple and straightforward to be applied to real world data.     

Measuring and Decomposing Productivity Change

Measuring productivity change with Malmquist indices has become common practice, because they are easily computed using nonparametric programming techniques and can be readily decomposed into technical and efficiency change. However, this approach is nonstochastic and requires a constant returns to scale assumption to construct the reference technology. We propose estimating productivity change using a stochastic input distance frontier, imposing no restrictions on returns to scale. We derive the analogous decomposition of productivity change and develop a generalized method of moments strategy in which outputs or inputs may be endogenous. We compare two methods in an application to electric utilities.