Variations of Q–Q Plots: The Power of Our Eyes!

In statistical modeling, we strive to specify models that resemble data collected in studies or observed from processes. Consequently, distributional specification and parameter estimation are central to parametric models. Graphical procedures, such as the quantile–quantile (Q–Q) plot, are arguably the most widely used method of distributional assessment, though critics find their interpretation to be overly subjective. Formal goodness of fit tests are available and are quite powerful, but only indicate whether there is a lack of fit, not why there is lack of fit. In this article, we explore the use of the lineup protocol to inject rigor into graphical distributional assessment and compare its power to that of formal distributional tests. We find that lineup tests are considerably more powerful than traditional tests of normality. A further investigation into the design of Q–Q plots shows that de-trended Q–Q plots are more powerful than the standard approach as long as the plot preserves distances in x and y to be the same. While we focus on diagnosing nonnormality, our approach is general and can be directly extended to the assessment of other distributions.     

Bayes estimators of the reliability function and parameter of inverted exponential distribution using informative and non-informative priors

In this paper, we propose Bayes estimators of the parameter and reliability function of inverted exponential distribution under the general entropy loss function for complete, type I and type II censored samples. The proposed estimators have been compared with the corresponding maximum-likelihood estimators for their simulated risks (average loss over sample space).     

Variance estimation for tree-order restricted models

In this article, we discuss the estimation of the common variance of several normal populations with tree-order restricted means. We discuss the asymptotic properties of the maximum-likelihood estimator (MLE) of the variance as the number of populations tends to infinity. We consider several cases of various orders of the sample sizes and show that the MLE of the variance may or may not be consistent or be asymptotically normal.     

Predicting probabilities for the 2010 FIFA World Cup games using a Poisson-Gamma model

In this paper, we provide probabilistic predictions for soccer games of the 2010 FIFA World Cup modelling the number of goals scored in a game by each team. We use a Poisson distribution for the number of goals for each team in a game, where the scoring rate is considered unknown. We use a Gamma distribution for the scoring rate and the Gamma parameters are chosen using historical data and difference among teams defined by a strength factor for each team. The strength factor is a measure of discrimination among the national teams obtained from their memberships to fuzzy clusters. The clusters are obtained with the use of the Fuzzy C-means algorithm applied to a vector of variables, most of them available on the official FIFA website. Static and dynamic models were used to predict the World Cup outcomes and the performance of our predictions was evaluated using two comparison methods.     

Segmental modeling of changing immunologic response for CD4 data with skewness,missingness and dropout

In clinical practice, the profile of each subject's CD4 response from a longitudinal study may follow a ‘broken stick’ like trajectory, indicating multiple phases of increase and/or decline in response. Such multiple phases (changepoints) may be important indicators to help quantify treatment effect and improve management of patient care. Although it is a common practice to analyze complex AIDS longitudinal data using nonlinear mixed-effects (NLME) or nonparametric mixed-effects (NPME) models in the literature, NLME or NPME models become a challenge to estimate changepoint due to complicated structures of model formulations. In this paper, we propose a changepoint mixed-effects model with random subject-specific parameters, including the changepoint for the analysis of longitudinal CD4 cell counts for HIV infected subjects following highly active antiretroviral treatment. The longitudinal CD4 data in this study may exhibit departures from symmetry, may encounter missing observations due to various reasons, which are likely to be non-ignorable in the sense that missingness may be related to the missing values, and may be censored at the time of the subject going off study-treatment, which is a potentially informative dropout mechanism. Inferential procedures can be complicated dramatically when longitudinal CD4 data with asymmetry (skewness), incompleteness and informative dropout are observed in conjunction with an unknown changepoint. Our objective is to address the simultaneous impact of skewness, missingness and informative censoring by jointly modeling the CD4 response and dropout time processes under a Bayesian framework. The method is illustrated using a real AIDS data set to compare potential models with various scenarios, and some interested results are presented.     

Efficient Bayesian Multivariate Surface Regression

Methods for choosing a fixed set of knot locations in additive spline models are fairly well established in the statistical literature. The curse of dimensionality makes it nontrivial to extend these methods to nonadditive surface models, especially when there are more than a couple of covariates. We propose a multivariate Gaussian surface regression model that combines both additive splines and interactive splines, and a highly efficient Markov chain Monte Carlo algorithm that updates all the knot locations jointly. We use shrinkage prior to avoid overfitting with different estimated shrinkage factors for the additive and surface part of the model, and also different shrinkage parameters for the different response variables. Simulated data and an application to firm leverage data show that the approach is computationally efficient, and that allowing for freely estimated knot locations can offer a substantial improvement in out‐of‐sample predictive performance.     

Bayesian Analysis of a Queueing System with a Long-Tailed Arrival Process

Internet traffic data is characterized by some unusual statistical properties, in particular, the presence of heavy-tailed variables. A typical model for heavy-tailed distributions is the Pareto distribution although this is not adequate in many cases. In this article, we consider a mixture of two-parameter Pareto distributions as a model for heavy-tailed data and use a Bayesian approach based on the birth-death Markov chain Monte Carlo algorithm to fit this model. We estimate some measures of interest related to the queueing system k-Par/M/1 where k-Par denotes a mixture of k Pareto distributions. Heavy-tailed variables are difficult to model in such queueing systems because of the lack of a simple expression for the Laplace Transform (LT). We use a procedure based on recent LT approximating results for the Pareto/M/1 system. We illustrate our approach with both simulated and real data.     

Bayesian Inference and Prediction Analysis of the Power Law Process Based on a Gamma Prior Distribution

Under a Gamma prior distribution, the importance sampling (IS) technique is applied to the Bayesian analysis of the Power Law Process (PLP). Samples of important parameters in the PLP are obtained from IS. Based on these samples, not only the posterior analyses of parameters and some functions of the parameter in the PLP can be performed conveniently, but also single-sample and two-sample predictions are constructed easily by the transformation formula of double integral. The sensitivity of the posterior mean of the parameter functions in the PLP is studied with respect to the prior moments in the Gamma prior distribution, and it can guide the selections of the prior moments. After some numerical experiments illustrate the rationality and feasibility of the proposed methods, an engineering example demonstrates its application.     

A graphical model selection tool for mixed models

ABSTRACT

Model selection can be defined as the task of estimating the performance of different models in order to choose the most parsimonious one, among a potentially very large set of candidate statistical models. We propose a graphical representation to be considered as an extension to the class of mixed models of the deviance plot proposed in the literature within the framework of classical and generalized linear models. This graphical representation allows, once a reduced number of models have been selected, to identify important covariates focusing only on the fixed effects component, assuming the random part properly specified. Nevertheless, we suggest also a standalone figure representing the residual random variance ratio: a cross-evaluation of the two graphical representations will allow to derive some conclusions on the random part specification of the model and a more accurate selection of the final model.     

Computing A-optimal Designs for Weighted Polynomial Regression by Taylor Expansion

This article is concerned with the problem of constructing A-optimal design for polynomial regression with analytic weight function on the interval [m ? a, m + a], m, a > 0. It is shown that the structure of the optimal design depends on a and weight function only, as a close to 0. Moreover, if the weight function is an analytic function a, then a scaled version of optimal support points, and weights are analytic functions of a at a = 0. We make use of a Taylor expansion to provide a recursive procedure for calculating the A-optimal designs. Examples are presented to illustrate the procedures for computing the optimal designs.