Bias reduction in the estimation of a shape second-order parameter of a heavy-tailed model

In extreme value theory, the shape second-order parameter is a quite relevant parameter related to the speed of convergence of maximum values, linearly normalized, towards its limit law. The adequate estimation of this parameter is vital for improving the estimation of the extreme value index, the primary parameter in statistics of extremes. In this article, we consider a recent class of semi-parametric estimators of the shape second-order parameter for heavy right-tailed models. These estimators, based on the largest order statistics, depend on a real tuning parameter, which makes them highly flexible and possibly unbiased for several underlying models. In this article, we are interested in the adaptive choice of such tuning parameter and the number of top order statistics used in the estimation procedure. The performance of the methodology for the adaptive choice of parameters is evaluated through a Monte Carlo simulation study.     

Stein-type estimation in logistic regression models based on minimum ϕ-divergence estimators

In this paper we present a study of Stein-type estimators for the unknown parameters in logistic regression models when it is suspected that the parameters may be restricted to a subspace of the parameter space. The Stein-type estimators studied are based on the minimum phi-divergence estimator instead on the maximum likelihood estimator as well as on phi-divergence test statistics.     

Tests for the skewness parameter of two-piece double exponential distribution in the presence of nuisance parameters

In this paper, tests for the skewness parameter of the two-piece double exponential distribution are derived when the location parameter is unknown. Classical tests like Neyman structure test and likelihood ratio test (LRT), that are generally used to test hypotheses in the presence of nuisance parameters, are not feasible for this distribution since the exact distributions of the test statistics become very complicated. As an alternative, we identify a set of statistics that are ancillary for the location parameter. When the scale parameter is known, Neyman–Pearson's lemma is used, and when the scale parameter is unknown, the LRT is applied to the joint density function of ancillary statistics, in order to obtain a test for the skewness parameter of the distribution. Test for symmetry of the distribution can be deduced as a special case. It is found that power of the proposed tests for symmetry is only marginally less than the power of corresponding classical optimum tests when the location parameter is known, especially for moderate and large sample sizes.     

The global minimum variance unbiased estimator of the parameter for a truncated parameter family under the optimal ranked set sampling

The minimum variance unbiased estimators (MVUEs) of the parameters for various distributions are extensively studied under ranked set sampling (RSS). However, the results in existing literatures are only locally MVUEs, i.e. the MVUE in a class of some unbiased estimators is obtained. In this paper, the global MVUE of the parameter in a truncated parameter family is obtained, that is to say, it is the MVUE in the class of all unbiased estimators. Firstly we find the optimal RSS according to the character of a truncated parameter family, i.e. arrange RSS based on complete and sufficient statistics of independent and identically distributed samples. Then under this RSS, the global MVUE of the parameter in a truncated parameter family is found. Numerical simulations for some usual distributions in this family fully support the result from the above two-step optimizations. A real data set is used for illustration.     

On a data-dependent choice of the tuning parameter appearing in certain goodness-of-fit tests

We propose a data-dependent method for choosing the tuning parameter appearing in many recently developed goodness-of-fit test statistics. The new method, based on the bootstrap, is applicable to a class of distributions for which the null distribution of the test statistic is independent of unknown parameters. No data-dependent choice for this parameter exists in the literature; typically, a fixed value for the parameter is chosen which can perform well for some alternatives, but poorly for others. The performance of the new method is investigated by means of a Monte Carlo study, employing three tests for exponentiality. It is found that the Monte Carlo power of these tests, using the data-dependent choice, compares favourably to the maximum achievable power for the tests calculated over a grid of values of the tuning parameter.     

Inference from PseudoLikelihoods with Plug‐In Estimates

Effective implementation of likelihood inference in models for high‐dimensional data often requires a simplified treatment of nuisance parameters, with these having to be replaced by handy estimates. In addition, the likelihood function may have been simplified by means of a partial specification of the model, as is the case when composite likelihood is used. In such circumstances tests and confidence regions for the parameter of interest may be constructed using Wald type and score type statistics, defined so as to account for nuisance parameter estimation or partial specification of the likelihood. In this paper a general analytical expression for the required asymptotic covariance matrices is derived, and suggestions for obtaining Monte Carlo approximations are presented. The same matrices are involved in a rescaling adjustment of the log likelihood ratio type statistic that we propose. This adjustment restores the usual chi‐squared asymptotic distribution, which is generally invalid after the simplifications considered. The practical implication is that, for a wide variety of likelihoods and nuisance parameter estimates, confidence regions for the parameters of interest are readily computable from the rescaled log likelihood ratio type statistic as well as from the Wald type and score type statistics. Two examples, a measurement error model with full likelihood and a spatial correlation model with pairwise likelihood, illustrate and compare the procedures. Wald type and score type statistics may give rise to confidence regions with unsatisfactory shape in small and moderate samples. In addition to having satisfactory shape, regions based on the rescaled log likelihood ratio type statistic show empirical coverage in reasonable agreement with nominal confidence levels.     

Multi - sample test of equal gamma distribution scale parameters in presence of unknown common shape parameter

Shiue and Bain proposed an approximate F statistic for testing equality of two gamma distribution scale parameters in presence of a common and unknown shape parameter. By generalizing Shiue and Bain's statistic we develop a new statistic for testing equality of L >= 2 gamma distribution scale parameters. We derive the distribution of the new statistic ESP for L = 2 and equal sample size situation. For other situations distribution of ESP is not known and test based on the ESP statistic has to be performed by using simulated critical values. We also derive a C(α) statistic CML and develop a likelihood ratio statistic, LR, two modified likelihood ratio statistics M and MLB and a quadratic statistic Q. The distribution of each of the statistics CML, LR, M, MLB and Q is asymptotically chi-square with L - 1 degrees of freedom. We then conducted a monte-carlo simulation study to compare the perfor- mance of the statistics ESP, LR, M, MLB, CML and Q in terms of size and power. The statistics LR, M, MLB and Q are in general liberal and do not show power advantage over other statistics. The statistic CML, based on its asymptotic chi-square distribution, in general, holds nominal level well. It is most powerful or nearly most powerful in most situations and is simple to use. Hence, we recommend the statistic CML for use in general. For better power the statistic ESP, based on its empirical distribution, is recommended for the special situation for which there is evidence in the data that λ₁ < … < λ_L and n₁ < … < n_L, where λ₁ …, λ_L are the scale parameters and n₁,…, n_L are the sample sizes.     

Evaluating the Accuracy of Small P‐Values In Genetic Association Studies Using Edgeworth Expansions

The asymptotic distributions of many classical test statistics are normal. The resulting approximations are often accurate for commonly used significance levels, 0.05 or 0.01. In genome‐wide association studies, however, the significance level can be as low as 1×10⁻⁷, and the accuracy of the p‐values can be challenging. We study the accuracies of these small p‐values are using two‐term Edgeworth expansions for three commonly used test statistics in GWAS. These tests have nuisance parameters not defined under the null hypothesis but estimable. We derive results for this general form of testing statistics using Edgeworth expansions, and find that the commonly used score test, maximin efficiency robust test and the chi‐squared test are second order accurate in the presence of the nuisance parameter, justifying the use of the p‐values obtained from these tests in the genome‐wide association studies.     

Testing for parameter constancy in the time series direction in panel data models

We propose tests for parameter constancy in the time series direction in panel data models. We construct a locally best invariant test based on Tanaka [Time series analysis: nonstationary and noninvertible distribution theory. New York: Wiley; 1996] and an asymptotically point optimal test based on Elliott and Müller [Efficient tests for general persistent time variation in regression coefficients. Rev Econ Stud. 2006;73:907–940]. We derive the limiting distributions of the test statistics as T→∞ while N is fixed, and calculate the critical values by applying numerical integration and response surface regression. Simulation results show that the proposed tests perform well if we apply them appropriately.     

A Consistent Method of Estimation For The Three-Parameter Gamma Distribution

For the three-parameter gamma distribution, it is known that the method of moments as well as the maximum likelihood method have difficulties such as non-existence in some range of the parameters, convergence problems, and large variability. For this reason, in this article, we propose a method of estimation based on a transformation involving order statistics from the sample. In this method, the estimates always exist uniquely over the entire parameter space, and the estimators also have consistency over the entire parameter space. The bias and mean squared error of the estimators are also examined by means of a Monte Carlo simulation study, and the empirical results show the small-sample superiority in addition to the desirable large sample properties.     

On similarity and independence properties of composite edf goodness-of-fit tests

Many test statistics for classical simple goodness-of-fit hypothesis testing problems are distancemeasures between the distribution function of the null hypothesis distributipn and the empirical distribution function sometimes called EDF tests. If a composite parametric null hypothesis is considered in place of the simple null hypothesis, then a test statistic can be obtained from each EDF test by replacing the known distribution function of the simple problem by the Rao-Blackwell estimating distribution function. In this note we use known results to show that these Rao-Blackwell-EDF test statistics have distributions that do not depend upon parameter values, and hence that these tests are independent of a complete sufficient statistic for the parameters.     

Hybrid regions for post-change mean in a sequence of normal variables

The hybrid bootstrap uses resampling ideas to extend the duality approach to the interval estimation for a parameter of interest when there are nuisance parameters. The confidence region constructed by the hybrid bootstrap may perform much better than the ordinary bootstrap region in a situation where the data provide substantial information about the nuisance parameter, but limited information about the parameter of interest. We apply this method to estimate the post-change mean after a change is detected by a stopping procedure in a sequence of independent normal variables. Since distribution theory in change point problems is generally a challenge, we use bootstrap simulation to find empirical distributions of test statistics and calculate critical thresholds. Both likelihood ratio and Bayesian test statistics are considered to set confidence regions for post-change means in the normal model. In the simulation studies, the performance of hybrid regions are compared with that of ordinary bootstrap regions in terms of the widths and coverage probabilities of confidence intervals.     

ON EXTERNAL ANCILLARITY1

Statistics distributed free of a certain parameter (called ancillary for the parameter) are of considerable use when sufficient estimation is not possible (Fisher (1925)). When the model involves, in addition to the parameters of interest, parameters not of direct interest (nuisance parameters) statistics which are distributed free of the latter may be of considerable use also. This requires a study of ancillary statistics which are not functions of the minimal sufficient statistic (MSS). In particular we study the general ancillary given in Williams (1982) and show that it has certain desirable properties including uniqueness under appropriate restrictions. Finally some non-trivial applications are given.     

Assessing cumulative logit models via a score test in random effect models

The purpose of this article is to develop a goodness-of-fit test based on score test statistics for cumulative logit models with extra variation of random effects. Two main theorems for the proposed score test statistics are derived. In simulation studies, the powers of the proposed tests are discussed and the power curve against a variety of dispersion parameters and bandwidths is depicted. The proposed method is illustrated by an ordinal data set from Mosteller and Tukey [23].     

On optimal tests for separate hypotheses and conditional probability integral transformations

Consider the problem of testing the composite null hypothesis that a random sample X₁,…,X_n is from a parent which is a member of a particular continuous parametric family of distributions against an alternative that it is from a separate family of distributions. It is shown here that in many cases a uniformly most powerful similar (UMPS) test exists for this problem, and, moreover, that this test is equivalent to a uniformly most powerful invariant (UMPI) test. It is also seen in the method of proof used that the UMPS test statistic Is a function of the statistics U₁,…,U_n?k obtained by the conditional probability integral transformations (CPIT), and thus that no Information Is lost by these transformations, It is also shown that these optimal tests have power that is a nonotone function of the null hypothesis class of distributions, so that, for example, if one additional parameter for the distribution is assumed known, then the power of the test can not lecrease. It Is shown that the statistics U₁, …, U_n?k are independent of the complete sufficient statistic, and that these statistics have important invariance properties. Two examples at given. The UMPS tests for testing the two-parameter uniform family against the two-parameter exponential family, and for testing one truncation parameter distribution against another one are derived.     

Hypothesis tests for linear functional relationships

The analysis of linear functional relationships is considered. Expressions useful for the estimation of both unconstrained and con¬strained parameters are presented. The testing of hypotheses which consist of linear constraints on the parameters is discussed. Wald type and Wilks type test statistics and their asymptotic null dis¬tributions are derived. It appears that these test statistics are not asymptotically equivalent.     

The Cusum Test for Parameter Change in Time Series Models

Abstract.  In this paper, we consider the problem of testing for parameter changes in time series models based on a cusum test. Although the test procedure is well established for the mean and variance in time series models, a general parameter case has not been discussed in the literature. Therefore, here we develop a cusum test for parameter change in a more general framework. As an example, we consider the change of the parameters in a random coeefficient autoregressive (1) model and that of the autocovariances of a linear process. Simulation results are reported for illustration.     

A Conway Maxwell Poisson type generalization of the negative hypergeometric distribution

Abstract

Negative hypergeometric distribution arises as a waiting time distribution when we sample without replacement from a finite population. It has applications in many areas such as inspection sampling and estimation of wildlife populations. However, as is well known, the negative hypergeometric distribution is over-dispersed in the sense that its variance is greater than the mean. To make it more flexible and versatile, we propose a modified version of negative hypergeometric distribution called COM-Negative Hypergeometric distribution (COM-NH) by introducing a shape parameter as in the COM-Poisson and COMP-Binomial distributions. It is shown that under some limiting conditions, COM-NH approaches to a distribution that we call the COM-Negative binomial (COMP-NB), which in turn, approaches to the COM Poisson distribution. For the proposed model, we investigate the dispersion characteristics and shape of the probability mass function for different combinations of parameters. We also develop statistical inference for this model including parameter estimation and hypothesis tests. In particular, we investigate some properties such as bias, MSE, and coverage probabilities of the maximum likelihood estimators for its parameters by Monte Carlo simulation and likelihood ratio test to assess shape parameter of the underlying model. We present illustrative data to provide discussion.     

INFERENCE ABOUT THE MEAN OF A POISSON DISTRIBUTION IN THE PRESENCE OF A NUISANCE PARAMETER

In this note we examine the problem of estimating the mean of a Poisson distribution when a nuisance parameter is present. Using a condition of Cox (1958) about ancillarity in the presence of a nuisance parameter, we justify that inference about the parameter should be carried out using the conditional distribution given the appropriate ancillary statistics. A small simulation study has been done to compare the performance of the conditional likelihood approach and the standard likelihood approach.     

Default Bayesian goodness-of-fit tests for the skew-normal model

In this paper we propose a series of goodness-of-fit tests for the family of skew-normal models when all parameters are unknown. As the null distributions of the considered test statistics depend only on asymmetry parameter, we used a default and proper prior on skewness parameter leading to the prior predictive p-value advocated by G. Box. Goodness-of-fit tests, here proposed, depend only on sample size and exhibit full agreement between nominal and actual size. They also have good power against local alternative models which also account for asymmetry in the data.