Detection of a pair of outliers in a sample from a Gumbel distribution with known scale parameter

Test procedures on outlier detection problems for Gumbel distribution are rarely available. Hence, a test statistic is proposed here for detection of a pair of upper and lower outliers from a Gumbel distribution with known scale parameter. The critical values of the statistic are obtained and some examples are also given to highlight the use of the statistic. The advantage of the proposed statistic is that the scale parameter, though assumed to be known is not explicitly involved in the determination of the critical values.     

Two‐Sample Test Against One‐Sided Alternatives

Abstract. This paper proposes, implements and investigates a new non‐parametric two‐sample test for detecting stochastic dominance. We pose the question of detecting the stochastic dominance in a non‐standard way. This is motivated by existing evidence showing that standard formulations and pertaining procedures may lead to serious errors in inference. The procedure that we introduce matches testing and model selection. More precisely, we reparametrize the testing problem in terms of Fourier coefficients of well‐known comparison densities. Next, the estimated Fourier coefficients are used to form a kind of signed smooth rank statistic. In such a setting, the number of Fourier coefficients incorporated into the statistic is a smoothing parameter. We determine this parameter via some flexible selection rule. We establish the asymptotic properties of the new test under null and alternative hypotheses. The finite sample performance of the new solution is demonstrated through Monte Carlo studies and an application to a set of survival times.     

Imputation procedures for categorical data: their effects on the goodness-of-fit chi-square statistic

An imputation procedure is a procedure by which each missing value in a data set is replaced (imputed) by an observed value using a predetermined resampling procedure. The distribution of a statistic computed from a data set consisting of observed and imputed values, called a completed data set, is affecwd by the imputation procedure used. In a Monte Carlo experiment, three imputation procedures are compared with respect to the empirical behavior of the goodness-of- fit chi-square statistic computed from a completed data set. The results show that each imputation procedure affects the distribution of the goodness-of-fit chi-square statistic in 3. different manner. However, when the empirical behavior of the goodness-of-fit chi-square statistic is compared u, its appropriate asymptotic distribution, there are no substantial differences between these imputation procedures.     

Questions & Answers: Statistical Aspects of Chronology

For discrete statistical models it is shown that any statistic induces a partition of the set of all possible distributions defined on the sample space. This partition identifies the subsets of the parameter space for which the statistic is sufficient.     

Detection of outliers in simple circular regression models using the mean circular error statistic

The investigation on the identification of outliers in linear regression models can be extended to those for circular regression case. In this paper, we propose a new numerical statistic called mean circular error to identify possible outliers in circular regression models by using a row deletion approach. Through intensive simulation studies, the cut-off points of the statistic are obtained and its power of performance investigated. It is found that the performance improves as the concentration parameter of circular residuals becomes larger or the sample size becomes smaller. As an illustration, the statistic is applied to a wind direction data set.     

Confidence intervals based on the deviance statistic for the hyperparameters in state space models

The main objective of this work is to evaluate the performance of confidence intervals, built using the deviance statistic, for the hyperparameters of state space models. The first procedure is a marginal approximation to confidence regions, based on the likelihood test, and the second one is based on the signed root deviance profile. Those methods are computationally efficient and are not affected by problems such as intervals with limits outside the parameter space, which can be the case when the focus is on the variances of the errors. The procedures are compared to the usual approaches existing in the literature, which includes the method based on the asymptotic distribution of the maximum likelihood estimator, as well as bootstrap confidence intervals. The comparison is performed via a Monte Carlo study, in order to establish empirically the advantages and disadvantages of each method. The results show that the methods based on the deviance statistic possess a better coverage rate than the asymptotic and bootstrap procedures.     

Variable sampling intervals for multiparameter shewhart charts

This paper considers the problem of using control charts to simultaneously monitor more than one parameter with emphasis on simultaneously monitoring the mean and variance. Fixed sampling interval control charts are modified to use variable sampling intervals depending on what is being observed from the data. Two basic strategies are investigated. One strategy uses separate control charts for each parameter, A second strategy uses a proposed single combined statistic which is sensitive to shifts in both the mean and variance. Each procedure is compared to corresponding fixed interval procedures. It is seen that for both strategies the variable sampling interval approach is substantially more efficient than fixed interval procedures.     

Divergences and duality for estimation and test under moment condition models

We introduce estimation and test procedures through divergence minimization for models satisfying linear constraints with unknown parameter. These procedures extend the empirical likelihood (EL) method and share common features with generalized empirical likelihood approach. We treat the problems of existence and characterization of the divergence projections of probability distributions on sets of signed finite measures. We give a precise characterization of duality, for the proposed class of estimates and test statistics, which is used to derive their limiting distributions (including the EL estimate and the EL ratio statistic) both under the null hypotheses and under alternatives or misspecification. An approximation to the power function is deduced as well as the sample size which ensures a desired power for a given alternative.     

Rank-based analysis of repeated measures block designs

A rank-based inference is developed for repeated measures balanced incomplete block and randomized complete block designs using a suitable dispersion function. Asymptotic distributions of rank estimators are developed after establishing approximate linearity of the gradient vector of the dispersion function. Unlike available nonparametric procedures for those designs, estimation and testing are tied together. Three different test statistics are developed for testing the linear hypotheses. Friedman's (1937) statistic and Durbin's (1951) statistic are particular cases of one of the three proposed statistics. An estimate of a scale parameter which appears in the ARE expression as well as as in the variences and covariances of the rank estimators is discussed.     

Inference from PseudoLikelihoods with Plug‐In Estimates

Effective implementation of likelihood inference in models for high‐dimensional data often requires a simplified treatment of nuisance parameters, with these having to be replaced by handy estimates. In addition, the likelihood function may have been simplified by means of a partial specification of the model, as is the case when composite likelihood is used. In such circumstances tests and confidence regions for the parameter of interest may be constructed using Wald type and score type statistics, defined so as to account for nuisance parameter estimation or partial specification of the likelihood. In this paper a general analytical expression for the required asymptotic covariance matrices is derived, and suggestions for obtaining Monte Carlo approximations are presented. The same matrices are involved in a rescaling adjustment of the log likelihood ratio type statistic that we propose. This adjustment restores the usual chi‐squared asymptotic distribution, which is generally invalid after the simplifications considered. The practical implication is that, for a wide variety of likelihoods and nuisance parameter estimates, confidence regions for the parameters of interest are readily computable from the rescaled log likelihood ratio type statistic as well as from the Wald type and score type statistics. Two examples, a measurement error model with full likelihood and a spatial correlation model with pairwise likelihood, illustrate and compare the procedures. Wald type and score type statistics may give rise to confidence regions with unsatisfactory shape in small and moderate samples. In addition to having satisfactory shape, regions based on the rescaled log likelihood ratio type statistic show empirical coverage in reasonable agreement with nominal confidence levels.     

On approximate inference for the two-parameter gamma model

In applied work, the two-parameter gamma model gives useful representations of many physical situations. It has a two dimensional sufficient statistic for the two parameters which describe shape and scale. This makes it superficially comparable to the normal model, but accurate and simple statistical inference procedures for each parameter have not been available. In this paper, the saddlepoint approximation is applied to approximate observed levels of significance of the shape parameter. An averaging method is proposed to approximate observed levels of significance of the scale parameter. These methods are extended to the two-sample case.     

A minimum variance adaptive technique for parameter estimation and hypothesis testing

This report presents numerical results of an approach for parameter estimation and hypothesis testing that does not rely on specific assumptions about the underlying distribution of errors in the measured data. This approach combines robust estimation procedures, the bootstrap method for estimation of parameter uncertainties, permutation techniques for hypothesis testing, and adaptive approaches to estimation in order to obtain the minimum variance estimator or test statistic (within a predefined class) for the data under consideration. The technique produces efficient estimators of central tendency and powerful test statistics, even for small sample sizes. (Portions of this work have been presented in preliminary form (Turkheimer et al., 1996)).     

A semiparametric Bayesian approach to simplex regression model with heterogeneous dispersion

ABSTRACT

Simplex regression model is often employed to analyze continuous proportion data in many studies. In this paper, we extend the assumption of a constant dispersion parameter (homogeneity) to varying dispersion parameter (heterogeneity) in Simplex regression model, and present the B-spline to approximate the smoothing unknown function within the Bayesian framework. A hybrid algorithm combining the block Gibbs sampler and the Metropolis-Hastings algorithm is presented for sampling observations from the posterior distribution. The procedures for computing model comparison criteria such as conditional predictive ordinate statistic, deviance information criterion, and averaged mean squared error are presented. Also, we develop a computationally feasible Bayesian case-deletion influence measure based on the Kullback-Leibler divergence. Several simulation studies and a real example are employed to illustrate the proposed methodologies.     

Some principles for surveillance adopted for multivariate processes with a common change point

The surveillance of multivariate processes has received growing attention during the last decade. Several generalizations of well-known methods such as Shewhart, CUSUM and EWMA charts have been proposed. Many of these multivariate procedures are based on a univariate summarized statistic of the multivariate observations, usually the likelihood ratio statistic. In this paper we consider the surveillance of multivariate observation processes for a shift between two fully specified alternatives. The effect of the dimension reduction using likelihood ratio statistics are discussed in the context of sufficiency properties. Also, an example of the loss of efficiency when not using the univariate sufficient statistic is given. Furthermore, a likelihood ratio method, the LR method, for constructing surveillance procedures is suggested for multivariate surveillance situations. It is shown to produce univariate surveillance procedures based on the sufficient likelihood ratios. As the LR procedure has several optimality properties in the univariate, it is also used here as a benchmark for comparisons between multivariate surveillance procedures     

Bayesian inference and prediction of the Rayleigh distribution based on ordered ranked set sampling

Based on ordered ranked set sample, Bayesian estimation of the model parameter as well as prediction of the unobserved data from Rayleigh distribution are studied. The Bayes estimates of the parameter involved are obtained using both squared error and asymmetric loss functions. The Bayesian prediction approach is considered for predicting the unobserved lifetimes based on a two-sample prediction problem. A real life dataset and simulation study are used to illustrate our procedures.     

Test for randomness of the technology parameter in a stochastic frontier regression model

This paper considers the problem of testing for randomness of the technology parameter in a stochastic frontier regression model. A test statistic is proposed and its asymptotic distribution theory is discussed. Simulation results show that the proposed test maintains its level and also quite powerful against various alternatives. An empirical investigation has been carried out by applying the suggested test procedure to the data set on electric utility companies. The results are consistent with the general finding that the technology parameter of the stochastic frontier model used for modeling these data is random.     

Marginal information for expectation parameters

The authors consider a special case of inference in the presence of nuisance parameters. They show that when the orthogonalized score function is a function of a statistic S, no Fisher information for the interest parameter is lost by using the marginal distribution of S rather than the full distribution of the observations. Therefore, no information for the interest parameter is recovered by conditioning on an ancillary statistic, and information will be lost by conditioning on an approximate ancillary statistic. This is the case for regular multivariate exponential families when the interest parameter is a subvector of the expectation parameter and the statistic is the maximum likelihood estimate of the interest parameter. Several examples are considered, including the 2 × 2 table.     

Bayesian goodness-of-fit test for censored data

We propose a Bayesian computation and inference method for the Pearson-type chi-squared goodness-of-fit test with right-censored survival data. Our test statistic is derived from the classical Pearson chi-squared test using the differences between the observed and expected counts in the partitioned bins. In the Bayesian paradigm, we generate posterior samples of the model parameter using the Markov chain Monte Carlo procedure. By replacing the maximum likelihood estimator in the quadratic form with a random observation from the posterior distribution of the model parameter, we can easily construct a chi-squared test statistic. The degrees of freedom of the test equal the number of bins and thus is independent of the dimensionality of the underlying parameter vector. The test statistic recovers the conventional Pearson-type chi-squared structure. Moreover, the proposed algorithm circumvents the burden of evaluating the Fisher information matrix, its inverse and the rank of the variance–covariance matrix. We examine the proposed model diagnostic method using simulation studies and illustrate it with a real data set from a prostate cancer study.     

Robust algorithms for economic designing of a nonparametric control chart for abrupt shift in location

The existing statistical process control procedures typically rely on the fundamental assumption of a parametric distribution of the quality characteristic. However, when there is a lack of knowledge about the underlying distribution (as full knowledge is not available in practice), the performance of these parametric charts is very likely to be heavily degraded. Motivated by this problem, a one-sided nonparametric monitoring procedure using the single sample sign statistic is proposed for detecting a shift in the location parameter of a continuous distribution. An economic model of the control chart is developed to optimize the sample size, sampling interval, and control limits. Three data-dependent estimation approaches for the unknown parameter are evaluated and discussed. Simulation results exhibit that our proposed procedure generally performs well under a great variety of continuous distributions and hence it is recommended as an alternative scheme especially when the knowledge of the underlying distribution is imperfect. Furthermore, beneficial recommendations of estimation approach selection are provided for practical implementation of the control chart.     

A modified likelihood ratio test for the mean direction in the von mises distribution

The likelihood ratio test (LRT) for the mean direction in the von Mises distribution is modified for possessing a common asymptotic distribution both for large sample size and for large concentration parameter. The test statistic of the modified LRT is compared with the F distribution but not with the chi-square distribution usually employed, Good performances of the modified LRT are shown by analytical studies and Monte Carlo simulation studies, A notable advantage of the test is that it takes part in the unified likelihood inference procedures including both the marginal MLE and the marginal LRT for the concentration parameter.