Monte carlo sampling approach to testing nonnested hypothesis: monte carlo results

Alternative ways of using Monte Carlo methods to implement a Cox-type test for separate families of hypotheses are considered. Monte Carlo experiments are designed to compare the finite sample performances of Pesaran and Pesaran's test, a RESET test, and two Monte Carlo hypothesis test procedures. One of the Monte Carlo tests is based on the distribution of the log-likelihood ratio and the other is based on an asymptotically pivotal statistic. The Monte Carlo results provide strong evidence that the size of the Pesaran and Pesaran test is generally incorrect, except for very large sample sizes. The RESET test has lower power than the other tests. The two Monte Carlo tests perform equally well for all sample sizes and are both clearly preferred to the Pesaran and Pesaran test, even in large samples. Since the Monte Carlo test based on the log-likelihood ratio is the simplest to calculate, we recommend using it.     

A note on the nonparametric test based on theL 1-version of the Cramér-von Mises statistic

We consider the test based on theL ₁-version of the Cramér-von Mises statistic for the nonparametric two-sample problem. Some quantiles of the exact distribution under H₀ of the test statistic are computed for small sample sizes. We compare the test in terms of power against general alternatives to other two-sample tests, namely the Wilcoxon rank sum test, the Smirnov test and the Cramér-von Mises test in the case of unbalanced small sample sizes. The computation of the power is rather complicated when the sample sizes are unequal. Using Monte Carlo power estimates it turns out that the Smirnov test is more sensitive to non stochastically ordered alternatives than the new test. And under location-contamination alternatives the power estimates of the new test and of the competing tests are equal.     

Maximizing generalized linear mixed model likelihoods with an automated Monte Carlo EM algorithm

Two new implementations of the EM algorithm are proposed for maximum likelihood fitting of generalized linear mixed models. Both methods use random (independent and identically distributed) sampling to construct Monte Carlo approximations at the E-step. One approach involves generating random samples from the exact conditional distribution of the random effects (given the data) by rejection sampling, using the marginal distribution as a candidate. The second method uses a multivariate t importance sampling approximation. In many applications the two methods are complementary. Rejection sampling is more efficient when sample sizes are small, whereas importance sampling is better with larger sample sizes. Monte Carlo approximation using random samples allows the Monte Carlo error at each iteration to be assessed by using standard central limit theory combined with Taylor series methods. Specifically, we construct a sandwich variance estimate for the maximizer at each approximate E-step. This suggests a rule for automatically increasing the Monte Carlo sample size after iterations in which the true EM step is swamped by Monte Carlo error. In contrast, techniques for assessing Monte Carlo error have not been developed for use with alternative implementations of Monte Carlo EM algorithms utilizing Markov chain Monte Carlo E-step approximations. Three different data sets, including the infamous salamander data of McCullagh and Nelder, are used to illustrate the techniques and to compare them with the alternatives. The results show that the methods proposed can be considerably more efficient than those based on Markov chain Monte Carlo algorithms. However, the methods proposed may break down when the intractable integrals in the likelihood function are of high dimension.     

A test for bivariate two sample location problem

A consistent test for difference in locations between two bivariate populations is proposed, The test is similar as the Mann-Whitney test and depends on the exceedances of slopes of the two samples where slope for each sample observation is computed by taking the ratios of the observed values. In terms of the slopes, it reduces to a univariate problem, The power of the test has been compared with those of various existing tests by simulation. The proposed test statistic is compared with Mardia's(1967) test statistics, Peters-Randies(1991) test statistic, Wilcoxon's rank sum test. statistic and Hotelling' T² test statistic using Monte Carlo technique. It performs better than other statistics compared for small differences in locations between two populations when underlying population is population 7(light tailed population) and sample size 15 and 18 respectively. When underlying population is population 6(heavy tailed population) and sample sizes are 15 and 18 it performas better than other statistic compared except Wilcoxon's rank sum test statistics for small differences in location between two populations. It performs better than Mardia's(1967) test statistic for large differences in location between two population when underlying population is bivariate normal mixture with probability p=0.5, population 6, Pearson type II population and Pearson type VII population for sample size 15 and 18 .Under bivariate normal population it performs as good as Mardia' (1967) test statistic for small differences in locations between two populations and sample sizes 15 and 18. For sample sizes 25 and 28 respectively it performs better than Mardia's (1967) test statistic when underlying population is population 6, Pearson type II population and Pearson type VII population     

Large-sample quantile estimation in pareto laws

A large-sample method of estimation for the parameters of Pareto laws is investigatedo The estimates are derived by using a small subset of k sample quantiles out of the original observations. The optimum spacing of the k quantiles is also examined. A Monte Carlo study compares this method with the method of moments and that of maximum likelihood for a selected set of parameter values and sample sizes.     

Computing Critical Values of Exact Tests by Incorporating Monte Carlo Simulations Combined with Statistical Tables

Various exact tests for statistical inference are available for powerful and accurate decision rules provided that corresponding critical values are tabulated or evaluated via Monte Carlo methods. This article introduces a novel hybrid method for computing p‐values of exact tests by combining Monte Carlo simulations and statistical tables generated a priori. To use the data from Monte Carlo generations and tabulated critical values jointly, we employ kernel density estimation within Bayesian‐type procedures. The p‐values are linked to the posterior means of quantiles. In this framework, we present relevant information from the Monte Carlo experiments via likelihood‐type functions, whereas tabulated critical values are used to reflect prior distributions. The local maximum likelihood technique is employed to compute functional forms of prior distributions from statistical tables. Empirical likelihood functions are proposed to replace parametric likelihood functions within the structure of the posterior mean calculations to provide a Bayesian‐type procedure with a distribution‐free set of assumptions. We derive the asymptotic properties of the proposed nonparametric posterior means of quantiles process. Using the theoretical propositions, we calculate the minimum number of needed Monte Carlo resamples for desired level of accuracy on the basis of distances between actual data characteristics (e.g. sample sizes) and characteristics of data used to present corresponding critical values in a table. The proposed approach makes practical applications of exact tests simple and rapid. Implementations of the proposed technique are easily carried out via the recently developed STATA and R statistical packages.     

A Goodness-of-Fit Test for Location-Scale Max-Stable Distributions

In this article, a technique based on the sample correlation coefficient to construct goodness-of-fit tests for max-stable distributions with unknown location and scale parameters and finite second moment is proposed. Specific details to test for the Gumbel distribution are given, including critical values for small sample sizes as well as approximate critical values for larger sample sizes by using normal quantiles. A comparison by Monte Carlo simulation shows that the proposed test for the Gumbel hypothesis is substantially more powerful than some other known tests against some alternative distributions with positive skewness coefficient.     

Confidence intervals for a two-parameter exponential distribution: One- and two-sample problems

The problems of interval estimating the mean, quantiles, and survival probability in a two-parameter exponential distribution are addressed. Distribution function of a pivotal quantity whose percentiles can be used to construct confidence limits for the mean and quantiles is derived. A simple approximate method of finding confidence intervals for the difference between two means and for the difference between two location parameters is also proposed. Monte Carlo evaluation studies indicate that the approximate confidence intervals are accurate even for small samples. The methods are illustrated using two examples.     

Testing for Granger-causality in quantiles

This paper proposes a consistent parametric test of Granger-causality in quantiles. Although the concept of Granger-causality is defined in terms of the conditional distribution, most articles have tested Granger-causality using conditional mean regression models in which the causal relations are linear. Rather than focusing on a single part of the conditional distribution, we develop a test that evaluates nonlinear causalities and possible causal relations in all conditional quantiles, which provides a sufficient condition for Granger-causality when all quantiles are considered. The proposed test statistic has correct asymptotic size, is consistent against fixed alternatives, and has power against Pitman deviations from the null hypothesis. As the proposed test statistic is asymptotically nonpivotal, we tabulate critical values via a subsampling approach. We present Monte Carlo evidence and an application considering the causal relation between the gold price, the USD/GBP exchange rate, and the oil price.     

Testing the Equality of Two Exponential Distributions

This paper proposes an overlapping-based test statistic for testing the equality of two exponential distributions with different scale and location parameters. The test statistic is defined as the maximum likelihood estimate of the Weitzman's overlapping coefficient, which estimates the agreement of two densities. The proposed test statistic is derived in closed form. Simulated critical points are generated for the proposed test statistic for various sample sizes and significance levels via Monte Carlo Simulations. Statistical powers of the proposed test are computed via simulation studies and compared to those of the existing Log likelihood ratio test.     

Goodness-of-fit test for exponentiality based on spacings for general progressive Type-II censored data

There have been numerous tests proposed to determine whether or not the exponential model is suitable for a given data set. In this article, we propose a new test statistic based on spacings to test whether the general progressive Type-II censored samples are from exponential distribution. The null distribution of the test statistic is discussed and it could be approximated by the standard normal distribution. Meanwhile, we propose an approximate method for calculating the expectation and variance of samples under null hypothesis and corresponding power function is also given. Then, a simulation study is conducted. We calculate the approximation of the power based on normality and compare the results with those obtained by Monte Carlo simulation under different alternatives with distinct types of hazard function. Results of simulation study disclose that the power properties of this statistic by using Monte Carlo simulation are better for the alternatives with monotone increasing hazard function, and otherwise, normal approximation simulation results are relatively better. Finally, two illustrative examples are presented.     

A continuously adaptive nonparametric two–sample test

A two–sample test statistic for detecting shifts in location is developed for a broad range of underlying distributions using adaptive techniques. The test statistic is a linear rank statistics which uses a simple modification of the Wilcoxon test; the scores are Winsorized ranks where the upper and lower Winsorinzing proportions are estimated in the first stage of the adaptive procedure using sample the first stage of the adaptive procedure using sample measures of the distribution's skewness and tailweight. An empirical relationship between the Winsorizing proportions and the sample skewness and tailweight allows for a ‘continuous’ adaptation of the test statistic to the data. The test has good asymptotic properties, and the small sample results are compared with other populatr parametric, nonparametric, and two–stage tests using Monte Carlo methods. Based on these results, this proposed test procedure is recommended for moderate and larger sample sizes.     

Assessing a hypothesis test for the difference between two quantiles from independent populations

An empirical distribution function estimator for the difference of order statistics from two independent populations can be used for inference between quantiles from these populations. The inferential properties of the approach are evaluated in a simulation study where different sample sizes, theoretical distributions, and quantiles are studied. Small to moderate sample sizes, tail quantiles, and quantiles which do not coincide with the expectation of an order statistic are identified as problematic for appropriate Type I error control.     

蒙特卡罗方法在经济学中的应用——基于河南省农业持续度的实证分析

首先利用蒙特卡罗方法研究小样本或有限样本的统计性质,然后计算ADF检验式中时间趋势项的τ统计量的值,最后用蒙特卡罗方法进行实证分析。通过分析可以看出蒙特卡罗方法在经济中的应用非常广泛,特别是用于解决随机性问题,使得这种方法成为一种优于其它方法的工具。     

A bivariate signed rank test for two sample location problem

An affine-invariant signed rank test for the difference in location between two symmetric populations is proposed. The proposed test statistic is compared with Hotelling's T2 test statistic, Mardia's(1967)test statistic, Peters-Randles(1991) test statistic and Wilcoxon's rank sum test statistic using a Monte Carlo Study. It performs better than Mardia's test statistic under almost all populations considered. Under the bivariate normal distribution, it performs better than other test statistics compared for small differences in location between two populations except Hotelling's T2. It performs better than all statistics, including Hotelling's T , for sample size 15 when samples are drawn from Pearson type.     

An entropy-based test for goodness of fit of the von mises distribution

The maximum entropy characterization of the von Mises distribution on the circle is exploited to derive a consistent goodness of fit test for the von Mises distribution. Monte Carlo simulation results are tabulated giving critical values of the test statistic for various sample sizes and values of the concentration parameter. A power analysis is presented for various alternative hypotheses, comparing this entropy statistic to two other competing goodness of fit statistics. The entropy statistic is shown to compare favorably and may be more attractive, especially considering its ease of computation.     

Multivariate rank tests for the two-sample location problem

A multivariate affinc-invariant family of rank tests is proposed for the two sample location problem. The class of statistics introduced is built upon Randles' multivariate one-sample sign statistic based on interdirections and the multivariate one-sample signed-rank statistic of Peters and Randles. Asymptotic relative efficiencies are obtained which indicate that selected members of the class perform very well for a broad class of distributions. Further comparisons are made among several statistics using Monte Carlo results.     

Comparison to control in logistic regression

We are interested in comparing logistic regressions for several test treatments or populations with a logistic regression for a standard treatment or population. The research was motivated by some real life problems, which are discussed as data examples. We propose a step-down likelihood ratio method for declaring differences between the test treatments or populations and the standard treatment or population. Competitors based on the sequentially rejective Bonferroni Wald statistic, sequentially rejective exact Wald statistic and Reiers?l's statistic are also discussed. It is shown that the proposed method asymptotically controls the probability of type I error. A Monte Carlo simulation shows that the proposed method performs well for relatively small sample sizes, outperforming its competitors.     

Estimation of the parameters of the Gompertz distribution under the first failure-censored sampling plan

This article presents the goodness-of-fit tests for the Laplace distribution based on its maximum entropy characterization result. The critical values of the test statistics estimated by Monte Carlo simulations are tabulated for various window and sample sizes. The test statistics use an entropy estimator depending on the window size; so, the choice of the optimal window size is an important problem. The window sizes for yielding the maximum power of the tests are given for selected sample sizes. Power studies are performed to compare the proposed tests with goodness-of-fit tests based on the empirical distribution function. Simulation results report that entropy-based tests have consistently higher power than EDF tests against almost all alternatives considered.     

Bootstrap Bartlett correction in inflated beta regression

The inflated beta regression model aims to enable the modeling of responses in the intervals (0, 1], [0, 1), or [0, 1]. In this model, hypothesis testing is often performed based on the likelihood ratio statistic. The critical values are obtained from asymptotic approximations, which may lead to distortions of size in small samples. In this sense, this article proposes the bootstrap Bartlett correction to the statistic of likelihood ratio in the inflated beta regression model. The proposed adjustment only requires a simple Monte Carlo simulation. Through extensive Monte Carlo simulations the finite sample performance (size and power) of the proposed corrected test is compared to the usual likelihood ratio test and the Skovgaard adjustment already proposed in the literature. The numerical results evidence that inference based on the proposed correction is much more reliable than that based on the usual likelihood ratio statistics and the Skovgaard adjustment. At the end of the work, an application to real data is also presented.