Dempster's combination rule and sufficient statistics

In his articles (1966-1968) concerning statistical inference based on lower and upper probabilities, Dempster refers to the connection between Fisher's fiducial argument and his own ideas of statistical inference. Dempster's main concern however focuses on the “Bayesian” aspects of his theory and not on an elaboration of the relation between Fisher's and his ideas. This article attempts to work out the connection between those two approaches and focuses primarily on the question, whether Dempster's combination rule, his upper and lower probabilty based on sufficient statistics and inference based on sufficient statistics in Fisher's sense are consistent. To be adequate to Fisher's reasoning, we deal with absolutely continuous, one parametric families of distributions.This is certainly not the usual assumption in context with Dempster's theory and implies a normative but straightforward definition concerning the underlying conditional distribution; this definition however is done in Dempster's spirit as can be seen from his articles, (1966, 1968,a,b). Under those assumptions it can be shown that - similar to Lindley's results concerning consistency in fiducial reasoning (1958) - the combination rule, Dempster's procedure based on sufficient statistics and fiducial inference by sufficient statistics agree iff the parametric family under consideration can be transformed to location parameter form.     

On Two Forms of Fisher's Measure of Information

ABSTRACT

Fisher's information number is the second moment of the “score function” where the derivative is with respect to x rather than Θ. It is Fisher's information for a location parameter, and also called shift-invariant Fisher information. In recent years, Fisher's information number has been frequently used in several places regardless of parameters of the distribution or of their nature. Is this number a nominal, standard, and typical measure of information? The Fisher information number is examined in light of the properties of classical statistical information theory. It has some properties analogous to those of Fisher's measure, but, in general, it does not have good properties if used as a measure of information when Θ is not a location parameter. Even in the case of location parameter, the regularity conditions must be satisfied. It does not possess the two fundamental properties of the mother information, namely the monotonicity and invariance under sufficient transformations. Thus the Fisher information number should not be used as a measure of information (except when Θ a location parameter). On the other hand, Fisher's information number, as a characteristic of a distribution f(x), has other interesting properties. As a byproduct of its superadditivity property a new coefficient of association is introduced.     

Some sufficient conditions for establishing (M,S)-optimality

Two sufficient conditions are given for an incomplete block design to be (M,S- optimal. For binary designs the conditions are (i) that the elements in each row, excluding the diagonal element, of the association matrix differ by at most one, and (ii) that the off-diagonal elements of the block characteristic matrix differ by at most one. It is also shown how the conditions can be utilized for nonbinary designs and that for blocks of size two the sufficient condition in terms of the association matrix can be attained.     

On the choice of transformations of the correlation coefficient with or without an outlier

Five transformations of the correlation coefficient, namely, Fisher's z, Nair's u, Sankaran's v, Ruben's y and Samiuddin's t are compared numerically using confidence intervals. Samiuddin's t_s transformation is close to the exact nominal confidence level for a small sample size ≤ 25 from a bivariate normal density. For a sample size > 25 both Samiuddin's t_s and Fisher's z can be used. In the presence of an outlier (on a minor axis), both Fisher's z and Samiuddin's t_s are not affected as long as |p| ≤ 0.3 but are seriously affected when |p&| > 0.3.     

On Hacking's fiducial theory of inference

Fisher's theory of fiducial inference is known to lead to mathematical inconsistencies. Hacking (1965) puts forward a new basis for fiducial inference. In this paper we have presented Hacking's theory retaining his original terminology but replacing his notation by more usual mathematical notation. His condition of irrelevance is derived in an explicit mathematical form, making it more comprehensible to statisticians. Further an example is constructed to show that Hacking's theory also leads to mathematical inconsistencies.     

Testing the homogeneity of several two‐parameter populations

The authors extend Fisher's method of combining two independent test statistics to test homogeneity of several two‐parameter populations. They explore two procedures combining asymptotically independent test statistics: the first pools two likelihood ratio statistics and the other, score test statistics. They then give specific results to test homogeneity of several normal, negative binomial or beta‐binomial populations. Their simulations provide evidence that in this context, Fisher's method performs generally well, even when the statistics to be combined are only asymptotically independent. They are led to recommend Fisher's test based on score statistics, since the latter have simple forms, are easy to calculate, and have uniformly good level properties.     

Test for the equality of several correlation coefficients

We derive two C(α) statistics and the likelihood-ratio statistic for testing the equality of several correlation coefficients, from k ≥ 2 independent random samples from bivariate normal populations. The asymptotic relationship of the C(α) tests, the likelihood-ratio test, and a statistic based on the normality assumption of Fisher's Z-transform of the sample correlation coefficient is established. A comparative performance study, in terms of size and power, is then conducted by Monte Carlo simulations. The likelihood-ratio statistic is often too liberal, and the statistic based on Fisher's Z-transform is conservative. The performance of the two C(α) statistics is identical. They maintain significance level well and have almost the same power as the other statistics when empirically calculated critical values of the same size are used. The C(α) statistic based on a noniterative estimate of the common correlation coefficient (based on Fisher's Z-transform) is recommended.     

A combined p-value test for multiple hypothesis testing

Tests that combine p-values, such as Fisher's product test, are popular to test the global null hypothesis H₀ that each of n component null hypotheses, H₁,…,H_n, is true versus the alternative that at least one of H₁,…,H_n is false, since they are more powerful than classical multiple tests such as the Bonferroni test and the Simes tests. Recent modifications of Fisher's product test, popular in the analysis of large scale genetic studies include the truncated product method (TPM) of Zaykin et al. (2002), the rank truncated product (RTP) test of Dudbridge and Koeleman (2003) and more recently, a permutation based test—the adaptive rank truncated product (ARTP) method of Yu et al. (2009). The TPM and RTP methods require users' specification of a truncation point. The ARTP method improves the performance of the RTP method by optimizing selection of the truncation point over a set of pre-specified candidate points. In this paper we extend the ARTP by proposing to use all the possible truncation points {1,…,n} as the candidate truncation points. Furthermore, we derive the theoretical probability distribution of the test statistic under the global null hypothesis H₀. Simulations are conducted to compare the performance of the proposed test with the Bonferroni test, the Simes test, the RTP test, and Fisher's product test. The simulation results show that the proposed test has higher power than the Bonferroni test and the Simes test, as well as the RTP method. It is also significantly more powerful than Fisher's product test when the number of truly false hypotheses is small relative to the total number of hypotheses, and has comparable power to Fisher's product test otherwise.     

Measuring diversity in biological populations with logarithmic abundance distributions

Fisher's logarithmic distribution for species abundance is derived under a suitable set of conditions. The derivation explains the explicit meaning of the two parameters of the distribution.     

On some tests for independence in nonnormal situations: neyman'S C(A)test

A study is made of Neyman's C(a) test for testing independence in nonnormal situations. It is shown that it performs very well both in terms of the level of significance and the powereven for smallvalues of the samplesize. Also, in the case of the bivariate Polsson distribution, itis shown that Fisher's z and Student's t transforms of the sample correlation coefficient are good competitors for Neyman's procedure.

     

Confidence Intervals on Sum of Variance Components in Unbalanced Two-Fold Nested Designs with Equal Subsampling

I hybrid significance test, which blends exact and asymptotic theory in a unique way, is presided as an alternative to Fisher's exact test for unordered rxc contingency tables. The hybrid test is almost equivlent to Fisher's exact test, but requires considerably less computational effort The accuracy of the hybrid p-value is not compromised by sparse contingency tables.     

A lower-bound oracle inequality for a blockwise-shrinkage estimate

Efromovich-Pinsker and Stein blockwise-shrinkage estimates are traditionally studied via upper-bound oracle inequalities, which bound the estimate's risk from above by the oracle's risk plus a remainder term. These bounds allow one to establish sufficient conditions for attaining the oracle's risk. To explore necessary conditions, this article develops a lower-bound oracle inequality, which bounds the estimate's risk from below by the oracle's risk minus a remainder term. In particular, the lower bound implies that thresholds must vanish for attaining the oracle's risk.     

Sampling theory for species abundances in certain biological populations

The sampling theory of Fisher's logarithmic distribution, discussed in Wani (1978), is extended to the class of power-series distributions.     

Unbiased asymptotically optimal estimates for the problem of the nile

We obtain a class of unbiased estimates with asymptotically minimal variance for a function of the parameter in Fisher's problem of the Nile.     

A New Approach for Testing Periodicity

This article describes testing for periodicity in the presence of FD processes. We propose two approaches for testing the periodicity based on Fisher's test. The first one is performed using the periodogram which has been divided into different parts. The second one is based on the discrete wavelet transform. Properties of the tests are illustrated by means of Monte Carlo simulations.     

Resolving the conflict over fisher's exact test

Fisher's exact test for two-by-two contingency tables has repeatedly been criticized as being too conservative. These criticisms arise most frequently in the context of a planned experiment for which the numbers of successes in each of two experimental groups are assumed to be binomially distributed. It is argued here that the binomial model is often unrealistic, and that the departures from the binomial assumptions reduce the conservatism in Fisher's exact test. Further discussion supports a recent claim of Barnard (1989) that the residual conservatism is attributable, not to any additional information used by the competing method, but to the discrete nature of the test, and can be drastically reduced through the use of Lancaster's mid-p-value. The binomial model is not recommended in that it depends on extra, questionable assumptions.     

Calculation Methods for Wallenius' Noncentral Hypergeometric Distribution

Two different probability distributions are both known in the literature as “the” noncentral hypergeometric distribution. Wallenius' noncentral hypergeometric distribution can be described by an urn model without replacement with bias. Fisher's noncentral hypergeometric distribution is the conditional distribution of independent binomial variates given their sum. No reliable calculation method for Wallenius' noncentral hypergeometric distribution has hitherto been described in the literature. Several new methods for calculating probabilities from Wallenius' noncentral hypergeometric distribution are derived. Range of applicability, numerical problems, and efficiency are discussed for each method. Approximations to the mean and variance are also discussed. This distribution has important applications in models of biased sampling and in models of evolutionary systems.     

Bayesian estimation and influence diagnostics of generalized partially linear mixed-effects models for longitudinal data

This paper develops a Bayesian approach to obtain the joint estimates of unknown parameters, nonparametric functions and random effects in generalized partially linear mixed models (GPLMMs), and presents three case deletion influence measures to identify influential observations based on the φ-divergence, Cook's posterior mean distance and Cook's posterior mode distance of parameters. Fisher's iterative scoring algorithm is developed to evaluate the posterior modes of parameters in GPLMMs. The first-order approximation to Cook's posterior mode distance is presented. The computationally feasible formulae for the φ-divergence diagnostic and Cook's posterior mean distance are given. Several simulation studies and an example are presented to illustrate our proposed methodologies.     

Sampling Methods for Wallenius' and Fisher's Noncentral Hypergeometric Distributions

Several methods for generating variates with univariate and multivariate Walleniu' and Fisher's noncentral hypergeometric distributions are developed. Methods for the univariate distributions include: simulation of urn experiments, inversion by binary search, inversion by chop-down search from the mode, ratio-of-uniforms rejection method, and rejection by sampling in the τ domain. Methods for the multivariate distributions include: simulation of urn experiments, conditional method, Gibbs sampling, and Metropolis-Hastings sampling. These methods are useful for Monte Carlo simulation of models of biased sampling and models of evolution and for calculating moments and quantiles of the distributions.     

Error-rate estimation in two-group discriminant analysis using the linear discriminant function

Fisher's linear discriminant function, adapted by Anderson for allocating new observations into one of two existing groups, is considered in this paper. Methods of estimating the misclassification error rates are reviewed and evaluated by Monte Carlo simulations. The investigation is carried out under both ideal (Multivariate Normal data) and non-ideal (Multivariate Binary data) conditions. The assessment is based on the usual mean square error (MSE) criterion and also on a new criterion of optimism. The results show that although there is a common cluster of good estimators for both ideal and non-ideal conditions, the single best estimators vary with respect to the different criteria