Testing for and against a set of linear inequality constraints in a multinomial setting

There are numerous situations in categorical data analysis where one wishes to test hypotheses involving a set of linear inequality constraints placed upon the cell probabilities. For example, it may be of interest to test for symmetry in k × k contingency tables against one-sided alternatives. In this case, the null hypothesis imposes a set of linear equalities on the cell probabilities (namely p_ij = P_ji ×i > j), whereas the alternative specifies directional inequalities. Another important application (Robertson, Wright, and Dykstra 1988) is testing for or against stochastic ordering between the marginals of a k × k contingency table when the variables are ordinal and independence holds. Here we extend existing likelihood-ratio results to cover more general situations. To be specific, we consider testing H_t,0 against H₁ - H₀ and H₁ against H₂ - H ₁ when H₀:k × i=1 p_ix_ji = 0, j = 1,…, s, H₁:k × i=1 p_ix_ji × 0, j = 1,…, s, and does not impose any restrictions on p. The x_ji's are known constants, and s × k - 1. We show that the asymptotic distributions of the likelihood-ratio tests are of chi-bar-square type, and provide expressions for the weighting values.     

Locally best invariant and locally minimax test of independence

Let X₁ X₂ … X_N be independent normal p-vectors with common mean vector $$ = ($$) and common nonsingular covariance matrix $$ = Diag ($sG_i) [(1–p) I + pE] Diag ($sG_i), $sG_i> 0, i = 1… p, 1>p>=1/p–1. Write r_ij = sample correlation between the i th and the j th variable i j = 1,… p. It has been proved that for testing the hypothesis H₀ : p = 0 against the alternative H₁ : p>0 where $$ and $sG₁,…, $sG_p are unknown, the test which rejects H₀ for large value of $$ r_ij is locally best invariant for every $aL: 0 > $aL > 1 and locally minimax as p $$ 0 in the sense of Giri and Kiefer, 1964, for every $aL: 0 > $aL $$ $aL₀ > 1 where$aL₀ = P_p=0 $$.     

ON TRANSITION PROBABILITIES OF SKIP-FREE MARKOV CHAINS

Consider an ergodic Markov chain X(t) in continuous time with an infinitesimal matrix Q = (q_ij) defined on a finite state space {0, 1,…, N}. In this note, we prove that if X(t) is skip-free positive (negative, respectively), i.e., q_ij, = 0 for j > i+ 1 (i > j+ 1), then the transition probability p_ij(t) = Pr[X(t)=j | X(0) =i] can be represented as a linear combination of p_0N(t) (p^(m)_(N0)(t)), 0 ≤ m ≤N, where f^(m)(t) denotes the mth derivative of a function f(t) with f⁽⁰⁾(t) =f(t). If X(t) is a birth-death process, then p_ij(t) is represented as a linear combination of p_0N^(m)(t), 0 ≤m≤N - |i-j|.     

Subset selection based on likelihood from uniform and related popupulations

Let π_i (i=1,2,…, k) be charceterized by the uniform distribution on (a_i;b_i), where exactly one of a_i and b_i is unknown. With unequal sample sizes, suppose that from the k (>=2) given populations, we wish to select a random-size subset containing the one with the smllest value of θ_i= b_i - a_i. RuleR_i selects π if a likelihood-based k-dimensional confidence region for the unknown (θ₁,… θ_k) contains at least one point having θ_i as its smallest component. A second rule, R , is derived through a likelihood ratio and turns out to be that of Barr and prabhu whenthe sample sizes are equal. Numerical comparisons are made. The results apply to the larger class of densities g ( z ; θ_i) =M(z)Q(θ_i) if a(θ_i) < z <b(θ_i). Extensions to the cases when both a_i and b_i are unknown and when θ_j isof interest are indicated. 1<=j<=k     

Approximate confidence bounds for ratios of variance components in two-way unbalanced crossed models with interactions

Consider the general unbalanced two-factor crossed components-of-variance model with interaction given by Y_ijk: = μ+A_i: +B_j: + C_ij: +E_ijk: (i = 1,2, … a; j = 1,…,b; k = 1,…,.n_ij:=0) A_i:,B_j:, C_ij: and E_ijk: are independent unobservable random variables. Also A_i:sim; N(0,σ² _A),B_j: ～ N(0,σ² _B), C_ij:～N(0,s² _C:) and E_ijk:～N(0,s² _E:). In this paper approximate confidence bounds are obtained for ρ_A: = ρ² _A/² and ρ_B: = ρ² _B:/ρ² (where σ² = σ² _A:+ σ² _B+σ² _Cσ² _E) for special cases of the above model. The balanced incomplete block model is studied as a special case.     

Improved estimators for the selected location parameters

_i , i = 1, 2, ..., k be k independent exponential populations with different unknown location parameters θ _i , i = 1, 2, ..., k and common known scale parameter σ. Let Y _i denote the smallest observation based on a random sample of size n from the i-th population. Suppose a subset of the given k population is selected using the subset selection procedure according to which the population π _i is selected iff Y _i ≥Y ₍₁₎−d, where Y ₍₁₎ is the largest of the Y _i 's and d is some suitable constant. The estimation of the location parameters associated with the selected populations is considered for the squared error loss. It is observed that the natural estimator dominates the unbiased estimator. It is also shown that the natural estimator itself is inadmissible and a class of improved estimators that dominate the natural estimator is obtained. The improved estimators are consistent and their risks are shown to be O(kn ⁻²). As a special case, we obtain the coresponding results for the estimation of θ₍₁₎, the parameter associated with Y ₍₁₎. Received: January 6, 1998; revised version: July 11, 2000     

A modified cluster sampling method for estimating the bacterial density in Xanthan gum

Suppose particles are randomly distributed in a certain medium, powder or liquid, which is conceptually divided into N cells. Let p_i denote the probability that a particle falls in the ith cell and Y_i denote the number of particles in the ith cell. Assume that the joint probability function of the Y_i follows a multinomial distribution with cell probabilities p_i respectively. Take n (≤N) cells at random without replacement and put each of the cells separately through a mixing mechanism of dilution and swirl. These n cells constitute the first stage samples and the number of particles in these cells are not observable. Now conceptually divide each of n cells into M subcells of equal size and let X_ij denote the number of particles in the jth subcell of the ith cell selected in the first stage; i=1,2,…,N and j=1,2,…,M. Consequently assume that the conditional joint probability function of the X_ij given Y_i=y_i follows a multinomial distribution with equal cell probabilities. Now take m (≤M) subcells at random from each of the cells selected in the first stage sample. Assume that the numbers of particles in M×N subcells are observable. The properties of the estimator of the particle density per sample unit are investigated under the modified two-stage cluster sampling method. A laboratory experiment for Xanthan Gum Products is analyzed in order to examine the appropriateness of the model assumed in this paper.     

Estimation bayesienne des effets dans le modele a effets aleatoires de classification double avec interaction

The problem of estimating the effects in a balanced two-way classification with interaction \documentclass{article}\pagestyle{empty}\begin{document}$i = 1, \ldots ,I;j = 1, \ldots ,J;k = 1, \ldots ,K$\end{document} using a random effect model is considered from a Bayesian view point. Posterior distributions of r_i, c_j and t_ij are obtained under the assumptions that r_i, c_j, t_ij and e_ijk are all independently drawn from normal distributions with zero meansand variances \documentclass{article}\pagestyle{empty}\begin{document}$\sigma _r^2 ,\sigma _c^2 ,\sigma _t^2 ,\sigma _e^2$\end{document} respectively. A non informative reference prior is adopted for \documentclass{article}\pagestyle{empty}\begin{document}$\mu ,\sigma _r^2 ,\sigma _c^2 ,\sigma _t^2 ,\sigma _e^2$\end{document}. Various features of thisposterior distribution are obtained. The same features of the psoterior distribution for a fixed effect model are also obtained. A numerical example is given.     

Efficient sequential estimation in a markov branching process with immigration

Sequential estimation of parameters In a continuous time Markov branching process with Immigration with split rate λ₁ Immigration rate λ₂, offspring distribution {p₁j≥O) and Immigration distribution {p₂j≥l} is considered. A sequential version of the Cramér-Rao type information inequality is derived which gives a lower bound on the variances of unbiased estimators for any function of these parameters. Attaining the lower bounds depends on whether the sampling plan or stopping rule S, the estimator f, and the parametric function g = E(f) are efficient. All efficient triples (S,f,g) are characterized; It Is shown that for i = 1,2, only linear combinations of λ_ip_{ij j}'s or their ratios are efficiently estimable. Applications to a Yule process, a linear birth and death process with immigration and an M/M/∞ queue are also considered     

Bootstrap test of goodness of fit to a linear model when errors are correlated

Given the regression model Y_i = m(x_i) +ε_i (x_i ε C, i = l,…,n, C a compact set in R) where m is unknown and the random errors {ε_i} present an ARMA structure, we design a bootstrap method for testing the hypothesis that the regression function follows a general linear model: H_o : m ε {mθ(.) = A^t(.)θ : θ ε ? ? R^q} with A a functional from R to R^q. The criterion of the test derives from a Cramer-von-Mises type functional distance D = d²([mcirc]_n, A^t(.)θ_n), between [mcirc]_n, a Gasser-Miiller non-parametric estimator of m, and the member of the class defined in H_o that is closest to m_n in terms of this distance. The consistency of the bootstrap distribution of D and θ_n is obtained under general conditions. Finally, simulations show the good behavior of the bootstrap approximation with respect to the asymptotic distribution of D = d².     

Score tests in the two - way layout of counts

For the balanced two-way layout of a count response variable Y classified by fixed or random factors A and B, we address the problems of (i) testing for individual and interactive effects on Y of two fixed factors, and (ii) testing for the effect of a fixed factor in the presence of a random factor and conversely. In case (i), we assume independent Poisson responses with µ_ij= E(Y| A=i,B=j) = α_iβ_jγ_ij corresponding respectively to the multiplicative

interactive and non-interactive cases. For case (ii) with factor A random, we derive a multivariate gamma-Poisson model by mixing on the random variable associated with each level of A. In each case Neyman C(α) score tests are derived. We present simulation results,and apply the interaction test to a data set, to evaluate and compare the size and power of the score test for interaction between two fixed factors, the competing Poisson-based likelihood ratio test, and the F-tests based on the assumptions that √Y+1 or log(Y+1) are approximately normal. Our results provide strong evidence that the normal-theory based F-tests typically are very far from nominal size, and that the likelihood ratio test is somewhat more liberal than the score test.     

Linear representation of M-estimates in linear models

Consider the linear regression model, y_i = x_iβ₀ + e_i, i = l,…,n, and an M-estimate β of β_o obtained by minimizing Σρ(y_i — x_iβ), where ρ is a convex function. Let S_n = ΣX_iX_iX_i and r_n = S_n^½ (β — β₀) — S_n ² Σx_ih(e_i), where, with a suitable choice of h(.), the expression Σ x_ix(e,) provides a linear representation of β. Bahadur (1966) obtained the order of r_n as n→ ∞ when β_o is a one-dimensional location parameter representing the median, and Babu (1989) proved a similar result for the general regression parameter estimated by the LAD (least absolute deviations) method. We obtain the stochastic order of r_n as n → ∞ for a general M-estimate as defined above, which agrees with the results of Bahadur and Babu in the special cases considered by them.     

Csiszar’s ϕ-divergences for testing the order in a Markov chain

x ₁, ..., x _n+r can be treated as the sample values of a Markov chain of order r or less (chain in which the dependence extends over r+1 consecutive variables only), and consider the problem of testing the hypothesis H ₀ that a chain of order r− 1 will be sufficient on the basis of the tools given by the Statistical Information Theory: _ϕ-Divergences. More precisely, if p _{a 1 ....., a r}: _{a r +1} denotes the transition probability for a r ^th order Markov chain, the hypothesis to be tested is H ₀:p _{a 1 ....., a r}: _{a r +1} = p _{a 2 ....., a r}: _{a r +1}, a _i ∈{1, ..., s}, i = 1, ..., r + 1 The tests given in this paper, for the first time, will have as a particular case the likelihood ratio test and the test based on the chi-squared statistic. Received: August 3, 1998; revised version: November 25, 1999     

On the bounded regret of empirical bayes estimators

Let (θ₁,x₁),…,(θ_n,x_n) be independent and identically distributed random vectors with E(xθ) = θ and Var(x|θ) = a + bθ + cθ². Let t_i be the linear Bayes estimator of θ_i and θ~_i be the linear empirical Bayes estimator of θ_i as proposed in Robbins (1983). When Ex and Var x are unknown to the statistician. The regret of using θ~_i instead of t_i because of ignorance of the mean and the variance is r_i = E(θ_i ? θ_i)² ?E(t_i ?θ_i)². Under appropriate conditions cumulative regret R_n = r₁+…r_n is shown to have a finite limit even when n tends to infinity. The limit can be explicitly computed in terms of a,b,c and the first four moments of x.     

Estimating parameters of a selected Pareto population

Let Π₁,…,Π_k be k populations with Π_i being Pareto with unknown scale parameter α_i and known shape parameter β_i;i=1,…,k. Suppose independent random samples (X_i1,…,X_in), i=1,…,k of equal size are drawn from each of k populations and let X_i denote the smallest observation of the ith sample. The population corresponding to the largest X_i is selected. We consider the problem of estimating the scale parameter of the selected population and obtain the uniformly minimum variance unbiased estimator (UMVUE) when the shape parameters are assumed to be equal. An admissible class of linear estimators is derived. Further, a general inadmissibility result for the scale equivariant estimators is proved.     

TESTING THE EQUALITY OF PARAMETERS IN THE DISTRIBUTIONS WHEN THE RANGE DEPENDS UPON THE PARAMETER

The authors derive the null and non-null distributions of the test statistic v=y_min/y_max (where y_min= min x_ij, y_max= max x_ij, J=1,2, …, k) connected with testing the equality of scale parameters θ₁, θ₂, …θ_k in certain, class of density functions given by      

On the construction of hypercubic design

Hypercubic design was introduced by Shah (1958) and Kusumoto(1965) in which the t=v^m treatments are represented by n-plets (x₁, x₂, ..., x_m),where 1≤ x₁, x₂, ..., x_m ≤v, and two treatments are said to be i-th associates if they differ in exactly i components. This paper deals with the construction of some hypercubic designs and gives their application to confounding plans for symmetrical factorial experiments. The proposed methods prove to be quite flexible in terms of choice of possible block sizes and are easy to use.     

Extreme probabilities for contingency tables under row and column independence with application to fisher's exact test

Theorerms are proved for the maxima and minima of IIR_i!/IIC_j!/T!II_yij ! over r× c contingcncy tables Y=(y_ij) with row sums R₁,…,R_r, column sums C₁,…,C_c, and grand total T. These results are imlplemented into the network algorithm of Mehta and Patel (1983) for computing the P-value of Fisher's exact test for unordered r×c contingency tables. The decrease in the amount of computing time can be substantial when the column sums are very different.     

Estimation and comparison of lognormal parameters in the presence of censored data

It is assumed that k(k?>?2) independent samples of sizes n _i (i?=?1, …, k) are available from k lognormal distributions. Four hypothesis cases (H ₁ – H ₄) are defined. Under H ₁, all k median parameters as well as all k skewness parameters are equal; under H ₂, all k skewness parameters are equal but not all k median parameters are equal; under H ₃, all k median parameters are equal but not all k skewness parameters are equal; under H ₄, neither the k median parameters nor the k skewness parameters are equal. The Expectation Maximization (EM) algorithm is used to obtain the maximum likelihood (ML) estimates of the lognormal parameters in each of these four hypothesis cases. A (2k???1) degree polynomial is solved at each step of the EM algorithm for the H ₃ case. A two-stage procedure for testing the equality of the medians either under skewness homogeneity or under skewness heterogeneity is also proposed and discussed. A simulation study was performed for the case k?=?3.