TESTING THE EQUALITY OF PARAMETERS IN THE DISTRIBUTIONS WHEN THE RANGE DEPENDS UPON THE PARAMETER

The authors derive the null and non-null distributions of the test statistic v=y_min/y_max (where y_min= min x_ij, y_max= max x_ij, J=1,2, …, k) connected with testing the equality of scale parameters θ₁, θ₂, …θ_k in certain, class of density functions given by      

Box-Cox transformed linear models: A parameter-based asymptotic approach

A Box-Cox transformed linear model usually has the form y(λ) = μ + β₁x₁ +… + β_px_p + oe, where y(λ) is the power transform of y. Although widely used in practice, the Fisher information matrix for the unknown parameters and, in particular, its inverse have not been studied seriously in the literature. We obtain those two important matrices to put the Box-Cox transformed linear model on a firmer ground. The question of how to make inference on β = (β₁,…,β_p)^T when λ; is estimated from the data is then discussed for large but finite sample size by studying some parameter-based asymptotics. Both unconditional and conditional inference are studied from the frequentist point of view.     

Sequential experimental design and response optimisation

We consider the situation where one wants to maximise a functionf(θ,x) with respect tox, with θ unknown and estimated from observationsy _k . This may correspond to the case of a regression model, where one observesy _k =f(θ,x _k )+ε _k , with ε _k some random error, or to the Bernoulli case wherey _k ∈{0, 1}, with Pr[y _k =1|θ,x _k |=f(θ,x _k ). Special attention is given to sequences given by , with an estimated value of θ obtained from (x₁, y₁),...,(x _k ,y _k ) andd _k (x) a penalty for poor estimation. Approximately optimal rules are suggested in the linear regression case with a finite horizon, where one wants to maximize ∑ _i=1 ^N w _i f(θ, x _i ) with {w _i } a weighting sequence. Various examples are presented, with a comparison with a Polya urn design and an up-and-down method for a binary response problem.     

Integral Identities for Random Variables

Using a general method for deriving identities for random variables, we find a number of new results involving characteristic functions and generating functions. The method is simply to promote a parameter in an integral relation to the status of a random variable and then take expected values of both sides of the equation. Results include formulas for calculating the characteristic functions for x ², √x, 1/x, x ² + x, R ² = x ² + y ², and so forth in terms of integral transforms of the characteristic functions for x and (x, y), and so forth. Generalizations to higher dimensions can be obtained using the same method. Expressions for inverse/fractional moments, E{n!}, and so forth are also presented, demonstrating the method.     

SOME ASYMPTOTIC PROPERTIES OF THE SIMPLE LOGLINEAR MODEL

Consistency and asymptotic normality of the maximum likelihood estimator of β in the loglinear model E(y_i) = e^α+βXi, where y_i are independent Poisson observations, 1 iaan, are proved under conditions which are near necessary and sufficient. The asymptotic distribution of the deviance test for β=β₀ is shown to be chi-squared with 1 degree of freedom under the same conditions, and a second order correction to the deviance is derived. The exponential model for censored survival data is also treated by the same methods.     

Testing equality of variances after a preliminary test of significance for correlation coefficient

On the basis of the outcome of a preliminary test of significance for the population correlation coefficient it is decided as to whether the variance ratio or the sample correlation coefficient between u=(x+y)/2 and v=x?y)/2 is to be used as a test statistic for testing the equality of variances. A method for determining the critical points for the preliminary test and the main test has been suggested. The power of the test procedure is compared with those of standard tests.     

A measure of general functional dependence between two continuous variables

Existing measures in the literature that are specifically concerned with testing and measuring independence between two continuous variables are all based on examining the definition of independence, i.e., F_XY(x, y) = F_X(x)F_Y(y). A new measure is constructed uniquely in this paper that uses the absolute value of first difference on adjacent ranks of one variable with respect to the other. This measure captures the degree of functional dependence attributable to the amount of randomness and the complexity of the underlying bivariate dependence structure in a commensurate way that existing coefficients are incapable of. As a test statistic of independence, this measure is shown to have comparable or better power than existing statistics against a wide range of alternative hypotheses that consist of functional and multivalued relational dependence with additive noise.     

Tests for detecting overdispersion in poisson models

Collings and Margolin(1985) developed a locally most powerful unbiased test for detecting negative binomial departures from a Poisson model, when the variance is a quadratic function of the mean. Kim and Park(1992) developed a locally most powerful unbiased test, when the variance is a linear function of the mean. It is found that a different mean-variance structure of a negative binomial derives a different locally optimal test statistic.

In this paper Collings and Margolin's and Kim and Park's results are unified and extended by developing a test for overdispersion in Poisson model against Katz family of distributions, Our setup has two extensions: First, Katz family of distributions is employed as an extension of the negative binomial distribution. Second, the mean-variance structure of the mixed Poisson model is given by σ² = μ+cμ^r for arbitrary but fixed r. We derive a local score test for testing H₀ : c = 0. Superiority of a new test is proved by the asymtotic relative efficiency as well as the simulation study.     

Bounds on Bivariate Distribution Functions with Given Margins and Known Values at Several Points

Let H(x, y) be a continuous bivariate distribution function with known marginal distribution functions F(x) and G(y). Suppose the values of H are given at several points, H(x _i , y _i ) = θ _i , i = 1, 2,…, n. We first discuss conditions for the existence of a distribution satisfying these conditions, and present a procedure for checking if such a distribution exists. We then consider finding lower and upper bounds for such distributions. These bounds may be used to establish bounds on the values of Spearman's ρ and Kendall's τ. For n = 2, we present necessary and sufficient conditions for existence of such a distribution function and derive best-possible upper and lower bounds for H(x, y). As shown by a counter-example, these bounds need not be proper distribution functions, and we find conditions for these bounds to be (proper) distribution functions. We also present some results for the general case, where the values of H(x, y) are known at more than two points. In view of the simplification in notation, our results are presented in terms of copulas, but they may easily be expressed in terms of distribution functions.     

A characterization of invariant power-series abundance distributions

Consider a population the individuals in which can be classified into groups. Let y, the number of individuals in a group, be distributed according to a probability function f(y;ø_o) where the functional form f is known. The random variable y cannot be observed directly, and hence a random sample of groups cannot be obtained. Consider a random sample of N individuals from the population. Suppose the N individuals are distributed into S groups with x₁, x₂, …, x_S representatives respectively. The random variable x, the number of individuals in a group in the sample, will be a fraction of its population counterpart y, and the distributions of x and y need not have the same functional form. If the two random variables x and y have the same functional form for their distributions, then the particular common distribution is called an invariant abundance distribution. The paper provides a characterization of invariant abundance distributions in the class of power-series distributions.     

Cross-correlation between simultaneously generated sequences of pseudo-random uniform deviates

Systematic patterns are revealed when sequences of pseudo-random uniform deviates are generated from multiplicative congruential generators. If the initial seeds, x ₀ and y ₀, for two such sequences are related by y ₀ = (n ₁/n ₂)x ₀, where n ₁ and n ₂ are relatively prime, positive integers, then an approximate argument suggests that the asymptotic correlation coefficient between corresponding members of the two sequences is (n ₁ n ₂)^–1. This unsettling phenomenon is discussed in the context of related, existing literature.     

The Uniform Asymptotics of the Overshoot of a Random Walk with Light-Tailed Increments

Let {S _n : n ≥ 0} be a random walk with light-tailed increments and negative drift, and let τ(x) be the first time when the random walk crosses a given level x ≥ 0. Tang (2007 Tang , Q. ( 2007 ). The overshoot of a random walk with negative drift . Statist. Probab. Lett. 77 : 158 – 165 .[Crossref], [Web of Science ®] , [Google Scholar]) obtained the asymptotics of P(S _τ(x) ? x > y, τ(x) < ∞) as x → ∞, which is uniform for y ≥ f(x) for any positive function f(x) → ∞ as x → ∞. In this article, the uniform asymptotics of P(S _τ(x) ? x > y, τ(x) < ∞) as x → ∞, for 0 ≤ y ≤ N for any positive number N will be given. Using the above two results, the uniform asymptotics of P(S _τ(x) ? x > y, τ(x) < ∞) as x → ∞, for y ≥ 0, is presented.     

D-Optimal Axial Designs for Quadratic and Cubic Additive Mixture Models

The paper discusses D-optimal axial designs for the additive quadratic and cubic mixture models σ_1≤i≤q(β_ix_i + β_iix²_i) and σ_1≤i≤q(β_ix_i + β_iix²_i + β_iiix³_i), where x_i≥ 0, x₁ + . . . + x_q = 1. For the quadratic model, a saturated symmetric axial design is used, in which support points are of the form (x₁, . . . , x_q) = [1 ? (q?1)δ_i, δ_i, . . . , δ_i], where i = 1, 2 and 0 ≤δ₂ <_{δ1 ≤} 1/(q ?1). It is proved that when 3 ≤q≤ 6, the above design is D-optimal if δ₂ = 0 and δ₁ = 1/(q?1), and when q≥ 7 it is D-optimal if δ₂ = 0 and δ₁ = [5q?1 ? (9q²?10q + 1)^1/2]/(4q²). Similar results exist for the cubic model, with support points of the form (x₁, . . . , x_q) = [1 ? (q?1)δ_i, δ_i, . . . , δ_i], where i = 1, 2, 3 and 0 = δ₃ <_δ2 < δ_{1 ≤}1/(q?1). The saturated D-optimal axial design and D-optimal design for the quadratic model are compared in terms of their efficiency and uniformity.     

Recursive characterization of a large family of discrete probability distributions showing extra-Poisson variation

This article analyses the broad family of discrete probability distributions generated by relating Prob (y) to Prob (y?1), …, Prob (y?n), for some n≥1, through a recursive equation. This family contains the binomial, negative binomial and Poisson distributions as well as the Katz family of distributions. In addition, the suggested family contains some convolutions of Poisson distributions and other generalized distributions, which provide models for Poisson overdispersion or underdispersion.     

On concurrence of several linear regressions and applications to problems of enzyme kinetics

In comparing several regressions E(y_ij) =α_i + β_ix_ij i = 1, 2, ..., k, j = 1,2, ..., n_i, researchers are generally interested in the following five problems: whether they have (1) equal slope, (2) equal intercept, (3) coincidence, (4) common intersection on X-axis, and (5) common intersection on (X,Y) - plane. Problems (1) - (3) can be put into the framework of the general linear hypothesis and the F-test can be used. However, problems (4) and (5) cannot be put into the general linear hypothesis because they are ratios of parameters. Hence, in this paper we consider the generalized likelihood ratio test for hypothesis testing. An application to an enzyme kinetics problem in Aniline Metabolism is demonstrated     

Cramér-von Mises tests of fit for the Poisson distribution

Goodness-of-fit tests based on the Cramér-von Mises statistics are given for the Poisson distribution. Power comparisons show that these statistics, particularly A², give good overall tests of fit. The statistic A² will be particularly useful for detecting distributions where the variance is close to the mean, but which are not Poisson.     

Confidence Intervals for Nonparametric Regression Functions with Missing Data

Suppose that we have a nonparametric regression model Y = m(X) + ε with X ∈ R^p, where X is a random design variable and is observed completely, and Y is the response variable and some Y-values are missing at random. Based on the “complete” data sets for Y after nonaprametric regression imputation and inverse probability weighted imputation, two estimators of the regression function m(x₀) for fixed x₀ ∈ R^p are proposed. Asymptotic normality of two estimators is established, which is used to construct normal approximation-based confidence intervals for m(x₀). We also construct an empirical likelihood (EL) statistic for m(x₀) with limiting distribution of χ²₁, which is used to construct an EL confidence interval for m(x₀).     

A class of tests for testing ‘new is better than used’

A class of tests is proposed for testing H₀ F?(x) = e^?λx, λ > 0, x≥0 vs. H₁ F?(x + y) ≤ F?(x)F?(y), x, y≥0, with strict inequality for some x, y ≥ 0 (F = new is better than used). Efficiency comparisons of some tests within the class are made and a new test is proposed on the basis of these comparisons. Consistency and the asymptotic normality of the class of tests is proved under fairly broad conditions on the underlying entities.     

Modeling with Mixtures of Linear Regressions

Consider data (x ₁,y ₁),...,(x _n,y _n), where each x _i may be vector valued, and the distribution of y _i given x _i is a mixture of linear regressions. This provides a generalization of mixture models which do not include covariates in the mixture formulation. This mixture of linear regressions formulation has appeared in the computer science literature under the name Hierarchical Mixtures of Experts model.This model has been considered from both frequentist and Bayesian viewpoints. We focus on the Bayesian formulation. Previously, estimation of the mixture of linear regression model has been done through straightforward Gibbs sampling with latent variables. This paper contributes to this field in three major areas. First, we provide a theoretical underpinning to the Bayesian implementation by demonstrating consistency of the posterior distribution. This demonstration is done by extending results in Barron, Schervish and Wasserman (Annals of Statistics 27: 536–561, 1999) on bracketing entropy to the regression setting. Second, we demonstrate through examples that straightforward Gibbs sampling may fail to effectively explore the posterior distribution and provide alternative algorithms that are more accurate. Third, we demonstrate the usefulness of the mixture of linear regressions framework in Bayesian robust regression. The methods described in the paper are applied to two examples.