Invariant methods for estimating variance components in mixed linear models 2

The subject of this contribution is to present a survey on new methods for variance component estimation, which appeared in the literature in recent years. Starting from mixed models treated in analysis of variance research work on this field turned over to a more general approach in which the covariance matrix of the vector of observations is assumed to be a unknown linear combination of known symmetric matrices. Much interest has been shown in developing some kinds op optimal estimators for the unknown parameters and most results were obtained for estimators being invariant with respect to a certain group of translations. Therefore we restrict attention to this class of estimates. We will deal with minimum variance unbiased estimators, least squared errors estimators, maximum likelihood estimators. Bayes quadratic estimators and show some relations to the mimimum norm quadratic unbiased estimation principle (MINQUE) introduced by C. R. Rao [20]. We do not mention the original motivation of MINQUE since the otion of minimum norm depends on a measure that is not accepted by all statisticians. Also we do‘nt deal with other approaches like the BAYEsian and fiducial methods which were successfully applied by S. Portnoy [18], P. Rusolph [22], G. C. Tiao, W. Y. Tan [28], M. J. K. Healy [9] and others, although in very special situations, only. Additionally we add some new results and also new insight in the properties of known estimators. We give a new characterization of MINQUE in the class of all estimators, extend explicite expressions for locally optimal quadratic estimators given by C. R. Rao [22] to a slightly more general situation and prove complete class theorems useful for the computation of BAYES quadratic estimators. We also investigate situations in which BAYES quadratic unbiased estimators do'nt change if the distribution of the error terms differ from the normal distribution.     

Rényi statistics for testing hypotheses in mixed linear regression models

Rényi divergences are used to propose some statistics for testing general hypotheses in mixed linear regression models. The asymptotic distribution of these tests statistics, of the Kullback–Leibler and of the likelihood ratio statistics are provided, assuming that the sample size and the number of levels of the random factors tend to infinity. A simulation study is carried out to analyze and compare the behavior of the proposed tests when the sample size and number of levels are small.     

IG-symmetry and R-symmetry: Interrelations and applications to the inverse Gaussian theory

The two parameter inverse Gaussian (IG) distribution is often more appropriate and convenient for modelling and analysis of nonnegative right skewed data than the better known and now ubiquitous Gaussian distribution. Its convenience stems from its analytic simplicity and the striking similarities of its methodologies with those employed with the normal theory models. These, known as the G–IG analogies, include the concepts and measures of IG-symmetry, IG-skewness and IG-kurtosis, the IG-analogues of the corresponding classical notions and measures. The new IG-associated entities, although well defined and mathematically transparent, are intuitively and conceptually opaque. In this paper, we first elaborate the importance of the IG distribution and of the G–IG analogies. Then we consider the IG-related root-reciprocal IG (RRIG) distribution and introduce a physically transparent, conceptually clear notion of reciprocal symmetry (R-symmetry) and use it to explain the IG-symmetry. We study the moments and mixture properties of the R-symmetric distributions and the relationship of R-symmetry with IG-symmetry and note that RRIG distribution provides a link, in addition to Tweedie's Laplace transform link, between the Gaussian and inverse Gaussian distributions. We also give a structural characterization of the unimodal R-symmetric distributions. This work further expands the long list of G–IG analogies. Several applications including product convolution, monotonicity of power functions, peakedness and monotone limit theorems of R-symmetry are outlined.     

Ordered ranked set samples and applications to inference

Ranked set sampling (RSS) was first proposed by McIntyre [1952. A method for unbiased selective sampling, using ranked sets. Australian J. Agricultural Res. 3, 385–390] as an effective way to estimate the unknown population mean. Chuiv and Sinha [1998. On some aspects of ranked set sampling in parametric estimation. In: Balakrishnan, N., Rao, C.R. (Eds.), Handbook of Statistics, vol. 17. Elsevier, Amsterdam, pp. 337–377] and Chen et al. [2004. Ranked Set Sampling—Theory and Application. Lecture Notes in Statistics, vol. 176. Springer, New York] have provided excellent surveys of RSS and various inferential results based on RSS. In this paper, we use the idea of order statistics from independent and non-identically distributed (INID) random variables to propose ordered ranked set sampling (ORSS) and then develop optimal linear inference based on ORSS. We determine the best linear unbiased estimators based on ORSS (BLUE-ORSS) and show that they are more efficient than BLUE-RSS for the two-parameter exponential, normal and logistic distributions. Although this is not the case for the one-parameter exponential distribution, the relative efficiency of the BLUE-ORSS (to BLUE-RSS) is very close to 1. Furthermore, we compare both BLUE-ORSS and BLUE-RSS with the BLUE based on order statistics from a simple random sample (BLUE-OS). We show that BLUE-ORSS is uniformly better than BLUE-OS, while BLUE-RSS is not as efficient as BLUE-OS for small sample sizes (n<5$n<5$).     

Characterization of the geometric distribution using properties of order statistics

Using certain properties of order statistics, the geometric distribution has been characterized when the components are independent and identically distributed. When the components are independent, the geometric distribution has been characterized in the class of either IFR or DFR discrete distributions. In particular, Ferguson's (1967) characterization theorem for independent components in a sample of size two has been extended in several directions.     

Representations of moments using lower-order conditional moments

Moments and central moments of a random variable X   are expressed as integrals of functions of lower-order conditional moments and the cumulative distribution of X$X$. In particular, sample central moments of order 2k$2k$ are expressed as the sum of between groups variations, providing an analogue to the analysis of variance. Similar expressions are obtained for the expectations of real-valued and measurable functions of X$X$.     

Large sample interval mapping method for genetic trait loci in finite regression mixture models

This article investigates the large sample interval mapping method for genetic trait loci (GTL) in a finite non-linear regression mixture model. The general model includes most commonly used kernel functions, such as exponential family mixture, logistic regression mixture and generalized linear mixture models, as special cases. The populations derived from either the backcross or intercross design are considered. In particular, unlike all existing results in the literature in the finite mixture models, the large sample results presented in this paper do not require the boundness condition on the parametric space. Therefore, the large sample theory presented in this article possesses general applicability to the interval mapping method of GTL in genetic research. The limiting null distribution of the likelihood ratio test statistics can be utilized easily to determine the threshold values or p-values required in the interval mapping. The limiting distribution is proved to be free of the parameter values of null model and free of the choice of a kernel function. Extension to the multiple marker interval GTL detection is also discussed. Simulation study results show favorable performance of the asymptotic procedure when sample sizes are moderate.     

Characterizations of distributions through coincidences of semiparametric families

Semiparametric families are families that have both a real parameter and a parameter that is itself a distribution. A number of semiparametric families suitable for lifetime data are introduced: scale, power, frailty (proportional hazards), age, moment, Laplace transform, and convolution parameter families. The coincidence of two families provides a characterization of the underlying distribution. Characterizations of the Weibull, gamma, lognormal, and Gompertz distributions are obtained.     

Generalized exponential distribution: Existing results and some recent developments

Mudholkar and Srivastava [1993. Exponentiated Weibull family for analyzing bathtub failure data. IEEE Trans. Reliability 42, 299–302] introduced three-parameter exponentiated Weibull distribution. Two-parameter exponentiated exponential or generalized exponential distribution is a particular member of the exponentiated Weibull distribution. Generalized exponential distribution has a right skewed unimodal density function and monotone hazard function similar to the density functions and hazard functions of the gamma and Weibull distributions. It is observed that it can be used quite effectively to analyze lifetime data in place of gamma, Weibull and log-normal distributions. The genesis of this model, several properties, different estimation procedures and their properties, estimation of the stress-strength parameter, closeness of this distribution to some of the well-known distribution functions are discussed in this article.     

Multivariate inverse Gaussian distribution as a limit of multivariate waiting time distributions

Multivariate inverse Gaussian distribution proposed by Minami [2003. A multivariate extension of inverse Gaussian distribution derived from inverse relationship. Commun. Statist. Theory Methods 32(12), 2285–2304] was derived through multivariate inverse relationship with multivariate Gaussian distributions and characterized as the distribution of the location at a certain stopping time of a multivariate Brownian motion. In this paper, we show that the multivariate inverse Gaussian distribution is also a limiting distribution of multivariate Lagrange distributions, which is a family of waiting time distributions, under certain conditions.     

Multivariate Matsumoto–Yor property is rather restrictive

Matsumoto and Yor [2001. An analogue of Pitman's 2M-X$2M-X$ theorem for exponential Wiener functionals. Part II: the role of the GIG laws. Nagoya Math. J. 162, 65–86] discovered an interesting invariance property of a product of the generalized inverse Gaussian (GIG) and the gamma distributions. For univariate random variables or symmetric positive definite random matrices it is a characteristic property for this pair of distributions. It appears that for random vectors the Matsumoto–Yor property characterizes only very special families of multivariate GIG and gamma distributions: components of the respective random vectors are grouped into independent subvectors, each subvector having linearly dependent components. This complements the version of the multivariate Matsumoto–Yor property on trees and related characterization obtained in Massam and Weso?owski [2004. The Matsumoto–Yor property on trees. Bernoulli 10, 685–700].     

Robust median estimator in logistic regression

This paper introduces a median estimator of the logistic regression parameters. It is defined as the classical _L1$L_1$-estimator applied to continuous data _Z1,…,_Zn$Z_1,\dots ,Z_n$ obtained by a statistical smoothing of the original binary logistic regression observations _Y1,…,_Yn$Y_1,\dots ,Y_n$. Consistency and asymptotic normality of this estimator are proved. A method called enhancement is introduced which in some cases increases the efficiency of this estimator. Sensitivity to contaminations and leverage points is studied by simulations and compared in this manner with the sensitivity of some robust estimators previously introduced to the logistic regression. The new estimator appears to be more robust for larger sample sizes and higher levels of contamination.     

Asymptotic expansions of the null distributions of some test statistics for profile analysis in general distributions

This paper discusses asymptotic expansions for the null distributions of some test statistics for profile analysis under non-normality. It is known that the null distributions of these statistics converge to chi-square distribution under normality [Siotani, M., 1956. On the distributions of the Hotelling's T²$T^2$-statistics. Ann. Inst. Statist. Math. Tokyo 8, 1–14; Siotani, M., 1971. An asymptotic expansion of the non-null distributions of Hotelling's generalized T²$T^2$-statistic. Ann. Math. Statist. 42, 560–571]. We extend this result by obtaining asymptotic expansions under general distributions. Moreover, the effect of non-normality is also considered. In order to obtain all the results, we make use of matrix manipulations such as direct products and symmetric tensor, rather than usual elementwise tensor notation.     

Flexible univariate and multivariate models based on hidden truncation

A broad spectrum of flexible univariate and multivariate models can be constructed by using a hidden truncation paradigm. Such models can be viewed as being characterized by a basic marginal density, a family of conditional densities and a specified hidden truncation point, or points. The resulting class of distributions includes the basic marginal density as a special case (or as a limiting case), but also includes an array of models that may unexpectedly include many well known densities. Most of the well known skew-normal models (developed from the seed distribution popularized by Azzalini [(1985). A class of distributions which includes the normal ones. Scand. J. Statist. 12(2), 171–178]) can be viewed as being products of such a hidden truncation construction. However, the many hidden truncation models with non-normal component densities undoubtedly deserve further attention.     

An asymptotically distribution-free test of symmetry

A procedure, based on sample spacings, is proposed for testing whether a univariate distribution is symmetric about some unknown value. The proposed test is a modification of a sign test suggested by Antille and Kersting [1977. Tests for symmetry. Z. Wahrscheinlichkeitstheorie verw. Gebiete 39, 235–255], but unlike Antille and Kersting's test, our modified test is asymptotically distribution-free and is usable in practice. A simulation study indicates that the proposed test maintains the nominal level of significance, α$\alpha$ fairly accurately even for samples of size as small as 20, and a comparison with the classical test based on sample coefficient of skewness, shows that our test has good power for detecting different asymmetric distributions.     

A generalization of the multivariate slash distribution

In this paper, we propose a generalization of the multivariate slash distribution and investigate some of its properties. We show that the new distribution belongs to the elliptically contoured distributions family, and can have heavier tails than the multivariate slash distribution. Therefore, this generalization of the multivariate slash distribution can be considered as an alternative heavy-tailed distribution for modeling data sets in a variety of settings. We apply the generalized multivariate slash distribution to two real data sets to provide some illustrative examples.     

Characterizations of exponentiality within the HNBUE class and related tests

A harmonic new better than used in expectation (HNBUE) variable is a random variable which is dominated by an exponential distribution in the convex stochastic order. We use a recently obtained condition on stochastic equality under convex domination to derive characterizations of the exponential distribution and bounds for HNBUE variables based on the mean values of the order statistics of the variable. We apply the results to generate discrepancy measures to test if a random variable is exponential against the alternative that is HNBUE, but not exponential.     

Canonical correlation analysis for the vector AR(1) model with ARCH innovations

This paper extends the results of canonical correlation analysis of Anderson [2002. Canonical correlation analysis and reduced-rank regression in autoregressive models. Ann. Statist. 30, 1134–1154] to a vector AR(1) process with a vector ARCH(1) innovations. We obtain the limiting distributions of the sample matrices, the canonical correlations and the canonical vectors of the process. The extension is important because many time series in economics and finance exhibit conditional heteroscedasticity. We also use simulation to demonstrate the effects of ARCH innovations on the canonical correlation analysis in finite sample. Both the limiting distributions and simulation results show that overlooking the ARCH effects in canonical correlation analysis can easily lead to erroneous inference.     

Waiting time distributions for a run with additional constraints

This paper proposes a method for obtaining the exact probability of occurrence of the first success run of specified length with the additional constraint that at every trial until the occurrence of the first success run the number of successes up to the trial exceeds that of failures. For the sake of the additional constraint, the problem cannot be solved by the usual method of conditional probability generating functions. An idea of a kind of truncation is introduced and studied in order to solve the problem. Concrete methods for obtaining the probability in the cases of Bernoulli trials and time-homogeneous {0,1}$\{0,1\}$-valued Markov dependent trials are given. As an application of the results, a modification of the start-up demonstration test is studied. Numerical examples which illustrate the feasibility of the results are also given.