Manipulating Statistical Hypotheses and Tests as Boolean Functions

Statistical hypotheses and test statistics are Boolean functions that can be manipulated using the tools of Boolean algebra. These tools are particularly useful for exploring multiple comparisons or simultaneous inference theory, in which multiparameter hypotheses or multiparameter test statistics may be decomposed into combinations of uniparameter hypotheses or uniparameter tests. These concepts are illustrated with both finite and infinite decompositions of familiar multiparameter hypotheses and tests. The corresponding decompositions of acceptance regions and rejection regions are also shown. Finally, the close relationship between hypothesis and test decompositions and Roy's union—intersection principle is demonstrated by a derivation of the union—intersection test of the univariate general linear hypothesis.     

On some expressions for variance,covariance, skewness and L-moments

Some results concerning expressions for moments and L-moments of continuous distributions are given. These include: some decompositions of variance and covariance closely related to decompositions recently given by Yatracos; a similar expression for the population third central moment and a simple proof thereof for nonnegative random variables; an alternative proof of a general expression for L-moments due to Hosking, and some straightforward consequences for inequalities concerning L-moments. Simplicity is a key feature of all results considered in this paper.     

Simultaneous decomposition of the variance by sources and subgroups – new insights

There are two types of decompositions: of linear combinations of random variables into contributions of individual variables (sources) and associations between them, and of populations into contributions of their subpopulations. Simultaneous treatment of the two types is called for, which takes into account the correlations between sources within subpopulations and between subpopulation means. The expected values of the subcomponents are derived and their sensitivity to correlations among sources within groups and among source group means is conducted. An example is provided, in which the correlations contribute 20--25% to total variability. This additional information is hidden when decompositions are not simultaneous.     

Diagonal,weighted marginal homogeneity model and decompositions for linear diagonals-parameter symmetry model

For square contingency tables rith ordered categories, this paper proposes two kinds of extensions of marginal homogeneity model and gives decompositions for the Liseer diagonals-parameter symmetry model considered by Agresti (1983a) using the proposed models- The proposed models are also applied to an unaided vision data.     

Optimal decomposition of probabilistic networks by simulated annealing

This paper investigates the applicability of a Monte Carlo technique known as simulated annealing to achieve optimum or sub-optimum decompositions of probabilistic networks under bounded resources. High-quality decompositions are essential for performing efficient inference in probabilistic networks. Optimum decomposition of probabilistic networks is known to be NP-hard (Wen, 1990). The paper proves that cost-function changes can be computed locally, which is essential to the efficiency of the annealing algorithm. Pragmatic control schedules which reduce the running time of the annealing algorithm are presented and evaluated. Apart from the conventional temperature parameter, these schedules involve the radius of the search space as a new control parameter. The evaluation suggests that the inclusion of this new parameter is important for the success of the annealing algorithm for the present problem.     

Strong orthogonal decompositions and non‐linear impulse response functions for infinite‐variance processes

The author proves that Wold‐type decompositions with strong orthogonal prediction innovations exist in smooth, reflexive Banach spaces of discrete time processes if and only if the projection operator generating the innovations satisfies the property of iterations. His theory includes as special cases all previous Wold‐type decompositions of discrete time processes, completely characterizes when non‐linear heavy‐tailed processes obtain a strong‐orthogonal moving average representation, and easily promotes a theory of non‐linear impulse response functions for infinite‐variance processes. The author exemplifies his theory by developing a non‐linear impulse response function for smooth transition threshold processes, and discusses how to test decomposition innovations for strong orthogonality and whether the proposed model represents the best predictor. A data set on currency exchange rates allows him to illustrate his methodology.     

On additive and block decompositions of WLSEs under a multiple partitioned regression model

While considering the mechanism of weighted least-squares estimators (WLSEs) of regression coefficients in a partitioned linear model, Tian and Takane [On sum decompositions of weighted least-squares estimators under the partitioned linear model, Comm. Statist. Theory Methods 37 (2008), pp. 55–69] gave some identifying conditions for the WLSEs to be the sum of WLSEs under its two small models based on orthogonality of regressors with respect to the given weight matrix. The purpose of this paper is to show how to establish additive and block decompositions of WLSEs under a multiple partitioned linear model and its k small models based on orthogonality of regressors with respect to a given weight matrix.     

Trend-Cycle Decompositions with Correlated Components

This paper raises some interpretative issues that arise from univariate trend-cycle decompositions with correlated disturbances. In particular, it discusses whether the interpretation of a negative correlation as providing evidence for the prominence of real, or supply, shocks, can be supported.

For this purpose it determines the conditions under which correlated components may originate from the underestimation of the cyclical component in an orthogonal decomposition; from the presence of a growth rate cycle, rather than a deviation cycle; or alternatively, as a consequence of the hysteresis phenomenon. Finally, it considers interpreting correlated components in terms of permanent-transitory decompositions, where the permanent component has richer dynamics than a pure random walk.

The consequences for smoothing and signal extraction are discussed: in particular, it is documented that a negative correlation implies that future observations carry most of the information needed to assess cyclical stance. As a result, the components will be subject to underestimation in real time and thus to high revisions. The overall conclusion is that the characterization of economic fluctuations in macroeconomic time series largely remains an open issue.     

The Racing Car Problem

An approach to teaching linear regression with unbalanced data is outlined that emphasizes its role as a method of adjustment for associated regressors. The method is introduced via direct standardization, a simple form of regression for categorical regressors. Properties of regression in the presence of association and interaction are emphasized. Least squares is introduced as a more efficient way of calculating adjusted effects for which exact decompositions of the variance are possible. Interval-scaled regressors are initially grouped and treated as categorical; polynomial regression and analysis of covariance can be introduced later as alternative methods.     

On linear statistical models of commutative quadratic type

By defining a special class of vector decompositions we consider linear statistical models of commutative quadratic type, which especially cover balanced complete and incomplete ANOVA models with fixed, random and mixed effects. Under the assumption of normal distribution we are concerned with distributions of general quadratic forms, with point and confidence region estimation as well as with hypothesis testing for fixed effects (including multiple comparisons) and variance components.     

Comment on state space modeling of multiple time series

This paper raises some interpretative issues that arise from univariate trend–cycle decompositions with correlated disturbances. In particular, it discusses whether the interpretation of a negative correlation as providing evidence for the prominence of real, or supply, shocks, can be supported.

For this purpose it determines the conditions under which correlated components may originate from the underestimation of the cyclical component in an orthogonal decomposition; from the presence of a growth rate cycle, rather than a deviation cycle; or alternatively, as a consequence of the hysteresis phenomenon. Finally, it considers interpreting correlated components in terms of permanent–transitory decompositions, where the permanent component has richer dynamics than a pure random walk.

The consequences for smoothing and signal extraction are discussed: in particular, it is documented that a negative correlation implies that future observations carry most of the information needed to assess cyclical stance. As a result, the components will be subject to underestimation in real time and thus to high revisions. The overall conclusion is that the characterization of economic fluctuations in macroeconomic time series largely remains an open issue.     

Analysis of Deviance for Hypothesis Testing in Generalized Partially Linear Models

In this study, we develop nonparametric analysis of deviance tools for generalized partially linear models based on local polynomial fitting. Assuming a canonical link, we propose expressions for both local and global analysis of deviance, which admit an additivity property that reduces to analysis of variance decompositions in the Gaussian case. Chi-square tests based on integrated likelihood functions are proposed to formally test whether the nonparametric term is significant. Simulation results are shown to illustrate the proposed chi-square tests and to compare them with an existing procedure based on penalized splines. The methodology is applied to German Bundesbank Federal Reserve data.     

Parametric Estimation Procedures in Multivariate Generalized Pareto Models

Abstract.  Modelling the tails of a multivariate distribution can be reasonably done by multivariate generalized Pareto distributions (GPDs). We present several methods of parametric estimation in these models, which use decompositions of the corresponding random vectors with the help of different versions of Pickands coordinates. The estimators are compared to each other with simulated data sets. To show the practical value of the methods, they are applied to a real hydrological data set.     

Asymmetrical Orthogonal Arrays With Run Size 100

Nowadays orthogonal arrays play important roles in statistics and other fields. Usual difference matrices are essential for the construction of many symmetrical or a few asymmetrical orthogonal arrays. But there are also asymmetrical orthogonal arrays which can not be obtained by the usual difference matrices. In order to construct these asymmetrical orthogonal arrays, a class of special matrices were discovered from the orthogonal decompositions of projection matrices. In this article, an interesting equivalent relationship between orthogonal arrays and the generalized difference matrices is presented. As an application, a lot of new orthogonal arrays of run size 100 have been constructed.     

A characterization of probability distributions similar to the exponential

A concept of the lack-of-memory property at a given time point c > 0 is introduced. It is equivalent to the concept of the almost-lack-of-memory (ALM) property of the random variables. A representation theorem is given for the cumulative distribution function of such random variables as well as for corresponding decompositions in terms of independent random variables. It is shown that a periodic failure rate for a random variable is equivalent to the ALM property. In addition some properties of the service time of an unreliable server are observed.     

Estimations of the parameter of a Dirichlet distribution using residual allocation model representations and sampling properties

Estimating the parameter of a Dirichlet distribution is an interesting question since this distribution arises in many situations of applied probability. Classical procedures are based on sample of Dirichlet distribution. In this paper we exhibit five different estimators from only one observation. They are based either on residual allocation model decompositions or on sampling properties of Dirichlet distributions. Two ways are investigated: the first one uses fragments’ size and the second one uses size-biased permutations of a partition. Numerical computations based on simulations are supplied. The estimators are finally used to estimate birth probabilities per month.     

Estimation of gaussian mixtures with rotationally invariant covariance matrices

Homoscedastic and heteroscedastic Gaussian mixtures differ in the constraints placed on the covariance matrices of the mixture components. A new mixture, called herein a strophoscedastic mixture, is defined by a new constraint, This constraint requires the matrices to be identical under orthogonal trans¬formations, where different transformations are allowed for different matrices. It is shown that the M-step of the EM method for estimating the parameters of strophoscedastic mixtures from sample data is explicitly solvable using singular value decompositions. Consequently, the EM-based maximum likelihood estimation algorithm is as easily implemented for strophoscedastic mixtures as it is for homoscedastic and heteroscedastic mixtures. An example of a “noisy” Archimedian spiral is presented.     

Maximum likelihood estimates in the multivariate normal with patterned mean and covariance via the em algorithm

The maximum likelihood equations for a multivariate normal model with structured mean and structured covariance matrix may not have an explicit solution. In some cases the model's error term may be decomposed as the sum of two independent error terms, each having a patterned covariance matrix, such that if one of the unobservable error terms is artificially treated as "missing data", the EM algorithm can be used to compute the maximum likelihood estimates for the original problem. Some decompositions produce likelihood equations which do not have an explicit solution at each iteration of the EM algorithm, but within-iteration explicit solutions are shown for two general classes of models including covariance component models used for analysis of longitudinal data.     

Orthogonal Stiefel manifold optimization for eigen-decomposed covariance parameter estimation in mixture models

Within the mixture model-based clustering literature, parsimonious models with eigen-decomposed component covariance matrices have dominated for over a decade. Although originally introduced as a fourteen-member family of models, the current state-of-the-art is to utilize just ten of these models; the rationale for not using the other four models usually centers around parameter estimation difficulties. Following close examination of these four models, we find that two are actually easily implemented using existing algorithms but that two benefit from a novel approach. We present and implement algorithms that use an accelerated line search for optimization on the orthogonal Stiefel manifold. Furthermore, we show that the ‘extra’ models that these decompositions facilitate outperform the current state-of-the art when applied to two benchmark data sets.     

Three-way association measure decompositions: The Delta index

In this paper we describe a general framework to decompose three-way association measures for contingency tables, in particular symmetric and non-symmetric measures will be discussed, like Pearson's index, Marcotorchino's index, whose special case is the Gray–Williams index, and a new non-symmetric one will be proposed, called the Delta index. After showing the orthogonal decomposition of these indices, practical examples illustrating the different decompositions will be given.