Decomposition of the main effects and interaction term by using orthogonal polynomials in multiple non symmetrical correspondence analysis

The multiple non symmetric correspondence analysis (MNSCA) is a useful technique for analyzing a two-way contingency table. In more complex cases, the predictor variables are more than one. In this paper, the MNSCA, along with the decomposition of the Gray–Williams Tau index, in main effects and interaction term, is used to analyze a contingency table with two predictor categorical variables and an ordinal response variable. The Multiple-Tau index is a measure of association that contains both main effects and interaction term. The main effects represent the change in the response variables due to the change in the level/categories of the predictor variables, considering the effects of their addition, while the interaction effect represents the combined effect of predictor categorical variables on the ordinal response variable. Moreover, for ordinal scale variables, we propose a further decomposition in order to check the existence of power components by using Emerson's orthogonal polynomials.     

Cumulative correspondence analysis using orthogonal polynomials

Taguchi's statistic has long been known to be a more appropriate measure of association of the dependence for ordinal variables compared to the Pearson chi-squared statistic. Therefore, there is some advantage in using Taguchi's statistic in the correspondence analysis context when a two-way contingency table consists at least of an ordinal categorical variable. The aim of this paper, considering the contingency table with two ordinal categorical variables, is to show a decomposition of Taguchi's index into linear, quadratic and higher-order components. This decomposition has been developed using Emerson's orthogonal polynomials. Moreover, two case studies to explain the methodology have been analyzed.     

Simple and multiple correspondence analysis for ordinal-scale variables using orthogonal polynomials

Correspondence analysis (CA) has gained a reputation for being a very useful statistical technique for determining the nature of association between two or more categorical variables. For simple and multiple CA, the singular value decomposition (SVD) is the primary tool used and allows the user to construct a low-dimensional space to visualize this association. As an alternative to SVD, one may consider the bivariate moment decomposition (BMD), a method of decomposition that involves using orthogonal polynomials to reflect the structure of ordered categorical responses. When the features of BMD are combined with SVD, a hybrid decomposition (HD) is formed. The aim of this paper is to show the applicability of HD when performing simple and multiple CA.     

Hierarchical clustering of variables: a comparison among strategies of analysis

In this paper some hierarchical methods for identifying groups of variables are illustrated and compared. It is shown that the use of multivariate association measures between two sets of variables can overcome the drawbacks of the usually employed bivariate correlation coefficient, but the resulting methods are generally not monotonic. Thus a new multivariate association measure is proposed, based on the links existing between canonical correlation analysis and principal component analysis, which can be more suitably used for the purpose at hand. The hierarchical method based on the suggested measure is illustrated and compared with other possible solutions by analysing simulated and real data sets. Finally an extension of the suggested method to the more general situation of mixed (qualitative and quantitative) variables is proposed and theoretically discussed.     

Interpretation of the coefficient of determination of an ANOVA model as a measure of polarization

In this paper, it is demonstrated that coefficient of determination of an ANOVA linear model provides a measure of polarization. Taking as the starting point the link between polarization and dispersion, we reformulate the measure of polarization of Zhang and Kanbur using the decomposition of the variance instead of the decomposition of the Theil index. We show that the proposed measure is equivalent to the coefficient of determination of an ANOVA linear model that explains, for example, the income of the households as a function of any population characteristic such as education, gender, occupation, etc. This result provides an alternative way to analyse polarization by sub-populations characteristics and at the same time allows us to compare sub-populations via the estimated coefficients of the ANOVA model.     

A generalized analysis of the dependence structure by means of ANOVA

The multiple non-symmetric correspondence analysis (MNSCA) is a useful technique for analysing the prediction of a categorical variable through two or more predictor variables placed in a contingency table. In MNSCA framework, for summarizing the predictability between criterion and predictor variables, the Multiple-TAU index has been proposed. But it cannot be used to test association, and for overcoming this limitation, a relationship with C-Statistic has been recommended. Multiple-TAU index is an overall measure of association that contains both main effects and interaction terms. The main effects represent the change in the response variables due to the change in the level/categories of the predictor variables, considering the effects of their addition. On the other hand, the interaction effect represents the combined effect of predictor variables on the response variable. In this paper, we propose a decomposition of the Multiple-TAU index in main effects and interaction terms. In order to show this decomposition, we consider an empirical case in which the relationship between the demographic characteristics of the American people, such as race, gender and location (column variables), and their propensity to move (row variable) to a new town to find a job is considered.     

Shrinkage and Orthogonal Decomposition

ABSTRACT. The problem of estimating the mean of a multivariate normal distribution when the parameter space allows an orthogonal decomposition is discussed. Risk functions and lower bounds for a class of shrinkage estimators that includes Stein's estimator are derived, and an improvement on Stein's estimator that takes advantage of the orthogonal decomposition is introduced. Uniform asymptotics related to Pinsker's minimax risk is derived and we give conditions for attaining the lower risk bound. Special cases including regression and analysis of variance are discussed.     

A proportional-reduction-in-impurity measure of association for categorical variables

This paper presents a proportional-reduction-in-impurity (PRI) measure for categorical association, that employs application-dependent loss functions which make the measure widely applicable. The well-known proportional -reduction-in-error (PRE) measure is shown to be a special case of the new PRI measure. Moreover, the asymptotic variance of the maximum likelihood estimator (MLE) of the measure is derived to facilitate its use for statistical inference. An extension of the PRI measure to compositional association is made to show that it can have a variety of applications. Selected loss functions are treated to illustrate the derivation of the measure.     

Deletion diagnostics for marginal mean and correlation model parameters in estimating equations

Regression diagnostics are introduced for parameters in marginal association models for clustered binary outcomes in an implementation of generalized estimating equations. Estimating equations for intracluster correlations facilitate computational formulae for one-step deletion diagnostics in an extension of earlier work on diagnostics for parameters in the marginal mean model. The proposed diagnostics measure the influence of an observation or a cluster of observations on the estimated regression parameters and on the overall fit of the model. The diagnostics are applied to data from four research studies from public health and medicine.     

The stability of several measures of association in small contingency tables

Measures of association are often used to describe the relationship between row and column variables in two—dimensional contingency tables. It is not uncommon in biomedical research to categorize continuous variables to obtain a two—dimensional table. In these situations it is desirable that the measure of association not be too sensitive to changes in the number of categories or to the choice of cut points. To accomplish this objective we attempt to find a measure of association that closely approximates the corresponding measure of association for the underlying distribution.Measures that are close to the underlying measure for various table sizes andcutpoints are called stable measures.     

Extending the Barnard’s test to non-inferiority

In 1945, George Alfred Barnard presented an unconditional exact test to compare two independent proportions. Critical regions for this test, by construction accomplish the very useful property of being Barnard convex sets. Besides, there are empirical findings suggesting that Barnard’s test is the most generally powerful. For Barnard’s test, calculation of critical regions is complicated due that they are constructed in an iterative form until is obtained a test size, as close as possible to the nominal significance level and less than or equal to it. In this article we present an extension to non-inferiority of this very leading test. This extension was contructed for any dissimilarity measure and tables were constructed for the difference between proportions. Also we calculate the critical regions for this extended test for sample sizes less or equal than 30, nominal significance level 0.01, 0.025, 0.05, and 0.10 and for non-inferiority margins 0.05, 0.10, 0.15, and 0.20. Additionally, we computed test sizes for the mentioned configurations. To do this calculations, we have written a program in the R environment.     

Correspondence Analysis of Cumulative Frequencies Using a Decomposition of Taguchi's Statistic

Taguchi's statistic has long been known to be a more appropriate measure of association for ordinal variables than the Pearson chi-squared statistic. Therefore, there is some advantage in using Taguchi's statistic for performing correspondence analysis when a two-way contingency table consists of one ordinal categorical variable. This article will explore the development of correspondence analysis using a decomposition of Taguchi's statistic.     

Generation of random matrices with orthonormal columns and multivariate normal wariates with given sample mean and covariance

In this paper, an algorithm for generating random matrices with orthonormal columns is introduced. As pointed out by a referee, the algorithm is almost identical to Wedderburn's (1975) unpublished method. The method can also be considered as an extension of Stewart's (1980) method, which was designed to generate random orthogonal matrices. It is found outperforming a simple extension of the QR factorization method and that of Heiberger's (1978) method. This paper also demonstrates how the algorithm can be used in generating multivariate normal variates with given sample mean and sample covariance matrix.     

Taux de résistance des tests de rang d'indépendance

The resistance of tests to acceptance and rejection of null hypotheses was denned and studied by Ylvisaker in the context of one-sample problems. This notion provides a measure of a test's resistance to outliers. In this paper, we propose an extension of this notion to rank-based tests of independence for bivariate random variables. We show, among other things, that Kendall's test of independence is more resistant than Spearman's test.     

A screening approach for non-parametric global sensitivity analysis

Global sensitivity analysis (GSA) can help practitioners focusing on the inputs whose uncertainties have an impact on the model output, which allows reducing the complexity of the model. Screening, as the qualitative method of GSA, is to identify and exclude non- or less-influential input variables in high-dimensional models. However, for non-parametric problems, there remains the challenging problem of finding an efficient screening procedure, as one needs to properly handle the non-parametric high-order interactions among input variables and keep the size of the screening experiment economically feasible. In this study, we design a novel screening approach based on analysis of variance decomposition of the model. This approach combines the virtues of run-size economy and model independence. The core idea is to choose a low-level complete orthogonal array to derive the sensitivity estimates for all input factors and their interactions with low cost, and then develop a statistical process to screen out the non-influential ones without assuming the effect-sparsity of the model. Simulation studies show that the proposed approach performs well in various settings.     

Various measures of dependence of a new asymmetric generalized Farlie–Gumbel–Morgenstern copulas

ABSTRACT

In this paper, we discuss an asymmetric extension of Farlie–Gumbel–Morgenstern copulas studied by several authors and obtain the range of the parameter. We derive an expression for regression function and the properties of these copulas are studied in detail. Also, explicit expressions for various measures of association are obtained. These measures are numerically compared for some particular parametric values of the copulas.     

Systemic risk statistics with scenario analysis

In this paper, we introduce two new classes of risk statistics, named convex and positively homogeneous systemic risk statistics, respectively. Structural decomposition results and representation results for them are provided. These new risk statistics can be considered as a kind of systemic risk extension of risk statistics introduced by Kou, Peng, and Heyde, and also empirical versions of system risk measures introduced by Cehn, Iyengar, and Mollemi and Kromer, Overbeck, and Zich. Finally, some examples are also given.     

An extension of the Anderson–Darling k-sample test to arbitrary sample space partition sizes

In this paper we first show that the k-sample Anderson–Darling test is basically an average of Pearson statistics in 2?×?k contingency tables that are induced by observation-based partitions of the sample space. As an extension, we construct a family of rank test statistics, indexed by c?∈??, which is based on similarly constructed c?×?k partitions. An extensive simulation study, in which we compare the new test with others, suggests that generally very high powers are obtained with the new tests. Finally we propose a decomposition of the test statistic in interpretable components.     

Ridge Regression: Degrees of Freedom in the Analysis of Variance

It appears to be common practice with ridge regression to obtain a decomposition of the total sum of squares, and assign degrees of freedom, according to established least squares theory. This discussion notes the obvious fallacies of such an approach, and introduces a decomposition based on orthogonality, and degrees of freedom based on expected mean squares, for non-stochastic k.     

A new measure of association for bivariate survival data

Time dependent association measures between variables are of interest in bivariate survival data. Several such measures have been proposed in literature for the modelling and analysis of survival data. In this paper, we introduce a new measure of association for bivariate survival data using product moment residual life function and mean residual life function. Various properties of the proposed measure and its relationship with existing measures are discussed. We also develop a non-parametric estimator of the measure and study its asymptotic properties. The application of the result is illustrated using a real life data. Finally, a stimulation study is carried out to assess the performance of the estimator.