A ROBUST TEST FOR MULTIPLE COMPARISONS OF CORRELATION COEFFICIENTS1

A limiting expression is derived for the tail of the distribution of the maximum of a set of product moment correlation coefficients. The technique used is quite general and may be applied to non-normal observations as well as to rank correlation coefficients. The result obtained for the latter leads to a test procedure for multiple comparisons of these non-parametric measures of dependence.     

An error-bounded polynomial approximation for bivariate normal probabilities

Although the bivariate normal distribution is frequently employed in the development of screening models, the formulae for computing bivariate normal probabilities are quite complicated. A simple and accurate error-bounded, noniterative approximation for bivariate normal probabilities based on a simple univariate normal quadratic or cubic approximation is developed for use in screening applications. The approximation, which is most accurate for large absolute correlation coefficients, is especially suitable for screening applications (e.g., in quality control), where large absolute correlations between performance and screening variables are desired. A special approximation for conditional bivariate normal probabilities is also provided which in quality control screening applications improves the accuracy of estimating the average outgoing product quality. Some anomalies in computing conditional bivariate normal probabilities using BNRDF and NORDF in IMSL are also discussed.     

Tests on the Equality of Two Multiple Correlation Coefficients

Asymptotic tests are suggested for testing the equality of two multiple correlation coefficients calculated from a single sample from a multivariate normal distribution. An F test is possible only when the two dependent variables coincide and one set of independent variables is a subset of the second set. Tests are compared by simulation for situations in which the F test is inapplicable. Special attention is paid to cases in which asymptotic normality of the test statistics does not hold.     

Approxmating the distribution of the maximum of a dependent stationary sequence based on estimatimates from a genrating function

A method based on estimating the coefficients of a generating function is used to approximate the distribution of the maximum term of a stationary dependent sequence. In a numerical comparison of our approximation with other apporoximations, our method yielded uniformly closer estimates to the exact distribution. In the examples we considered, statisfactory estimates of the distribution were obtained by our method based on a knowledge of the tri-variate distribution of the underlying random sequence. Knowledge of higher variate distributions can be incorporated to yield even more accurate estimates.     

A Measure of Dependence Between Two Compositions

We consider the problem of describing the correlation between two compositions. Using a bicompositional Dirichlet distribution, we calculate a joint correlation coefficient, based on the concept of information gain, between two compositions. Numerical values of the joint correlation coefficient are calculated for compositions of two and three components, respectively. We also present an estimator of the joint correlation coefficient for a sample from a bicompositional Dirichlet distribution. Two confidence intervals are presented and we examine their empirical confidence coefficients using a Monte Carlo study. Finally, we apply the estimator to a data set analysing the joint correlation between the 1967 and 1997, and the 1977 and 1997 compositions of the government gross domestic product for the 50 states of the USA and the District of Columbia.     

Approximating the Shapiro-Wilk W-test for non-normality

A new approximation for the coefficients required to calculate the Shapiro-WilkW-test is derived. It is easy to calculate and applies for any sample size greater than 3. A normalizing transformation for theW statistic is given, enabling itsP-value to be computed simply. The distribution of the new approximation toW agrees well with published critical points which use exact coefficients.     

On the distribution of Fisher's transformation of the correlation coefficient

As the sample size increases, the coefficient of skewness of the Fisher's transformation, z = (1/2) log ((l+r)/(l-r)), of the correlation coefficient decreases much more rapidly than the excess of its kurtosis. Hence, the usual normal approximation for its distribution can be improved by adjusting for the excess of its kurtosis. This is accomplished by mixing the approximating normal distribution with a logistic distribution. The resulting mixture approximation which can be used to estimate the probabilities, as well as the percentiles, compares favorably in both accuracy and simplicity, with the two best earlier approximations, namely, those due to Ruben (1966) and Kraemer (1973).     

THE EFFECTS OF CORRELATION AMONG OBSERVATIONS ON THE ACCURACY OF APPROXIMATING THE DISTRIBUTION OF SAMPLE MEAN BY ITS ASYMPTOTIC DISTRIBUTION1

In this paper, we investigate the effects of correlation among observations on the accuracy of approximating the distribution of sample mean by its asymptotic distribution. The accuracy is investigated by the Berry-Esseen bound (BEB), which gives an upper bound on the error of approximation of the distribution function of the sample mean from its asymptotic distribution for independent observations. For a given sample size (n₀) the BEB is obtained when the observations are independent. Let this be BEB. We then find the sample size (n_*) required to have BEB below BEB₀, when the observations are dependent. Comparison of n_* with n₀ reveals the effects of correlation among observations on the accuracy of the asymptotic distribution as an approximation. It is shown that the effects of correlation among observations are not appreciable if the correlation is moderate to small but it can be severe for extreme correlations.     

Some asymptotic results on generalized penalized spline smoothing

Summary.  The paper discusses asymptotic properties of penalized spline smoothing if the spline basis increases with the sample size. The proof is provided in a generalized smoothing model allowing for non-normal responses. The results are extended in two ways. First, assuming the spline coefficients to be a priori normally distributed links the smoothing framework to generalized linear mixed models. We consider the asymptotic rates such that the Laplace approximation is justified and the resulting fits in the mixed model correspond to penalized spline estimates. Secondly, we make use of a fully Bayesian viewpoint by imposing an a priori distribution on all parameters and coefficients. We argue that with the postulated rates at which the spline basis dimension increases with the sample size the posterior distribution of the spline coefficients is approximately normal. The validity of this result is investigated in finite samples by comparing Markov chain Monte Carlo results with their asymptotic approximation in a simulation study.     

Approximating the difference of two t-variables for all degrees of freedom using truncated variables

A scaled t‐distribution is used to approximate the distribution of a linear combination of two independent t‐variables for any number of degrees of freedom, and in particular for low degrees of freedom where moments do not exist. The approximation is the method‐of‐moments solution to the analogous problem with truncated t‐variables. The approximation exists for all degrees of freedom, is very accurate for more than two degrees of freedom, and performs as well as other approximations of this form when they exist.     

Path analysis and determining the distribution of indirect effects via simulation

The difference between a path analysis and the other multivariate analyses is that the path analysis has the ability to compute the indirect effects apart from the direct effects. The aim of this study is to investigate the distribution of indirect effects that is one of the components of path analysis via generated data. To realize this, a simulation study has been conducted with four different sample sizes, three different numbers of explanatory variables and with three different correlation matrices. A replication of 1000 has been applied for every single combination. According to the results obtained, it is found that irrespective of the sample size path coefficients tend to be stable. Moreover, path coefficients are not affected by correlation types either. Since the replication number is 1000, which is fairly large, the indirect effects from the path models have been treated as normal and their confidence intervals have been presented as well. It is also found that the path analysis should not be used with three explanatory variables. We think that this study would help scientists who are working in both natural and social sciences to determine sample size and different number of variables in the path analysis.     

A new approximation to the distribution function of the studentized maximum root

The Studentized maximum root (SMR) distribution is useful for constructing simultaneous confidence intervals around product interaction contrasts in replicated two-way ANOVA. A three-moment approximation to the SMR distribution is proposed. The approximation requires the first three moments of the maximum root of a central Wishart matrix. These values are obtained by means of numerical integration. The accuracy of the approximation is compared to the accuracy of a two-moment approximation for selected two-way table sizes. Both approximations are reasonably accurate. The three-moment approximation is generally superior.     

Correlated random effects regression analysis for a log-normally distributed variable

In regression analysis, it is assumed that the response (or dependent variable) distribution is Normal, and errors are homoscedastic and uncorrelated. However, in practice, these assumptions are rarely satisfied by a real data set. To stabilize the heteroscedastic response variance, generally, log-transformation is suggested. Consequently, the response variable distribution approaches nearer to the Normal distribution. As a result, the model fit of the data is improved. Practically, a proper (seems to be suitable) transformation may not always stabilize the variance, and the response distribution may not reduce to Normal distribution. The present article assumes that the response distribution is log-normal with compound autocorrelated errors. Under these situations, estimation and testing of hypotheses regarding regression parameters have been derived. From a set of reduced data, we have derived the best linear unbiased estimators of all the regression coefficients, except the intercept which is often unimportant in practice. Unknown correlation parameters have been estimated. In this connection, we have derived a test rule for testing any set of linear hypotheses of the unknown regression coefficients. In addition, we have developed the confidence ellipsoids of a set of estimable functions of regression coefficients. For the fitted regression equation, an index of fit has been proposed. A simulated study illustrates the results derived in this report.     

On the distribution of the maximum of bivariate normal random variables with general means and variances

A great amount of effort has been devoted to achieving exact expressions for moments of order statistics of independent normal random variables, as well as the dependent case with the same correlation coefficients, means and variances. It does not seem as if there are handy formulae for the order statistics of even the simple bivariate normal random variables when the means and variances are allowed to be different. In this paper we give an explicit formula for the Lanl ace-Stielties Transform of the maximum of bivariate normal random variables by which we obtain formulae for the first two moments in the standard way.     

Development and comparative study of two near-exact approximations to the distribution of the product of an odd number of independent Beta random variables

Using the concept of near-exact approximation to a distribution we developed two different near-exact approximations to the distribution of the product of an odd number of particular independent Beta random variables (r.v.'s). One of them is a particular generalized near-integer Gamma (GNIG) distribution and the other is a mixture of two GNIG distributions. These near-exact distributions are mostly adequate to be used as a basis for approximations of distributions of several statistics used in multivariate analysis. By factoring the characteristic function (c.f.) of the logarithm of the product of the Beta r.v.'s, and then replacing a suitably chosen factor of that c.f. by an adequate asymptotic result it is possible to obtain what we call a near-exact c.f., which gives rise to the near-exact approximation to the exact distribution. Depending on the asymptotic result used to replace the chosen parts of the c.f., one may obtain different near-exact approximations. Moments from the two near-exact approximations developed are compared with the exact ones. The two approximations are also compared with each other, namely in terms of moments and quantiles.     

Saddlepoint Approximations for a Product and Its Application

A technique of the saddlepoint approximation with double exponential base, SPA_D is developed to evaluate the probability of a product of two random variables, which may be independent or dependent, normal or contaminated normal random variables. The SPA_D shows a slightly better approximation as compared to the saddlepoint approximation with Lagannani–Rice formula. However, both methods get remarkable results when applied to evaluate the tail probabilities of the Reynolds stress for soil erosion prediction.     

Two-dimensional Renewal Function Approximation

Two-dimensional renewal functions, which are naturally extensions of one-dimensional renewal functions, have wide applicability in areas where two random variables are needed to characterize the underlying process. These functions satisfy the renewal equation, which is not amenable for analytical solutions. This paper proposes a simple approximation for the computation of the two- dimensional renewal function based only on the first two moments and the correlation coefficient of the variables. The approximation yields exact values of renewal function for bivariate exponential distribution function. Illustrations are presented to compare our approximation with that of Iskandar (1991) who provided a computational procedure which requires the use of the bivariate distribution function of the two variables. A two-dimensional warranty model is used to illustrate the approximation.     

Frequency domain bootstrap for ratio statistics under long-range dependence

A frequency domain bootstrap (FDB) is a common technique to apply Efron’s independent and identically distributed resampling technique (Efron, 1979) to periodogram ordinates – especially normalized periodogram ordinates – by using spectral density estimates. The FDB method is applicable to several classes of statistics, such as estimators of the normalized spectral mean, the autocorrelation (but not autocovariance), the normalized spectral density function, and Whittle parameters. While this FDB method has been extensively studied with respect to short-range dependent time processes, there is a dearth of research on its use with long-range dependent time processes. Therefore, we propose an FDB methodology for ratio statistics under long-range dependence, using semi- and nonparametric spectral density estimates as a normalizing factor. It is shown that the FDB approximation allows for valid distribution estimation for a broad class of stationary, long-range (or short-range) dependent linear processes, without any stringent assumptions on the distribution of the underlying process. The results of a large simulation study show that the FDB approximation using a semi- or nonparametric spectral density estimator is often robust for various values of a long-memory parameter reflecting magnitude of dependence. We apply the proposed procedure to two data examples.     

Testing for a trend in exponential means: A two-moment approximation to the null distribution of the likelihood-ratio statistic

The likelihood-ratio test statistic for testing homogeneity of exponential means with an ordered alternative has a rather complex null distribution. Expressions for the mean and variance of its null distribution are derived, and the accuracy of a two-moment chi-squared approximation is studied. The coefficients needed to implement the approximation are tabled. The application of these results in testing for a constant versus a nondecreasing intensity in a nonhomogeneous Poisson process is also discussed.     

Exact distribution of the sample lead

The sample lead can refer to the lead of one party over another in public opinion polls, of one product over another in market research surveys, of one programme over another in TV viewing surveys, etc. In applied statistics, it is common to assume that the distribution of the sample lead is approximately normal. The assumption is justified in most situations, but, when samples are small or when population proportions are extreme, the normal approximation may be inadequate. This paper describes the derivation of the exact distribution of the sample lead and employs it to test hypotheses when the normal approximation is inadequate. The exact distribution also can be used to check whether or not a particular distribution of the sample lead can be adequately represented by the normal distribution.