On an adjustment of degrees of freedom in the minimim mean squared error ertimator

In this paper, we consider an adjustment of degrees of freedom in the minimum mean squared error (MMSE) estimator, We derive the exact MSE of the adjusted MMSE (AMMSE) estimator, and compare the MSE of the AMMSE estimator with those of the Stein-(SR), positive-part Stein-rule (PSR) and MMSE estimators by numerical evaluations. It is shown that the adjustment of degrees of freedom is effective when the noncentrality parameter is close to zero, and the MSE performance of the MMSE estimator can be improved in the wide region of the noncentrality parameter by the adjustment, ft is also shown that the AMMSE estimator can have the smaller MSE than the PSR estimator in the wide region of the noncentrality parameter     

New monte carlo results on the robustness of the anova f,w and f statistics

Because the usual F test for equal means is not robust to unequal variances, Brown and Forsythe (1974a) suggest replacing F with the statistics F or W which are based on the Satterthwaite and Welch adjusted degrees of freedom procedures. This paper reports practical situations where both F and W give * unsatisfactory results. In particular, both F and W may not provide adequate control over Type I errors. Moreover, for equal variances, but unequal sample sizes, W should be avoided in favor of F (or F ), but for equal sample sizes, and possibly unequal variances, W was the only satisfactory statistic. New results on power are included as well. The paper also considers the effect of using F or W only after a significant test for equal variances has been obtained, and new results on the robustness of the F test are described. It is found that even for equal sample sizes as large as 50 per treatment group, there are practical situations where the F test does not provide adequately control over the probability of a Type I error.     

An approximate degrees of freedom test for heteroscedastic two-way ANOVA

Heteroscedastic two-way ANOVA are frequently encountered in real data analysis. In the literature, classical F-tests are often blindly employed although they are often biased even for moderate heteroscedasticity. To overcome this problem, several approximate tests have been proposed in the literature. These tests, however, are either too complicated to implement or do not work well in terms of size controlling. In this paper, we propose a simple and accurate approximate degrees of freedom (ADF) test. The ADF test is shown to be invariant under affine-transformations, different choices of contrast matrix for the same null hypothesis, or different labeling schemes of cell means. Moreover, it can be conducted easily using the usual F-distribution with one unknown degree of freedom estimated from the data. Simulations demonstrate that the ADF test works well in various cell sizes and parameter configurations but the classical F-tests work badly when the cell variance homogeneity assumption is violated. A real data example illustrates the methodologies.     

Secondary design considerations for minimum bias estimation

Several authors have suggested the method of minimum bias estimation for estimating response surfaces. The minimum bias estimation procedure achieves minimum average squared bias of the fitted model without depending on the values of the unknown parameters of the true surface. The only requirement is that the design satisfies a simple estimability condition. Subject to providing minimum average squared bias, the minimum bias estimator also provides minimum average variance of ?(x) where ?(x) is the estimate of the response at the point x.

To support the estimation of the parameters in the fitted model, very little has been suggested in the way of experimental designs except to say that a full rank matrix X of independent variables should be used. This paper presents a closer look at the estimability conditions that are required for minimum bias estimation, and from the form of the matrix X, a formula is derived which measures the amount of design flexibility available. The design flexibility is termed “the degrees of freedom” of the X matrix and it is shown how the degrees of freedom can be used to decide if other design optimality criteria might be considered along with minimum bias estimation. Several examples are provided.     

A bartlett correction factor for a likelihood ratio statistic in multivariate bioassay

A more accurate Bartlett correction factor is proposed for a likelihood ratio statistic in multivariate bioassay.     

Collinearity: revisiting the variance inflation factor in ridge regression

Ridge regression has been widely applied to estimate under collinearity by defining a class of estimators that are dependent on the parameter k. The variance inflation factor (VIF) is applied to detect the presence of collinearity and also as an objective method to obtain the value of k in ridge regression. Contrarily to the definition of the VIF, the expressions traditionally applied in ridge regression do not necessarily lead to values of VIFs equal to or greater than 1. This work presents an alternative expression to calculate the VIF in ridge regression that satisfies the aforementioned condition and also presents other interesting properties.     

A solution to the multivariate behrens-fisher problem

Some new algebra on pattern and transition matrices is used to determine the degrees of freedom and the parameter matrix, if the distribution of a linear sum of Wishart matrices is approximated by a single Wishart distribution. This approximation is then used to find a solution to the multivariate Behrens-Fisher problem similar to the Welch (1947) solution in the univariate case.     

A note on the power of the f-test for testing linear hypothesis with elliptic t errors

The power of the classical .F-test for testing the regression coefficient of a general linear model with elliptic t error variable depends on the degrees of freedom of the t- distribution. In this note it is shown that the power of the F-test based on t-distribution is greater than the normal based test at smaller level of significance.     

从统计学史解析“自由度”概念

自由度是统计学中一个十分重要而又长期没有被圆满解释的概念。对此,从统计学史角度,对皮尔逊、费歇尔有关自由度问题争论原始文献细致考察,彻底澄清了自由度概念的内涵及与其相关的统计思想,弥补了Fienberg、Stigler与陈希孺已有解释的缺陷。研究表明：皮尔逊关于卡方检验中无论总体分布已知还是其来自于样本推断统计量都具有同一分布的错误判断,导致卡方检验的准确性出现偏差,这种偏差虽被同时代少数几个统计学家察觉但他们却无法解释其根源。费歇尔提出自由度概念并结合n维几何、假设检验与最大似然方法的论证不仅修正了皮尔逊的错误,也完善了从样本统计量估计总体参数的数理逻辑。     

Ridge Regression: Degrees of Freedom in the Analysis of Variance

It appears to be common practice with ridge regression to obtain a decomposition of the total sum of squares, and assign degrees of freedom, according to established least squares theory. This discussion notes the obvious fallacies of such an approach, and introduces a decomposition based on orthogonality, and degrees of freedom based on expected mean squares, for non-stochastic k.     

Estimation of the correlation coefficient in probability proportional to size with replacement sampling

g of the population correlation coefficient has been suggested in case of probability proportional to size with replacement sampling. The asymptotic bias, variance and the estimate of the variance of the estimator r_g have been obtained. A comparison of this estimator has been made with the estimator r given by Gupta et al (1993) and usual estimator r₁ for PPSWR sampling. The proposed estimator r_g satisfies the condition −1≤r_g≤1 which the estimator r does not satisfy. Received: September 1, 1999; revised version: May 29, 2001     

A method for choosing the smoothing parameter in a semi-parametric model for detecting change-points in blood flow

In a smoothing spline model with unknown change-points, the choice of the smoothing parameter strongly influences the estimation of the change-point locations and the function at the change-points. In a tumor biology example, where change-points in blood flow in response to treatment were of interest, choosing the smoothing parameter based on minimizing generalized cross-validation (GCV) gave unsatisfactory estimates of the change-points. We propose a new method, aGCV, that re-weights the residual sum of squares and generalized degrees of freedom terms from GCV. The weight is chosen to maximize the decrease in the generalized degrees of freedom as a function of the weight value, while simultaneously minimizing aGCV as a function of the smoothing parameter and the change-points. Compared with GCV, simulation studies suggest that the aGCV method yields improved estimates of the change-point and the value of the function at the change-point.     

Approximating the difference of two t-variables for all degrees of freedom using truncated variables

A scaled t‐distribution is used to approximate the distribution of a linear combination of two independent t‐variables for any number of degrees of freedom, and in particular for low degrees of freedom where moments do not exist. The approximation is the method‐of‐moments solution to the analogous problem with truncated t‐variables. The approximation exists for all degrees of freedom, is very accurate for more than two degrees of freedom, and performs as well as other approximations of this form when they exist.     

Verification bias on sensitivity and specificity measurements in diagnostic medicine: a comparison of some approaches used for correction

Verification bias may occur when the test results of not all subjects are verified by using a gold standard. The correction for this bias can be made using different approaches depending on whether missing gold standard test results are random or not. Some of these approaches with binary test and gold standard results include the correction method by Begg and Greenes, lower and upper limits for diagnostic measurements by Zhou, logistic regression method, multiple imputation method, and neural networks. In this study, all these approaches are compared by employing a real and simulated data under different conditions.     

A permutation procedure for testing the equality of pattern hypotheses across groups involving correlation or covariance matrices

This paper describes a permutation procedure to test for the equality of selected elements of a covariance or correlation matrix across groups. It involves either centring or standardising each variable within each group before randomly permuting observations between groups. Since the assumption of exchangeability of observations between groups does not strictly hold following such transformations, Monte Carlo simulations were used to compare expected and empirical rejection levels as a function of group size, the number of groups and distribution type (Normal, mixtures of Normals and Gamma with various values of the shape parameter). The Monte Carlo study showed that the estimated probability levels are close to those that would be obtained with an exact test except at very small sample sizes (5 or 10 observations per group). The test appears robust against non-normal data, different numbers of groups or variables per group and unequal sample sizes per group. Power was increased with increasing sample size, effect size and the number of elements in the matrix and power was decreased with increasingly unequal numbers of observations per group.     

Maximum likelihood estimation of parameter structures for the Wishart distribution using constraints

Maximum likelihood estimation under constraints for estimation in the Wishart class of distributions, is considered. It provides a unified approach to estimation in a variety of problems concerning covariance matrices. Virtually all covariance structures can be translated to constraints on the covariances. This includes covariance matrices with given structure such as linearly patterned covariance matrices, covariance matrices with zeros, independent covariance matrices and structurally dependent covariance matrices. The methodology followed in this paper provides a useful and simple approach to directly obtain the exact maximum likelihood estimates. These maximum likelihood estimates are obtained via an estimation procedure for the exponential class using constraints.     

Inference With Dyadic Data: Asymptotic Behavior of the Dyadic-Robust t-Statistic

ABSTRACT

This article is concerned with inference in the linear model with dyadic data. Dyadic data are indexed by pairs of “units;” for example, trade data between pairs of countries. Because of the potential for observations with a unit in common to be correlated, standard inference procedures may not perform as expected. We establish a range of conditions under which a t-statistic with the dyadic-robust variance estimator of Fafchamps and Gubert is asymptotically normal. Using our theoretical results as a guide, we perform a simulation exercise to study the validity of the normal approximation, as well as the performance of a novel finite-sample correction. We conclude with guidelines for applied researchers wishing to use the dyadic-robust estimator for inference.