Some Results About Standardization for a Non Confounder in Estimators of (log) Relative Risk

Confounding is very fundamental to the design and analysis of studies of causal effects. A variable is not a confounder if it is not a risk factor to disease or if it has the same distribution in the exposed and unexposed population. Whether or not to adjust for a non confounder to improve the precision of estimation has been argued by many authors. This article shows that if C is a non confounder, the pooled and standardized (log) relative risk estimators are asymptotic normal distributions with the mean being the true (log) relative risk, and that the asymptotic variance of the pooled (log) relative risk estimator is less than that of the stratified estimator.     

On distribution of AIC in linear regression models

This paper investigates an asymptotic distribution of the Akaike information criterion (AIC) and presents its characteristics in normal linear regression models. The bias correction of the AIC has been studied. It may be noted that the bias is only the mean, i.e., the first moment. Higher moments are important for investigating the behavior of the AIC. The variance increases as the number of explanatory variables increases. The skewness and kurtosis imply a favorable accuracy of the normal approximation. An asymptotic expansion of the distribution function of a standardized AIC is also derived.     

A Theorem on Products of Random Variables, With Application to Regression

It is shown that the product of two independent random variables in the domain of attraction of the normal distribution is also in the domain of attraction of the normal distribution, while if the product is in the domain of attraction of the normal distribution and one of the variables has finite variance, the other is in the domain of attraction of the normal distribution. This result is applied to prove the asymptotic normality of the regression coefficient in a linear regression when the error variance is not necessarily finite.     

Asymptotics for L1-estimators of regression parameters under heteroscedasticityY

We consider the asymptotic behaviour of L₁ -estimators in a linear regression under a very general form of heteroscedasticity. The limiting distributions of the estimators are derived under standard conditions on the design. We also consider the asymptotic behaviour of the bootstrap in the heteroscedastic model and show that it is consistent to first order only if the limiting distribution is normal.     

EXTREME VALUE THEORY FOR CERTAIN NON-STATIONARY SEQUENCES1

Under a Markovian structure on a sequence of random variables which can be partitioned into m(1) jointly dependent subsequences (where within each subsequence the random variables have a common marginal distribution which may vary between the subsequences), the asymptotic distribution theory of the sample extreme values is developed. The asymptotic independence of the subsequence extreme values is also studied.     

Efficiency of projected score methods in rectangular array asymptotics

Summary. The paper considers a rectangular array asymptotic embedding for multistratum data sets, in which both the number of strata and the number of within-stratum replications increase, and at the same rate. It is shown that under this embedding the maximum likelihood estimator is consistent but not efficient owing to a non-zero mean in its asymptotic normal distribution. By using a projection operator on the score function, an adjusted maximum likelihood estimator can be obtained that is asymptotically unbiased and has a variance that attains the Cramér–Rao lower bound. The adjusted maximum likelihood estimator can be viewed as an approximation to the conditional maximum likelihood estimator.     

Tests on the Equality of Two Multiple Correlation Coefficients

Asymptotic tests are suggested for testing the equality of two multiple correlation coefficients calculated from a single sample from a multivariate normal distribution. An F test is possible only when the two dependent variables coincide and one set of independent variables is a subset of the second set. Tests are compared by simulation for situations in which the F test is inapplicable. Special attention is paid to cases in which asymptotic normality of the test statistics does not hold.     

Bootstrapping regression models with BLUS residuals

To bootstrap a regression problem, pairs of response and explanatory variables or residuals can be resam‐pled, according to whether we believe that the explanatory variables are random or fixed. In the latter case, different residuals have been proposed in the literature, including the ordinary residuals (Efron 1979), standardized residuals (Bickel & Freedman 1983) and Studentized residuals (Weber 1984). Freedman (1981) has shown that the bootstrap from ordinary residuals is asymptotically valid when the number of cases increases and the number of variables is fixed. Bickel & Freedman (1983) have shown the asymptotic validity for ordinary residuals when the number of variables and the number of cases both increase, provided that the ratio of the two converges to zero at an appropriate rate. In this paper, the authors introduce the use of BLUS (Best Linear Unbiased with Scalar covariance matrix) residuals in bootstrapping regression models. The main advantage of the BLUS residuals, introduced in Theil (1965), is that they are uncorrelated. The main disadvantage is that only n —p residuals can be computed for a regression problem with n cases and p variables. The asymptotic results of Freedman (1981) and Bickel & Freedman (1983) for the ordinary (and standardized) residuals are generalized to the BLUS residuals. A small simulation study shows that even though only n — p residuals are available, in small samples bootstrapping BLUS residuals can be as good as, and sometimes better than, bootstrapping from standardized or Studentized residuals.     

Asymptotic expansions of the distributions of the chi-square statistic based on the asymptotically distribution-free theory in covariance structures

An asymptotic expansion of the null distribution of the chi-square statistic based on the asymptotically distribution-free theory for general covariance structures is derived under non-normality. The added higher-order term in the approximate density is given by a weighted sum of those of the chi-square distributed variables with different degrees of freedom. A formula for the corresponding Bartlett correction is also shown without using the above asymptotic expansion. Under a fixed alternative hypothesis, the Edgeworth expansion of the distribution of the standardized chi-square statistic is given up to order O(1/n). From the intermediate results of the asymptotic expansions for the chi-square statistics, asymptotic expansions of the joint distributions of the parameter estimators both under the null and fixed alternative hypotheses are derived up to order O(1/n).     

On the exact distribution of the sum of the largest n−k out of n normal random variables with differing mean values

Motivated by an application in Electrical Engineering, we derive the exact distribution of the sum of the largest n?k out of n normally distributed random variables, with differing mean values. Comparisons are made with two normal approximations to this distribution—one arising from the asymptotic negligibility of the omitted order statistics and one from the theory of L-statistics. The latter approximation is found to be in excellent agreement with the exact distribution.     

A note on the asymptotic distribution of the process capability index C pmk

Process capability indices have been widely used to evaluate the process performance to the continuous improvement of quality and productivity. The distribution of the estimator of the process capability index C _pmk is very complicated and the asymptotic distribution is proposed by Chen and Hsu [The asymptotic distribution of the processes capability index C _pmk , Comm. Statist. Theory Methods 24(5) (1995), pp. 1279–1291]. However, we found a critical error for the asymptotic distribution when the population mean is not equal to the midpoint of the specification limits. In this paper, a correct version of the asymptotic distribution is given. An asymptotic confidence interval of C _pmk by using the correct version of asymptotic distribution is proposed and the lower bound can be used to test if the process is capable. A simulation study of the coverage probability of the proposed confidence interval is shown to be satisfactory. The relation of six sigma technique and the index C _pmk is also discussed in this paper. An asymptotic testing procedure to determine if a process is capable based on the index of C _pmk is also given in this paper.     

Testing for spherical symmetry via the empirical characteristic function

Kolmogorov–Smirnov-type and Cramér–von Mises-type goodness-of-fit tests are proposed for the null hypothesis that the distribution of a random vector X is spherically symmetric. The test statistics utilize the fact that X has a spherical symmetric distribution if, and only if, the characteristic function of X is constant over surfaces of spheres centred at the origin. Both tests come in convenient forms that are straightforwardly applicable with the computer. The asymptotic null distribution of the test statistics as well as the consistency of the tests is investigated under general conditions. Since both the finite sample and the asymptotic null distribution depend on the unknown distribution of the Euclidean norm of X, a conditional Monte Carlo procedure is used to actually carry out the tests. Results on the behaviour of the test in finite-samples are included along with a real-data example.     

An exact test for nbue class of survival functions

Let F(x) be a life distribution. An exact test is given for testing H₀ F is exponential, versusH₁Fε NBUE (NWUE); along with a table of critical values for n=5(l)80, and n=80(5)65. An asymptotic test is made available for large values of n, where the standardized normal table can be used for testing.     

Strictly monotone and smooth nonparametric regression for two or more variables

The authors propose a new monotone nonparametric estimate for a regression function of two or more variables. Their method consists in applying successively one‐dimensional isotonization procedures on an initial, unconstrained nonparametric regression estimate. In the case of a strictly monotone regression function, they show that the new estimate and the initial one are first‐order asymptotic equivalent; they also establish asymptotic normality of an appropriate standardization of the new estimate. In addition, they show that if the regression function is not monotone in one of its arguments, the new estimate and the initial one have approximately the same L^p‐norm. They illustrate their approach by means of a simulation study, and two data examples are analyzed.     

Asymptotics for an Adaptive Trimmed Likelihood Location Estimator

An asymptotic normality result is given for an adaptive trimmed likelihood estimator of location, which parallels the asymptotic normality result for the adaptive trimmed mean. The new result comes out of studying the adaptive trimmed likelihood estimator modelled parametrically by a normal family but then examining the behavior when the underlying distribution is in fact some F different from normal. The asymptotic variance of the adaptive estimator is equal to the asymptotic variance of the trimmed likelihood estimator at the optimal trimming proportion for the distribution F, subject to that trimming proportion being positive and F being suitably smooth.     

Simultaneous robust estimation of location and scale parameters: A minimum-distance approach

Simultaneous robust estimates of location and scale parameters are derived from minimizing a minimum-distance criterion function. The criterion function measures the squared distance between the pth power (p > 0) of the empirical distribution function and the pth power of the imperfectly determined model distribution function over the real line. We show that the estimator is uniquely defined, is asymptotically bivariate normal and for p > 0.3 has positive breakdown. If the scale parameter is known, when p = 0.9 the asymptotic variance (1.0436) of the location estimator for the normal model is smaller than the asymptotic variance of the Hodges-Lehmann (HL)estimator (1.0472). Efficiencies with respect to HL and maximum-likelihood estimators (MLE) are 1.0034 and 0.9582, respectively. Similarly, if the location parameter is known, when p = 0.97 the asymptotic variance (0.6158) of the scale estimator is minimum. The efficiency with respect to the MLE is 0.8119. We show that the estimator can tolerate more corrupted observations at oo than at – for p < 1, and vice versa for p > 1.     

Convergence of the moment generating function of standardized quantiles

A sequence of independent, identically distributed random variables is considered. Given a simple local condition on the distribution of these random variables, we give necessary and sufficient conditions on the tails of the distribution for the moment generating function of a standardized quantile of the first n observations to converge to the moment generating function of an appropriate normal distribution as n →infinity;. This result is actually a special case of a more general result which can also be used to show convergence in distribution and convergence of moments of standardized quantiles.     

Application of a predictive distribution formula to Bayesian computation for incomplete data models

We consider exact and approximate Bayesian computation in the presence of latent variables or missing data. Specifically we explore the application of a posterior predictive distribution formula derived in Sweeting And Kharroubi (2003), which is a particular form of Laplace approximation, both as an importance function and a proposal distribution. We show that this formula provides a stable importance function for use within poor man’s data augmentation schemes and that it can also be used as a proposal distribution within a Metropolis-Hastings algorithm for models that are not analytically tractable. We illustrate both uses in the case of a censored regression model and a normal hierarchical model, with both normal and Student t distributed random effects. Although the predictive distribution formula is motivated by regular asymptotic theory, it is not necessary that the likelihood has a closed form or that it possesses a local maximum.     

Asymmetry models for square contingency tables: exact tests via algebraic statistics

Square contingency tables with the same row and column classification occur frequently in a wide range of statistical applications, e.g. whenever the members of a matched pair are classified on the same scale, which is usually ordinal. Such tables are analysed by choosing an appropriate loglinear model. We focus on the models of symmetry, triangular, diagonal and ordinal quasi symmetry. The fit of a specific model is tested by the chi-squared test or the likelihood-ratio test, where p-values are calculated from the asymptotic chi-square distribution of the test statistic or, if this seems unjustified, from the exact conditional distribution. Since the calculation of exact p-values is often not feasible, we propose alternatives based on algebraic statistics combined with MCMC methods.     

Asymptotic distributions of error density and distribution function estimators in nonparametric regression

This paper considers the problem of estimating the error density and distribution functions in nonparametric regression models. The asymptotic distribution of a suitably standardized density estimator at a fixed point is shown to be normal while that of the maximum of a suitably normalized deviation of the density estimator from the true density function is the same as in the case of the one sample set up. Finally, the standardized residual empirical process is shown to be uniformly close to the similarly standardized empirical process of the errors. This paper thus generalizes some of the well known results about the residual density estimators and the empirical process in parametric regression models to nonparametric regression models, thereby enhancing the domain of their applications.