Estimate of variance of u-statistics

Let g(x₁,… , x_k) be a symmetric function with k arguments. Let U be a U-statistic based on a random sample of size n with kernel function g . In this paper, the problem of estimating var(U) is considered. Several estimators are compared by computer simulations and we conclude that two estimators, one is constructed as a U-statistic and the other is the bootstrap estimator, give good estimates for many U-statistics.     

Conditional variance estimation in heteroscedastic regression models

First, we propose a new method for estimating the conditional variance in heteroscedasticity regression models. For heavy tailed innovations, this method is in general more efficient than either of the local linear and local likelihood estimators. Secondly, we apply a variance reduction technique to improve the inference for the conditional variance. The proposed methods are investigated through their asymptotic distributions and numerical performances.     

Subsampling-extrapolation bandwidth selection in bivariate kernel density estimation

This paper focuses on bivariate kernel density estimation that bridges the gap between univariate and multivariate applications. We propose a subsampling-extrapolation bandwidth matrix selector that improves the reliability of the conventional cross-validation method. The proposed procedure combines a U-statistic expression of the mean integrated squared error and asymptotic theory, and can be used in both cases of diagonal bandwidth matrix and unconstrained bandwidth matrix. In the subsampling stage, one takes advantage of the reduced variability of estimating the bandwidth matrix at a smaller subsample size m (m < n); in the extrapolation stage, a simple linear extrapolation is used to remove the incurred bias. Simulation studies reveal that the proposed method reduces the variability of the cross-validation method by about 50% and achieves an expected integrated squared error that is up to 30% smaller than that of the benchmark cross-validation. It shows comparable or improved performance compared to other competitors across six distributions in terms of the expected integrated squared error. We prove that the components of the selected bivariate bandwidth matrix have an asymptotic multivariate normal distribution, and also present the relative rate of convergence of the proposed bandwidth selector.     

On estimating the variance of a U-statistic

We compare jackknifing and bootstrapping as methods for estimating the variance of a U-statistic. The use of these estimates in calculating asymptotic confidence intervals is discussed, and the results of a numerical study involving Kendall's tau are reported. For the special case of this statistic, the bootstrap is the estimate of choice.     

Simple heterogeneity variance estimation for meta-analysis

Summary.  A simple method of estimating the heterogeneity variance in a random-effects model for meta-analysis is proposed. The estimator that is presented is simple and easy to calculate and has improved bias compared with the most common estimator used in random-effects meta-analysis, particularly when the heterogeneity variance is moderate to large. In addition, it always yields a non-negative estimate of the heterogeneity variance, unlike some existing estimators. We find that random-effects inference about the overall effect based on this heterogeneity variance estimator is more reliable than inference using the common estimator, in terms of coverage probability for an interval estimate.     

Iterative weighted estimation based on variance modelling in linear regression models

ABSTRACT

The estimation of variance function plays an extremely important role in statistical inference of the regression models. In this paper we propose a variance modelling method for constructing the variance structure via combining the exponential polynomial modelling method and the kernel smoothing technique. A simple estimation method for the parameters in heteroscedastic linear regression models is developed when the covariance matrix is unknown diagonal and the variance function is a positive function of the mean. The consistency and asymptotic normality of the resulting estimators are established under some mild assumptions. In particular, a simple version of bootstrap test is adapted to test misspecification of the variance function. Some Monte Carlo simulation studies are carried out to examine the finite sample performance of the proposed methods. Finally, the methodologies are illustrated by the ozone concentration dataset.     

Improved estimation of variance components in balanced hierarchical mixed models

The problem of simultaneous estimation of variance components is considered for a balanced hierarchical mixed model under a sum of squared error loss. A new class of estimators is suggested which dominate the usual sensible estimators. These estimators shrink towards the geometric mean of the component mean squares that appear in the ANOVA table. Numerical results are tabled to exhibit the improvement in risk under a simple model.     

Variance estimation in the analysis of microarray data

Summary.  Microarrays are one of the most widely used high throughput technologies. One of the main problems in the area is that conventional estimates of the variances that are required in the t -statistic and other statistics are unreliable owing to the small number of replications. Various methods have been proposed in the literature to overcome this lack of degrees of freedom problem. In this context, it is commonly observed that the variance increases proportionally with the intensity level, which has led many researchers to assume that the variance is a function of the mean. Here we concentrate on estimation of the variance as a function of an unknown mean in two models: the constant coefficient of variation model and the quadratic variance–mean model. Because the means are unknown and estimated with few degrees of freedom, naive methods that use the sample mean in place of the true mean are generally biased because of the errors-in-variables phenomenon. We propose three methods for overcoming this bias. The first two are variations on the theme of the so-called heteroscedastic simulation–extrapolation estimator, modified to estimate the variance function consistently. The third class of estimators is entirely different, being based on semiparametric information calculations. Simulations show the power of our methods and their lack of bias compared with the naive method that ignores the measurement error. The methodology is illustrated by using microarray data from leukaemia patients.     

Effectual variance estimation strategy in two-occasion successive sampling in presence of random non response

Present investigation deals with the problem of random non response in estimation of population variance on current occasion in two-occasion successive sampling. To reduce the negative impact of random non response on both occasions, regression type imputation method has been suggested. Using auxiliary information, efficient estimation strategies have been developed for estimation of population variance on the current occasion. Estimator for the population variance is also derived as a special case when random non response occurs only on the current occasion. Empirical studies are carried out to show the dominance of suggested estimators over sample variance and exponential type estimators. Results are interpreted.     

Wavelet-based estimation of regression function with strong mixing errors under fixed design

We consider wavelet-based non linear estimators, which are constructed by using the thresholding of the empirical wavelet coefficients, for the mean regression functions with strong mixing errors and investigate their asymptotic rates of convergence. We show that these estimators achieve nearly optimal convergence rates within a logarithmic term over a large range of Besov function classes B^s_{p, q}. The theory is illustrated with some numerical examples.

A new ingredient in our development is a Bernstein-type exponential inequality, for a sequence of random variables with certain mixing structure and are not necessarily bounded or sub-Gaussian. This moderate deviation inequality may be of independent interest.     

Testing Linear Regression Models in Non Regular Case

We propose a new statistic for testing linear hypotheses in the non parametric regression model in the case of a homoscedastic error structure and fixed design. In contrast to most models suggested in the literature, our procedure is applicable in the non parametric model case without regularity condition, and also under either the null or the alternative hypotheses. We show the asymptotic normality of the test statistic under the null hypothesis and the alternative one. A simulation study is conducted to investigate the finite sample properties of the test with application to regime switching.     

On difference-based variance estimation in nonparametric regression when the covariate is high dimensional

Summary.  We consider the problem of estimating the noise variance in homoscedastic nonparametric regression models. For low dimensional covariates t  ∈  R ^d ,  d =1, 2, difference-based estimators have been investigated in a series of papers. For a given length of such an estimator, difference schemes which minimize the asymptotic mean-squared error can be computed for d =1 and d =2. However, from numerical studies it is known that for finite sample sizes the performance of these estimators may be deficient owing to a large finite sample bias. We provide theoretical support for these findings. In particular, we show that with increasing dimension d this becomes more drastic. If d 4, these estimators even fail to be consistent. A different class of estimators is discussed which allow better control of the bias and remain consistent when d 4. These estimators are compared numerically with kernel-type estimators (which are asymptotically efficient), and some guidance is given about when their use becomes necessary.     

Unbiased estimation in type II censored samples prom two-truncation parameter family

We consider a type II censored sample data from a two-truncation parameter density and obtain the UMVU estimator for an U-estimable parametric function. An explicit expression for the estimator is derived and some interesting special cases are developed. The shortest length confidence interval for the density is also obtained.     

Multiple-start balanced modified systematic sampling in the presence of linear trend

ABSTRACT

In this paper, we propose a sampling design termed as multiple-start balanced modified systematic sampling (MBMSS), which involves the supplementation of two or more balanced modified systematic samples, thus permitting us to obtain an unbiased estimate of the associated sampling variance. There are five cases for this design and in the presence of linear trend only one of these cases is optimal. To further improve results for the other cases, we propose an estimator that removes linear trend by applying weights to the first and last sampling units of the selected balanced modified systematic samples and is thus termed as the MBMSS with end corrections (MBMSSEC) estimator. By assuming a linear trend model averaged over a super-population model, we will compare the expected mean square errors (MSEs) of the proposed sample means, to that of simple random sampling (SRS), linear systematic sampling (LSS), stratified random sampling (STR), multiple-start linear systematic sampling (MLSS), and other modified MLSS estimators. As a result, MBMSS is optimal for one of the five possible cases, while the MBMSSEC estimator is preferred for three of the other four cases.     

C472. The expected value of a conditional variance: An upper bound

The article derives Bartlett corrections for improving the chi-square approximation to the likelihood ratio statistics in a class of symmetric nonlinear regression models. This is a wide class of models which encompasses the t model and several other symmetric distributions with longer-than normal tails. In this paper we present, in matrix notation, Bartlett corrections to likelihood ratio statistics in nonlinear regression models with errors that follow a symmetric distribution. We generalize the results obtained by Ferrari, S. L. P. and Arellano-Valle, R. B. (1996). Modified likelihood ratio and score tests in linear regression models using the t distribution. Braz. J. Prob. Statist., 10, 15–33, who considered a t distribution for the errors, and by Ferrari, S. L. P. and Uribe-Opazo, M. A. (2001). Corrected likelihood ratio tests in a class of symmetric linear regression models. Braz. J. Prob. Statist., 15, 49–67, who considered a symmetric linear regression model. The formulae derived are simple enough to be used analytically to obtain several Bartlett corrections in a variety of important models. We also present simulation results comparing the sizes and powers of the usual likelihood ratio tests and their Bartlett corrected versions.     

Half-sample variance estimation

This paper studies an alternative to the jackknife variance estimator, the half-sample variance estimator. Both theoretical and Monte Carlo comparisons between the half-sample variance estimator and the jackknife variance estimator indicate that the former is better in some situations.     

A variance shift model for detection of outliers in the linear mixed measurement error models

ABSTRACT

In this paper, we extend a variance shift model, previously considered in the linear mixed models, to the linear mixed measurement error models using the corrected likelihood of Nakamura (1990 Nakamura, T. (1990). Corrected score function for errors in variables models: methodology and application to generalized linear models. Biometrika 77:127–137.[Crossref], [Web of Science ®] , [Google Scholar]). This model assumes that a single outlier arises from an observation with inflated variance. We derive the score test and the analogue of the likelihood ratio test, to assess whether the ith observation has inflated variance. A parametric bootstrap procedure is implemented to obtain empirical distributions of the test statistics. Finally, results of a simulation study and an example of real data are presented to illustrate the performance of proposed tests.     

Linear approximate ML estimation in scaled Type I generalized logistic distribution based on Type-II censored samples

The scaled (two-parameter) Type I generalized logistic distribution (GLD) is considered with the known shape parameter. The ML method does not yield an explicit estimator for the scale parameter even in complete samples. In this article, we therefore construct a new linear estimator for scale parameter, based on complete and doubly Type-II censored samples, by making linear approximations to the intractable terms of the likelihood equation using least-squares (LS) method, a new approach of linearization. We call this as linear approximate maximum likelihood estimator (LAMLE). We also construct LAMLE based on Taylor series method of linear approximation and found that this estimator is slightly biased than that based on the LS method. A Monte Carlo simulation is used to investigate the performance of LAMLE and found that it is almost as efficient as MLE, though biased than MLE. We also compare unbiased LAMLE with BLUE based on the exact variances of the estimators and interestingly this new unbiased LAMLE is found just as efficient as the BLUE in both complete and Type-II censored samples. Since MLE is known as asymptotically unbiased, in large samples we compare unbiased LAMLE with MLE and found that this estimator is almost as efficient as MLE. We have also discussed interval estimation of the scale parameter from complete and Type-II censored samples. Finally, we present some numerical examples to illustrate the construction of the new estimators developed here.