A Class of Estimators of Population Variance Using Auxiliary Information in Sample Surveys

This article advocates the problem of estimating the population variance of the study variable using information on certain known parameters of an auxiliary variable. A class of estimators for population variance using information on an auxiliary variable has been defined. In addition to many estimators, usual unbiased estimator, Isaki's (1983), Upadhyaya and Singh's (1999), and Kadilar and Cingi's (2006) estimators are shown as members of the proposed class of estimators. Asymptotic expressions for bias and mean square error of the proposed class of estimators have been obtained. An empirical study has been carried out to judge the performance of the various estimators of population variance generated from the proposed class of estimators over usual unbiased estimator, Isaki's (1983), Upadhyaya and Singh's (1999) and Kadilar and Cingi's (2006) estimators.     

A useful tool for statistical estimation: genetic algorithms

In this article, we introduce genetic algorithms (GAs) as a viable tool in estimating parameters in a wide array of statistical models. We performed simulation studies that compared the bias and variance of GAs with classical tools, namely, the steepest descent, Gauss–Newton, Levenberg–Marquardt and don't use derivative methods. In our simulation studies, we used the least squares criterion as the optimizing function. The performance of the GAs and classical methods were compared under the logistic regression model; non-linear Gaussian model and non-linear non-Gaussian model. We report that the GAs' performance is competitive to the classical methods under these three models.     

Aggregated functional data model for near-infrared spectroscopy calibration and prediction

Calibration and prediction for NIR spectroscopy data are performed based on a functional interpretation of the Beer–Lambert formula. Considering that, for each chemical sample, the resulting spectrum is a continuous curve obtained as the summation of overlapped absorption spectra from each analyte plus a Gaussian error, we assume that each individual spectrum can be expanded as a linear combination of B-splines basis. Calibration is then performed using two procedures for estimating the individual analytes’ curves: basis smoothing and smoothing splines. Prediction is done by minimizing the square error of prediction. To assess the variance of the predicted values, we use a leave-one-out jackknife technique. Departures from the standard error models are discussed through a simulation study, in particular, how correlated errors impact on the calibration step and consequently on the analytes’ concentration prediction. Finally, the performance of our methodology is demonstrated through the analysis of two publicly available datasets.     

Mean shift and influence measures in linear measurement error models with stochastic linear restrictions

We present influence diagnostics for linear measurement error models with stochastic linear restrictions using the corrected likelihood of Nakamura in 1990. The case deletion and mean shift outlier models are developed to identify outlying and influential observations. We derive a corrected score test statistic for outlier detection based on mean shift outlier models. The analogs of Cook's distance and likelihood distance are proposed to determine influential observations based on case deletion models. A parametric bootstrap procedure is used to obtain empirical distributions of the test statistics and a simulation study has been used to evaluate the performance of the proposed estimators based on the mean squares error criterion and the score test statistic. Finally, a numerical example is given to illustrate the theoretical results.     

Performance of nonparametric multiple comparison tests under heteroscedasticity,dependency, and skewed error distribution

In this article, an extensive Monte Carlo simulation study is conducted to evaluate and compare nonparametric multiple comparison tests under violations of classical analysis of variance assumptions. Simulation space of the Monte Carlo study is composed of 288 different combinations of balanced and unbalanced sample sizes, number of groups, treatment effects, various levels of heterogeneity of variances, dependence between subgroup levels, and skewed error distributions under the single factor experimental design. By this large simulation space, we present a detailed analysis of effects of the violations of assumptions on the performance of nonparametric multiple comparison tests in terms of three error and four power measures. Observations of this study are beneficial to decide the optimal nonparametric test according to requirements and conditions of undertaken experiments. When some of the assumptions of analysis of variance are violated and number of groups is small, use of stepwise Steel-Dwass procedure with Holm's approach is appropriate to control type I error at a desired level. Dunn's method should be employed for greater number of groups. When subgroups are unbalanced and number of groups is small, Nemenyi's procedure with Duncan's approach produces high power values. Conover's procedure successfully provides high power values with a small number of unbalanced groups or with a greater number of balanced or unbalanced groups. At the same time, Conover's procedure is unable to control type I error rates.     

Estimation of inaccuracy measure for censored dependent data

In the present paper, we propose non parametric estimators for the inaccuracy measure for the lifetime distribution based on censored data. This measure plays important roles in reliability and survival analysis in connection with modeling and analysis of life time data. Asymptotic properties of the estimators are established under suitable regularity conditions. Monte Carlo simulation studies are carried out to compare the performance of the estimators using the mean-squared error. The methods are illustrated using a real data set.     

Redescending M-estimators

In finite sample studies redescending M-estimators outperform bounded M-estimators (see for example, Andrews et al. [1972. Robust Estimates of Location. Princeton University Press, Princeton]). Even though redescenders arise naturally out of the maximum likelihood approach if one uses very heavy-tailed models, the commonly used redescenders have been derived from purely heuristic considerations. Using a recent approach proposed by Shurygin, we study the optimality of redescending M-estimators. We show that redescending M-estimator can be designed by applying a global minimax criterion to locally robust estimators, namely maximizing over a class of densities the minimum variance sensitivity over a class of estimators. As a particular result, we prove that Smith's estimator, which is a compromise between Huber's skipped mean and Tukey's biweight, provides a guaranteed level of an estimator's variance sensitivity over the class of densities with a bounded variance.     

A Combined Nonlinear Programming Model and Kibria Method for Choosing Ridge Parameter Regression

Ridge regression solves multicollinearity problems by introducing a biasing parameter that is called ridge parameter; it shrinks the estimates as well as their standard errors in order to reach acceptable results. Many methods are available for estimating a ridge parameter. This article has considered some of these methods and also proposed a combined nonlinear programming model and Kibria method. A simulation study has been made to evaluate the performance of the proposed estimators based on the minimum mean squared error criterion. The simulation study indicates that under certain conditions the proposed estimators outperform the least squares (LS) estimators and other popular existing estimators. Moreover, the new proposed model is applied on dataset that suffers also from the presence of heteroscedastic errors.     

A Bayesian approach with generalized ridge estimation for high-dimensional regression and testing

This paper adopts a Bayesian strategy for generalized ridge estimation for high-dimensional regression. We also consider significance testing based on the proposed estimator, which is useful for selecting regressors. Both theoretical and simulation studies show that the proposed estimator can simultaneously outperform the ordinary ridge estimator and the LSE in terms of the mean square error (MSE) criterion. The simulation study also demonstrates the competitive MSE performance of our proposal with the Lasso under sparse models. We demonstrate the method using the lung cancer data involving high-dimensional microarrays.     

Testing of homogeneity of variance and autocorrelation coefficients of nonlinear mixed models with AR(1) errors based on M-estimation

Homogeneity of between-individual variance and autocorrelation coefficients is one of assumptions in the study of longitudinal data. However, the assumption could be challenging due to the complexity of the dataset. In the paper we propose and analyze nonlinear mixed models with AR(1) errors for longitudinal data, intend to introduce Huber's function in the log-likelihood function and get robust estimation, which may help to reduce the influence of outliers, by Fisher scoring method. Testing of homogeneity of variance among individuals and autocorrelation coefficients on the basis of Huber's M-estimation is studied later in the paper. Simulation studies are carried to assess performance of score test we proposed. Results obtained from plasma concentrations data are reported as an illustrative example.     

Testing Periodicity in Short Series and Application to Gene Expression Data

Testing for periodicity in microarray time series encounters the challenges of short series length, missing values and presence of non-Fourier frequencies. In this article, a test method for such series has been proposed. The method is completely simulation based and finds p-values for test of periodicity through fitting Pearson Type VI distribution. The simulation results compare and reveal the excellence of this method over Fisher's g test for varying series length, frequencies, and error variance. This approach is applied to Caulobacter crescentus cell cycle data in order to demonstrate the practical performance.     

Finite sample properties of beale's ratio estimator

In this paper, the exact blas and mean square error of Beale's ratio estimator are derived under a blvariate normal nlodel in the form of an infinite series. It is found that some conventional large sample approxlmatlons are extremely poor if the relative variance of the auxlllary variable X is large. It is also brought out through this.study that Beale's estimator of the population mean seems to be more efficient than the usual sanple mean under the condition resulting from the large sample comparison of the customary ratio estimator and the usual sample mean.     

PITMAN NEARNESS COMPARISONS OF ESTIMATES OF TWO ORDERED NORMAL MEANS

Maximum likelihood estimates of ordered means of two normal distributions having common variance have been shown to be better than the usual maximum likelihood estimates (i.e. corresponding sample means) with respect to Pitman Nearness criterion. The maximum likelihood estimate of common variance taking into consideration the order restriction of the means is shown to have smaller mean square error than the unrestricted maximum likelihood estimate of the common variance. These two estimators have also been compared with respect to Pitman Nearness criterion.     

Focused information criteria for copulas

In this paper, we extend the focused information criterion (FIC) to copula models. Copulas are often used for applications where the joint tail behavior of the variables is of particular interest, and selecting a copula that captures this well is then essential. Traditional model selection methods such as the Akaike information criterion (AIC) and the Bayesian information criterion (BIC) aim at finding the overall best‐fitting model, which is not necessarily the one best suited for the application at hand. The FIC, on the other hand, evaluates and ranks candidate models based on the precision of their point estimates of a context‐given focus parameter. This could be any quantity of particular interest, for example, the mean, a correlation, conditional probabilities, or measures of tail dependence. We derive FIC formulae for the maximum likelihood estimator, the two‐stage maximum likelihood estimator, and the so‐called pseudo‐maximum‐likelihood (PML) estimator combined with parametric margins. Furthermore, we confirm the validity of the AIC formula for the PML estimator combined with parametric margins. To study the numerical behavior of FIC, we have carried out a simulation study, and we have also analyzed a multivariate data set pertaining to abalones. The results from the study show that the FIC successfully ranks candidate models in terms of their performance, defined as how well they estimate the focus parameter. In terms of estimation precision, FIC clearly outperforms AIC, especially when the focus parameter relates to only a specific part of the model, such as the conditional upper‐tail probability.     

A Summary of Some Research on PC and Bayesian PC Criterion in China

In the past two decades, Pitman closeness (PC) criterion has been studied intensively in China. But many of research works were written in Chinese, which cannot be accessed by researchers from other countries. In this paper, we briefly summarize part of main results on the PC criterion in linear model in China. First, we present the basic model and some definitions. Then, we introduce the PC superiority for covariance adjustment estimate, and a class of biased estimates such as a kind of linear estimate, James–Stein estimate and the principal components estimate. Third, we introduce Bayesian PC superiorities for several different linear models such as ordinary univariate regression model, multivariate linear model and analysis of variance model. Finally, some results of robustness under Bayesian PC criterion are shown.     

Inference after separated hypotheses testing: an empirical investigation for linear models

Model selection problems arise while constructing unbiased or asymptotically unbiased estimators of measures known as discrepancies to find the best model. Most of the usual criteria are based on goodness-of-fit and parsimony. They aim to maximize a transformed version of likelihood. For linear regression models with normally distributed error, the situation is less clear when two models are equivalent: are they close to or far from the unknown true model? In this work, based on stochastic simulation and parametric simulation, we study the results of Vuong's test, Cox's test, Akaike's information criterion, Bayesian information criterion, Kullback information criterion and bias corrected Kullback information criterion and the ability of these tests to discriminate between non-nested linear models.     

Estimation of variance of a normal population

In this paper we have suggested two estimators of variance of a normal population developed from the estimators of u² suggested by Govindarajulu and Sahai and Das. These have been shown to be more efficient than the usual estimator s².     

A comparison of bootstrap approaches for estimating uncertainty of parameters in linear mixed‐effects models

A version of the nonparametric bootstrap, which resamples the entire subjects from original data, called the case bootstrap, has been increasingly used for estimating uncertainty of parameters in mixed‐effects models. It is usually applied to obtain more robust estimates of the parameters and more realistic confidence intervals (CIs). Alternative bootstrap methods, such as residual bootstrap and parametric bootstrap that resample both random effects and residuals, have been proposed to better take into account the hierarchical structure of multi‐level and longitudinal data. However, few studies have been performed to compare these different approaches. In this study, we used simulation to evaluate bootstrap methods proposed for linear mixed‐effect models. We also compared the results obtained by maximum likelihood (ML) and restricted maximum likelihood (REML). Our simulation studies evidenced the good performance of the case bootstrap as well as the bootstraps of both random effects and residuals. On the other hand, the bootstrap methods that resample only the residuals and the bootstraps combining case and residuals performed poorly. REML and ML provided similar bootstrap estimates of uncertainty, but there was slightly more bias and poorer coverage rate for variance parameters with ML in the sparse design. We applied the proposed methods to a real dataset from a study investigating the natural evolution of Parkinson's disease and were able to confirm that the methods provide plausible estimates of uncertainty. Given that most real‐life datasets tend to exhibit heterogeneity in sampling schedules, the residual bootstraps would be expected to perform better than the case bootstrap. Copyright © 2013 John Wiley & Sons, Ltd.     

A comparison of robust versions of the AIC based on M-, S- and MM-estimators

Variable selection in the presence of outliers may be performed by using a robust version of Akaike's information criterion (AIC). In this paper, explicit expressions are obtained for such criteria when S- and MM-estimators are used. The performance of these criteria is compared with the existing AIC based on M-estimators and with the classical non-robust AIC. In a simulation study and in data examples, we observe that the proposed AIC with S and MM-estimators selects more appropriate models in case outliers are present.     

Detection of outliers in growth curve models

The growth curve model introduced by Potthoff and Roy (1964) is a general statistical model which includes as special cases regression models and both univariate and multivariate analysis of variance models. In this paper, we discuss procedures for detection of outliers in growth curve models for mean-slippage and dispersion-slippage outlier model. The distributions of the test statistics are discussed and the values of significant probabilities are given using Bonferronl's bounds. Some simulation results are also presented.