Ridge Regression – A Simulation Study

In this article we assess the suitability of two new ridge estimators by means of a simulation study. We compare these estimators with well-known ridge estimators. We also make direct comparisons between the ordinary least squares (OLS) estimator and the ridge estimators by using ratio of the average total mean square error of the OLS estimator and the ridge estimators. We find that the new estimators perform well under certain conditions.     

Separate Ratio Estimators for the Population Variance in Stratified Random Sampling

We propose separate ratio estimators for population variance in stratified random sampling. We obtain mean square error equations and compare proposed estimators about efficiency with each other. By these comparisons, we find the conditions which make proposed estimators more efficient than others. It has been shown that proposed classes of estimators are more efficient than usual unbiased estimator. We find that separate ratio estimators are more efficient than combined ratio estimators for population variance. The theoretical results are supported by a numerical illustration with original data. A simulation study is also carried out to investigate empirical performance of estimators.     

Nonparametric Shrinkage Estimation for Aalen's Additive Hazards Model

Aalen's nonparametric additive model in which the regression coefficients are assumed to be unspecified functions of time is a flexible alternative to Cox's proportional hazards model when the proportionality assumption is in doubt. In this paper, we incorporate a general linear hypothesis into the estimation of the time‐varying regression coefficients. We combine unrestricted least squares estimators and estimators that are restricted by the linear hypothesis and produce James‐Stein‐type shrinkage estimators of the regression coefficients. We develop the asymptotic joint distribution of such restricted and unrestricted estimators and use this to study the relative performance of the proposed estimators via their integrated asymptotic distributional risks. We conduct Monte Carlo simulations to examine the relative performance of the estimators in terms of their integrated mean square errors. We also compare the performance of the proposed estimators with a recently devised LASSO estimator as well as with ridge‐type estimators both via simulations and data on the survival of primary billiary cirhosis patients.     

Improved estimators for the common mean and ordered means of two normal distributions with ordered variances

We first consider the problem of estimating the common mean of two normal distributions with unknown ordered variances. We give a broad class of estimators which includes the estimators proposed by Nair (1982) and Elfessi et al. (1992) and show that the estimators stochastically dominate the estimators which do not take into account the order restriction on variances, including the one given by Graybill and Deal (1959). Then we propose a broad class of individual estimators of two ordered means when unknown variances are ordered. We show that in estimating the mean with larger variance, estimators which do not take into account the order restriction on variances are stochastically dominated by the proposed class of estimators which take into account both order restrictions. However, in estimating the mean with smaller variance, similar improvement is not possible even in terms of mean squared error. We also show a domination result in the simultaneous estimation problem of two ordered means. Further, improving upon the unbiased estimators of the two means is discussed.     

Marshall–Olkin distribution: parameter estimation and application to cancer data

In this study, as alternatives to the maximum likelihood (ML) and the frequency estimators, we propose robust estimators for the parameters of Zipf and Marshall–Olkin Zipf distributions. A small simulation study is given to illustrate the performance of the proposed estimators. We apply the proposed estimators to a real data set from cancer research to illustrate the performance of the proposed estimators over the ML, moments and frequency estimators. We observe that the robust estimators have superiority over the frequency estimators based on classical sample mean.     

On self-consistent estimators and kernel density estimators with doubly censored data

We study the detailed structure (in a large sample) of the self-consistent estimators of the survival functions with doubly censored data. We also introduce the kernel-type density estimators based on the self-consistent estimators, and using our results on the structure of the self-consistent estimators, we establish the strong uniform consistency and the asymptotic normality of the kernel density estimators for doubly censored data. From these, the strong uniform consistency and the asymptotic normality of the failure rate estimators for doubly censored data are derived.     

Reducing Bias and Mean Squared Error Associated With Regression-Based Odds Ratio Estimators

Ratio estimators of effect are ordinarily obtained by exponentiating maximum-likelihood estimators (MLEs) of log-linear or logistic regression coefficients. These estimators can display marked positive finite-sample bias, however. We propose a simple correction that removes a substantial portion of the bias due to exponentiation. By combining this correction with bias correction on the log scale, we demonstrate that one achieves complete removal of second-order bias in odds ratio estimators in important special cases. We show how this approach extends to address bias in odds or risk ratio estimators in many common regression settings. We also propose a class of estimators that provide reduced mean bias and squared error, while allowing the investigator to control the risk of underestimating the true ratio parameter. We present simulation studies in which the proposed estimators are shown to exhibit considerable reduction in bias, variance, and mean squared error compared to MLEs. Bootstrapping provides further improvement, including narrower confidence intervals without sacrificing coverage.     

Bayesian analysis of complementary Poisson rate parameters with data subject to misclassification

We formulate closed-form Bayesian estimators for two complementary Poisson rate parameters using double sampling with data subject to misclassification and error free data. We also derive closed-form Bayesian estimators for two misclassification parameters in the modified Poisson model we assume. We use our results to determine credible sets for the rate and misclassification parameters. Additionally, we use MCMC methods to determine Bayesian estimators for three or more rate parameters and the misclassification parameters. We also perform a limited Monte Carlo simulation to examine the characteristics of these estimators. We demonstrate the efficacy of the new Bayesian estimators and highest posterior density regions with examples using two real data sets.     

The Information Geometric Structure of Generalized Empirical Likelihood Estimators

The generalized empirical likelihood (GEL) method produces a class of estimators of parameters defined via general estimating equations. This class includes several important estimators, such as empirical likelihood (EL), exponential tilting (ET), and continuous updating estimators (CUE). We examine the information geometric structure of GEL estimators. We introduce a class of estimators closely related to the class of minimum divergence (MD) estimators and show that there is a one-to-one correspondence between this class and the class GEL.     

INDEX TO VOLUME 17 (1999)

We study how to select or combine estimators of the average treatment effect (ATE) and the average treatment effect on the treated (ATT) in the presence of multiple sets of covariates. We consider two cases: (1) all sets of covariates satisfy the unconfoundedness assumption and (2) some sets of covariates violate the unconfoundedness assumption locally. For both cases, we propose a data-driven covariate selection criterion (CSC) to minimize the asymptotic mean squared errors (AMSEs). Based on our CSC, we propose new average estimators of ATE and ATT, which include the selected estimators based on a single set of covariates as a special case. We derive the asymptotic distributions of our new estimators and propose how to construct valid confidence intervals. Our Monte Carlo simulations show that in finite samples, our new average estimators achieve substantial efficiency gains over the estimators based on a single set of covariates. We apply our new estimators to study the impact of inherited control on firm performance.     

Estimation of parameters of inverse Weibull distribution and application to multi-component stress-strength model

The problem of estimation of the parameters of two-parameter inverse Weibull distributions has been considered. We establish existence and uniqueness of the maximum likelihood estimators of the scale and shape parameters. We derive Bayes estimators of the parameters under the entropy loss function. Hierarchical Bayes estimator, equivariant estimator and a class of minimax estimators are derived when shape parameter is known. Ordered Bayes estimators using information about second population are also derived. We investigate the reliability of multi-component stress-strength model using classical and Bayesian approaches. Risk comparison of the classical and Bayes estimators is done using Monte Carlo simulations. Applications of the proposed estimators are shown using real data sets.     

Robust estimators based on generalization of trimmed mean

In this article, we propose new estimators of location. These estimators select a robust set around the geometric median, enlarge it, and compute the (iterative) weighted mean from it. By doing so, we obtain a robust estimator in the sense of the breakdown point, which uses more observations than standard estimators. We apply our approach on the concepts of boxplot and bagplot. We work in a general normed vector space and allow multi-valued estimators.     

Efficient Estimation of Parameters of the Negative Binomial Distribution

In this article we investigate a class of moment-based estimators, called power method estimators, which can be almost as efficient as maximum likelihood estimators and achieve a lower asymptotic variance than the standard zero term method and method of moments estimators. We investigate different methods of implementing the power method in practice and examine the robustness and efficiency of the power method estimators.     

Change-Point Estimation in Long Memory Nonparametric Models with Applications

We consider the estimation of a change point or discontinuity in a regression function for random design model with long memory errors. We provide several change-point estimators and investigate the consistency of the estimators. Using the fractional ARIMA process as an example of long memory process, we report a small Monte Carlo experiment to compare the performance of the estimators in finite samples. We finish by applying the method to a climatological data example.     

Invariant methods for estimating variance components in mixed linear models 2

The subject of this contribution is to present a survey on new methods for variance component estimation, which appeared in the literature in recent years. Starting from mixed models treated in analysis of variance research work on this field turned over to a more general approach in which the covariance matrix of the vector of observations is assumed to be a unknown linear combination of known symmetric matrices. Much interest has been shown in developing some kinds op optimal estimators for the unknown parameters and most results were obtained for estimators being invariant with respect to a certain group of translations. Therefore we restrict attention to this class of estimates. We will deal with minimum variance unbiased estimators, least squared errors estimators, maximum likelihood estimators. Bayes quadratic estimators and show some relations to the mimimum norm quadratic unbiased estimation principle (MINQUE) introduced by C. R. Rao [20]. We do not mention the original motivation of MINQUE since the otion of minimum norm depends on a measure that is not accepted by all statisticians. Also we do‘nt deal with other approaches like the BAYEsian and fiducial methods which were successfully applied by S. Portnoy [18], P. Rusolph [22], G. C. Tiao, W. Y. Tan [28], M. J. K. Healy [9] and others, although in very special situations, only. Additionally we add some new results and also new insight in the properties of known estimators. We give a new characterization of MINQUE in the class of all estimators, extend explicite expressions for locally optimal quadratic estimators given by C. R. Rao [22] to a slightly more general situation and prove complete class theorems useful for the computation of BAYES quadratic estimators. We also investigate situations in which BAYES quadratic unbiased estimators do'nt change if the distribution of the error terms differ from the normal distribution.     

A novel weighted likelihood estimation with empirical Bayes flavor

We propose a novel approach to estimation, where a set of estimators of a parameter is combined into a weighted average to produce the final estimator. The weights are chosen to be proportional to the likelihood evaluated at the estimators. We investigate the method for a set of estimators obtained by using the maximum likelihood principle applied to each individual observation. The method can be viewed as a Bayesian approach with a data-driven prior distribution. We provide several examples illustrating the new method and argue for its consistency, asymptotic normality, and efficiency. We also conduct simulation studies to assess the performance of the estimators. This straightforward methodology produces consistent estimators comparable with those obtained by the maximum likelihood method. The method also approximates the distribution of the estimator through the “posterior” distribution.     

On a class of improved estimators of variance and estimation under order restriction

We consider the estimation of error variance and construct a class of estimators improving upon the usual estimators uniformly under entropy loss or under squared error loss. Through a Monte Carlo simulation study, the magnitude of the risk reduction of our improved estimator as compared with the usual one is examined in a context of a nested linear hypothesis testing of a linear regression model, where substantial risk reduction can be attained. We also construct a class of confidence intervals having larger coverage probabilities and not larger interval lengths than those of the usual ones. This allows us to construct a class of estimators universally dominating the usual ones. Further, we consider the estimation of order-restricted normal variances. We give a class of isotonic regression estimators improving upon the usual ones under various types of order restrictions. We also give a class of improved confidence intervals over the usual ones, and a class of estimators universally dominating the usual ones.     

Estimation in a Two Variance Components Model When one Component is Known

We study a mixed linear model with two variance components. We suppose that one component is known. The objective of the paper is the estimation of the unknown component. The usual MINQE estimators seem to be unadapted to the problem. So we propose a new family of quadratic estimators, based on a natural class of estimators and the idea upon which the MINQE theory is built. All the estimators are compared on simulated data.     

Estimation of Variance Components for a Linear Toeplitz Model

The linear Toeplitz covariance structure model of order one is considered. We give some elegant explicit expressions of the Locally Minimum Variance Quadratic Unbiased Estimators of its covariance parameters. We deduce from a Monte Carlo method some properties of their Gaussian maximum likelihood estimators. Finally, for small sample sizes, these two types of estimators are compared with the intuitive empirical estimators and it is shown that the empirical biased estimators should be used.     

Amplitude modulated model for analyzing non-stationary speech signals

Recently amplitude modulated (AM) model in presence of additive white noise was used to analyze certain non-stationary speech data. It is observed that the assumption of white noise may not be proper in many cases. In this article, we consider the AM signal model in presence of stationary noise. We consider the least squares estimators and the estimators obtained by maximizing the Periodogram function. The two estimators are asymptotically equivalent. We study the theoretical properties of both estimators and observe their performances through numerical simulations. One speech data is analyzed and it is observed that the performance of the proposed estimators is quite satisfactory.