Estimation of two ordered normal means when a covariance matrix is known

Estimation of two normal means with an order restriction is considered when a covariance matrix is known. It is shown that restricted maximum likelihood estimator (MLE) stochastically dominates both estimators proposed by Hwang and Peddada [Confidence interval estimation subject to order restrictions. Ann Statist. 1994;22(1):67–93] and Peddada et al. [Estimation of order-restricted means from correlated data. Biometrika. 2005;92:703–715]. The estimators are also compared under the Pitman nearness criterion and it is shown that the MLE is closer to ordered means than the other two estimators. Estimation of linear functions of ordered means is also considered and a necessary and sufficient condition on the coefficients is given for the MLE to dominate the other estimators in terms of mean squared error.     

Merging data from multiple sources: pretest and shrinkage perspectives

In this article, we have developed asymptotic theory for the simultaneous estimation of the k means of arbitrary populations under the common mean hypothesis and further assuming that corresponding population variances are unknown and unequal. The unrestricted estimator, the Graybill-Deal-type restricted estimator, the preliminary test, and the Stein-type shrinkage estimators are suggested. A large sample test statistic is also proposed as a pretest for testing the common mean hypothesis. Under the sequence of local alternatives and squared error loss, we have compared the asymptotic properties of the estimators by means of asymptotic distributional quadratic bias and risk. Comprehensive Monte-Carlo simulation experiments were conducted to study the relative risk performance of the estimators with reference to the unrestricted estimator in finite samples. Two real-data examples are also furnished to illustrate the application of the suggested estimation strategies.     

Improved estimators for the common mean and ordered means of two normal distributions with ordered variances

We first consider the problem of estimating the common mean of two normal distributions with unknown ordered variances. We give a broad class of estimators which includes the estimators proposed by Nair (1982) and Elfessi et al. (1992) and show that the estimators stochastically dominate the estimators which do not take into account the order restriction on variances, including the one given by Graybill and Deal (1959). Then we propose a broad class of individual estimators of two ordered means when unknown variances are ordered. We show that in estimating the mean with larger variance, estimators which do not take into account the order restriction on variances are stochastically dominated by the proposed class of estimators which take into account both order restrictions. However, in estimating the mean with smaller variance, similar improvement is not possible even in terms of mean squared error. We also show a domination result in the simultaneous estimation problem of two ordered means. Further, improving upon the unbiased estimators of the two means is discussed.     

Estimation of the intercept parameter for linear regression model with uncertain non-sample prior information

This paper considers alternative estimators of the intercept parameter of the linear regression model with normal error when uncertain non-sample prior information about the value of the slope parameter is available. The maximum likelihood, restricted, preliminary test and shrinkage estimators are considered. Based on their quadratic biases and mean square errors the relative performances of the estimators are investigated. Both analytical and graphical comparisons are explored. None of the estimators is found to be uniformly dominating the others. However, if the non-sample prior information regarding the value of the slope is not too far from its true value, the shrinkage estimator of the intercept parameter dominates the rest of the estimators.     

Asymptotic variance approximations for invariant estimators in uncertain asset-pricing models

This article derives explicit expressions for the asymptotic variances of the maximum likelihood and continuously-updated GMM estimators in models that may not satisfy the fundamental asset-pricing restrictions in population. The proposed misspecification-robust variance estimators allow the researcher to conduct valid inference on the model parameters even when the model is rejected by the data. While the results for the maximum likelihood estimator are only applicable to linear asset-pricing models, the asymptotic distribution of the continuously-updated GMM estimator is derived for general, possibly nonlinear, models. The large corrections in the asymptotic variances, that arise from explicitly incorporating model misspecification in the analysis, are illustrated using simulations and an empirical application.     

Efficient estimation for time series following generalized linear models

In this paper, we consider James–Stein shrinkage and pretest estimation methods for time series following generalized linear models when it is conjectured that some of the regression parameters may be restricted to a subspace. Efficient estimation strategies are developed when there are many covariates in the model and some of them are not statistically significant. Statistical properties of the pretest and shrinkage estimation methods including asymptotic distributional bias and risk are developed. We investigate the relative performances of shrinkage and pretest estimators with respect to the unrestricted maximum partial likelihood estimator (MPLE). We show that the shrinkage estimators have a lower relative mean squared error as compared to the unrestricted MPLE when the number of significant covariates exceeds two. Monte Carlo simulation experiments were conducted for different combinations of inactive covariates and the performance of each estimator was evaluated in terms of its mean squared error. The practical benefits of the proposed methods are illustrated using two real data sets.     

Estimation of three-parameter exponentiated-Weibull distribution under type-II censoring

The present article obtains the point estimators of the exponentiated-Weibull parameters when all the three parameters of the distribution are unknown. Maximum likelihood estimator generalized maximum likelihood estimator and Bayes estimators are proposed for three-parameter exponentiated-Weibull distribution when available sample is type-II censored. Independent non-informative types of priors are considered for the unknown parameters to develop generalized maximum likelihood estimator and Bayes estimators. Although the proposed estimators cannot be expressed in nice closed forms, these can be easily obtained through the use of appropriate numerical techniques. The performances of these estimators are studied on the basis of their risks, computed separately under LINEX loss and squared error loss functions through Monte-Carlo simulation technique. An example is also considered to illustrate the estimators.     

Estimation of Slope for Linear Regression Model with Uncertain Prior Information and Student-t Error

This article considers estimation of the slope parameter of the linear regression model with Student-t errors in the presence of uncertain prior information on the value of the unknown slope. Incorporating uncertain non sample prior information with the sample data the unrestricted, restricted, preliminary test, and shrinkage estimators are defined. The performances of the estimators are compared based on the criteria of unbiasedness and mean squared errors. Both analytical and graphical methods are explored. Although none of the estimators is uniformly superior to the others, if the non sample information is close to its true value, the shrinkage estimator over performs the rest of the estimators.     

Estimation of common location parameter of two exponential populations based on records

Consider the problem of estimating the common location parameter of two exponential populations using record data when the scale parameters are unknown. We derive the maximum likelihood estimator (MLE), the modified maximum likelihood estimator (MMLE) and the uniformly minimum variance unbiased estimator (UMVUE) of the common location parameter. Further, we derive a general result for inadmissibility of an equivariant estimator under the scaled-squared error loss function. Using this result, we conclude that the MLE and the UMVUE are inadmissible and better estimators are provided. A simulation study is conducted for comparing the performances of various competing estimators.     

Estimation of odds ratios under order restrictions

A new method for estimating a set of odds ratios under an order restriction based on estimating equations is proposed. The method is applied to those of the conditional maximum likelihood estimators and the Mantel-Haenszel estimators. The estimators derived from the conditional likelihood estimating equations are shown to maximize the conditional likelihoods. It is also seen that the restricted estimators converge almost surely to the respective odds ratios when the respective sample sizes become large regularly. The restricted estimators are compared with the unrestricted maximum likelihood estimators by a Monte Carlo simulation. The simulation studies show that the restricted estimates improve the mean squared errors remarkably, while the Mantel-Haenszel type estimates are competitive with the conditional maximum likelihood estimates, being slightly worse.     

MAXIMUM LIKELIHOOD ESTIMATION IN LINEAR MODELS WITH EQUI-CORRELATED RANDOM ERRORS

Necessary and sufficient conditions for the existence of maximum likelihood estimators of unknown parameters in linear models with equi‐correlated random errors are presented. The basic technique we use is that these models are, first, orthogonally transformed into linear models with two variances, and then the maximum likelihood estimation problem is solved in the environment of transformed models. Our results generalize a result of Arnold, S. F. (1981) [The theory of linear models and multivariate analysis. Wiley, New York]. In addition, we give necessary and sufficient conditions for the existence of restricted maximum likelihood estimators of the parameters. The results of Birkes, D. & Wulff, S. (2003) [Existence of maximum likelihood estimates in normal variance‐components models. J Statist Plann. Inference. 113 , 35–47] are compared with our results and differences are pointed out.     

On unbiased estimation of gini index and yntema-pietra index of lognormal distribution and their variances

Here we derive the uniformly minimum variance unbiased (best) estimator and a strongly consistent, asymptotically normal, unbiased estimator of each of Gini index and Yntema-Pietra index of lognormal distribution . These estimators are in terms of generalized hypergeometric functions ₁F₂. Further, the variances of these estimators and the best estimators of variances of best estimators are found out. They are in terms of Kempé de Fériet's hypergeometric functions.     

PITMAN NEARNESS COMPARISONS OF ESTIMATES OF TWO ORDERED NORMAL MEANS

Maximum likelihood estimates of ordered means of two normal distributions having common variance have been shown to be better than the usual maximum likelihood estimates (i.e. corresponding sample means) with respect to Pitman Nearness criterion. The maximum likelihood estimate of common variance taking into consideration the order restriction of the means is shown to have smaller mean square error than the unrestricted maximum likelihood estimate of the common variance. These two estimators have also been compared with respect to Pitman Nearness criterion.     

A note on the common location parameter of several exponential populations

The problem of estimation of an unknown common location parameter of several exponential populations with unknown and possibly unequal scale parameters is considered. A wide class of estimators, including both a modified maximum likelihood estimator (MLE), and the uniformly minimum variance unbiased estimator (Umvue) proposed by ghosh and razmpour(1984), is obtained under a class of convex loss functions.     

Stein-type estimation in logistic regression models based on minimum ϕ-divergence estimators

In this paper we present a study of Stein-type estimators for the unknown parameters in logistic regression models when it is suspected that the parameters may be restricted to a subspace of the parameter space. The Stein-type estimators studied are based on the minimum phi-divergence estimator instead on the maximum likelihood estimator as well as on phi-divergence test statistics.     

Preliminary test and Bayes Estimation of a Location Parameter Under Blinex Loss

In this article, the preliminary test estimator is considered under the BLINEX loss function. The problem under consideration is the estimation of the location parameter from a normal distribution. The risk under the null hypothesis for the preliminary test estimator, the exact risk function for restricted maximum likelihood and approximated risk function for the unrestricted maximum likelihood estimator, are derived under BLINEX loss and the different risk structures are compared to one another both analytically and computationally. As a motivation on the use of BLINEX rather than LINEX, the risk for the preliminary test estimator under BLINEX loss is compared to the risk of the preliminary test estimator under LINEX loss and it is shown that the LINEX expected loss is higher than BLINEX expected loss. Furthermore, two feasible Bayes estimators are derived under BLINEX loss, and a feasible Bayes preliminary test estimator is defined and compared to the classical preliminary test estimator.     

Estimation for Location-Scale Models with Censored Data

This article considers a class of estimators for the location and scale parameters in the location-scale model based on ‘synthetic data’ when the observations are randomly censored on the right. The asymptotic normality of the estimators is established using counting process and martingale techniques when the censoring distribution is known and unknown, respectively. In the case when the censoring distribution is known, we show that the asymptotic variances of this class of estimators depend on the data transformation and have a lower bound which is not achievable by this class of estimators. However, in the case that the censoring distribution is unknown and estimated by the Kaplan–Meier estimator, this class of estimators has the same asymptotic variance and attains the lower bound for variance for the case of known censoring distribution. This is different from censored regression analysis, where asymptotic variances depend on the data transformation. Our method has three valuable advantages over the method of maximum likelihood estimation. First, our estimators are available in a closed form and do not require an iterative algorithm. Second, simulation studies show that our estimators being moment-based are comparable to maximum likelihood estimators and outperform them when sample size is small and censoring rate is high. Third, our estimators are more robust to model misspecification than maximum likelihood estimators. Therefore, our method can serve as a competitive alternative to the method of maximum likelihood in estimation for location-scale models with censored data. A numerical example is presented to illustrate the proposed method.     

Consistency of semiparametric maximum likelihood estimators for two‐phase sampling

Semiparametric maximum likelihood estimators have recently been proposed for a class of two‐phase, outcome‐dependent sampling models. All of them were “restricted” maximum likelihood estimators, in the sense that the maximization is carried out only over distributions concentrated on the observed values of the covariate vectors. In this paper, the authors give conditions for consistency of these restricted maximum likelihood estimators. They also consider the corresponding unrestricted maximization problems, in which the “absolute” maximum likelihood estimators may then have support on additional points in the covariate space. Their main consistency result also covers these unrestricted maximum likelihood estimators, when they exist for all sample sizes.     

Model selection and post estimation based on a pretest for logistic regression models

ABSTRACT

This article addresses the problem of parameter estimation of the logistic regression model under subspace information via linear shrinkage, pretest, and shrinkage pretest estimators along with the traditional unrestricted maximum likelihood estimator and restricted estimator. We developed an asymptotic theory for the linear shrinkage and pretest estimators and compared their relative performance using the notion of asymptotic distributional bias and asymptotic quadratic risk. The analytical results demonstrated that the proposed estimation strategies outperformed the classical estimation strategies in a meaningful parameter space. Detailed Monte-Carlo simulation studies were conducted for different combinations and the performance of each estimation method was evaluated in terms of simulated relative efficiency. The results of the simulation study were in strong agreement with the asymptotic analytical findings. Two real-data examples are also given to appraise the performance of the estimators.     

Nonparametric Shrinkage Estimation for Aalen's Additive Hazards Model

Aalen's nonparametric additive model in which the regression coefficients are assumed to be unspecified functions of time is a flexible alternative to Cox's proportional hazards model when the proportionality assumption is in doubt. In this paper, we incorporate a general linear hypothesis into the estimation of the time‐varying regression coefficients. We combine unrestricted least squares estimators and estimators that are restricted by the linear hypothesis and produce James‐Stein‐type shrinkage estimators of the regression coefficients. We develop the asymptotic joint distribution of such restricted and unrestricted estimators and use this to study the relative performance of the proposed estimators via their integrated asymptotic distributional risks. We conduct Monte Carlo simulations to examine the relative performance of the estimators in terms of their integrated mean square errors. We also compare the performance of the proposed estimators with a recently devised LASSO estimator as well as with ridge‐type estimators both via simulations and data on the survival of primary billiary cirhosis patients.