Maximum likelihood estimation and prediction mean square error in the spatial linear model

This paper is concerned with prediction in the spatial linear model using the maximum likelihood estimation of parameters in this model. In particular, we give some properties of predictors obtained on substituting the maximum likelihood estimators of model parameters into the form of the best-in the sense of minimum mean square prediction error-predictor. Such predictors are not optimal but we show them to be asymptotically equivalent to the optimum. We discuss practical aspects of this work and conclude by considering the connection with other areas.     

ESTIMATION OF EXPONENTIATED WEIBULL SHAPE PARAMETERS UNDER LINEX LOSS FUNCTION

ABSTRACT

The paper deals with Bayes estimation of the exponentiated Weibull shape parameters under linex loss function when independent non-informative type of priors are available for the parameters. Generalized maximum likelihood estimators have also been obtained. Performances of the proposed Bayes estimator, generalized maximum likelihood estimators, posterior mean (i.e., Bayes estimator under squared error loss function) and maximum likelihood estimators have been studied on the basis of their risks under linex loss function. The comparison is based on a simulation study because the expressions for risk functions of these estimators cannot be obtained in nice closed forms.     

Approximate maximum likelihood estimation of the mean and standard deviation of the normal distribution based on type ii censored samples

It is known that the maximum likelihood methods does not provide explicit estimators for the mean and standard deviation of the normal distribution based on Type II censored samples. In this paper we present a simple method of deriving explicit estimators by approximating the likelihood equations appropriately. We obtain the variances and covariance of these estimators. We also show that these estimators are almost as eficient as the maximum likelihood (ML) estimators and just as eficient as the best linear unbiased (BLU), and the modified maximum likelihood (MML) estimators. Finally, we illustrate this method of estimation by applying it to Gupta's and Darwin's data.     

Estimation of the Mean and Standard Deviation of the Logistic Distribution Based on Multiply Type-II Censored Samples

In this paper, we discuss the problem of estimating the mean and standard deviation of a logistic population based on multiply Type-II censored samples. First, we discuss the best linear unbiased estimation and the maximum likelihood estimation methods. Next, by appropriately approximating the likelihood equations we derive approximate maximum likelihood estimators for the two parameters and show that these estimators are quite useful as they do not need the construction of any special tables (as required for the best linear unbiased estimators) and are explicit estimators (unlike the maximum likelihood estimators which need to be determined by numerical methods). We show that these estimators are also quite efficient, and derive the asymptotic variances and covariance of the estimators. Finally, we present an example to illustrate the methods of estimation discussed in this paper.     

随机效应空间滞后单指数面板模型

对随机效应空间滞后单指数面板模型,本文构建了该模型的截面极大似然估计方法,从理论证明和数值模拟两方面分别考察了其估计量的大样本性质和小样本表现。研究结果表明:(1)在大样本条件下,估计量均具有一致性,并且参数估计量具有渐近正态性。(2)在小样本条件下,各估计量依然具有良好的表现,其精度随着样本容量的增加而提高;空间权重矩阵结构的复杂性对空间相关系数的估计量影响较大,但对其他估计量的影响较小。     

On the characterization of maximum likelihood estimators for location-scale families

Given maximum likelihood equations for location and scale parameters, one determines conditions under which there exists a uniquely defined parametric statistical model, whose location and scale maximum likelihood estimators are the given ones. The constructive approach is exemplified at several kinds of mean estimators including the mean, mean square, mean mean and stretched power mean. The possible extension of the method to more general situations is discussed and illustrated at the sample median maximum likelihood estimator.     

Estimation of odds ratios under order restrictions

A new method for estimating a set of odds ratios under an order restriction based on estimating equations is proposed. The method is applied to those of the conditional maximum likelihood estimators and the Mantel-Haenszel estimators. The estimators derived from the conditional likelihood estimating equations are shown to maximize the conditional likelihoods. It is also seen that the restricted estimators converge almost surely to the respective odds ratios when the respective sample sizes become large regularly. The restricted estimators are compared with the unrestricted maximum likelihood estimators by a Monte Carlo simulation. The simulation studies show that the restricted estimates improve the mean squared errors remarkably, while the Mantel-Haenszel type estimates are competitive with the conditional maximum likelihood estimates, being slightly worse.     

Comparison of Maximum Likelihood with Conditional Pairwise Likelihood Estimation of Person Parameters in the Rasch Model

This paper is concerned with person parameter estimation in the binary Rasch model. The loss of efficiency of a pseudo, quasi, or composite likelihood approach investigated. By means of a Monte Carlo study, two quasi likelihood estimators are compared to two well-established maximum likelihood approaches, one of which being a weighted likelihood procedure. The results show that the observed values of the root mean squared error are practically equivalent for the compared estimators in the case of a sufficiently large number of items.     

Estimation of parameters of a right truncated exponential distribution

The maximum likelihood, moment and mixture of the estimators are for samples from the right truncated exponential distribution. The estimators are compared empirically when all the parameters are unknown; their bias and mean square error are investigated with the help of numerical technique. We have shown that these estimators are asymptotically unbiased. At the end, we conclude that mixture estimators are better than the maximum likelihood and moment estimators.     

Parameter estimation of state space models for univariate observations

This paper contributes to the problem of estimation of state space model parameters by proposing estimators for the mean, the autoregressive parameters and the noise variances which, contrarily to maximum likelihood, may be calculated without assuming any specific distribution for the errors. The estimators suggested widen the scope of the application of the generalized method of moments to some heteroscedastic models, as in the case of state-space models with varying coefficients, and give sufficient conditions for their consistency. The paper includes a simulation study comparing the proposed estimators with maximum likelihood estimators. Finally, these methods are applied to the calibration of the meteorological radar and estimation of area rainfall.     

A note on properties of spatial yule-walker estimators

For two-dimensional spatial autoregressive (AR) models, asymptotic properties of the spatial Yule-Walker (YW) estimators (Tjøstheim, 1978) are studied. These estimators although consistent, are shown to be asymptotically biased. Estimators from the first-order spatial bilateral AR model are looked at in more detail and the spatial YW estimators for this model are compared with the exact maximum likelihood estimators. Small sample properties of both estimators are also discussed briefly and some simulation results are presented.     

Classical Estimator of Parameters of the Gamma Case With Presence of Two Outliers

The authors derive the moment, maximum likelihood, and mixture estimators of parameters of the gamma distribution with presence of two outliers generated from uniform distribution. These estimators are compared empirically when all the parameters are unknown; their bias and mean squared error are investigated with the help of numerical technique. The authors shown that these estimators are asymptotically unbiased. At the end, they conclude that mixture estimators are better than the maximum likelihood and moment estimators.     

On the failure rate estimation of the inverse gaussian distribution

New estimators of the inverse Gaussian failure rate are proposed based on the maximum likelihood predictive densities derived by Yang (1999). These estimators are compared, via Monte Carlo simulation, with the usual maximum likelihood estimators of the failure rate and found to be superior in terms of bias and mean squared error. Sensitivity of the estimators against the departure from the inverse Gaussian distribution is studied.     

Inference on constant stress accelerated life tests for log-location-scale lifetime distributions with type-I hybrid censoring

In this paper, we consider a constant stress accelerated life test terminated by a hybrid Type-I censoring at the first stress level. The model is based on a general log-location-scale lifetime distribution with mean life being a linear function of stress and with constant scale. We obtain the maximum likelihood estimators (MLE) and the approximate maximum likelihood estimators (AMLE) of the model parameters. Approximate confidence intervals, likelihood ratio tests and two bootstrap methods are used to construct confidence intervals for the unknown parameters of the Weibull and lognormal distributions using the MLEs. Finally, a simulation study and two illustrative examples are provided to demonstrate the performance of the developed inferential methods.     

Improper use of the ordinary least squares estimator in the switching regression model

The paper considers the consequences of incorrectly using the ordinary least squares estimator, when the true but unknown model is a switching regression. Bias and mean square error express ons are given for slope and residual variance estimators. Except for in very specialized cases the estimators are biased. A numerical exarnple illustrates some of the issues raised and provides a conpelison between the ordinary least squares and maximum likelihood estimators.     

Estimation and tests of hypotheses for the initial mean and covariance in the kalman filter model

Kalman filtering techniques are widely used by engineers to recursively estimate random signal parameters which are essentially coefficients in a large-scale time series regression model. These Bayesian estimators depend on the values assumed for the mean and covariance parameters associated with the initial state of the random signal. This paper considers a likelihood approach to estimation and tests of hypotheses involving the critical initial means and covariances. A computationally simple convergent iterative algorithm is used to generate estimators which depend only on standard Kalman filter outputs at each successive stage. Conditions are given under which the maximum likelihood estimators are consistent and asymptotically normal. The procedure is illustrated using a typical large-scale data set involving 10-dimensional signal vectors.     

Bayesian estimates in a one-way ANOVA random effects model

Bayesian estimators of variance components are developed, based on posterior mean and posterior mode, respectively, in a one-way ANOVA random effects model with independent prior distributions. The formulas for the proposed estimators are simple. The estimators give sensible results for 'badly-behaved' datasets, where the standard unbiased estimates are negative. They are markedly robust as compared to the existing estimators such as the maximum likelihood estimators and the maximum posterior density estimators.     

A Comparison Between Maximum Likelihood and Bayesian Estimation of Stochastic Frontier Production Models

In this paper, the finite sample properties of the maximum likelihood and Bayesian estimators of the half-normal stochastic frontier production function are analyzed and compared through a Monte Carlo study. The results show that the Bayesian estimator should be used in preference to the maximum likelihood owing to the fact that the mean square error performance is substantially better in the Bayesian framework.     

Estimation of two order restricted normal means with unknown and possibly unequal variances

Estimation of each of and linear functions of two order restricted normal means is considered when variances are unknown and possibly unequal. We replace unknown variances with sample variances and construct isotonic regression estimators, which we call in our paper the plug-in estimators, to estimate ordered normal means. Under squared error loss, a necessary and sufficient condition is given for the plug-in estimators to improve upon the unrestricted maximum likelihood estimators uniformly. As for the estimation of linear functions of ordered normal means, we also show that when variances are known, the restricted maximum likelihood estimator always improves upon the unrestricted maximum likelihood estimator uniformly, but when variances are unknown, the plug-in estimator does not always improve upon the unrestricted maximum likelihood estimator uniformly.     

Modified maximum likelihood estimator under the Jones and Faddy's skew t-error distribution for censored regression model

It is well-known that classical Tobit estimator of the parameters of the censored regression (CR) model is inefficient in case of non-normal error terms. In this paper, we propose to use the modified maximum likelihood (MML) estimator under the Jones and Faddy''s skew t-error distribution, which covers a wide range of skew and symmetric distributions, for the CR model. The MML estimators, providing an alternative to the Tobit estimator, are explicitly expressed and they are asymptotically equivalent to the maximum likelihood estimator. A simulation study is conducted to compare the efficiencies of the MML estimators with the classical estimators such as the ordinary least squares, Tobit, censored least absolute deviations and symmetrically trimmed least squares estimators. The results of the simulation study show that the MML estimators work well among the others with respect to the root mean square error criterion for the CR model. A real life example is also provided to show the suitability of the MML methodology.