Estimating utility functions using generalized maximum entropy

This paper estimates von Neumann and Morgenstern utility functions using the generalized maximum entropy (GME), applied to data obtained by utility elicitation methods. Given the statistical advantages of this approach, we provide a comparison of the performance of the GME estimator with ordinary least square (OLS) in a real data small sample setup. The results confirm the ones obtained for small samples through Monte Carlo simulations. The difference between the two estimators is small and it decreases as the width of the parameter support vector increases. Moreover, the GME estimator is more precise than the OLS one. Overall, the results suggest that GME is an interesting alternative to OLS in the estimation of utility functions when data are generated by utility elicitation methods.     

Two steps generalized maximum entropy estimation procedure for fitting linear regression when both covariates are subject to error

This paper presents a procedure utilizing the generalized maximum entropy (GME) estimation method in two steps to quantify the uncertainty of the simple linear structural measurement error model parameters exactly. The first step estimates the unknowns from the horizontal line, and then the estimates were used in a second step to estimate the unknowns from the vertical line. The proposed estimation procedure has the ability to minimize the number of unknown parameters in formulating the GME system within each step, and hence reduce variability of the estimates. Analytical and illustrative Monte Carlo simulation comparison experiments with the maximum likelihood estimators and a one-step GME estimation procedure were presented. Simulation experiments demonstrated that the two steps estimation procedure produced parameter estimates that are more accurate and more efficient than the classical estimation methods. An application of the proposed method is illustrated using a data set gathered from the Centre for Integrated Government Services in Delma Island – UAE to predict the association between perceived quality and the customer satisfaction.     

Information theoretic methods in small domain estimation

Small area estimation techniques are becoming increasingly used in survey applications to provide estimates for local areas of interest. The objective of this article is to develop and apply Information Theoretic (IT)-based formulations to estimate small area business and trade statistics. More specifically, we propose a Generalized Maximum Entropy (GME) approach to the problem of small area estimation that exploits auxiliary information relating to other known variables on the population and adjusts for consistency and additivity. The GME formulations, combining information from the sample together with out-of-sample aggregates of the population of interest, can be particularly useful in the context of small area estimation, for both direct and model-based estimators, since they do not require strong distributional assumptions on the disturbances. The performance of the proposed IT formulations is illustrated through real and simulated datasets.     

基于最大熵原理的条件回收率建模分析

通常使用的数据拟合只是对回收率分布的一个描述,为有效对回收率进行研究,建模时将抵押担保和企业的信用等级这两个因素加以考虑,应用最大熵原理,对违约损失率估计出最佳的条件概率密度。利用该模型不仅能够估计出违约损失率的均值和方差,还可以得出违约损失率的分布密度;另外,该模型也具有更明确的经济学意义。返回检验表明,该模型的估计效果优于单因素模型、动态多元回归模型以及非参数核密度估计法。     

On the performance of some new Liu parameters for the gamma regression model

The maximum likelihood (ML) method is used to estimate the unknown Gamma regression (GR) coefficients. In the presence of multicollinearity, the variance of the ML method becomes overstated and the inference based on the ML method may not be trustworthy. To combat multicollinearity, the Liu estimator has been used. In this estimator, estimation of the Liu parameter d is an important problem. A few estimation methods are available in the literature for estimating such a parameter. This study has considered some of these methods and also proposed some new methods for estimation of the d. The Monte Carlo simulation study has been conducted to assess the performance of the proposed methods where the mean squared error (MSE) is considered as a performance criterion. Based on the Monte Carlo simulation and application results, it is shown that the Liu estimator is always superior to the ML and recommendation about which best Liu parameter should be used in the Liu estimator for the GR model is given.     

Reliability estimation in a multicomponent stress–strength model under generalized half-normal distribution based on progressive type-II censoring

In this paper, based on progressively Type-II censored samples, the problem of estimation of multicomponent stress–strength reliability under generalized half-normal (GHN) distribution is considered. The reliability of a k-component stress-strength system is estimated when both stress and strength variates are assumed to have a GHN distribution with various cases of same and different shape and scale parameters. Different methods such as the maximum likelihood estimates (MLEs) and Bayes estimation are discussed. The expectation maximization algorithm and approximate maximum likelihood methods are proposed to compute the MLE of reliability. The Lindley's approximation method, as well as Metropolis–Hastings algorithm, are applied to compute Bayes estimates. The performance of the proposed procedures is also demonstrated via a Monte Carlo simulation study and an illustrative example.     

The generalized maximum Tsallis entropy estimators and applications to the Portland cement dataset

Tsallis entropy is a generalized form of entropy and tends to be Shannon entropy when q → 1. Using Tsallis entropy, an alternative estimation methodology (generalized maximum Tsallis entropy) is introduced and used to estimate the parameters in a linear regression model when the basic data are ill-conditioned. We describe the generalized maximum Tsallis entropy and for q = 2 we call that GMET2 estimator. We apply the GMET2 estimator for estimating the linear regression model Y = Xβ + e where the design matrix X is subject to severe multicollinearity. We compared the GMET2, generalized maximum entropy (GME), ordinary least-square (OLS), and inequality restricted least-square (IRLS) estimators on the analyzed dataset on Portland cement.     

Parameter estimation of three-parameter Weibull distribution based on progressively Type-II censored samples

In this paper, the estimation of parameters for a three-parameter Weibull distribution based on progressively Type-II right censored sample is studied. Different estimation procedures for complete sample are generalized to the case with progressively censored data. These methods include the maximum likelihood estimators (MLEs), corrected MLEs, weighted MLEs, maximum product spacing estimators and least squares estimators. We also proposed the use of a censored estimation method with one-step bias-correction to obtain reliable initial estimates for iterative procedures. These methods are compared via a Monte Carlo simulation study in terms of their biases, root mean squared errors and their rates of obtaining reliable estimates. Recommendations are made from the simulation results and a numerical example is presented to illustrate all of the methods of inference developed here.     

Parametric estimation of mixtures of two uniform distributions

In this paper, we consider a mixture of two uniform distributions and derive L-moment estimators of its parameters. Three possible ways of mixing two uniforms, namely with neither overlap nor gap, with overlap, and with gap, are studied. The performance of these L-moment estimators in terms of bias and efficiency is compared to that obtained by means of the conventional method of moments (MM), modified maximum likelihood (MML) method and the usual maximum likelihood (ML) method. These intensive simulations reveal that MML estimators are the best in most of the cases, and the L-moment estimators are less subject to bias in estimation for some mixtures and more efficient in most of the cases than the conventional MM estimators. The L-moment estimators are, in some cases, more efficient than the ML and MML estimators.     

Ridge Regression and Generalized Maximum Entropy: An improved version of the Ridge–GME parameter estimator

In this article, the Ridge–GME parameter estimator, which combines Ridge Regression and Generalized Maximum Entropy, is improved in order to eliminate the subjectivity in the analysis of the ridge trace. A serious concern with the visual inspection of the ridge trace to define the supports for the parameters in the Ridge–GME parameter estimator is the misinterpretation of some ridge traces, in particular where some of them are very close to the axes. A simulation study and two empirical applications are used to illustrate the performance of the improved estimator. A MATLAB code is provided as supplementary material.     

A note on comparison and improvement of estimators based on likelihood

The problem of estimation of a parameter of interest in the presence of a nuisance parameter, which is either location or scale, is considered. Three estimators are taken into account: usual maximum likelihood (ML) estimator, maximum integrated likelihood estimator and the bias-corrected ML estimator. General results on comparison of these estimators w.r.t. the second-order risk based on the mean-squared error are obtained. Possible improvements of basic estimators via the notion of admissibility and methodology given in Ghosh and Sinha [A necessary and sufficient condition for second order admissibility with applications to Berkson's bioassay problem. Ann Stat. 1981;9(6):1334–1338] are considered. In the recent paper by Tanaka et al. [On improved estimation of a gamma shape parameter. Statistics. 2014; doi:10.1080/02331888.2014.915842], this problem was considered for estimating the shape parameter of gamma distribution. Here, we perform more accurate comparison of estimators for this case as well as for some other cases.     

SiZer inference for generalized varying coefficient models

ABSTRACT

SiZer (significant zero crossings of derivatives) is an effective tool for exploring significant features in curves from the viewpoint of the scale space theory. In this paper, a SiZer approach is developed for generalized varying coefficient models (GVCMs) in order to achieve the task of understanding dynamic characteristics of the regression relationship at multiscales. The proposed SiZer method is based on the local-linear maximum likelihood estimation of GVCMs and the one-step estimation procedure is employed to alleviate the computational cost of estimating the coefficients and their derivatives at different scales. Simulation studies are performed to assess the performance of the SiZer inference and two real-world examples are given to demonstrate its applications.     

Comparison of estimation methods for the Weibull distribution

Weibull distributions have received wide ranging applications in many areas including reliability, hydrology and communication systems. Many estimation methods have been proposed for Weibull distributions. But there has not been a comprehensive comparison of these estimation methods. Most studies have focused on comparing the maximum likelihood estimation (MLE) with one of the other approaches. In this paper, we first propose an L-moment estimator for the Weibull distribution. Then, a comprehensive comparison is made of the following methods: the method of maximum likelihood estimation (MLE), the method of logarithmic moments, the percentile method, the method of moments and the method of L-moments.     

Performance evaluation of processes with asymmetric tolerances in the presence of gauge measurement errors

ABSTRACT

In this study, the generalized confidence interval method is applied to evaluate the performances of processes with asymmetric tolerances taking into account the gauge measurement errors (GME). To examine the performance of the proposed method, a series of simulations is conducted. Moreover, a sensitivity study is carried out to analyze the effects of ignoring GME. The proposed method performs very well and can be recommended for assessing the performances of processes with asymmetric tolerances in the presence of GME.     

Approximate maximum likelihood estimation of the mean and standard deviation of the normal distribution based on type ii censored samples

It is known that the maximum likelihood methods does not provide explicit estimators for the mean and standard deviation of the normal distribution based on Type II censored samples. In this paper we present a simple method of deriving explicit estimators by approximating the likelihood equations appropriately. We obtain the variances and covariance of these estimators. We also show that these estimators are almost as eficient as the maximum likelihood (ML) estimators and just as eficient as the best linear unbiased (BLU), and the modified maximum likelihood (MML) estimators. Finally, we illustrate this method of estimation by applying it to Gupta's and Darwin's data.     

Robust estimation for partially linear single-index model

In this article, we investigate a new estimation approach for the partially linear single-index model based on modal regression method, where the non parametric function is estimated by penalized spline method. Moreover, we develop an expection maximum (EM)-type algorithm and establish the large sample properties of the proposed estimation method. A distinguishing characteristic of the newly proposed estimation is robust against outliers through introducing an additional tuning parameter which can be automatically selected using the observed data. Simulation studies and real data example are used to evaluate the finite-sample performance, and the results show that the newly proposed method works very well.     

General Multi-Level Modeling with Sampling Weights

ABSTRACT

In this article we study the approximately unbiased multi-level pseudo maximum likelihood (MPML) estimation method for general multi-level modeling with sampling weights. We conduct a simulation study to determine the effect various factors have on the estimation method. The factors we included in this study are scaling method, size of clusters, invariance of selection, informativeness of selection, intraclass correlation, and variability of standardized weights. The scaling method is an indicator of how the weights are normalized on each level. The invariance of the selection is an indicator of whether or not the same selection mechanism is applied across clusters. The informativeness of the selection is an indicator of how biased the selection is. We summarize our findings and recommend a multi-stage procedure based on the MPML method that can be used in practical applications.     

Pivotal inference for the inverse Rayleigh distribution based on general progressively Type-II censored samples

In this paper, we consider the problem of estimating the scale parameter of the inverse Rayleigh distribution based on general progressively Type-II censored samples and progressively Type-II censored samples. The pivotal quantity method is used to derive the estimator of the scale parameter. Besides, considering that the maximum likelihood estimator is tough to obtain for this distribution, we derive an explicit estimator of the scale parameter by approximating the likelihood equation with Taylor expansion. The interval estimation is also studied based on pivotal inference. Then we conduct Monte Carlo simulations and compare the performance of different estimators. We demonstrate that the pivotal inference is simpler and more effective. The further application of the pivotal quantity method is also discussed theoretically. Finally, two real data sets are analyzed using our methods.     

On the Convergence of the Monte Carlo Maximum Likelihood Method for Latent Variable Models

While much used in practice, latent variable models raise challenging estimation problems due to the intractability of their likelihood. Monte Carlo maximum likelihood (MCML), as proposed by Geyer & Thompson (1992 ), is a simulation-based approach to maximum likelihood approximation applicable to general latent variable models. MCML can be described as an importance sampling method in which the likelihood ratio is approximated by Monte Carlo averages of importance ratios simulated from the complete data model corresponding to an arbitrary value of the unknown parameter. This paper studies the asymptotic (in the number of observations) performance of the MCML method in the case of latent variable models with independent observations. This is in contrast with previous works on the same topic which only considered conditional convergence to the maximum likelihood estimator, for a fixed set of observations. A first important result is that when is fixed, the MCML method can only be consistent if the number of simulations grows exponentially fast with the number of observations. If on the other hand, is obtained from a consistent sequence of estimates of the unknown parameter, then the requirements on the number of simulations are shown to be much weaker.     

Estimation of the two-parameter bathtub-shaped lifetime distribution with progressive censoring

In this paper, we investigate the estimation problem concerning a progressively type-II censored sample from the two-parameter bathtub-shaped lifetime distribution. We use the maximum likelihood method to obtain the point estimators of the parameters. We also provide a method for constructing an exact confidence interval and an exact joint confidence region for the parameters. Two numerical examples are presented to illustrate the method of inference developed here. Finally, Monte Carlo simulation studies are used to assess the performance of our proposed method.