Estimation of the scale parameter of the half-logistic distribution with multiply type II censored sample

In this paper, we consider the maximum likelihood and Bayes estimation of the scale parameter of the half-logistic distribution based on a multiply type II censored sample. However, the maximum likelihood estimator(MLE) and Bayes estimator do not exist in an explicit form for the scale parameter. We consider a simple method of deriving an explicit estimator by approximating the likelihood function and discuss the asymptotic variances of MLE and approximate MLE. Also, an approximation based on the Laplace approximation (Tierney & Kadane, 1986) is used to obtain the Bayes estimator. In order to compare the MLE, approximate MLE and Bayes estimates of the scale parameter, Monte Carlo simulation is used.     

Approximate MLE for the scale parameter of the generalized exponential distribution under random censoring

In this paper, we consider the maximum likelihood estimator (MLE) of the scale parameter of the generalized exponential (GE) distribution based on a random censoring model. We assume the censoring distribution also follows a GE distribution. Since the estimator does not provide an explicit solution, we propose a simple method of deriving an explicit estimator by approximating the likelihood function. In order to compare the performance of the estimators, Monte Carlo simulation is conducted. The results show that the MLE and the approximate MLE are almost identical in terms of bias and variance.     

Estimation of the scale parameter of the half-logistic distribution under progressively type II censored sample

Based on a progressively type II censored sample, the maximum likelihood and Bayes estimators of the scale parameter of the half-logistic distribution are derived. However, since the maximum likelihood estimator (MLE) and Bayes estimator do not exist in an explicit form for the scale parameter, we consider a simple method of deriving an explicit estimator by approximating the likelihood function and derive the asymptotic variances of MLE and approximate MLE. Also, an approximation based on the Laplace approximation (Tierney and Kadane in J Am Stat Assoc 81:82–86, 1986) and importance sampling methods are used for obtaining the Bayes estimator. In order to compare the performance of the MLE, approximate MLE and Bayes estimates of the scale parameter, we use Monte Carlo simulation.     

Opportunities of the minimum Anderson–Darling estimator as a variant of the maximum likelihood method

We reveal that the minimum Anderson–Darling (MAD) estimator is a variant of the maximum likelihood method. Furthermore, it is shown that the MAD estimator offers excellent opportunities for parameter estimation if there is no explicit formulation for the distribution model. The computation time for the MAD estimator with approximated cumulative distribution function is much shorter than that of the classical maximum likelihood method with approximated probability density function. Additionally, we research the performance of the MAD estimator for the generalized Pareto distribution and demonstrate a further advantage of the MAD estimator with an issue of seismic hazard analysis.     

Pivotal inference for the inverse Rayleigh distribution based on general progressively Type-II censored samples

In this paper, we consider the problem of estimating the scale parameter of the inverse Rayleigh distribution based on general progressively Type-II censored samples and progressively Type-II censored samples. The pivotal quantity method is used to derive the estimator of the scale parameter. Besides, considering that the maximum likelihood estimator is tough to obtain for this distribution, we derive an explicit estimator of the scale parameter by approximating the likelihood equation with Taylor expansion. The interval estimation is also studied based on pivotal inference. Then we conduct Monte Carlo simulations and compare the performance of different estimators. We demonstrate that the pivotal inference is simpler and more effective. The further application of the pivotal quantity method is also discussed theoretically. Finally, two real data sets are analyzed using our methods.     

ON LIKELIHOOD ESTIMATION FOR DISCRETELY OBSERVED MARKOV JUMP PROCESSES

The parameter estimation problem for a Markov jump process sampled at equidistant time points is considered here. Unlike the diffusion case where a closed form of the likelihood function is usually unavailable, here an explicit expansion of the likelihood function of the sampled chain is provided. Under suitable ergodicity conditions on the jump process, the consistency and the asymptotic normality of the likelihood estimator are established as the observation period tends to infinity. Simulation experiments are conducted to demonstrate the computational facility of the method.     

Sequential maximum likelihood estimation for reflected Ornstein-Uhlenbeck processes

The paper studies the properties of a sequential maximum likelihood estimator of the drift parameter in a one dimensional reflected Ornstein-Uhlenbeck process. We observe the process until the observed Fisher information reaches a specified precision level. We derive the explicit formulas for the sequential estimator and its mean squared error. The estimator is shown to be unbiased and uniformly normally distributed. A simulation study is conducted to assess the performance of the estimator compared with the ordinary maximum likelihood estimator.     

Linear approximate ML estimation in scaled Type I generalized logistic distribution based on Type-II censored samples

The scaled (two-parameter) Type I generalized logistic distribution (GLD) is considered with the known shape parameter. The ML method does not yield an explicit estimator for the scale parameter even in complete samples. In this article, we therefore construct a new linear estimator for scale parameter, based on complete and doubly Type-II censored samples, by making linear approximations to the intractable terms of the likelihood equation using least-squares (LS) method, a new approach of linearization. We call this as linear approximate maximum likelihood estimator (LAMLE). We also construct LAMLE based on Taylor series method of linear approximation and found that this estimator is slightly biased than that based on the LS method. A Monte Carlo simulation is used to investigate the performance of LAMLE and found that it is almost as efficient as MLE, though biased than MLE. We also compare unbiased LAMLE with BLUE based on the exact variances of the estimators and interestingly this new unbiased LAMLE is found just as efficient as the BLUE in both complete and Type-II censored samples. Since MLE is known as asymptotically unbiased, in large samples we compare unbiased LAMLE with MLE and found that this estimator is almost as efficient as MLE. We have also discussed interval estimation of the scale parameter from complete and Type-II censored samples. Finally, we present some numerical examples to illustrate the construction of the new estimators developed here.     

Estimation of the scale parameter of the Rayleigh distribution with multiply type–II censored sample

Based on a multiply type-II censored sample, the maximum likelihood estimator (MLE) and Bayes estimator for the scale parameter and the reliability function of the Rayleigh distribution are derived. However, since the MLE does not exist an explicit form, an approximate MLE which is the maximizer of an approximate likelihood function will be given. The comparisons among estimators are investigated through Monte Carlo simulations. An illustrative example with the real data concerning the 23 ball bearing in the life test is presented.     

Exact Bayesian variable sampling plans for the exponential distribution with progressive hybrid censoring

From the exact distribution of the maximum likelihood estimator of the average lifetime based on progressive hybrid exponential censored sample, we derive an explicit expression for the Bayes risk of a sampling plan when a quadratic loss function is used. The simulated annealing algorithm is then used to determine the optimal sampling plan. Some optimal Bayes solutions under progressive hybrid and ordinary hybrid censoring schemes are presented to illustrate the effectiveness of the proposed method.     

Moderate Deviation for Parameter Estimation in the Rayleigh Diffusion Process

In this article, we study moderate deviation for parameter estimation in the Rayleigh diffusion process and obtain the moderate deviation principle of the maximum likelihood estimator with explicit rate function.     

Local likelihood with time-varying additive hazards model

The authors propose the local likelihood method for the time-varying coefficient additive hazards model. They use the Newton-Raphson algorithm to maximize the likelihood into which a local polynomial expansion has been incorporated. They establish the asymptotic properties for the time-varying coefficient estimators and derive explicit expressions for the variance and bias. The authors present simulation results describing the performance of their approach for finite sample sizes. Their numerical comparisons show the stability and efficiency of the local maximum likelihood estimator. They finally illustrate their proposal with data from a laryngeal cancer clinical study.     

Exact Bayesian Variable Sampling Plans for the Exponential Distribution Based on Type-I and Type-II Hybrid Censored Samples

A sampling plan with a polynomial loss function for the exponential distribution is considered. From the distribution of the maximum likelihood estimator of the mean of an exponential distribution based on Type-I and Type-II hybrid censored samples, we obtain an explicit expression for the Bayes risk of a sampling plan with a quadratic loss function. Some numerical examples and comparisons are given to illustrate the effectiveness of the proposed method, and a robustness study reveals that the proposed optimal sampling plans are quite robust.     

Investigation of the performance of trimmed estimators of life time distributions with censoring

For the lifetime (or negative) exponential distribution, the trimmed likelihood estimator has been shown to be explicit in the form of a β‐trimmed mean which is representable as an estimating functional that is both weakly continuous and Fréchet differentiable and hence qualitatively robust at the parametric model. It also has high efficiency at the model. The robustness is in contrast to the maximum likelihood estimator (MLE) involving the usual mean which is not robust to contamination in the upper tail of the distribution. When there is known right censoring, it may be perceived that the MLE which is the most asymptotically efficient estimator may be protected from the effects of ‘outliers’ due to censoring. We demonstrate that this is not the case generally, and in fact, based on the functional form of the estimators, suggest a hybrid defined estimator that incorporates the best features of both the MLE and the β‐trimmed mean. Additionally, we study the pure trimmed likelihood estimator for censored data and show that it can be easily calculated and that the censored observations are not always trimmed. The different trimmed estimators are compared by a modest simulation study.     

A theory of statistical models for Monte Carlo integration

Summary. The task of estimating an integral by Monte Carlo methods is formulated as a statistical model using simulated observations as data. The difficulty in this exercise is that we ordinarily have at our disposal all of the information required to compute integrals exactly by calculus or numerical integration, but we choose to ignore some of the information for simplicity or computational feasibility. Our proposal is to use a semiparametric statistical model that makes explicit what information is ignored and what information is retained. The parameter space in this model is a set of measures on the sample space, which is ordinarily an infinite dimensional object. None-the-less, from simulated data the base-line measure can be estimated by maximum likelihood, and the required integrals computed by a simple formula previously derived by Vardi and by Lindsay in a closely related model for biased sampling. The same formula was also suggested by Geyer and by Meng and Wong using entirely different arguments. By contrast with Geyer's retrospective likelihood, a correct estimate of simulation error is available directly from the Fisher information. The principal advantage of the semiparametric model is that variance reduction techniques are associated with submodels in which the maximum likelihood estimator in the submodel may have substantially smaller variance than the traditional estimator. The method is applicable to Markov chain and more general Monte Carlo sampling schemes with multiple samplers.     

Asymptotic variance approximations for invariant estimators in uncertain asset-pricing models

This article derives explicit expressions for the asymptotic variances of the maximum likelihood and continuously-updated GMM estimators in models that may not satisfy the fundamental asset-pricing restrictions in population. The proposed misspecification-robust variance estimators allow the researcher to conduct valid inference on the model parameters even when the model is rejected by the data. While the results for the maximum likelihood estimator are only applicable to linear asset-pricing models, the asymptotic distribution of the continuously-updated GMM estimator is derived for general, possibly nonlinear, models. The large corrections in the asymptotic variances, that arise from explicitly incorporating model misspecification in the analysis, are illustrated using simulations and an empirical application.     

On the use of the selection matrix in the maximum likelihood estimation of normal distribution models with missing data

In this article, by using the constant and random selection matrices, several properties of the maximum likelihood (ML) estimates and the ML estimator of a normal distribution with missing data are derived. The constant selection matrix allows us to obtain an explicit form of the ML estimates and the exact relationship between the EM algorithm and the score function. The random selection matrix allows us to clarify how the missing-data mechanism works in the proof of the consistency of the ML estimator, to derive the asymptotic properties of the sequence by the EM algorithm, and to derive the information matrix.     

Generalized Pickands estimators for the extreme value index

The Pickands estimator for the extreme value index is generalized in a way that includes all of its previously known variants. A detailed study of the asymptotic behavior of the estimators in the family serves to determine its optimally performing members. These are given by simple, explicit formulas, have the same asymptotic variance as the maximum likelihood estimator in the generalized Pareto model, and are robust to departures from the limiting generalized Pareto model in case the convergence of the excess distribution to its limit is slow. A simulation study involving a wide range of distributions shows the new estimators to compare favorably with the maximum likelihood estimator.     

Continuous Invertibility and Stable QML Estimation of the EGARCH(1,1) Model

I introduce the notion of continuous invertibility on a compact set for volatility models driven by a stochastic recurrence equation. I prove strong consistency of the quasi‐maximum likelihood estimator (QMLE) when the quasi‐likelihood criterion is maximized on a continuously invertible domain. This approach yields, for the first time, the asymptotic normality of the QMLE for the exponential general autoregressive conditional heteroskedastic (EGARCH(1,1)) model under explicit but non‐verifiable conditions. In practice, I propose to stabilize the QMLE by constraining the optimization procedure to an empirical continuously invertible domain. The new method, called stable QMLE, is asymptotically normal when the observations follow an invertible EGARCH(1,1) model.     

On the UMVU estimator for the generalized variance of the multinomial family

Abstract

The generalized variance is an important statistical indicator which appears in a number of statistical topics. It is a successful measure for multivariate data concentration. In this article, we established, in a closed form, the bias of the generalized variance maximum likelihood estimator of the Multinomial family. We also derived, with a complete proof, the uniformly minimum variance unbiased estimator (UMVU) for the generalized variance of this family. These results rely on explicit calculations, the completeness of the exponential family and the Lehmann–Scheffé theorem.