Estimation in the presence of incidental parameters

This paper considers the estimation of “structural” parameters when the number of unknown parameters increases with the sample size. Neyman and Scott (1948) had demonstrated that maximum likelihood estimators (MLE) of structural parameters may be inconsistent in this case. Patefield (1977) further observed that the asymptotic covariance matrix of the MLE is not equal to the inverse of the information matrix. In this paper we establish asymptotic properties of estimators (which include in particular the MLE) obtained via the usual likelihood approach when the incidental parameters are first replaced by their estimates (which are allowed to depend on the structural parameters). Conditions for consistency and asymptotic normality together with a proper formula for the asymptotic covariance matrix are given. The results are illustrated and applied to the problem of estimating linear functional relationships, and mild conditions on the incidental parameters for the MLE (or an adjusted MLE) to be consistent and asymptotically normal are obtained. These conditions are weaker than those imposed by previous authors.     

Estimation of system reliability for exponential distributions based on L ranked set sampling

Abstract

In the case where strength and stress both follow exponential distributions, this paper considers the maximum likelihood estimator (MLE) of the system reliability based on L ranked set sampling (LRSS). The proposed MLE is shown to have existence, uniqueness and asymptotic normality, and its asymptotic variance is obtained by the Fisher information matrix of LRSS. The values of asymptotic relative efficiencies show that the proposed MLE is always more efficient than the MLE using simple random sampling (SRS). However, the MLE using LRSS cannot be written in closed form. Therefore, the modified MLE is proposed using the technique replaced some terms in the maximum likelihood equations by their expectations. The newly modified MLE using LRSS is shown to be superior to the MLE using SRS. Finally, the proposed method is applied to a real data set on metastatic renal carcinoma study.     

Asymptotic properties of the maximum-likelihood estimator in zero-inflated binomial regression

The zero-inflated binomial (ZIB) regression model was proposed to account for excess zeros in binomial regression. Since then, the model has been applied in various fields, such as ecology and epidemiology. In these applications, maximum-likelihood estimation (MLE) is used to derive parameter estimates. However, theoretical properties of the MLE in ZIB regression have not yet been rigorously established. The current paper fills this gap and thus provides a rigorous basis for applying the model. Consistency and asymptotic normality of the MLE in ZIB regression are proved. A consistent estimator of the asymptotic variance–covariance matrix of the MLE is also provided. Finite-sample behavior of the estimator is assessed via simulations. Finally, an analysis of a data set in the field of health economics illustrates the paper.     

Estimation of the scale parameter of the half-logistic distribution with multiply type II censored sample

In this paper, we consider the maximum likelihood and Bayes estimation of the scale parameter of the half-logistic distribution based on a multiply type II censored sample. However, the maximum likelihood estimator(MLE) and Bayes estimator do not exist in an explicit form for the scale parameter. We consider a simple method of deriving an explicit estimator by approximating the likelihood function and discuss the asymptotic variances of MLE and approximate MLE. Also, an approximation based on the Laplace approximation (Tierney & Kadane, 1986) is used to obtain the Bayes estimator. In order to compare the MLE, approximate MLE and Bayes estimates of the scale parameter, Monte Carlo simulation is used.     

LAN, LAM and convergence of Iterative ML estimates; optimal design in Gaussian one-way mixed model

For a one-way mixed Gaussian ANOVA model we prove local asymptotic normality and local asymptotic minimaxity of maximum likelihood estimates (MLE) and of its certain iterative approximations. A geometric rate of convergence in probability is proved for these iterative estimates to MLE. Asymptotically optimal designs for large samples are studied.     

Asymptotic properties of MLE for partially observed fractional diffusion system with dependent noises

The paper studies long time asymptotic properties of the maximum likelihood estimator (MLE) for the signal drift parameter in a partially observed fractional diffusion system with dependent noise. Using the method of weak convergence of likelihoods due to Ibragimov and Khasminskii [1981. Statistics of Random Processes. Springer, New-York], consistency, asymptotic normality and convergence of the moments are established for MLE. The proof is based on Laplace transform computations which was introduced in Brouste and Kleptsyna [2008. Asymptotic properties of MLE for partially observed fractional diffusion system, preprint].     

The MLE of Geometric Parameter for a Geometric Process

In this article, we provide the MLE of the ratio parameter of a geometric process and discuss its consistency and asymptotic normality.     

A modified likelihood ratio test for the mean direction in the von mises distribution

The likelihood ratio test (LRT) for the mean direction in the von Mises distribution is modified for possessing a common asymptotic distribution both for large sample size and for large concentration parameter. The test statistic of the modified LRT is compared with the F distribution but not with the chi-square distribution usually employed, Good performances of the modified LRT are shown by analytical studies and Monte Carlo simulation studies, A notable advantage of the test is that it takes part in the unified likelihood inference procedures including both the marginal MLE and the marginal LRT for the concentration parameter.     

Inference in a generalized endpoint-inflated binomial regression model

Generalized endpoint-inflated binomial regression was recently proposed to model count data with large frequencies of both zeros and right-endpoints. Maximum likelihood estimation (MLE) was developed for this model and simulations suggest that the resulting estimates behave well. However, large-sample properties of the MLE have not yet been rigorously established. Such results are however essential for ensuring reliable statistical inference and decision-making. This paper addresses this issue. Identifiability of the generalized endpoint-inflated binomial regression model is first proved. Then, consistency and asymptotic normality of the MLE are established. A simulation study is conducted to assess finite-sample behaviour of the estimator.     

The Minimum Density Power Divergence Estimation for the Lognormal Density

In this article, we implement the minimum density power divergence estimation for estimating the parameters of the lognormal density. We compare the minimum density power divergence estimator (MDPDE) and the maximum likelihood estimator (MLE) in terms of robustness and asymptotic distribution. The simulations and an example indicate that the MDPDE is less biased than MLE and is as good as MLE in terms of the mean square error under various distributional situations.     

Inference of R=P[X<Y] for generalized logistic distribution

This paper deals with the estimation of R=P[X<Y] when X and Y come from two independent generalized logistic distributions with different parameters. The maximum-likelihood estimator (MLE) and its asymptotic distribution are proposed. The asymptotic distribution is used to construct an asymptotic confidence interval of R. Assuming that the common scale parameter is known, the MLE, uniformly minimum variance unbiased estimator, Bayes estimation and confidence interval of R are obtained. The MLE of R, asymptotic distribution of R in the general case, is also discussed. Monte Carlo simulations are performed to compare the different proposed methods. Analysis of a real data set has also been presented for illustrative purposes.     

Estimation of the scale parameter of the half-logistic distribution under progressively type II censored sample

Based on a progressively type II censored sample, the maximum likelihood and Bayes estimators of the scale parameter of the half-logistic distribution are derived. However, since the maximum likelihood estimator (MLE) and Bayes estimator do not exist in an explicit form for the scale parameter, we consider a simple method of deriving an explicit estimator by approximating the likelihood function and derive the asymptotic variances of MLE and approximate MLE. Also, an approximation based on the Laplace approximation (Tierney and Kadane in J Am Stat Assoc 81:82–86, 1986) and importance sampling methods are used for obtaining the Bayes estimator. In order to compare the performance of the MLE, approximate MLE and Bayes estimates of the scale parameter, we use Monte Carlo simulation.     

Estimation for Continuous Branching Processes

The maximum-likelihood estimator for the curved exponential family given by continuous branching processes with immigration is investigated. These processes originated from population biology but also model the dynamics of interest rates and development of the state of technology in economics. It is proved that in contrast to branching processes with discrete space and/or time the MLE gives a unified approach to the inference. In order to include singular subdomains of the parameter space we modify the MLE slightly. Consistency and asymptotic normality for the MLE are considered. Concerning the asymptotic theory of the experiments, all three properties LAQ, LAN, and LAMN occur for different submodels     

LOSS OF INFORMATION ASSOCIATED WITH THE ORDER STATISTICS AND RELATED ESTIMATORS IN THE DOUBLE EXPONENTIAL DISTRIBUTION CASE

Fisher (1934) derived the loss of information of the maximum likelihood estimator (MLE) of the location parameter in the case of the double exponential distribution. Takeuchi & Akahira (1976) showed that the MLE is not second order asymptotically efficient. This paper extends these results by obtaining the (asymptotic) losses of information of order statistics and related estimators, and by comparing them via their asymptotic distributions up to the second order.     

Two tests for monotone failure rate with incomplete data

Two statistics are proposed for testing for the exponential distribution against monotone failure rate alternatives when ran-domly right censored data are available. One of them is a general-ization of the Billmann, Antle and Bain test based on the MLE of the shape parameter of the Weibull distribution. The second has the advantage of being given in closed form. For this test the asymptotic null distribution is given. Consistency of the two tests is proved starting from an expected value inequality characterizing monotone failure rate.     

时变系数空间自回归面板数据模型的极大似然估计

本文对扰动项存在跨时期的异方差、但不存在序列相关的时变系数空间自回归模型提出了极大似然的估计方法,并证明了该估计量的一致性,同时,证明了该估计量渐进服从正态分布,由此说明该估计量具有优良的大样本性质。同时,我们还对本文所提出估计量的小样本性质进行了数值模拟。本文研究表明,估计量虽然在N较小时偏差较大,但是随着N的不断增加,估计量偏差减小,体现了比较优良的渐进性质。同时,估计量的偏差会随着时期数的增加而变大,这说明本文所提出的估计方法适用于个体数较多、时期数较少的短面板数据。     

On the maximum likelihood estimate for the drift of brownian motion following a symmetric sequential probability ratio test

Bias and variance are evaluated explicitly for the maximum likelihood estimate (MLE) of the drift of a Brownian motion following a symmetric sequential probability ratio test (SPRT). The MLE is shown to be asymptotically efficient when the boundary of the SPRT tends to infinity.     

Optimal rank set sampling estimates for a population proportion

This paper examines two different classes of estimates for a population proportion based on an unbalanced rank set sample. Specifically, the two classes correspond to the maximum likelihood estimator (MLE) and a weighted average (WA) estimate. Both estimators are asymptotically normal, so standard inference procedures can still be implemented. Furthermore, these results can be used to develop optimal allocation schemes for both estimators. The performances of the optimal estimators are studied in terms of both finite sample and asymptotic relative efficiency. In general, the MLE is more efficient than the WA estimate. Lastly, the practicality of the optimal sampling plans is addressed and illustrated via an example.     

Uniformly adaptive estimation for models with arma errors

A semiparametric estimator based on an unknown density isuniformly adaptive if the expected loss of the estimator converges to the asymptotic expected loss of the maximum liklihood estimator based on teh true density (MLE), and if convergence does not depend on either the parameter values or the form of the unknown density. Without uniform adaptivity, the asymptotic expected loss of the MLE need not approximate the expected loss of a semiparametric estimator for any finite sample I show that a two step semiparametric estimator is uniformly adaptive for the parameters of nonlinear regression models with autoregressive moving average errors.