On the maximum-likelihood estimator for the location parameter of a cauchy distribution

In the literature of point estimation, the Cauchy distribution with location parameter is often cited as an example for the failure of maximum-likelihood method and hence the failure of the likelihood principle in general. Contrary to the above notion, we prove that even in this case the likelihood equation has multiple roots and that the maximum-likelihood estimator (the global maximum) remains as an asymptotically optimal estimator in the Bahadur sense.     

Asymptotic properties of maximum-likelihood estimators for Heston models based on continuous time observations

We study asymptotic properties of maximum-likelihood estimators for Heston models based on continuous time observations of the log-price process. We distinguish three cases: subcritical (also called ergodic), critical and supercritical. In the subcritical case, asymptotic normality is proved for all the parameters, while in the critical and supercritical cases, non-standard asymptotic behaviour is described.     

Bias reduction of the maximum-likelihood estimator for a conditional Gaussian MA(1) model

In this paper, we consider an estimation for the unknown parameters of a conditional Gaussian MA(1) model. In the majority of cases, a maximum-likelihood estimator is chosen because the estimator is consistent. However, for small sample sizes the error is large, because the estimator has a bias of O(n^{? 1}). Therefore, we provide a bias of O(n^{? 1}) for the maximum-likelihood estimator for the conditional Gaussian MA(1) model. Moreover, we propose new estimators for the unknown parameters of the conditional Gaussian MA(1) model based on the bias of O(n^{? 1}). We investigate the properties of the bias, as well as the asymptotical variance of the maximum-likelihood estimators for the unknown parameters, by performing some simulations. Finally, we demonstrate the validity of the new estimators through this simulation study.     

Moderate Deviations for Bayes Posteriors

Let ( X_k ) k be a sequence of i.i.d. random variables taking values in a set , and consider the problem of estimating the law of X₁ in a Bayesian framework. We prove, under mild conditions on the prior, that the sequence of posterior distributions satisfies a moderate deviation principle.     

Asymptotic properties of the maximum-likelihood estimator for a class of birth-and-death processes admitting a unique stationary distribution

The asymptotic properties of the maximum-likelihood estimator of the parameter vector for a class of birth-and-death processes admitting a unique stationary distribution are studied. Also, it is shown that identifiability of the parameter vector with respect to the likelihood implies that the Fisher information matrix is of full rank. Two special cases of biological interest are presented. One of these, the exponential birth-and-death process, is proposed as a more appropriate model of density dependence than the logistic process.     

On a preliminary test estimator for one of the parameters of the log-zero-poisson distribution

A discrete distribution called the log-zero-Poisson distribution has been recommended by Katti (c.f. Biometrics 1970) as an alternate to the negative binomial and other distributions usually called "contagious" distributions.A major problem in the use of this and all other contagious distributions has been the difficulty of obtaining the maximum likelihood esti-mates. A custom-made ad hoc estimator, λ, has been proposed for the parameter λ of this distribution in Katti and Khedr (1980). In this paper, its efficiency relative to Fisher information is studied, only to discover that λ can be 30 times better than the maximum likelihood estimate in some parts of the parameter space and much weaker in other parts.A preliminary test is recommended to choose between the estimates, and the efficiency of the procedure is tabulated. As it is to be expected, the resultant estimator equals the better of the two estimators with some error at the values of the parameters where the two estimators are equivalent.     

Moderate deviations for the total population arising from a nearly unstable sub-critical Galton-Watson process with immigration

Abstract

In this paper, we consider the moderate deviation of the nearly unstable sub-critical Galton-Waston process with immigration for the centered total population arising. We discuss the main influence factors for the form of moderate deviation in different stochastic processes. Moreover, we compute the exact rate function in every different situation of MDP.     

Optimal bivariate step-stress accelerated life test for Type-I hybrid censored data

This paper presents a step-stress accelerated life test for two stress variables to obtain optimal hold times under a Type-I hybrid censoring scheme. An exponentially distributed life and a cumulative exposure model are assumed. The maximum-likelihood estimates are given, from which the asymptotic variance and the Fisher information matrix are obtained. The optimal test plan is determined for each combination of stress levels by minimizing the asymptotic variance of reliability estimate at a typical operating condition. Finally, simulation results are discussed to illustrate the proposed criteria. Simulation results show that the proposed optimum plan is robust, and the initial estimates have a small effect on optimal values.     

Moderate deviations for the random weighted sums of END random variables with consistently varying tails

In this paper, we study moderate deviations for random weighted sums of extended negative dependent (END) random variables, which are consistently-varying tailed and not necessarily identically distributed. When these END random variables are independent of their weights, and the weights are positive random variables with two-sided bounds, the results shows END structure and the dependence between the weights have no effects on the asymptotic behavior of moderate deviations of partial sums and random sums.     

Moderate deviations for the random weighted sums of WUOD random variables with consistently varying tails

Abstract

In this paper, we investigate the moderate deviations for random weighted sums of widely upper orthant dependent (WUOD) random variables with consistently varying tails, which are not necessarily identically distributed. In the end, we obtain the asymptotic relations for random weighted sums of random variables.     

A robust estimator for wall following

An early goal in autonomous navigation research is to build a research vehicle which can travel through office areas and factory floors, A simple strategy for directing the robot's movement in a hallway is to maintain a fixed distance from the wall. The problem is complicated by the fact that there are many factors in the environment, such as opened doors, pillars or other temporary objects, that can introduce 'noise' into the distance measure. To maintain a proper path with minimum interruption, the robot should have the ability to make decisions, based on measurements, and adjust its course only when it is deemed necessary. This report describes a new algorithm which enables the robot to move along and maintain a fixed distance from a reference object. The method, based on a robust estimator of the location, combines information from earlier measurements with current observations from range sensors to effectively produce an estimate of the distance between the robot and the object. A simulation study, showing the trajectories generated using this algorithm with different parameters for different environments, is presented.     

A maximum-likelihood estimator with infinite error

The standard error of the maximum-likelihood estimator for 1/μ based on a random sample of size N from the normal distribution N(μ,σ²) is infinite. This could be considered to be a disadvantage.Another disadvantage is that the bias of the estimator is undefined if the integral is interpreted in the usual sense as a Lebesgue integral. It is shown here that the integral expression for the bias can be interpreted in the sense given by the Schwartz theory of generalized functions. Furthermore, an explicit closed form expression in terms of the complex error function is derived. It is also proven that unbiased estimation of 1/μ is impossible.Further results on the maximum-likelihood estimator are investigated, including closed form expressions for the generalized moments and corresponding complete asymptotic expansions. It is observed that the problem can be reduced to a one-parameter problem depending only on , and this holds also for more general location-scale problems. The parameter can be interpreted as a shape parameter for the distribution of the maximum-likelihood estimator.An alternative estimator is suggested motivated by the asymptotic expansion for the bias, and it is argued that the suggested estimator is an improvement. The method used for the construction of the estimator is simple and generalizes to other parametric families.The problem leads to a rediscovery of a generalized mathematical expectation introduced originally by Kolmogorov [1933. Foundations of the Theory of Probability, second ed. Chelsea Publishing Company (1956)]. A brief discussion of this, and some related integrals, is provided. It is in particular argued that the principal value expectation provides a reasonable location parameter in cases where it exists. This does not hold generally for expectations interpreted in the sense given by the Schwartz theory of generalized functions.     

Large and moderate deviations for the total population in the nearly unstable INAR(1) model

This paper considers the non negative integer-valued autoregressive process with order one (INAR(1)), where the autoregression parameter is close to unity. Using the methods introduced by Yu, Wang, and Chen (2016 Yu, S. H., D. H. Wang, and X. Chen. 2016. Large and moderate deviations for the total population arising from a sub-critical Galton-Watson process with immigration. Journal of Theoretical Probabiltiy, doi:10.1007/s10959-016-0706-4.[Crossref] , [Google Scholar]), the large and moderate deviations with explicit rate functions for the total population of this process can be obtained.     

Large and moderate deviations for modified Engel series

The modified Engel series of real numbers introduced by Rényi (1962 Rényi, A. (1962). A new approach to the theory of Engel’s series. Ann. Univ. Sci. Budapest. Eötvös Sect. Math. 5:25–32. [Google Scholar]) is a simple modification of Engel series, and they have the same classical limit theorems, such as the law of large numbers, central limit theorem, and law of the iterated logarithm. In this paper, we studied the large and moderate deviations for modified Engel series, which indicate that the large deviations for modified Engel series and Engel series are different.     

An extension of a rank criterion for the least squares estimator to be the best linear unbiased estimator

Among criteria for the least squares estimator in a linear model (y, Xβ, V) to be simultaneously the best linear unbiased estimator, one convenient for applications is that of Anderson (1971, 1972). His result, however, has been developed under assumptions of full column rank for X and nonsingularity for V. Subsequently, this result has been extended by Styan (1973) to the case when the restriction on X is removed. In this note, it is shown that also the restriction on V can be relaxed and, consequently, that Anderson's criterion is applicable to the general linear model without any rank assumptions at all.     

Trimmed least squares estimator as best trimmed linear conditional estimator for linear regression model

A class of trimmed linear conditional estimators based on regression quantiles for the linear regression model is introduced. This class serves as a robust analogue of non-robust linear unbiased estimators. Asymptotic analysis then shows that the trimmed least squares estimator based on regression quantiles ( Koenker and Bassett ( 1978 ) ) is the best in this estimator class in terms of asymptotic covariance matrices. The class of trimmed linear conditional estimators contains the Mallows-type bounded influence trimmed means ( see De Jongh et al ( 1988 ) ) and trimmed instrumental variables estimators. A large sample methodology based on trimmed instrumental variables estimator for confidence ellipsoids and hypothesis testing is also provided.     

Asymptotic properties of a conditional maximum-likelihood estimator

Inference for a scalar interest parameter in the presence of nuisance parameters is considered in terms of the conditional maximum-likelihood estimator developed by Cox and Reid (1987). Parameter orthogonality is assumed throughout. The estimator is analyzed by means of stochastic asymptotic expansions in three cases: a scalar nuisance parameter, m nuisance parameters from m independent samples, and a vector nuisance parameter. In each case, the expansion for the conditional maximum-likelihood estimator is compared with that for the usual maximum-likelihood estimator. The means and variances are also compared. In each of the cases, the bias of the conditional maximum-likelihood estimator is unaffected by the nuisance parameter to first order. This is not so for the maximum-likelihood estimator. The assumption of parameter orthogonality is crucial in attaining this result. Regardless of parametrization, the difference in the two estimators is first-order and is deterministic to this order.     

On necessary and sufficient condition for superiority of ridge estimator over least squares estimator

The necessary and sufficient condition is obtained such that ridge estimator is better than the least squares estimator relative to the matrix mean square error.     

A note on the asymptotic distribution of the maximum likelihood estimator for the scalar skew-normal distribution

We consider likelihood based inference for the parameter of a skew-normal distribution. One of the problems shown by this model is the singularity of the Fisher information matrix when skewness is absent. We derive the rate of convergence to the asymptotic distribution of the maximum likelihood estimator and study an alternative parameterization which overcomes problems related to the singularity of the information matrix.