Robust 2k factorial design with Weibull error distributions

It is well known that the least squares method is optimal only if the error distributions are normally distributed. However, in practice, non-normal distributions are more prevalent. If the error terms have a non-normal distribution, then the efficiency of least squares estimates and tests is very low. In this paper, we consider the 2^k factorial design when the distribution of error terms are Weibull W(p,σ). From the methodology of modified likelihood, we develop robust and efficient estimators for the parameters in 2^k factorial design. F statistics based on modified maximum likelihood estimators (MMLE) for testing the main effects and interaction are defined. They are shown to have high powers and better robustness properties as compared to the normal theory solutions. A real data set is analysed.     

Robust pairwise multiple comparisons under short-tailed symmetric distributions

In one-way ANOVA, most of the pairwise multiple comparison procedures depend on normality assumption of errors. In practice, errors have non-normal distributions so frequently. Therefore, it is very important to develop robust estimators of location and the associated variance under non-normality. In this paper, we consider the estimation of one-way ANOVA model parameters to make pairwise multiple comparisons under short-tailed symmetric (STS) distribution. The classical least squares method is neither efficient nor robust and maximum likelihood estimation technique is problematic in this situation. Modified maximum likelihood (MML) estimation technique gives the opportunity to estimate model parameters in closed forms under non-normal distributions. Hence, the use of MML estimators in the test statistic is proposed for pairwise multiple comparisons under STS distribution. The efficiency and power comparisons of the test statistic based on sample mean, trimmed mean, wave and MML estimators are given and the robustness of the test obtained using these estimators under plausible alternatives and inlier model are examined. It is demonstrated that the test statistic based on MML estimators is efficient and robust and the corresponding test is more powerful and having smallest Type I error.     

Parametric estimation of mixtures of two uniform distributions

In this paper, we consider a mixture of two uniform distributions and derive L-moment estimators of its parameters. Three possible ways of mixing two uniforms, namely with neither overlap nor gap, with overlap, and with gap, are studied. The performance of these L-moment estimators in terms of bias and efficiency is compared to that obtained by means of the conventional method of moments (MM), modified maximum likelihood (MML) method and the usual maximum likelihood (ML) method. These intensive simulations reveal that MML estimators are the best in most of the cases, and the L-moment estimators are less subject to bias in estimation for some mixtures and more efficient in most of the cases than the conventional MM estimators. The L-moment estimators are, in some cases, more efficient than the ML and MML estimators.     

Estimation of common location parameter of several heterogeneous exponential populations based on generalized order statistics

In this article, several independent populations following exponential distribution with common location parameter and unknown and unequal scale parameters are considered. From these populations, several independent samples of generalized order statistics (gos) are drawn. Under the setup of gos, the problem of estimation of common location parameter is discussed and various estimators of common location parameter are derived. The authors obtained maximum likelihood estimator (MLE), modified MLE and uniformly minimum variance unbiased estimator of common location parameter. Furthermore, under scaled-squared error loss function, a general inadmissibility result of invariant estimator is proposed. The derived results are further reduced for upper record values which is a special case of gos. Finally, simulation study and real life example are reported to show the performances of various competing estimators in terms of percentage risk improvement.     

Estimation and hypothesis testing in multivariate linear regression models under non normality

This paper discusses the problem of statistical inference in multivariate linear regression models when the errors involved are non normally distributed. We consider multivariate t-distribution, a fat-tailed distribution, for the errors as alternative to normal distribution. Such non normality is commonly observed in working with many data sets, e.g., financial data that are usually having excess kurtosis. This distribution has a number of applications in many other areas of research as well. We use modified maximum likelihood estimation method that provides the estimator, called modified maximum likelihood estimator (MMLE), in closed form. These estimators are shown to be unbiased, efficient, and robust as compared to the widely used least square estimators (LSEs). Also, the tests based upon MMLEs are found to be more powerful than the similar tests based upon LSEs.     

Estimation of common location parameter of two exponential populations based on records

Consider the problem of estimating the common location parameter of two exponential populations using record data when the scale parameters are unknown. We derive the maximum likelihood estimator (MLE), the modified maximum likelihood estimator (MMLE) and the uniformly minimum variance unbiased estimator (UMVUE) of the common location parameter. Further, we derive a general result for inadmissibility of an equivariant estimator under the scaled-squared error loss function. Using this result, we conclude that the MLE and the UMVUE are inadmissible and better estimators are provided. A simulation study is conducted for comparing the performances of various competing estimators.     

Estimation of the parameters of the gamma distribution by means of a maximal invariant

The use of a scale invariance criterion allows estimation of the shape parameter of the two parameter gamma distribution without estimating the scale parameter. Simulation experiments are used to show that the resulting estimators of both parameters are better than the usual maximum likelihood estimators in terms of both bias and mean square error. Approximately unbiased versions of the maximal invariant based estimators are derived and are shown to be as good as approximately unbiased versions of the usual maximum likelihood estimators     

Modified maximum likelihood and modified moment estimators for the three-parameter weibull distribution

This article is concerned with modifications of both maximum likelihood and moment estimators for parameters of the three-parameter Wei bull distribution. Modifications presented here are basically the same as those previously proposed by the authors (1980, 1981, 1982) in connection with the lognormal and the gamma distributions. Computer programs were prepared for the practical application of these estimators and an illustrative example is included. Results of a simulation study provide insight into the sampling behavior of the new estimators and include comparisons with the traditional moment and maximum likelihood estimators. For some combinations of parameter values, some of the modified estimators considered here enjoy advantages over both moment and maximum likelihood estimators with respect to bias, variance, and/or ease of calculation.     

On bias reduction estimators of skew-normal and skew-t distributions

A particular concerns of researchers in statistical inference is bias in parameters estimation. Maximum likelihood estimators are often biased and for small sample size, the first order bias of them can be large and so it may influence the efficiency of the estimator. There are different methods for reduction of this bias. In this paper, we proposed a modified maximum likelihood estimator for the shape parameter of two popular skew distributions, namely skew-normal and skew-t, by offering a new method. We show that this estimator has lower asymptotic bias than the maximum likelihood estimator and is more efficient than those based on the existing methods.     

A note on comparison and improvement of estimators based on likelihood

The problem of estimation of a parameter of interest in the presence of a nuisance parameter, which is either location or scale, is considered. Three estimators are taken into account: usual maximum likelihood (ML) estimator, maximum integrated likelihood estimator and the bias-corrected ML estimator. General results on comparison of these estimators w.r.t. the second-order risk based on the mean-squared error are obtained. Possible improvements of basic estimators via the notion of admissibility and methodology given in Ghosh and Sinha [A necessary and sufficient condition for second order admissibility with applications to Berkson's bioassay problem. Ann Stat. 1981;9(6):1334–1338] are considered. In the recent paper by Tanaka et al. [On improved estimation of a gamma shape parameter. Statistics. 2014; doi:10.1080/02331888.2014.915842], this problem was considered for estimating the shape parameter of gamma distribution. Here, we perform more accurate comparison of estimators for this case as well as for some other cases.     

On second-order improved estimation of a gamma scale parameter

This paper concludes our comprehensive study on point estimation of model parameters of a gamma distribution from a second-order decision theoretic point of view. It should be noted that efficient estimation of gamma model parameters for samples ‘not large’ is a challenging task since the exact sampling distributions of the maximum likelihood estimators and its variants are not known. Estimation of a gamma scale parameter has received less attention from the earlier researchers compared to shape parameter estimation. What we have observed here is that improved estimation of the shape parameter does not necessarily lead to improved scale estimation if a natural moment condition (which is also the maximum likelihood restriction) is satisfied. Therefore, this work deals with the gamma scale parameter estimation as a separate new problem, not as a by-product of the shape parameter estimation, and studies several estimators in terms of second-order risk.     

Comparison of Maximum Likelihood with Conditional Pairwise Likelihood Estimation of Person Parameters in the Rasch Model

This paper is concerned with person parameter estimation in the binary Rasch model. The loss of efficiency of a pseudo, quasi, or composite likelihood approach investigated. By means of a Monte Carlo study, two quasi likelihood estimators are compared to two well-established maximum likelihood approaches, one of which being a weighted likelihood procedure. The results show that the observed values of the root mean squared error are practically equivalent for the compared estimators in the case of a sufficiently large number of items.     

Estimation of the location and scale parameters of the extreme value distmbution based on multiply type-II censored samples

In this paper, we consider the problem of estimating the location and scale parameters of an extreme value distribution based on multiply Type-II censored samples. We first describe the best linear unbiased estimators and the maximum likelihood estimators of these parameters. After observing that the best linear unbiased estimators need the construction of some tables for its coefficients and that the maximum likelihood estimators do not exist in an explicit algebraic form and hence need to be found by numerical methods, we develop approximate maximum likelihood estimators by appropriately approximating the likelihood equations. In addition to being simple explicit estimators, these estimators turn out to be nearly as efficient as the best linear unbiased estimators and the maximum likelihood estimators. Next, we derive the asymptotic variances and covariance of these estimators in terms of the first two single moments and the product moments of order statistics from the standard extreme value distribution. Finally, we present an example in order to illustrate all the methods of estimation of parameters discussed in this paper.     

Time series models with asymmetric innovations

We consider AR(q) models in time series with asymmetric innovations represented by two families ofdistributions: (i) gamma with support IR : (0, ∞), and (ii) generalized logistic with support IR:(-∞,∞). Since the ML (maximum likelihood) estimators are intractable, we derive the MML (modified maximum likelihood) estimators of the parameters and show that they are remarkably efficient besides being easy to compute. We investigate the efficiency properties of the classical LS (least squares) estimators. Their efficiencies relative to the proposed MML estimators are very low.     

New modified moment estimators for the two-parameter weighted Lindley distribution

We propose a modification of the moment estimators for the two-parameter weighted Lindley distribution. The modification replaces the second sample moment (or equivalently the sample variance) by a certain sample average which is bounded on the unit interval for all values in the sample space. In this method, the estimates always exist uniquely over the entire parameter space and have consistency and asymptotic normality over the entire parameter space. The bias and mean squared error of the estimators are also examined by means of a Monte Carlo simulation study, and the empirical results show the small-sample superiority in addition to the desirable large sample properties. Monte Carlo simulation study showed that the proposed modified moment estimators have smaller biases and smaller mean-square errors than the existing moment estimators and are compared favourably with the maximum likelihood estimators in terms of bias and mean-square error. Three illustrative examples are finally presented.     

Robust statistics for testing mean vectors of multivariate distributions

We develop a ‘robust’ statistic T² _R, based on Tiku's (1967, 1980) MML (modified maximum likelihood) estimators of location and scale parameters, for testing an assumed meam vector of a symmetric multivariate distribution. We show that T² _R is one the whole considerably more powerful than the prominenet Hotelling T² statistics. We also develop a robust statistic T² _D for testing that two multivariate distributions (skew or symmetric) are identical; T² _D seems to be usually more powerful than nonparametric statistics. The only assumption we make is that the marginal distributions are of the type (1/σ_k)f((x-μ_k)/σ_k) and the means and variances of these marginal distributions exist.     

Modeling binary responses with stochastic covariates

In a traditional binary regression model, covariates are assumed to be fixed by design. In practice, however, they are most likely to be stochastic and non-normally distributed. We develop modified maximum likelihood estimators for such situations. We show that these estimators are more efficient than the traditional binary regression estimators and robust to data anomalies. We illustrate our results using a real life example.     

Properties of estimators for the gamma distribution

Accurate moments of maximum likelihood and moment estimators for the scale and shape parameters of a two parameter gamma density are given, the former being tabulated over a segment of the parameter space. In addition, joint acceptance regions are given for a particular case. The three parameter model is also considered and comments made on second order asymptotics for the maximum likelihood estimators     

ASYMPTOTIC PROPERTIES OF RESTRICTED MAXIMUM LIKELIHOOD (REML) ESTIMATES FOR HIERARCHICAL MIXED LINEAR MODELS

This paper explores the asymptotic distribution of the restricted maximum likelihood estimator of the variance components in a general mixed model. Restricting attention to hierarchical models, central limit theorems are obtained using elementary arguments with only mild conditions on the covariates in the fixed part of the model and without having to assume that the data are either normally or spherically symmetrically distributed. Further, the REML and maximum likelihood estimators are shown to be asymptotically equivalent in this general framework, and the asymptotic distribution of the weighted least squares estimator (based on the REML estimator) of the fixed effect parameters is derived.     

Robust Estimation and Hypothesis Testing of Linear Contrasts in Analysis of Covariance with Stochastic Covariates

Estimators of parameters are derived by using the method of modified maximum likelihood (MML) estimation when the distribution of covariate X and the error e are both non-normal in a simple analysis of covariance (ANCOVA) model. We show that our estimators are efficient. We also develop a test statistic for testing a linear contrast and show that it is robust. We give a real life example.