ESTIMATION OF PARAMETERS IN THE MARGINAL FISHER DISTRIBUTION1

The Fisher distribution is frequently used as a model for the probability distribution of directional data, which may be specified either in terms of unit vectors or angular co-ordinates (co-latitude and azimuth). If, in practical situations, only the co-latitudes can be observed, the available data must be regarded as a sample from the corresponding marginal distribution. This paper discusses the estimation by Maximum Likelihood (ML) and the Method of Moments of the two parameters of this marginal Fisher distribution. The moment estimators are generally simpler to compute than the ML estimators, and have high asymptotic efficiency.     

Estimating a distribution for each category of a sensitive variate

The use of a Randomized Response (RR) design makes it possible to estimate the distribution of a sensitive variate. In this paper, the estimation of the distribution of a non-sensitive variate for each category of a sensitive variate is considered for the case where data on the sensitive variate is obtained by use of an RR procedure. Simple estimators are developed without making any distributional assumptions about the non-sensitive variate. However, if distributional assumptions are made, it is shown that the EM algorithm may be used to compute Maximum Likelihood estimates. Computational comparisons of the estimators, using simulation, indicate that the simple estimators perform well, particularly for large sample sizes.     

Maximum likelihood estimation of variance components of heteroscedastic random anova model

the estimation of variance components of heteroscedastic random model is discussed in this paper. Maximum Likelihood (ML) is described for one-way heteroscedastic random models. The proportionality condition that cell variance is proportional to the cell sample size, is used to eliminate the efffect of heteroscedasticity. The algebraic expressions of the estimators are obtained for the model. It is seen that the algebraic expressions of the estimators depend mainly on the inverse of the variance-covariance matrix of the observation vector. So, the variance-covariance matrix is obtained and the formulae for the inversions are given. A Monte Carlo study is conducted. Five different variance patterns with different numbers of cells are considered in this study. For each variance pattern, 1000 Monte Carlo samples are drawn. Then the Monte Carlo biases and Monte Carlo MSE’s of the estimators of variance components are calculated. In respect of both bias and MSE, the Maximum Likelihood (ML) estimators of variance components are found to be sufficiently good.     

The empirical Bayes estimators of the parameter of the Poisson distribution with a conjugate gamma prior under Stein's loss function

For the hierarchical Poisson and gamma model, we calculate the Bayes posterior estimator of the parameter of the Poisson distribution under Stein's loss function which penalizes gross overestimation and gross underestimation equally and the corresponding Posterior Expected Stein's Loss (PESL). We also obtain the Bayes posterior estimator of the parameter under the squared error loss and the corresponding PESL. Moreover, we obtain the empirical Bayes estimators of the parameter of the Poisson distribution with a conjugate gamma prior by two methods. In numerical simulations, we have illustrated: The two inequalities of the Bayes posterior estimators and the PESLs; the moment estimators and the Maximum Likelihood Estimators (MLEs) are consistent estimators of the hyperparameters; the goodness-of-fit of the model to the simulated data. The numerical results indicate that the MLEs are better than the moment estimators when estimating the hyperparameters. Finally, we exploit the attendance data on 314 high school juniors from two urban high schools to illustrate our theoretical studies.     

On the comparison of Fisher information of the Weibull and GE distributions

In this paper, we consider the Fisher information matrices of the generalized exponential (GE) and Weibull distributions for complete and Type-I censored observations. Fisher information matrix can be used to compute asymptotic variances of the different estimators. Although both distributions may provide similar data fit but the corresponding Fisher information matrices can be quite different. Moreover, the percentage loss of information due to truncation of the Weibull distribution is much more than the GE distribution. We compute the total information of the Weibull and GE distributions for different parameter ranges. We compare the asymptotic variances of the median estimators and the average asymptotic variances of all the percentile estimators for complete and Type-I censored observations. One data analysis has been preformed for illustrative purposes. When two fitted distributions are very close to each other and very difficult to discriminate otherwise, the Fisher information or the above mentioned asymptotic variances may be used for discrimination purposes.     

A Robust Control Chart for Monitoring the Mean of an Autocorrelated Process

Residual control charts are frequently used for monitoring autocorrelated processes. In the design of a residual control chart, values of the true process parameters are often estimated from a reference sample of in-control observations by using least squares (LS) estimators. We propose a robust control chart for autocorrelated data by using Modified Maximum Likelihood (MML) estimators in constructing a residual control chart. Average run length (ARL) is simulated for the proposed chart when the underlying process is AR(1). The results show the superiority of the new chart under several situations. Moreover, the chart is robust to plausible deviations from assumed distribution of errors.     

Estimation and prediction for the generalized inverted exponential distribution based on progressively first-failure-censored data with application

In this paper, the estimation of parameters for a generalized inverted exponential distribution based on the progressively first-failure type-II right-censored sample is studied. An expectation–maximization (EM) algorithm is developed to obtain maximum likelihood estimates of unknown parameters as well as reliability and hazard functions. Using the missing value principle, the Fisher information matrix has been obtained for constructing asymptotic confidence intervals. An exact interval and an exact confidence region for the parameters are also constructed. Bayesian procedures based on Markov Chain Monte Carlo methods have been developed to approximate the posterior distribution of the parameters of interest and in addition to deduce the corresponding credible intervals. The performances of the maximum likelihood and Bayes estimators are compared in terms of their mean-squared errors through the simulation study. Furthermore, Bayes two-sample point and interval predictors are obtained when the future sample is ordinary order statistics. The squared error, linear-exponential and general entropy loss functions have been considered for obtaining the Bayes estimators and predictors. To illustrate the discussed procedures, a set of real data is analyzed.     

Estimation for an inverted exponentiated Rayleigh distribution under type II progressive censoring

In this paper, we consider estimation of unknown parameters of an inverted exponentiated Rayleigh distribution under type II progressive censored samples. Estimation of reliability and hazard functions is also considered. Maximum likelihood estimators are obtained using the Expectation–Maximization (EM) algorithm. Further, we obtain expected Fisher information matrix using the missing value principle. Bayes estimators are derived under squared error and linex loss functions. We have used Lindley, and Tiernery and Kadane methods to compute these estimates. In addition, Bayes estimators are computed using importance sampling scheme as well. Samples generated from this scheme are further utilized for constructing highest posterior density intervals for unknown parameters. For comparison purposes asymptotic intervals are also obtained. A numerical comparison is made between proposed estimators using simulations and observations are given. A real-life data set is analyzed for illustrative purposes.     

Fitting DNA sequences through log-linear modelling with linear constraints

For some discrete state series, such as DNA sequences, it can often be postulated that its probabilistic behaviour is given by a Markov chain. For making the decision on whether or not an uncharacterized piece of DNA is part of the coding region of a gene, under the Markovian assumption, there are two statistical tools that are essential to be considered: the hypothesis testing of the order in a Markov chain and the estimators of transition probabilities. In order to improve the traditional statistical procedures for both of them when stationarity assumption can be considered, a new version for understanding the homogeneity hypothesis is proposed so that log-linear modelling is applied for conditional independence jointly with homogeneity restrictions on the expected means of transition counts in the sequence. In addition we can consider a variety of test-statistics and estimators by using φ-divergence measures. As special case of them the well-known likelihood ratio test-statistics and maximum-likelihood estimators are obtained.     

A study of moments and likelihood estimators of the odd Weibull distribution

The odd Weibull distribution is a three-parameter generalization of the Weibull and the inverse Weibull distributions having rich density and hazard shapes for modeling lifetime data. This paper explored the odd Weibull parameter regions having finite moments and examined the relation to some well-known distributions based on skewness and kurtosis functions. The existence of maximum likelihood estimators have shown with complete data for any sample size. The proof for the uniqueness of these estimators is given only when the absolute value of the second shape parameter is between zero and one. Furthermore, elements of the Fisher information matrix are obtained based on complete data using a single integral representation which have shown to exist for any parameter values. The performance of the odd Weibull distribution over various density and hazard shapes is compared with generalized gamma distribution using two different test statistics. Finally, analysis of two data sets has been performed for illustrative purposes.     

Inference on a progressive type I interval-censored truncated normal distribution

In this paper, we consider the problem of making statistical inference for a truncated normal distribution under progressive type I interval censoring. We obtain maximum likelihood estimators of unknown parameters using the expectation-maximization algorithm and in sequel, we also compute corresponding midpoint estimates of parameters. Estimation based on the probability plot method is also considered. Asymptotic confidence intervals of unknown parameters are constructed based on the observed Fisher information matrix. We obtain Bayes estimators of parameters with respect to informative and non-informative prior distributions under squared error and linex loss functions. We compute these estimates using the importance sampling procedure. The highest posterior density intervals of unknown parameters are constructed as well. We present a Monte Carlo simulation study to compare the performance of proposed point and interval estimators. Analysis of a real data set is also performed for illustration purposes. Finally, inspection times and optimal censoring plans based on the expected Fisher information matrix are discussed.     

Robust Estimators for the Parameters of Multivariate Lognormal Distribution

Abstract

In this paper, we introduce a class of location and scale estimators for the p-variate lognormal distribution. These estimators are obtained by applying a log transform to the data, computing robust Fisher consistent estimators for the obtained Gaussian data and transforming those estimators for the lognormal using the relationship between the parameters of both distributions. We prove some of the properties of these estimators, such as Fisher consistency, robustness and asymptotic normality.     

The power piecewise exponential model

In this paper an extension of the piecewise exponential distribution based on the distribution of the maximum of a random sample is considered. Properties of its density and hazard function are investigated. Maximum likelihood inference is discussed and the Fisher information matrix is identified. Results of two real data applications are reported, where model fitting is implemented by using maximum likelihood. The applications illustrate the better performance of the new distribution when compared with other recently proposed alternative models.     

Comparative Study of Blu and ML Estimators of Location and Scale Parameters of an Extreme Value Distribution for Small Samples and Type I Censorship

The Maximum Likelihood (ML) and Best Linear Unbiased (BLU) estimators of the location and scale parameters of an extreme value distribution (Lawless [1982]) are compared under conditions of small sample sizes and Type I censorship. The comparisons were made in terms of the mean square error criterion. According to this criterion, the ML estimator of σ in the case of very small sample sizes (n < 10) and heavy censorship (low censoring time) proved to be more efficient than the corresponding BLU estimator. However, the BLU estimator for σ attains parity with the corresponding ML estimator when the censoring time increases even for sample sizes as low as 10. The BLU estimator of σ attains equivalence with the ML estimator when the sample size increases above 10, particularly when the censoring time is also increased. The situation is reversed when it came to estimating the location parameter μ, as the BLU estimator was found to be consistently more efficient than the ML estimator despite the improved performance of the ML estimator when the sample size increases. However, computational ease and convenience favor the ML estimators.     

Basu–Dhar bivariate geometric distribution in the presence of covariates and censored data: a Bayesian approach

In this paper, we introduce classical and Bayesian approaches for the Basu–Dhar bivariate geometric distribution in the presence of covariates and censored data. This distribution is considered for the analysis of bivariate lifetime as an alternative to some existing bivariate lifetime distributions assuming continuous lifetimes as the Block and Basu or Marshall and Olkin bivariate distributions. Maximum likelihood and Bayesian estimators are presented. Two examples are considered to illustrate the proposed methodology: an example with simulated data and an example with medical bivariate lifetime data.     

Improved inference for MCP-Mod approach using time-to-event endpoints with small sample sizes

The Multiple Comparison Procedures with Modeling Techniques (MCP-Mod) framework has been recently approved by the U.S. Food, Administration, and European Medicines Agency as fit-for-purpose for phase II studies. Nonetheless, this approach relies on the asymptotic properties of Maximum Likelihood (ML) estimators, which might not be reasonable for small sample sizes. In this paper, we derived improved ML estimators and correction for their covariance matrices in the censored Weibull regression model based on the corrective and preventive approaches. We performed two simulation studies to evaluate ML and improved ML estimators with their covariance matrices in (i) a regression framework (ii) the Multiple Comparison Procedures with Modeling Techniques framework. We have shown that improved ML estimators are less biased than ML estimators yielding Wald-type statistics that controls type I error without loss of power in both frameworks. Therefore, we recommend the use of improved ML estimators in the MCP-Mod approach to control type I error at nominal value for sample sizes ranging from 5 to 25 subjects per dose.     

Empirical likelihood estimation for linear regression models with AR(p) error terms with numerical examples

Linear regression models are useful statistical tools to analyze data sets in different fields. There are several methods to estimate the parameters of a linear regression model. These methods usually perform under normally distributed and uncorrelated errors. If error terms are correlated the Conditional Maximum Likelihood (CML) estimation method under normality assumption is often used to estimate the parameters of interest. The CML estimation method is required a distributional assumption on error terms. However, in practice, such distributional assumptions on error terms may not be plausible. In this paper, we propose to estimate the parameters of a linear regression model with autoregressive error term using Empirical Likelihood (EL) method, which is a distribution free estimation method. A small simulation study is provided to evaluate the performance of the proposed estimation method over the CML method. The results of the simulation study show that the proposed estimators based on EL method are remarkably better than the estimators obtained from CML method in terms of mean squared errors (MSE) and bias in almost all the simulation configurations. These findings are also confirmed by the results of the numerical and real data examples.     

Two sided acceptance sampling plans based on mml estimators

Alternative estimators that are robust to non-normality in the symmetric thick tailed situation are shown to yield much better results tl)an do [Xbar] and s. The particular estimators suggested in this paper are the Modified Maximum Likelihood estimators of Tiku (1967).     

A monte carlo study of variable selection and inferences in a two stage random coefficient linear regression model with unbalanced data

A growth curve analysis is often applied to estimate patterns of changes in a given characteristic of different individuals. It is also used to find out if the variations in the growth rates among individuals are due to effects of certain covariates. In this paper, a random coefficient linear regression model, as a special case of the growth curve analysis, is generalized to accommodate the situation where the set of influential covariates is not known a priori. Two different approaches for seleaing influential covariates (a weighted stepwise selection procedure and a modified version of Rao and Wu’s selection criterion) for the random slope coefficient of a linear regression model with unbalanced data are proposed. Performances of these methods are evaluated by means of Monte-Carlo simulation. In addition, several methods (Maximum Likelihood, Restricted Maximum Likelihood, Pseudo Maximum Likelihood and Method of Moments) for estimating the parameters of the selected model are compared Proposed variable selection schemes and estimators are appliedtotheactualindustrial problem which motivated this investigation.     

Maximum likelihood revisited under a semi-parametric context - estimation of the tail index

In this paper, and in a context of regularly varying tails, we study computationally the classical Maximum Likelihood (ML) estimator based on the Paretian behaviour of the excesses over a high threshold, denoted PML-estimator, a type II Censoring estimator based specifically on a Fréchet parent, denoted CENS-estimator, and two ML estimators based on the scaled log-spacings, and denoted SLS-estimators. These estimators are considered under a semi-parametric set-up, and compared with the classical Hill estimator and a Generalized Jackknife (GJ) estimator, which has essentially in mind a reduction of the bias of Hill's estimator.