Response shrinkage estimation in multinomial logit models

A shrinkage estimation method for multinomial logit models is developed. The proposed method is based on shrinking the responses for each category towards the underlying probabilities. The estimator is also used in combination with Pregibon's resistant fitting. The resulting estimator can also be used to control the over-estimation of Pregibon's resistant estimator. The proposed method handles not only the problem of separation in multinomial logit models but estimates also exist when the number of covariates is large relative to the sample size. Estimates exist even when the MLE does not exist. Estimates can be easily computed with all commonly used statistical packages supporting the fitting procedures with weights. Estimates are compared with the usual MLE and Firth's bias reduction technique in a simulation study and an application.     

Maximum likelihood estimation for the negative multinomial log-linear model

A log-linear model is defined for multiway contingency tables with negative multinomial frequency counts. The maximum likelihood estimator of the model parameters and the estimator covariance matrix is given. The likelihood ratio test for the general log-linear hypothesis also is presented.     

The negative multinomial logit model

A polychotomous logit model is defined for negative multinomial frequency counts within independent populations. An efficient estimator of the model parameters and estimator covariance matrix is given in closed form. Minimum chi-square and Wald tests are presented.     

Small area estimates of labour force participation under a multinomial logit mixed model

Summary.  A new methodology is developed for estimating unemployment or employment characteristics in small areas, based on the assumption that the sample totals of unemployed and employed individuals follow a multinomial logit model with random area effects. The method is illustrated with UK labour force data aggregated by sex–age groups. For these data, the accuracy of direct estimates is poor in comparison with estimates that are derived from the multinomial logit model. Furthermore, two different estimators of the mean-squared errors are given: an analytical approximation obtained by Taylor linearization and an estimator based on bootstrapping. A simulation study for comparison of the two estimators shows the good performance of the bootstrap estimator.     

Inference on Polychotomous Responses in Finite Populations

Abstract. A model‐based predictive estimator is proposed for the population proportions of a polychotomous response variable, based on a sample from the population and on auxiliary variables, whose values are known for the entire population. The responses for the non‐sample units are predicted using a multinomial logit model, which is a parametric function of the auxiliary variables. A bootstrap estimator is proposed for the variance of the predictive estimator, its consistency is proved and its small sample performance is compared with that of an analytical estimator. The proposed predictive estimator is compared with other available estimators, including model‐assisted ones, both in a simulation study involving different sampling designs and model mis‐specification, and using real data from an opinion survey. The results indicate that the prediction approach appears to use auxiliary information more efficiently than the model‐assisted approach.     

Clustering Discrete Data Through the Multinomial Mixture Model

In this work, the multinomial mixture model is studied, through a maximum likelihood approach. The convergence of the maximum likelihood estimator to a set with characteristics of interest is shown. A method to select the number of mixture components is developed based on the form of the maximum likelihood estimator. A simulation study is then carried out to verify its behavior. Finally, two applications on real data of multinomial mixtures are presented.     

Maximum likelihood estimation for ordered expectations of correlated binary variables

A multivariate binary distribution that incorporates the correlation between individual variables is considered. The availability of auxiliary information taking the form of simple ordering constraints on their expected values is assumed. The problem of constructing constraint-preserving estimates for expectations is formulated as conditional maximization of convex likelihood function for corresponding multinomial distribution with suitably chosen restrictions. Starting values for convex optimization algorithms are proposed. The proposed estimator is consistent under mild assumptions.     

Multinomial Probability Estimation by Wavelet Thresholding

In this article, we introduce a wavelet threshold estimator to estimate multinomial probabilities. The advantages of the estimator are its adaptability to the roughness and sparseness of the data. The asymptotic behavior of the estimator is investigated through an often-used criteria: the mean sum of squared error (MSSE). We show that the MSSE of the estimator achieves the optimal rate of convergence. Its performance on finite samples is examined through simulation studies which show favorable results for the new estimator over the commonly used kernel estimator.     

Some New Results on the Multinomial Randomized Response Model

ABSTRACT

The randomized response technique is an effective survey method designed to elicit sensitive information while ensuring the privacy of the respondents. In this article, we present some new results on the randomization response model in situations wherein one or two response variables are assumed to follow a multinomial distribution. For a single sensitive question, we use the well-known Hopkins randomization device to derive estimates, both under the assumption of truthful and untruthful responses, and present a technique for making pairwise comparisons. When there are two sensitive questions of interest, we derive a Pearson product moment correlation estimator based on the multinomial model assumption. This estimator may be used to quantify the linear relationship between two variables when multinomial response data are observed according to a randomized-response protocol.     

On parameter estimation in Bernoulli trials with dependence

A simple estimator is proposed for the dependence parameter for the Klotz model of Bernoulli trials with Markov dependence and it is compared with the ratio estimator given by Price and the approximate maximum likelihood estimator given by Klotz. The proposed estimator is shown to have considerably smaller bias than the other two estimators with comparable mean squared errors, and has all the large sample optimal properties that the other two estimators have.     

Pseudo-bayes estimation of multinomial proportions

In the simultaneous estimation of multinomial proportions, two estimators are developed which incorporate prior means and a prior parameter which reflects the accuracy of the prior means. These estimators possess substantially smaller risk than the standard estimator in a region of the parameter space and are much more robust than the conjugate Bayes estimator with respect to parameter values far from the prior mean. When vague prior information is available, these estimators and confidence regions derived from them appear to be attractive alternatives to the procedures based on the standard estimator.     

On the estimation of serial correlation in Markov-dependent production processes

In this paper, we present a study about the estimation of the serial correlation for Markov chain models which is used often in the quality control of autocorrelated processes. Two estimators, non-parametric and multinomial, for the correlation coefficient are discussed. They are compared with the maximum likelihood estimator [U.N. Bhat and R. Lal, Attribute control charts for Markov dependent production process, IIE Trans. 22 (2) (1990), pp. 181–188.] by using some theoretical facts and the Monte Carlo simulation under several scenarios that consider large and small correlations as well a range of fractions (p) of non-conforming items. The theoretical results show that for any value of p≠0.5 and processes with autocorrelation higher than 0.5, the multinomial is more precise than maximum likelihood. However, the maximum likelihood is better when the autocorrelation is smaller than 0.5. The estimators are similar for p=0.5. Considering the average of all simulated scenarios, the multinomial estimator presented lower mean error values and higher precision, being, therefore, an alternative to estimate the serial correlation. The performance of the non-parametric estimator was reasonable only for correlation higher than 0.5, with some improvement for p=0.5.     

Consistent Estimation of the Structural Distribution Function

Motivated by problems in linguistics we consider a multinomial random vector for which the number of cells N is not much smaller than the sum of the cell frequencies, i.e. the sample size n . The distribution function of the uniform distribution on the set of all cell probabilities multiplied by N is called the structural distribution function of the cell probabilities. Conditions are given that guarantee that the structural distribution function can be estimated consistently as n increases indefinitely although n / N does not. The natural estimator is inconsistent and we prove consistency of essentially two alternative estimators.     

A two-parameter estimator in the negative binomial regression model

In this article, a two-parameter estimator is proposed to combat multicollinearity in the negative binomial regression model. The proposed two-parameter estimator is a general estimator which includes the maximum likelihood (ML) estimator, the ridge estimator (RE) and the Liu estimator as special cases. Some properties on the asymptotic mean-squared error (MSE) are derived and necessary and sufficient conditions for the superiority of the two-parameter estimator over the ML estimator and sufficient conditions for the superiority of the two-parameter estimator over the RE and the Liu estimator in the asymptotic mean-squared error (MSE) matrix sense are obtained. Furthermore, several methods and three rules for choosing appropriate shrinkage parameters are proposed. Finally, a Monte Carlo simulation study is given to illustrate some of the theoretical results.     

Estimation of the mean of an exponential distribution in the presence of an outlier

Kale and Sinha (1971) have found an estimator of the mean of an exponential distribution in the présence of an outlying observation with higher expected value. Here an alternative estimator of the mean is proposed and it is compared with the estimator of Kale and Sinha (1971) and the maximum likelihood estimator given by Kale (1975). The proposed estimator is found to be more efficient than the latter two estimators in some cases.     

双重分层抽样中的校正估计

校正估计法已被大量运用于抽样调查中,它利用辅助信息构造的校正权重提高了对总体总值（或均值）的估计精度。本文提出了分层抽样中的校正组合比率估计量,并推广到分层双重抽样中。同时给出新估计量的近似方差表达式。最后利用计算机随机模拟验证较正估计量对估计精度的改进。     

On the Principal Component Liu-type Estimator in Linear Regression

In this article, we present a principal component Liu-type estimator (LTE) by combining the principal component regression (PCR) and LTE to deal with the multicollinearity problem. The superiority of the new estimator over the PCR estimator, the ordinary least squares estimator (OLSE) and the LTE are studied under the mean squared error matrix. The selection of the tuning parameter in the proposed estimator is also discussed. Finally, a numerical example is given to explain our theoretical results.     

Minimum power-divergence estimator in three-way contingency tables

Cressie et al. (2000; 2003) introduced and studied a new family of statistics, based on the φ-divergence measure, for solving the problem of testing a nested sequence of loglinear models. In that family of test statistics the parameters are estimated using the minimum φ-divergence estimator which is a generalization of the maximum likelihood estimator. In this paper we study the minimum power-divergence estimator (the most important family of minimum φ-divergence estimator) for a nested sequence of loglinear models in three-way contingency tables under assumptions of multinomial sampling. A simulation study illustrates that the minimum chi-squared estimator is simultaneously the most robust and efficient estimator among the family of the minimum power-divergence estimator.     

A Bezier curve method in interval-censored data

In this paper we propose a Bezier curve method to estimate the survival function and the median survival time in interval-censored data. We compare the proposed estimator with other existing methods such as the parametric method, the single point imputation method, and the nonparametric maximum likelihood estimator through extensive numerical studies, and it is shown that the proposed estimator performs better than others in the sense of mean squared error and mean integrated squared error. An illustrative example based on a real data set is given.     

A Semiparametric Model for Line Transect Sampling

This paper introduces an appealing semiparametric model for estimating wildlife abundance based on line transect data. The proposed method requires the existence of a parametric model and then improves the estimator using a kernel method. Properties of the resultant estimator are derived and an expression for the asymptotic mean square error (AMSE) of the estimator is given. Minimization of the AMSE leads to an explicit formula for an optimal choice of the smoothing parameter. Small-sample properties of the proposed estimator using the parametric half-normal model are investigated and compared with the classical kernel estimator using both simulations and real data. Numerical results show that improvements over the classical kernel estimator often can be realized even when the true density is far from the half-normal model.