Pooling choices or categories in multinomial logit models

The estimation of multinomial logit models today is routine. With this increased use has also come a need for testing. A test to determine whether choices can be combined is important. This paper presents a likelihood ratio test for combining choices in multinomial logit models. The use of the test is demonstrated with a simple example.     

Model-Robust Design of Conjoint Choice Experiments

Within the context of choice experimental designs, most authors have proposed designs for the multinomial logit model under the assumption that only the main effects matter. Very little attention has been paid to designs for attribute interaction models. In this article, three types of Bayesian D-optimal designs for the multinomial logit model are studied: main-effects designs, interaction-effects designs, and composite designs. Simulation studies are used to show that in situations where a researcher is not sure whether or not attribute interaction effects are present, it is best to take into account interactions in the design stage. In particular, it is shown that a composite design constructed by including an interaction-effects model and a main-effects model in the design criterion is most robust against misspecification of the underlying model when it comes to making precise predictions.     

Small area estimates of labour force participation under a multinomial logit mixed model

Summary.  A new methodology is developed for estimating unemployment or employment characteristics in small areas, based on the assumption that the sample totals of unemployed and employed individuals follow a multinomial logit model with random area effects. The method is illustrated with UK labour force data aggregated by sex–age groups. For these data, the accuracy of direct estimates is poor in comparison with estimates that are derived from the multinomial logit model. Furthermore, two different estimators of the mean-squared errors are given: an analytical approximation obtained by Taylor linearization and an estimator based on bootstrapping. A simulation study for comparison of the two estimators shows the good performance of the bootstrap estimator.     

The negative multinomial logit model

A polychotomous logit model is defined for negative multinomial frequency counts within independent populations. An efficient estimator of the model parameters and estimator covariance matrix is given in closed form. Minimum chi-square and Wald tests are presented.     

A self-consistency approach to multinomial logit model with random effects

The computation in the multinomial logit mixed effects model is costly especially when the response variable has a large number of categories, since it involves high-dimensional integration and maximization. Tsodikov and Chefo (2008) developed a stable MLE approach to problems with independent observations, based on generalized self-consistency and quasi-EM algorithm developed in Tsodikov (2003). In this paper, we apply the idea to clustered multinomial response to simplify the maximization step. The method transforms the complex multinomial likelihood to Poisson-type likelihood and hence allows for the estimates to be obtained iteratively solving a set of independent low-dimensional problems. The methodology is applied to real data and studied by simulations. While maximization is simplified, numerical integration remains the dominant challenge to computational efficiency.     

Kernel-based semiparametric multinomial logit modelling of political party preferences

Conventional, parametric multinomial logit models are in general not sufficient for capturing the complex structures of electorates. In this paper, we use a semiparametric multinomial logit model to give an analysis of party preferences along individuals’ characteristics using a sample of the German electorate in 2006. Germany is a particularly strong case for more flexible nonparametric approaches in this context, since due to the reunification and the preceding different political histories the composition of the electorate is very complex and nuanced. Our analysis reveals strong interactions of the covariates age and income, and highly nonlinear shapes of the factor impacts for each party’s likelihood to be supported. Notably, we develop and provide a smoothed likelihood estimator for semiparametric multinomial logit models, which can be applied also in other application fields, such as, e.g., marketing.     

A Proportional Random Utility Approach to Qualitative Response Models

A new functional form of the response probability for a qualitative response model is proposed. The new model is flexible enough to avoid the constraint of independence from irrelevant alternatives, which is perceived as a weakness of the multinomial logit model in some applications. It is computationally simpler than the multinomial probit model and is promising for analyzing problems with a moderate number of alternatives.     

Semiparametric multinomial logit models for analysing consumer choice behaviour

The multinomial logit model (MNL) is one of the most frequently used statistical models in marketing applications. It allows one to relate an unordered categorical response variable, for example representing the choice of a brand, to a vector of covariates such as the price of the brand or variables characterising the consumer. In its classical form, all covariates enter in strictly parametric, linear form into the utility function of the MNL model. In this paper, we introduce semiparametric extensions, where smooth effects of continuous covariates are modelled by penalised splines. A mixed model representation of these penalised splines is employed to obtain estimates of the corresponding smoothing parameters, leading to a fully automated estimation procedure. To validate semiparametric models against parametric models, we utilise different scoring rules as well as predicted market share and compare parametric and semiparametric approaches for a number of brand choice data sets.     

A comparison of artificial neural network and multinomial logit models in predicting mergers

A merger proposal discloses a bidder firm's desire to purchase the control rights in a target firm. Predicting who will propose (bidder candidacy) and who will receive (target candidacy) merger bids is important to investigate why firms merge and to measure the price impact of mergers. This study investigates the performance of artificial neural networks and multinomial logit models in predicting bidder and target candidacy. We use a comprehensive data set that covers the years 1979–2004 and includes all deals with publicly listed bidders and targets. We find that both models perform similarly while predicting target and non-merger firms. The multinomial logit model performs slightly better in predicting bidder firms.     

Flexible Covariance Structures for Categorical Dependent Variables Through Finite Mixtures of Generalized Extreme Value Models

A new class of finite mixture discrete choice models, denoted FinMix (fīn m?ks), is introduced. These arise from the combination of a finite number of core Generalized Extreme Value (GEV) models to achieve more flexible functional forms, particularly in terms of error covariance structures. Example members of the class include combinations of (1) Multinomial Logit (MNL) models with differing scales, (2) multinomial logit with nested MNL models, (3) tree extreme value models with differing preference trees, and so on. Compatibility of FinMix models with utility maximization is easily determined, which permits empirical investigation of the suitability of specific model forms for economic evaluation exercises.     

Data augmentation,frequentist estimation,and the Bayesian analysis of multinomial logit models

This article describes a convenient method of selecting Metropolis– Hastings proposal distributions for multinomial logit models. There are two key ideas involved. The first is that multinomial logit models have a latent variable representation similar to that exploited by Albert and Chib (J Am Stat Assoc 88:669–679, 1993) for probit regression. Augmenting the latent variables replaces the multinomial logit likelihood function with the complete data likelihood for a linear model with extreme value errors. While no conjugate prior is available for this model, a least squares estimate of the parameters is easily obtained. The asymptotic sampling distribution of the least squares estimate is Gaussian with known variance. The second key idea in this paper is to generate a Metropolis–Hastings proposal distribution by conditioning on the estimator instead of the full data set. The resulting sampler has many of the benefits of so-called tailored or approximation Metropolis–Hastings samplers. However, because the proposal distributions are available in closed form they can be implemented without numerical methods for exploring the posterior distribution. The algorithm converges geometrically ergodically, its computational burden is minor, and it requires minimal user input. Improvements to the sampler’s mixing rate are investigated. The algorithm is also applied to partial credit models describing ordinal item response data from the 1998 National Assessment of Educational Progress. Its application to hierarchical models and Poisson regression are briefly discussed.     

The multinomial logistic regression model for predicting the discharge status after liver transplantation: estimation and diagnostics analysis

The multinomial logistic regression model (MLRM) can be interpreted as a natural extension of the binomial model with logit link function to situations where the response variable can have three or more possible outcomes. In addition, when the categories of the response variable are nominal, the MLRM can be expressed in terms of two or more logistic models and analyzed in both frequentist and Bayesian approaches. However, few discussions about post modeling in categorical data models are found in the literature, and they mainly use Bayesian inference. The objective of this work is to present classic and Bayesian diagnostic measures for categorical data models. These measures are applied to a dataset (status) of patients undergoing kidney transplantation.     

Inference on Polychotomous Responses in Finite Populations

Abstract. A model‐based predictive estimator is proposed for the population proportions of a polychotomous response variable, based on a sample from the population and on auxiliary variables, whose values are known for the entire population. The responses for the non‐sample units are predicted using a multinomial logit model, which is a parametric function of the auxiliary variables. A bootstrap estimator is proposed for the variance of the predictive estimator, its consistency is proved and its small sample performance is compared with that of an analytical estimator. The proposed predictive estimator is compared with other available estimators, including model‐assisted ones, both in a simulation study involving different sampling designs and model mis‐specification, and using real data from an opinion survey. The results indicate that the prediction approach appears to use auxiliary information more efficiently than the model‐assisted approach.     

Using compositional and Dirichlet models for market share regression

When the aim is to model market shares, the marketing literature proposes some regression models which can be qualified as attraction models. They are generally derived from an aggregated version of the multinomial logit model. But aggregated multinomial logit models (MNL) and the so-called generalized multiplicative competitive interaction models (GMCI) present some limitations: in their simpler version they do not specify brand-specific and cross effect parameters. In this paper, we consider alternative models: the Dirichlet model (DIR) and the compositional model (CODA). DIR allows to introduce brand-specific parameters and CODA allows additionally to consider cross effect parameters. We show that these two models can be written in a similar fashion, called attraction form, as the MNL and the GMCI models. As market share models are usually interpreted in terms of elasticities, we also use this notion to interpret the DIR and CODA models. We compare the properties of the models in order to explain why CODA and DIR models can outperform traditional market share models. An application to the automobile market is presented where we model brands market shares as a function of media investments, controlling for the brands price and scrapping incentive. We compare the quality of the models using measures adapted to shares.     

Small sample properties of the logit maximum likelihood estimator:a simulation study

This paper explores the effect of sample size, scale of parameters and size of the choice set on the maximum likelihood estimator of the parameters of the multinomial logit model. Data were generated by simulations under a three-way factorial experimental design for logit models containing three, four and five explanatory variables. Simulation data were analyzed by analysis of covariance and a regression model of the performance measure, the log root mean-squared error (LRMSE), fitted against the three factors and their interactions. Several important conclusions emerged. First, the LRMSE improves, but at a decreasing rate, with increases in the model's degrees of freedom. Second, the number of choice alternatives in the decision makers' choice sets has a significant impact on the LRMSE; however, heterogeneity in the choice sets across the sample has little or no impact. Finally, the scale of parameters and all of its two-way interactions with the other two factors significantly affect the LRMSE. Using the regression results, a family of iso-LRMSE curves are derived in the space of model degrees of freedom and scale of parameters. Their implications for researchers in choosing sample size and scale of parameters is discussed.     

An L1-type estimator of multivariate location and shape

The main goal of the paper is to specify a suitable multivariate multilevel model for polytomous responses with a non-ignorable missing data mechanism in order to determine the factors which influence the way of acquisition of the skills of the graduates and to evaluate the degree programmes on the basis of the adequacy of the skills they give to their graduates. The application is based on data gathered by a telephone survey conducted, about two years after the degree, on the graduates of year 2000 of the University of Florence. A multilevel multinomial logit model for the response of interest is fitted simultaneously with a multilevel logit model for the selection mechanism by means of maximum likelihood with adaptive Gaussian quadrature. In the application the multilevel structure has a crucial role, while selection bias results negligible. The analysis of the empirical Bayes residuals allows to detect some extreme degree programmes to be further inspected.     

Response shrinkage estimation in multinomial logit models

A shrinkage estimation method for multinomial logit models is developed. The proposed method is based on shrinking the responses for each category towards the underlying probabilities. The estimator is also used in combination with Pregibon's resistant fitting. The resulting estimator can also be used to control the over-estimation of Pregibon's resistant estimator. The proposed method handles not only the problem of separation in multinomial logit models but estimates also exist when the number of covariates is large relative to the sample size. Estimates exist even when the MLE does not exist. Estimates can be easily computed with all commonly used statistical packages supporting the fitting procedures with weights. Estimates are compared with the usual MLE and Firth's bias reduction technique in a simulation study and an application.     

Simple inference in multinomial and ordered logit

This paper provides some simple methods of interpreting the coefficients in multinomial logit and ordered logit models. These methods are summarized in Propositions concerning the magnitudes, signs, and patterns of partial derivatives of the outcome probabilities with respect to the exogenousvariables. The paper also provides an empirical example illustrating the use of these Propositions.     

Simple inference in multinomial and ordered logit

This paper provides some simple methods of interpreting the coefficients in multinomial logit and ordered logit models. These methods are summarized in Propositions concerning the magnitudes, signs, and patterns of partial derivatives of the outcome probabilities with respect to the exogenousvariables. The paper also provides an empirical example illustrating the use of these Propositions.     

Book Reviews

Aggregate forecasts using McFadden's conditional logit model of discrete choice harbor the unrealistic implicit assumption of a random-utility distribution that is homogeneous across both alternatives and individuals. This article relaxes that assumption. A choice model is developed that describes the random-utility component as a probability-mixture model. Some numerical results illustrate that the derived model is not constrained by the independence-of-irrelevant-alternatives property. An experimental test of visual perceptions demonstrates the potential superiority of the model.