Exact and stochastic nonlinear constrained estimation in the conditional poisson log-linear model

A minimum chi-square estimator of the conditional Poisson log-linear model parameters subject to exact and stochastic nonlinear constraints is defined. The Wald test is used to evaluate the exact and stochastic constraints.     

A BIVARIATE BINOMIAL DISTRIBUTION AND SOME APPLICATIONS1

This study is concerned with the joint distribution of the total numbers of occurrences of binary characters A and B, given three independent samples in which both characters, A but not B, and B but not A, are observed. The distribution function is given; its conditional distributions and regression functions are found; bounds on certain joint probabilities are established; and conditions for bivariate Poisson and Gaussian limits are studied. An application yields the joint distribution of sign statistics for the pair-wise comparison of treatments with a control.     

Generalised quasi‐symmetry models for ordinal contingency tables

This paper extends the ordinary quasi‐symmetry (QS) model for square contingency tables with commensurable classification variables. The proposed generalised QS model is defined in terms of odds ratios that apply to ordinal variables. In particular, we present QS models based on global, cumulative and continuation odds ratios and discuss their properties. Finally, the conditional generalised QS model is introduced for local and global odds ratios. These models are illustrated through the analysis of two data sets.     

Modelling two way contingency tables with recursive logits and odds ratios

In this work a new type of logits and odds ratios, which includes as special cases the continuation and the reverse-continuation logits and odds ratios, are defined. We prove that these logits and odds ratios define a parameterization of the joint probabilities of a two way contingency table. The problem of testing equality and inequality constraints on these logits and odds ratios is examined with particular regard to two new hypotheses of monotone dependence. Work partially supported by a MIUR2004 grant. Preliminary findings have been presented at SIS (Società Italiana di Statistica) Annual Meeting, Torino, 2006.     

Bayesian Model Choice in Exponential Survival Models

ABSTRACT

Log-linear models for the distribution on a contingency table are represented as the intersection of only two kinds of log-linear models. One assuming that a certain group of the variables, if conditioned on all other variables, has a jointly independent distribution and another one assuming that a certain group of the variables, if conditioned on all other variables, has no highest order interaction. The subsets entering into these models are uniquely determined by the original log-linear model. This canonical representation suggests considering joint conditional independence and conditional no highest order association as the elementary building blocks of log-linear models.     

A class of log-linear models with constrained marginal distributions

Summary In the log-linear model for bivariate probability functions the conditional and joint probabilities have a simple form. This property make the log-linear parametrization useful when modeling these probabilities is the focus of the investigation. On the contrary, in the log-linear representation of bivariate probability functions, the marginal probabilities have a complex form. So the log-linear models are not useful when the marginal probabilities are of particular interest. In this paper the previous statements are discussed and a model obtained from the log-linear one by imposing suitable constraints on the marginal probabilities is introduced. This work was supported by a M.U.R.S.T. grant.     

Admissible Linear Predictors in the Superpopulation Model with Respect to Inequality Constraints

Admissibility of linear predictors of the linear quantity Qy is investigated under a general linear regression superpopulation model with some inequality constraints. The relation between admissible homogeneous and inhomogeneous linear predictors is characterized. Further, necessary and sufficient conditions for a linear predictor to be admissible in two cases of inequality constraints in the classes of homogeneous and inhomogeneous linear predictors are given, respectively.     

Multiple Imputation of Missing or Faulty Values Under Linear Constraints

Many statistical agencies, survey organizations, and research centers collect data that suffer from item nonresponse and erroneous or inconsistent values. These data may be required to satisfy linear constraints, for example, bounds on individual variables and inequalities for ratios or sums of variables. Often these constraints are designed to identify faulty values, which then are blanked and imputed. The data also may exhibit complex distributional features, including nonlinear relationships and highly nonnormal distributions. We present a fully Bayesian, joint model for modeling or imputing data with missing/blanked values under linear constraints that (i) automatically incorporates the constraints in inferences and imputations, and (ii) uses a flexible Dirichlet process mixture of multivariate normal distributions to reflect complex distributional features. Our strategy for estimation is to augment the observed data with draws from a hypothetical population in which the constraints are not present, thereby taking advantage of computationally expedient methods for fitting mixture models. Missing/blanked items are sampled from their posterior distribution using the Hit-and-Run sampler, which guarantees that all imputations satisfy the constraints. We illustrate the approach using manufacturing data from Colombia, examining the potential to preserve joint distributions and a regression from the plant productivity literature. Supplementary materials for this article are available online.     

Change-Point Detection in Two-Phase Regression with Inequality Constraints on the Regression Parameters

Two-phase regression models with inequality constraints on the regression coefficients and with a small number of measurements is considered. A new test based on the likelihood ratio in linear model with inequality constraints for the presence of a change-point is proposed. Numerical approximations to the powers against various alternatives are given and compared with the powers of the likelihood ratio test in the two-phase regression models without inequality constraints, the backwards CUSUM test, and the k-linear-r-ahead recursive residuals tests. Performance of related likelihood based estimators of the change-point is briefly studied in a Monte Carlo experiment.     

Nonparametric likelihood and doubly robust estimating equations for marginal and nested structural models

This article considers Robins's marginal and nested structural models in the cross‐sectional setting and develops likelihood and regression estimators. First, a nonparametric likelihood method is proposed by retaining a finite subset of all inherent and modelling constraints on the joint distributions of potential outcomes and covariates under a correctly specified propensity score model. A profile likelihood is derived by maximizing the nonparametric likelihood over these joint distributions subject to the retained constraints. The maximum likelihood estimator is intrinsically efficient based on the retained constraints and weakly locally efficient. Second, two regression estimators, named hat and tilde, are derived as first‐order approximations to the likelihood estimator under the propensity score model. The tilde regression estimator is intrinsically and weakly locally efficient and doubly robust. The methods are illustrated by data analysis for an observational study on right heart catheterization. The Canadian Journal of Statistics 38: 609–632; 2010 © 2010 Statistical Society of Canada     

Bayesian multiple comparison of models for binary data with inequality constraints

In this paper we consider generalized linear models for binary data subject to inequality constraints on the regression coefficients, and propose a simple and efficient Bayesian method for parameter estimation and model selection by using Markov chain Monte Carlo (MCMC). In implementing MCMC, we introduce appropriate latent variables and use a simple approximation of a link function, to resolve computational difficulties and obtain convenient forms for full conditional posterior densities of elements of parameters. Bayes factors are computed via the Savage-Dickey density ratios and the method of Oh (Comput. Stat. Data Anal. 29:411–427, 1999), for which posterior samples from the full model with no degenerate parameter and the full conditional posterior densities of elements are needed. Since it uses one set of posterior samples from the full model for any model in consideration, it performs simultaneous comparison of all possible models and is very efficient compared with other model selection methods which require one to fit all candidate models. A simulation study shows that significant improvements can be made by taking the constraints into account. Real data on purchase intention of a product subject to order constraints is analyzed by using the proposed method. The analysis results show that there exist some price changes which significantly affect the consumer behavior. The results also show the importance of simultaneous comparison of models rather than separate pairwise comparisons of models since the latter may yield misleading results from ignoring possible correlations between parameters.     

Admissibility of Linear Predictors in the Superpopulation Model with Respect to Inequality Constraints under Matrix Loss Function

Admissibility of linear predictors for the linear quantity Qy is investigated in a superpopulation model with respect to some inequality constraints. Necessary and sufficient conditions for a linear predictor to be admissible in the class of homogeneous linear predictors and the class of inhomogeneous linear predictors are obtained, respectively, under matrix loss function.     

The Joint Distribution of the Sum and the Maximum of IID Exponential Random Variables

The authors establish the joint distribution of the sum X and the maximum Y of IID exponential random variables. They derive exact formuli describing the random vector (X, Y), including its joint PDF, CDF, and other characteristics; marginal and conditional distributions; moments and related parameters; and stochastic representations leading to further properties of infinite divisibility and self-decomposability. The authors also discuss parameter estimation and include an example from climatology that illustrates the modeling potential of this new bivariate model.     

Likelihood-based approaches for multivariate linear models under inequality constraints for incomplete data

In this paper, we consider a multivariate linear model with complete/incomplete data, where the regression coefficients are subject to a set of linear inequality restrictions. We first develop an expectation/conditional maximization (ECM) algorithm for calculating restricted maximum likelihood estimates of parameters of interest. We then establish the corresponding convergence properties for the proposed ECM algorithm. Applications to growth curve models and linear mixed models are presented. Confidence interval construction via the double-bootstrap method is provided. Some simulation studies are performed and a real example is used to illustrate the proposed methods.     

Inequality Constrained State-Space Models

ABSTRACT

The standard Kalman filter cannot handle inequality constraints imposed on the state variables, as state truncation induces a nonlinear and non-Gaussian model. We propose a Rao-Blackwellized particle filter with the optimal importance function for forward filtering and the likelihood function evaluation. The particle filter effectively enforces the state constraints when the Kalman filter violates them. Monte Carlo experiments demonstrate excellent performance of the proposed particle filter with Rao-Blackwellization, in which the Gaussian linear sub-structure is exploited at both the cross-sectional and temporal levels.     

Implied distributions in multiple change point problems

A method for efficiently calculating exact marginal, conditional and joint distributions for change points defined by general finite state Hidden Markov Models is proposed. The distributions are not subject to any approximation or sampling error once parameters of the model have been estimated. It is shown that, in contrast to sampling methods, very little computation is needed. The method provides probabilities associated with change points within an interval, as well as at specific points.     

Testing linear inequality constraints in the standard linear model

In this paper we are concerned with the problem of testing whether the â-parameters of the standard linear model satisfy the linear equality constraints R = r when they are known to satisfy the corresponding linear inequality constraints Râ ? r. In particular we will show that the exact finite sample null distributions of the Likelihood Ratio, Wald and Kuhn-Tucker

statistics are known when R is of full row rank but not known when R has less than full row rank. The less than full row rank problem has not been discussed previously but it is of considerable potential importance.

This paper contains several simple numerical examples which illustrate the computational details of the tests     

Simulation of Constrained Variables in Engineering Risk Analyses

The problem of sampling random variables with overlapping pdfs subject to inequality constraints is addressed. Often, the values of physical variables in an engineering model are interrelated. This mutual dependence imposes inequality constraints on the random variables representing these parameters. Ignoring the interdependencies and sampling the variables independently can lead to inconsistency/bias. We propose an algorithm to generate samples of constrained random variables that are characterized by typical continuous probability distributions and are subject to different kinds of inequality constraints. The sampling procedure is illustrated for various representative cases and one realistic application to simulation of structural natural frequencies.     

A Unified Method for Checking Compatibility and Uniqueness for Finite Discrete Conditional Distributions

Checking compatibility for two given conditional distributions and identifying the corresponding unique compatible marginal distributions are important problems in mathematical statistics, especially in Bayesian inferences. In this article, we develop a unified method to check the compatibility and uniqueness for two finite discrete conditional distributions. By formulating the compatibility problem into a system of linear equations subject to constraints, it can be reduced to a quadratic optimization problem with box constraints. We also extend the proposed method from two-dimensional cases to higher-dimensional cases. Finally, we show that our method can be easily applied to checking compatibility and uniqueness for a regression function and a conditional distribution. Several numerical examples are used to illustrate the proposed method. Some comparisons with existing methods are also presented.     

Exploratory model analysis using cdf knotting with applications to distinguishability,limiting forms,and moment ratios to the three parameter weibull family

An exploratory model analysis device we call CDF knotting is introduced. It is a technique we have found useful for exploring relationships between points in the parameter space of a model and global properties of associated distribution functions. It can be used to alert the model builder to a condition we call lack of distinguishability which is to nonlinear models what multicollinearity is to linear models. While there are simple remedial actions to deal with multicollinearity in linear models, techniques such as deleting redundant variables in those models do not have obvious parallels for nonlinear models. In some of these nonlinear situations, however, CDF knotting may lead to alternative models with fewer parameters whose distribution functions are very similar to those of the original overparameterized model. We also show how CDF knotting can be exploited as a mathematical tool for deriving limiting distributions and illustrate the technique for the 3-parameterWeibull family obtaining limiting forms and moment ratios which correct and extend previously published results. Finally, geometric insights obtained by CDF knotting are verified relative to data fitting and estimation.