Bayesian estimation of incomplete data using conditionally specified priors

In this article, a class of conjugate prior for estimating incomplete count data based on a broad class of conjugate prior distributions is presented. The new class of prior distributions arises from a conditional perspective, making use of the conditional specification methodology and can be considered as the generalization of the form of prior distributions that have been used previously in the estimation of incomplete count data well. Finally, some examples of simulated and real data are given.     

Characterization of distributions by conditional expectation of generalized order statistics

In this work, general forms of many well-known continuous probability distributions are characterized by conditional expectation of some functions of generalized order statistics. These results are the generalization of the characterization results based on conditional expectation of the functions of order statistics given by Khan and Abu-Salih (1989).     

Bayesian inference in a heteroscedastic replicated measurement error model using heavy-tailed distributions

We introduce a multivariate heteroscedastic measurement error model for replications under scale mixtures of normal distribution. The model can provide a robust analysis and can be viewed as a generalization of multiple linear regression from both model structure and distribution assumption. An efficient method based on Markov Chain Monte Carlo is developed for parameter estimation. The deviance information criterion and the conditional predictive ordinates are used as model selection criteria. Simulation studies show robust inference behaviours of the model against both misspecification of distributions and outliers. We work out an illustrative example with a real data set on measurements of plant root decomposition.     

Canonical expansions,correlation structure,and conditional distributions of bivariate distributions generated by mixtures

A simple result concerning the canonical expansions of mixed bivariate distributions is considered. This result is then applied to analyze the correlation structures of the Bates-Neyman accident proneness model and its generalization, to derive probability inequalities based on the concept of positive dependence, and to construct a bivariate beta distribution with positive correlation coefficient applicable in computer simulation experiments. The mixture formulation of the conditional distribution of this class of mixed bivariate distributions is used to define and generate first-order autoregressive gamma and negative binomial sequences.     

Multivariate lagrange distributions and a subfamiliy

Second order moments about its means, i.e. the variances and covari-ances for multivariate Lagrange distributions are derived in a matrix form. A subfamily of multivariate Lagrange distributions which can be characterized as the distributions of customers served in a busy period in queues with some conditions are considered. Theorems about their probability functions, one of which is a multivariate generalization of a formula by Takà cs(1989). are given and the means and second order moments about its means are considered. As an example, a multivariate Borel-Tanner distribution is derived.     

Inferactive data analysis

We describe inferactive data analysis, so-named to denote an interactive approach to data analysis with an emphasis on inference after data analysis. Our approach is a compromise between Tukey's exploratory and confirmatory data analysis allowing also for Bayesian data analysis. We see this as a useful step in concrete providing tools (with statistical guarantees) for current data scientists. The basis of inference we use is (a conditional approach to) selective inference, in particular its randomized form. The relevant reference distributions are constructed from what we call a DAG-DAG—a Data Analysis Generative DAG, and a selective change of variables formula is crucial to any practical implementation of inferactive data analysis via sampling these distributions. We discuss a canonical example of an incomplete cross-validation test statistic to discriminate between black box models, and a real HIV dataset example to illustrate inference after making multiple queries on data.     

Bootstrapping the conditional copula

This paper is concerned with inference about the dependence or association between two random variables conditionally upon the given value of a covariate. A way to describe such a conditional dependence is via a conditional copula function. Nonparametric estimators for a conditional copula then lead to nonparametric estimates of conditional association measures such as a conditional Kendall's tau. The limiting distributions of nonparametric conditional copula estimators are rather involved. In this paper we propose a bootstrap procedure for approximating these distributions and their characteristics, and establish its consistency. We apply the proposed bootstrap procedure for constructing confidence intervals for conditional association measures, such as a conditional Blomqvist beta and a conditional Kendall's tau. The performances of the proposed methods are investigated via a simulation study involving a variety of models, ranging from models in which the dependence (weak or strong) on the covariate is only through the copula and not through the marginals, to models in which this dependence appears in both the copula and the marginal distributions. As a conclusion we provide practical recommendations for constructing bootstrap-based confidence intervals for the discussed conditional association measures.     

On generalized semi-Pareto and semi-Burr distributions and random coefficient minification processes

A characterization of Pareto type III distribution is obtained. As a generalization of the Pareto distribution, a new class of distributions called the generalized Pareto distributions is introduced and a characterization of this class is obtained. We introduce a new class of autoregressive models with semi-Pareto marginals and study its properties. As a generalization of semi-Pareto distribution, we introduce semi-Burr distribution and develop a random coefficient autoregressive model with semi-Burr marginal distributions.     

Some aspects of statistical inference on the lagrange (generalized) poisson distribution

A generalization of the Poisson distribution was defined by Consul and Jain (Ann. Math. Statist., 41, (1970)) and was obtained as a particular family of Lagrange distributions by Consul and Shenton (SIAM. J. Appl. Math., 23, (1972)). The distribution is subsequently named the generalized Poisson distribution (GPD). This GPD reduces to the Poisson distribution for ? = 0. When the data have a one-way layout structure, the asymptotically locally optimal Neyman's C(d) test is constructed and compared with the conditional test on the hypothesis H_o? = 0. Within the framework of the generalized linear models an appropriate link function is given, and the asymptotic distributions of the estimated parameters are derived.     

A note on a universal random variate generator for integer-valued random variables

A universal generator for integer-valued square-integrable random variables is introduced. The generator relies on a rejection technique based on a generalization of the inversion formula for integer-valued random variables. This approach allows to create a dominating probability function, whose evaluation solely involves two integrals depending on the characteristic function of the random variable to be generated. The proposal gives rise to a simple algorithm which may be implemented in a few code lines and which may show good performance when the classical families of distributions—such as the Poisson and the Binomial—are considered. In addition, applications to the Poisson-Tweedie and the Luria-Delbrück distributions are provided.     

A Unified Method for Checking Compatibility and Uniqueness for Finite Discrete Conditional Distributions

Checking compatibility for two given conditional distributions and identifying the corresponding unique compatible marginal distributions are important problems in mathematical statistics, especially in Bayesian inferences. In this article, we develop a unified method to check the compatibility and uniqueness for two finite discrete conditional distributions. By formulating the compatibility problem into a system of linear equations subject to constraints, it can be reduced to a quadratic optimization problem with box constraints. We also extend the proposed method from two-dimensional cases to higher-dimensional cases. Finally, we show that our method can be easily applied to checking compatibility and uniqueness for a regression function and a conditional distribution. Several numerical examples are used to illustrate the proposed method. Some comparisons with existing methods are also presented.     

Estimation and inference of the joint conditional distribution for multivariate longitudinal data using nonparametric copulas

In this paper we study estimating the joint conditional distributions of multivariate longitudinal outcomes using regression models and copulas. For the estimation of marginal models, we consider a class of time-varying transformation models and combine the two marginal models using nonparametric empirical copulas. Our models and estimation method can be applied in many situations where the conditional mean-based models are not good enough. Empirical copulas combined with time-varying transformation models may allow quite flexible modelling for the joint conditional distributions for multivariate longitudinal data. We derive the asymptotic properties for the copula-based estimators of the joint conditional distribution functions. For illustration we apply our estimation method to an epidemiological study of childhood growth and blood pressure.     

Joint response graphs and separation induced by triangular systems

Summary.  We consider joint probability distributions generated recursively in terms of univariate conditional distributions satisfying conditional independence restrictions. The independences are captured by missing edges in a directed graph. A matrix form of such a graph, called the generating edge matrix, is triangular so the distributions that are generated over such graphs are called triangular systems. We study consequences of triangular systems after grouping or reordering of the variables for analyses as chain graph models, i.e. for alternative recursive factorizations of the given density using joint conditional distributions. For this we introduce families of linear triangular equations which do not require assumptions of distributional form. The strength of the associations that are implied by such linear families for chain graph models is derived. The edge matrices of chain graphs that are implied by any triangular system are obtained by appropriately transforming the generating edge matrix. It is shown how induced independences and dependences can be studied by graphs, by edge matrix calculations and via the properties of densities. Some ways of using the results are illustrated.     

On the estimation of a binary response model in a selected population

A generalization of the Probit model is presented, with the extended skew-normal cumulative distribution as a link function, which can be used for modelling a binary response variable in the presence of selectivity bias. The estimate of the parameters via ML is addressed, and inference on the parameters expressing the degree of selection is discussed. The assumption underlying the model is that the selection mechanism influences the unmeasured factors and does not affect the explanatory variables. When this assumption is violated, but other conditional independencies hold, then the model proposed here is derived. In particular, the instrumental variable formula still applies and the model results at the second stage of the estimating procedure.     

Distributions with Generalized Skewed Conditionals and Mixtures of Such Distributions

Mixtures of skewed distributions (univariate and bivariate) provide flexible models. An alternative modeling approach involves distributions with skewed conditional distributions and mixtures of such distributions. We consider the interrelationships between such models. Examples are provided to show that several skewed distributions already considered in the literature can be viewed as having been constructed via a combination of mixing and skewing.     

Test of Association Between Two Ordinal Variables While Adjusting for Covariates

We propose a new set of test statistics to examine the association between two ordinal categorical variables X and Y after adjusting for continuous and/or categorical covariates Z. Our approach first fits multinomial (e.g., proportional odds) models of X and Y, separately, on Z. For each subject, we then compute the conditional distributions of X and Y given Z. If there is no relationship between X and Y after adjusting for Z, then these conditional distributions will be independent, and the observed value of (X, Y) for a subject is expected to follow the product distribution of these conditional distributions. We consider two simple ways of testing the null of conditional independence, both of which treat X and Y equally, in the sense that they do not require specifying an outcome and a predictor variable. The first approach adds these product distributions across all subjects to obtain the expected distribution of (X, Y) under the null and then contrasts it with the observed unconditional distribution of (X, Y). Our second approach computes "residuals" from the two multinomial models and then tests for correlation between these residuals; we define a new individual-level residual for models with ordinal outcomes. We present methods for computing p-values using either the empirical or asymptotic distributions of our test statistics. Through simulations, we demonstrate that our test statistics perform well in terms of power and Type I error rate when compared to proportional odds models which treat X as either a continuous or categorical predictor. We apply our methods to data from a study of visual impairment in children and to a study of cervical abnormalities in human immunodeficiency virus (HIV)-infected women. Supplemental materials for the article are available online.     

Quantile smoothing in financial time series

Various parametric models have been designed to analyze volatility in time series of financial market data. For maximum likelihood estimation these parametric methods require the assumption of a known conditional distribution. In this paper we examine the conditional distribution of daily DAX returns with the help of nonparametric methods. We use kernel estimators for conditional quantiles resulting from a kernel estimation of conditional distributions. This work was financially supported by the Deutsche Forschungsgemeinschaft     

Nonlinear semiparametric autoregressive model with finite mixtures of scale mixtures of skew normal innovations

We propose data generating structures which can be represented as the nonlinear autoregressive models with single and finite mixtures of scale mixtures of skew normal innovations. This class of models covers symmetric/asymmetric and light/heavy-tailed distributions, so provide a useful generalization of the symmetrical nonlinear autoregressive models. As semiparametric and nonparametric curve estimation are the approaches for exploring the structure of a nonlinear time series data set, in this article the semiparametric estimator for estimating the nonlinear function of the model is investigated based on the conditional least square method and nonparametric kernel approach. Also, an Expectation–Maximization-type algorithm to perform the maximum likelihood (ML) inference of unknown parameters of the model is proposed. Furthermore, some strong and weak consistency of the semiparametric estimator in this class of models are presented. Finally, to illustrate the usefulness of the proposed model, some simulation studies and an application to real data set are considered.     

Pair‐copula constructions for non‐Gaussian DAG models

We propose a new type of multivariate statistical model that permits non‐Gaussian distributions as well as the inclusion of conditional independence assumptions specified by a directed acyclic graph. These models feature a specific factorisation of the likelihood that is based on pair‐copula constructions and hence involves only univariate distributions and bivariate copulas, of which some may be conditional. We demonstrate maximum‐likelihood estimation of the parameters of such models and compare them to various competing models from the literature. A simulation study investigates the effects of model misspecification and highlights the need for non‐Gaussian conditional independence models. The proposed methods are finally applied to modeling financial return data. The Canadian Journal of Statistics 40: 86–109; 2012 © 2012 Statistical Society of Canada     

Inference and rare event simulation for stopped Markov processes via reverse-time sequential Monte Carlo

We present a sequential Monte Carlo algorithm for Markov chain trajectories with proposals constructed in reverse time, which is advantageous when paths are conditioned to end in a rare set. The reverse time proposal distribution is constructed by approximating the ratio of Green’s functions in Nagasawa’s formula. Conditioning arguments can be used to interpret these ratios as low-dimensional conditional sampling distributions of some coordinates of the process given the others. Hence, the difficulty in designing SMC proposals in high dimension is greatly reduced. Empirically, our method outperforms an adaptive multilevel splitting algorithm in three examples: estimating an overflow probability in a queueing model, the probability that a diffusion follows a narrowing corridor, and the initial location of an infection in an epidemic model on a network.