Embedding latent class regression and latent class distal outcome models into cluster-weighted latent class analysis: a detailed simulation experiment

Usually in latent class (LC) analysis, external predictors are taken to be cluster conditional probability predictors (LC models with external predictors), and/or score conditional probability predictors (LC regression models). In such cases, their distribution is not of interest. Class-specific distribution is of interest in the distal outcome model, when the distribution of the external variables is assumed to depend on LC membership. In this paper, we consider a more general formulation, that embeds both the LC regression and the distal outcome models, as is typically done in cluster-weighted modelling. This allows us to investigate (1) whether the distribution of the external variables differs across classes, (2) whether there are significant direct effects of the external variables on the indicators, by modelling jointly the relationship between the external and the latent variables. We show the advantages of the proposed modelling approach through a set of artificial examples, an extensive simulation study and an empirical application about psychological contracts among employees and employers in Belgium and the Netherlands.     

Edgeworth expansions for the conditional distributions in logistic regression models

Edgeworth expansions are derived for conditional distributions of sufficient statistics as well as conditional maximum likelihood estimators of log odds ratios in logistic regression models assuming that the risk factors are not almost equally distanced. Expansions are given in several special cases. Similar results are obtained for models with polytomous outcomes.     

Estimation and inference of the joint conditional distribution for multivariate longitudinal data using nonparametric copulas

In this paper we study estimating the joint conditional distributions of multivariate longitudinal outcomes using regression models and copulas. For the estimation of marginal models, we consider a class of time-varying transformation models and combine the two marginal models using nonparametric empirical copulas. Our models and estimation method can be applied in many situations where the conditional mean-based models are not good enough. Empirical copulas combined with time-varying transformation models may allow quite flexible modelling for the joint conditional distributions for multivariate longitudinal data. We derive the asymptotic properties for the copula-based estimators of the joint conditional distribution functions. For illustration we apply our estimation method to an epidemiological study of childhood growth and blood pressure.     

On conditional risk estimation considering model risk

Usually, parametric procedures used for conditional variance modelling are associated with model risk. Model risk may affect the volatility and conditional value at risk estimation process either due to estimation or misspecification risks. Hence, non-parametric artificial intelligence models can be considered as alternative models given that they do not rely on an explicit form of the volatility. In this paper, we consider the least-squares support vector regression (LS-SVR), weighted LS-SVR and Fixed size LS-SVR models in order to handle the problem of conditional risk estimation taking into account issues of model risk. A simulation study and a real application show the performance of proposed volatility and VaR models.     

A NOTE ON MULTIVARIATE LOGISTIC MODELS FOR CONTINGENCY TABLES

The log-linear model is a tool widely accepted for modelling discrete data given in a contingency table. Although its parameters reflect the interaction structure in the joint distribution of all variables, it does not give information about structures appearing in the margins of the table. This is in contrast to multivariate logistic parameters, recently introduced by Glonek & McCullagh (1995), which have as parameters the highest order log odds ratios derived from the joint table and from each marginal table. Glonek & McCullagh give the link between the cell probabilities and the multivariate logistic parameters, in an algebraic fashion. The present paper focuses on this link, showing that it is derived by general parameter transformations in exponential families. In particular, the connection between the natural, the expectation and the mixed parameterization in exponential families (Barndorff-Nielsen, 1978) is used; this also yields the derivatives of the likelihood equation and shows properties of the Fisher matrix. The paper emphasises the analysis of independence hypotheses in margins of a contingency table.     

A class of log-linear models with constrained marginal distributions

Summary In the log-linear model for bivariate probability functions the conditional and joint probabilities have a simple form. This property make the log-linear parametrization useful when modeling these probabilities is the focus of the investigation. On the contrary, in the log-linear representation of bivariate probability functions, the marginal probabilities have a complex form. So the log-linear models are not useful when the marginal probabilities are of particular interest. In this paper the previous statements are discussed and a model obtained from the log-linear one by imposing suitable constraints on the marginal probabilities is introduced. This work was supported by a M.U.R.S.T. grant.     

A multivariate logit model with marginal canonical association

In this work, a generalization of the Goodman Association Model to the case of q, q > 2, categorical variables which is based on the idea of marginal modelling discussed by Gloneck–McCullagh is introduced; the difference between the proposed generalization and two models, previously introduced by Becker and Colombi, is discussed. The Becker generalization is not a marginal model because it does not imply Logit Models for the marginal probabilities, and because it is based on the conditional approach of modelling the association. The Colombi model is only partially a marginal model because it uses simple logit models for the univariate marginal probabilities but is based on the conditional approach of modelling the association. It is also shown that the maximum likelihood estimation of the parameters of the new model is feasible and, to compute the maximum likelihood estimates, an algorithm is proposed, which is a numerically convenient compromise between the constrained optimization approach of Lang and the straightforward use of the Fisher Scoring Algorithm suggested by Glonek–McCullagh.Finally, the proposed model is used to analyze a data set concerning work accidents which occurred to workers at some Italian firms during the years 1994–1996.     

A Bayesian analysis of clustered discrete and continuous outcomes

Many study designs yield a variety of outcomes from each subject clustered within an experimental unit. When these outcomes are of mixed data types, it is challenging to jointly model the effects of covariates on the responses using traditional methods. In this paper, we develop a Bayesian approach for a joint regression model of the different outcome variables and show that the fully conditional posterior distributions obtained under the model assumptions allow for estimation of posterior distributions using Gibbs sampling algorithm.     

Single-index modelling of conditional probabilities in two-way contingency tables

When analysing a contingency table, it is often worth relating the probabilities that a given individual falls into different cells from a set of predictors. These conditional probabilities are usually estimated using appropriate regression techniques. In particular, in this paper, a semiparametric model is developed. Essentially, it is only assumed that the effect of the vector of covariates on the probabilities can entirely be captured by a single index, which is a linear combination of the initial covariates. The estimation is then twofold: the coefficients of the linear combination and the functions linking this index to the related conditional probabilities have to be estimated. Inspired by the estimation procedures already proposed in the literature for single-index regression models, four estimators of the index coefficients are proposed and compared, from a theoretical point-of-view, but also practically, with the aid of simulations. Estimation of the link functions is also addressed.     

Arbitrage Pricing Theory as a Restricted Nonlinear Multivariate Regression Model Iterated Nonlinear Seemingly Unrelated Regression Estimates

By replacing the unknown random factors of factor analysis with observed macroeconomic variables, the arbitrage pricing theory (APT) is recast as a multivariate nonlinear regression model with across-equation restrictions. An explicit theoretical justification for the inclusion of an arbitrary, well-diversified market index is given. Using monthly returns on 70 stocks, iterated nonlinear seemingly unrelated regression techniques are employed to obtain joint estimates of asset sensitivities and their associated APT risk “prices.” Without the assumption of normally distributed errors, these estimators are strongly consistent and asymptotically normal. With the additional assumption of normal errors, they are also full-information maximum likelihood estimators. Classical asymptotic nonlinear nested hypothesis tests are supportive of the APT with measured macroeconomic factors.     

Variable selection in joint location and scale models of the skew-normal distribution

A regression model with skew-normal errors provides a useful extension for ordinary normal regression models when the data set under consideration involves asymmetric outcomes. Variable selection is an important issue in all regression analyses, and in this paper, we investigate the simultaneously variable selection in joint location and scale models of the skew-normal distribution. We propose a unified penalized likelihood method which can simultaneously select significant variables in the location and scale models. Furthermore, the proposed variable selection method can simultaneously perform parameter estimation and variable selection in the location and scale models. With appropriate selection of the tuning parameters, we establish the consistency and the oracle property of the regularized estimators. Simulation studies and a real example are used to illustrate the proposed methodologies.     

Multilevel models for longitudinal variables prognostic for survival

The issue of modelling the joint distribution of survival time and of prognostic variables measured periodically has recently become of interest in the AIDS literature but is of relevance in other applications. The focus of this paper is on clinical trials where follow-up measurements of potentially prognostic variables are often collected but not routinely used. These measurements can be used to study the biological evolution of the disease of interest; in particular the effect of an active treatment can be examined by comparing the time profiles of patients in the active and placebo group. It is proposed to use multilevel regression analysis to model the individual repeated observations as function of time and, possibly, treatment. To address the problem of informative drop-out—which may arise if deaths (or any other censoring events) are related to the unobserved values of the prognostic variables—we analyse sequentially overlapping portions of the follow-up information. An example arising from a randomized clinical trial for the treatment of primary biliary cirrhosis is examined in detail.     

Variable Selection in Joint Location and Scale Models of the Skew-t-Normal Distribution

Variable selection is an important issue in all regression analysis, and in this article, we investigate the simultaneous variable selection in joint location and scale models of the skew-t-normal distribution when the dataset under consideration involves heavy tail and asymmetric outcomes. We propose a unified penalized likelihood method which can simultaneously select significant variables in the location and scale models. Furthermore, the proposed variable selection method can simultaneously perform parameter estimation and variable selection in the location and scale models. With appropriate selection of the tuning parameters, we establish the consistency and the oracle property of the regularized estimators. These estimators are compared by simulation studies.     

Moment-based estimation of nonlinear regression models with boundary outcomes and endogeneity,with applications to nonnegative and fractional responses

In this article, we suggest simple moment-based estimators to deal with unobserved heterogeneity in a special class of nonlinear regression models that includes as main particular cases exponential models for nonnegative responses and logit and complementary loglog models for fractional responses. The proposed estimators: (i) treat observed and omitted covariates in a similar manner; (ii) can deal with boundary outcomes; (iii) accommodate endogenous explanatory variables without requiring knowledge on the reduced form model, although such information may be easily incorporated in the estimation process; (iv) do not require distributional assumptions on the unobservables, a conditional mean assumption being enough for consistent estimation of the structural parameters; and (v) under the additional assumption that the dependence between observables and unobservables is restricted to the conditional mean, produce consistent estimators of partial effects conditional only on observables.     

Integer-valued moving average (INMA) process

A simple model for a stationary sequence of dependent integer-valued random variables {X_n} is given. The sequence to be called integer-valued moving average (INMA) process, is taken as the “survivals” of i.i.d. non-negative integervalued random variables. It is argued that the model’s structure reflects to some extent the mechanism generating real life data for many counting process and consequently it is useful for modelling such processes. Various properties for the special case in which {X_n} is Poisson INMA (1) process, such as the joint distribution, regression, time reversibility, along with the conditional and partial correlations, are discussed in details. Extension of the INMA of first order to higher order moving average is considered.     

Extreme behaviour for bivariate elliptical distributions

The authors examine the asymptotic behaviour of conditional threshold exceedance probabilities for an elliptically distributed pair (X, Y) of random variables. More precisely, they investigate the limiting behaviour of the conditional distribution of Y given that X becomes extreme. They show that this behaviour differs between regularly and rapidly varying tails.     

Factor Stochastic Volatility in Mean Models: A GMM Approach

This paper provides a semiparametric framework for modeling multivariate conditional heteroskedasticity. We put forward latent stochastic volatility (SV) factors as capturing the commonality in the joint conditional variance matrix of asset returns. This approach is in line with common features as studied by Engle and Kozicki (1993), and it allows us to focus on identication of factors and factor loadings through first- and second-order conditional moments only. We assume that the time-varying part of risk premiums is based on constant prices of factor risks, and we consider a factor SV in mean model. Additional specification of both expectations and volatility of future volatility of factors provides conditional moment restrictions, through which the parameters of the model are all identied. These conditional moment restrictions pave the way for instrumental variables estimation and GMM inference.     

A litter-based approach to risk assessment in developmental toxicity studies via a power family of completely monotone functions

Summary.  A new class of distributions for exchangeable binary data is proposed that originates from modelling the joint success probabilities of all orders by a power family of completely monotone functions. The distribution proposed allows flexible modelling of the dose–response relationship for both the marginal response probability and the pairwise odds ratio and is especially well suited for a litter-based approach to risk assessment. Specifically, the risk of at least one adverse response within a litter takes on a simple form under the distribution proposed and can be reduced further to a generalized linear model if a complementary log–log-link function is used. Existing distributions such as the beta–binomial or folded logistic functions have a tendency to assign too much probability to zero, leading to an underestimation of the risk that at least one foetus is affected and an overestimation of the safe dose. The distribution proposed does not suffer from this problem. With the aid of symbolic differentiation, the distribution proposed can be fitted easily and quickly via the method of scoring. The usefulness of the class of distributions proposed and its superiority over existing distributions are demonstrated in a series of examples involving developmental toxicology and teratology data.     

A BIVARIATE BINOMIAL DISTRIBUTION AND SOME APPLICATIONS1

This study is concerned with the joint distribution of the total numbers of occurrences of binary characters A and B, given three independent samples in which both characters, A but not B, and B but not A, are observed. The distribution function is given; its conditional distributions and regression functions are found; bounds on certain joint probabilities are established; and conditions for bivariate Poisson and Gaussian limits are studied. An application yields the joint distribution of sign statistics for the pair-wise comparison of treatments with a control.     

Boosting multi-state models

One important goal in multi-state modelling is to explore information about conditional transition-type-specific hazard rate functions by estimating influencing effects of explanatory variables. This may be performed using single transition-type-specific models if these covariate effects are assumed to be different across transition-types. To investigate whether this assumption holds or whether one of the effects is equal across several transition-types (cross-transition-type effect), a combined model has to be applied, for instance with the use of a stratified partial likelihood formulation. Here, prior knowledge about the underlying covariate effect mechanisms is often sparse, especially about ineffectivenesses of transition-type-specific or cross-transition-type effects. As a consequence, data-driven variable selection is an important task: a large number of estimable effects has to be taken into account if joint modelling of all transition-types is performed. A related but subsequent task is model choice: is an effect satisfactory estimated assuming linearity, or is the true underlying nature strongly deviating from linearity? This article introduces component-wise Functional Gradient Descent Boosting (short boosting) for multi-state models, an approach performing unsupervised variable selection and model choice simultaneously within a single estimation run. We demonstrate that features and advantages in the application of boosting introduced and illustrated in classical regression scenarios remain present in the transfer to multi-state models. As a consequence, boosting provides an effective means to answer questions about ineffectiveness and non-linearity of single transition-type-specific or cross-transition-type effects.