A unified approach to estimation of nonlinear mixed effects and Berkson measurement error models

Mixed effects models and Berkson measurement error models are widely used. They share features which the author uses to develop a unified estimation framework. He deals with models in which the random effects (or measurement errors) have a general parametric distribution, whereas the random regression coefficients (or unobserved predictor variables) and error terms have nonparametric distributions. He proposes a second-order least squares estimator and a simulation-based estimator based on the first two moments of the conditional response variable given the observed covariates. He shows that both estimators are consistent and asymptotically normally distributed under fairly general conditions. The author also reports Monte Carlo simulation studies showing that the proposed estimators perform satisfactorily for relatively small sample sizes. Compared to the likelihood approach, the proposed methods are computationally feasible and do not rely on the normality assumption for random effects or other variables in the model.     

Hazard rate ordering of the second-order statistics from multiple-outlier PHR samples

In this paper, we compare the hazard rate functions of the second-order statistics arising from two sets of independent multiple-outlier proportional hazard rates (PHR) samples. It is proved that the submajorization order between the sample size vectors together with the supermajorization order between the hazard rate vectors imply the hazard rate ordering between the corresponding second-order statistics from multiple-outlier PHR random variables. The results established here provide theoretical guidance both for the winner's price for the bid in the second-price reverse auction in auction theory and fail-safe system design in reliability. Some numerical examples are also provided for illustration.     

Use of non-normality in structural equation modeling: Application to direction of causation

Structural equation modeling (SEM) typically utilizes first- and second-order moment structures. This limits its applicability since many unidentified models and many equivalent models that researchers would like to distinguish are created. In this paper, we relax this restriction and assume non-normal distributions on exogenous variables. We shall provide a solution to the problems of underidentifiability and equivalence of SEM models by making use of non-normality (higher-order moment structures). The non-normal SEM is applied to finding the possible direction of a path in simple regression models. The method of (generalized) least squares is employed to estimate model parameters. A test statistic for examining a fit of a model is proposed. A simulation result and a real data example are reported to study how the non-normal SEM approach works empirically.     

Optimizing a control plan using a structural equation model with an application to statistical process analysis

In the case where non-experimental data are available from an industrial process and a directed graph for how various factors affect a response variable is known based on a substantive understanding of the process, we consider a problem in which a control plan involving multiple treatment variables is conducted in order to bring a response variable close to a target value with variation reduction. Using statistical causal analysis with linear (recursive and non-recursive) structural equation models, we configure an optimal control plan involving multiple treatment variables through causal parameters. Based on the formulation, we clarify the causal mechanism for how the variance of a response variable changes when the control plan is conducted. The results enable us to evaluate the effect of a control plan on the variance of a response variable from non-experimental data and provide a new application of linear structural equation models to engineering science.     

Bayesian Analysis of DSGE Models

This paper reviews Bayesian methods that have been developed in recent years to estimate and evaluate dynamic stochastic general equilibrium (DSGE) models. We consider the estimation of linearized DSGE models, the evaluation of models based on Bayesian model checking, posterior odds comparisons, and comparisons to vector autoregressions, as well as the non-linear estimation based on a second-order accurate model solution. These methods are applied to data generated from correctly specified and misspecified linearized DSGE models and a DSGE model that was solved with a second-order perturbation method.     

Empirical Bayes Small-Area Estimation Using Logistic Regression Models and Summary Statistics

Many of the available methods for estimating small-area parameters are model-based approaches in which auxiliary variables are used to predict the variable of interest. For models that are nonlinear, prediction is not straightforward. MacGibbon and Tomberlin and Farrell, MacGibbon, and Tomberlin have proposed approaches that require microdata for all individuals in a small area. In this article, we develop a method, based on a second-order Taylor-series expansion to obtain model-based predictions, that requires only local-area summary statistics for both continuous and categorical auxiliary variables. The methodology is evaluated using data based on a U.S. Census.     

Non-parametric smoothing of the location model in mixed variable discrimination

The location model is a familiar basis for discriminant analysis of mixtures of categorical and continuous variables. Its usual implementation involves second-order smoothing, using multivariate regression for the continuous variables and log-linear models for the categorical variables. In spite of the smoothing, these procedures still require many parameters to be estimated and this in turn restricts the categorical variables to a small number if implementation is to be feasible. In this paper we propose non-parametric smoothing procedures for both parts of the model. The number of parameters to be estimated is dramatically reduced and the range of applicability thereby greatly increased. The methods are illustrated on several data sets, and the performances are compared with a range of other popular discrimination techniques. The proposed method compares very favourably with all its competitors.     

Generalized Linear Factor Models: A New Local EM Estimation Algorithm

In this article, a general approach to latent variable models based on an underlying generalized linear model (GLM) with factor analysis observation process is introduced. We call these models Generalized Linear Factor Models (GLFM). The observations are produced from a general model framework that involves observed and latent variables that are assumed to be distributed in the exponential family. More specifically, we concentrate on situations where the observed variables are both discretely measured (e.g., binomial, Poisson) and continuously distributed (e.g., gamma). The common latent factors are assumed to be independent with a standard multivariate normal distribution. Practical details of training such models with a new local expectation-maximization (EM) algorithm, which can be considered as a generalized EM-type algorithm, are also discussed. In conjunction with an approximated version of the Fisher score algorithm (FSA), we show how to calculate maximum likelihood estimates of the model parameters, and to yield inferences about the unobservable path of the common factors. The methodology is illustrated by an extensive Monte Carlo simulation study and the results show promising performance.     

大维变量选择、混频因子模型与新冠肺炎疫情冲击下的GDP现时预测

新冠肺炎疫情不仅对我国宏观经济造成了巨大冲击,也为准确预测我国宏观经济未来走势带来挑战。本文从新冠肺炎疫情冲击出发,将模型置信集检验与U-MIDAS模型组合,设计了一种在混频情形下利用预测变量的异质性波动从大维数据集中选取对GDP具有稳定预测效果变量的方法。通过利用选取出的稳定性变量构建多种形式的混频目标因子模型并与其他类型的混频因子模型对比,全面评估了不同模型在疫情前后对GDP进行高频现时预测的效果。研究发现,在疫情冲击前的平稳时期,利用覆盖范围较广的变量构建双因子MIDAS模型预测效果最优;利用稳定性变量构建的单因子U-MIDAS模型同样具有良好的预测效果。当经济从冲击中持续恢复时,利用部分稳定性变量构建的双因子U-MIDAS模型在捕捉到GDP的核心变化后率先对其连续做出准确的现时预测。经济稳定时,对预测变量设定较长的滞后阶数会提升预测效果;在冲击后的恢复期中则应减少滞后阶数,避免变量在冲击中出现的异常值对预测产生负面影响。本文也为当经济受到巨大外生冲击或处于冲击后的恢复期时其他宏观经济指标的预测提供了有价值的参考。     

Bias reduction in the estimation of a shape second-order parameter of a heavy-tailed model

In extreme value theory, the shape second-order parameter is a quite relevant parameter related to the speed of convergence of maximum values, linearly normalized, towards its limit law. The adequate estimation of this parameter is vital for improving the estimation of the extreme value index, the primary parameter in statistics of extremes. In this article, we consider a recent class of semi-parametric estimators of the shape second-order parameter for heavy right-tailed models. These estimators, based on the largest order statistics, depend on a real tuning parameter, which makes them highly flexible and possibly unbiased for several underlying models. In this article, we are interested in the adaptive choice of such tuning parameter and the number of top order statistics used in the estimation procedure. The performance of the methodology for the adaptive choice of parameters is evaluated through a Monte Carlo simulation study.     

Factor Stochastic Volatility in Mean Models: A GMM Approach

This paper provides a semiparametric framework for modeling multivariate conditional heteroskedasticity. We put forward latent stochastic volatility (SV) factors as capturing the commonality in the joint conditional variance matrix of asset returns. This approach is in line with common features as studied by Engle and Kozicki (1993), and it allows us to focus on identication of factors and factor loadings through first- and second-order conditional moments only. We assume that the time-varying part of risk premiums is based on constant prices of factor risks, and we consider a factor SV in mean model. Additional specification of both expectations and volatility of future volatility of factors provides conditional moment restrictions, through which the parameters of the model are all identied. These conditional moment restrictions pave the way for instrumental variables estimation and GMM inference.     

Reliability properties of record values from non-identically distributed random variables

In reliability theory, order statistics and record values are used for statistical modelling. The r-th order statistic in a sample of size n represents the life—length of a (n?r+l)-out-of-n system, and record values are used in shock models. In recent years, reliability properties of order statistics and record values have been investigated. The two models are included in Pfeifer's concept of record values from non-identically distributed random variables. Here, some results on the transmission of distributional properties, such as increasing failure rate, are shown for such records, which contain the results for order statistics and ordinary record values as particular cases.     

Bayesian Model Choice in Exponential Survival Models

ABSTRACT

Log-linear models for the distribution on a contingency table are represented as the intersection of only two kinds of log-linear models. One assuming that a certain group of the variables, if conditioned on all other variables, has a jointly independent distribution and another one assuming that a certain group of the variables, if conditioned on all other variables, has no highest order interaction. The subsets entering into these models are uniquely determined by the original log-linear model. This canonical representation suggests considering joint conditional independence and conditional no highest order association as the elementary building blocks of log-linear models.     

Dynamic latent trait models with mixed hidden Markov structure for mixed longitudinal outcomes

We propose a general Bayesian joint modeling approach to model mixed longitudinal outcomes from the exponential family for taking into account any differential misclassification that may exist among categorical outcomes. Under this framework, outcomes observed without measurement error are related to latent trait variables through generalized linear mixed effect models. The misclassified outcomes are related to the latent class variables, which represent unobserved real states, using mixed hidden Markov models (MHMMs). In addition to enabling the estimation of parameters in prevalence, transition and misclassification probabilities, MHMMs capture cluster level heterogeneity. A transition modeling structure allows the latent trait and latent class variables to depend on observed predictors at the same time period and also on latent trait and latent class variables at previous time periods for each individual. Simulation studies are conducted to make comparisons with traditional models in order to illustrate the gains from the proposed approach. The new approach is applied to data from the Southern California Children Health Study to jointly model questionnaire-based asthma state and multiple lung function measurements in order to gain better insight about the underlying biological mechanism that governs the inter-relationship between asthma state and lung function development.     

Analyzing supersaturated designs with entropic measures

A supersaturated design is a design for which there are fewer runs than effects to be estimated. In this paper, we propose a method for screening out the important factors from a large set of potentially active variables, based on an information theoretical approach. Three entropy measures: Rényi entropy, Tsallis entropy and Havrda–Charvát entropy, have been associated with the measure of information gain, in order to identify the significant factors using data and assuming generalized linear models. The investigation of the proposed method performance and the comparison of each entropic measure application have been accomplished through simulation experiments. A noteworthy advantage of this paper is the use of generalized linear models for analyzing data from supersaturated designs, a fact that, to the best of our knowledge, has not yet been studied.     

Multivariate Excess Wealth Ordering of Generalized Order Statistics

The concept of generalized order statistics (GOSs) was introduced as a unified approach to a variety of models of ordered random variables. The purpose of this paper is to investigate conditions on the underlying distribution function and the parameters on which GOSs are based, to establish multivariate excess wealth ordering of GOSs from one sample and two samples, respectively.     

Partial least squares estimator for single-index models

The partial least squares (PLS) approach first constructs new explanatory variables, known as factors (or components), which are linear combinations of available predictor variables. A small subset of these factors is then chosen and retained for prediction. We study the performance of PLS in estimating single-index models, especially when the predictor variables exhibit high collinearity. We show that PLS estimates are consistent up to a constant of proportionality. We present three simulation studies that compare the performance of PLS in estimating single-index models with that of sliced inverse regression (SIR). In the first two studies, we find that PLS performs better than SIR when collinearity exists. In the third study, we learn that PLS performs well even when there are multiple dependent variables, the link function is non-linear and the shape of the functional form is not known.     

Ordering results on extremes of scaled random variables with dependence and proportional hazards

This study deals with random variables equipped with Archimedean copulas and following scale proportional hazards (SPHs) or revered hazards models. We build the usual stochastic order both between minimums of two SPHs samples with Archimedean survival copulas and between maximums from two scale proportional reversed hazards (PRHs) samples with Archimedean copulas. The hazard rate order between minimums of independent SPHs samples and the reversed hazard rate order between maximums of independent scale PRHs samples are both derived. Also we have a discussion on the dispersive order between minimums from samples with a common Archimedean survival copula. The present results either generalize or improve some related ones in the recent literature.     

Construction and analysis of edge designs from skew-symmetric supplementary difference sets

The purpose of screening experiments is to identify the dominant variables from a set of many potentially active variables which may affect some characteristic y. Edge designs were recently introduced in the literature and are constructed by using conferences matrices and were proved to be robust. We introduce a new class of edge designs which are constructed from skew-symmetric supplementary difference sets. These designs are particularly useful since they can be applied for experiments with an even number of factors and they may exist for orders where conference matrices do not exist. Using this methodology, examples of new edge designs for 6, 14, 22, 26, 38, 42, 46, 58, and 62 factors are constructed. Of special interest are the new edge designs for studying 22 and 58 factors because edge designs with these parameters have not been constructed in the literature since conference matrices of the corresponding order do not exist. The suggested new edge designs achieve the same model-robustness as the traditional edge designs. We also suggest the use of a mirror edge method as a test for the linearity of the true underlying model. We give the details of the methodology and provide some illustrating examples for this new approach. We also show that the new designs have good D-efficiencies when applied to first order models.     

Logistic与分类树模型变量筛选的比较——基于信用卡邮寄业务响应率分析

基于信用卡邮寄业务响应率分析来讨论Logistic模型和分类树模型在变量选取上的区别,并尝试从几个不同角度去解释两类模型变量筛选差异的原因。笔者认为没有绝对占优势的方法,需要结合具体场景和模型的特点来选择合适的模型。分类树模型在训练集上容易过度拟合,对单个变量的影响很敏感,在进行危险因素分析时结果更能强调危险因素,对孤立点的识别率很高。Logistic模型容易受到解释变量依存关系的影响,加上分类变量的影响容易过多地选入变量或者因子,对孤立点敏感,对噪点不敏感。判别函数的差异是变量筛选差异的关键因素。