C472. The expected value of a conditional variance: An upper bound

The article derives Bartlett corrections for improving the chi-square approximation to the likelihood ratio statistics in a class of symmetric nonlinear regression models. This is a wide class of models which encompasses the t model and several other symmetric distributions with longer-than normal tails. In this paper we present, in matrix notation, Bartlett corrections to likelihood ratio statistics in nonlinear regression models with errors that follow a symmetric distribution. We generalize the results obtained by Ferrari, S. L. P. and Arellano-Valle, R. B. (1996). Modified likelihood ratio and score tests in linear regression models using the t distribution. Braz. J. Prob. Statist., 10, 15–33, who considered a t distribution for the errors, and by Ferrari, S. L. P. and Uribe-Opazo, M. A. (2001). Corrected likelihood ratio tests in a class of symmetric linear regression models. Braz. J. Prob. Statist., 15, 49–67, who considered a symmetric linear regression model. The formulae derived are simple enough to be used analytically to obtain several Bartlett corrections in a variety of important models. We also present simulation results comparing the sizes and powers of the usual likelihood ratio tests and their Bartlett corrected versions.     

Bayesian modeling of autoregressive partial linear models with scale mixture of normal errors

Normality and independence of error terms are typical assumptions for partial linear models. However, these assumptions may be unrealistic in many fields, such as economics, finance and biostatistics. In this paper, a Bayesian analysis for partial linear model with first-order autoregressive errors belonging to the class of the scale mixtures of normal distributions is studied in detail. The proposed model provides a useful generalization of the symmetrical linear regression model with independent errors, since the distribution of the error term covers both correlated and thick-tailed distributions, and has a convenient hierarchical representation allowing easy implementation of a Markov chain Monte Carlo scheme. In order to examine the robustness of the model against outlying and influential observations, a Bayesian case deletion influence diagnostics based on the Kullback–Leibler (K–L) divergence is presented. The proposed method is applied to monthly and daily returns of two Chilean companies.     

Penalized Composite Quasi-Likelihood for Ultrahigh-Dimensional Variable Selection

In high-dimensional model selection problems, penalized least-square approaches have been extensively used. This paper addresses the question of both robustness and efficiency of penalized model selection methods, and proposes a data-driven weighted linear combination of convex loss functions, together with weighted L(1)-penalty. It is completely data-adaptive and does not require prior knowledge of the error distribution. The weighted L(1)-penalty is used both to ensure the convexity of the penalty term and to ameliorate the bias caused by the L(1)-penalty. In the setting with dimensionality much larger than the sample size, we establish a strong oracle property of the proposed method that possesses both the model selection consistency and estimation efficiency for the true non-zero coefficients. As specific examples, we introduce a robust method of composite L1-L2, and optimal composite quantile method and evaluate their performance in both simulated and real data examples.     

Equivariant prediction in finite populations

A theory of equivariant prediction is developed for predicting the population total in finite populations. Minimum risk equivariant predictors (MREP) are derived under the location, scale and locationscale superpopulation models. Under the general linear model, it is shown that the best(linear) unbiased predictor (B(L)UP) is an MREP.     

Robust group-Lasso for functional regression model

In this article, we consider the problem of selecting functional variables using the L1 regularization in a functional linear regression model with a scalar response and functional predictors, in the presence of outliers. Since the LASSO is a special case of the penalized least-square regression with L1 penalty function, it suffers from the heavy-tailed errors and/or outliers in data. Recently, Least Absolute Deviation (LAD) and the LASSO methods have been combined (the LAD-LASSO regression method) to carry out robust parameter estimation and variable selection simultaneously for a multiple linear regression model. However, variable selection of the functional predictors based on LASSO fails since multiple parameters exist for a functional predictor. Therefore, group LASSO is used for selecting functional predictors since group LASSO selects grouped variables rather than individual variables. In this study, we propose a robust functional predictor selection method, the LAD-group LASSO, for a functional linear regression model with a scalar response and functional predictors. We illustrate the performance of the LAD-group LASSO on both simulated and real data.     

The estimations under power normalization for the tail index,with comparison

It is well known that the max-stable laws under power normalization attract more distributions than that under linear normalization. This fact practically means that the classical linear model (L-model) may fail to fit the given extreme data, while the power model (P-model) succeeds to do that. The main object of this paper is developing the modeling of extreme values via P-model by suggesting a simple technique to obtain a parallel estimator of the extreme value index (EVI) in the P-model for every known estimator to the corresponding parameter in L-mode. An application of this technique yields two classes of moment and moment ratio estimators for EVI in the P-model. The performances of these estimators are assessed via a simulation study. Moreover, an efficient criterion for comparing the L and P models is proposed to choose the best model when the two models successfully work.     

Determination of anaerobic threshold

This report describes the estimation of the parameters for a model of ventilation (y) by human subjects as a two-segment linear function of oxygen uptake (x). Experimental data were supplied by R.L. Hughson of the Department of Kinesiology. The analysis of one of nine available sets of data is described in detail.     

Performances of Bayesian model selection criteria for generalized linear models with non-ignorably missing covariates

This article deals with model comparison as an essential part of generalized linear modelling in the presence of covariates missing not at random (MNAR). We provide an evaluation of the performances of some of the popular model selection criteria, particularly of deviance information criterion (DIC) and weighted L (WL) measure, for comparison among a set of candidate MNAR models. In addition, we seek to provide deviance and quadratic loss-based model selection criteria with alternative penalty terms targeting directly the MNAR models. This work is motivated by the need in the literature to understand the performances of these important model selection criteria for comparison among a set of MNAR models. A Monte Carlo simulation experiment is designed to assess the finite sample performances of these model selection criteria in the context of interest under different scenarios for missingness amounts. Some naturally driven DIC and WL extensions are also discussed and evaluated.     

Sparse discriminant analysis based on estimation of posterior probabilities

ABSTRACT

Fisher's linear discriminant analysis (FLDA) is known as a method to find a discriminative feature space for multi-class classification. As a theory of extending FLDA to an ultimate nonlinear form, optimal nonlinear discriminant analysis (ONDA) has been proposed. ONDA indicates that the best theoretical nonlinear map for maximizing the Fisher's discriminant criterion is formulated by using the Bayesian a posterior probabilities. In addition, the theory proves that FLDA is equivalent to ONDA when the Bayesian a posterior probabilities are approximated by linear regression (LR). Due to some limitations of the linear model, there is room to modify FLDA by using stronger approximation/estimation methods. For the purpose of probability estimation, multi-nominal logistic regression (MLR) is more suitable than LR. Along this line, in this paper, we develop a nonlinear discriminant analysis (NDA) in which the posterior probabilities in ONDA are estimated by MLR. In addition, in this paper, we develop a way to introduce sparseness into discriminant analysis. By applying L1 or L2 regularization to LR or MLR, we can incorporate sparseness in FLDA and our NDA to increase generalization performance. The performance of these methods is evaluated by benchmark experiments using last_exam17 standard datasets and a face classification experiment.     

Marginal Projected Multivariate Linear Models for Clustered Angular Data

Among the diverse frameworks that have been proposed for regression analysis of angular data, the projected multivariate linear model provides a particularly appealing and tractable methodology. In this model, the observed directional responses are assumed to correspond to the angles formed by latent bivariate normal random vectors that are assumed to depend upon covariates through a linear model. This implies an angular normal distribution for the observed angles, and incorporates a regression structure through a familiar and convenient relationship. In this paper we extend this methodology to accommodate clustered data (e.g., longitudinal or repeated measures data) by formulating a marginal version of the model and basing estimation on an EM‐like algorithm in which correlation among within‐cluster responses is taken into account by incorporating a working correlation matrix into the M step. A sandwich estimator is used for the parameter estimates’ covariance matrix. The methodology is motivated and illustrated using an example involving clustered measurements of microbril angle on loblolly pine (Pinus taeda L.) Simulation studies are presented that evaluate the finite sample properties of the proposed fitting method. In addition, the relationship between within‐cluster correlation on the latent Euclidean vectors and the corresponding correlation structure for the observed angles is explored.     

NONNORMAL REGRESSION. II. SYMMETRIC DISTRIBUTIONS

Salient features of a family of short-tailed symmetric distributions, introduced recently by Tiku and Vaughan [1] Tiku, M. L. and Vaughan, D. C. 1999. “A family of short-tailed symmetric distributions”. In Technical Report Canada: McMaster University.  [Google Scholar], are enunciated. Assuming the error distribution to be one of this family, the methodology of modified likelihood is used to derive MML estimators of parameters in a linear regression model. The estimators are shown to be efficient, and robust to inliers. This paper is essentially the first to achieve robustness to inliers. The methodology is extended to long-tailed symmetric distributions and the resulting estimators are shown to be efficient, and robust to outliers. This paper should be read in conjunction with Islam et al. [2] Islam, Q., Tiku, M. L. and Yildirim, F. 2001. Nonnormal regression, Part I: Skew distributions. Commun. Stat.—Theory Meth., to appear [Google Scholar]who develop modified likelihood methodology for skew distributions in the context of linear regression.     

Generalized Poisson–Lindley linear model for count data

The purpose of this paper is to develop a new linear regression model for count data, namely generalized-Poisson Lindley (GPL) linear model. The GPL linear model is performed by applying generalized linear model to GPL distribution. The model parameters are estimated by the maximum likelihood estimation. We utilize the GPL linear model to fit two real data sets and compare it with the Poisson, negative binomial (NB) and Poisson-weighted exponential (P-WE) models for count data. It is found that the GPL linear model can fit over-dispersed count data, and it shows the highest log-likelihood, the smallest AIC and BIC values. As a consequence, the linear regression model from the GPL distribution is a valuable alternative model to the Poisson, NB, and P-WE models.     

Statistical aspects of W. D. Fisher's method of optimal aggregation

W. D. Fisher's approach to approximating a known linear model y=Ax by an aggregation-disaggregation sequence involves a moment matrix M which is supposed to be known. This paper investigates the statistical problems arising when M is not known. As an example we consider the open static Leontief model with A being the Leontief inverse. Under the assumption that the exogenous variables are multinormal with zero mean, tests and confidence intervals for the loss of information are given. The use of maximum entropy estimation of M for insufficient data is discussed. Statistical procedures to evaluate the goodness of aggregation-disaggregation of a time series of matrices A are also described.     

Robust Liu estimator for regression based on an M-estimator

Consider the regression model y = beta 0 1 + Xbeta + epsilon. Recently, the Liu estimator, which is an alternative biased estimator beta L (d) = (X'X + I) -1 (X'X + dI)beta OLS , where 0<d<1 is a parameter, has been proposed to overcome multicollinearity . The advantage of beta L (d) over the ridge estimator beta R (k) is that beta L (d) is a linear function of d. Therefore, it is easier to choose d than to choose k in the ridge estimator. However, beta L (d) is obtained by shrinking the ordinary least squares (OLS) estimator using the matrix (X'X + I) -1 (X'X + dI) so that the presence of outliers in the y direction may affect the beta L (d) estimator. To cope with this combined problem of multicollinearity and outliers, we propose an alternative class of Liu-type M-estimators (LM-estimators) obtained by shrinking an M-estimator beta M , instead of the OLS estimator using the matrix (X'X + I) -1 (X'X + dI).     

广义线性混合模型在顾客满意度研究中的应用——基于某地区银行理财产品顾客满意度的分析

在对广义线性模型与经典线性模型进行对比分析基础上,重点介绍了广义线性混合模型与估计方法及其在满意度调查数据中的模型设定与应用,并采用某调查机构在2011年1月至2012年3月期间对购买过某地区银行理财产品的客户进行的满意度调查数据进行实证分析。研究表明:相对于经典线性回归模型与广义线性模型,广义线性混合模型是分析满意度调查数据的有效方法。     

Sufficient and admissible estimators in general multivariate linear model

The notion of linear sufficiency in general Gauss–Markov model is extended to a general multivariate linear model for any specific set of estimable functions. A general formula of the difference between the dispersion matrix of the BLUE in the original model and that in the transformed model is provided, which brings some further contributions to the theory of linear sufficiency. Moreover, a general formula of the change of BLUE due to transformation is obtained. The analysis here leads to some results, some of which are known in the literature. Besides linear sufficiency, the admissibility of a linear statistic is also extended to the multivariate case.     

D-optimal Designs for a Combined Simple Linear and Haar-Wavelet Regression Model

A combined simple linear and Haar-wavelet regression model is the combination of a simple linear model and a Haar-wavelet regression model. In this article we show how to construct D-optimal designs for a combined simple linear and Haar-wavelet regression model. An example is also given.     

The distribution of a linear predictor after model selection: conditional finite-sample distributions and asymptotic approximations

This paper studies the distribution of a linear predictor that is constructed after a data-driven model selection step in a linear regression model. The finite-sample cumulative distribution function (cdf) of the linear predictor is derived and a detailed analysis of the effects of the model selection step is given. Moreover, a simple approximation to the (complicated) finite-sample cdf is proposed. This approximation facilitates the study of the large-sample limit behavior of the linear predictor and its cdf, in the fixed-parameter case and under local alternatives. The focus of this paper is on the conditional distribution of a linear predictor, conditional on the event that a fixed (possibly incorrect) model has been selected. The unconditional distribution of a linear predictor is studied in the companion paper Leeb (The distribution of a linear predictor after model selection: unconditional finite-sample distributions and asymptotic approximations, Technical Report, Department of Statistics, University of Vienna, 2002).     

Evaluating the Effectiveness of State-Switching Time Series Models for U.S. Real Output

Two types of state-switching models for U.S. real output have been proposed: models that switch randomly between states and models that switch states deterministically, as in the threshold autoregressive model of Potter. These models have been justified primarily on how well they fit the sample data, yielding statistically significant estimates of the model coefficients. Here we propose a new approach to the evaluation of an estimated nonlinear time series model that provides a complement to existing methods based on in-sample fit or on out-of-sample forecasting. In this new approach, a battery of distinct nonlinearity tests is applied to the sample data, resulting in a set of p-values for rejecting the null hypothesis of a linear generating mechanism. This set of p-values is taken to be a “stylized fact” characterizing the nonlinear serial dependence in the generating mechanism of the time series. The effectiveness of an estimated nonlinear model for this time series is then evaluated in terms of the congruence between this stylized fact and a set of nonlinearity test results obtained from data simulated using the estimated model. In particular, we derive a portmanteau statistic based on this set of nonlinearity test p-values that allows us to test the proposition that a given model adequately captures the nonlinear serial dependence in the sample data. We apply the method to several estimated state-switching models of U.S. real output.