Asymptotic theory for maximum likelihood estimates in reduced-rank multivariate generalized linear models

Reduced-rank regression is a dimensionality reduction method with many applications. The asymptotic theory for reduced rank estimators of parameter matrices in multivariate linear models has been studied extensively. In contrast, few theoretical results are available for reduced-rank multivariate generalized linear models. We develop M-estimation theory for concave criterion functions that are maximized over parameter spaces that are neither convex nor closed. These results are used to derive the consistency and asymptotic distribution of maximum likelihood estimators in reduced-rank multivariate generalized linear models, when the response and predictor vectors have a joint distribution. We illustrate our results in a real data classification problem with binary covariates.     

Hilbert space methods for reduced-rank Gaussian process regression

Statistics and Computing - This paper proposes a novel scheme for reduced-rank Gaussian process regression. The method is based on an approximate series expansion of the covariance function in...     

THE REDUCED-RANK GROWTH CURVE MODEL FOR DISCRIMINANT ANALYSIS OF LONGITUDINAL DATA

This paper presents a method of discriminant analysis especially suited to longitudinal data. The approach is in the spirit of canonical variate analysis (CVA) and is similarly intended to reduce the dimensionality of multivariate data while retaining information about group differences. A drawback of CVA is that it does not take advantage of special structures that may be anticipated in certain types of data. For longitudinal data, it is often appropriate to specify a growth curve structure (as given, for example, in the model of Potthoff & Roy, 1964). The present paper focuses on this growth curve structure, utilizing it in a model-based approach to discriminant analysis. For this purpose the paper presents an extension of the reduced-rank regression model, referred to as the reduced-rank growth curve (RRGC) model. It estimates discriminant functions via maximum likelihood and gives a procedure for determining dimensionality. This methodology is exploratory only, and is illustrated by a well-known dataset from Grizzle & Allen (1969).     

Canonical correlation analysis for the vector AR(1) model with ARCH innovations

This paper extends the results of canonical correlation analysis of Anderson [2002. Canonical correlation analysis and reduced-rank regression in autoregressive models. Ann. Statist. 30, 1134–1154] to a vector AR(1) process with a vector ARCH(1) innovations. We obtain the limiting distributions of the sample matrices, the canonical correlations and the canonical vectors of the process. The extension is important because many time series in economics and finance exhibit conditional heteroscedasticity. We also use simulation to demonstrate the effects of ARCH innovations on the canonical correlation analysis in finite sample. Both the limiting distributions and simulation results show that overlooking the ARCH effects in canonical correlation analysis can easily lead to erroneous inference.     

Generalized Least Squares Estimation in Contingency Tables Analysis: Asymptotic Properties and Applications

Different sorts of bilinear models (models with bilinear interaction terms) are currently used when analyzing contingency tables: association models, correlation models... All these can be included in a general family of bilinear models: power models. In this framework, Maximum Likelihood (ML) estimation is not always possible, as explained in an introductory example. Thus, Generalized Least Squares (GLS) estimation is sometimes needed in order to estimate parameters. A subclass of power models is then considered in this paper: separable reduced-rank (SRR) models. They allow an optimal choice of weights for GLS estimation and simplifications in asymptotic studies concerning GLS estimators. Power 2 models belong to the subclass of SRR models and the asymptotic properties of GLS estimators are established. Similar results are also established for association models which are not SRR models. However, these results are more difficult to prove. Finally, 2 examples are considered to illustrate our results.     

Reduced-rank multi-label classification

Multi-label classification is a natural generalization of the classical binary classification for classifying multiple class labels. It differs from multi-class classification in that the multiple class labels are not exclusive. The key challenge is to improve the classification accuracy by incorporating the intrinsic dependency structure among the multiple class labels. In this article we propose to model the dependency structure via a reduced-rank multi-label classification model, and to enforce a group lasso regularization for sparse estimation. An alternative optimization scheme is developed to facilitate the computation, where a constrained manifold optimization technique and a gradient descent algorithm are alternated to maximize the resultant regularized log-likelihood. Various simulated examples and two real applications are conducted to demonstrate the effectiveness of the proposed method. More importantly, its asymptotic behavior is quantified in terms of the estimation and variable selection consistencies, as well as the model selection consistency via the Bayesian information criterion.     

Analysis of cointegrated models with measurement errors

We study the asymptotic properties of the reduced-rank estimator of error correction models of vector processes observed with measurement errors. Although it is well known that there is no asymptotic measurement error bias when predictor variables are integrated processes in regression models [Phillips BCB, Durlauf SN. Multiple time series regression with integrated processes. Rev Econom Stud. 1986;53:473–495], we systematically investigate the effects of the measurement errors (in the dependent variables as well as in the predictor variables) on the estimation of not only cointegrating vectors but also the speed of the adjustment matrix. Furthermore, we present the asymptotic properties of the estimators. We also obtain the asymptotic distribution of the likelihood ratio test for the cointegrating ranks. We investigate the effects of the measurement errors on estimation and test through a Monte Carlo simulation study.     

A probabilistic model for nonsymmetric correspondence analysis and prediction in contingency tables

Summary Nonsymmetric correspondence analysis is a model meant for the analysis of the dependence in a two-way continengy table, and is an alternative to correspondence analysis. Correspondence analysis is based on the decomposition of Pearson's Ф²-index Nonsymmetric correspondence analysis is based on the decomposition of Goodman-Kruskal's τ-index for predicatablity. In this paper, we approach nonsymmetric correspondence analysis as a statistical model based on a probability distribution. We provide algorithms for the maximum likelihood and the least-squares estimation with linear constraints upon model parameters. The nonsymmetric correspondence analysis model has many properties that can be useful for prediction analysis in contingency tables. Predictability measures are introduced to identify the categories of the response variable that can be best predicted, as well as the categories of the explanatory variable having the highest predictability power. We describe the interpretation of model parameters in two examples. In the end, we discuss the relations of nonsymmetric correspondence analysis with other reduced-rank models.     

Multilevel dimensionality-reduction methods

When data sets are multilevel (group nesting or repeated measures), different sources of variations must be identified. In the framework of unsupervised analyses, multilevel simultaneous component analysis (MSCA) has recently been proposed as the most satisfactory option for analyzing multilevel data. MSCA estimates submodels for the different levels in data and thereby separates the “within”-subject and “between”-subject variations in the variables. Following the principles of MSCA and the strategy of decomposing the available data matrix into orthogonal blocks, and taking into account the between- and the within data structures, we generalize, in a multilevel perspective, multivariate models in which a matrix of response variables can be used to guide the projections (formed by responses predicted by explanatory variables or by a limited number of their combinations/composites) into choices of meaningful directions. To this end, the current paper proposes the multilevel version of the multivariate regression model and dimensionality-reduction methods (used to predict responses with fewer linear composites of explanatory variables). The principle findings of the study are that the minimization of the loss functions related to multivariate regression, principal-component regression, reduced-rank regression, and canonical-correlation regression are equivalent to the separate minimization of the sum of two separate loss functions corresponding to the between and within structures, under some constraints. The paper closes with a case study of an application focusing on the relationships between mental health severity and the intensity of care in the Lombardy region mental health system.     

A class of modified stein estimators with easily computable risk functions

Consider the problem of estimating the mean of a p (≥3)-variate multi-normal distribution with identity variance-covariance matrix and with unweighted sum of squared error loss. A class of minimax, noncomparable (i.e. no estimate in the class dominates any other estimate in the class) estimates is proposed; the class contains rules dominating the simple James-Stein estimates. The estimates are essentially smoothed versions of the scaled, truncated James-Stein estimates studied by Efron and Morris. Explicit and analytically tractable expressions for their risks are obtained and are used to give guidelines for selecting estimates within the class.     

流动人口社会融合指标体系内在关系研究

利用2014年流动人口社会融合专题调查数据,分别以经济融合、社区融合、文化接纳、自我认同中任何一个变量为因变量,剩余三个变量为自变量,构建由经济模型、社会模型、文化模型和自我认同模型组成的联立方程组,并采用多元线性回归和logistic回归为主要方法,引入流动性别、年龄、受教育程度、户口性质、流动区域、民族等六个变量为控制变量,对流动人口社会融合的四个维度的内在关系进行了分析。研究发现,经济收入与社区融合统计关系不显著,与文化接纳和身份认同统计关系显著,表明收入越高文化接纳越好,身份认同却越差;经济收入对心理文化及社区参与的影响要略微强于心理文化及社区参与对经济收入的影响,经济融合有一定的独立性特征,而社区参与、文化接纳与身份认同存在更高的一致性关系。     

ON AN IDENTITY FOR FINDING MOMENTS OF SAMPLE MOMENTS OF BIVARIATE NORMAL RANDOM VARIABLES

Probabilistic arguments are used to establish an identity useful for deriving the moments of the sample variances and covariance of a bivariate normal population. Some variances and covariances are derived to illustrate the use of the identity.     

Electronic Resources Forum - Managing Researcher Identity: Tools for Researchers and Librarians

Abstract

Researchers have increasing opportunities to identify themselves and raise the profile of their research and scholarship through online researcher identity management and researcher profile systems. This column provides a basic introduction to researcher identity management and examines four widely used researcher profile systems: Google Scholar Citations, Open Researcher and Contributor Identifier (ORCID), Scopus Author ID, and Web of Science ResearcherID. System benefits and comparisons are provided, with the purpose of helping researchers and librarians to select appropriate researcher identity management tools to support their work.     

Application of 'delete = replace' to deletion diagnostics for variance component estimation in the linear mixed model

Summary.  'Delete = replace' is a powerful and intuitive modelling identity. This paper extends previous work by stating and proving the identity in more general terms and extending its application to deletion diagnostics for estimates of variance components obtained by restricted maximum likelihood estimation for the linear mixed model. We present a new, fast, transparent and approximate computational procedure, arising as a by-product of the fitting process. We illustrate the effect of the deletion of individual observations, of 'subjects' and of arbitrary subsets. Central to the identity and its application is the conditional residual.     

An identity for exponential distributions with the common location parameter and its applications

An identity for exponential distributions with an unknown common location parameter and unknown and possibly unequal scale parameters is established.Through use of the identity the maximum likelihood estimator (MLE) and the uniformly minimum variance unbiased estimator (UMVUE) of a quantile of an exponential population are compared under the squared error loss.A class of estimators dominating both MLE and UMVUE is obtained by using the identity.     

On Stein Identity,Chernoff Inequality,and Orthogonal Polynomials

In this article, we present a general method for deriving Stein-like identity and Chernoff-like inequality based on orthogonal polynomials. In order to illustrate our method, some applications are given with respect to normal, Gamma, Beta, Poisson, binomial, and negative binomial distribution, not only for random variables but also for random vectors, resulting corresponding Stein-like identity and Chernoff-like inequality are obtained consequently. Within our best knowledge, some of our matrix version results are new in the literature. In addition, forward difference formulae of Charlier polynomials, Krawtchouk polynomials and Meixner polynomials, Stein-like identity, and Chernoff-like inequality with respect to Beta distribution, as well as Rodrigues formula of Meixner polynomials are also prepared in the first time within our limited information. Interestingly, as far as normal, Gamma, Beta, Poisson, binomial, and negative binomial distribution are concerned, we found that their Stein-like identity and corresponding Chernoff-like inequality are related closely, by examining their Rodrigues formula.     

A MOMENT IDENTITY

A moment identity based on the concept of weighted distributions is presented. The identity has potential applications to problems involving the manipulation of expectations of functions of random variables. Several examples, mainly concerning the evaluation of the risk of shrinkage estimators of several parameters, are given.     

Moment identity for discrete random variable and its applications

In this paper, we obtain a moment identity applicable to a general class of discrete probability distributions. We then derive the corresponding identities for modified power series, Ord and Katz families. It is noted that the proposed identity has potential applications in different fields.     

Identity for the NPMLE in Censored Data Models

We derive an identity for nonparametric maximum likelihood estimators (NPMLE) and regularized MLEs in censored data models which expresses the standardized maximum likelihood estimator in terms of the standardized empirical process. This identity provides an effective starting point in proving both consistency and efficiency of NPMLE and regularized MLE. The identity and corresponding method for proving efficiency is illustrated for the NPMLE in the univariate right-censored data model, the regularized MLE in the current status data model and for an implicit NPMLE based on a mixture of right-censored and current status data. Furthermore, a general algorithm for estimation of the limiting variance of the NPMLE is provided. This revised version was published online in July 2006 with corrections to the Cover Date.     

A Simple Probabilistic Proof for the Alternating Convolution of the Central Binomial Coefficients

This note presents a simple probabilistic proof of the identity for the alternating convolution of the central binomial coefficients. The proof of the identity involves the computation of moments of order n for the product of standard normal random variables.