Limit distributions of unbiased estimators in natural exponential families

We obtain the possible limit distributions of unbiased estimators of functions of the parameter of a natural exponential family. The limit distribution depends on <$>j<$>, the order of the first non-zero derivative at the true (but usually unknown) value of the parameter. We show that if <$>j \geq 2<$> then the umvu and the maximum likelihood estimators are not asymptotically equivalent.     

Asymptotic linearity and limit distributions,approximations

Linear and quadratic forms as well as other low degree polynomials play an important role in statistical inference. Asymptotic results and limit distributions are obtained for a class of statistics depending on μ+X$\mu +\mathbf{X}$, with X any random vector and μ$\mu$ non-random vector with ∥μ∥→+∞$\parallel \mu \parallel \to +\infty$. This class contain the polynomials in μ+X$\mu +\mathbf{X}$. An application to the case of normal X is presented. This application includes a new central limit theorem which is connected with the increase of non-centrality for samples of fixed size. Moreover upper bounds for the suprema of the differences between exact and approximate distributions and their quantiles are obtained.     

Interpretation of Canonical Discriminant Functions,Canonical Variates,and Principal Components

Canonical discriminant functions are defined here as linear combinations that separate groups of observations, and canonical variates are defined as linear combinations associated with canonical correlations between two sets of variables. In standardized form, the coefficients in either type of canonical function provide information about the joint contribution of the variables to the canonical function. The standardized coefficients can be converted to correlations between the variables and the canonical function. These correlations generally alter the interpretation of the canonical functions. For canonical discriminant functions, the standardized coefficients are compared with the correlations, with partial t and F tests, and with rotated coefficients. For canonical variates, the discussion includes standardized coefficients, correlations between variables and the function, rotation, and redundancy analysis. Various approaches to interpretation of principal components are compared: the choice between the covariance and correlation matrices, the conversion of coefficients to correlations, the rotation of the coefficients, and the effect of special patterns in the covariance and correlation matrices.     

Nonparametric Tests for Comparing Several Coefficients of Variation

We consider the problem of comparing (k + 1) coefficients of variation. We are interested in testing the null hypothesis that the coefficients of variation are equal against each of the alternatives: (a) some populations have different coefficients of variation and (b) the coefficients of variation are ordered. Three nonparametric test statistics are proposed and their asymptotic theory is developed. We compared the proposed tests together with another parametric test using two Monte Carlo studies to estimate their probabilities of Type I error and powers. An illustration of the proposed tests using a real data set is given.     

Estimation of multivariate frailty models with varying coefficients

The complicated structures can be modeled more efficiently and their flexibility can be increased through frailty models with varying coefficients.Therefore, such models are proposed in this article. The real challenge is to estimate varying coefficients by the penalized partial likelihood without closed form. The Laplace approximation is used to solve this problem. These varying coefficients are fitted using B-splines. Moreover, the variances of random effects are estimated by maximizing an approximate profile likelihood. The performance of the proposed methods are assessed with simulation studies and real data. The results show that the methods proposed are better than the counterpart in literature.     

Distribution of linear combination of exponential variates

The exact distribution of a linear combination of n independent negative exponential random variables, when the coefficients of the linear combination are distinct and positive quantities, is well-known. This paper extends the above result to the general case, namely when the coefficients are arbitrary real numbers, positive or negative, distinct or coincident.     

A simulation study of the Bennett test and Miller test for coefficients of variation

In the article, properties of the Bennett test and Miller test are analyzed. Assuming that the sample size is the same for each sample and considering the null hypothesis that the coefficients of variation for k populations are equal against the hypothesis that k ? 1 coefficients of variation are the same but differ from the coefficient of variation for the kth population, the empirical significance level and the power of the test are studied. Moreover, the dependence of the test statistic and the power of the test on the ratio of coefficients of variation are considered. The analyses are performed on simulated data.     

Sieve Estimation of Time-Varying Panel Data Models With Latent Structures

We propose a heterogeneous time-varying panel data model with a latent group structure that allows the coefficients to vary over both individuals and time. We assume that the coefficients change smoothly over time and form different unobserved groups. When treated as smooth functions of time, the individual functional coefficients are heterogeneous across groups but homogeneous within a group. We propose a penalized-sieve-estimation-based classifier-Lasso (C-Lasso) procedure to identify the individuals’ membership and to estimate the group-specific functional coefficients in a single step. The classification exhibits the desirable property of uniform consistency. The C-Lasso estimators and their post-Lasso versions achieve the oracle property so that the group-specific functional coefficients can be estimated as well as if the individuals’ membership were known. Several extensions are discussed. Simulations demonstrate excellent finite sample performance of the approach in both classification and estimation. We apply our method to study the heterogeneous trending behavior of GDP per capita across 91 countries for the period 1960–2012 and find four latent groups.     

An easy way to tell what you are esting in analysis of variance

Least squares regression models are often used to analyze unbalanced fixed effect data sets with u unique cells defined by design or by post-hoc stratification. Constraints exist among the regression coefficients if there are more coefficients than cells. Models with fewer linearly independent regression coefficients than cells or with empty cells impose constraints on estimated cell means. An easy method of determining constraints among the estimated cell means and among the estimated regression coefficients for any model is developed and illustrated using a small data set.     

Mixed models for data from thorough QT studies: part 2. One-step assessment of conditional QT prolongation

We investigate mixed analysis of covariance models for the 'one-step' assessment of conditional QT prolongation. Initially, we consider three different covariance structures for the data, where between-treatment covariance of repeated measures is modelled respectively through random effects, random coefficients, and through a combination of random effects and random coefficients. In all three of those models, an unstructured covariance pattern is used to model within-treatment covariance. In a fourth model, proposed earlier in the literature, between-treatment covariance is modelled through random coefficients but the residuals are assumed to be independent identically distributed (i.i.d.). Finally, we consider a mixed model with saturated covariance structure. We investigate the precision and robustness of those models by fitting them to a large group of real data sets from thorough QT studies. Our findings suggest: (i) Point estimates of treatment contrasts from all five models are similar. (ii) The random coefficients model with i.i.d. residuals is not robust; the model potentially leads to both under- and overestimation of standard errors of treatment contrasts and therefore cannot be recommended for the analysis of conditional QT prolongation. (iii) The combined random effects/random coefficients model does not always converge; in the cases where it converges, its precision is generally inferior to the other models considered. (iv) Both the random effects and the random coefficients model are robust. (v) The random effects, the random coefficients, and the saturated model have similar precision and all three models are suitable for the one-step assessment of conditional QT prolongation.     

Forward Moving Average Representation in Multivariate MA(1) Processes

Forward-moving average coefficients are in general different from their corresponding backward-moving average coefficients in multivariate stationary time series. There is lack of practical methods to derive forward-moving average coefficients from the backward ones. In this article, we establish a new practical approach for obtaining the forward-moving average coefficients for multivariate moving average processes of order one.     

On the estimation of a regression model with fixed and random coefficients

With the recent accent on varying parameter models, theoretical studies have concentrated on estimating equations where all the coefficients are stochastic. This paper analyses an estimation of a single equation in which the coefficients of certain exogenous variables are fixed and those of other exogenous variables are random.     

基于DA插补法的线性回归模型系数估计值的模拟研究

Data Augmentation(DA)插补法是最常用的MCMC多重插补法之一。利用模拟方法研究基于DA插补法的线性回归模型的系数估计值,分析估计值的统计性质受无回答机制、无回答率和插补重数的影响。模拟结果显示:在完全随机无回答机制下,选择较小插补重数常常会得到较好的回归系数估计值;在随机无回答机制下,随着无回答率增大而选择更大插补重数往往会得到更好的回归系数估计值;在非随机无回答机制下,选择更大插补重数并不一定总会得到更好的回归系数估计值。     

Random coefficients regression models. a review 1

A review is given of random regression coefficients models. The emphasis is put on the problem of estimating the mean regression coefficients and the covariance matrix of the coefficients. Prediction of the individual random coefficients is not discussed. The main purpose of the review is to point to the practical aspects of the models and the problem of statistical inference in finite samples. Some problems for future research are indicated.     

A simple approach for varying-coefficient model selection

In varying-coefficient models, an important question is to determine whether some of the varying coefficients are actually invariant coefficients. This article proposes a penalized likelihood method in the framework of the smoothing spline ANOVA models, with a penalty designed toward the goal of automatically distinguishing varying coefficients and those which are not varying. Unlike the stepwise procedure, the method simultaneously quantifies and estimates the coefficients. An efficient algorithm is given and ways of choosing the smoothing parameters are discussed. Simulation results and an analysis on the Boston housing data illustrate the usefulness of the method. The proposed approach is further extended to longitudinal data analysis.     

Penalized least-squares estimation for regression coefficients in high-dimensional partially linear models

We consider a partially linear model with diverging number of groups of parameters in the parametric component. The variable selection and estimation of regression coefficients are achieved simultaneously by using the suitable penalty function for covariates in the parametric component. An MM-type algorithm for estimating parameters without inverting a high-dimensional matrix is proposed. The consistency and sparsity of penalized least-squares estimators of regression coefficients are discussed under the setting of some nonzero regression coefficients with very small values. It is found that the root p_n/n-consistency and sparsity of the penalized least-squares estimators of regression coefficients cannot be given consideration simultaneously when the number of nonzero regression coefficients with very small values is unknown, where p_n and n, respectively, denote the number of regression coefficients and sample size. The finite sample behaviors of penalized least-squares estimators of regression coefficients and the performance of the proposed algorithm are studied by simulation studies and a real data example.     

Analysis of the cross-effects in a cross-lagged panel study

Panel studies are statistical studies in which two or more variables are observed for two or more subjects at two or more points in time. Cross-lagged panel studies are comprised of continuous variables which divide naturally into two sets, and otten the primary statistical issue Is to estimate and test the cross-effects which indicate the degree to which each set is related to the other over time. By taking a regression approach to modeling the relationships, we apply multivariate regression methodology to make inferences about the regression coefficients in a cross-lagged panel model. In particular we develop a test of the hypothesis that the regression coefficients indicating the cross-effects are equal and develop simultaneous confidence bounds for various linear combinations of these regression coefficients.     

On regressing regression coefficients

This paper considers a regression model in which coefficients obtained from a previous regression are themselves the object of analysis. It is shown that the parameters of interest can be obtained in two ways: pooling across observations and subsamples, or a two-stage process of first estimating the coefficients within each subsample, and then using these coefficients as dependent variables in a second stage regression. The relative properties of these estimators are analyzed, and the conditions under which the two estimators are equivalent are derived.     

Bayes Estimates for the Price and Income Elasticities of Alcoholic Beverages in Finland From 1955 to 1980

The Lindley–Smith theory of Bayes estimates for multiple regression equations with exchangeability between the regression coefficients of the individual equations is extended to the case in which a first-order autoregressive process generates the regression coefficients. The ensuing formulas are applied to study monthly Finnish consumption of alcohol. The point of this application is that exchangeability between the regression coefficients is less than we can assess beforehand when there is a natural ordering, in this case according to chronological time, of the equations. Still, the general task of the Lindley–Smith estimators, to consider the combined data when estimating individual regression coefficients, is a relevant one.     

Partially linear single-index model with missing responses at random

This paper considers semiparametric partially linear single-index model with missing responses at random. Imputation approach is developed to estimate the regression coefficients, single-index coefficients and the nonparametric function, respectively. The imputation estimators for the regression coefficients and single-index coefficients are obtained by a stepwise approach. These estimators are shown to be asymptotically normal, and the estimator for the nonparametric function is proved to be asymptotically normal at any fixed point. The bandwidth problem is also considered in this paper, a delete-one cross validation method is used to select the optimal bandwidth. A simulation study is conducted to evaluate the proposed methods.