Asymptotic cumulants of the minimum phi-divergence estimator for categorical data under possible model misspecification

Abstract

The asymptotic cumulants of the minimum phi-divergence estimators of the parameters in a model for categorical data are obtained up to the fourth order with the higher-order asymptotic variance under possible model misspecification. The corresponding asymptotic cumulants up to the third order for the studentized minimum phi-divergence estimator are also derived. These asymptotic cumulants, when a model is misspecified, depend on the form of the phi-divergence. Numerical illustrations with simulations are given for typical cases of the phi-divergence, where the maximum likelihood estimator does not necessarily give best results. Real data examples are shown using log-linear models for contingency tables.     

Higher Order Asymptotic Cumulants of Studentized Estimators in Covariance Structures

In covariance structure analysis, the Studentized pivotal statistic of a parameter estimator is often used since the statistic is asymptotically normally distributed with mean zero and unit variance. For more accurate asymptotic distribution, the first and third asymptotic cumulants can be used to have the single-term Edgeworth, Cornish-Fisher, and Hall type asymptotic expansions. In this paper, the higher order asymptotic variance and the fourth asymptotic cumulant of the statistic are obtained under nonnormality when the partial derivatives of a parameter estimator with respect to sample variances and covariances up to the third order and the moments of the associated observed variables up to the eighth order are available. The result can be used to have the two-term Edgeworth expansion. Simulations are performed to see the accuracy of the asymptotic results in finite samples.     

Estimation of product moments of a stationary stochastic process with application to estimation of cumulants and cumulant spectral densities

Inference concerning the structure of stationary stochastic processes can be investigated by looking at properties of various cumulant spectral densities of order two and higher. However, except for cases when cumulants and product moments are identical, estimation of higher-order cumulant spectral densities has been restricted by the dependence of higher-order cumulants on lower-order product moments. By first estimating product moments and then using an identity between product moments and cumulants, asymptotically unbiased and consistent estimates of cumulants are obtained. This in turn leads to asymptotically unbiased and consistent estimators of higher-order cumulant spectral densities. In addition, asymptotic normality of product-moment estimators is exhibited under weak dependence.     

Parametric Inference in Stationary Time Series Models with Dependent Errors

This article is concerned with inference for the parameter vector in stationary time series models based on the frequency domain maximum likelihood estimator. The traditional method consistently estimates the asymptotic covariance matrix of the parameter estimator and usually assumes the independence of the innovation process. For dependent innovations, the asymptotic covariance matrix of the estimator depends on the fourth‐order cumulants of the unobserved innovation process, a consistent estimation of which is a difficult task. In this article, we propose a novel self‐normalization‐based approach to constructing a confidence region for the parameter vector in such models. The proposed procedure involves no smoothing parameter, and is widely applicable to a large class of long/short memory time series models with weakly dependent innovations. In simulation studies, we demonstrate favourable finite sample performance of our method in comparison with the traditional method and a residual block bootstrap approach.     

Asymptotic Expansion and Conditional Robustness for the Sample Multiple Correlation Coefficient Under Nonnormality

ABSTRACT

Asymptotic distributions of the standardized estimators of the squared and non squared multiple correlation coefficients under nonnormality were obtained using Edgeworth expansion up to O(1/n). Conditions for the normal-theory asymptotic biases and variances to hold under nonnormality were derived with respect to the parameter values and the weighted sum of the cumulants of associated variables. The condition for the cumulants indicates a compensatory effect to yield the robust normal-theory lower-order cumulants. Simulations were performed to see the usefulness of the formulas of the asymptotic expansions using the model with the asymptotic robustness under nonnormality, which showed that the approximations by Edgeworth expansions were satisfactory.     

An estimator for the scale parameter of the two parameter weibull distribution for type i singly right-censored data

For type I censoring, in addition to the failure times, the number failures is also observed as part of the data. Using this feature of type I singly right-censored data a simple estimator is obtained for the scale parameter of the two parameter Weibull distribution. The exact mean and variance of the estimator are derived and computed for finite sample sizes. Its limiting properties such as asymptotic normality and asymptotic relative efficiency are obtained. The estimator has high efficiency for moderate and heavy censoring. Its use is illustrated by means of an example.     

Estimation of Pr( x<y ) in the exponential case with common location parameter

This paper considers the problem of estimating the probability P = Pr(X < Y) when X and Y are independent exponential random variables with unequal scale parameters and a common location parameter. Uniformly minimum variance unbiased estimator of P is obtained. The asymptotic distribution of the maximum likelihood estimator is obtained and then the asymptotic equivalence of the two estimators is established. Performance of the two estimators for moderate sample sizes is studied by Monte Carlo simulation. An approximate interval estimator is also obtained.     

Some asymptotic results in the multivariate lognormal estimation theory

An asymptotic expansion of the variance of the uniformly minimum variance unbiased estimator of a class of parameters of the multivariate lognormal distribution is considered. It is obtained by some calculations of the zonal polynomials. Then it is compared with an asymptotic mean square error of the maximum likelihood estimator of the same parameter.     

On periodic time-varying bilinear processes: structure and asymptotic inference

This paper is devoted to the bilinear time series models with periodic-varying coefficients \(\left( { PBL}\right) \). So, firstly conditions ensuring the existence of periodic stationary solutions of the \({ PBL}\) and the existence of higher-order moments of such solutions are given. A distribution free approach to the parameter estimation of \({ PBL}\) is presented. The proposed method relies on minimum distance estimator based on the first and second order empirical moments of the observed process. Consistency and asymptotic normality of the estimator are discussed. Examples and Monte Carlo simulation results illustrate the practical relevancy of our general theoretical results are presented.     

Rank estimation of regression coefficients using iterated reweighted least squares

This paper is concerned with the rank estimator for the parameter vector β in a linear model which is obtained by the minimization of a rank dispersion function. The rank estimator has many advantages over the regular least squares estimator, but the inaccessibility of software to carry out its computation has limited its use. An iterated reweighted least squares algorithm is presented for the computation of the rank estimator. The method is simple in concept and can be carried out readily with a wide variety of statistical software. Details of the method are discussed along with some results on its asymptotic distribution and numerical stability. Some examples are presented to show advantages of the rank method.     

The LAD estimation of the change-point linear model with randomly censored data

Abstract

In this paper, a change-point linear model with randomly censored data is investigated. We propose the least absolute deviation estimation procedure for regression and change-point parameters simultaneously. The asymptotic properties of the change-point and regression parameter estimators are obtained. We show that the resulting regression parameter estimator is asymptotically normal, and the change-point estimator converges weakly to the minimizer of a given random process. The extensive simulation studies and the analysis of an acute myocardial infarction data set are conducted to illustrate the finite sample performance of the proposed method.     

Approximate Studentization with marginal and conditional inference

Many inference problems lead naturally to a marginal or conditional measure of departure that depends on a nuisance parameter. As a device for first-order elimination of the nuisance parameter, we suggest averaging with respect to an exact or approximate confidence distribution function. It is shown that for many standard problems where an exact answer is available by other methods, the averaging method reproduces the exact answer. Moreover, for the gamma-mean problem, where the exact answer is not explicitly available, the averaging method gives results that agree closely with those obtained from higher-order asymptotic methods. Examples are discussed; detailed asymptotic calculations will be examined elsewhere.     

Binomial AR(1) processes: moments,cumulants, and estimation

The modelling and analysis of count-data time series are areas of emerging interest with various applications in practice. We consider the particular case of the binomial AR(1) model, which is well suited for describing binomial counts with a first-order autoregressive serial dependence structure. We derive explicit expressions for the joint (central) moments and cumulants up to order 4. Then, we apply these results for expressing moments and asymptotic distribution of the squared difference estimator as an alternative to the sample autocovariance. We also analyse the asymptotic distribution of the conditional least-squares estimators of the parameters of the binomial AR(1) model. The finite-sample performance of these estimators is investigated in a simulation study, and we apply them to real data about computerized workstations.     

Robust Estimation of Moments in Dynamic Panel Models with Potential Intercorrelation

In this article, we provide some robust estimation of moments of the random effects and the errors in dynamic panel data models with potential intercorrelation. By differencing the residuals over the individual and time indies, we modify the popularly used Arellano-Bond GMM estimator of the parameter coefficient and study its asymptotic properties. Based on the modified parameter estimator, we construct, respectively, some moment estimators of the random effects and the errors with no affecting each other. Their asymptotic normalities are obtained under some mild conditions. The finite sample properties are investigated by a small Monte Carlo simulation experiment.     

Estimation of regression parameters in generalized linear models for cluster correlated data with measurement error

Liang and Zeger (1986) introduced a class of estimating equations that gives consistent estimates of regression parameters and of their asymptotic variances in the class of generalized linear models for cluster correlated data. When the independent variables or covariates in such models are subject to measurement errors, the parameter estimates obtained from these estimating equations are no longer consistent. To correct for the effect of measurement errors, an estimator with smaller asymptotic bias is constructed along the lines of Stefanski (1985), assuming that the measurement error variance is either known or estimable. The asymptotic distribution of the bias-corrected estimator and a consistent estimator of its asymptotic variance are also given. The special case of a binary logistic regression model is studied in detail. For this case, methods based on conditional scores and quasilikelihood are also extended to cluster correlated data. Results of a small simulation study on the performance of the proposed estimators and associated tests of hypotheses are reported.     

On the statistical inference of a machine-generated autoregressive AR(1) model

We have obtained the asymptotic bias and the limiting distribution for the Yule–Walker estimator of the autoregressive parameter under a considerably weaker assumption than that of independence in the noise sequence. Among other things, these suggest robustness of the classical results and throw some light on the use of simulations based on pseudorandom numbers in verifying these results.     

Practical Point Estimation from Higher-Order Pivots

Point estimators for a scalar parameter of interest in the presence of nuisance parameters can be defined as zero-level confidence intervals as explained in Skovgaard (1989). A natural implementation of this approach is based on estimating equations obtained from higher-order pivots for the parameter of interest. In this paper, generalising the results in Pace and Salvan (1999) outside exponential families, we take as an estimating function the modified directed likelihood. This is a higher-order pivotal quantity that can be easily computed in practice for a wide range of models, using recent advances in higher-order asymptotics (HOA, 2000). The estimators obtained from these estimating equations are a refinement of the maximum likelihood estimators, improving their small sample properties and keeping equivariance under reparameterisation. Simple explicit approximate versions of these estimators are also derived and have the form of the maximum likelihood estimator plus a function of derivatives of the loglikelihood function. Some examples and simulation studies are discussed for widely-used model classes.     

Robust estimation of dynamic fixed-effects panel data models

This paper extends an existing outlier-robust estimator of linear dynamic panel data models with fixed effects, which is based on the median ratio of two consecutive pairs of first-order differenced data. To improve its precision and robustness properties, a general procedure based on higher-order pairwise differences and their ratios is designed. The asymptotic distribution of this class of estimators is derived. Further, the breakdown point properties are obtained under contamination by independent additive outliers and by the patches of additive outliers, and are used to select the pairwise differences that do not compromise the robustness properties of the procedure. The proposed estimator is additionally compared with existing methods by means of Monte Carlo simulations.     

Sequential estimation for semiparametric models with application to the proportional hazards model

In this paper, we show that if the Euclidean parameter of a semiparametric model can be estimated through an estimating function, we can extend straightforwardly conditions by Dmitrienko and Govindarajulu [2000. Ann. Statist. 28 (5), 1472–1501] in order to prove that the estimator indexed by any regular sequence (sequential estimator), has the same asymptotic behavior as the non-sequential estimator. These conditions also allow us to obtain the asymptotic normality of the stopping rule, for the special case of sequential confidence sets. These results are applied to the proportional hazards model, for which we show that after slight modifications, the classical assumptions given by Andersen and Gill [1982. Ann. Statist. 10(4), 1100–1120] are sufficient to obtain the asymptotic behavior of the sequential version of the well-known [Cox, 1972. J. Roy. Statist. Soc. Ser. B (34), 187–220] partial maximum likelihood estimator. To prove this result we need to establish a strong convergence result for the regression parameter estimator, involving mainly exponential inequalities for both continuous martingales and some basic empirical processes. A typical example of a fixed-width confidence interval is given and illustrated by a Monte Carlo study.     

Approximate distribution and test of fit for the clustering effect in the dirichlet multinomial model

The Dirichlet-multinomial model is considered as a model for cluster sampling. The model assumes that the design's covariance matrix is a constant times the covariance under multinomial sampling. The use of this model requires estimating a parameter C, that measures the clustering effect. In this paper, a regression estimate for C is obtained. An approximate distribution of this estimator is obtained through the use of asymptotic techniques. A goodness of fit statistic for testing the fit of the Dirichlet Multinomial model is also obtained, based on those asymptotic techniques. These statistics provide a means of knowing when the data satisfy the model assumption. These results are used to analyze data concerning the authorship of Greek prose.