Covariance Matrix Formula for Exponential Family Nonlinear Models

This article gives a matrix formula for second-order covariances of maximum likelihood estimators in exponential family nonlinear models, thus generalizing the result of Cordeiro (2004 Cordeiro , G. M. ( 2004 ). Second-order covariance matrix of maximum likelihood estimates in generalized linear models . Statist. Probab. Lett. 66 : 153 – 160 .[Crossref], [Web of Science ®] , [Google Scholar]) valid for generalized linear models with known dispersion parameter. Some simulations show that the second-order covariances for exponential family nonlinear models can be quite pronounced in small to moderate sample sizes.     

Convergence Rate of Strong Consistency of the Maximum Likelihood Estimator in Exponential Family Nonlinear Models

This article proposes some regularity conditions. On the basis of the proposed regularity conditions, we show the strong consistency of the maximum likelihood estimator (MLE) in exponential family nonlinear models (EFNM) and give its convergence rate. In an important case, we obtain the convergence rate O(n ^?1/2(log log n)^1/2)—the rate as that in the Law of the Iterated Logarithm (LIL) for iid partial sums and thus cannot be improved anymore.     

Skewness of maximum likelihood estimators in dispersion models

We introduce the dispersion models with a regression structure to extend the generalized linear models, the exponential family nonlinear models (Cordeiro and Paula, 1989) and the proper dispersion models (Jørgensen, 1997a). We provide a matrix expression for the skewness of the maximum likelihood estimators of the regression parameters in dispersion models. The formula is suitable for computer implementation and can be applied for several important submodels discussed in the literature. Expressions for the skewness of the maximum likelihood estimators of the precision and dispersion parameters are also derived. In particular, our results extend previous formulas obtained by Cordeiro and Cordeiro (2001) and Cavalcanti et al. (2009). A simulation study is performed to show the practice importance of our results.     

Asymptotic Properties of the MLE in Nonlinear Reproductive Dispersion Models With Stochastic Regressors

Nonlinear reproductive dispersion models with stochastic regressors (NRDMWSR) includes generalized linear models with stochastic regressors (Fahrmer and Kaufmann, 1985 Fahrmer , L. , Kaufmann , H. ( 1985 ). Consistency and asymptotic normality of the maximum likelihood estimator in generalized linear models . Ann. Statist. 13 : 342 – 368 . [Google Scholar]) as a special case. This article presents some mild regularity conditions. On the basis of those mild conditions, the existence, strong consistency, and asymptotic normality of maximum likelihood estimator (MLE) are obtained in NRDMWSR.     

SKEWNESS FOR PARAMETERS IN GENERALIZED LINEAR MODELS

In this paper we give an asymptotic formula of order n ^?1/2, where n is the sample size, for the skewness of the distribution of the maximum likelihood estimates of the linear parameters in generalized linear models. The formula is given in matrix notation and is very suitable for computer implementation. Several special cases are discussed. We also give asymptotic formulae for the skewness of the distribution of the maximum likelihood estimates of the dispersion and precision parameters.     

Asymptotic Properties of the Maximum Quasi-Likelihood Estimator in Quasi-Likelihood Nonlinear Models

Quasi-likelihood nonlinear models (QLNM) are a further extension of generalized linear models by only specifying the expectation and variance functions of the response variable. In this article, some mild regularity conditions are proposed. These regularity conditions, respectively, assure the existence, strong consistency, and the asymptotic normality of the maximum quasi-likelihood estimator (MQLE) in QLNM.     

Asymptotic Distribution of the Maximum Likelihood Estimators of the Parameters of the Right-Truncated Dagum Distribution

In this work we have determined the asymptotic distribution of the maximum likelihood estimators of the parameters β, λ, and δ for the right-truncated Dagum model. Some numerical comparisons show that, for each combination of the parameters and for each sample size, the variance of maximum likelihood estimators increases as the truncation point decreases, i.e., with the increase in the cut of the right tail of distribution.     

Third-Order Asymptotic Distributions of Classic Test Statistics for One-Parameter Exponential Family Models

ABSTRACT

In this article we derive third-order asymptotic expansions for the non null distribution functions of four classic statistics under a sequence of local alternatives in one-parameter exponential family models. Our results are quite general and cover a wide range of important distributions.     

Asymptotic study of the change-point mle in multivariate Gaussian families under contiguous alternatives

The problem of estimating an unknown change-point in the mean vector or covariance matrix of a sequence of independent multivariate Gaussian random variables is considered. Adapting the estimation methodology that Hinkley pursued for the case of abrupt changes, we develop theory for deriving the asymptotic distribution of the maximum likelihood estimator of the change-point when the amount of change is a function of the sample size and goes to zero in a smooth fashion as the sample size goes to infinity, yielding a contiguous change-point model. Simulations have been performed to illustrate the closeness of the asymptotic distribution with the empirical distribution, and to evaluate its robustness to departures from normality for reasonable sample sizes as well as parameter changes. Finally, we apply the methodology to estimate the change-point in the daily log-returns data of BLS (BellSouth) and VZ (Verizon) from NYSE.     

Asymptotic Distribution of Robust Estimator for Functional Nonparametric Models

We propose a family of robust nonparametric estimators for regression function based on kernel method. We establish the asymptotic normality of the estimator under the concentration properties on small balls of the probability measure of the functional explanatory variables. Useful applications to prediction, discrimination in a semi-metric space, and confidence curves are given. In addition, to highlight the generality of our purpose and to emphasize the role of each of our hypotheses, several special cases of our general conditions are also discussed. Finally, some numerical study in chemiometrical real data are carried out to compare the sensitivity to outliers between the classical and robust regression.     

Bias Correction in Generalized Nonlinear Models with Dispersion Covariates

We derive general formulae for the second-order biases of maximum likelihood estimates of the parameters in generalized nonlinear models with dispersion covariates. This result generalizes previous work by Botter and Cordeiro (1998 Botter , D. A. , Cordeiro , G. M. ( 1998 ). Improved estimates for generalized linear models with dispersion covariates . J. Statist. Comput. Simul. 62 : 91 – 104 .[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]) and Cordeiro and McCullagh (1991 Cordeiro , G. M. , McCullagh , P. ( 1991 ). Bias correction in generalized linear models . J. Roy Statist. Soc. B 53 : 629 – 643 . [Google Scholar]). The practical use of such bias corrections is illustrated in a simulation study.     

Asymptotic properties of the estimators of the semi-parametric spatial regression model

Spatial data and non parametric methods arise frequently in studies of different areas and it is a common practice to analyze such data with semi-parametric spatial autoregressive (SPSAR) models. We propose the estimations of SPSAR models based on maximum likelihood estimation (MLE) and kernel estimation. The estimation of spatial regression coefficient ρ was done by optimizing the concentrated log-likelihood function with respect to ρ. Furthermore, under appropriate conditions, we derive the limiting distributions of our estimators for both the parametric and non parametric components in the model.     

Bias-Corrected Maximum Likelihood Estimators in Nonlinear Heteroscedastic Models

Nonlinear heteroscedastic models are widely used in econometrics and statistical applications. We derive matrix formulae for the second-order biases of the maximum likelihood estimators of the parameters in the mean and variance response which generalize previous results by Cook et al. (1986 Cook , D. R. , Tsai , C. L. , Wei , B. C. ( 1986 ). Bias in nonlinear regression . Biometrika 73 : 615 – 623 .[Crossref], [Web of Science ®] , [Google Scholar]) and Cordeiro (1993 Cordeiro , G. M. ( 1993 ). Bartlett corrections and bias correction for two heteroscedastic regression models . Commun. Statist. Theor. Meth. 22 : 169 – 188 .[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]). The biases of the estimators are easily obtained as vectors of regression coefficients from suitable weighted linear regressions. The practical use of such biases is illustrated in a simulation study and in an application to a real data set.     

Asymptotic Theory for the QMLE in GARCH-X Models With Stationary and Nonstationary Covariates

This article investigates the asymptotic properties of the Gaussian quasi-maximum-likelihood estimators (QMLE’s) of the GARCH model augmented by including an additional explanatory variable—the so-called GARCH-X model. The additional covariate is allowed to exhibit any degree of persistence as captured by its long-memory parameter d_x; in particular, we allow for both stationary and nonstationary covariates. We show that the QMLE’s of the parameters entering the volatility equation are consistent and mixed-normally distributed in large samples. The convergence rates and limiting distributions of the QMLE’s depend on whether the regressor is stationary or not. However, standard inferential tools for the parameters are robust to the level of persistence of the regressor with t-statistics following standard Normal distributions in large sample irrespective of whether the regressor is stationary or not. Supplementary materials for this article are available online.     

Second-Order Covariance Matrix Formula for Heteroskedastic Generalized Linear Models

For the first time, we provide a matrix formula for second-order covariances of maximum likelihood estimates in heteroskedastic generalized linear models, thus generalizing the results of Cordeiro (2004 Cordeiro , G. M. ( 2004 ). Second-order covariance matrix of maximum likelihood estimates in generalized linear models . Statist. Probab. Lett. 66 : 153 – 160 .[Crossref], [Web of Science ®] , [Google Scholar]) and Cordeiro et al. (2006 Cordeiro , G. M. , Barroso , L. P. , Botter , D. A. (2006). Covariance matrix formula for generalized linear models with unknown dispersion. Commun. Statist. Theor. Meth. 35:113–120.[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]) related to the generalized linear models with known and unknown dispersion parameter, respectively. The covariance matrix formula does not involve cumulants of log-likelihood derivatives and can be easily obtained using simple matrix operations. We apply our main result to a simple model. Some simulations show that the second-order covariances can be quite pronounced in small to moderate samples. The usual covariances of the maximum likelihood estimates can be corrected by these second-order covariances.     

Asymptotic Inference with Incomplete Data

This article discusses asymptotic theory for the maximum likelihood estimator based on incomplete data. Although much literature has implicitly assumed the basic properties of the estimator, such as consistency and asymptotic normality, it is hard to find their precise and comprehensive proofs. In this article, we first show that under MAR an estimator based on the likelihood function ignoring the missing-data mechanism is strongly consistent. The estimator is then shown to be asymptotically normal. When the data are NMAR and when the data are MAR without parameter distinctness, the consistency and the asymptotic normality are shown. Several examples are provided.     

Covariance Matrix Formula for Generalized Linear Models with Unknown Dispersion

In this paper, the existence of the Uniformly Minimum Risk Equivariant (UMRE) estimator of parameters in SURE model under some quadratic losses and matrix losses is studied. The necessary and sufficient conditions for existence of the UMRE estimator of linearly estimable function vectors of regression coefficients under an affine group of transformations are obtained. It is proved that no UMRE estimator of the covariance matrix under any one of two affine groups of transformations exists.     

Estimating Mixing Densities in Exponential Family Models for Discrete Variables

This paper is concerned with estimating a mixing density g using a random sample from the mixture distribution f(x)=∫f x | θ)g(θ)dθ where f(· | θ) is a known discrete exponen tial family of density functions. Recently two techniques for estimating g have been proposed. The first uses Fourier analysis and the method of kernels and the second uses orthogonal polynomials. It is known that the first technique is capable of yielding estimators that achieve (or almost achieve) the minimax convergence rate. We show that this is true for the technique based on orthogonal polynomials as well. The practical implementation of these estimators is also addressed. Computer experiments indicate that the kernel estimators give somewhat disappoint ing finite sample results. However, the orthogonal polynomial estimators appear to do much better. To improve on the finite sample performance of the orthogonal polynomial estimators, a way of estimating the optimal truncation parameter is proposed. The resultant estimators retain the convergence rates of the previous estimators and a Monte Carlo finite sample study reveals that they perform well relative to the ones based on the optimal truncation parameter.