Asymptotic properties of one-step M-estimators

We study the asymptotic behavior of one-step M-estimators based on not necessarily independent identically distributed observations. In particular, we find conditions for asymptotic normality of these estimators. Asymptotic normality of one-step M-estimators is proven under a wide spectrum of constraints on the exactness of initial estimators. We discuss the question of minimal restrictions on the exactness of initial estimators. We also discuss the asymptotic behavior of the solution to an M-equation closest to the parameter under consideration. As an application, we consider some examples of one-step approximation of quasi-likelihood estimators in nonlinear regression.     

Estimation of entropy-type integral functionals

ABSTRACT

Entropy-type integral functionals of densities are widely used in mathematical statistics, information theory, and computer science. Examples include measures of closeness between distributions (e.g., density power divergence) and uncertainty characteristics for a random variable (e.g., Rényi entropy). In this paper, we study U-statistic estimators for a class of such functionals. The estimators are based on ε-close vector observations in the corresponding independent and identically distributed samples. We prove asymptotic properties of the estimators (consistency and asymptotic normality) under mild integrability and smoothness conditions for the densities. The results can be applied in diverse problems in mathematical statistics and computer science (e.g., distribution identification problems, approximate matching for random databases, two-sample problems).     

Basic structure of the asymptotic theory in dynamic nonlinear econometric models

This is the second of two papers that provide an expository discussion of the basic structure of the asymptotic theory of M-estimators in dynamic nonlinear models and a review of the literature. The first paper, Pötscher and Prucha(1991), deals with consistency. In the present paper we discuss asymptotic normality. As an important ingredient to the asymptotic normality proof in dynamic nonlinear models we consider central limit theorems for dependent random variables. We also discuss the estimation of the variance covariance matrix of m-estimators under heteroscedasticity and autocorrelation.     

Multivariate portmanteau test for structural VARMA models with uncorrelated but non-independent error terms

We consider portmanteau tests for testing the adequacy of structural vector autoregressive moving-average (VARMA) models under the assumption that the errors are uncorrelated but not necessarily independent. The structural forms are mainly used in econometrics to introduce instantaneous relationships between economic variables. We first study the joint distribution of the quasi-maximum likelihood estimator (QMLE) and the noise empirical autocovariances. We then derive the asymptotic distribution of residual empirical autocovariances and autocorrelations under weak assumptions on the noise. We deduce the asymptotic distribution of the Ljung-Box (or Box-Pierce) portmanteau statistics in this framework. It is shown that the asymptotic distribution of the portmanteau tests is that of a weighted sum of independent chi-squared random variables, which can be quite different from the usual chi-squared approximation used under independent and identically distributed (iid) assumptions on the noise. Hence we propose a method to adjust the critical values of the portmanteau tests. Monte Carlo experiments illustrate the finite sample performance of the modified portmanteau test.     

Unbiased tests for some one-sided testing problems

Unbiased tests are found for various testing problems. In the first model considered we test homogeneity of k + 1 independent one-parameter exponential family populations vs. the tree-top ordering alternative. The tree-top alternative is appropriate for one-sided comparisons for treatments with a control. In the next set of models normality is assumed. In one such model k independent populations have different unknown means but have an unknown common variance. An independent estimate of the variance exists. We test homogeneity of means against the alternative of no homogeneity. We also consider the alternative of an ordering of the means as well as the tree-top ordering. The final model considered is when we take a random sample from a multivariate normal population with unknown mean vector and an unknown covariance matrix of the intraclass type. We test the hypothesis that the mean vector is the zero vector against the one-sided alternative that each mean is nonnegative (with at least one positive).     

Asymptotic normality of a conditional hazard function estimate in the single index for quasi-associated data

Abstract

The main goal of this paper is to study the estimation of the conditional hazard function of a scalar response variable Y given a hilbertian random variable X in functional single-index model. We construct an estimator of this nonparametric function and we study its asymptotic properties, under quasi-associated structure. Precisely, we establish the asymptotic normality of the constructed estimator. We carried out simulation experiments to examine the behavior of this asymptotic property over finite sample data.     

Likelihood ratio tests for variance components in linear mixed models

Although the asymptotic distributions of the likelihood ratio for testing hypotheses of null variance components in linear mixed models derived by Stram and Lee [1994. Variance components testing in longitudinal mixed effects model. Biometrics 50, 1171–1177] are valid, their proof is based on the work of Self and Liang [1987. Asymptotic properties of maximum likelihood estimators and likelihood tests under nonstandard conditions. J. Amer. Statist. Assoc. 82, 605–610] which requires identically distributed random variables, an assumption not always valid in longitudinal data problems. We use the less restrictive results of Vu and Zhou [1997. Generalization of likelihood ratio tests under nonstandard conditions. Ann. Statist. 25, 897–916] to prove that the proposed mixture of chi-squared distributions is the actual asymptotic distribution of such likelihood ratios used as test statistics for null variance components in models with one or two random effects. We also consider a limited simulation study to evaluate the appropriateness of the asymptotic distribution of such likelihood ratios in moderately sized samples.     

Estimating the distribution function of symmetric pairs

We discuss three classes of bivariate symmetry models and study the estimation of their distribution functions (DFs). Under radial symmetry, an estimator based on the mean of the empirical and survival DFs is considered. For exchangeable symmetry, an estimator based on the mean of the empirical DF and its exchangeable image is presented. At their intersection, we define radial exchangeability and study estimation of its DF. The symmetrized estimators coincide with the non parametric maximum likelihood estimators of the DF under each model. We obtain their mean and variance and state their asymptotic normality. The relative efficiency of the estimators for the bivariate normal distribution is obtained.     

Two-stage generalized moment method approach for bidimensional random coefficient autoregressive models

ABSTRACT

A two-dimensionally indexed random coefficients autoregressive models (2D ? RCAR) and the corresponding statistical inference are important tools for the analysis of spatial lattice data. The study of such models is motivated by their second-order properties that are similar to those of 2D ? (G)ARCH which play an important role in spatial econometrics. In this article, we study the asymptotic properties of two-stage generalized moment method (2S ? GMM) under general asymptotic framework for 2D ? RCA models. So, the efficiency, strong consistency, the asymptotic normality, and hypothesis tests of 2S ? GMM estimation are derived. A simulation experiment is presented to highlight the theoretical results.     

Counting certain binary strings

Consider a sequence of exchangeable or independent binary (i.e. zero-one) random variables. Numbers of strings with a fixed number of ones between two subsequent zeros are studied under an overlapping enumeration scheme. The respective waiting times are examined as well. Exact probability functions are obtained by means of combinatorial analysis and via recursive schemes in the case of an exchangeable and of an independent sequence, respectively. Explicit formulae for the mean values and variances of the number of strings are provided for both types of the sequences. For a Bernoulli sequence the asymptotic normality of the numbers of strings is established too. Indicative exchangeable and independent sequences, combined with numerical examples, clarify further the theoretical results.     

Linear Models with Doubly Exchangeable Distributed Errors

We study the general linear model (GLM) with doubly exchangeable distributed error for m observed random variables. The doubly exchangeable general linear model (DEGLM) arises when the m-dimensional error vectors are “doubly exchangeable,” jointly normally distributed, which is a much weaker assumption than the independent and identically distributed error vectors as in the case of GLM or classical GLM (CGLM). We estimate the parameters in the model and also find their distributions. We show that the tests of intercept and slope are possible in DEGLM as a particular case using parametric bootstrap as well as multivariate Satterthwaite approximation.     

Estimation and Asymptotic Properties in Periodic GARCH(1, 1) Models

This article studies the probabilistic structure and asymptotic inference of the first-order periodic generalized autoregressive conditional heteroscedasticity (PGARCH(1, 1)) models in which the parameters in volatility process are allowed to switch between different regimes. First, we establish necessary and sufficient conditions for a PGARCH(1, 1) process to have a unique stationary solution (in periodic sense) and for the existence of moments of any order. Second, using the representation of squared PGARCH(1, 1) model as a PARMA(1, 1) model, we then consider Yule-Walker type estimators for the parameters in PGARCH(1, 1) model and derives their consistency and asymptotic normality. The estimator can be surprisingly efficient for quite small numbers of autocorrelations and, in some cases can be more efficient than the least squares estimate (LSE). We use a residual bootstrap to define bootstrap estimators for the Yule-Walker estimates and prove the consistency of this bootstrap method. A set of numerical experiments illustrates the practical relevance of our theoretical results.     

Testing the Goodness of Fit of Parametric Regression Models with Random Toeplitz Forms

ABSTRACT: We introduce a class of Toeplitz‐band matrices for simple goodness of fit tests for parametric regression models. For a given length r of the band matrix the asymptotic optimal solution is derived. Asymptotic normality of the corresponding test statistic is established under a fixed and random design assumption as well as for linear and non‐linear models, respectively. This allows testing at any parametric assumption as well as the computation of confidence intervals for a quadratic measure of discrepancy between the parametric model and the true signal g;. Furthermore, the connection between testing the parametric goodness of fit and estimating the error variance is highlighted. As a by‐product we obtain a much simpler proof of a result of 34 ) concerning the optimality of an estimator for the variance. Our results unify and generalize recent results by 9 ) and 15 , 16 ) in several directions. Extensions to multivariate predictors and unbounded signals are discussed. A simulation study shows that a simple jacknife correction of the proposed test statistics leads to reasonable finite sample approximations.     

A note on asymptotic distributions in directed exponential random graph models with bi-degree sequences

The asymptotic normality of a fixed number of the maximum likelihood estimators (MLEs) in the directed exponential random graph models with an increasing bi-degree sequence has been established recently. In this article, we further derive a central limit theorem for a linear combination of all the MLEs with an increasing dimension. Simulation studies are provided to illustrate the asymptotic results.     

Bridge Estimation for Linear Regression Models with Mixing Properties

Penalized regression methods have for quite some time been a popular choice for addressing challenges in high dimensional data analysis. Despite their popularity, their application to time series data has been limited. This paper concerns bridge penalized methods in a linear regression time series model. We first prove consistency, sparsity and asymptotic normality of bridge estimators under a general mixing model. Next, as a special case of mixing errors, we consider bridge regression with autoregressive and moving average (ARMA) error models and develop a computational algorithm that can simultaneously select important predictors and the orders of ARMA models. Simulated and real data examples demonstrate the effective performance of the proposed algorithm and the improvement over ordinary bridge regression.     

Power periodic threshold GARCH model: Structure and estimation

Abstract

In this paper, we introduce and study the Power Periodic Threshold GARCH Model (PPTGARCH). We give the necessary and sufficient conditions for the existence of the unique strictly periodically stationary solution of the model and the necessary and sufficient conditions for the existence of moments. A sufficient condition for the periodic geometric ergodicity and β – mixing property using the uniform countable additivity condition is given. We prove the consistency and asymptotic normality of the Quasi-Maximum Likelihood estimator (QMLE) of the parameters. Simulation studies to illustrate consistency and asymptotic normality of the estimators for different underlying error distributions are presented.     

On discrete-domain multidimensional sinusoidal models

We consider three-dimensional sinusoidal frequency model in a random field. Three-dimensional frequency model has wide applications in statistical signal processing. In this article, we mainly consider the usual least squares estimators and the estimators that can be obtained by maximizing the periodogram function. We obtain consistency and asymptotic normality property of both the estimators. It is observed that they are asymptotically equivalent. Finally we generalize the results to the multidimensional case.     

Nonnull asymptotic distributions of the LR,Wald, score and gradient statistics in generalized linear models with dispersion covariates

The class of generalized linear models with dispersion covariates, which allows us to jointly model the mean and dispersion parameters, is a natural extension to the classical generalized linear models. In this paper, we derive the asymptotic expansions under a sequence of Pitman alternatives (up to order n ^?1/2) for the nonnull distribution functions of the likelihood ratio, Wald, Rao score and gradient statistics in this class of models. The asymptotic distributions of these statistics are obtained for testing a subset of regression parameters and for testing a subset of dispersion parameters. Based on these nonnull asymptotic expansions, the power of all four tests, which are equivalent to first order, are compared. Furthermore, we consider Monte Carlo simulations in order to compare the finite-sample performance of these tests in this class of models. We present two empirical applications to two real data sets for illustrative purposes.     

Statistical Inference and Applications of Mixture of Varying Coefficient Models

In this paper, we consider a new mixture of varying coefficient models, in which each mixture component follows a varying coefficient model and the mixing proportions and dispersion parameters are also allowed to be unknown smooth functions. We systematically study the identifiability, estimation and inference for the new mixture model. The proposed new mixture model is rather general, encompassing many mixture models as its special cases such as mixtures of linear regression models, mixtures of generalized linear models, mixtures of partially linear models and mixtures of generalized additive models, some of which are new mixture models by themselves and have not been investigated before. The new mixture of varying coefficient model is shown to be identifiable under mild conditions. We develop a local likelihood procedure and a modified expectation–maximization algorithm for the estimation of the unknown non‐parametric functions. Asymptotic normality is established for the proposed estimator. A generalized likelihood ratio test is further developed for testing whether some of the unknown functions are constants. We derive the asymptotic distribution of the proposed generalized likelihood ratio test statistics and prove that the Wilks phenomenon holds. The proposed methodology is illustrated by Monte Carlo simulations and an analysis of a CO₂‐GDP data set.