Improved estimation for Poisson INAR(1) models

We consider the first-order Poisson autoregressive model proposed by McKenzie [Some simple models for discrete variate time series. Water Resour Bull. 1985;21:645–650] and Al-Osh and Alzaid [First-order integer valued autoregressive (INAR(1)) process. J Time Ser Anal. 1987;8:261–275], which may be suitable in situations where the time series data are non-negative and integer valued. We derive the second-order bias of the squared difference estimator [Weiß. Process capability analysis for serially dependent processes of Poisson counts. J Stat Comput Simul. 2012;82:383–404] for one of the parameters and show that this bias can be used to define a bias-reduced estimator. The behaviour of a modified conditional least-squares estimator is also studied. Furthermore, we access the asymptotic properties of the estimators here discussed. We present numerical evidence, based upon Monte Carlo simulation studies, showing that the here proposed bias-adjusted estimator outperforms the other estimators in small samples. We also present an application to a real data set.     

Nonparametric likelihood inference for general autoregressive models

This paper shows how nonparametric likelihood inference for autoregressive models can be based on the family of “empirical” Cressie–Read statistics. The results of the paper apply to possibly nonstationary autoregressive models with innovations that form a martingale difference sequence, and can accommodate multiple and complex unit roots, as well as deterministic components. As an application, the paper considers nonparametric likelihood-based tests for seasonal unit roots and for double unit roots. Monte Carlo evidence seems to suggest that the proposed tests have competitive finite sample properties.     

A new estimator for the unit root

We compare the ordinary least squares, weighted symmetric, modified weighted symmetric (MWS), maximum likelihood, and our new modification for least squares (MLS) estimator for first-order autoregressive in the case of unit root using Monte Carlo method. The Monte Carlo study sheds some light on how well the estimators and the predictors perform on different samples sizes. We found that MLS estimator is less biased and has less mean squared error (MSE) than any other estimators, and MWS predictor error performs well, in the sense of MSE, than any other predictors’ methods. The sample percentiles for the distribution of the τ statistic for the first, second, and third periods in the future, for alternative estimators, are reported to know if it agrees with those of normal distribution or not.     

Some asymptotic properties in INAR(1) processes with Poisson marginals

The first-order integer-valued autoregressive (INAR(1)) process with Poisson marginal distributions is considered. It is shown that the sample autocovariance function of the model is asymptotically normally distributed. We derive asymptotic distribution of Yule-Walker type estimators of parameters. It turns out that our Yule-Walker type estimators are better than the conditional least squares estimators proposed by Klimko and Nelson (1978) and Al-Osh and Alzaid (1987). also, we study the relationship between the model andM/M/∞ queueing system.     

Maximum likelihood estimation in vector autoregressive models with multivariate scaled t-distributed innovations using EM-based algorithms

This article is concerned with the likelihood-based inference of vector autoregressive models with multivariate scaled t-distributed innovations by applying the EM-based (ECM and ECME) algorithms. The ECM and ECME algorithms, which are analytically quite simple to use, are applied to find the maximum likelihood estimates of the model parameters and then compared based on the computational running time and the accuracy of estimation via a simulation study. The results demonstrate that the ECME is efficient and usable in practice. We also show how the method can be applied to a multivariate dataset.     

Asymptotic Results for Spatial ARMA Models

Causal quadrantal-type spatial ARMA(p, q) models with independent and identically distributed innovations are considered. In order to select the orders (p, q) of these models and estimate their autoregressive parameters, estimators of the autoregressive coefficients, derived from the extended Yule–Walker equations are defined. Consistency and asymptotic normality are obtained for these estimators. Then, spatial ARMA model identification is considered and simulation study is given.     

A new class of INAR(1) model for count time series

The present work proposes a new integer valued autoregressive model with Poisson marginal distribution based on the mixing Pegram and dependent Bernoulli thinning operators. Properties of the model are discussed. We consider several methods for estimating the unknown parameters of the model. Also, the classical and Bayesian approaches are used for forecasting. Simulations are performed for the performance of these estimators and forecasting methods. Finally, the analysis of two real data has been presented for illustrative purposes.     

Bayesian analysis of complementary Poisson rate parameters with data subject to misclassification

We formulate closed-form Bayesian estimators for two complementary Poisson rate parameters using double sampling with data subject to misclassification and error free data. We also derive closed-form Bayesian estimators for two misclassification parameters in the modified Poisson model we assume. We use our results to determine credible sets for the rate and misclassification parameters. Additionally, we use MCMC methods to determine Bayesian estimators for three or more rate parameters and the misclassification parameters. We also perform a limited Monte Carlo simulation to examine the characteristics of these estimators. We demonstrate the efficacy of the new Bayesian estimators and highest posterior density regions with examples using two real data sets.     

A new modified Jackknifed estimator for the Poisson regression model

The Poisson regression is very popular in applied researches when analyzing the count data. However, multicollinearity problem arises for the Poisson regression model when the independent variables are highly intercorrelated. Shrinkage estimator is a commonly applied solution to the general problem caused by multicollinearity. Recently, the ridge regression (RR) estimators and some methods for estimating the ridge parameter k in the Poisson regression have been proposed. It has been found that some estimators are better than the commonly used maximum-likelihood (ML) estimator and some other RR estimators. In this study, the modified Jackknifed Poisson ridge regression (MJPR) estimator is proposed to remedy the multicollinearity. A simulation study and a real data example are provided to evaluate the performance of estimators. Both mean-squared error and the percentage relative error are considered as the performance criteria. The simulation study and the real data example results show that the proposed MJPR method outperforms the Poisson ridge regression, Jackknifed Poisson ridge regression and the ML in all of the different situations evaluated in this paper.     

Local Linear Regression for Non Grid Spatiotemporal Models with Autoregressive Errors

In various environmental studies, spatiotemporal correlated data are involved, so there has been increasing demand of proposing spatiotemporal estimation methods that capture spatiotemporal correlation so as to improve the accuracy of estimation. In this article, we construct estimators for non grid spatiotemporal models with autoregressive errors. It is proved that the estimators are asymptotic normality. Simulation results also show the estimators perform well.     

Markov switching model of nonlinear autoregressive with skew-symmetric innovations

We consider data generating structures which can be represented as a Markov switching of nonlinear autoregressive model with considering skew-symmetric innovations such that switching between the states is controlled by a hidden Markov chain. We propose semi-parametric estimators for the nonlinear functions of the proposed model based on a maximum likelihood (ML) approach and study sufficient conditions for geometric ergodicity of the process. Also, an Expectation-Maximization type optimization for obtaining the ML estimators are presented. A simulation study and a real world application are also performed to illustrate and evaluate the proposed methodology.     

A simulation study of least squares and ridge estimaors for normal and nonnormal autocorrelated disturbances

The purpose of this paper is to examine the small sample properties of various ridge estimators along with least squares, in some special settings.Specifically, we consider a first order autoregressive structuure for normal and nonnormal disturbances, and report on a Monte Carlo study the small sample behavior of these estimators according to the criteria of bias and dispersion.The results suggest that under all the examined settings and for all the criteria used the HKB estimator exhibited a superior performance compared to the other estimators, while the LS and LW estimators gave consistently poor results.Also if the error term is only moderately autocorrelated the performance of the ridge estimators that do not account for autocorrelation outperform their counterparts as well as least squares that account for autocorrelation.     

Asymptotic Behavior of Conditional Least Squares Estimators for Unstable Integer‐valued Autoregressive Models of Order 2

In this paper, the asymptotic behavior of the conditional least squares estimators of the autoregressive parameters, of the mean of the innovations, and of the stability parameter for unstable integer‐valued autoregressive processes of order 2 is described. The limit distributions and the scaling factors are different according to the following three cases: (i) decomposable, (ii) indecomposable but not positively regular, and (iii) positively regular models.     

Estimation of a rare sensitive attribute in a stratified sample using Poisson distribution

This study proposes the estimators for the mean and its variance of the number of respondents who possessed a rare sensitive attribute based on stratified sampling schemes (stratified sampling and stratified double sampling). This study deals with the extension of the estimation reported in Land et al. [Estimation of a rare sensitive attribute using Poisson distribution, Statistics (2011), in press. DOI: 10.1080/02331888.2010.524300] using a Poisson distribution and an unrelated question randomized response model reported in Greenberg et al. [The unrelated question randomized response model: Theoretical framework, J. Amer. Statist. Assoc. 64 (1969), 520–539]. In the stratified sampling, the estimators are proposed when the parameter of the rare unrelated attribute is known and unknown. The variances of estimators using a proportional and optimum allocation are also suggested. The proposed estimators are evaluated using a relative efficiency comparing variances of the estimators reported in Land et al. depending on the parameters and the probability of selecting a question. We showed that our proposed methods have better efficiencies than Land et al.’s randomized response model in some conditions. When the sizes of stratified populations are not given, other estimators are suggested using a stratified double sampling. For the proportional allocation, the difference between two variances in the stratified sampling and the stratified double sampling is given with the known rare unrelated attribute.     

Nonlinear semiparametric AR(1) model with skew-symmetric innovations

In this paper, we expand a first-order nonlinear autoregressive (AR) model with skew normal innovations. A semiparametric method is proposed to estimate a nonlinear part of model by using the conditional least squares method for parametric estimation and the nonparametric kernel approach for the AR adjustment estimation. Then computational techniques for parameter estimation are carried out by the maximum likelihood (ML) approach using Expectation-Maximization (EM) type optimization and the explicit iterative form for the ML estimators are obtained. Furthermore, in a simulation study and a real application, the accuracy of the proposed methods is verified.     

Process capability analysis for serially dependent processes of Poisson counts

Process capability indices evaluate the actual compliance of a process with given external specifications in a single number. For the case of a process of independent and identically distributed Poisson counts, two types of index have been proposed and investigated in the literature. The assumption of serial independence, however, is quite unrealistic for practice. We consider the case of an underlying Poisson INAR(1) process which has an AR(1)-like autocorrelation structure. We show that the performance of the estimated indices is degraded heavily if serial dependence is ignored. Therefore, we develop approaches for estimating the process capability (both for the observation and innovation process), which explicitly consider the observed degree of autocorrelation. For this purpose, we introduce a new unbiased estimator of the innovations’ mean of a Poisson INAR(1) process and derive its exact as well as asymptotic stochastic properties. In this context, we also present new explicit expressions for the third- and fourth-order moments of a Poisson INAR(1) process. Then the capability indices and the performance of their estimators are analysed and recommendations for practice are given.     

Bayesian computation for Log-Gaussian Cox processes: a comparative analysis of methods

The Log-Gaussian Cox process is a commonly used model for the analysis of spatial point pattern data. Fitting this model is difficult because of its doubly stochastic property, that is, it is a hierarchical combination of a Poisson process at the first level and a Gaussian process at the second level. Various methods have been proposed to estimate such a process, including traditional likelihood-based approaches as well as Bayesian methods. We focus here on Bayesian methods and several approaches that have been considered for model fitting within this framework, including Hamiltonian Monte Carlo, the Integrated nested Laplace approximation, and Variational Bayes. We consider these approaches and make comparisons with respect to statistical and computational efficiency. These comparisons are made through several simulation studies as well as through two applications, the first examining ecological data and the second involving neuroimaging data.     

Likelihood-Based Inference for Weak Exogeneity in I(2) Cointegrated VAR Models

This article develops limit theory for likelihood analysis of weak exogeneity in I(2) cointegrated vector autoregressive (VAR) models incorporating deterministic terms. Conditions for weak exogeneity in I(2) VAR models are reviewed, and the asymptotic properties of conditional maximum likelihood estimators and a likelihood-based weak exogeneity test are then investigated. It is demonstrated that weak exogeneity in I(2) VAR models allows us to conduct asymptotic conditional inference based on mixed Gaussian distributions. It is then proved that a log-likelihood ratio test statistic for weak exogeneity in I(2) VAR models is asymptotically χ² distributed. The article also presents an empirical illustration of the proposed test for weak exogeneity using Japan's macroeconomic data.     

A comparison of some robust,adaptive, and partially adaptive estimators of regression models

Numerous estimation techniques for regression models have been proposed. These procedures differ in how sample information is used in the estimation procedure. The efficiency of least squares (OLS) estimators implicity assumes normally distributed residuals and is very sensitive to departures from normality, particularly to "outliers" and thick-tailed distributions. Lead absolute deviation (LAD) estimators are less sensitive to outliers and are optimal for laplace random disturbances, but not for normal errors. This paper reports monte carlo comparisons of OLS,LAD, two robust estimators discussed by huber, three partially adaptiveestimators, newey's generalized method of moments estimator, and an adaptive maximum likelihood estimator based on a normal kernal studied by manski. This paper is the first to compare the relative performance of some adaptive robust estimators (partially adaptive and adaptive procedures) with some common nonadaptive robust estimators. The partially adaptive estimators are based on three flxible parametric distributions for the errors. These include the power exponential (Box-Tiao) and generalized t distributions, as well as a distribution for the errors, which is not necessarily symmetric. The adaptive procedures are "fully iterative" rather than one step estimators. The adaptive estimators have desirable large sample properties, but these properties do not necessarily carry over to the small sample case.

The monte carlo comparisons of the alternative estimators are based on four different specifications for the error distribution: a normal, a mixture of normals (or variance-contaminated normal), a bimodal mixture of normals, and a lognormal. Five hundred samples of 50 are used. The adaptive and partially adaptive estimators perform very well relative to the other estimation procedures considered, and preliminary results suggest that in some important cases they can perform much better than OLS with 50 to 80% reductions in standard errors.

     

A BINAR(1) time-series model with cross-correlated COM–Poisson innovations

This article proposes a bivariate integer-valued autoregressive time-series model of order 1 (BINAR(1) with COM–Poisson marginals to analyze a pair of non stationary time series of counts. The interrelation between the series is induced by the correlated innovations, while the non stationarity is captured through a common set of time-dependent covariates that influence the count responses. The regression and dependence effects are estimated using generalized quasi-likelihood (GQL) approach. Simulation experiments are performed to assess the performance of the estimation algorithms. The proposed BINAR(1) process is applied to analyze a real-life series of day and night accidents in Mauritius.