Small Area Estimation via Multivariate Fay–Herriot Models with Latent Spatial Dependence

The Fay–Herriot model is a standard model for direct survey estimators in which the true quantity of interest, the superpopulation mean, is latent and its estimation is improved through the use of auxiliary covariates. In the context of small area estimation, these estimates can be further improved by borrowing strength across spatial regions or by considering multiple outcomes simultaneously. We provide here two formulations to perform small area estimation with Fay–Herriot models that include both multivariate outcomes and latent spatial dependence. We consider two model formulations. In one of these formulations the outcome‐by‐space dependence structure is separable. The other accounts for the cross dependence through the use of a generalized multivariate conditional autoregressive (GMCAR) structure. The GMCAR model is shown, in a state‐level example, to produce smaller mean square prediction errors, relative to equivalent census variables, than the separable model and the state‐of‐the‐art multivariate model with unstructured dependence between outcomes and no spatial dependence. In addition, both the GMCAR and the separable models give smaller mean squared prediction error than the state‐of‐the‐art model when conducting small area estimation on county level data from the American Community Survey.     

Indirect estimation of randomized generalized autoregressive conditional heteroskedastic models

The class of generalized autoregressive conditional heteroskedastic (GARCH) models can be used to describe the volatility with less parameters than autoregressive conditional heteroskedastic (ARCH)-type models, their distributions are heavy-tailed, with time-dependent conditional variance, and are able to model clustering of volatility. Despite all these facts, the way that GARCH models are built imposes limits on the heaviness of the tails of their unconditional distribution. The class of randomized generalized autoregressive conditional heteroskedastic (R-GARCH) models includes the ARCH and GARCH models allowing the use of stable innovations. Estimation methods and empirical analysis of R-GARCH models are the focus of this work. We present the indirect inference method to estimate the R-GARCH models, some simulations and an empirical application.     

A Monte Carlo Markov chain algorithm for a class of mixture time series models

This article generalizes the Monte Carlo Markov Chain (MCMC) algorithm, based on the Gibbs weighted Chinese restaurant (gWCR) process algorithm, for a class of kernel mixture of time series models over the Dirichlet process. This class of models is an extension of Lo’s (Ann. Stat. 12:351–357, 1984) kernel mixture model for independent observations. The kernel represents a known distribution of time series conditional on past time series and both present and past latent variables. The latent variables are independent samples from a Dirichlet process, which is a random discrete (almost surely) distribution. This class of models includes an infinite mixture of autoregressive processes and an infinite mixture of generalized autoregressive conditional heteroskedasticity (GARCH) processes.     

FITTING SPATIAL CORRELATION MODELS: APPROXIMATING A LIKELIHOOD APPROXIMATION

The paper considers a class of spatial correlation models (stationary Gaussian processes) which includes (spatial) conditional autoregressive, simultaneous autoregressive, moving average and direct covariance models. Given observations on a finite rectangular lattice, a likelihood approximation for estimating the parameters in the spectral density of the model is discussed. The approximation consists of applying the trapezoidal rule, with a her grid of frequencies than the usual Fourier frequencies, to compute the integral in an appraximation due to Whittle (1954) and later modified by Guyon (1984). With this approximation, a Fisher scoring type algorithm has a simple form and in some casea reduces to iteratively reweighted least squares. Methods for computing the unbiased two-dimensional periodogram required by the method are presented and the accuracy of the approximation is discussed. The asymptotic distribution of the parameter estimates computed from the likelihood approximation is also given.     

Quantile Regression for Location‐Scale Time Series Models with Conditional Heteroscedasticity

This paper considers quantile regression for a wide class of time series models including autoregressive and moving average (ARMA) models with asymmetric generalized autoregressive conditional heteroscedasticity errors. The classical mean‐variance models are reinterpreted as conditional location‐scale models so that the quantile regression method can be naturally geared into the considered models. The consistency and asymptotic normality of the quantile regression estimator is established in location‐scale time series models under mild conditions. In the application of this result to ARMA‐generalized autoregressive conditional heteroscedasticity models, more primitive conditions are deduced to obtain the asymptotic properties. For illustration, a simulation study and a real data analysis are provided.     

Localizing ruptures in block stochastic systems

Summary In the present paper, rupture detection in a possibly complex stochastic system is enhanced by means of a procedure for localizing the actual rupture among various possible sources. A general model is considered which includes a variety oflinear and non-linear innovation based models. The proposed localizing multiple comparison procedure satisfiescoherence andconsonance and, for a wide class of models, strongly controls the familywise error i.e. the various type I error probabilities involved. The first order autoregressive optimal control model is considered as a popular example. Montecarlo simulations are performed to evaluate asymptotic approximations and diagnostic performances by means of mean time of delay and mean time between false alarms. Some conjectures are then given on the possible structure of these indicators.     

Periodic Autoregressive Conditional Heteroscedasticity

Most high-frequency asset returns exhibit seasonal volatility patterns. This article proposes a new class of models featuring periodicity in conditional heteroscedasticity explicitly designed to capture the repetitive seasonal time variation in the second-order moments. This new class of periodic autoregressive conditional heteroscedasticity, or P-ARCH, models is directly related to the class of periodic autoregressive moving average (ARMA) models for the mean. The implicit relation between periodic generalized ARCH (P-GARCH) structures and time-invariant seasonal weak GARCH processes documents how neglected autoregressive conditional heteroscedastic periodicity may give rise to a loss in forecast efficiency. The importance and magnitude of this informational loss are quantified for a variety of loss functions through the use of Monte Carlo simulation methods. Two empirical examples with daily bilateral Deutschemark/British pound and intraday Deutschemark/U.S. dollar spot exchange rates highlight the practical relevance of the new P-GARCH class of models. Extensions to discrete-time periodic representations of stochastic volatility models subject to time deformation are briefly discussed.     

Beta seasonal autoregressive moving average models

In this paper, we introduce the class of beta seasonal autoregressive moving average (βSARMA) models for modelling and forecasting time series data that assume values in the standard unit interval. It generalizes the class of beta autoregressive moving average models [Rocha AV and Cribari-Neto F. Beta autoregressive moving average models. Test. 2009;18(3):529–545] by incorporating seasonal dynamics to the model dynamic structure. Besides introducing the new class of models, we develop parameter estimation, hypothesis testing inference, and diagnostic analysis tools. We also discuss out-of-sample forecasting. In particular, we provide closed-form expressions for the conditional score vector and for the conditional Fisher information matrix. We also evaluate the finite sample performances of conditional maximum likelihood estimators and white noise tests using Monte Carlo simulations. An empirical application is presented and discussed.     

Constructing First Order Stationary Autoregressive Models via Latent Processes

First order stationary autoregressive (AR(1)) models are introduced for which there exists a linear relation between the expectations of the observations, and where it is readily possible to arrange the marginal distributions to be other than normal.     

A generalization of a Gaussian semiparametric estimator on multivariate long-range dependent processes

In this paper, we propose and study a general class of Gaussian semiparametric estimators (GSE) of the fractional differencing parameter in the context of long-range dependent multivariate time series. We establish large sample properties of the estimator without assuming Gaussianity. The class of models considered here satisfies simple conditions on the spectral density function, restricted to a small neighbourhood of the zero frequency and includes important class of vector autoregressive fractionally integrated moving average processes. We also present a simulation study to assess the finite sample properties of the proposed estimator based on a smoothed version of the GSE which supports its competitiveness.     

Adaptive LASSO for linear regression models with ARMA-GARCH errors

The linear regression models with the autoregressive moving average (ARMA) errors (REGARMA models) are often considered, in order to reflect a serial correlation among observations. In this article, we focus on an adaptive least absolute shrinkage and selection operator (LASSO) (ALASSO) method for the variable selection of the REGARMA models and extend it to the linear regression models with the ARMA-generalized autoregressive conditional heteroskedasticity (ARMA-GARCH) errors (REGARMA-GARCH models). This attempt is an extension of the existing ALASSO method for the linear regression models with the AR errors (REGAR models) proposed by Wang et al. in 2007 Wang, H., Li, G., Tsai, C. (2007). Regression coefficient and autoregressive order shrinkage and selection via the lasso. Journal of the Royal Statistical Society: Series B 69:63–78. [Google Scholar]. New ALASSO algorithms are proposed to determine important predictors for the REGARMA and REGARMA-GARCH models. Finally, we provide the simulation results and real data analysis to illustrate our findings.     

Geometric ergodicity of nonlinear autoregressive models with changing conditional variances

The authors give easy‐to‐check sufficient conditions for the geometric ergodicity and the finiteness of the moments of a random process x_t = ?(x_t‐1,…, x_t‐p) + ?_tσ(x_t‐1,…, x_t‐q) in which ?: R^p → R, σ R^q → R and (?_t) is a sequence of independent and identically distributed random variables. They deduce strong mixing properties for this class of nonlinear autoregressive models with changing conditional variances which includes, among others, the ARCH(p), the AR(p)‐ARCH(p), and the double‐threshold autoregressive models.     

On Shifted Geometric INAR(1) Models Based on Geometric Counting Series

Two types of shifted geometric integer valued autoregressive models of order one (SGINAR(1)) are proposed. Both are based on the thinning operator generated by counting series of i.i.d. geometric random variables. Their correlation properties are derived and compared. Also, regression and conditional variance are considered. Nonparametric estimators of model parameters are obtained and their asymptotic characterizations are given. Finally, these two models are applied to a real-life data set and they are compared to some referent INAR(1) models.     

Nonlinear semiparametric autoregressive model with finite mixtures of scale mixtures of skew normal innovations

We propose data generating structures which can be represented as the nonlinear autoregressive models with single and finite mixtures of scale mixtures of skew normal innovations. This class of models covers symmetric/asymmetric and light/heavy-tailed distributions, so provide a useful generalization of the symmetrical nonlinear autoregressive models. As semiparametric and nonparametric curve estimation are the approaches for exploring the structure of a nonlinear time series data set, in this article the semiparametric estimator for estimating the nonlinear function of the model is investigated based on the conditional least square method and nonparametric kernel approach. Also, an Expectation–Maximization-type algorithm to perform the maximum likelihood (ML) inference of unknown parameters of the model is proposed. Furthermore, some strong and weak consistency of the semiparametric estimator in this class of models are presented. Finally, to illustrate the usefulness of the proposed model, some simulation studies and an application to real data set are considered.     

Estimation of the Spectral Density with Assigned Risk

It is well known that adaptive sequential nonparametric estimation of differentiable functions with assigned mean integrated squared error and minimax expected stopping time is impossible. In other words, no sequential estimator can compete with an oracle estimator that knows how many derivatives an estimated curve has. Differentiable functions are typical in probability density and regression models but not in spectral density models, where considered functions are typically smoother. This paper shows that for a large class of spectral densities, which includes spectral densities of classical autoregressive moving average processes, an adaptive minimax sequential estimation with assigned mean integrated squared error is possible. Furthermore, a two‐stage sequential procedure is proposed, which is minimax and adaptive to smoothness of an underlying spectral density.     

Improved model selection criteria for SETAR time series models

The purpose of this paper is threefold. First, we obtain the asymptotic properties of the modified model selection criteria proposed by Hurvich et al. (1990. Improved estimators of Kullback-Leibler information for autoregressive model selection in small samples. Biometrika 77, 709–719) for autoregressive models. Second, we provide some highlights on the better performance of this modified criteria. Third, we extend the modification introduced by these authors to model selection criteria commonly used in the class of self-exciting threshold autoregressive (SETAR) time series models. We show the improvements of the modified criteria in their finite sample performance. In particular, for small and medium sample size the frequency of selecting the true model improves for the consistent criteria and the root mean square error (RMSE) of prediction improves for the efficient criteria. These results are illustrated via simulation with SETAR models in which we assume that the threshold and the parameters are unknown.     

Practical small sample inference for single lag subset autoregressive models

We propose a method for saddlepoint approximating the distribution of estimators in single lag subset autoregressive models of order one. By viewing the estimator as the root of an appropriate estimating equation, the approach circumvents the difficulty inherent in more standard methods that require an explicit expression for the estimator to be available. Plots of the densities reveal that the distributions of the Burg and maximum likelihood estimators are nearly identical. We show that one possible reason for this is the fact that Burg enjoys the property of estimation equation optimality among a class of estimators expressible as a ratio of quadratic forms in normal random variables, which includes Yule–Walker and least squares. By inverting a two-sided hypothesis test, we show how small sample confidence intervals for the parameters can be constructed from the saddlepoint approximations. Simulation studies reveal that the resulting intervals generally outperform traditional ones based on asymptotics and have good robustness properties with respect to heavy-tailed and skewed innovations. The applicability of the models is illustrated by analyzing a longitudinal data set in a novel manner.     

Inference for linear and nonlinear stable error processes via estimating functions

This paper describes an estimating function approach for parameter estimation in linear and nonlinear times series models with infinite variance stable errors. Joint estimates of location and scale parameters are derived for classes of autoregressive (AR) models and random coefficient autoregressive (RCA) models with stable errors, as well as for AR models with stable autoregressive conditionally heteroscedastic (ARCH) errors. Fast, on-line, recursive parametric estimation for the location parameter based on estimating functions is discussed using simulation studies. A real financial time series is also discussed in some detail.     

Seasonality of hospitalizations due to respiratory diseases: modelling serial correlation all we need is Poisson

The identification of seasonality and trend patterns of the weekly number of hospitalizations may be useful to plan the structure of health care and the vaccination calendar. A generalized additive model with the negative binomial distribution and a generalized additive model with autoregressive terms (GAMAR) and Poisson distribution are fitted including seasonal parameters and nonlinear trend using splines. The GAMAR includes autoregressive terms to take into account the serial correlation, yielding correct standard errors and reducing overdispersion. For the number of hospitalizations of people older than 60 years due to respiratory diseases in São Paulo city, both models present similar estimates but the Poisson-GAMAR presents uncorrelated residuals, no overdispersion and provides smaller confidence intervals for the weekly percentage changes. Forecasts for the next year based on both models are obtained by simulation and the Poisson-GAMAR presented better performance.