AN EMPIRICAL LIKELIHOOD APPROACH FOR NON‐GAUSSIAN VECTOR STATIONARY PROCESSES AND ITS APPLICATION TO MINIMUM CONTRAST ESTIMATION

We develop the empirical likelihood approach for a class of vector‐valued, not necessarily Gaussian, stationary processes with unknown parameters. In time series analysis, it is known that the Whittle likelihood is one of the most fundamental tools with which to obtain a good estimator of unknown parameters, and that the score functions are asymptotically normal. Motivated by the Whittle likelihood, we apply the empirical likelihood approach to its derivative with respect to unknown parameters. We also consider the empirical likelihood approach to minimum contrast estimation based on a spectral disparity measure, and apply the approach to the derivative of the spectral disparity. This paper provides rigorous proofs on the convergence of our two empirical likelihood ratio statistics to sums of gamma distributions. Because the fitted spectral model may be different from the true spectral structure, the results enable us to construct confidence regions for various important time series parameters without assuming specified spectral structures and the Gaussianity of the process.     

Local Whittle likelihood approach for generalized divergence

There are many approaches in the estimation of spectral density. With regard to parametric approaches, different divergences are proposed in fitting a certain parametric family of spectral densities. Moreover, nonparametric approaches are also quite common considering the situation when we cannot specify the model of process. In this paper, we develop a local Whittle likelihood approach based on a general score function, with some special cases of which, the approach applies to more applications. This paper highlights the effective asymptotics of our general local Whittle estimator, and presents a comparison with other estimators. Additionally, for a special case, we construct the one-step ahead predictor based on the form of the score function. Subsequently, we show that it has a smaller prediction error than the classical exponentially weighted linear predictor. The provided numerical studies show some interesting features of our local Whittle estimator.     

Frequency Domain Tests of Semiparametric Hypotheses for Locally Stationary Processes

Abstract.  Many time series in applied sciences obey a time-varying spectral structure. In this article, we focus on locally stationary processes and develop tests of the hypothesis that the time-varying spectral density has a semiparametric structure, including the interesting case of a time-varying autoregressive moving-average (tvARMA) model. The test introduced is based on a L ₂ -distance measure of a kernel smoothed version of the local periodogram rescaled by the time-varying spectral density of the estimated semiparametric model. The asymptotic distribution of the test statistic under the null hypothesis is derived. As an interesting special case, we focus on the problem of testing for the presence of a tvAR model. A semiparametric bootstrap procedure to approximate more accurately the distribution of the test statistic under the null hypothesis is proposed. Some simulations illustrate the behaviour of our testing methodology in finite sample situations.     

Automatic Local Smoothing for Spectral Density Estimation

This article uses local polynomial techniques to fit Whittle's likelihood for spectral density estimation. Asymptotic sampling properties of the proposed estimators are derived, and adaptation of the proposed estimator to the boundary effect is demonstrated. We show that the Whittle likelihood-based estimator has advantages over the least-squares based log-periodogram. The bandwidth for the Whittle likelihood-based method is chosen by a simple adjustment of a bandwidth selector proposed in Fan & Gijbels (1995). The effectiveness of the proposed procedure is demonstrated by a few simulated and real numerical examples. Our simulation results support the asymptotic theory that the likelihood based spectral density and log-spectral density estimators are the most appealing among their peers     

Temporal Aggregation of Stationary and Non-stationary Continuous-Time Processes

Abstract.  We study the autocorrelation structure of aggregates from a continuous-time process. The underlying continuous-time process or some of its higher derivative is assumed to be a stationary continuous-time auto-regressive fractionally integrated moving-average (CARFIMA) process with Hurst parameter H . We derive closed-form expressions for the limiting autocorrelation function and the normalized spectral density of the aggregates, as the extent of aggregation increases to infinity. The limiting model of the aggregates, after appropriate number of differencing, is shown to be some functional of the standard fractional Brownian motion with the same Hurst parameter of the continuous-time process from which the aggregates are measured. These results are then used to assess the loss of forecasting efficiency due to aggregation.     

Empirical likelihood inference in the presence of measurement error

Suppose that several different imperfect instruments and one perfect instrument are used independently to measure some characteristic of a population. The authors consider the problem of combining this information to make statistical inference on parameters of interest, in particular the population mean and cumulative distribution function. They develop maximum empirical likelihood estimators and study their asymptotic properties. They also present simulation results on the finite sample efficiency of these estimators.     

Asymptotic normality of locally modelled regression estimator for functional data

We focus on the nonparametric regression of a scalar response on a functional explanatory variable. As an alternative to the well-known Nadaraya-Watson estimator for regression function in this framework, the locally modelled regression estimator performs very well [cf. [Barrientos-Marin, J., Ferraty, F., and Vieu, P. (2010), ‘Locally Modelled Regression and Functional Data’, Journal of Nonparametric Statistics, 22, 617–632]. In this paper, the asymptotic properties of locally modelled regression estimator for functional data are considered. The mean-squared convergence as well as asymptotic normality for the estimator are established. We also adapt the empirical likelihood method to construct the point-wise confidence intervals for the regression function and derive the Wilk's phenomenon for the empirical likelihood inference. Furthermore, a simulation study is presented to illustrate our theoretical results.     

Large Deviation Results for Statistics of Short- and Long-memory Gaussian Processes

This paper discusses the large deviation principle of several important statistics for short- and long-memory Gaussian processes. First, large deviation theorems for the log-likelihood ratio and quadratic forms for a short-memory Gaussian process with mean function are proved. Their asymptotics are described by the large deviation rate functions. Since they are complicated, they are numerically evaluated and illustrated using the Maple V system (Char et al ., 1991a,b). Second, the large deviation theorem of the log-likelihood ratio statistic for a long-memory Gaussian process with constant mean is proved. The asymptotics of the long-memory case differ greatly from those of the short-memory case. The maximum likelihood estimator of a spectral parameter for a short-memory Gaussian stationary process is asymptotically efficient in the sense of Bahadur.     

Estimation for Continuous Branching Processes

The maximum-likelihood estimator for the curved exponential family given by continuous branching processes with immigration is investigated. These processes originated from population biology but also model the dynamics of interest rates and development of the state of technology in economics. It is proved that in contrast to branching processes with discrete space and/or time the MLE gives a unified approach to the inference. In order to include singular subdomains of the parameter space we modify the MLE slightly. Consistency and asymptotic normality for the MLE are considered. Concerning the asymptotic theory of the experiments, all three properties LAQ, LAN, and LAMN occur for different submodels     

An Estimation Method of the Pair Potential Function for Gibbs Point Processes on Spheres

An estimation method for pairwise interaction potential of a stationary Gibbs point process is introduced by considering the case of observations located on a sphere. It is based both on Fourier decomposition of the potential and on minimum contrast estimation. It is defined when many independent realizations of the process are available. Consistency and asymptotic normality are proved for the resulting estimators. The method enables derivation of the choice of the potential function by embedded hypotheses testing. The method is applied to independent observations of root locations on internodes around stem of maize roots. The internodes are described as circles and we focus on the interaction function associated with the potential. Since a model with too many components seems to fail, we choose a sequential procedure based on embedded hypotheses testing to build a simpler model.     

Semiparametric Inference for ROC Curves with Censoring

Abstract.  Comparison of two samples can sometimes be conducted on the basis of analysis of receiver operating characteristic (ROC) curves. A variety of methods of point estimation and confidence intervals for ROC curves have been proposed and well studied. We develop smoothed empirical likelihood-based confidence intervals for ROC curves when the samples are censored and generated from semiparametric models. The resulting empirical log-likelihood function is shown to be asymptotically chi-squared. Simulation studies illustrate that the proposed empirical likelihood confidence interval is advantageous over the normal approximation-based confidence interval. A real data set is analysed using the proposed method.     

A density based empirical likelihood approach for testing bivariate normality

Sample entropy based tests, methods of sieves and Grenander estimation type procedures are known to be very efficient tools for assessing normality of underlying data distributions, in one-dimensional nonparametric settings. Recently, it has been shown that the density based empirical likelihood (EL) concept extends and standardizes these methods, presenting a powerful approach for approximating optimal parametric likelihood ratio test statistics, in a distribution-free manner. In this paper, we discuss difficulties related to constructing density based EL ratio techniques for testing bivariate normality and propose a solution regarding this problem. Toward this end, a novel bivariate sample entropy expression is derived and shown to satisfy the known concept related to bivariate histogram density estimations. Monte Carlo results show that the new density based EL ratio tests for bivariate normality behave very well for finite sample sizes. To exemplify the excellent applicability of the proposed approach, we demonstrate a real data example.     

Hidden Second‐order Stationary Spatial Point Processes

In the existing statistical literature, the almost default choice for inference on inhomogeneous point processes is the most well‐known model class for inhomogeneous point processes: reweighted second‐order stationary processes. In particular, the K‐function related to this type of inhomogeneity is presented as the inhomogeneous K‐function. In the present paper, we put a number of inhomogeneous model classes (including the class of reweighted second‐order stationary processes) into the common general framework of hidden second‐order stationary processes, allowing for a transfer of statistical inference procedures for second‐order stationary processes based on summary statistics to each of these model classes for inhomogeneous point processes. In particular, a general method to test the hypothesis that a given point pattern can be ascribed to a specific inhomogeneous model class is developed. Using the new theoretical framework, we reanalyse three inhomogeneous point patterns that have earlier been analysed in the statistical literature and show that the conclusions concerning an appropriate model class must be revised for some of the point patterns.     

The consistency of model selection for dynamic Semi-varying coefficient models with autocorrelated errors

The consistency of model selection criterion BIC has been well and widely studied for many nonlinear regression models. However, few of them had considered models with lag variables as regressors and auto-correlated errors in time series settings, which is common in both linear and nonlinear time series modeling. This paper studies a dynamic semi-varying coefficient model with ARMA errors, using an approach based on spectrum analysis of time series. The consistency property of the proposed model selection criteria is established and an implementation procedure of model selection is proposed for practitioners. Simulation studies have also been conducted to numerically show the consistency property.     

Spectral and circulant approximations to the likelihood for stationary Gaussian random fields

Consider a Gaussian random field model on , observed on a rectangular region. Suppose it is desired to estimate a set of parameters in the covariance function. Spectral and circulant approximations to the likelihood are often used to facilitate estimation of the parameters. The purpose of the paper is to give a careful treatment of the quality of these approximations. A spectral approximation for the likelihood was given by Guyon (Biometrika 69 (1982) 95–105) but without proof. The results given here generalize those of Guyon, and fill in the details of the proof. In addition some matrix results are derived which may be of independent interest. Applications are made to Fisher information and bias calculations for maximum likelihood estimates.     

The Pearson Diffusions: A Class of Statistically Tractable Diffusion Processes

Abstract.  The Pearson diffusions form a flexible class of diffusions defined by having linear drift and quadratic squared diffusion coefficient. It is demonstrated that for this class explicit statistical inference is feasible. A complete model classification is presented for the ergodic Pearson diffusions. The class of stationary distributions equals the full Pearson system of distributions. Well-known instances are the Ornstein–Uhlenbeck processes and the square root (CIR) processes. Also diffusions with heavy-tailed and skew marginals are included. Explicit formulae for the conditional moments and the polynomial eigenfunctions are derived. Explicit optimal martingale estimating functions are found. The discussion covers GMM, quasi-likelihood, non-linear weighted least squares estimation and likelihood inference too. The analytical tractability is inherited by transformed Pearson diffusions, integrated Pearson diffusions, sums of Pearson diffusions and Pearson stochastic volatility models. For the non-Markov models, explicit optimal prediction-based estimating functions are found. The estimators are shown to be consistent and asymptotically normal.     

Inference for Observations of Integrated Diffusion Processes

Abstract.  Estimation of parameters in diffusion models is investigated when the observations are integrals over intervals of the process with respect to some weight function. This type of observations can, for example, be obtained when the process is observed after passage through an electronic filter. Another example is provided by the ice-core data on oxygen isotopes used to investigate paleo-temperatures. Finally, such data play a role in connection with the stochastic volatility models of finance. The integrated process is not a Markov process. Therefore, prediction-based estimating functions are applied to estimate parameters in the underlying diffusion model. The estimators are shown to be consistent and asymptotically normal. The theory developed in the paper also applies to integrals of processes other than diffusions. The method is applied to inference based on integrated data from Ornstein–Uhlenbeck processes and from the Cox–Ingersoll–Ross model, for both of which an explicit optimal estimating function is found.     

Asymptotic distribution of least square estimators for linear models with dependent errors

In this paper, we consider the usual linear regression model in the case where the error process is assumed strictly stationary. We use a result from Hannan (Central limit theorems for time series regression. Probab Theory Relat Fields. 1973;26(2):157–170), who proved a Central Limit Theorem for the usual least squares estimator under general conditions on the design and on the error process. Whatever the design satisfying Hannan's conditions, we define an estimator of the covariance matrix and we prove its consistency under very mild conditions. As an application, we show how to modify the usual tests on the linear model in this dependent context, in such a way that the type-I error rate remains asymptotically correct, and we illustrate the performance of this procedure through different sets of simulations.