On minimum Lp-distance estimation for inhomogeneous Poisson processes

ABSTRACT

We consider the problem of parameter estimation by the observations of the inhomogeneous Poisson processes. We suppose that the intensity function of these processes is a smooth function of the unknown parameter and as a method of estimation we take the minimum distance approach. We are interested by the behavior of estimators in non Hilbertian situation and we define the minimum distance estimation (MDE) with the help of the L^p metrics. We show that (under regularity conditions) the MDE is consistent and we describe its limit distribution.     

Inference on the asymptotic behavior of covariance operator of first-order periodically correlated autoregressive Hilbertian processes

This paper is devoted to a study on the structure of tensorial products of periodically correlated autoregressive (PCAR) processes with values in separable Hilbert spaces. It will be demonstrated that the resulting processes are PCAR with values in the space of Hilbert–Schmidt operators. These processes are applied while studying the convergence rate, limiting behavior and asymptotic distribution of the empirical estimators of the covariance operators of PCAR processes.     

On the estimation of serial correlation in Markov-dependent production processes

In this paper, we present a study about the estimation of the serial correlation for Markov chain models which is used often in the quality control of autocorrelated processes. Two estimators, non-parametric and multinomial, for the correlation coefficient are discussed. They are compared with the maximum likelihood estimator [U.N. Bhat and R. Lal, Attribute control charts for Markov dependent production process, IIE Trans. 22 (2) (1990), pp. 181–188.] by using some theoretical facts and the Monte Carlo simulation under several scenarios that consider large and small correlations as well a range of fractions (p) of non-conforming items. The theoretical results show that for any value of p≠0.5 and processes with autocorrelation higher than 0.5, the multinomial is more precise than maximum likelihood. However, the maximum likelihood is better when the autocorrelation is smaller than 0.5. The estimators are similar for p=0.5. Considering the average of all simulated scenarios, the multinomial estimator presented lower mean error values and higher precision, being, therefore, an alternative to estimate the serial correlation. The performance of the non-parametric estimator was reasonable only for correlation higher than 0.5, with some improvement for p=0.5.     

Efficiency of least squares estimators in the presence of spatial autocorrelation

The effect of spatial autocorrelation on inferences made using ordinary least squares estimation is considered. It is found, in some cases, that ordinary least squares estimators provide a reasonable alternative to the estimated generalized least squares estimators recommended in the spatial statistics literature. One of the most serious problems in using ordinary least squares is that the usual variance estimators are severely biased when the errors are correlated. An alternative variance estimator that adjusts for any observed correlation is proposed. The need to take autocorrelation into account in variance estimation negates much of the advantage that ordinary least squares estimation has in terms of computational simplicity     

Preliminary Estimation in Gaussian Stationary Processes

Preliminary estimation of the kth Lag autocorrelation function in the Gaussian stationary processes is considered. An estimation procedure is derived from the ratio of the sum filter and the difference filter. The performance of this estimator is compared to the sample estimator through a Monte Carlo study.     

Maximum likelihood estimation for reflected Ornstein-Uhlenbeck processes

In this paper, we investigate the maximum likelihood estimation for the reflected Ornstein-Uhlenbeck (ROU) processes based on continuous observations. Both the cases with one-sided barrier and two-sided barriers are considered. We derive the explicit formulas for the estimators, and then prove their strong consistency and asymptotic normality. Moreover, the bias and mean square errors are represented in terms of the solutions to some PDEs with homogeneous Neumann boundary conditions. We also illustrate the asymptotic behavior of the estimators through a simulation study.     

Parameter estimation for switched counting processes

The paper investigates parameter estimation problems in special Markov modulated counting processes. The events occuring at any state of an underlying Markov chain can be equipped with marks performing additional information on the events. Specifying the model to the case of two-state Markov chain modulation, the so-called switched counting process, some statistical problems are studied:maximum likelihood estimators, Rao-Blackwell optimal estimators, test of equality of the counting intensities of the two states and minimax estimation procedures. Tne consideration could be applied in various practical problems, in particular, in queueing and in reliability models, for example in failure-repair processes with alternatively operating repair systems.     

Parametric estimation for ARFIMA models via spectral methods

Given a fractional integrated, autoregressive, moving average,ARFIMA (p, d, q) process, the simultaneous estimation of the short and long memory parameters can be achieved by maximum likelihood estimators. In this paper, following a two-step algorithm, the coefficients are estimated combining the maximum likelihood estimators with the general orthogonal decomposition of stochastic processes. In particular, the principal component analysis of stochastic processes is exploited to estimate the short memory parameters, which are plugged into the maximum likelihood function to obtain the fractional differencingd.     

Estimation for a first-order bifurcating autoregressive process with heavy-tail innovations

Asymptotics of an alternative extreme-value estimator for the autocorrelation parameter in a first-order bifurcating autoregressive (BAR) process with non-gaussian innovations are derived. This contrasts with traditional estimators whose asymptotic behavior depends on the central part of the innovation distribution. Within any BAR model, the main concern is addressing the complex dependency between generations. The inability of traditional methods to handle this dependency motivated an alternative procedure. With the combination of an extreme-value approach and a clever blocking argument, the dependency issue within the BAR process was resolved, which in turn allowed us to derive the limiting distribution for the proposed estimator through the use of regular variation and non-stationary point processes. Finally, the implications of our extreme-value approach are discussed with an extensive simulation study that not only assesses the reliability of our proposed estimate but also presents the findings for a new estimator of an unknown location parameter θ and its implications.     

Innovative methods for modeling of scale invariant processes

This paper presents some innovative methods for modeling discrete scale invariant (DSI) processes and evaluation of corresponding parameters. For the case where the absolute values of the increments of DSI processes are in general increasing, we consider some moving sample variance of the increments and present some heuristic algorithm to characterize successive scale intervals. This enables us to estimate scale parameter of such DSI processes. To present some superior structure for the modeling of DSI processes, we consider the possibility that the variations inside the prescribed scale intervals show some further self-similar behavior. Such consideration enables us to provide more efficient estimators for Hurst parameters. We also present two competitive estimation methods for the Hurst parameters of self-similar processes with stationary increments and prove their efficiency. Using simulated samples of some simple fractional Brownian motion, we show that our estimators of Hurst parameter are more efficient as compared with the celebrated methods of convex rearrangement and quadratic variation. Finally we apply the proposed methods to evaluate DSI behavior of the S&P500 indices in some period.     

Computation of the exact likelihood function of an arima process

Acceptance of Arima processes as valuable univariate forecasting mechanisms is increasing. Maximum likelihood estimation of parameters is complicated, and least squares approximations are not always satisfactory. The singular vaiue decomposition is used here to determine numericaily accurate values of the likelihood function for a given set of parameter estimates. Suggestions for efficient computational search procedures of maximum likelihood estimators are made.     

A new method of edge correction for estimating the nearest neighbor distribution

Analysis of data in the form of a set of points irregularly distributed within a region of space usually involves the study of some property of the distribution of inter-event distances. One such function is G, the distribution of the distance from an event to its nearest neighbor. In practice, point processes are commonly observed through a bounded window, thus making edge effects an important component in the estimation of G. Several estimators have been proposed, all dealing with the edge effect problem in different ways. This paper proposes a new alternative for estimating the nearest neighbor distribution and compares it to other estimators. The result is an estimator with relatively small mean squared error for a wide variety of stationary processes.     

MOMENT ESTIMATION IN THE CLASS OF BISEXUAL BRANCHING PROCESSES WITH POPULATION–SIZE DEPENDENT MATING

This paper concerns the estimation of the offspring mean vector, the covariance matrix and the growth rate in the class of bisexual branching processes with population‐size dependent mating. For the proposed estimators, some unconditional moments and some conditioned to non‐extinction are determined and asymptotic properties are established. Confidence intervals are obtained and, as illustration, a simulation example is given.     

Heteroscedasticity-robust estimation of autocorrelation

This paper proposes estimators of the first-order autocorrelation that are based on suitably transformed ratios of successive observations. The new estimators are given by simple functions of the observations. Numerical optimization is not required. Simulations show that they are highly robust against extreme values and clusters of high volatility and are therefore particularly useful for the estimation of serial correlation in return series. Besides, the results of the simulation study also call into question the common practice of correcting the small-sample bias of conventional estimators.     

Theory & Methods: Krige,Smooth, Both or Neither?

Both kriging and non-parametric regression smoothing can model a non-stationary regression function with spatially correlated errors. However comparisons have mainly been based on ordinary kriging and smoothing with uncorrelated errors. Ordinary kriging attributes smoothness of the response to spatial autocorrelation whereas non-parametric regression attributes trends to a smooth regression function. For spatial processes it is reasonable to suppose that the response is due to both trend and autocorrelation. This paper reviews methodology for non-parametric regression with autocorrelated errors which is a natural compromise between the two methods. Re-analysis of the one-dimensional stationary spatial data of Laslett (1994) and a clearly non-stationary time series demonstrates the rather surprising result that for these data, ordinary kriging outperforms more computationally intensive models including both universal kriging and correlated splines for spatial prediction. For estimating the regression function, non-parametric regression provides adaptive estimation, but the autocorrelation must be accounted for in selecting the smoothing parameter.     

The Scale Invariant Wigner Spectrum Estimation of Gaussian Locally Self-Similar Processes

We study locally self-similar processes (LSSPs) in Silverman’s sense. By deriving the minimum mean-square optimal kernel within Cohen’s class counterpart of time–frequency representations, we obtain an optimal estimation for the scale invariant Wigner spectrum (SIWS) of Gaussian LSSPs. The class of estimators is completely characterized in terms of kernels, so the optimal kernel minimizes the mean-square error of the estimation. We obtain the SIWS estimation for two cases: global and local, where in the local case, the kernel is allowed to vary with time and frequency. We also introduce two generalizations of LSSPs: the locally self-similar chirp process and the multicomponent LSSP, and obtain their optimal kernels. Finally, the performance and accuracy of the estimation is studied via simulation.     

Efficiency and Validity Analyses of Two-Stage Estimation Procedures and Derived Testing Procedures in Quantitative Linear Models with AR(1) Errors

Abstract

In a quantitative linear model with errors following a stationary Gaussian, first-order autoregressive or AR(1) process, Generalized Least Squares (GLS) on raw data and Ordinary Least Squares (OLS) on prewhitened data are efficient methods of estimation of the slope parameters when the autocorrelation parameter of the error AR(1) process, ρ, is known. In practice, ρ is generally unknown. In the so-called two-stage estimation procedures, ρ is then estimated first before using the estimate of ρ to transform the data and estimate the slope parameters by OLS on the transformed data. Different estimators of ρ have been considered in previous studies. In this article, we study nine two-stage estimation procedures for their efficiency in estimating the slope parameters. Six of them (i.e., three noniterative, three iterative) are based on three estimators of ρ that have been considered previously. Two more (i.e., one noniterative, one iterative) are based on a new estimator of ρ that we propose: it is provided by the sample autocorrelation coefficient of the OLS residuals at lag 1, denoted r(1). Lastly, REstricted Maximum Likelihood (REML) represents a different type of two-stage estimation procedure whose efficiency has not been compared to the others yet. We also study the validity of the testing procedures derived from GLS and the nine two-stage estimation procedures. Efficiency and validity are analyzed in a Monte Carlo study. Three types of explanatory variable x in a simple quantitative linear model with AR(1) errors are considered in the time domain: Case 1, x is fixed; Case 2, x is purely random; and Case 3, x follows an AR(1) process with the same autocorrelation parameter value as the error AR(1) process. In a preliminary step, the number of inadmissible estimates and the efficiency of the different estimators of ρ are compared empirically, whereas their approximate expected value in finite samples and their asymptotic variance are derived theoretically. Thereafter, the efficiency of the estimation procedures and the validity of the derived testing procedures are discussed in terms of the sample size and the magnitude and sign of ρ. The noniterative two-stage estimation procedure based on the new estimator of ρ is shown to be more efficient for moderate values of ρ at small sample sizes. With the exception of small sample sizes, REML and its derived F-test perform the best overall. The asymptotic equivalence of two-stage estimation procedures, besides REML, is observed empirically. Differences related to the nature, fixed or random (uncorrelated or autocorrelated), of the explanatory variable are also discussed.     

Nonparametric regression for dependent data in the errors-in-variables problem

We consider the nonparametric estimation of the regression functions for dependent data. Suppose that the covariates are observed with additive errors in the data and we employ nonparametric deconvolution kernel techniques to estimate the regression functions in this paper. We investigate how the strength of time dependence affects the asymptotic properties of the local constant and linear estimators. We treat both short-range dependent and long-range dependent linear processes in a unified way and demonstrate that the long-range dependence (LRD) of the covariates affects the asymptotic properties of the nonparametric estimators as well as the LRD of regression errors does.     

First order autoregressive time series with negative binomial and geometric marginals

In this paper we present first order autoregressive (AR(1)) time series with negative binomial and geometric marginals. These processes are the discrete analogues of the gamma and exponential processes introduced by Sim (1990). Many properties of the processes discussed here, such as autocorrelation, regression and joint distributions, are studied.     

The small sample performance of some limited information estimators of a dynamic structural equation with autocorrelated errors †

This paper examines the small sample properties of the following seven estimators of a dynamic structural equation with autocorrelated errors: (1) 2SLS; (2) Fair’s modification of Sargan’s 2SLS; (3) the Dhrymes, Berner and Cummins (1974) variant of 2SLS; (4) a modified Theil's (1958) generalized 2SLS; (5) three two-step estimators proposed by Hatanaka (1976). Our principal results are that for low degrees of autocorrelation 2SLS performs well whereas for high degrees of autocorrelation the Theil and Dhrymes estimators are best with two of Hatanaka’s estimators close behind. The Fair and the remaining Hatanaka estimator are always dominated by the others. This is of some practical interest because the Fair estimator is a standard option in some software packages.