Estimation using plug-in of the stationary distribution and Shannon entropy of continuous time Markov processes

A natural way to deal with the uncertainty of an ergodic finite state space Markov process is to investigate the entropy of its stationary distribution. When the process is observed, it becomes necessary to estimate this entropy.We estimate both the stationary distribution and its entropy by plug-in of the estimators of the infinitesimal generator. Three situations of observation are discussed: one long trajectory is observed, several independent short trajectories are observed, or the process is observed at discrete times. The good asymptotic behavior of the plug-in estimators is established. We also illustrate the behavior of the estimators through simulation.     

基于ARFIMA(p, d, q)过程的半参数估计量分布特征及其有偏性研究7737976300

 本文运用蒙特卡罗模拟的方法对小样本下长记忆性的三种半参数估计量的分布特征尤其是有偏性问题进行了深入分析,结果发现,当长记忆和短记忆同时存在时,在大多数情况下,各参数估计量仍然服从正态分布,因此在小样本下仍可以构造t统计量判别参数的显著性,但由于受到短期参数的影响,估计量的分布是有偏的,因此导致参数的估计和检验出现偏差。而当真实数据过程接近非平稳或过度差分时,半参数估计量的分布也会发生改变。     

Parameter estimation for fractional Poisson processes

The paper proposes a formal estimation procedure for parameters of the fractional Poisson process (fPp). Such procedures are needed to make the fPp model usable in applied situations. The basic idea of fPp, motivated by experimental data with long memory is to make the standard Poisson model more flexible by permitting non-exponential, heavy-tailed distributions of interarrival times and different scaling properties. We establish the asymptotic normality of our estimators for the two parameters appearing in our fPp model. This fact permits construction of the corresponding confidence intervals. The properties of the estimators are then tested using simulated data.     

Behaviour of skewness, kurtosis and normality tests in long memory data

We establish the limiting distributions for empirical estimators of the coefficient of skewness, kurtosis, and the Jarque–Bera normality test statistic for long memory linear processes. We show that these estimators, contrary to the case of short memory, are neither ${\sqrt{n}}We establish the limiting distributions for empirical estimators of the coefficient of skewness, kurtosis, and the Jarque–Bera normality test statistic for long memory linear processes. We show that these estimators, contrary to the case of short memory, are neither ?n{\sqrt{n}}-consistent nor asymptotically normal. The normalizations needed to obtain the limiting distributions depend on the long memory parameter d. A direct consequence is that if data are long memory then testing normality with the Jarque–Bera test by using the chi-squared critical values is not valid. Therefore, statistical inference based on skewness, kurtosis, and the Jarque–Bera normality test, needs a rescaling of the corresponding statistics and computing new critical values of their nonstandard limiting distributions.     

Estimation of the Entropy Rate of a Countable Markov Chain

We consider here ergodic homogeneous Markov chains with countable state spaces. The entropy rate of the chain is an explicit function of its transition and stationary distributions. We construct estimators for this entropy rate and for the entropy of the stationary distribution of the chain, in the parametric and nonparametric cases. We study estimation from one sample with long length and from many independent samples with given length. In the parametric case, the estimators are deduced by plug-in from the maximum likelihood estimator of the parameter. In the nonparametric case, the estimators are deduced by plug-in from the empirical estimators of the transition and stationary distributions. They are proven to have good asymptotic properties.     

Time varying long memory parameter estimation for locally stationary long memory processes

The semiparametric estimators of time varying long memory parameter are investigated for locally stationary long memory processes. The GPH estimator and the local Whittle estimator are considered. Under some mild regularity assumptions, the weak consistency and the asymptotic normality of the estimators are obtained. The finite sample performance of the estimators is discussed through a small simulation study.     

Shrinkage Estimation of the Memory Parameter in Stationary Gaussian Processes

The correct and efficient estimation of memory parameters in a stationary Gaussian processes is an important issue, since otherwise, forecasts based on the resulting time series would be misleading. On the other hand, if the memory parameters are suspected to fall in a smaller subspace through some hypothesis restrictions, it becomes a hard decision whether to use estimators based on the restricted spaces or to use unrestricted estimators over the full parameter space. In this article, we propose James-Stein-type estimators of the memory parameters of a stationary Gaussian times series process, which can efficiently incorporate the hypothetical restrictions. We show theoretically that the proposed estimators are more efficient than the usual unrestricted maximum likelihood estimators over the entire parameter space.     

Wavelet estimation of the memory parameter for long range dependent random fields

In this paper we study the estimation of the spatial long memory parameter for stationary long range dependent random fields using wavelet methods. We first show the relation between the wavelet coefficients of the random fields and its long memory parameter. Based on this relation, we construct a log-regression wavelet estimator of the long memory parameter. Under some mild regularity assumptions, the asymptotic properties of the estimators are investigated. Finally, a small simulation study illustrates the method.     

Long-range dependence and approximate Bayesian computation

In this work, we propose a method for estimating the Hurst index, or memory parameter, of a stationary process with long memory in a Bayesian fashion. Such approach provides an approximation for the posterior distribution for the memory parameter and it is based on a simple application of the so-called approximate Bayesian computation (ABC), also known as likelihood-free method. Some popular existing estimators are reviewed and compared to this method for the fractional Brownian motion, for a long-range binary process and for the Rosenblatt process. The performance of our proposal is remarkably efficient.     

Parameter estimation of three-parameter Weibull distribution based on progressively Type-II censored samples

In this paper, the estimation of parameters for a three-parameter Weibull distribution based on progressively Type-II right censored sample is studied. Different estimation procedures for complete sample are generalized to the case with progressively censored data. These methods include the maximum likelihood estimators (MLEs), corrected MLEs, weighted MLEs, maximum product spacing estimators and least squares estimators. We also proposed the use of a censored estimation method with one-step bias-correction to obtain reliable initial estimates for iterative procedures. These methods are compared via a Monte Carlo simulation study in terms of their biases, root mean squared errors and their rates of obtaining reliable estimates. Recommendations are made from the simulation results and a numerical example is presented to illustrate all of the methods of inference developed here.     

Parametric estimation for ARFIMA models via spectral methods

Given a fractional integrated, autoregressive, moving average,ARFIMA (p, d, q) process, the simultaneous estimation of the short and long memory parameters can be achieved by maximum likelihood estimators. In this paper, following a two-step algorithm, the coefficients are estimated combining the maximum likelihood estimators with the general orthogonal decomposition of stochastic processes. In particular, the principal component analysis of stochastic processes is exploited to estimate the short memory parameters, which are plugged into the maximum likelihood function to obtain the fractional differencingd.     

Estimating Long and Short Run Effects in Static Panel Models

Abstract

This paper assesses the biases of four different estimators with respect to the short run and the long run parameters if a static panel model is used, although the data generating process is a dynamic error components model. We analytically derive the associated biases and provide a discussion of the determinants thereof. Our analytical and numerical results as well as Monte Carlo simulations illustrate that the asymptotic bias of both the within and the between parameter with respect to the short run and long run impact can be substantial, depending on the memory of the data generating process, the length of the time series and the importance of the cross-sectional variation in the explanatory variables.     

Asymptotic properties of nonparametric regression for long memory random fields

The kernel estimator of spatial regression function is investigated for stationary long memory (long range dependent) random fields observed over a finite set of spatial points. A general result on the strong consistency of the kernel density estimator is first obtained for the long memory random fields, and then, under some mild regularity assumptions, the asymptotic behaviors of the regression estimator are established. For the linear long memory random fields, a weak convergence theorem is also obtained for kernel density estimator. Finally, some related issues on the inference of long memory random fields are discussed through a simulation example.     

A semiparametric approach for modelling multivariate nonlinear time series

In this article, a semiparametric time‐varying nonlinear vector autoregressive (NVAR) model is proposed to model nonlinear vector time series data. We consider a combination of parametric and nonparametric estimation approaches to estimate the NVAR function for both independent and dependent errors. We use the multivariate Taylor series expansion of the link function up to the second order which has a parametric framework as a representation of the nonlinear vector regression function. After the unknown parameters are estimated by the maximum likelihood estimation procedure, the obtained NVAR function is adjusted by a nonparametric diagonal matrix, where the proposed adjusted matrix is estimated by the nonparametric kernel estimator. The asymptotic consistency properties of the proposed estimators are established. Simulation studies are conducted to evaluate the performance of the proposed semiparametric method. A real data example on short‐run interest rates and long‐run interest rates of United States Treasury securities is analyzed to demonstrate the application of the proposed approach. The Canadian Journal of Statistics 47: 668–687; 2019 © 2019 Statistical Society of Canada     

Bayes methods in the ecological fallacy cntext:estimation of individual correlation from aggregate data

The ecological fallacy is related to Simpson's paradox (1951) where relationships among group means may be counterintuitive and substantially different from relationships within groups, where the groups are usually geographic entities such as census tracts. We consider the problem of estimating the correlation between two jointly normal random variables where only ecological data (group means) are available. Two empirical Bayes estimators and one fully Bayesian estimator are derived and compared with the usual ecological estimator, which is simply the Pearson correlation coefficient of the group sample means. We simulate the bias and mean squared error performance of these estimators, and also give an example employing a dataset where the individual level data are available for model checking. The results indicate superiority of the empirical Bayes estimators in a variety of practical situations where, though we lack individual level data, other relevant prior information is available.     

A comparison of micro versus macro point estimators for markov-process models

We compare, by means of factorially designed Monte Carlo simulation experiments, the performance of (macro-data) restricted least-squares point estimators with that of (micro-data) maximum likelihood estimators for Markov-process models. We find, by various measures of estimator accuracy, that micro data are approximately ten times more valuable than macro data. We also find evidence that a small state space, a long time series, and a large number of entities observed enhance performance.     

A Bivariate Geometric Distribution with Applications to Reliability

This article studies a bivariate geometric distribution (BGD) as a plausible reliability model. Maximum likelihood and Bayes estimators of parameters and various reliability characteristics are obtained. Approximations to the mean, variance, and Bayes risk of these estimators have been derived using Taylor's expansion. A Monte-Carlo simulation study has been performed to compare these estimators. At the end, the theory is illustrated with a real data set example of accidents.     

Long memory versus structural breaks: An overview

We discuss the increasing literature on misspecifying structural breaks or more general trends as long-range dependence. We consider tests on structural breaks in the long-memory regression model as well as the behaviour of estimators of the memory parameter when structural breaks or trends are in the data but long memory is not. Methods for distinguishing both of these phenomena are proposed. The financial support of Volkswagenstiftung is gratefully acknowledged.     

Estimating Long and Short Run Effects in Static Panel Models

This paper assesses the biases of four different estimators with respect to the short run and the long run parameters if a static panel model is used, although the data generating process is a dynamic error components model. We analytically derive the associated biases and provide a discussion of the determinants thereof. Our analytical and numerical results as well as Monte Carlo simulations illustrate that the asymptotic bias of both the within and the between parameter with respect to the short run and long run impact can be substantial, depending on the memory of the data generating process, the length of the time series and the importance of the cross-sectional variation in the explanatory variables.     

On simple wavelet estimators of random signals and their small-sample properties

In the paper we suggest certain nonparametric estimators of random signals based on the wavelet transform. We consider stochastic signals embedded in white noise and extractions with wavelet denoizing algorithms utilizing the non-decimated discrete wavelet transform and the idea of wavelet scaling. We evaluate properties of these estimators via extensive computer simulations and partially also analytically. Our wavelet estimators of random signals have clear advantages over parametric maximum likelihood methods as far as computational issues are concerned, while at the same time they can compete with these methods in terms of precision of estimation in small samples. An illustrative example concerning smoothing of survey data is also provided.