Multiscale detection and location of multiple variance changes in the presence of long memory

Procedures for detecting change points in sequences of correlated observations (e.g., time series) can help elucidate their complicated structure. Current literature on the detection of multiple change points emphasizes the analysis of sequences of independent random variables. We address the problem of an unknown number of variance changes in the presence of long-range dependence (e.g., long memory processes). Our results are also applicable to time series whose spectrum slowly varies across octave bands. An iterated cumulative sum of squares procedure is introduced in order to look at the multiscale stationarity of a time series; that is, the variance structure of the wavelet coefficients on a scale by scale basis. The discrete wavelet transform enables us to analyze a given time series on a series of physical scales. The result is a partitioning of the wavelet coefficients into locally stationary regions. Simulations are performed to validate the ability of this procedure to detect and locate multiple variance changes. A ‘time’ series of vertical ocean shear measurements is also analyzed, where a variety of nonstationary features are identified.     

Inference for Local Autocorrelations in Locally Stationary Models

For nonstationary processes, the time-varying correlation structure provides useful insights into the underlying model dynamics. We study estimation and inferences for local autocorrelation process in locally stationary time series. Our constructed simultaneous confidence band can be used to address important hypothesis testing problems, such as whether the local autocorrelation process is indeed time-varying and whether the local autocorrelation is zero. In particular, our result provides an important generalization of the R function acf() to locally stationary Gaussian processes. Simulation studies and two empirical applications are developed. For the global temperature series, we find that the local autocorrelations are time-varying and have a “V” shape during 1910–1960. For the S&P 500 index, we conclude that the returns satisfy the efficient-market hypothesis whereas the magnitudes of returns show significant local autocorrelations.     

The star-shaped Λ-coalescent and Fleming–Viot process

The star-shaped Λ-coalescent and corresponding Λ-Fleming–Viot process, where the Λ measure has a single atom at unity, are studied in this article. The transition functions and stationary distribution of the Λ-Fleming–Viot process are derived in a two-type model with mutation. The distribution of the number of non-mutant lines back in time in the star-shaped Λ-coalescent is found. Extensions are made to a model with d types, either with parent-independent mutation or general Markov mutation, and an infinitely-many-types model, when d → ∞. An eigenfunction expansion for the transition functions is found, which has polynomial right eigenfunctions and left eigenfunctions described by hyperfunctions. A further star-shaped model with general frequency-dependent change is considered and the stationary distribution in the Fleming–Viot process derived. This model includes a star-shaped Λ-Fleming–Viot process with mutation and selection. In a general Λ-coalescent explicit formulae for the transition functions and stationary distribution, when there is mutation, are unknown. However, in this article, explicit formulae are derived in the star-shaped coalescent.     

On linear statistical models of commutative quadratic type

By defining a special class of vector decompositions we consider linear statistical models of commutative quadratic type, which especially cover balanced complete and incomplete ANOVA models with fixed, random and mixed effects. Under the assumption of normal distribution we are concerned with distributions of general quadratic forms, with point and confidence region estimation as well as with hypothesis testing for fixed effects (including multiple comparisons) and variance components.     

Conditional Least Squares Estimators for the Offspring Mean in a Subcritical Branching Process with Immigration

Consider a Bienayme–Galton–Watson process with generation-dependent immigration, whose mean and variance vary regularly with non negative exponents α and β, respectively. We study the estimation problem of the offspring mean based on an observation of population sizes. We show that if β <2α, the conditional least squares estimator (CLSE) is strongly consistent. Conditions which are sufficient for the CLSE to be asymptotically normal will also be derived. The rate of convergence is faster than n ^?1/2, which is not the case in the process with stationary immigration.     

Analyzing point processes subjected to random deletions

Certain nonstationary point process data are viewed as having arisen through time dependent random deletions of a stationary point process. Initially the probability Of deletion is assumed known and estimates of the rate and autointensity function of the inherent stationary process are constructed. Then an estimate of the deletion probability function is developed for the case of the function depending on a finite dimensional parameter. An estimate is provided for the variance of the autointensity estimate.     

Reverse Regression and Employment Discrimination

The importance of interval forecasts is reviewed. Several general approaches to calculating such forecasts are described and compared. They include the use of theoretical formulas based on a fitted probability model (with or without a correction for parameter uncertainty), various “approximate” formulas (which should be avoided), and empirically based, simulation, and resampling procedures. The latter are useful when theoretical formulas are not available or there are doubts about some model assumptions. The distinction between a forecasting method and a forecasting model is expounded. For large groups of series, a forecasting method may be chosen in a fairly ad hoc way. With appropriate checks, it may be possible to base interval forecasts on the model for which the method is optimal. It is certainly unsound to use a model for which the method is not optimal, but, strangely, this is sometimes done. Some general comments are made as to why prediction intervals tend to be too narrow in practice to encompass the required proportion of future observations. An example demonstrates the overriding importance of careful model specification. In particular, when data are “nearly nonstationary,” the difference between fitting a stationary and a nonstationary model is critical.     

On geometry of the set of admissible invariant quadratic estimators in balanced two variance components model

Two variance components model for which each invariant quadratic admissible estimator of a linear function of variance components (under quadratic loss function) is a linear combination of two quadratic forms,Z ₁,Z ₂, say, is considered. A setD={(d ₁,d ₂)′:d ₁ Z ₁+d ₂ Z ₂ is admissible} is described by giving formulae on the boundary ofD. Different forms of the setD are presented on figures.     

Sur un test d'égalité des autocovariances de deux séries chronologiques

We propose a test for the equality of the autocovariance functions of two independent and stationary time series. The test statistic is a quadratic form in the vector of differences of the first J + 1 autocovariances. Its asymptotic distribution is derived under the null hypothesis, and the finite-sample properties of the test, namely the bias and the power, are investigated by Monte Carlo methods. A by-product of this study is a new estimator of the covariance between two sample autocovariances which provides a positive definite covariance matrix. We establish the convergence of this estimator in the L₁ norm.     

On hsu's model in regression analysis

The paper examplifies with Hsu’s model a general pattern as how to derive results of variance component estimation from well known results on mean estimation, as far as linear model theory is concerned. This ’ dispersion-mean-correspondence‘provides new and short proofs for various theorems from the literature, concerning unbiased invariant quadratic estimators with minimum BAYES risk or minimum variance. For pure variance component models, unbiased non-negative quadratic estimability is characterized in terms of the design matrices.     

Tests for detecting overdispersion in poisson models

Collings and Margolin(1985) developed a locally most powerful unbiased test for detecting negative binomial departures from a Poisson model, when the variance is a quadratic function of the mean. Kim and Park(1992) developed a locally most powerful unbiased test, when the variance is a linear function of the mean. It is found that a different mean-variance structure of a negative binomial derives a different locally optimal test statistic.

In this paper Collings and Margolin's and Kim and Park's results are unified and extended by developing a test for overdispersion in Poisson model against Katz family of distributions, Our setup has two extensions: First, Katz family of distributions is employed as an extension of the negative binomial distribution. Second, the mean-variance structure of the mixed Poisson model is given by σ² = μ+cμ^r for arbitrary but fixed r. We derive a local score test for testing H₀ : c = 0. Superiority of a new test is proved by the asymtotic relative efficiency as well as the simulation study.     

Best quadratic predictions in finite populations

For a finite population and the resulting linear model Y=Xβ+e, the problem of the optimal invariant quadratic predictors including optimal invariant quadratic unbiased predictor and optimal invariant quadratic (potentially) biased predictor for the population quadratic quantities, f(H)=Y′HY , is of interest and has been previously considered in the literature for the case of HX=0. However, the special case does not contain all of situations at all. So, predicting f(H) in general situations may be of particular interest. In this paper, we make an effort to investigate how to offer a good predictor for f(H), not restricted yet to the mentioned case. Permutation matrix techniques play an important role in handling the process. The expected predictors are finally derived. In addition, we mention that the resulting predictors can be viewed as acceptable in all situations.     

Asymptotic Theory for the QMLE in GARCH-X Models With Stationary and Nonstationary Covariates

This article investigates the asymptotic properties of the Gaussian quasi-maximum-likelihood estimators (QMLE’s) of the GARCH model augmented by including an additional explanatory variable—the so-called GARCH-X model. The additional covariate is allowed to exhibit any degree of persistence as captured by its long-memory parameter d_x; in particular, we allow for both stationary and nonstationary covariates. We show that the QMLE’s of the parameters entering the volatility equation are consistent and mixed-normally distributed in large samples. The convergence rates and limiting distributions of the QMLE’s depend on whether the regressor is stationary or not. However, standard inferential tools for the parameters are robust to the level of persistence of the regressor with t-statistics following standard Normal distributions in large sample irrespective of whether the regressor is stationary or not. Supplementary materials for this article are available online.     

Nonparametric Inference for Time-Varying Coefficient Quantile Regression

The article considers nonparametric inference for quantile regression models with time-varying coefficients. The errors and covariates of the regression are assumed to belong to a general class of locally stationary processes and are allowed to be cross-dependent. Simultaneous confidence tubes (SCTs) and integrated squared difference tests (ISDTs) are proposed for simultaneous nonparametric inference of the latter models with asymptotically correct coverage probabilities and Type I error rates. Our methodologies are shown to possess certain asymptotically optimal properties. Furthermore, we propose an information criterion that performs consistent model selection for nonparametric quantile regression models of nonstationary time series. For implementation, a wild bootstrap procedure is proposed, which is shown to be robust to the dependent and nonstationary data structure. Our method is applied to studying the asymmetric and time-varying dynamic structures of the U.S. unemployment rate since the 1940s. Supplementary materials for this article are available online.     

Asymptotic Properties of an Estimate of the Prediction Error Variance

An estimate of the variance of the prediction error for a linear stationary time series is constructed by using only a part, ?₀, ?₁,…, ?_M, of the sample autocovariance sequence, where M increases with T, the length of the time series observed. M increases as T^α (α < ¹₄). Under a higher moment condition, but not assuming Gaussianity, the estimate obtained is shown to be strongly consistent and asymptotically normal. The asymptotic variance of the estimation error is also obtained.     

Convergence of normalized quadratic forms

The asymptotic behavior of quadratic forms of stationary sequences plays an important role in statistics, for example, in the context of the Whittle approximation to maximum likelihood. The quadratic form, appropriately normalized, may have Gaussian or non-Gaussian limits. Under what circumstances will the limits be of one type or another? And if the limits are non-Gaussian, what are they? The goal of this paper is to describe the historical development of the problem and provide further extensions of recent results.     

COVARIANCES FOR FIXED INTERVAL SMOOTHED KALMAN FILTER PARAMETER ESTIMATES

Given time series data for fixed interval t= 1,2,…, M with non-autocorrelated innovations, the regression formulae for the best linear unbiased parameter estimates at each time t are given by the Kalman filter fixed interval smoothing equations. Formulae for the variance of such parameter estimates are well documented. However, formulae for covariance between these fixed interval best linear parameter estimates have previously been derived only for lag one. In this paper more general formulae for covariance between fixed interval best linear unbiased estimates at times t and t - l are derived for t= 1,2,…, M and l= 0,1,…, t - 1. Under Gaussian assumptions, these formulae are also those for the corresponding conditional covariances between the fixed interval best linear unbiased parameter estimates given the data to time M. They have application, for example, in determination via the expectation-maximisation (EM) algorithm of exact maximum likelihood parameter estimates for ARMA processes expressed in statespace form when multiple observations are available at each time point.     

JAMES-STEIN RULE ESTIMATORS IN LINEAR REGRESSION MODELS WITH MULTIVARIATE-t DISTRIBUTED ERROR

This paper considers estimation of β in the regression model y =Xβ+μ, where the error components in μ have the jointly multivariate Student-t distribution. A family of James-Stein type estimators (characterised by nonstochastic scalars) is presented. Sufficient conditions involving only X are given, under which these estimators are better (with respect to the risk under a general quadratic loss function) than the usual minimum variance unbiased estimator (MVUE) of β. Approximate expressions for the bias, the risk, the mean square error matrix and the variance-covariance matrix for the estimators in this family are obtained. A necessary and sufficient condition for the dominance of this family over MVUE is also given.     

Comparison of powers for the sphericity tests using both the asymptotic distribution and the bootstrap

The asymptotic distributions of two tests for sphericity:the locally most powerful invariant test and the likelihood ratio test are derived under the general alternaties ∑?σ² I. The powers of these two tests are then compared when the data are from a trivariate normal population. The bootstrap method is also used to obtain the powers and the powers obtained by this method agree with those from the asymptotic distributions.     

Finding maximum G-criterion values for central composite designs on the hypercube

For quadratic regression on the hypercube, G—efficiencies are often used in the selection process of an experimental design. To calculate a design's G—efficiency, it is necessary to maximize the prediction variance over the experimental design region. However, it is common to approximate a G—efficiency. This is achieved by calculating the prediction variances generated from a subset of points in the design space and taking the maximum to estimate the maximum prediction variance. This estimate is then applied to approximate the G—efficiency. In this paper, it will be shown that over the class of central composite designs (CCDs) on the hypercube. the prediction variance can be expressed in a closed-form. An exact value of the maximum prediction variance can then be determined by evaluating this closed-form expression over a finite subset of barycentric points. Tables of exact G—efficiencies will be presented. Design optimality criteria, quadratic regression on the hypercube, and the structures of the design matrix X, X'X, and (X'X)^?1 for any CCD will be discussed.