Detection of outliers in bivariate time series data

In this article, we use the influence function matrix of auto and cross-correlations of a bivariate (multivariate) time series for detecting the outliers. The multivariate analog of the graphical method of Chernick et. al. (1982), to detect outliers and partial outliers is presented. A simulation study illustrating the method is also given.     

Trend estimation of multivariate time series with controlled smoothness

This paper extends the univariate time series smoothing approach provided by penalized least squares to a multivariate setting, thus allowing for joint estimation of several time series trends. The theoretical results are valid for the general multivariate case, but particular emphasis is placed on the bivariate situation from an applied point of view. The proposal is based on a vector signal-plus-noise representation of the observed data that requires the first two sample moments and specifying only one smoothing constant. A measure of the amount of smoothness of an estimated trend is introduced so that an analyst can set in advance a desired percentage of smoothness to be achieved by the trend estimate. The required smoothing constant is determined by the chosen percentage of smoothness. Closed form expressions for the smoothed estimated vector and its variance-covariance matrix are derived from a straightforward application of generalized least squares, thus providing best linear unbiased estimates for the trends. A detailed algorithm applicable for estimating bivariate time series trends is also presented and justified. The theoretical results are supported by a simulation study and two real applications. One corresponds to Mexican and US macroeconomic data within the context of business cycle analysis, and the other one to environmental data pertaining to a monitored site in Scotland.     

Correcting moments for goodness of fit tests based on two entropy estimates

The sample entropy (Vasicek, 1976) has been most widely used as a nonparametric entropy estimator due to its simplicity, but its underlying distribution function has not been known yet though its moments are required in establishing the entropy-based goodness of test statistic (Soofi et al., 1995). In this paper we derive the nonparametric distribution function of the sample entropy as a piece-wise uniform distribution in the lights of Theil (1980) and Dudwicz and van der Meulen (1987). Then we establish the entropy-based goodness of fit test statistics based on the nonparametric distribution functions of the sample entropy and modified sample entropy (Ebrahimi et al., 1994), and compare their performances for the exponential and normal distributions.     

Third and fourth moments of vector autoregressions with regime switching

We derive matrix formulae in closed form for the unconditional third and fourth moments of a broad class of vector autoregressive time series with regime switching. First and second moments are well known. New measures of multivariate skewness and kurtosis are introduced and basic properties are investigated. The knowledge of series level, variation, co-movements, skewness, and kurtosis is useful to support model interpretation in real data application. Numerical examples complete the paper.     

Testing for pairwise serial independence via the empirical distribution function

Built on Skaug and Tjøstheim's approach, this paper proposes a new test for serial independence by comparing the pairwise empirical distribution functions of a time series with the products of its marginals for various lags, where the number of lags increases with the sample size and different lags are assigned different weights. Typically, the more recent information receives a larger weight. The test has some appealing attributes. It is consistent against all pairwise dependences and is powerful against alternatives whose dependence decays to zero as the lag increases. Although the test statistic is a weighted sum of degenerate Cramér–von Mises statistics, it has a null asymptotic N (0, 1) distribution. The test statistic and its limit distribution are invariant to any order preserving transformation. The test applies to time series whose distributions can be discrete or continuous, with possibly infinite moments. Finally, the test statistic only involves ranking the observations and is computationally simple. It has the advantage of avoiding smoothed nonparametric estimation. A simulation experiment is conducted to study the finite sample performance of the proposed test in comparison with some related tests.     

Tests for noncorrelation of two multivariate ARMA time series

In many situations, we want to verify the existence of a relationship between multivariate time series. In this paper, we generalize the procedure developed by Haugh (1976) for univariate time series in order to test the hypothesis of noncorrelation between two multivariate stationary ARMA series. The test statistics are based on residual cross-correlation matrices. Under the null hypothesis of noncorrelation, we show that an arbitrary vector of residual cross-correlations asymptotically follows the same distribution as the corresponding vector of cross-correlations between the two innovation series. From this result, it follows that the test statistics considered are asymptotically distributed as chi-square random variables. Two test procedures are described. The first one is based on the residual cross-correlation matrix at a particular lag, whilst the second one is based on a portmanteau type statistic that generalizes Haugh's statistic. We also discuss how the procedures for testing noncorrelation can be adapted to determine the directions of causality in the sense of Granger (1969) between the two series. An advantage of the proposed procedures is that their application does not require the estimation of a global model for the two series. The finite-sample properties of the statistics introduced were studied by simulation under the null hypothesis. It led to modified statistics whose upper quantiles are much better approximated by those of the corresponding chi-square distribution. Finally, the procedures developed are applied to two different sets of economic data.     

The beta exponentiated Weibull distribution

The Weibull distribution is one of the most important distributions in reliability. For the first time, we introduce the beta exponentiated Weibull distribution which extends recent models by Lee et al. [Beta-Weibull distribution: some properties and applications to censored data, J. Mod. Appl. Statist. Meth. 6 (2007), pp. 173–186] and Barreto-Souza et al. [The beta generalized exponential distribution, J. Statist. Comput. Simul. 80 (2010), pp. 159–172]. The new distribution is an important competitive model to the Weibull, exponentiated exponential, exponentiated Weibull, beta exponential and beta Weibull distributions since it contains all these models as special cases. We demonstrate that the density of the new distribution can be expressed as a linear combination of Weibull densities. We provide the moments and two closed-form expressions for the moment-generating function. Explicit expressions are derived for the mean deviations, Bonferroni and Lorenz curves, reliability and entropies. The density of the order statistics can also be expressed as a linear combination of Weibull densities. We obtain the moments of the order statistics. The expected information matrix is derived. We define a log-beta exponentiated Weibull regression model to analyse censored data. The estimation of the parameters is approached by the method of maximum likelihood. The usefulness of the new distribution to analyse positive data is illustrated in two real data sets.     

Order test for high-dimensional two-sample means

We propose a new method to test the order between two high-dimensional mean curves. The new statistic extends the approach of Follmann (1996) to high-dimensional data by adapting the strategy of Bai and Saranadasa (1996). The proposed procedure is an alternative to the non-negative basis matrix factorization (NBMF) based test of Lee et al. (2008) for the same hypothesis, but it is much easier to implement. We derive the asymptotic mean and variance of the proposed test statistic under the null hypothesis of equal mean curves. Based on theoretical results, we put forward a permutation procedure to approximate the null distribution of the new test statistic. We compare the power of the proposed test with that of the NBMF-based test via simulations. We illustrate the approach by an application to tidal volume traces.     

A nonparametric test to compare survival distributions with covariate adjustment

Summary.  The analysis of covariance is a technique that is used to improve the power of a k -sample test by adjusting for concomitant variables. If the end point is the time of survival, and some observations are right censored, the score statistic from the Cox proportional hazards model is the method that is most commonly used to test the equality of conditional hazard functions. In many situations, however, the proportional hazards model assumptions are not satisfied. Specifically, the relative risk function is not time invariant or represented as a log-linear function of the covariates. We propose an asymptotically valid k -sample test statistic to compare conditional hazard functions which does not require the assumption of proportional hazards, a parametric specification of the relative risk function or randomization of group assignment. Simulation results indicate that the performance of this statistic is satisfactory. The methodology is demonstrated on a data set in prostate cancer.     

The mean and variance of rank and exponential score product moment statistics in the non-circular case

This paper gives a general formula for the first two moments of the non-circular product moment statistic, which is used as a test for the statistical independence of the interarrival times of certain time series data, e.g., neuronal spike discharges. For the special cases of rank and exponential score product moment statistics, the mean and variance are formulated.     

A Laguerre polynomial approximation for a goodness-of-fit test for exponential distribution based on progressively censored data

This paper proposes an approximation to the distribution of a goodness-of-fit statistic proposed recently by Balakrishnan et al. [Balakrishnan, N., Ng, H.K.T. and Kannan, N., 2002, A test of exponentiality based on spacings for progressively Type-II censored data. In: C. Huber-Carol et al. (Eds.), Goodness-of-Fit Tests and Model Validity (Boston: Birkhäuser), pp. 89–111.] for testing exponentiality based on progressively Type-II right censored data. The moments of this statistic can be easily calculated, but its distribution is not known in an explicit form. We first obtain the exact moments of the statistic using Basu's theorem and then the density approximants based on these exact moments of the statistic, expressed in terms of Laguerre polynomials, are proposed. A comparative study of the proposed approximation to the exact critical values, computed by Balakrishnan and Lin [Balakrishnan, N. and Lin, C.T., 2003, On the distribution of a test for exponentiality based on progressively Type-II right censored spacings. Journal of Statistical Computation and Simulation, 73 (4), 277–283.], is carried out. This reveals that the proposed approximation is very accurate.     

A more powerful test for incomplete block designs

We studied the behavior of a statistic that tests for treatment effects in incomplete block designs, Simulation was used to estimate the first four moments of a test statistic that combines intra- and inter-block estimates of treatment contrasts. For a wide range of alternative hypotheses, the moments are remarkably close to those of an F distribution with one degree of freedom in the numerator, and the denominator degrees of freedom equal to that of the mean square error in the usual intra-block analysis, The noncentrality parameter depends upon the block and unit variances and the eigenvalues of the incidence matrix of the design, The power of the test statistic can be estimated from standard power function charts.     

A Family Which Integrates the Generalized Charlier Series and Extended Noncentral Negative Binomial Distributions

The generalized Charlier series distribution includes the binomial distribution, and the noncentral negative binomial distribution extends the negative binomial distribution. The present article proposes a family of counting distributions, which contains both the generalized Charlier series and extended noncentral negative binomial distributions. Compound and mixture formulations of the proposed distribution are given. The probability mass function is expressible in terms of the confluent hypergeometric function as well as the Gauss hypergeometric function. Recursive formulae for probability mass function have been studied by Panjer, Sundt and Jewell, Schröter, Sundt, and Kitano et al. in the context of insurance risk. This article explores horizontal, vertical, triangular, and diagonal recursions. Recursive formulae as well as exact expressions for descending factorial moments are studied. The proposed distribution allows overdispersion or underdispersion relative to a Poisson distribution. An illustrative example of data fitting is given.     

On multivariate truncated generalized Cauchy distribution

In this paper, a multivariate form of truncated generalized Cauchy distribution (TGCD), which is denoted by (MVTGCD), is introduced. The joint density function, conditional density function, moment generating function and mixed moments of order ${b=\sum_{i=1}^{k}b_{i}}$ are obtained. Making use of the mixed moments formula, skewness and kurtosis in case of the bivariate case are obtained. Also, all parameters of the distribution are estimated using the maximum likelihood and Bayes methods. A real data set is introduced and analyzed using three models. The first model is the bivariate Cauchy distribution, the second is the truncated bivariate Cauchy distribution and the third is the bivariate truncated generalized Cauchy distribution. A comparison is carried out between the mentioned models based on the corresponding Kolmogorov–Smirnov (K–S) test statistic to emphasize that the bivariate truncated generalized Cauchy model fits the data better than the other models.     

A bivariate distribution with gamma and beta marginals with application to drought data

The first known bivariate distribution with gamma and beta marginals is introduced. Various representations are derived for its joint probability density function (pdf), joint cumulative distribution function (cdf), product moments, conditional pdfs, conditional cdfs, conditional moments, joint moment generating function, joint characteristic function and entropies. The method of maximum likelihood and the method of moments are used to derive the associated estimation procedures as well as the Fisher information matrix, variance–covariance matrix and the profile likelihood confidence intervals. An application to drought data from Nebraska is provided. Some other applications are also discussed. Finally, an extension of the bivariate distribution to the multivariate case is proposed.     

Goodness-of-fit tests for the Gompertz distribution

Abstract

While the Gompertz distribution is often fitted to lifespan data, testing whether the fit satisfies theoretical criteria is being neglected. Here four goodness-of-fit measures – the Anderson–Darling statistic, the correlation coefficient test, a statistic using moments, and a nested test against the generalized extreme value distributions – are discussed. Along with an application to laboratory rat data, critical values calculated by the empirical distribution of the test statistics are also presented.     

On Transition and First Hitting Time Densities and Moments of the Ornstein–Uhlenbeck Process

This paper derives transition and first hitting time densities and moments for the Ornstein–Uhlenbeck Process (OUP) between exponential thresholds. The densities are obtained by simplifying the process via Doob’s representation into Brownian motion between affine thresholds. The densities in this paper also offer easy-to-use and fast small-time approximations for the densities of OUP between constant thresholds given that exponential thresholds are virtually constant for a small time. This is of interest for estimation with high-frequency data given that extant approaches for constant thresholds impose a large demand on computing power. The moments of the transition distribution up to order n are derived within a closed-form recursive formula that offers valuable information for management. Expressions for the moments of the first hitting time distribution are also obtained in closed form by simplifying integrals via series expansions.     

Typical decision problems in the first-order autoregressive time series

Applied statistical decision theory has wide applications in decision-making fields of studies, such as economic, business management and industrial managements. In this work, following Pratt et al.’s [Introduction to statistical decision theory. 3rd ed. Cambridge, MA: The MIT Press; 2001] approach, we provide theoretical and practical formulations for the calculations of the key decision-making indices expected value of perfect information and expected value of sample information, whenever the unknown state appears to be the first-order autoregressive (AR) time series parameter that assumes a normal prior distribution. A practical procedure is furnished for calculating the decision-making indices. We treat the finite and infinite state spaces for the linear value functions and the quadratic opportunity losses. Interestingly our investigations on the distribution of the mean of the posterior distribution lead us to a general form for the corresponding statistic and its distribution, discussed by Reeves [The distribution of the maximum likelihood estimator of the parameter in the first-order AR series. Biometrika. 1972;59:387–394], Moschopoulos and Canada [The distribution function of a linear combination of chi-squares. Comput Math Appl. 1984;10:383–386], and Roychowdhury and Bhattacharya [On the performance of estimators of parameter in AR model of order one and optimal prediction under asymmetric loss. Model Assist Stat Appl. 2008;3:225–232].     

APPROXIMATIONS TO SOME TEST STATISTICS FOR PERMUTATION TESTS IN A COMPLETELY RANDOMIZED DESIGN1

Under a randomization model for a completely randomized design permutation tests are considered based on the usual F statistic and on a multi-response permutation procedure statistic. For the first statistic the first two moments are obtained so a comparision with the distribution under the normal theory model can be made. The second statistic is shown to converge in distribution to an infinite weighted sum of chi-squared variates, the weights being the limits of the eigenvalues of a matrix depending on the distance measure used and the order statistics of the observations.     

NONNULL DISTRIBUTION OF LIKELIHOOD RATIO CRITERION FOR TESTING MULTISAMPLE SPHERICITY IN THE COMPLEX CASE

In this paper, nonnull moments of the likelihood ratio statistic for testing multisample sphericity in the complex case have been derived in series involving zonal polynomials. The nonnull asymptotic distribution of the statistic is also derived for certain alternatives.