Simple diagnostic tools for inverstigating linear trends in time series

This paper presents a simple diagnostic tool for time series. Based on a coefficient α that veries between 1 and 0, the tool measures the approximation of a time series to an arithmetic progression (i.e., a linear function of time). The proposed α is based on the ratio of the average squared second difference to the average squared first difference of the ginven series. As such, α reduces to the Von Neumann ratio η of the series of first differences, namely, α = 1-η/4. For an arithmetic progression α = 1, and deviations therefrom cause it to decrease. Unlike the correlation coefficient (between the entries and the indics), α is sensitive to local, or piecewise, linearity. Here α is evaluated for an assortment of simple time series models such as random walk, AR(1) and MA(1). Large-sample distribution yields a number of commonly used stochastic models including non-normal process. For most standard deterministic and stochastic models, α stabilizes as n approaches infinity, and provides a statistic that is capable of distinguishing between many different standard random and deterministic models. A further measure τ, which together with α distinguisches between random walks and deterministic trend plus i.i.d., is also suggested. Some examples based on empirical data are also studied.     

A robust permutation test for the concordance correlation coefficient

In this work, we developed a robust permutation test for the concordance correlation coefficient (ρ_c) for testing the general hypothesis H₀ : ρ_c = ρ_c(0). The proposed test is based on an appropriately studentized statistic. Theoretically, the test is proven to be asymptotically valid in the general setting when two paired variables are uncorrelated but dependent. This desired property was demonstrated across a range of distributional assumptions and sample sizes in simulation studies, where the test exhibits robust type I error control in all settings tested, even when the sample size is small. We demonstrated the application of this test in two real world examples across cardiac output measurements and endocardiographic imaging.     

Adaptive parametric test in a semiparametric regression model

Consider the semiparametric regression model Y_i = x′_iβ +g(t_i)+e_i for i=1,2, …,n. Here the design points (x_i,t_i) are known and nonrandom and the e_i are iid random errors with Ee₁ = 0 and Ee² ₁ = α²<∞. Based on g(.) approximated by a B-spline function, we consider using atest statistic for testing H₀ : β = 0. Meanwhile, an adaptive parametric test statistic is constructed and a large sample study for this adaptive parametric test statistic is presented.     

Asymptotic Distribution for Symmetric Spacing Statistics

A new procedure for testing the H ₀: μ₁ = ··· = μ _k against the alternative H _u :μ₁ ≥ ··· ≥μ _r  ≤ ··· ≤ μ _k with at least one strict inequality, where μ _i is the location parameter of the ith two-parameter exponential distribution, i = 1,…, k, is proposed. Exact critical constants are computed using a recursive integration algorithm. Tables containing these critical constants are provided to facilitate the implementation of the proposed test procedure. Simultaneous confidence intervals for certain contrasts of the location parameters are derived by inverting the proposed test statistic. In comparison to existing tests, it is shown, by a simulation study, that the new test statistic is more powerful in detecting U-shaped alternatives when the samples are derived from exponential distributions. As an extension, the use of the critical constants for comparing Pareto distribution parameters is discussed.     

Tests for the mean of a multivariate normal population

We study the problem of testing: H₀ : μ ∈ P against H₁ : μ ? P, based on a random sample of N observations from a p-dimensional normal distribution N_p(μ, Σ) with Σ > 0 and P a closed convex positively homogeneous set. We develop the likelihood-ratio test (LRT) for this problem. We show that the union-intersection principle leads to a test equivalent to the LRT. It also gives a large class of tests which are shown to be admissible by Stein's theorem (1956). Finally, we give the α-level cutoff points for the LRT.     

BAHADUR SLOPES FOR COMPARISONS OF TESTS BASED ON RESAMPLING

Let X₁,…, X_n be random variables symmetric about θ from a common unknown distribution F_θ(x) =F(x–θ). To test the null hypothesis H₀:θ= 0 against the alternative H₁:θ > 0, permutation tests can be used at the cost of computational difficulties. This paper investigates alternative tests that are computationally simpler, notably some bootstrap tests which are compared with permutation tests. Of these the symmetrical bootstrap-f test competes very favourably with the permutation test in terms of Bahadur asymptotic efficiency, so it is a very attractive alternative.     

The exact hypothesis test for the shape parameter of a new two-parameter distribution with the bathtub shape or increasing failure rate function under progressive censoring with random removals

This study considers the exact hypothesis test for the shape parameter of a new two-parameter distribution with the shape of a bathtub or increasing failure rate function under type II progressive censoring with random removals, where the number of units removed at each failure time follows a binomial or a uniform distribution. Several test statistics are proposed and one numerical example is provided to illustrate the proposed hypothesis test for the shape parameter. Finally, a simulation study is performed to compare the power performances of all proposed test statistics. We concluded that the test statistic w ₁ is more attractive than other methods as it has better performance than other test statistics for most cases based on the criteria of maximum power.     

Statistical inference on the drift parameter in fractional Brownian motion with a deterministic drift

In statistical inference on the drift parameter a in the fractional Brownian motion W^H_t with the Hurst parameter H ∈ (0, 1) with a constant drift Y^H_t = at + W^H_t, there is a large number of options how to do it. We may, for example, base this inference on the properties of the standard normal distribution applied to the differences between the observed values of the process at discrete times. Although such methods are very simple, it turns out that more appropriate is to use inverse methods. Such methods can be generalized to non constant drift. For the hypotheses testing about the drift parameter a, it is more proper to standardize the observed process, and to use inverse methods based on the first exit time of the observed process of a pre-specified interval until some given time. These procedures are illustrated, and their times of decision are compared against the direct approach. Other generalizations are possible when the random part is a symmetric stochastic integral of a known, deterministic function with respect to fractional Brownian motion.     

A note on a strong renewal theorem

Let {S_n, n ≥ 1} be a sequence of partial sums of independent and identically distributed non-negative random variables with a common distribution function F. Let F belong to the domain of attraction of a stable law with exponent α, 0 < α < 1. Suppose H(t) = ? N(t), t ? 0, where N(t) = max(n : S_n ≥ t). Under some additional assumptions on F, the difference between H(t) and its asymptotic value as t → ∞ is estimated.     

The parametric hypothesis test of multiple uniform populations

X₁, X₂, …, X_k are k(k ? 2) uniform populations which each X_i follows U(0, θ_i). This note shows the test statistic for the null hypothesis H₀: θ₁ = θ₂ = ??? = θ_k by using the order statistics.     

CONDITIONING VS. STANDARDIZATION FOR CONTRASTS ON ERRORS ATTRACTED TO STABLE LAWS

In multiple regression and other settings one encounters the problem of estimating sampling distributions for contrast operations applied to i.i.d. errors. Permutation bootstrap applied to least squares residuals has been proven to consistently estimate conditionalsampling distributions of contrasts, conditional upon order statistics of errors, even for long-tailed error distributions. How does this compare with the unconditional sampling distribution of the contrast when standardizing by the sample s.d. of the errors (or the residuals)? For errors belonging to the domain of attraction of a normal we present a limit theorem proving that these distributions are far closer to one another than they are to the limiting standard normal distribution. For errors attracted to α-stable laws with α ≤ 2 we construct random variables possessing these conditional and unconditional sampling distributions and develop a Poisson representation for their a.s. limit correlation ρ_α. We prove that ρ₂= 1, ρ_α→ 1 for α → 0 + or 2 ?, and ρ_α< 1 a.s. for α < 2.     

A comparison of some nonparametric tests for the simple tree alternative

This paper develops a new test statistic for testing hypotheses of the form H_O M₀=M₁=…=M_k versus H_a: M₀≦M₁,M₂,…,M_k] where at least one inequality is strict. M₀ is the median of the control population and M₁ is the median of the population receiving trearment i, i=1,2,…,k. The population distributions are assumed to be unknown but to differ only in their location parameters if at all. A simulation study is done comparing the new test statistic with the Chacko and the Kruskal-Wallis when the underlying population distributions are either normal, uniform, exponential, or Cauchy. Sample sizes of five, eight, ten, and twenty were considered. The new test statistic did better than the Chacko and the Kruskal-Wallis when the medians of the populations receiving the treatments were approximately the same     

Confidence Intervals for Nonparametric Regression Functions with Missing Data

Suppose that we have a nonparametric regression model Y = m(X) + ε with X ∈ R^p, where X is a random design variable and is observed completely, and Y is the response variable and some Y-values are missing at random. Based on the “complete” data sets for Y after nonaprametric regression imputation and inverse probability weighted imputation, two estimators of the regression function m(x₀) for fixed x₀ ∈ R^p are proposed. Asymptotic normality of two estimators is established, which is used to construct normal approximation-based confidence intervals for m(x₀). We also construct an empirical likelihood (EL) statistic for m(x₀) with limiting distribution of χ²₁, which is used to construct an EL confidence interval for m(x₀).     

Some robust tests of independence in symmetrical multivariate distributions

Let X =(x)^ij=(11¹, …, X,)_T, i = l, …n, be an n X random matrix having multivariate symmetrical distributions with parameters μ, Σ. The p-variate normal with mean μ and covariance matrix is a member of this family. Let be the squared multiple correlation coefficient between the first and the succeeding p₁ components, and let p² = + be the squared multiple correlation coefficient between the first and the remaining p₁ + p₂ =p – 1 components of the p-variate normal vector. We shall consider here three testing problems for multivariate symmetrical distributions. They are (A) to test p² =0 against; (B) to test against =0, 0; (C) to test against p² =0, We have shown here that for problem (A) the uniformly most powerful invariant (UMPI) and locally minimax test for the multivariate normal is UMPI and is locally minimax as p² 0 for multivariate symmetrical distributions. For problem (B) the UMPI and locally minimax test is UMPI and locally minimax as for multivariate symmetrical distributions. For problem (C) the locally best invariant (LBI) and locally minimax test for the multivariate normal is also LBI and is locally minimax as for multivariate symmetrical distributions.     

A note on the nonparametric test based on theL 1-version of the Cramér-von Mises statistic

We consider the test based on theL ₁-version of the Cramér-von Mises statistic for the nonparametric two-sample problem. Some quantiles of the exact distribution under H₀ of the test statistic are computed for small sample sizes. We compare the test in terms of power against general alternatives to other two-sample tests, namely the Wilcoxon rank sum test, the Smirnov test and the Cramér-von Mises test in the case of unbalanced small sample sizes. The computation of the power is rather complicated when the sample sizes are unequal. Using Monte Carlo power estimates it turns out that the Smirnov test is more sensitive to non stochastically ordered alternatives than the new test. And under location-contamination alternatives the power estimates of the new test and of the competing tests are equal.     

Bias of the lse estimator of the first order autoregressive model under tukey contamination

Results of an exhaustive study of the bias of the least square estimator (LSE) of an first order autoregression coefficient α in a contaminated Gaussian model are presented. The model describes the following situation. The process is defined as X_t = α X_t-1 + Y_t . Until a specified time T, Y_t are iid normal N(0, 1). At the moment T we start our observations and since then the distribution of Y_t, t≥T, is a Tukey mixture T(εσ) = (1 – ε)N(0,1) + εN(0, σ²). Bias of LSE as a function of α and ε, and σ² is considered. A rather unexpected fact is revealed: given α and ε, the bias does not change montonically with σ (“the magnitude of the contaminant”), and similarly, given α and σ, the bias is not growing with ε (“the amount of contaminants”).     

Uniform hypothesis testing for finite-valued stationary processes

Given a discrete-valued sample X₁, …, X_n, we wish to decide whether it was generated by a distribution belonging to a family H₀, or it was generated by a distribution belonging to a family H₁. In this work, we assume that all distributions are stationary ergodic, and do not make any further assumptions (e.g. no independence or mixing rate assumptions). We would like to have a test whose probability of error (both Types I and II) is uniformly bounded. More precisely, we require that for each ? there exists a sample size n such that probability of error is upper-bounded by ? for samples longer than n. We find some necessary and some sufficient conditions on H₀ and H₁ under which a consistent test (with this notion of consistency) exists. These conditions are topological, with respect to the topology of distributional distance.     

Minimum hellinger distance estimation for normal models

A robust estimator introduced by Beran (1977a, 1977b), which is based on the minimum Hellinger distance between a projection model density and a nonparametric sample density, is studied empirically. An extensive simulation provides an estimate of the small sample distribution and supplies empirical evidence of the estimator performance for a normal location-scale model. While the performance of the minimum Hellinger distance estimator is seen to be competitive with the maximum likelihood estimator at the true model, its robustness to deviations from normality is shown to be competitive in this setting with that obtained from the M-estimator and the Cramér-von Mises minimum distance estimator. Beran also introduced a goodness-of-fit statisticH ₂, based on the minimized Hellinger distance between a member of a parametric family of densities and a nonparametric density estimate. We investigate the statistic H (the square root of H ₂) as a test for normality when both location and scale are unspecified. Empirically derived critical values are given which do not require extensive tables. The power of the statistic H compares favorably with four other widely used tests for normality.