Nonparametric regression estimation in a null recurrent time series

We derive an asymptotic theory of nonparametric estimation for a time series regression model Z_t=f(X_t)+W_t, where {X_t} and {Z_t} are observed nonstationary processes, and {W_t} is an unobserved stationary process. The class of nonstationary processes allowed for {X_t} is a subclass of the class of null recurrent Markov chains. This subclass contains the random walk, unit root processes and nonlinear processes. The process {W_t} is assumed to be linear and stationary.     

Simulation of a stationary autoregression: A characterization of the normal distribution

Simulating a stationary AR(p), X_t = ∑^p_i=1α_iX_t−i + Z_t, when the innovations {Z_t} are assumed to be i.i.d. is straightforward. Starting the process in the stationary state, however, requires generation of (X₁,X₂,…,X_p) from the stationary p-dimensional distribution. When Z_t is normal this may be achieved by generating X_i as a linear function of X₁,X₂,…,X_i−1 and an independent normal variate for i = 2,3,…, p. It is shown that the ability to initialize a stationary AR(p) in this way characterizes the normal distribution.     

Optimal designs for approximating the path of a stochastic process

We consider a centered stochastic process {X(t):t ∈ T} with known and continuous covariance function. On the basis of observations X(t₁), …, X(t_n) we approximate the whole path by orthogonal projection and measure the performance of the chosen design d = (t₁, …, t_n)′ by the corresponding mean squared L²-distance. For covariance functions on T² = [0, 1]², which satisfy a generalized Sacks-Ylvisaker regularity condition of order zero, we construct asymptotically optimal sequences of designs. Moreover, we characterize the achievement of a lower error bound, given by Micchelli and Wahba (1981), and study the question of whether this bound can be attained.     

Estimation of an autoregressive semiparametric model with exogenous variables

In many autoregressive relationships, there are observed external influences. This paper deals with the estimation of the multivariate model X_t+1= φ(X_t,…,X_t−r+1) + ψ(Y_t) + ε_t, where φ(·) is an unknown nonlinear function, ∫ the exogenous variable concerning ψ(·). Two cases are considered: ψ(·) is linear ψ(Y_t) = AY_t, where A is an unknown parameter, and ψ(·) the nonlinear function corresponding to a series expansion. In the latter situation, the method of estimation is ‘seminonparametric’. We first isolate and estimate parametrically the exogenous part, and then estimate nonparametrically the endogenous part ψ(·).     

On the run length of the EWMA scheme: a monotonicity result for normal variables

We discuss the EWMA control chart for a stationary Gaussian process {X_t}. It is proved that in the in-control state the probability of no signal until a fixed time is a nondecreasing function in the autocorrelations of {X_t} provided that they satisfy a certain monotonicity assumption.     

On large deviation asymptotics of some tests in time series

Let {X_t} be a Gaussian stationary process with spectral density f_θ(λ). The problem considered is that of testing a simple hypothesis H₀:θ=θ₀ against the alternative A:θ≠θ₀. For this we investigate the Bahadur efficiency of the likelihood ratio, Rao, modified Wald and Wald tests. The Bahadur efficiency is based on the large deviation theory. Then it is shown that the asymptotics of the above tests are identical up to second-order in a certain sense. We show that this result makes a sharp contrast with the ordinary higher-order asymptotic theory for tests.     

Estimation in dynamic regression with an integrated process

This paper deals with a dynamic regression model y_t = αy_t−1 + βz_t + u_t, where z_t is an integrated process of order one abbreviated as z_t ∼ I(1). Generally speaking, nonstandard asymptotic theory is required to investigate asymptotic properties of statistics related to an integrated process and the asymptotic results are very different from standard ones. There are two distinctive properties in nonstandard asymptotics: the so-called ‘super-consistency’ or T-consistency (where T is a sample size) and the weak convergence to a functional of the Wiener process. In spite of z_t being involved in our model, however, it is shown that our asymptotic results are the same as in the standard asymptotics in classical dynamic regression models, or if the disturbance u_t is serially correlated the OLS estimators of α and β have √T-inconsistency. This is due to the cointegration between y_t−1 and z_t. Although this point was clarified by Park and Phillips (1989) in a general context, we examine this explicitly through our specific model and connect the standard asymptotic theory with the nonstandard one in our case. Furthermore we investigate the limiting properties of other statistics such as t-ratio, the Durbin-Watson test and h-test. We also propose a consistent estimator of α and β by making use of Durbin's 2-step method. Finally, we carry out simulation studies which support our theoretical results.     

On the bootstrap quantile-treatment-effect test

Let {X ₁, …, X _n } and {Y ₁, …, Y _m } be two samples of independent and identically distributed observations with common continuous cumulative distribution functions F(x)=P(X≤x) and G(y)=P(Y≤y), respectively. In this article, we would like to test the no quantile treatment effect hypothesis H ₀: F=G. We develop a bootstrap quantile-treatment-effect test procedure for testing H ₀ under the location-scale shift model. Our test procedure avoids the calculation of the check function (which is non-differentiable at the origin and makes solving the quantile effects difficult in typical quantile regression analysis). The limiting null distribution of the test procedure is derived and the procedure is shown to be consistent against a broad family of alternatives. Simulation studies show that our proposed test procedure attains its type I error rate close to the pre-chosen significance level even for small sample sizes. Our test procedure is illustrated with two real data sets on the lifetimes of guinea pigs from a treatment-control experiment.     

Strict stationarity of ar(p) processes generated by nonlinear random functions with additive perturbations

Let {X_n} be a generalized autoregressive process of order ρ defined by X_n=Φ_n(X_n-ρ,…,X_n-1)-η_m, where {φ_n} is a sequence of i.i.d. random maps taking values on H, and {η_n} is a sequence of i.i.d. random variables. Let H be a collection of Borel measurable functions on R_P to R. By considering the associated Markov process, we obtain sufficient conditions for stationarity, (geometric) ergodicity of {X_n}.     

Weak approximations for quantile processes of stationary sequences

ABSTRACT By studying the deviations between uniform empirical and quantile processes (the so-called Bahadur-Kiefer representations) of a stationary sequence in properly weighted sup-norm metrics, we find a general approach to obtaining weighted results for uniform quantile processes of stationary sequences. Consequently we are able to obtain weak convergence for weighted uniform quantile processes of stationary mixing and associated sequences. Further, by studying the sup-norm distance of a general quantile process from its corresponding uniform quantile process, we find that information at the two end points of the uniform quantile process can be so utilized that this weighted sup-norm distance converges in probability to zero under the so-called Csörgõ-Révész conditions. This enables us to obtain weak convergence for weighted general quantile processes of stationary mixing and associated sequences.     

POISSON REGRESSION WITH A PERIODIC FUNCTION

ABSTRACT

Let {y_t } be a Poisson-like process with the mean μ _t which is a periodic function of time t. We discuss how to fit this type of data set using quasi-likelihood method. Our method provides a new avenue to fit a time series data when the usual assumption of stationarity and homogeneous residual variances are invalid. We show that the estimators obtained are strongly consistent and also asymptotically normal.     

Bootstrap test of goodness of fit to a linear model when errors are correlated

Given the regression model Y_i = m(x_i) +ε_i (x_i ε C, i = l,…,n, C a compact set in R) where m is unknown and the random errors {ε_i} present an ARMA structure, we design a bootstrap method for testing the hypothesis that the regression function follows a general linear model: H_o : m ε {mθ(.) = A^t(.)θ : θ ε ? ? R^q} with A a functional from R to R^q. The criterion of the test derives from a Cramer-von-Mises type functional distance D = d²([mcirc]_n, A^t(.)θ_n), between [mcirc]_n, a Gasser-Miiller non-parametric estimator of m, and the member of the class defined in H_o that is closest to m_n in terms of this distance. The consistency of the bootstrap distribution of D and θ_n is obtained under general conditions. Finally, simulations show the good behavior of the bootstrap approximation with respect to the asymptotic distribution of D = d².     

Berry-Esseen bounds for kernel estimates of stationaryprocesses

In this paper we obtain nonuniform Berry-Esseen bounds of the kernel estimate of stationary process {X_i} by the method of martingale approximation. In particular, by choice of bandwidth b_n, the Berry-Esseen bounds can be n^−2/15. The dependence condition of {X_i} is expressed in terms of physical dependence measures introduced by Wu (2005).     

Precise large deviations for the difference of two sums of END random variables with heavy tails

Assume that there are two types of insurance contracts in an insurance company, and the ith related claims are denoted by {X_ij, j ? 1}, i = 1, 2. In this article, the asymptotic behaviors of precise large deviations for non random difference ∑^n₁(t)_{j = 1}X_1j ? ∑^n₂(t)_{j = 1}X_2j and random difference ∑^N₁(t)_{j = 1}X_1j ? ∑^N₂(t)_{j = 1}X_2j are investigated, and under several assumptions, some corresponding asymptotic formulas are obtained.     

Locking the Wiener Process to its Level-Crossing Time

We consider the specific transformation of a Wiener process {X(t), t ≥ 0} in the presence of an absorbing barrier a that results when this process is “time-locked” with respect to its first passage time T _a through a criterion level a, and the evolution of X(t) is considered backwards (retrospectively) from T _a . Formally, we study the random variables defined by Y(t) ≡ X(T _a  ? t) and derive explicit results for their density and mean, and also for their asymptotic forms. We discuss how our results can aid interpretations of time series “response-locked” to their times of crossing a criterion level.     

On the number of near-records after the maximum observation in a continuous sample

{X_n, n≥1} are independent and identically distributed random variables with continuous distribution function F(x). For j=1,…,n, X_j is called a near-record up to time n if X_j ∈ (M_na, M_n], where M_n = max_1≤j≤n {X_j} and a is a positive constant. Let Z_n(a) denote the number of near-records after, and including the maximum observation of the sequence. In this paper, the distributional results of Z_n(a) are considered and its asymptotic behaviours are studied.     

Precise large deviations for the difference of two sums of WUOD and non identically distributed random variables with dominatedly varying tails

In this article, we study large deviations for non random difference ∑^n₁(t)_{j = 1}X_1j ? ∑^n₂(t)_{j = 1}X_2j and random difference ∑^N₁(t)_{j = 1}X_1j ? ∑^N₂(t)_{j = 1}X_2j, where {X_1j, j ? 1} is a sequence of widely upper orthant dependent (WUOD) random variables with non identical distributions {F_1j(x), j ? 1}, {X_2j, j ? 1} is a sequence of independent identically distributed random variables, n₁(t) and n₂(t) are two positive integer-valued functions, and {N_i(t), t ? 0}²_{i = 1} with EN_i(t) = λ_i(t) are two counting processes independent of {X_ij, j ? 1}²_{i = 1}. Under several assumptions, some results of precise large deviations for non random difference and random difference are derived, and some corresponding results are extended.     

Characterizations of geometric distribution and discrete IFR (DFR) distributions using order statistics

Let X be a discrete random variable the set of possible values (finite or infinite) of which can be arranged as an increasing sequence of real numbers a₁<a₂<a₃<…. In particular, a_i could be equal to i for all i. Let X_1n≦X_2n≦?≦X_nn denote the order statistics in a random sample of size n drawn from the distribution of X, where n is a fixed integer ≧2. Then, we show that for some arbitrary fixed k(2≦k≦n), independence of the event {X_kn=X_1n} and X_1n is equivalent to X being either degenerate or geometric. We also show that the montonicity in i of P{X_kn = X_1n | X_1n = a_i} is equivalent to X having the IFR (DFR) property. Let a_i = i and $\text{G(i) = P(X≧i), i = 1, 2, …}$. We prove that the independence of {X_2n ? X_1n ∈B} and X_1n for all i is equivalent to X being geometric, where B = {m} (B = {m,m+1,…}), provided G(i) = q^i?1, 1≦i≦m+2 (1≦i≦m+1), where 0<q<1.     

Correctings tests for trend in proportions for skewness

We develop the score test for the hypothesis that a parameter of a Markov sequence is constant over time, against the alternatives that it varies over time, i.e., θ_t = θ + U_t; t = 1,2,…, where {U_t; t = 1,2,...} is a sequence of independently and identically distributed random variables with mean zero and variance σ^z _u and θ is a fixed constant. The asymptotic null distribution of the test statistic is proved to be normal. We illustrate our procedure by examples and a real life data analysis.