Uniform asymptotic linearity in a regression parameter of a process based on a rank statistic

For X₁, …, X_N a random sample from a distribution F, let the process S^δ_N(t) be defined as where K²_N = σ^N_i=1(c_i ? c?)² and R x_i, + Δd, is the rank of X_i + Δd_i, among X₁ + Δd₁, …, X_N + Δd_N. The purpose of this note is to prove that, under certain regularity conditions on F and on the constants c_i and d_i, S^Δ_N (t) is asymptotically approximately a linear function of Δ, uniformly in t and in Δ, |Δ| ≤ C. The special case of two samples is considered.     

THE CONVERGENCE RATE OF SEQUENTIAL FIXED-WIDTH CONFIDENCE INTERVALS FOR REGULAR FUNCTIONALS

Let X₁X₂,.be i.i.d. random variables and let U_n= (n r)^-1S?^(n,r) h (X_i1,., X_ir,) be a U-statistic with EU_n= v, v unknown. Assume that g(X₁) =E[h(X₁,.,X_r) - v |X₁]has a strictly positive variance s?². Further, let a be such that φ(a) - φ(-a) =α for fixed α, 0 < α < 1, where φ is the standard normal d.f., and let S²_n be the Jackknife estimator of n Var U_n. Consider the stopping times N(d)= min {n: S²_n: + n^-1≤²a^-2},d > 0, and a confidence interval for v of length 2d,of the form I_n,d= [U_n,-d, Un + d]. We assume that Var U_n is unknown, and hence, no fixed sample size method is available for finding a confidence interval for v of prescribed width 2d and prescribed coverage probability α Turning to a sequential procedure, let I_N(d),d be a sequence of sequential confidence intervals for v. The asymptotic consistency of this procedure, i.e. lim_{d → 0}P(v ∈ I_N(d),d)=α follows from Sproule (1969). In this paper, the rate at which |P(v ∈ I_N(d),d) converges to α is investigated. We obtain that |P(v ∈ I_N(d),d) - α| = 0 (d^{1/2-(1+k)/2(1+m)}), d → 0, where K = max {0,4 - m}, under the condition that E|h(X₁, X_r)|^m < ∞m > 2. This improves and extends recent results of Ghosh & DasGupta (1980) and Mukhopadhyay (1981).     

First-exit times for compound poisson processes for some types of positive and negative jumps

We consider the one-sided and the two-sided first-exit problem for a compound Poisson process with linear deterministic decrease between positive and negative jumps. This process (X(t)) _t≥0 occurs as the workload process of a single-server queueing system with random workload removal, which we denote by M/G _u /G _d /1, where G _u (G _d ) stands for the distribution of the upward (downward) jumps; other applications are to cash management, dams, and several related fields. Under various conditions on G _u and G _d (assuming e.g. that one of them is hyperexponential, Erlang or Coxian), we derive the joint distribution of τ _y =inf{t≥0|X(t)?(0,y)}, y>0, and X(τ _y ) as well as that of T=inf{t≥0|X(t)≤0} and X(T). We also determine the distribution of sup{X(t)|0≤t≤T}.     

A new robust Kalman filter for filtering the microstructure noise

We propose a robust Kalman filter (RKF) to estimate the true but hidden return when microstructure noise is present. Following Zhou's definition, we assume the observed return Y_t is the result of adding microstructure noise to the true but hidden return X_t. Microstructure noise is assumed to be independent and identically distributed (i.i.d.); it is also independent of X_t. When X_t is sampled from a geometric Brownian motion process to yield Y_t, the Kalman filter can produce optimal estimates of X_t from Y_t. However, the covariance matrix of microstructure noise and that of X_t must be known for this claim to hold. In practice, neither covariance matrix is known so they must be estimated. Our RKF, in contrast, does not need the covariance matrices as input. Simulation results show that the RKF gives essentially identical estimates to the Kalman filter, which has access to the covariance matrices. As applications, estimated X_t can be used to estimate the volatility of X_t.     

Precise large deviations for the difference of two sums of WUOD and non identically distributed random variables with dominatedly varying tails

In this article, we study large deviations for non random difference ∑^n₁(t)_{j = 1}X_1j ? ∑^n₂(t)_{j = 1}X_2j and random difference ∑^N₁(t)_{j = 1}X_1j ? ∑^N₂(t)_{j = 1}X_2j, where {X_1j, j ? 1} is a sequence of widely upper orthant dependent (WUOD) random variables with non identical distributions {F_1j(x), j ? 1}, {X_2j, j ? 1} is a sequence of independent identically distributed random variables, n₁(t) and n₂(t) are two positive integer-valued functions, and {N_i(t), t ? 0}²_{i = 1} with EN_i(t) = λ_i(t) are two counting processes independent of {X_ij, j ? 1}²_{i = 1}. Under several assumptions, some results of precise large deviations for non random difference and random difference are derived, and some corresponding results are extended.     

Estimated Generalized Least Squares for a Heteroscedastic Regression Model

This paper considers the general linear regression model yc = X₁β+u_t under the heteroscedastic structure E(u_t) = 0, E(u²) =σ²- (X_tβ)², E(u_t u_s) = 0, tæs, t, s= 1, T. It is shown that any estimated GLS estimator for β is asymptotically equivalent to the GLS estimator under some regularity conditions. A three-step GLS estimator, which calls upon the assumption E(u_t²) =s?²(X,β)² for the estimation of the disturbance covariance matrix, is considered.     

A binomial CUSUM chart for detecting large shifts in fraction nonconforming

This article studies a unique feature of the binomial CUSUM chart in which the difference (d _t ?d ₀) is replaced by (d _t ?d ₀)² in the formulation of the cumulative sum C _t (where d _t and d ₀ are the actual and in-control numbers of nonconforming units, respectively, in a sample). Performance studies are reported and the results reveal that this new feature is able to increase the detection effectiveness when fraction nonconforming p becomes three to four times as large as the in-control value p ₀. The design of the new binomial CUSUM chart is presented along with the calculation of the in-control and out-of-control Average Run Lengths (ARL₀ and ARL₁).     

Optimal designs for approximating the path of a stochastic process

We consider a centered stochastic process {X(t):t ∈ T} with known and continuous covariance function. On the basis of observations X(t₁), …, X(t_n) we approximate the whole path by orthogonal projection and measure the performance of the chosen design d = (t₁, …, t_n)′ by the corresponding mean squared L²-distance. For covariance functions on T² = [0, 1]², which satisfy a generalized Sacks-Ylvisaker regularity condition of order zero, we construct asymptotically optimal sequences of designs. Moreover, we characterize the achievement of a lower error bound, given by Micchelli and Wahba (1981), and study the question of whether this bound can be attained.     

ON TRANSITION PROBABILITIES OF SKIP-FREE MARKOV CHAINS

Consider an ergodic Markov chain X(t) in continuous time with an infinitesimal matrix Q = (q_ij) defined on a finite state space {0, 1,…, N}. In this note, we prove that if X(t) is skip-free positive (negative, respectively), i.e., q_ij, = 0 for j > i+ 1 (i > j+ 1), then the transition probability p_ij(t) = Pr[X(t)=j | X(0) =i] can be represented as a linear combination of p_0N(t) (p^(m)_(N0)(t)), 0 ≤ m ≤N, where f^(m)(t) denotes the mth derivative of a function f(t) with f⁽⁰⁾(t) =f(t). If X(t) is a birth-death process, then p_ij(t) is represented as a linear combination of p_0N^(m)(t), 0 ≤m≤N - |i-j|.     

Precise large deviations for the difference of two sums of END random variables with heavy tails

Assume that there are two types of insurance contracts in an insurance company, and the ith related claims are denoted by {X_ij, j ? 1}, i = 1, 2. In this article, the asymptotic behaviors of precise large deviations for non random difference ∑^n₁(t)_{j = 1}X_1j ? ∑^n₂(t)_{j = 1}X_2j and random difference ∑^N₁(t)_{j = 1}X_1j ? ∑^N₂(t)_{j = 1}X_2j are investigated, and under several assumptions, some corresponding asymptotic formulas are obtained.     

Bias of the lse estimator of the first order autoregressive model under tukey contamination

Results of an exhaustive study of the bias of the least square estimator (LSE) of an first order autoregression coefficient α in a contaminated Gaussian model are presented. The model describes the following situation. The process is defined as X_t = α X_t-1 + Y_t . Until a specified time T, Y_t are iid normal N(0, 1). At the moment T we start our observations and since then the distribution of Y_t, t≥T, is a Tukey mixture T(εσ) = (1 – ε)N(0,1) + εN(0, σ²). Bias of LSE as a function of α and ε, and σ² is considered. A rather unexpected fact is revealed: given α and ε, the bias does not change montonically with σ (“the magnitude of the contaminant”), and similarly, given α and σ, the bias is not growing with ε (“the amount of contaminants”).     

EMPIRICAL BAYES ESTIMATION WITH NON-IDENTICAL COMPONENTS. CONTINUOUS CASE.

In this paper a variant of the standard empirical Bayes estimation problem is considered where the component problems in the sequence are not identical in that the conditional distribution of the observations may vary with the component problems. Let {(Θ_n, X_n)} be a sequence of independent random vectors where Θ_n? G and, given Θ_n=Θ_n, X_n -P_Θ,m(n) with {m(n)} a sequence of positive integers where m(n)≤m? < ∞ for all n. With P_Θ,m in a continuous exponential family of distributions, asymptotically optimal empirical Bayes procedures are exhibited which depend on uniform approximations of certain functions on compact sets by polynomials in e^Θ. Such approximations have been explicitly calculated in the case of normal and gamma families. In the case of normal families, asymptotically optimal linear empirical Bayes estimators in the class of all linear estimators are derived and shown to have rate O(n^-1/2).     

Slow convergence of the Gibbs sampler

We consider the Gibbs sampler as a tool for generating an absolutely continuous probability measure ≥ on R^d. When an appropriate irreducibility condition is satisfied, the Gibbs Markov chain (X_n;n ≥ 0) converges in total variation to its target distribution ≥. Sufficient conditions for geometric convergence have been given by various authors. Here we illustrate, by means of simple examples, how slow the convergence can be. In particular, we show that given a sequence of positive numbers decreasing to zero, say (b_n;n ≥ 1), one can construct an absolutely continuous probability measure ≥ on R^d which is such that the total variation distance between ≥ and the distribution of X_n, converges to 0 at a rate slower than that of the sequence (b_n;n ≥ 1). This can even be done in such a way that ≥ is the uniform distribution over a bounded connected open subset of R^d. Our results extend to hit-and-run samplers with direction distributions having supports with symmetric gaps.     

Nonparametric two‐step regression estimation when regressors and error are dependent

This paper considers estimation of the function g in the model Y_t = g(X_t ) + ?_t when E(?_t|Xt) ≠ 0 with nonzero probability. We assume the existence of an instrumental variable Z_t that is independent of ?_t, and of an innovation ηt = X_t — E(X_t|Z_t). We use a nonparametric regression of X_t on Z_t to obtain residuals η_t, which in turn are used to obtain a consistent estimator of g. The estimator was first analyzed by Newey, Powell & Vella (1999) under the assumption that the observations are independent and identically distributed. Here we derive a sample mean‐squared‐error convergence result for independent identically distributed observations as well as a uniform‐convergence result under time‐series dependence.     

Nonlinear regression in a trivariate elliptical distribution via a linear combination of order statistics

In this paper, by assuming that (X, Y ₁, Y ₂)^T has a trivariate elliptical distribution, we derive the exact joint distribution of X and a linear combination of order statistics from (Y ₁, Y ₂)^T and show that it is a mixture of unified bivariate skew-elliptical distributions. We then derive the corresponding marginal and conditional distributions for the special case of t kernel. We also present these results for an exchangeable case with t kernel and illustrate the established results with an air-pollution data.     

Bayesian Estimation of Change Point in Inverse Weibull Sequence

A sequence of independent lifetimes X ₁,…, X _m , X _m+1,…, X _n were observed from inverse Weibull distribution with mean stress θ₁ and reliability R ₁(t ₀) at time t ₀ but later it was found that there was a change in the system at some point of time m and it is reflected in the sequence after X _m by change in mean stress θ₁ and in reliability R ₂(t ₀) at time t ₀. The Bayes estimators of m, R ₁(t ₀) and R ₂(t ₀) are derived when a poor and a more detailed prior information is introduced into the inferential procedure. The effects of correct and wrong prior information on the Bayes estimators are studied.     

Some multivariate singular unified skew-normal distributions and their application

Abstract

We introduce here the truncated version of the unified skew-normal (SUN) distributions. By considering a special truncations for both univariate and multivariate cases, we derive the joint distribution of consecutive order statistics X_{(r, ..., r + k)} = (X_(r), ..., X_{(r + K)})^T from an exchangeable n-dimensional normal random vector X. Further we show that the conditional distributions of X_{(r + j, ..., r + k)} given X_{(r, ..., r + j ? 1)}, X_{(r, ..., r + k)} given (X_(r) > t)?and X_{(r, ..., r + k)} given (X_{(r + k)} < t) are special types of singular SUN distributions. We use these results to determine some measures in the reliability theory such as the mean past life (MPL) function and mean residual life (MRL) function.     

On a conjecture of Kakosyan,Klebanov and Melamed

Suppose X₁, X₂, ..., X_m is a random sample of size m from a population with probability density function f(x), x>0 and let X_1,m<...m,m be the corresponding order statistics. We assume m as an integer valued random variable with P(m=k)=p(1?p)^k?1, k=1, 2, ... and 0 and n X_1,n for fixed n characterizes the exponential distribution. In this paper we prove that under the assumption of monotone hazard rate the identical distribution of and (n?r+1) (X_r,n?X_r?1,n) for some fixed r and n with 1≤r≤n, n≥2, X_0,n=0, characterizes the exponential distribution. Under the assumption of monotone hazard rate the conjecture of Kakosyan, Klebanov and Melamed follows from the above result with r=1.     

A test of linearity against functional coefficient autoregressive models

Our object in this paper is to propose a powerful test for detecting a broad class of nonlinearity of time series as one application of the method by Matsuda (1998). Consider autoregresive models X_t=Φ₁X_t?1+…+Φ_ρX_t?ρ+ε_t and we propose a statistic for testing whether or not Φ_i depends on delayed values X_t?d for some i. We compare the power of our test with that of tests proposed by Luukkonen, Saikkonen and Teräsvirta (1988a) and Hjellvik and TjΦstheim (1995) by simulation studies and our test is shown to be satisfactory.     

Asymptotics for multisample statistics

Consider a family of square-integrable R^d-valued statistics S_k = S_k(X_1,k1; X_2,k2;…; X_m,km), where the independent samples X_i,kj respectively have k_i i.i.d. components valued in some separable metric space X_i. We prove a strong law of large numbers, a central limit theorem and a law of the iterated logarithm for the sequence {S_k}, including both the situations where the sample sizes tend to infinity while m is fixed and those where the sample sizes remain small while m tends to infinity. We also obtain two almost sure convergence results in both these contexts, under the additional assumption that S_k is symmetric in the coordinates of each sample X_i,kj. Some extensions to row-exchangeable and conditionally independent observations are provided. Applications to an estimator of the dimension of a data set and to the Henze-Schilling test statistic for equality of two densities are also presented.