Sequential experimental design and response optimisation

We consider the situation where one wants to maximise a functionf(θ,x) with respect tox, with θ unknown and estimated from observationsy _k . This may correspond to the case of a regression model, where one observesy _k =f(θ,x _k )+ε _k , with ε _k some random error, or to the Bernoulli case wherey _k ∈{0, 1}, with Pr[y _k =1|θ,x _k |=f(θ,x _k ). Special attention is given to sequences given by , with an estimated value of θ obtained from (x₁, y₁),...,(x _k ,y _k ) andd _k (x) a penalty for poor estimation. Approximately optimal rules are suggested in the linear regression case with a finite horizon, where one wants to maximize ∑ _i=1 ^N w _i f(θ, x _i ) with {w _i } a weighting sequence. Various examples are presented, with a comparison with a Polya urn design and an up-and-down method for a binary response problem.     

A characterization of invariant power-series abundance distributions

Consider a population the individuals in which can be classified into groups. Let y, the number of individuals in a group, be distributed according to a probability function f(y;ø_o) where the functional form f is known. The random variable y cannot be observed directly, and hence a random sample of groups cannot be obtained. Consider a random sample of N individuals from the population. Suppose the N individuals are distributed into S groups with x₁, x₂, …, x_S representatives respectively. The random variable x, the number of individuals in a group in the sample, will be a fraction of its population counterpart y, and the distributions of x and y need not have the same functional form. If the two random variables x and y have the same functional form for their distributions, then the particular common distribution is called an invariant abundance distribution. The paper provides a characterization of invariant abundance distributions in the class of power-series distributions.     

HITTING LINES and CIRCLES WITH DIFFUSION PROCESSES

For (x(t),y(t)), a diffusion process starting from (x(0),y(0)) = (x,y), the problem of computing the moment generating function of the first passage time T(x, y) to a given subset D of IR²is considered. A particular case of the method of similarity solutions is used. The problems that can be solved explicitly are those for which D is either a straight line or a circle.     

THE DIFFERENCE BETWEEN TWO POISSON EXPECTATIONS1

A number of statistics have been suggested for testing the difference between two Poisson expectations. On the basis of size and power calculations a new statistic, v= (2x+ 3/4)1/2 - (2y + 3/4)1/2, where x and y are the two observed Poisson values, is recommended for testing such differences. This statistic is shown to be similar in performance to the familiar u=(x-y)f(x+y)1/2, except in the tails of the distribution where it is superior.     

A class of tests for testing ‘new is better than used’

A class of tests is proposed for testing H₀ F?(x) = e^?λx, λ > 0, x≥0 vs. H₁ F?(x + y) ≤ F?(x)F?(y), x, y≥0, with strict inequality for some x, y ≥ 0 (F = new is better than used). Efficiency comparisons of some tests within the class are made and a new test is proposed on the basis of these comparisons. Consistency and the asymptotic normality of the class of tests is proved under fairly broad conditions on the underlying entities.     

The Uniform Asymptotics of the Overshoot of a Random Walk with Light-Tailed Increments

Let {S _n : n ≥ 0} be a random walk with light-tailed increments and negative drift, and let τ(x) be the first time when the random walk crosses a given level x ≥ 0. Tang (2007 Tang , Q. ( 2007 ). The overshoot of a random walk with negative drift . Statist. Probab. Lett. 77 : 158 – 165 .[Crossref], [Web of Science ®] , [Google Scholar]) obtained the asymptotics of P(S _τ(x) ? x > y, τ(x) < ∞) as x → ∞, which is uniform for y ≥ f(x) for any positive function f(x) → ∞ as x → ∞. In this article, the uniform asymptotics of P(S _τ(x) ? x > y, τ(x) < ∞) as x → ∞, for 0 ≤ y ≤ N for any positive number N will be given. Using the above two results, the uniform asymptotics of P(S _τ(x) ? x > y, τ(x) < ∞) as x → ∞, for y ≥ 0, is presented.     

The number of records within a random interval of the current record value

LetX ₁,X ₂, … be a sequence of i.i.d. random variables with some continuous distribution functionF. LetX(n) be then-th record value associated with this sequence and μ _n ⁻ , μ _n ⁺ be the variables that count the number of record values belonging to the random intervals(f−(X(n)), X(n)), (X(n), f+(X(n))), wheref−, f+ are two continuous functions satisfyingf−(x)<x, f+(x)>x. Properties of μ _n ⁻ , μ _n ⁺ are studied in the present paper. Some statistical applications connected with these variables are also provided.     

The Characterization of the Symmetric Lorenz Curves by Doubly Truncated Mean Function

We characterize symmetric Lorenz curves by the relation m(x, μ²/x) = μ (where μ =E(X) and m(x, y) = E(X | x ≤ X ≤ y) is the doubly truncated mean function). We establish that the points of the r.v. which generate the symmetric points on the Lorenz curve are x and μ²/x, and that all the distribution functions defined on the same support which are generators of the symmetric Lorenz curves have the same mean. We obtain the conditions under which doubly truncated distributions generate symmetrical Lorenz curves.     

Bounds on Bivariate Distribution Functions with Given Margins and Known Values at Several Points

Let H(x, y) be a continuous bivariate distribution function with known marginal distribution functions F(x) and G(y). Suppose the values of H are given at several points, H(x _i , y _i ) = θ _i , i = 1, 2,…, n. We first discuss conditions for the existence of a distribution satisfying these conditions, and present a procedure for checking if such a distribution exists. We then consider finding lower and upper bounds for such distributions. These bounds may be used to establish bounds on the values of Spearman's ρ and Kendall's τ. For n = 2, we present necessary and sufficient conditions for existence of such a distribution function and derive best-possible upper and lower bounds for H(x, y). As shown by a counter-example, these bounds need not be proper distribution functions, and we find conditions for these bounds to be (proper) distribution functions. We also present some results for the general case, where the values of H(x, y) are known at more than two points. In view of the simplification in notation, our results are presented in terms of copulas, but they may easily be expressed in terms of distribution functions.     

TESTING THE EQUALITY OF PARAMETERS IN THE DISTRIBUTIONS WHEN THE RANGE DEPENDS UPON THE PARAMETER

The authors derive the null and non-null distributions of the test statistic v=y_min/y_max (where y_min= min x_ij, y_max= max x_ij, J=1,2, …, k) connected with testing the equality of scale parameters θ₁, θ₂, …θ_k in certain, class of density functions given by      

COMPARISON OF THREE NON-PARAMETRIC TESTS FOR BIVARIATE INTERCHANGEABILITY1

Given a random sample(X₁, Y₁), …,(X_n, Y_n) from a bivariate (BV) absolutely continuous c.d.f. H (x, y), we consider rank tests for the null hypothesis of interchangeability H₀: H(x, y). Three linear rank test statistics, Wilcoxon (W_N), sum of squared ranks (SSR_N) and Savage (S_N), are described in Section 1. In Section 2, asymptotic relative efficiency (ARE) comparisons of the three types of tests are made for Morgenstern (Plackett, 1965) and Moran (1969)BV alternatives with marginal distributions satisfying G(x) = F(x/θ) for some θ≠ 1. Both gamma and lognormal marginal distributions are used.     

A lower bound for the transition density function of a stochastic differential equation

Let W_t be a one-dimensional Brownian motion on the probability space (Ω,F,P), and let dx_t = a(x_t)dt + b(x_t)dw_t, b²(x) > 0, be a one-dimensional Ito stochastic differential equation. For a(x) = a₀ + a₁x + … + a_nxⁿ on a bounded interval we obtain a lower bound for p(t,x,y), the transition density function of the homogeneous Markov process x_t, depending directly on the coefficients a₀,a₁, …, a_n, and b(x).     

A recipe for bivariate copulas

ABSTRACT

We give conditions on a ? ?1, b ∈ ( ? ∞, ∞), and f and g so that C_{a, b}(x, y) = xy(1 + af(x)g(y))^b is a bivariate copula. Many well-known copulas are of this form, including the Ali–Mikhail–Haq Family, Huang–Kotz Family, Bairamov–Kotz Family, and Bekrizadeh–Parham–Zadkarmi Family. One result is that we produce an algorithm for producing such copulas. Another is a one-parameter family of copulas whose measures of concordance range from 0 to 1.     

CERTAIN BOUNDS CONCERNING CHARACTERISTIC FUNCTIONS1

The largest value of the constant c for which holds over the class of random variables X with non-zero mean and finite second moment, is c=π. Let the random variable (r.v.) X with distribution function F(·) have non-zero mean and finite second moment. In studying a certain random walk problem (Daley, 1976) we sought a bound on the characteristic function of the form for some positive constant c. Of course the inequality is non-trivial only provided that . This note establishes that the best possible constant c =π. The wider relevance of the result is we believe that it underlines the use of trigonometric inequalities in bounding the (modulus of a) c.f. (see e.g. the truncation inequalities in §12.4 of Loève (1963)). In the present case the bound thus obtained is the best possible bound, and is better than the bound (2) |1-?(θ)| ≥ |θEX|-θ²EX²\2 obtained by applying the triangular inequality to the relation which follows from a two-fold integration by parts in the defining equation (*). The treatment of the counter-example furnished below may also be of interest. To prove (1) with c=π, recall that sin u > u(1-u/π) (all real u), so Since |E sinθX|-|E sin(-θX)|, the modulus sign required in (1) can be inserted into (4). Observe that since sin u > u for u < 0, it is possible to strengthen (4) to (denoting max(0,x) by x₊) To show that c=π is the best possible constant in (1), assume without loss of generality that EX > 0, and take θ > 0. Then (1) is equivalent to (6) c < θEX²/{EX-|1-?(θ)|/θ} for all θ > 0 and all r.v.s. X with EX > 0 and EX². Consider the r.v. where 0 < x < 1 and 0 < γ < ∞. Then EX=1, EX²=1+γx², From (4) it follows that |1-?(θ)| > 0 for 0 < |θ| <π|EX|/EX² but in fact this positivity holds for 0 < |θ| < 2π|EX|/EX² because by trigonometry and the Cauchy-Schwartz inequality, |1-?(θ)| > |Re(1-?(θ))| = |E(1-cosθX)| = 2|E sin²θX/2| (10) >2(E sinθX/2)² (11) >(|θEX|-θ²EX²/2π)²/2 > 0, the inequality at (11) holding provided that |θEX|-θ²EX²/2π > 0, i.e., that 0 < |θ| < 2π|EX|/EX². The random variable X at (7) with x= 1 shows that the range of positivity of |1-?(θ)| cannot in general be extended. If X is a non-negative r.v. with finite positive mean, then the identity shows that (1-?(θ))/iθEX is the c.f. of a non-negative random variable, and hence (13) |1-?(θ)| < |θEX| (all θ). This argument fans if pr{X < 0}pr{X> 0} > 0, but as a sharper alternative to (14) |1-?(θ)| < |θE|X||, we note (cf. (2) and (3)) first that (15) |1-?(θ)| < |θEX| +θ²EX²/2. For a bound that is more precise for |θ| close to 0, |1-?(θ)|²= (Re(1-?(θ)))²+ (Im?(θ))² <(θ²EX²/2)²+(|θEX| +θ²EX²_-/π)², so (16) |1-?(θ)| <(|θEX| +θ²EX²_-/π) + |θ|³(EX²)²/8|EX|.     

Limiting distributions of Kolmogorov-Lévy-type statistics under the alternative

Let X_i, 1 ≤ i ≤ n, be independent identically distributed random variables with a common distribution function F, and let G be a smooth distribution function. We derive the limit distribution of □{ρ_α(F_n, G) - _α(F, G)}, where F_n is the empirical distribution function based on X₁,…,X_n and _α is a Kolmogorov-Lévy-type metric between distribution functions. For α ≤ 0 and two distribution functions F and G the metric p_α is given by p_α(F, G) = inf {? ≤ 0: G(x - α?) - ? F(x) ≤ G(x + α?) + ? for all x ?}.     

Geometric ergodicity of nonlinear autoregressive models with changing conditional variances

The authors give easy‐to‐check sufficient conditions for the geometric ergodicity and the finiteness of the moments of a random process x_t = ?(x_t‐1,…, x_t‐p) + ?_tσ(x_t‐1,…, x_t‐q) in which ?: R^p → R, σ R^q → R and (?_t) is a sequence of independent and identically distributed random variables. They deduce strong mixing properties for this class of nonlinear autoregressive models with changing conditional variances which includes, among others, the ARCH(p), the AR(p)‐ARCH(p), and the double‐threshold autoregressive models.     

Missing at random (MAR) in nonparametric regression - A simulation experiment

The additive model is considered when some observations on x are missing at random but corresponding observations on y are available. Especially for this model, missing at random is an interesting case because the complete case analysis is expected to be no more suitable. A simulation experiment is reported and the different methods are compared based on their superiority with respect to the sample mean squared error. Some focus is also given on the sample variance and the estimated bias. In detail, the complete case analysis, a kind of stochastic mean imputation, a single imputation and the nearest neighbor imputation are discussed.     

Box-Cox transformed linear models: A parameter-based asymptotic approach

A Box-Cox transformed linear model usually has the form y(λ) = μ + β₁x₁ +… + β_px_p + oe, where y(λ) is the power transform of y. Although widely used in practice, the Fisher information matrix for the unknown parameters and, in particular, its inverse have not been studied seriously in the literature. We obtain those two important matrices to put the Box-Cox transformed linear model on a firmer ground. The question of how to make inference on β = (β₁,…,β_p)^T when λ; is estimated from the data is then discussed for large but finite sample size by studying some parameter-based asymptotics. Both unconditional and conditional inference are studied from the frequentist point of view.     

Berry–Esseen type bounds in heteroscedastic errors-in-variables model

ABSTRACT

Consider the heteroscedastic partially linear errors-in-variables (EV) model y_i = x_iβ + g(t_i) + ε_i, ξ_i = x_i + μ_i (1 ? i ? n), where ε_i = σ_ie_i are random errors with mean zero, σ²_i = f(u_i), (x_i, t_i, u_i) are non random design points, x_i are observed with measurement errors μ_i. When f( · ) is known, we derive the Berry–Esseen type bounds for estimators of β and g( · ) under {e_i,?1 ? i ? n} is a sequence of stationary α-mixing random variables, when f( · ) is unknown, the Berry–Esseen type bounds for estimators of β, g( · ), and f( · ) are discussed under independent errors.