Pseudo confidence regions for the solution of a multivariate linear functional relationship

The problem of finding confidence regions (CR) for a q-variate vector γ given as the solution of a linear functional relationship (LFR) Λγ = μ is investigated. Here an m-variate vector μ and an m × q matrix Λ = (Λ₁, Λ₂,…, Λ_q) are unknown population means of an m(q+1)-variate normal distribution $\text{N}{}_{\mathrm{m(q+1)}}\text{(ζΩ?Σ)}$, where ζ′ = (μ′, Λ₁′, Λ₂′,…, Λ_q′Σ is an unknown, symmetric and positive definite m × m matrix and Ω is a known, symmetric and positive definite (q+1) × (q+1) matrix and ? denotes the Kronecker product. This problem is a generalization of the univariate special case for the ratio of normal means.A CR for γ with level of confidence 1 ? α, is given by a quadratic inequality, which yields the so-called ‘pseudo’ confidence regions (PCR) valid conditionally in subsets of the parameter space. Our discussion is focused on the ‘bounded pseudo’ confidence region (BPCR) given by the interior of a hyperellipsoid. The two conditions necessary for a BPCR to exist are shown to be the consistency conditions concerning the multivariate LFR. The probability that these conditions hold approaches one under ‘reasonable circumstances’ in many practical situations. Hence, we may have a BPCR with confidence approximately 1 ? α. Some simulation results are presented.     

A stochastic Newton-Raphson method

A stochastic approximation procedure of the Robbins-Monro type is considered. The original idea behind the Newton-Raphson method is used as follows. Given n approximations X₁,…, X_n with observations Y₁,…, Y_n, a least squares line is fitted to the points (X_m, Y_m),…, (X_n, Y_n) where m<n may depend on n. The (n+1)st approximation is taken to be the intersection of the least squares line with y=0. A variation of the resulting process is studied. It is shown that this process yields a strongly consistent sequence of estimates which is asymptotically normal with minimal asymptotic variance.     

A modified cluster sampling method for estimating the bacterial density in Xanthan gum

Suppose particles are randomly distributed in a certain medium, powder or liquid, which is conceptually divided into N cells. Let p_i denote the probability that a particle falls in the ith cell and Y_i denote the number of particles in the ith cell. Assume that the joint probability function of the Y_i follows a multinomial distribution with cell probabilities p_i respectively. Take n (≤N) cells at random without replacement and put each of the cells separately through a mixing mechanism of dilution and swirl. These n cells constitute the first stage samples and the number of particles in these cells are not observable. Now conceptually divide each of n cells into M subcells of equal size and let X_ij denote the number of particles in the jth subcell of the ith cell selected in the first stage; i=1,2,…,N and j=1,2,…,M. Consequently assume that the conditional joint probability function of the X_ij given Y_i=y_i follows a multinomial distribution with equal cell probabilities. Now take m (≤M) subcells at random from each of the cells selected in the first stage sample. Assume that the numbers of particles in M×N subcells are observable. The properties of the estimator of the particle density per sample unit are investigated under the modified two-stage cluster sampling method. A laboratory experiment for Xanthan Gum Products is analyzed in order to examine the appropriateness of the model assumed in this paper.     

Gaussian approximation of signed rank statistics process

We consider the signed linear rank statistics of the form

$\text{S}{}_{\mathrm{\Delta N}}\text{=}\text{∑}\text{i=1}\text{N}\text{c}{}_{\mathrm{Ni}}\text{ø(}\text{R}{}^{\mathrm{\Delta }}{}_{\mathrm{Ni}}\text{(N+1)}\text{)}\text{sgn}\text{Y}{}^{\mathrm{\Delta }}{}_{\mathrm{Ni}}$

where the c_Ni's are known real numbers, Δ∈[0,1] is an unknown real parameter,R^Δ_Ni is the rank of |Y^Δ_Ni| among |Y^Δ_Nj|, 1≤j≤N, ø is a score generating function, sgn y=1 or -1 according as y≥0 or <0, and Y^Δ_Nj, 1≤j ≤N, are independent random variables with continuous cumulative distribution functions F(y?Δd_Nj), 1≤ j≤N, respectively where the d_fNi's are known real numbers. Under suitable assumptions on the c's, d's, φ and F, it is proved that the random process {S_ΔN?S_0N?ES_ΔN, 0≤Δ≤1}, properly normalized, converges weakly to a Gaussian process, and this result is also true if ES_ΔN is replaced by Δb_N, where

$\text{b}{}_{\mathrm{N}}\text{=4}\text{∑}\text{i=1}\text{N}\text{c}{}_{\mathrm{Ni}}\text{d}{}_{\mathrm{Ni}}\text{∫}\text{0}\text{∞}\text{ø′(2F(x)?1)?}{}^2\text{(x)}\text{d}\text{x}\text{and}\text{?=F′}$

. As an application, we derive the asymptotic distribution of the properly normalized length of a confidence interval for Δ.     

Comparison of rotatable designs for regression on balls,I (quadratic)

Designs for quadratic and cubic regression are considered when the possible choices of the controlable variable are points x=( x₁,x₂,…,x_q) in the q-dimensional. Full of radius R, B_q(R) ={x:Σ⁴_ix²_i?R²}. The designs that are optimum among rotatable designs with respect to the D-, A-, and E-optimality criteria are compared in their performance relative to these and other criteria, including extrapolation. Additionally, the performance of a design optimum for one value of R, when it is implemented for a different value of R, is investigated. Some of the results are developed algebraically; others, numerically. For example, in quadratic regression the A-optimum design appears to be fairly robust in its efficiency, under variation of criterion.     

A RENEWAL THEOREM IN MULTIDIMENSIONAL TIME

Let Y_l, Y₂,… be i.i.d., positive, integer-valued random variables with means, μ. Let the sequences {Y_ij, j= 1,2,…}, i= 1,…, r be independent copies of {Y₁, Y₂,…}. For n={n₁,…, n_r.}, n₁≥1, let S_n=S?ⁿ¹_k1=1= 1 …S?^nr_kr=1 Y_ik1… Y_rkr. We show that S?^N_k=1S?^∞_k1=1…S?^∞_nr=1 P[[S_n= k] ? [μ^-r N log^r-1 (N)/(r-1)!] as N →∞.     

A sequential design for a clinical trial with a linear prognostic factor

We study a randomized adaptive design to assign one of the L$L$ treatments to patients who arrive sequentially by means of an urn model. At each stage n$n$, a reward is distributed between treatments. The treatment applied is rewarded according to its response, 0?_Yn?1$0?Y_n?1$, and 1-_Yn$1-Y_n$ is distributed among the other treatments according to their performance until stage n-1$n-1$. Patients can be classified in K+1$K+1$ levels and we assume that the effect of this level in the response to the treatments is linear. We study the asymptotic behavior of the design when the ordinary least square estimators are used as a measure of performance until stage n-1$n-1$.     

Theory of factorial designs of the parallel flats type. I: the coefficient matrix

Let GF(s) be the finite field with s elements.(Thus, when s=3, the elements of GF(s) are 0, 1 and 2.)Let A(r×n), of rank r, and c_i(i=1,…,f), (r×1), be matrices over GF(s). (Thus, for n=4, r=2, f=2, we could have A=[¹¹¹⁰₀₁₂₁], c₁=[¹₀], c₂=[⁰₂].) Let T_i (i=1,…,f) be the flat in EG(n, s) consisting of the set of all the s^n?r solutions of the equations At=c_i, wheret′=(t₁,…,t_n) is a vector of variables.(Thus, EG(4, 3) consists of the 3⁴=81 points of the form (t₁,t₂,t₃,t₄), where t's take the values 0,1,2 (in GF(3)). The number of solutions of the equations At=c_i is s^n?r, where r=Rank(A), and the set of such solutions is said to form an (n?r)-flat, i.e. a flat of (n?r) dimensions. In our example, both T₁ and T₂ are 2-flats consisting of 3^4?2=9 points each. The flats T₁,T₂,…,T_f are said to be parallel since, clearly, no two of them can have a common point. In the example, the points of T₁ are (1000), (0011), (2022), (0102), (2110), (1121), (2201), (1212) and (0220). Also, T₂ consists of (0002), (2010), (1021), (2101), (1112), (0120), (1200), (0211) and (2222).) Let T be the fractional design for a sⁿ symmetric factorial experiment obtained by taking T₁,T₂,…,T_f together. (Thus, in the example, 3⁴=81 treatments of the 3⁴ factorial experiment correspond one-one with the points of EG(4,3), and T will be the design (i.e. a subset of the 81 treatments) consisting of the 18 points of T₁ and T₂ enumerated above.)In this paper, we lay the foundation of the general theory of such ‘parallel’ types of designs. We define certain functions of A called the alias component matrices, and use these to partition the coefficient matrix X (n×v), occuring in the corresponding linear model, into components X._j(j=0,1,…,g), such that the information matrix X is the direct sum of the X′._jX._j. Here, v is the total number of parameters, which consist of (possibly μ), and a (general) set of (geometric) factorial effects (each carrying (s?1) degrees of freedom as usual). For j≠0, we show that the spectrum of X′._jX._j does not change if we change (in a certain important way) the usual definition of the effects. Assuming that such change has been adopted, we consider the partition of the X._j into the X_ij (i=1,…,f). Furthermore, the X_ij are in turn partitioned into smaller matrices (which we shall here call the) X_ijh. We show that each X_ijh can be factored into a product of 3 matrices J, ζ (not depending on i,j, and h) and Q(j,h,i)where both the Kronecker and ordinary product are used. We introduce a ring R using the additive groups of the rational field and GF(s), and show that the Q(j,h,i) belong to a ring isomorphic to R. When s is a prime number, we show that R is the cyclotomic field. Finally, we show that the study of the X._j and X′._jX._j can be done in a much simpler manner, in terms of certain relatively small sized matrices over R.     

On the norm of alias matrices in balanced fractional 2m factorial designs of resolution 2l + 1

The norm $\text{6A6 = {tr(A′A)}}{}^{\mathrm{<mtext>1</mtext><mtext>2</mtext>}}$ of the alias matrix A of a design can be used as a measure for selecting a design. In this paper, an explicit expression for 6A6 will be given for a balanced fractional 2^m factorial design of resolution 2l + 1 which obtained from a simple array with parameters (m; λ₀, λ₁,…, λ_m). This array is identical with a balanced array of strength m, m constraints and index set {λ₀, λ₁,…, λ_m}. In the class of the designs of resolution V (l = 2) obtained from S-arrays, ones which minimize 6A6 will be presented for any fixed N assemblies satisfying (i) m = 4, 11 ? N ? 16, (ii) m = 5, 16 ? N ? 32, and (iii) m = 6, 22 ? N ? 40.     

Optimal Designs for Approximating a Stochastic Process with Respect to a Minimax Criterion

We study the problem of approximating a stochastic process Y = {Y(t: t ∈ T} with known and continuous covariance function R on the basis of finitely many observations Y(t ₁,), …, Y(t _n ). Dependent on the knowledge about the mean function, we use different approximations ? and measure their performance by the corresponding maximum mean squared error sub _t∈T E(Y(t) ? ?(t))². For a compact T ? ? ^p we prove sufficient conditions for the existence of optimal designs. For the class of covariance functions on T ² = [0, 1]² which satisfy generalized Sacks/Ylvisaker regularity conditions of order zero or are of product type, we construct sequences of designs for which the proposed approximations perform asymptotically optimal.     

Comparison of design for quadratic regression on cubes

Designs for quadratic regression are considered when the possible choices of the controllable variable are points x=(x₁,x₂,…,x_q) in the q-dimensional cube of side 2. The designs that are optimum with respect to such criteria as those of D-, A-, and E-optimality are compared in their performance relative to these and other criteria. Some of the results are developed algebraically; others, numerically. The possible supports of E-optimum designs are much more numerous than the D-optimum supports characterized earlier. The A-optimum design appears to be fairly robust in its efficiency, under variation of criterion.     

Characterizations of geometric distribution and discrete IFR (DFR) distributions using order statistics

Let X be a discrete random variable the set of possible values (finite or infinite) of which can be arranged as an increasing sequence of real numbers a₁<a₂<a₃<…. In particular, a_i could be equal to i for all i. Let X_1n≦X_2n≦?≦X_nn denote the order statistics in a random sample of size n drawn from the distribution of X, where n is a fixed integer ≧2. Then, we show that for some arbitrary fixed k(2≦k≦n), independence of the event {X_kn=X_1n} and X_1n is equivalent to X being either degenerate or geometric. We also show that the montonicity in i of P{X_kn = X_1n | X_1n = a_i} is equivalent to X having the IFR (DFR) property. Let a_i = i and $\text{G(i) = P(X≧i), i = 1, 2, …}$. We prove that the independence of {X_2n ? X_1n ∈B} and X_1n for all i is equivalent to X being geometric, where B = {m} (B = {m,m+1,…}), provided G(i) = q^i?1, 1≦i≦m+2 (1≦i≦m+1), where 0<q<1.     

Estimation of a finite population distribution function based on a linear model with unknown heteroscedastic errors

The authors consider a finite population ρ = {(Y_k, x_k), k = 1,…,N} conforming to a linear superpopulation model with unknown heteroscedastic errors, the variances of which are values of a smooth enough function of the auxiliary variable X for their nonparametric estimation. They describe a method of the Chambers‐Dunstan type for estimation of the distribution of {Y_k, k = 1,…, N} from a sample drawn from without replacement, and determine the asymptotic distribution of its estimation error. They also consider estimation of its mean squared error in particular cases, evaluating both the analytical estimator derived by “plugging‐in” the asymptotic variance, and a bootstrap approach that is also applicable to estimation of parameters other than mean squared error. These proposed methods are compared with some common competitors in simulation studies.     

Second order asymptotic relations of M-estimators and R-estimators in two-sample location model

Let T_M be an M-estimator (maximum likelihood type estimator) and T_R be an R-estimator (Hodges-Lehmann's estimator) of the shift parameter Δ in the two-sample location model. The asymptotic representation of √N(T_M-T_R) up to a term of the order O_p(N^{-$\text{1}\text{4}$}) is derived which is valid if the functions Ψ and ? generating T_M and T_R, respectively, decompose into an absolutely continuous and a step-function components; the order O_p(N^{-$\text{1}\text{4}$}) cannot be improved unless the discontinuous components vanish. As a consequence, the conditions under which √N(T_M-T_R)=O_p(N^{-$\text{1}\text{4}$}) are obtained. The main tool for obtaining the results is the second order asymptotic linearity of the pertaining linear rank statistics which is proved here under the assumption that the score-generating function ? has some jump-discontinuities.     

Minimax subset selection for the multinomial distribution

Let (X₁,…,X_k) be a multinomial vector with unknown cell probabilities (p₁,?,p_k). A subset of the cells is to be selected in a way so that the cell associated with the smallest cell probability is included in the selected subset with a preassigned probability, P¹. Suppose the loss is measured by the size of the selected subset, S. Using linear programming techniques, selection rules can be constructed which are minimax with respect to S in the class of rules which satisfy the P¹-condition. In some situations, the rule constructed by this method is the rule proposed by Nagel (1970). Similar techniques also work for selection in terms of the largest cell probability.     

Bootstrap test of goodness of fit to a linear model when errors are correlated

Given the regression model Y_i = m(x_i) +ε_i (x_i ε C, i = l,…,n, C a compact set in R) where m is unknown and the random errors {ε_i} present an ARMA structure, we design a bootstrap method for testing the hypothesis that the regression function follows a general linear model: H_o : m ε {mθ(.) = A^t(.)θ : θ ε ? ? R^q} with A a functional from R to R^q. The criterion of the test derives from a Cramer-von-Mises type functional distance D = d²([mcirc]_n, A^t(.)θ_n), between [mcirc]_n, a Gasser-Miiller non-parametric estimator of m, and the member of the class defined in H_o that is closest to m_n in terms of this distance. The consistency of the bootstrap distribution of D and θ_n is obtained under general conditions. Finally, simulations show the good behavior of the bootstrap approximation with respect to the asymptotic distribution of D = d².     

Approximations for marginal densities of M-estimators

We develop a saddle-point approximation for the marginal density of a real-valued function p(), where is a general M-estimator of a p-dimensional parameter, that is, the solution of the system {n^-1_ljl (Y_l,) = 0}_j=1,…,p. The approximation is applied to several regression problems and yields very good accuracy for small samples. This enables us to compare different classes of estimators according to their finite-sample properties and to determine when asymptotic approximations are useful in practice.     

A construction for generalized hadamard matrices

We prove that if p^r and p^r ? 1 are both prime powers then there is a generalized Hadamard matrix of order p^r(p^r ? 1) with elements from the elementary abelian group Z_p x?x Z_p. This result was motivated by results of Rajkundia on BIBD's. This result is then used to produce p^r ? 1 mutually orthogonal F-squares F(p^r(p^r ? 1); p^r ? 1).     

Robust Linear Calibration

We regard the simple linear calibration problem where only the response y of the regression line y = β₀ + β₁ t is observed with errors. The experimental conditions t are observed without error. For the errors of the observations y we assume that there may be some gross errors providing outlying observations. This situation can be modeled by a conditionally contaminated regression model. In this model the classical calibration estimator based on the least squares estimator has an unbounded asymptotic bias. Therefore we introduce calibration estimators based on robust one-step-M-estimators which have a bounded asymptotic bias. For this class of estimators we discuss two problems: The optimal estimators and their corresponding optimal designs. We derive the locally optimal solutions and show that the maximin efficient designs for non-robust estimation and robust estimation coincide.     

Small samples confidencce intervals on common mean of two normal distributions variances

Let X₁,X₂,…,X_m be distributed normally with mean μ and variance σ² _X; Let Y₁,Y₂,…,Y_n be distributed normally with mean μ and variance σ² _Y; let X₁,X₂,…,X_m,Y₁,Y₂,…,Y_n be jointly independent. There have been several papers written concerning point estimation of μ for this problem, but very little is available in the literature concerning confidence intervals on the common mean μ. In this paper a method is proposed that results in a confidence interval with confidence coefficient essentially equal to a prescribed value 1 - α. The method is evaluated and compnred with other methods through the expected length of the confidence interval.