Non-parametric recursive estimates of a probability density function and its derivatives

Recursive estimates of a probability density function (pdf) are known. This paper presents recursive estimates of a derivative of any desired order of a pdf. Let f be a pdf on the real line and p?0 be any desired integer. Based on a random sample of size n from f, estimators f^(p)_n of f^(p), the pth order derivatives of f, are exhibited. These estimators are of the form $\text{n}{}^{\mathrm{?1}}\text{∑n}\text{j=1}\text{δ}{}_{\mathrm{jp}}$, where δ_jp depends only on p and the jth observation in the sample, and hence can be computed recursively as the sample size increases. These estimators are shown to be asymptotically unbiased, mean square consistent and strongly consistent, both at a point and uniformly on the real line. For pointwise properties, the conditions on f^(p) have been weakened with a little stronger assumption on the kernel function.     

Fitting a multiple regression function

Consider the p-dimensional unit cube [0,1]^p, p≥1. Partition [0, 1]^p into n regions, R_1,n,…,R_n,n such that the volume Δ(R_j,n) is of order n^?1,j=1,…,n. Select and fix a point in each of these regions so that we have x⁽ⁿ⁾₁,…,x⁽ⁿ⁾_n. Suppose that associated with the j-th predictor vector x⁽ⁿ⁾_j there is an observable variable Y⁽ⁿ⁾_j, j=1,…,n, satisfying the multiple regression model $\text{Y}{}^{\mathrm{(n)}}{}_{\mathrm{j}}\text{=g(}\text{x}{}^{\mathrm{(n)}}{}_{\mathrm{j}}\text{)+e}{}^{\mathrm{(n)}}{}_{\mathrm{j}}$, where g is an unknown function defined on [0, 1]^pand {e⁽ⁿ⁾_j} are independent identically distributed random variables with Ee⁽ⁿ⁾₁=0 and Var e⁽ⁿ⁾₁=σ²<∞. This paper proposes as an estimator of g(x), where k(u) is a known p-dimensional bounded density and {a_n} is a sequence of reals converging to 0 asn→∞. Weak and strong consistency of g_n(x) and rates of convergence are obtained. Asymptoticnormality of the estimator is established. Also proposed is $\text{σ}{}^2{}_{\mathrm{n}}\text{=n}{}^{\mathrm{?1}}\text{Σ}{}^{\mathrm{n}}{}_{\mathrm{j=1}}\text{(Y}{}^{\mathrm{(n)}}{}_{\mathrm{j}}\text{?g}{}_{\mathrm{n}}\text{(}\text{x}{}^{\mathrm{(n)}}{}_{\mathrm{j}}\text{))}{}^2$ as a consistent estimate of σ².     

Testing optimality of experimental designs for a regression model with random variables

Tsukanov (Theor. Probab. Appl. 26 (1981) 173–177) considers the regression model $\text{E(}\text{y}\text{|}\text{Z}\text{)=}\text{Fp}\text{+}\text{Zq}$, $\text{D(}\text{y}\text{|}\text{Z}\text{)=σ}{}^2\text{I}{}_{\mathrm{n}}$, where $\text{y}\text{(n×1)}$ is a vector of measured values,$\text{F}\text{(n×k)}$ contains the control variables, $\text{Z}\text{(n×l)}$ contains the observed values, and $\text{p}\text{(k×1)}$ and $\text{q}\text{(l×1)}$ are being estimated. Assuming that $\text{Z}\text{=}\text{FL}\text{+}\text{R}$, where $\text{L}\text{(k×l)}$ is non-random, and the rows of $\text{R}\text{(n×l)}$ are i.i.d. $\text{N(}\text{0}\text{,Σ)}$, we extend Tsukanov's results by (i) computing E(detH_p), where H_p is the covariance matrix of p?, the l.s.e. of p, (ii) considering ‘optimality in the mean’ for the largest root criterion, (iii) discussing these equations when the matrix R has a left-spherical distribution.     

Some aspects of the theory of estimating equations

An estimating equation for a parameter θ, based on an observation ?, is an equation g(x,θ)=0 which can be solved for θ in terms of x. An estimating equation is unbiased if the funaction g has 0 mean for every θ. For the case when the form of the frequency function p(x,θ) is completely specified up to the unknown real parameter θ, the optimality of the m.1 equation $\text{?}\text{log}\text{p}\text{?θ}\text{=0}$ in the class of all unbiased estimating equations was established by Godambe (1960). In this paper we allow the form of the frequency function p to vary assuming that $\text{x=(x}{}_1\text{,…,x}{}_{\mathrm{n}}\text{)?}\text{R}{}^{\mathrm{n}}$ and that under p, E(x_i)=θ. x₁,…, x_n are independent observations on a variate x, it is shown that among all the unbiased estimating equations for θ, $\text{x}\text{?}\text{?θ=0}$ is uniquely optimum up to a constant multiple.     

Optimum designs in complete two-way layouts

In the usual two-way layout of ANOVA (interactions are admitted) let nij ? 1 be the number of observations for the factor-level combination(i, j). For testing the hypothesis that all main effects of the first factor vanish numbers $\text{n}{}^1\text{ij}$ are given such that the power function of the F-test is uniformly maximized (U-optimality), if one considers only designs (nij) for which the row-sums ni are prescribed. Furthermore, in the (larger) set of all designs for which the total number of observations is given, all D-optimum designs are constructed.     

Asymptotic distribution of hotelling's trace for two unequal covariance matrices and robustness study of test of equality of mean vectors

Asymptotic expansions for the percentiles and c.d.f., up to terms of order $\text{1}\text{n}{}^2$ of the statistic $\text{T =m}\text{T}\text{r}\text{S}{}_1\text{S}{}^{-1}{}_2$, where mS₁ and nS₂ independently distributed W(m, p, Σ₁) and W(n, p, Σ₂) respectively, are obtained using methods similar to those of Ito [4], Chattopadhyay and Pillai [2]. These expansions hold when $\text{Σ}{}_1\text{Σ}{}^{-1}{}_2\text{=}\text{I}\text{+}\text{F}$ and$\text{|}\text{Ch}{}_{\mathrm{i}}\text{(}\text{F}\text{)| < 1}$. Tables of powers of T for p = 3 and p = 4 for m = 4 and various values of n are given and comparison made with the exact powers for p = 3. These powers are useful for the study of (i) the test of equality of covariance matrices in two p-variate normal populations and (ii) robustness of test of equality of mean vectors of l normal populations against the violation of the assumption of equality of covariance matrices.     

Embedding of orthogonal arrays of strength two and deficiency greater than two

Let x ≥ 0 and n ≥ 2 be integers. Suppose there exists an orthogonal array $\text{A(n, q, μ}{}^1\text{)}$ of strength 2 in n symbols with q rows and $\text{n}{}^2\text{μ}{}^1$ columns where $\text{q = q}{}^1\text{? d, q}{}^1\text{= n}{}^2\text{x + n + 1}$, $\text{μ}{}^1\text{= (n ?}\text{1}\text{)x +}\text{1}$ and d is a positive integer. Then d is called the deficiency of the orthogonal array. The question of embedding such an array into a complete array $\text{A(n, q}{}^1\text{, μ}{}^1\text{)}$ is considered for the case d ≥ 3. It is shown that for d = 3 such an embedding is always possible if n ≥ 2(d ? 1)²(2d² ? 2d + 1). Partial results are indicated if d ≥ 4 for the embedding of a related design in a corresponding balanced incomplete block design.     

Sequence-compound estimation in scale-exponential families and speed of convergence

This paper deals with a sequence-compound estimation. The component problem is the squared error loss estimation of θ?[a,b] based on an observation X whose p.d.f. is of the form $\text{u(x)c(θ)}\text{exp}\text{(?}\text{x}\text{θ}\text{)}$. For each $\text{0<t<}\text{1}\text{2}$ a class of sequence-compound estimators $\text{ψ}\text{?}\text{=}\text{ψ}\text{?}{}_1\text{,}\text{ψ}\text{?}{}_2\text{,…)}$ is exhibited whose compound risk (average of risks) up to stage n differs from the Bayes envelope (in the component problem) w.r.t. the empiric distribution G_n of the parameters involved up to stage n by a quantity of order O(n^?δt) for a δ>0. It is also shown that at any stage i the difference of the risk of ψ?_i and the risk of the Bayes response w.r.t. G_i?1 is O(i^?δt). Examples of the above type of families are given where δ is min{1,$\text{2a}\text{b}$} and t is arbitrarily close to $\text{1}\text{2}$. Here it may be worthwhile to mention that a rate $\text{O}\text{(n}{}^{\mathrm{<mtext>?</mtext><mtext>1</mtext><mtext>2</mtext>}}\text{)}$ or better has not yet been obtained even in a very special family of densities.     

Optimality in presence of damaged observations

In this paper we study a situation where, instead of observing $\text{y}\text{(N×1)}$, we observe $\text{y}\text{+}\text{d}$; where the random variables in the vector d are called damage components. It is shown that A- and E-optimum designs minimize the effect of d in the mean square error (m.s.e.) of estimable linear functions of parameters under the ordinary linear model.     

Second order asymptotic relations of M-estimators and R-estimators in two-sample location model

Let T_M be an M-estimator (maximum likelihood type estimator) and T_R be an R-estimator (Hodges-Lehmann's estimator) of the shift parameter Δ in the two-sample location model. The asymptotic representation of √N(T_M-T_R) up to a term of the order O_p(N^{-$\text{1}\text{4}$}) is derived which is valid if the functions Ψ and ? generating T_M and T_R, respectively, decompose into an absolutely continuous and a step-function components; the order O_p(N^{-$\text{1}\text{4}$}) cannot be improved unless the discontinuous components vanish. As a consequence, the conditions under which √N(T_M-T_R)=O_p(N^{-$\text{1}\text{4}$}) are obtained. The main tool for obtaining the results is the second order asymptotic linearity of the pertaining linear rank statistics which is proved here under the assumption that the score-generating function ? has some jump-discontinuities.     

Some determinant optimality aspects of main effect fold-over designs

Saha and Mohanty (1970) presented a main effect fold-over design consisting of 14 treatment combinations of the 24×33 factorial, which had the nice property of being even balanced. Calling this design DSM, this paper establishes the following specific results: (i) DSM is not d-optimal in the subclass Δe of all 14 point even balanced main effect fold-over designs of the 24×33 factorial; (ii) DSM is not d-optimal in the subclass $\text{Δ}{}^1\text{?Δ}{}^{\mathrm{e}}$ of all 14 point even and odd balanced main effect fold-over designs of the 24×33 factorial; (iii) DSM is even optimal in $\text{Δ}{}^1$ and Δe. In addition to these results two 14 point designs in $\text{Δ}{}^1$ are presented which are d-optimal and via a counter example it is shown that these designs are not odd optimal. Finally, several general matrix algebra results are given which should be useful in resolving d-optimality problems of fold-over designs of the kn11×kn22 factorial.     

Measures of lack of fit from tests of chi-squared type

If X² is the Pearson chi-squared statistic for testing fit, then $\text{X}{}^2\text{n}$ has long been considered an associated measure of the degree of lack of fit. Here we consider two classes of statistics of chi-squared type, each having X² as a member. The first is a class of directed divergence statistics discussed by Cressie and Read, the second consists of nonnegative definite quadratic forms in the standardized cell frequencies. We investigate the large sample behavior of $\text{T}\text{n}$, where T is any of these statistics. A number of auxiliary results on the Cressie-Read statistics are also obtained. The measures are illustrated by application to data from classical physics compiled by Stigler.     

On the construction of m-associate PBIB designs I

The m-associate triangular association scheme has been discussed, and several series of partially balanced incomplete block (PBIB) designs with m-associate triangular association scheme have been obtained in Section 1. In Section 2, an m-associate triangular-group divisible association scheme $\text{(T}{}_{\mathrm{q}}\text{—}\text{GD}\text{m}\text{, 1<q<m)}$ has been introduced and several series of PBIB designs with m-associate triangular group divisible association scheme, from m-associate triangular PBIB designs have been constructed. Some numerical values to the three associate triangular designs, and three associate triangular group divisible designs in the range b, v≦100; r, k≦10, with their average efficiencies are given, respectively, in Tables I and II, in Section 3, where as usual v denotes the number of treatments, b the number of blocks, r the number of replications of each treatment, and k the block size.     

On the construction of orthogonal F-squares of order n from an orthogonal array (n, k, s, 2) and an OL(s, t) set

Complete sets of orthogonal F-squares of order n = s^p, where g is a prime or prime power and p is a positive integer have been constructed by Hedayat, Raghavarao, and Seiden (1975). Federer (1977) has constructed complete sets of orthogonal F-squares of order n = 4t, where t is a positive integer. We give a general procedure for constructing orthogonal F-squares of order n from an orthogonal array (n, k, s, 2) and an OL(s, t) set, where n is not necessarily a prime or prime power. In particular, we show how to construct sets of orthogonal F-squares of order n = 2s^p, where s is a prime or prime power and p is a positive integer. These sets are shown to be near complete and approach complete sets as s and/or p become large. We have also shown how to construct orthogonal arrays by these methods. In addition, the best upper bound on the number t of orthogonal F(n, λ₁), F(n, λ₂), …, F(n, λ₁) squares is given.     

Convergence rates of empirical Bayes estimation in exponential family

The convergence rates of empirical Bayes estimation in the exponential family are studied in this paper. We first develop an approach for obtaining the lower bound of empirical Bayes estimators. As an application of the approach, we demonstrate that O(n⁻¹) is the lower bound rate for priors with bounded compact support. Second, we construct an empirical Bayes estimator using kernel sequence method and show that it has a rate of convergence of $\text{O}\text{(n}{}^{\mathrm{-1}}\text{(}\text{ln}\text{n)}{}^8\text{)}$. This upper bound rate is much faster compared to the earlier results published in the literature under the same assumption.     

2n−m designs with resolution III or IV containing clear two-factor interactions

For a fixed number of runs, not all 2^n−m designs with resolution III or IV have clear two-factor interactions. Therefore, it is highly desirable to know when resolution III or IV designs can have clear two-factor interactions. In this paper, we provide a unified geometrical study of this problem and give a complete classification of the existence of clear two-factor interactions in regular 2^n−m designs with resolution III or IV and reveal the structures of these designs.     

A note on the asymptotic efficiency of the sobel–wald test

Let X₁,X₂, … be iid random variables with the pdf f(x,θ)=exp(θx?b(θ)) relative to a σ-finite measure μ, and consider the problem of deciding among three simple hypotheses H_i:θ=θ_i (1?i?3) subject to P(acceptH_i|θ_i)=1?α (1?i?3). A procedure similar to Sobel–Wald procedure is discussed and its asymptotic efficiency as compared with the best nonsequential test is obtained by finding the limit lim_a→0(E_iN(a)/n(a)), where N (a) is the stopping time of the proposed procedure and n(a) is the sample size of the best non-sequential test. It is shown that the same asymptotic limit holds for the original Sobel–Wald procedure. Specializing to N(θ,1) distribution it is found that lim_a→0$\text{(E}{}_{\mathrm{i}}\text{N(α)/n(α))=}\text{1}\text{4}$ (i=1,2) and lim_a→0 (E₃N(α)n(α))=δ²₁/4δ, where δ_i=(θ_i+1?θ_i) with 0<δ₁?δ₂. Also, the asymptotic efficiency evaluated when the X's have an exponential distribution.