Some aspects of the theory of estimating equations

An estimating equation for a parameter θ, based on an observation ?, is an equation g(x,θ)=0 which can be solved for θ in terms of x. An estimating equation is unbiased if the funaction g has 0 mean for every θ. For the case when the form of the frequency function p(x,θ) is completely specified up to the unknown real parameter θ, the optimality of the m.1 equation $\text{?}\text{log}\text{p}\text{?θ}\text{=0}$ in the class of all unbiased estimating equations was established by Godambe (1960). In this paper we allow the form of the frequency function p to vary assuming that $\text{x=(x}{}_1\text{,…,x}{}_{\mathrm{n}}\text{)?}\text{R}{}^{\mathrm{n}}$ and that under p, E(x_i)=θ. x₁,…, x_n are independent observations on a variate x, it is shown that among all the unbiased estimating equations for θ, $\text{x}\text{?}\text{?θ=0}$ is uniquely optimum up to a constant multiple.     

Asymptotic distribution of hotelling's trace for two unequal covariance matrices and robustness study of test of equality of mean vectors

Asymptotic expansions for the percentiles and c.d.f., up to terms of order $\text{1}\text{n}{}^2$ of the statistic $\text{T =m}\text{T}\text{r}\text{S}{}_1\text{S}{}^{-1}{}_2$, where mS₁ and nS₂ independently distributed W(m, p, Σ₁) and W(n, p, Σ₂) respectively, are obtained using methods similar to those of Ito [4], Chattopadhyay and Pillai [2]. These expansions hold when $\text{Σ}{}_1\text{Σ}{}^{-1}{}_2\text{=}\text{I}\text{+}\text{F}$ and$\text{|}\text{Ch}{}_{\mathrm{i}}\text{(}\text{F}\text{)| < 1}$. Tables of powers of T for p = 3 and p = 4 for m = 4 and various values of n are given and comparison made with the exact powers for p = 3. These powers are useful for the study of (i) the test of equality of covariance matrices in two p-variate normal populations and (ii) robustness of test of equality of mean vectors of l normal populations against the violation of the assumption of equality of covariance matrices.     

Non-parametric recursive estimates of a probability density function and its derivatives

Recursive estimates of a probability density function (pdf) are known. This paper presents recursive estimates of a derivative of any desired order of a pdf. Let f be a pdf on the real line and p?0 be any desired integer. Based on a random sample of size n from f, estimators f^(p)_n of f^(p), the pth order derivatives of f, are exhibited. These estimators are of the form $\text{n}{}^{\mathrm{?1}}\text{∑n}\text{j=1}\text{δ}{}_{\mathrm{jp}}$, where δ_jp depends only on p and the jth observation in the sample, and hence can be computed recursively as the sample size increases. These estimators are shown to be asymptotically unbiased, mean square consistent and strongly consistent, both at a point and uniformly on the real line. For pointwise properties, the conditions on f^(p) have been weakened with a little stronger assumption on the kernel function.     

Gaussian approximation of signed rank statistics process

We consider the signed linear rank statistics of the form

$\text{S}{}_{\mathrm{\Delta N}}\text{=}\text{∑}\text{i=1}\text{N}\text{c}{}_{\mathrm{Ni}}\text{ø(}\text{R}{}^{\mathrm{\Delta }}{}_{\mathrm{Ni}}\text{(N+1)}\text{)}\text{sgn}\text{Y}{}^{\mathrm{\Delta }}{}_{\mathrm{Ni}}$

where the c_Ni's are known real numbers, Δ∈[0,1] is an unknown real parameter,R^Δ_Ni is the rank of |Y^Δ_Ni| among |Y^Δ_Nj|, 1≤j≤N, ø is a score generating function, sgn y=1 or -1 according as y≥0 or <0, and Y^Δ_Nj, 1≤j ≤N, are independent random variables with continuous cumulative distribution functions F(y?Δd_Nj), 1≤ j≤N, respectively where the d_fNi's are known real numbers. Under suitable assumptions on the c's, d's, φ and F, it is proved that the random process {S_ΔN?S_0N?ES_ΔN, 0≤Δ≤1}, properly normalized, converges weakly to a Gaussian process, and this result is also true if ES_ΔN is replaced by Δb_N, where

$\text{b}{}_{\mathrm{N}}\text{=4}\text{∑}\text{i=1}\text{N}\text{c}{}_{\mathrm{Ni}}\text{d}{}_{\mathrm{Ni}}\text{∫}\text{0}\text{∞}\text{ø′(2F(x)?1)?}{}^2\text{(x)}\text{d}\text{x}\text{and}\text{?=F′}$

. As an application, we derive the asymptotic distribution of the properly normalized length of a confidence interval for Δ.     

Robust designs and optimality of least squares for regression problems

Unbiased linear estimators are considered for the model

$\text{Y(}\text{x}{}_{\mathrm{i}}\text{)=θ}{}_0\text{+}\text{∑k}\text{j=1}\text{θ}{}_{\mathrm{j}}\text{x}{}_{\mathrm{ij}}\text{+ψ(}\text{x}{}_{\mathrm{i}}\text{)+ε}{}_{\mathrm{i}}\text{, i=1,2,…,n,}$

where ψ(x) is an unknown contamination. It is assumed that |ψ(x)|?φ(6x6) where φ is a convex function. Minimax analogues of Φ_p-optimality criteria are introduced. It is shown that, under certain (sufficient) conditions, the least squares estimators and corresponding designs are optimal in the class of all unbiased linear estimators and designs. It is also shown that, in the case when least squares estimators with symmetric design do not lead to an optimal solution, the relative efficiency of optimal least squares is not diminishing and has a uniform lower bound.     

Empirical Bayes regression analysis with many regressors but fewer observations

In this paper, we consider the prediction problem in multiple linear regression model in which the number of predictor variables, p, is extremely large compared to the number of available observations, n  . The least-squares predictor based on a generalized inverse is not efficient. We propose six empirical Bayes estimators of the regression parameters. Three of them are shown to have uniformly lower prediction error than the least-squares predictors when the vector of regressor variables are assumed to be random with mean vector zero and the covariance matrix (1/n)X^tX$(1/n){\mathit{X}}^{\mathrm{t}}\mathit{X}$ where X^t=(_x1,…,_xn)${\mathit{X}}^{\mathrm{t}}=({\mathit{x}}_1,\dots ,{\mathit{x}}_n)$ is the p×n$p\times n$ matrix of observations on the regressor vector centered from their sample means. For other estimators, we use simulation to show its superiority over the least-squares predictor.     

Sequence-compound estimation in scale-exponential families and speed of convergence

This paper deals with a sequence-compound estimation. The component problem is the squared error loss estimation of θ?[a,b] based on an observation X whose p.d.f. is of the form $\text{u(x)c(θ)}\text{exp}\text{(?}\text{x}\text{θ}\text{)}$. For each $\text{0<t<}\text{1}\text{2}$ a class of sequence-compound estimators $\text{ψ}\text{?}\text{=}\text{ψ}\text{?}{}_1\text{,}\text{ψ}\text{?}{}_2\text{,…)}$ is exhibited whose compound risk (average of risks) up to stage n differs from the Bayes envelope (in the component problem) w.r.t. the empiric distribution G_n of the parameters involved up to stage n by a quantity of order O(n^?δt) for a δ>0. It is also shown that at any stage i the difference of the risk of ψ?_i and the risk of the Bayes response w.r.t. G_i?1 is O(i^?δt). Examples of the above type of families are given where δ is min{1,$\text{2a}\text{b}$} and t is arbitrarily close to $\text{1}\text{2}$. Here it may be worthwhile to mention that a rate $\text{O}\text{(n}{}^{\mathrm{<mtext>?</mtext><mtext>1</mtext><mtext>2</mtext>}}\text{)}$ or better has not yet been obtained even in a very special family of densities.     

Embedding of orthogonal arrays of strength two and deficiency greater than two

Let x ≥ 0 and n ≥ 2 be integers. Suppose there exists an orthogonal array $\text{A(n, q, μ}{}^1\text{)}$ of strength 2 in n symbols with q rows and $\text{n}{}^2\text{μ}{}^1$ columns where $\text{q = q}{}^1\text{? d, q}{}^1\text{= n}{}^2\text{x + n + 1}$, $\text{μ}{}^1\text{= (n ?}\text{1}\text{)x +}\text{1}$ and d is a positive integer. Then d is called the deficiency of the orthogonal array. The question of embedding such an array into a complete array $\text{A(n, q}{}^1\text{, μ}{}^1\text{)}$ is considered for the case d ≥ 3. It is shown that for d = 3 such an embedding is always possible if n ≥ 2(d ? 1)²(2d² ? 2d + 1). Partial results are indicated if d ≥ 4 for the embedding of a related design in a corresponding balanced incomplete block design.     

The consistency of a matching test

Let $\text{X}{}^1{}_1\text{?X}{}^1{}_2\text{???X}{}^1{}_{\mathrm{n}}$ be the order statistics of a random sample from a distribution on [0, 1]. Let A_k, the kth match, be the event that $\text{X}{}^1{}_{\mathrm{k}}\text{?(}\text{(k?1)}\text{n}\text{k}\text{n}$], and let S_n be the total number of matches. The consistency of S_n for testing uniform df, U, against df G≠U is investigated, and it is shown that S_n is consistent if the intersection of G with U has Lebesgue measure zero. It is also consistent against a sequence of alternatives approaching U at a rate less faster than $\text{n}{}^{\mathrm{<mtext>-1</mtext><mtext>2</mtext>}}$.     

Testing optimality of experimental designs for a regression model with random variables

Tsukanov (Theor. Probab. Appl. 26 (1981) 173–177) considers the regression model $\text{E(}\text{y}\text{|}\text{Z}\text{)=}\text{Fp}\text{+}\text{Zq}$, $\text{D(}\text{y}\text{|}\text{Z}\text{)=σ}{}^2\text{I}{}_{\mathrm{n}}$, where $\text{y}\text{(n×1)}$ is a vector of measured values,$\text{F}\text{(n×k)}$ contains the control variables, $\text{Z}\text{(n×l)}$ contains the observed values, and $\text{p}\text{(k×1)}$ and $\text{q}\text{(l×1)}$ are being estimated. Assuming that $\text{Z}\text{=}\text{FL}\text{+}\text{R}$, where $\text{L}\text{(k×l)}$ is non-random, and the rows of $\text{R}\text{(n×l)}$ are i.i.d. $\text{N(}\text{0}\text{,Σ)}$, we extend Tsukanov's results by (i) computing E(detH_p), where H_p is the covariance matrix of p?, the l.s.e. of p, (ii) considering ‘optimality in the mean’ for the largest root criterion, (iii) discussing these equations when the matrix R has a left-spherical distribution.     

New estimator for functions of the canonical correlation coefficients

Let ρ₁,…,ρ_p be the population canonical correlation coefficients from a normal distribution. This paper considers the estimation of δ₁,…,δ_p, where $\text{δ}{}_{\mathrm{i}}\text{=ρ}{}_{\mathrm{i}}{}^2\text{/(1−ρ}{}_{\mathrm{i}}{}^2\text{),}\text{i=1,…,p}$, in a decision theoretic way. Since the distribution of δ_i's is complicated, two-staged estimation has been a usual method so far; i.e., first find a good estimator of a matrix whose eigenvalues are the δ_i's, then use its eigenvalues as the estimators of δ_i's. In this paper we directly estimate δ_i's and evaluate the estimators with respect to a quadratic loss function. We propose a new class of estimators and prove its dominance over the usual estimator.     

Nonparametric estimation of conditional expectation

Denote the integer lattice points in the N  -dimensional Euclidean space by Z^N${\mathbb{Z}}^N$ and assume that (_Xi,_Yi)$(X_{\mathbf{i}},Y_{\mathbf{i}})$, i∈Z^N$\mathbf{i}\in {\mathbb{Z}}^N$ is a mixing random field. Estimators of the conditional expectation r(x)=E[_Yi|_Xi=x]$r(\mathbf{x})=\mathrm{E}[Y_{\mathbf{i}}|X_{\mathbf{i}}=\mathbf{x}]$ by nearest neighbor methods are established and investigated. The main analytical result of this study is that, under general mixing assumptions, the estimators considered are asymptotically normal. Many difficulties arise since points in higher dimensional space N?2$N?2$ cannot be linearly ordered. Our result applies to many situations where parametric methods cannot be adopted with confidence.