The consistency of a matching test

Let $\text{X}{}^1{}_1\text{?X}{}^1{}_2\text{???X}{}^1{}_{\mathrm{n}}$ be the order statistics of a random sample from a distribution on [0, 1]. Let A_k, the kth match, be the event that $\text{X}{}^1{}_{\mathrm{k}}\text{?(}\text{(k?1)}\text{n}\text{k}\text{n}$], and let S_n be the total number of matches. The consistency of S_n for testing uniform df, U, against df G≠U is investigated, and it is shown that S_n is consistent if the intersection of G with U has Lebesgue measure zero. It is also consistent against a sequence of alternatives approaching U at a rate less faster than $\text{n}{}^{\mathrm{<mtext>-1</mtext><mtext>2</mtext>}}$.     

Some aspects of the theory of estimating equations

An estimating equation for a parameter θ, based on an observation ?, is an equation g(x,θ)=0 which can be solved for θ in terms of x. An estimating equation is unbiased if the funaction g has 0 mean for every θ. For the case when the form of the frequency function p(x,θ) is completely specified up to the unknown real parameter θ, the optimality of the m.1 equation $\text{?}\text{log}\text{p}\text{?θ}\text{=0}$ in the class of all unbiased estimating equations was established by Godambe (1960). In this paper we allow the form of the frequency function p to vary assuming that $\text{x=(x}{}_1\text{,…,x}{}_{\mathrm{n}}\text{)?}\text{R}{}^{\mathrm{n}}$ and that under p, E(x_i)=θ. x₁,…, x_n are independent observations on a variate x, it is shown that among all the unbiased estimating equations for θ, $\text{x}\text{?}\text{?θ=0}$ is uniquely optimum up to a constant multiple.     

Fitting a multiple regression function

Consider the p-dimensional unit cube [0,1]^p, p≥1. Partition [0, 1]^p into n regions, R_1,n,…,R_n,n such that the volume Δ(R_j,n) is of order n^?1,j=1,…,n. Select and fix a point in each of these regions so that we have x⁽ⁿ⁾₁,…,x⁽ⁿ⁾_n. Suppose that associated with the j-th predictor vector x⁽ⁿ⁾_j there is an observable variable Y⁽ⁿ⁾_j, j=1,…,n, satisfying the multiple regression model $\text{Y}{}^{\mathrm{(n)}}{}_{\mathrm{j}}\text{=g(}\text{x}{}^{\mathrm{(n)}}{}_{\mathrm{j}}\text{)+e}{}^{\mathrm{(n)}}{}_{\mathrm{j}}$, where g is an unknown function defined on [0, 1]^pand {e⁽ⁿ⁾_j} are independent identically distributed random variables with Ee⁽ⁿ⁾₁=0 and Var e⁽ⁿ⁾₁=σ²<∞. This paper proposes as an estimator of g(x), where k(u) is a known p-dimensional bounded density and {a_n} is a sequence of reals converging to 0 asn→∞. Weak and strong consistency of g_n(x) and rates of convergence are obtained. Asymptoticnormality of the estimator is established. Also proposed is $\text{σ}{}^2{}_{\mathrm{n}}\text{=n}{}^{\mathrm{?1}}\text{Σ}{}^{\mathrm{n}}{}_{\mathrm{j=1}}\text{(Y}{}^{\mathrm{(n)}}{}_{\mathrm{j}}\text{?g}{}_{\mathrm{n}}\text{(}\text{x}{}^{\mathrm{(n)}}{}_{\mathrm{j}}\text{))}{}^2$ as a consistent estimate of σ².     

Non-parametric recursive estimates of a probability density function and its derivatives

Recursive estimates of a probability density function (pdf) are known. This paper presents recursive estimates of a derivative of any desired order of a pdf. Let f be a pdf on the real line and p?0 be any desired integer. Based on a random sample of size n from f, estimators f^(p)_n of f^(p), the pth order derivatives of f, are exhibited. These estimators are of the form $\text{n}{}^{\mathrm{?1}}\text{∑n}\text{j=1}\text{δ}{}_{\mathrm{jp}}$, where δ_jp depends only on p and the jth observation in the sample, and hence can be computed recursively as the sample size increases. These estimators are shown to be asymptotically unbiased, mean square consistent and strongly consistent, both at a point and uniformly on the real line. For pointwise properties, the conditions on f^(p) have been weakened with a little stronger assumption on the kernel function.     

A note on the asymptotic efficiency of the sobel–wald test

Let X₁,X₂, … be iid random variables with the pdf f(x,θ)=exp(θx?b(θ)) relative to a σ-finite measure μ, and consider the problem of deciding among three simple hypotheses H_i:θ=θ_i (1?i?3) subject to P(acceptH_i|θ_i)=1?α (1?i?3). A procedure similar to Sobel–Wald procedure is discussed and its asymptotic efficiency as compared with the best nonsequential test is obtained by finding the limit lim_a→0(E_iN(a)/n(a)), where N (a) is the stopping time of the proposed procedure and n(a) is the sample size of the best non-sequential test. It is shown that the same asymptotic limit holds for the original Sobel–Wald procedure. Specializing to N(θ,1) distribution it is found that lim_a→0$\text{(E}{}_{\mathrm{i}}\text{N(α)/n(α))=}\text{1}\text{4}$ (i=1,2) and lim_a→0 (E₃N(α)n(α))=δ²₁/4δ, where δ_i=(θ_i+1?θ_i) with 0<δ₁?δ₂. Also, the asymptotic efficiency evaluated when the X's have an exponential distribution.     

Robust designs and optimality of least squares for regression problems

Unbiased linear estimators are considered for the model

$\text{Y(}\text{x}{}_{\mathrm{i}}\text{)=θ}{}_0\text{+}\text{∑k}\text{j=1}\text{θ}{}_{\mathrm{j}}\text{x}{}_{\mathrm{ij}}\text{+ψ(}\text{x}{}_{\mathrm{i}}\text{)+ε}{}_{\mathrm{i}}\text{, i=1,2,…,n,}$

where ψ(x) is an unknown contamination. It is assumed that |ψ(x)|?φ(6x6) where φ is a convex function. Minimax analogues of Φ_p-optimality criteria are introduced. It is shown that, under certain (sufficient) conditions, the least squares estimators and corresponding designs are optimal in the class of all unbiased linear estimators and designs. It is also shown that, in the case when least squares estimators with symmetric design do not lead to an optimal solution, the relative efficiency of optimal least squares is not diminishing and has a uniform lower bound.     

Moderate deviations for LS estimator in simple linear EV regression model

In this paper, we consider the following simple linear Errors-in-Variables (EV) regression model _ηi=θ+β_xi+_?i${\eta }_i=\theta +\beta x_i+{?}_i$, _ξi=_xi+_δi${\xi }_i=x_i+{\delta }_i$, 1?i?n$1?i?n$. The moderate deviation principle for the least squares (LS) estimators of the unknown parameters θ$\theta$, β$\beta$ in the model are obtained.     

Asymptotic distribution of hotelling's trace for two unequal covariance matrices and robustness study of test of equality of mean vectors

Asymptotic expansions for the percentiles and c.d.f., up to terms of order $\text{1}\text{n}{}^2$ of the statistic $\text{T =m}\text{T}\text{r}\text{S}{}_1\text{S}{}^{-1}{}_2$, where mS₁ and nS₂ independently distributed W(m, p, Σ₁) and W(n, p, Σ₂) respectively, are obtained using methods similar to those of Ito [4], Chattopadhyay and Pillai [2]. These expansions hold when $\text{Σ}{}_1\text{Σ}{}^{-1}{}_2\text{=}\text{I}\text{+}\text{F}$ and$\text{|}\text{Ch}{}_{\mathrm{i}}\text{(}\text{F}\text{)| < 1}$. Tables of powers of T for p = 3 and p = 4 for m = 4 and various values of n are given and comparison made with the exact powers for p = 3. These powers are useful for the study of (i) the test of equality of covariance matrices in two p-variate normal populations and (ii) robustness of test of equality of mean vectors of l normal populations against the violation of the assumption of equality of covariance matrices.     

Gaussian approximation of signed rank statistics process

We consider the signed linear rank statistics of the form

$\text{S}{}_{\mathrm{\Delta N}}\text{=}\text{∑}\text{i=1}\text{N}\text{c}{}_{\mathrm{Ni}}\text{ø(}\text{R}{}^{\mathrm{\Delta }}{}_{\mathrm{Ni}}\text{(N+1)}\text{)}\text{sgn}\text{Y}{}^{\mathrm{\Delta }}{}_{\mathrm{Ni}}$

where the c_Ni's are known real numbers, Δ∈[0,1] is an unknown real parameter,R^Δ_Ni is the rank of |Y^Δ_Ni| among |Y^Δ_Nj|, 1≤j≤N, ø is a score generating function, sgn y=1 or -1 according as y≥0 or <0, and Y^Δ_Nj, 1≤j ≤N, are independent random variables with continuous cumulative distribution functions F(y?Δd_Nj), 1≤ j≤N, respectively where the d_fNi's are known real numbers. Under suitable assumptions on the c's, d's, φ and F, it is proved that the random process {S_ΔN?S_0N?ES_ΔN, 0≤Δ≤1}, properly normalized, converges weakly to a Gaussian process, and this result is also true if ES_ΔN is replaced by Δb_N, where

$\text{b}{}_{\mathrm{N}}\text{=4}\text{∑}\text{i=1}\text{N}\text{c}{}_{\mathrm{Ni}}\text{d}{}_{\mathrm{Ni}}\text{∫}\text{0}\text{∞}\text{ø′(2F(x)?1)?}{}^2\text{(x)}\text{d}\text{x}\text{and}\text{?=F′}$

. As an application, we derive the asymptotic distribution of the properly normalized length of a confidence interval for Δ.     

New estimator for functions of the canonical correlation coefficients

Let ρ₁,…,ρ_p be the population canonical correlation coefficients from a normal distribution. This paper considers the estimation of δ₁,…,δ_p, where $\text{δ}{}_{\mathrm{i}}\text{=ρ}{}_{\mathrm{i}}{}^2\text{/(1−ρ}{}_{\mathrm{i}}{}^2\text{),}\text{i=1,…,p}$, in a decision theoretic way. Since the distribution of δ_i's is complicated, two-staged estimation has been a usual method so far; i.e., first find a good estimator of a matrix whose eigenvalues are the δ_i's, then use its eigenvalues as the estimators of δ_i's. In this paper we directly estimate δ_i's and evaluate the estimators with respect to a quadratic loss function. We propose a new class of estimators and prove its dominance over the usual estimator.     

Empirical Bayes regression analysis with many regressors but fewer observations

In this paper, we consider the prediction problem in multiple linear regression model in which the number of predictor variables, p, is extremely large compared to the number of available observations, n  . The least-squares predictor based on a generalized inverse is not efficient. We propose six empirical Bayes estimators of the regression parameters. Three of them are shown to have uniformly lower prediction error than the least-squares predictors when the vector of regressor variables are assumed to be random with mean vector zero and the covariance matrix (1/n)X^tX$(1/n){\mathit{X}}^{\mathrm{t}}\mathit{X}$ where X^t=(_x1,…,_xn)${\mathit{X}}^{\mathrm{t}}=({\mathit{x}}_1,\dots ,{\mathit{x}}_n)$ is the p×n$p\times n$ matrix of observations on the regressor vector centered from their sample means. For other estimators, we use simulation to show its superiority over the least-squares predictor.     

Estimation of a standard measuring error by repeated measurements and sortings

A sorting-and-measuring machine (SMM) measures and sorts (classifies) on-line produced items into several groups according to their size. The measuring devices of the SMM perceive the actual item size with a random error ε and classify the item as being smaller than b iff z+ε<b. Here ε is a normal zero-mean r.v. with unknown standard deviation σ which is the main parameter characterizing the precision and technical condition of an SMM. The paper gives the following method of estimating σ. N₀ items are measured and N₁ of them are recognized by the SMM as belonging to the group a<z≤b. These N₁ items are sorted again and N₂ of them return to this group, these are sorted again, and so on. The estimation of σ is based on the statistics N_m/N_n. Moments of the ratio statistics N_m/N_n and their distributional properties are investigated. It turns out that the expected value of N_m/N_n depends almost linearly on σ which allows us to construct ‘almost’ unbiased estimators of type $\text{σ}\text{?}{}_{\mathrm{mn}}\text{=A}\textcolor{red}{}\text{N}{}_{\mathrm{m}}\text{/N}{}_{\mathrm{n}}\text{+B}$ with good propert including robustness with respect to the distribution of item size. Convex combinations of $\text{σ}\text{?}{}_{\mathrm{mn}}$ statistics are considered to obtain an estimator with minimal variance.     

Complete designs with blocks of maximal multiplicity

The set of distinct blocks of a block design is known as its support. We construct complete designs with parameters v(?7), k=3, λ=v ? 2 which contain a block of maximal multiplicity and with support size $\text{b}{}^1\text{= (}{}^{\mathrm{v}}{}_3\text{) ? 4(v ? 2)}$. Any complete design which contains such a block, and has parameters v, k, λ as above, must be supported on at most (^v₃) ? 4(v ? 2) blocks. Attention is given to complete designs because of their direct relationship to simple random sampling.     

Characterizations based on record values and order statistics

Consider a sequence of independent and identically distributed random variables {_Xi,i?1}$\{X_i,i?1\}$ with a common absolutely continuous distribution function F  . Let _X1:n?_X2:n???_Xn:n$X_{1:n}?X_{2:n}???X_{n:n}$ be the order statistics of {_X1,_X2,…,_Xn}$\{X_1,X_2,\dots ,X_n\}$ and {_Yl,l?1}$\{Y_l,l?1\}$ be the sequence of record values generated by {_Xi,i?1}$\{X_i,i?1\}$. In this work, the conditional distribution of _Yl$Y_l$ given _Xn:n$X_{n:n}$ is established. Some characterizations of F   based on record values and _Xn:n$X_{n:n}$ are then given.     

Bounds on the empirical Bayes and compound risks of truncated versions of Robbins's estimator of a binomial parameter

Robbins (1956) in his original paper on empirical Bayes methods suggested a method of estimating a binomial success probability. We give explicit bounds for the empirical Bayes risk of natural variants of the Robbins estimator that show convergence to an optimal risk at $\text{O(n}{}^{\mathrm{<mtext>?</mtext><mtext>1</mtext><mtext>2</mtext>}}\text{)}$ rate. Bounds that yield the same convergence rate are also obtained in the related compound estimation problem.     

Optimum designs in complete two-way layouts

In the usual two-way layout of ANOVA (interactions are admitted) let nij ? 1 be the number of observations for the factor-level combination(i, j). For testing the hypothesis that all main effects of the first factor vanish numbers $\text{n}{}^1\text{ij}$ are given such that the power function of the F-test is uniformly maximized (U-optimality), if one considers only designs (nij) for which the row-sums ni are prescribed. Furthermore, in the (larger) set of all designs for which the total number of observations is given, all D-optimum designs are constructed.     

Some determinant optimality aspects of main effect fold-over designs

Saha and Mohanty (1970) presented a main effect fold-over design consisting of 14 treatment combinations of the 24×33 factorial, which had the nice property of being even balanced. Calling this design DSM, this paper establishes the following specific results: (i) DSM is not d-optimal in the subclass Δe of all 14 point even balanced main effect fold-over designs of the 24×33 factorial; (ii) DSM is not d-optimal in the subclass $\text{Δ}{}^1\text{?Δ}{}^{\mathrm{e}}$ of all 14 point even and odd balanced main effect fold-over designs of the 24×33 factorial; (iii) DSM is even optimal in $\text{Δ}{}^1$ and Δe. In addition to these results two 14 point designs in $\text{Δ}{}^1$ are presented which are d-optimal and via a counter example it is shown that these designs are not odd optimal. Finally, several general matrix algebra results are given which should be useful in resolving d-optimality problems of fold-over designs of the kn11×kn22 factorial.     

A note on the estimation of the integral of ⨍2(x)

The estimation of $\text{γ=∫}{}^{\mathrm{\infty }}{}_{\mathrm{?\infty }}\text{?}{}^2\text{(x)dx}$, important in nonparametric inference, is discussed. Methods, based on either density estimators or on the lengths of nonparametric confidence intervals, are compared. We conclude that density type estimators have advantages over the estimators based on confidence intervals.