Fitting a multiple regression function

Consider the p-dimensional unit cube [0,1]^p, p≥1. Partition [0, 1]^p into n regions, R_1,n,…,R_n,n such that the volume Δ(R_j,n) is of order n^?1,j=1,…,n. Select and fix a point in each of these regions so that we have x⁽ⁿ⁾₁,…,x⁽ⁿ⁾_n. Suppose that associated with the j-th predictor vector x⁽ⁿ⁾_j there is an observable variable Y⁽ⁿ⁾_j, j=1,…,n, satisfying the multiple regression model $\text{Y}{}^{\mathrm{(n)}}{}_{\mathrm{j}}\text{=g(}\text{x}{}^{\mathrm{(n)}}{}_{\mathrm{j}}\text{)+e}{}^{\mathrm{(n)}}{}_{\mathrm{j}}$, where g is an unknown function defined on [0, 1]^pand {e⁽ⁿ⁾_j} are independent identically distributed random variables with Ee⁽ⁿ⁾₁=0 and Var e⁽ⁿ⁾₁=σ²<∞. This paper proposes as an estimator of g(x), where k(u) is a known p-dimensional bounded density and {a_n} is a sequence of reals converging to 0 asn→∞. Weak and strong consistency of g_n(x) and rates of convergence are obtained. Asymptoticnormality of the estimator is established. Also proposed is $\text{σ}{}^2{}_{\mathrm{n}}\text{=n}{}^{\mathrm{?1}}\text{Σ}{}^{\mathrm{n}}{}_{\mathrm{j=1}}\text{(Y}{}^{\mathrm{(n)}}{}_{\mathrm{j}}\text{?g}{}_{\mathrm{n}}\text{(}\text{x}{}^{\mathrm{(n)}}{}_{\mathrm{j}}\text{))}{}^2$ as a consistent estimate of σ².     

Sequence-compound estimation in scale-exponential families and speed of convergence

This paper deals with a sequence-compound estimation. The component problem is the squared error loss estimation of θ?[a,b] based on an observation X whose p.d.f. is of the form $\text{u(x)c(θ)}\text{exp}\text{(?}\text{x}\text{θ}\text{)}$. For each $\text{0<t<}\text{1}\text{2}$ a class of sequence-compound estimators $\text{ψ}\text{?}\text{=}\text{ψ}\text{?}{}_1\text{,}\text{ψ}\text{?}{}_2\text{,…)}$ is exhibited whose compound risk (average of risks) up to stage n differs from the Bayes envelope (in the component problem) w.r.t. the empiric distribution G_n of the parameters involved up to stage n by a quantity of order O(n^?δt) for a δ>0. It is also shown that at any stage i the difference of the risk of ψ?_i and the risk of the Bayes response w.r.t. G_i?1 is O(i^?δt). Examples of the above type of families are given where δ is min{1,$\text{2a}\text{b}$} and t is arbitrarily close to $\text{1}\text{2}$. Here it may be worthwhile to mention that a rate $\text{O}\text{(n}{}^{\mathrm{<mtext>?</mtext><mtext>1</mtext><mtext>2</mtext>}}\text{)}$ or better has not yet been obtained even in a very special family of densities.     

Non-parametric recursive estimates of a probability density function and its derivatives

Recursive estimates of a probability density function (pdf) are known. This paper presents recursive estimates of a derivative of any desired order of a pdf. Let f be a pdf on the real line and p?0 be any desired integer. Based on a random sample of size n from f, estimators f^(p)_n of f^(p), the pth order derivatives of f, are exhibited. These estimators are of the form $\text{n}{}^{\mathrm{?1}}\text{∑n}\text{j=1}\text{δ}{}_{\mathrm{jp}}$, where δ_jp depends only on p and the jth observation in the sample, and hence can be computed recursively as the sample size increases. These estimators are shown to be asymptotically unbiased, mean square consistent and strongly consistent, both at a point and uniformly on the real line. For pointwise properties, the conditions on f^(p) have been weakened with a little stronger assumption on the kernel function.     

A note on the asymptotic efficiency of the sobel–wald test

Let X₁,X₂, … be iid random variables with the pdf f(x,θ)=exp(θx?b(θ)) relative to a σ-finite measure μ, and consider the problem of deciding among three simple hypotheses H_i:θ=θ_i (1?i?3) subject to P(acceptH_i|θ_i)=1?α (1?i?3). A procedure similar to Sobel–Wald procedure is discussed and its asymptotic efficiency as compared with the best nonsequential test is obtained by finding the limit lim_a→0(E_iN(a)/n(a)), where N (a) is the stopping time of the proposed procedure and n(a) is the sample size of the best non-sequential test. It is shown that the same asymptotic limit holds for the original Sobel–Wald procedure. Specializing to N(θ,1) distribution it is found that lim_a→0$\text{(E}{}_{\mathrm{i}}\text{N(α)/n(α))=}\text{1}\text{4}$ (i=1,2) and lim_a→0 (E₃N(α)n(α))=δ²₁/4δ, where δ_i=(θ_i+1?θ_i) with 0<δ₁?δ₂. Also, the asymptotic efficiency evaluated when the X's have an exponential distribution.     

Gaussian approximation of signed rank statistics process

We consider the signed linear rank statistics of the form

$\text{S}{}_{\mathrm{\Delta N}}\text{=}\text{∑}\text{i=1}\text{N}\text{c}{}_{\mathrm{Ni}}\text{ø(}\text{R}{}^{\mathrm{\Delta }}{}_{\mathrm{Ni}}\text{(N+1)}\text{)}\text{sgn}\text{Y}{}^{\mathrm{\Delta }}{}_{\mathrm{Ni}}$

where the c_Ni's are known real numbers, Δ∈[0,1] is an unknown real parameter,R^Δ_Ni is the rank of |Y^Δ_Ni| among |Y^Δ_Nj|, 1≤j≤N, ø is a score generating function, sgn y=1 or -1 according as y≥0 or <0, and Y^Δ_Nj, 1≤j ≤N, are independent random variables with continuous cumulative distribution functions F(y?Δd_Nj), 1≤ j≤N, respectively where the d_fNi's are known real numbers. Under suitable assumptions on the c's, d's, φ and F, it is proved that the random process {S_ΔN?S_0N?ES_ΔN, 0≤Δ≤1}, properly normalized, converges weakly to a Gaussian process, and this result is also true if ES_ΔN is replaced by Δb_N, where

$\text{b}{}_{\mathrm{N}}\text{=4}\text{∑}\text{i=1}\text{N}\text{c}{}_{\mathrm{Ni}}\text{d}{}_{\mathrm{Ni}}\text{∫}\text{0}\text{∞}\text{ø′(2F(x)?1)?}{}^2\text{(x)}\text{d}\text{x}\text{and}\text{?=F′}$

. As an application, we derive the asymptotic distribution of the properly normalized length of a confidence interval for Δ.     

Minimum Hellinger distance estimation in a nonparametric mixture model

In this paper, we investigate the estimation problem of the mixture proportion λ$\lambda$ in a nonparametric mixture model of the form λF(x)+(1-λ)G(x)$\lambda F(x)+(1-\lambda )G(x)$ using the minimum Hellinger distance approach, where F and G are two unknown distributions. We assume that data from the distributions F and G   as well as from the mixture distribution λF+(1-λ)G$\lambda F+(1-\lambda )G$ are available. We construct a minimum Hellinger distance estimator of λ$\lambda$ and study its asymptotic properties. The proposed estimator is chosen to minimize the Hellinger distance between a parametric mixture model and a nonparametric density estimator. We also develop a maximum likelihood estimator of λ$\lambda$. Theoretical properties such as the existence, strong consistency, asymptotic normality and asymptotic efficiency of the proposed estimators are investigated. Robustness properties of the proposed estimator are studied using a Monte Carlo study. Two real data examples are also analyzed.     

Some aspects of the theory of estimating equations

An estimating equation for a parameter θ, based on an observation ?, is an equation g(x,θ)=0 which can be solved for θ in terms of x. An estimating equation is unbiased if the funaction g has 0 mean for every θ. For the case when the form of the frequency function p(x,θ) is completely specified up to the unknown real parameter θ, the optimality of the m.1 equation $\text{?}\text{log}\text{p}\text{?θ}\text{=0}$ in the class of all unbiased estimating equations was established by Godambe (1960). In this paper we allow the form of the frequency function p to vary assuming that $\text{x=(x}{}_1\text{,…,x}{}_{\mathrm{n}}\text{)?}\text{R}{}^{\mathrm{n}}$ and that under p, E(x_i)=θ. x₁,…, x_n are independent observations on a variate x, it is shown that among all the unbiased estimating equations for θ, $\text{x}\text{?}\text{?θ=0}$ is uniquely optimum up to a constant multiple.     

Testing optimality of experimental designs for a regression model with random variables

Tsukanov (Theor. Probab. Appl. 26 (1981) 173–177) considers the regression model $\text{E(}\text{y}\text{|}\text{Z}\text{)=}\text{Fp}\text{+}\text{Zq}$, $\text{D(}\text{y}\text{|}\text{Z}\text{)=σ}{}^2\text{I}{}_{\mathrm{n}}$, where $\text{y}\text{(n×1)}$ is a vector of measured values,$\text{F}\text{(n×k)}$ contains the control variables, $\text{Z}\text{(n×l)}$ contains the observed values, and $\text{p}\text{(k×1)}$ and $\text{q}\text{(l×1)}$ are being estimated. Assuming that $\text{Z}\text{=}\text{FL}\text{+}\text{R}$, where $\text{L}\text{(k×l)}$ is non-random, and the rows of $\text{R}\text{(n×l)}$ are i.i.d. $\text{N(}\text{0}\text{,Σ)}$, we extend Tsukanov's results by (i) computing E(detH_p), where H_p is the covariance matrix of p?, the l.s.e. of p, (ii) considering ‘optimality in the mean’ for the largest root criterion, (iii) discussing these equations when the matrix R has a left-spherical distribution.     

Asymptotic distribution of hotelling's trace for two unequal covariance matrices and robustness study of test of equality of mean vectors

Asymptotic expansions for the percentiles and c.d.f., up to terms of order $\text{1}\text{n}{}^2$ of the statistic $\text{T =m}\text{T}\text{r}\text{S}{}_1\text{S}{}^{-1}{}_2$, where mS₁ and nS₂ independently distributed W(m, p, Σ₁) and W(n, p, Σ₂) respectively, are obtained using methods similar to those of Ito [4], Chattopadhyay and Pillai [2]. These expansions hold when $\text{Σ}{}_1\text{Σ}{}^{-1}{}_2\text{=}\text{I}\text{+}\text{F}$ and$\text{|}\text{Ch}{}_{\mathrm{i}}\text{(}\text{F}\text{)| < 1}$. Tables of powers of T for p = 3 and p = 4 for m = 4 and various values of n are given and comparison made with the exact powers for p = 3. These powers are useful for the study of (i) the test of equality of covariance matrices in two p-variate normal populations and (ii) robustness of test of equality of mean vectors of l normal populations against the violation of the assumption of equality of covariance matrices.     

Weakly resolvable IV.3 search designs for the pn factorial experiment

A series of weakly resolvable search designs for the pⁿ factorial experiment is given for which the mean and all main effects are estimable in the presence of any number of two-factor interactions and for which any combination of three or fewer pairs of factors that interact may be detected. The designs have N = p(p–1)n+p runs except in one case where additional runs are required for detection and one case where $\text{(p?1)}\text{2}$ additional runs are needed to estimate all (p–1)² degrees of freedom for each pair of detected interactions. The detection procedure is simple enough that computations can be carried out with hand calculations.     

Optimal Designs for Approximating a Stochastic Process with Respect to a Minimax Criterion

We study the problem of approximating a stochastic process Y = {Y(t: t ∈ T} with known and continuous covariance function R on the basis of finitely many observations Y(t ₁,), …, Y(t _n ). Dependent on the knowledge about the mean function, we use different approximations ? and measure their performance by the corresponding maximum mean squared error sub _t∈T E(Y(t) ? ?(t))². For a compact T ? ? ^p we prove sufficient conditions for the existence of optimal designs. For the class of covariance functions on T ² = [0, 1]² which satisfy generalized Sacks/Ylvisaker regularity conditions of order zero or are of product type, we construct sequences of designs for which the proposed approximations perform asymptotically optimal.     

Rate of consistency of one sample tests of location

Let X₁,…,X_n be a sample from a population with continuous distribution function F(x?θ) such that F(x)+F(-x)=1 and 0<F(x)<1, x?R¹. It is shown that the power- function of a monotone test of H: θ=θ₀ against K: θ>θ₀ cannot tend to 1 as θ?θ₀ → ∞ more than n times faster than the tails of F tend to 0. Some standard as well as robust tests are considered with respect to this rate of convergence.     

Bounds on the empirical Bayes and compound risks of truncated versions of Robbins's estimator of a binomial parameter

Robbins (1956) in his original paper on empirical Bayes methods suggested a method of estimating a binomial success probability. We give explicit bounds for the empirical Bayes risk of natural variants of the Robbins estimator that show convergence to an optimal risk at $\text{O(n}{}^{\mathrm{<mtext>?</mtext><mtext>1</mtext><mtext>2</mtext>}}\text{)}$ rate. Bounds that yield the same convergence rate are also obtained in the related compound estimation problem.     

Estimation of a standard measuring error by repeated measurements and sortings

A sorting-and-measuring machine (SMM) measures and sorts (classifies) on-line produced items into several groups according to their size. The measuring devices of the SMM perceive the actual item size with a random error ε and classify the item as being smaller than b iff z+ε<b. Here ε is a normal zero-mean r.v. with unknown standard deviation σ which is the main parameter characterizing the precision and technical condition of an SMM. The paper gives the following method of estimating σ. N₀ items are measured and N₁ of them are recognized by the SMM as belonging to the group a<z≤b. These N₁ items are sorted again and N₂ of them return to this group, these are sorted again, and so on. The estimation of σ is based on the statistics N_m/N_n. Moments of the ratio statistics N_m/N_n and their distributional properties are investigated. It turns out that the expected value of N_m/N_n depends almost linearly on σ which allows us to construct ‘almost’ unbiased estimators of type $\text{σ}\text{?}{}_{\mathrm{mn}}\text{=A}\textcolor{red}{}\text{N}{}_{\mathrm{m}}\text{/N}{}_{\mathrm{n}}\text{+B}$ with good propert including robustness with respect to the distribution of item size. Convex combinations of $\text{σ}\text{?}{}_{\mathrm{mn}}$ statistics are considered to obtain an estimator with minimal variance.     

Super efficient frequency estimation

In this paper we propose a modified Newton-Raphson method to obtain super efficient estimators of the frequencies of a sinusoidal signal in presence of stationary noise. It is observed that if we start from an initial estimator with convergence rate O_p(n⁻¹) and use Newton-Raphson algorithm with proper step factor modification, then it produces super efficient frequency estimator in the sense that its asymptotic variance is lower than the asymptotic variance of the corresponding least squares estimator. The proposed frequency estimator is consistent and it has the same rate of convergence, namely O_p(n^−3/2), as the least squares estimator. Monte Carlo simulations are performed to observe the performance of the proposed estimator for different sample sizes and for different models. The results are quite satisfactory. One real data set has been analyzed for illustrative purpose.     

On asymptotic properties of the parameter estimator for a type of SPDE

In this paper, we study a random field _U?(t,x)$U_{?}(t,x)$ governed by some type of stochastic partial differential equations with an unknown parameter θ$\theta$ and a small noise ?$?$. We construct an estimator of θ$\theta$ based on the continuous observation of N   Fourier coefficients of _U?(t,x)$U_{?}(t,x)$, and prove the strong convergence and asymptotic normality of the estimator when the noise ?$?$ tends to zero.