Estimation of Conditional Ranks and Tests of Exogeneity in Nonparametric Nonseparable Models

Consider a nonparametric nonseparable regression model Y = ?(Z, U), where ?(Z, U) is strictly increasing in U and U ～ U[0, 1]. We suppose that there exists an instrument W that is independent of U. The observable random variables are Y, Z, and W, all one-dimensional. We construct test statistics for the hypothesis that Z is exogenous, that is, that U is independent of Z. The test statistics are based on the observation that Z is exogenous if and only if V = F_Y|Z(Y|Z) is independent of W, and hence they do not require the estimation of the function ?. The asymptotic properties of the proposed tests are proved, and a bootstrap approximation of the critical values of the tests is shown to be consistent and to work for finite samples via simulations. An empirical example using the U.K. Family Expenditure Survey is also given. As a byproduct of our results we obtain the asymptotic properties of a kernel estimator of the distribution of V, which equals U when Z is exogenous. We show that this estimator converges to the uniform distribution at faster rate than the parametric n^{? 1/2}-rate.     

Monotonicity Conditions and Inequality Imputation for Sample-Selection and Non-Response Problems

ABSTRACT

Under a sample selection or non-response problem, where a response variable y is observed only when a condition δ = 1 is met, the identified mean E(y|δ = 1) is not equal to the desired mean E(y). But the monotonicity condition E(y|δ = 1) ≤ E(y|δ = 0) yields an informative bound E(y|δ = 1) ≤ E(y), which is enough for certain inferences. For example, in a majority voting with δ being the vote-turnout, it is enough to know if E(y) > 0.5 or not, for which E(y|δ = 1) > 0.5 is sufficient under the monotonicity. The main question is then whether the monotonicity condition is testable, and if not, when it is plausible. Answering to these queries, when there is a ‘proxy’ variable z related to y but fully observed, we provide a test for the monotonicity; when z is not available, we provide primitive conditions and plausible models for the monotonicity. Going further, when both y and z are binary, bivariate monotonicities of the type P(y, z|δ = 1) ≤ P(y, z|δ = 0) are considered, which can lead to sharper bounds for P(y). As an empirical example, a data set on the 1996 U.S. presidential election is analyzed to see if the Republican candidate could have won had everybody voted, i.e., to see if P(y) > 0.5, where y = 1 is voting for the Republican candidate.     

The strong uniform convergence of multivariate variable kernel estimates

We show that sup, completely as, where f is a uniformly continuous density on are independent random vectors with common density f, and f_n is the variable kernel estimate Here H_ni is the distance between X_i and its kth nearest neighbour, K is a given density satisfying some regularity conditions, and k is a sequence of integers with the property that log asn     

Improved estimators for the selected location parameters

_i , i = 1, 2, ..., k be k independent exponential populations with different unknown location parameters θ _i , i = 1, 2, ..., k and common known scale parameter σ. Let Y _i denote the smallest observation based on a random sample of size n from the i-th population. Suppose a subset of the given k population is selected using the subset selection procedure according to which the population π _i is selected iff Y _i ≥Y ₍₁₎−d, where Y ₍₁₎ is the largest of the Y _i 's and d is some suitable constant. The estimation of the location parameters associated with the selected populations is considered for the squared error loss. It is observed that the natural estimator dominates the unbiased estimator. It is also shown that the natural estimator itself is inadmissible and a class of improved estimators that dominate the natural estimator is obtained. The improved estimators are consistent and their risks are shown to be O(kn ⁻²). As a special case, we obtain the coresponding results for the estimation of θ₍₁₎, the parameter associated with Y ₍₁₎. Received: January 6, 1998; revised version: July 11, 2000     

Estimation of the number of studies with positive trends when studies with negative trends are present

A two-point estimator is proposed for the proportion of studies with positive trends among a collection of studies, some of which may demonstrate negative trends. The proposed estimator is the y-intercept of the secant line joining the points (a, F?(a)) and (b, F?(b)), where F?(p) is the empirical distribution function of p-values from one-tailed tests for positive trend derived from the individual studies. Although this estimator is negatively biased for any choice of the points 0 ≤ a < b ≤ 1, the bias is less than that of the previously proposed one-point estimator defined by setting b = 1. The bias of the two-point estimator is smallest when a and b approach the inflection point of the true distribution function, E [F?(p)]. The utility of the two-point estimator is demonstrated by using it to estimate the number of male-mouse liver carcinogens among carcinogenicity studies conducted by the National Toxicology Program.     

Jensen's Inequality for General Location Parameter

A wide class of location parameters is shown to satisfy Jensen's inequality. When the expectation EX exists and l is a convex function, Jensen's inequality states that El(x) ≥ l(EX). It is shown that for μ, a properly defined location parameter, μ(l(x)) μ l(μ(x)).     

Consistent deconvolution in density estimation

Suppose we have n observations from X = Y + Z, where Z is a noise component with known distribution, and Y has an unknown density f. When the characteristic function of Z is nonzero almost everywhere, we show that it is possible to construct a density estimate f_n such that for all f, Iim_n| |=0.     

PLUG-IN ESTIMATION OF GENERAL LEVEL SETS

Given an unknown function (e.g. a probability density, a regression function, …) f and a constant c, the problem of estimating the level set L(c) ={f≥c} is considered. This problem is tackled in a very general framework, which allows f to be defined on a metric space different from . Such a degree of generality is motivated by practical considerations and, in fact, an example with astronomical data is analyzed where the domain of f is the unit sphere. A plug‐in approach is followed; that is, L(c) is estimated by L_n(c) ={f_n≥c} , where f_n is an estimator of f. Two results are obtained concerning consistency and convergence rates, with respect to the Hausdorff metric, of the boundaries ?L_n(c) towards ?L(c) . Also, the consistency of L_n(c) to L(c) is shown, under mild conditions, with respect to the L₁ distance. Special attention is paid to the particular case of spherical data.     

Particle swarm optimization based Liu-type estimator

In this study, a new method for the estimation of the shrinkage and biasing parameters of Liu-type estimator is proposed. Because k is kept constant and d is optimized in Liu’s method, a (k, d) pair is not guaranteed to be the optimal point in terms of the mean square error of the parameters. The optimum (k, d) pair that minimizes the mean square error, which is a function of the parameters k and d, should be estimated through a simultaneous optimization process rather than through a two-stage process. In this study, by utilizing a different objective function, the parameters k and d are optimized simultaneously with the particle swarm optimization technique.     

Nonparametric Benchmark Dose Estimation with Continuous Dose‐Response Data

We propose a new method for risk‐analytic benchmark dose (BMD) estimation in a dose‐response setting when the responses are measured on a continuous scale. For each dose level d, the observation X(d) is assumed to follow a normal distribution: . No specific parametric form is imposed upon the mean μ(d), however. Instead, nonparametric maximum likelihood estimates of μ(d) and σ are obtained under a monotonicity constraint on μ(d). For purposes of quantitative risk assessment, a ‘hybrid’ form of risk function is defined for any dose d as R(d) = P[X(d) < c], where c > 0 is a constant independent of d. The BMD is then determined by inverting the additional risk functionR_A(d) = R(d) ? R(0) at some specified value of benchmark response. Asymptotic theory for the point estimators is derived, and a finite‐sample study is conducted, using both real and simulated data. When a large number of doses are available, we propose an adaptive grouping method for estimating the BMD, which is shown to have optimal mean integrated squared error under appropriate designs.     

On the asymptotic distribution of an estimate of the change point in a failure rate

The failure rate r(t) is assumed to have the shape of the"first"part of the"bathtub"model, i.e.r(t) is non-increasing for t<r and is constant for t> r. Asymptotic distribution of one of the estimates proposed earlier has been investigated in this paper. This leads to a test for the hypothesis HQ r<r ₀ vs H :r>r (where TQ > 0). Asymptotic expression for the power of this test under Pitman alternatives is derived. Some simulations are reported.     

Efficient Estimation of a Distribution Function under Quadrant Dependence

LetX₁,X₂, ..., be real-valued random variables forming a strictly stationary sequence, and satisfying the basic requirement of being either pairwise positively quadrant dependent or pairwise negatively quadrant dependent. LetF^ be the marginal distribution function of theX_ips, which is estimated by the empirical distribution functionF_n and also by a smooth kernel-type estimateF_n, by means of the segmentX₁, ...,X_n. These estimates are compared on the basis of their mean squared errors (MSE). The main results of this paper are the following. Under certain regularity conditions, the optimal bandwidth (in the MSE sense) is determined, and is found to be the same as that in the independent identically distributed case. It is also shown thatn MSE(F_n(t)) andnMSE (F^_n(t)) tend to the same constant, asn→∞ so that one can not discriminate be tween the two estimates on the basis of the MSE. Next, ifi(n) = min {k∈{1, 2, ...}; MSE (F_k(t)) ≤ MSE (F_n(t))}, then it is proved thati(n)/n tends to 1, asn→∞. Thus, once again, one can not choose one estimate over the other in terms of their asymptotic relative efficiency. If, however, the squared bias ofF^_n(t) tends to 0 sufficiently fast, or equivalently, the bandwidthh_n satisfies the requirement thatnh³_n→ 0, asn→∞, it is shown that, for a suitable choice of the kernel, (i(n) ?n)/(nh_n) tends to a positive number, asn→∞ It follows that the deficiency ofF_n(t) with respect toF^_n(t),i(n) ?n, is substantial, and, actually, tends to ∞, asn→∞. In terms of deficiency, the smooth estimateF^_n(t) is preferable to the empirical distribution functionF_n(t)     

On the trimmed mean and minimax-variance L-estimation in Kolmogorov neighbourhoods

We consider the properties of the trimmed mean, as regards minimax-variance L-estimation of a location parameter in a Kolmogorov neighbourhood K() of the normal distribution: We first review some results on the search for an L-minimax estimator in this neighbourhood, i.e. a linear combination of order statistics whose maximum variance in K_t() is a minimum in the class of L-estimators. The natural candidate – the L-estimate which is efficient for that member of K_t,() with minimum Fisher information – is known not to be a saddlepoint solution to the minimax problem. We show here that it is not a solution at all. We do this by showing that a smaller maximum variance is attained by an appropriately trimmed mean. We argue that this trimmed mean, as well as being computationally simple – much simpler than the efficient L-estimate referred to above, and simpler than the minimax M- and R-estimators – is at least “nearly” minimax.     

ON CHARACTERIZATIONS THROUGH MIXED SUMS

Let X, X‘ and X“ be independent and have the same law, and let U be uniform on [0,1] and independent of X’ and XI”. A problem which has received considerable attention is to identify the laws of X for which X =c U(X‘+X“), the equality being in law. If X is positive it has an exponential law, and mixture solutions exist without the sign restriction. The problem has been extended to allow more summands on either side and to let U have a special beta law. In the positive case X then has a gamma law. This problem is tackled in full generality by considering an integral equation for the characteristic function of X. Uniqueness results and necessary conditions are given. The general case is reduced to that where X is positive, and the solution of the corresponding integral equation is constructed under the necessary conditions. This is shown to characterize all possible laws of X when there is a single summand on the left and U has an arbitrary law on [0,1]. Examples are given and known particular results are sharpened.     

Variable selection in partial linear regression with functional covariate

The problem of variable selection is considered in high-dimensional partial linear regression under some model allowing for possibly functional variable. The procedure studied is that of nonconcave-penalized least squares. It is shown the existence of a √n/s_n-consistent estimator for the vector of p_n linear parameters in the model, even when p_n tends to ∞ as the sample size n increases (s_n denotes the number of influential variables). An oracle property is also obtained for the variable selection method, and the nonparametric rate of convergence is stated for the estimator of the nonlinear functional component of the model. Finally, a simulation study illustrates the finite sample size performance of our procedure.     

Characterization theorems for some discrete distributions based on conditional structure

The joint distribution of (X,Y) is determined if the conditional expectation E {g(X)|Y = y} is given and the conditional distribution of Y|(X = x) is a conditional power series distribution, where g(·) is a function satisfying some minor conditions.     

On testing more IFRA ordering-II

ABSTRACT

Suppose F and G are two life distribution functions. It is said that F is more IFRA (increasing failure rate average) than G (written by F ? _*G) if G^{? 1}F(x) is star-shaped on (0, ∞). In this paper, the problem of testing H₀: F = _*G against H₁: F ? _*G and F ≠ _*G is considered in both cases when G is known and when G is unknown. We propose a new test based on U-statistics and obtain the asymptotic distribution of the test statistics. The new test is compared with some well-known tests in the literature. In addition, we apply our test to a real data set in the context of reliability.     

Scale Checks in Censored Regression

Abstract. Suppose the random vector (X,Y) satisfies the regression model Y = m(X) + σ (X) ? , where m (?) and σ (?) are unknown location and scale functions and ? is independent of X. The response Y is subject to random right censoring, and the covariate X is completely observed. A new test for a specific parametric form of any scale function σ (?) (including the standard deviation function) is proposed. Its statistic is based on the distribution of the residuals obtained from the assumed regression model. Weak convergence of the corresponding process is obtained, and its finite sample behaviour is studied via simulations. Finally, characteristics of the test are illustrated in the analysis of a fatigue data set.     

Optimal Nonparametric Quantile Estimators. Towards a General Theory. A Survey

“Nonparametric” in the title is used to say that observations X ₁,…,X _n come from an unknown distribution F ∈ ? with ? being the class of all continuous and strictly increasing distribution functions. The problem is to estimate the quantile of a given order q ∈ (0,1) of the distribution F. The class ? of distributions is very large; it is so large that even X _nq:n , where nq is an integer, may be very poor estimator of the qth quantile. To assess the performance of estimators no properties based on moments may be used: expected values of estimators should be replaced by their medians, their variances—by some characteristics of concentration of distributions around the median. If an estimator is median-biased for one of distributions, the bias of the estimator may be infinitely large for other distributions. In the note optimal estimators with respect to various criteria of optimality are presented. The pivotal function F(T) of the estimator T is introduced which enables us to apply the classical statistical approach.     

Admissible Linear Estimators with Respect to Inequality Constraints

Admissibility of linear estimators is characterized in linear models E(Y)=Xβ, D(Y)=V, with an unknown multidimensional parameter (β, V) varying in the Cartesian product C × ν, where C is a subset of space and ν is a given set of non negative definite symmetric matrices. The relation between admissibility of inhomogeneous and homogeneous linear estimators is discussed, and some sufficient and necessary conditions for admissibility of an inhomogeneous linear estimator are given.