ROBUST RIDGE REGRESSION BASED ON AN M-ESTIMATOR

Consider the linear regression model y =β₀1 +Xβ+ in the usual notation. It is argued that the class of ordinary ridge estimators obtained by shrinking the least squares estimator by the matrix (X¹X + kI)^-1X'X is sensitive to outliers in the ^variable. To overcome this problem, we propose a new class of ridge-type M-estimators, obtained by shrinking an M-estimator (instead of the least squares estimator) by the same matrix. Since the optimal value of the ridge parameter k is unknown, we suggest a procedure for choosing it adaptively. In a reasonably large scale simulation study with a particular M-estimator, we found that if the conditions are such that the M-estimator is more efficient than the least squares estimator then the corresponding ridge-type M-estimator proposed here is better, in terms of a Mean Squared Error criteria, than the ordinary ridge estimator with k chosen suitably. An example illustrates that the estimators proposed here are less sensitive to outliers in the y-variable than ordinary ridge estimators.     

The parametric hypothesis test of multiple uniform populations

X₁, X₂, …, X_k are k(k ? 2) uniform populations which each X_i follows U(0, θ_i). This note shows the test statistic for the null hypothesis H₀: θ₁ = θ₂ = ??? = θ_k by using the order statistics.     

Estimating population size with truncated sampling

Let X₁, X₂,…,X_n be independent, indentically distributed random variables with density f(x,θ) with respect to a σ-finite measure μ. Let R be a measurable set in the sample space X. The value of X is observable if X ? (X?R) and not otherwise. The number J of observable X’s is binomial, N, Q, Q = 1?P(X ? R). On the basis of J observations, it is desired to estimate N and θ. Estimators considered are conditional and unconditional maximum likelihood and modified maximum likelihood using a prior weight function to modify the likelihood before maximizing. Asymptotic expansions are developed for the [Ncirc]’s of the form [Ncirc] = N + α√N + β + o_p(1), where α and β are random variables. All estimators have the same α, which has mean 0, variance σ² (a function of θ) and is asymptotically normal. Hence all are asymptotically equivalent by the usual limit distributional theory. The β’s differ and Eβ can be considered an “asymptotic bias”. Formulas are developed to compare the asymptotic biases of the various estimators. For a scale parameter family of absolutely continuous distributions with X = (0,∞) and R = (T,∞), special formuli are developed and a best estimator is found.     

THE CONVERGENCE RATE OF SEQUENTIAL FIXED-WIDTH CONFIDENCE INTERVALS FOR REGULAR FUNCTIONALS

Let X₁X₂,.be i.i.d. random variables and let U_n= (n r)^-1S?^(n,r) h (X_i1,., X_ir,) be a U-statistic with EU_n= v, v unknown. Assume that g(X₁) =E[h(X₁,.,X_r) - v |X₁]has a strictly positive variance s?². Further, let a be such that φ(a) - φ(-a) =α for fixed α, 0 < α < 1, where φ is the standard normal d.f., and let S²_n be the Jackknife estimator of n Var U_n. Consider the stopping times N(d)= min {n: S²_n: + n^-1≤²a^-2},d > 0, and a confidence interval for v of length 2d,of the form I_n,d= [U_n,-d, Un + d]. We assume that Var U_n is unknown, and hence, no fixed sample size method is available for finding a confidence interval for v of prescribed width 2d and prescribed coverage probability α Turning to a sequential procedure, let I_N(d),d be a sequence of sequential confidence intervals for v. The asymptotic consistency of this procedure, i.e. lim_{d → 0}P(v ∈ I_N(d),d)=α follows from Sproule (1969). In this paper, the rate at which |P(v ∈ I_N(d),d) converges to α is investigated. We obtain that |P(v ∈ I_N(d),d) - α| = 0 (d^{1/2-(1+k)/2(1+m)}), d → 0, where K = max {0,4 - m}, under the condition that E|h(X₁, X_r)|^m < ∞m > 2. This improves and extends recent results of Ghosh & DasGupta (1980) and Mukhopadhyay (1981).     

On moments of the supremum of normed weighted averages

Let {X, X_n; n ≥ 1} be a sequence of real-valued iid random variables, 0 < r < 2 and p > 0. Let D = { A = (a_nk; 1 ≤ k ≤ n, n ≥ 1); a_nk, ? R and sup_{n, k} |a_n,k| < ∞}. Set S_n( A ) = ∑ⁿ_k=1a_{n, k}X_k for A ? D and n ≥ 1. This paper is devoted to determining conditions whereby E{sup_{n ≥ 1}, |S_n( A )|/n^1/r}^p < ∞ or E{sup_{n ≥ 2} |S_n( A )|/2n log n)^1/2}^p < ∞ for every A ? D. This generalizes some earlier results, including those of Burkholder (1962), Choi and Sung (1987), Davis (1971), Gut (1979), Klass (1974), Siegmund (1969) and Teicher (1971).     

Some multivariate singular unified skew-normal distributions and their application

Abstract

We introduce here the truncated version of the unified skew-normal (SUN) distributions. By considering a special truncations for both univariate and multivariate cases, we derive the joint distribution of consecutive order statistics X_{(r, ..., r + k)} = (X_(r), ..., X_{(r + K)})^T from an exchangeable n-dimensional normal random vector X. Further we show that the conditional distributions of X_{(r + j, ..., r + k)} given X_{(r, ..., r + j ? 1)}, X_{(r, ..., r + k)} given (X_(r) > t)?and X_{(r, ..., r + k)} given (X_{(r + k)} < t) are special types of singular SUN distributions. We use these results to determine some measures in the reliability theory such as the mean past life (MPL) function and mean residual life (MRL) function.     

Estimation of system reliability

In this paper, we estimate the reliability of a system with k components. The system functions when at least s (1≤s≤k) components survive a common random stress. We assume that the strengths of these k components are subjected to a common stress which is independent of the strengths of these k components. If (X ₁,X ₂,…,X _k ) are strengths of k components subjected to a common stress (Y), then the reliability of the system or system reliability is given byR=P[Y<X _(k−s+1)] whereX _(k−s+1) is (k−s+1)-th order statistic of (X ₁,…,X _k ). We estimate R when (X ₁,…,X _k ) follow an absolutely continuous multivariate exponential (ACMVE) distribution of Hanagal (1993) which is the submodel of Block (1975) and Y follows an independent exponential distribution. We also obtain the asymptotic normal (AN) distribution of the proposed estimator.     

Orderings for series and parallel systems comprising heterogeneous exponentiated Weibull-geometric components

Let X₁, …, X_n be independent random variables with X_i ～ EWG(α, β, λ_i, p_i), i = 1, …, n, and Y₁, …, Y_n be another set of independent random variables with Y_i ～ EWG(α, β, γ_i, q_i), i = 1, …, n. The results established here are developed in two directions. First, under conditions p₁ = ??? = p_n = q₁ = ??? = q_n = p, and based on the majorization and p-larger orders between the vectors of scale parameters, we establish the usual stochastic and reversed hazard rate orders between the series and parallel systems. Next, for the case λ₁ = ??? = λ_n = γ₁ = ??? = γ_n = λ, we obtain some results concerning the reversed hazard rate and hazard rate orders between series and parallel systems based on the weak submajorization between the vectors of (p₁, …, p_n) and (q₁, …, q_n). The results established here can be used to find various bounds for some important aging characteristics of these systems, and moreover extend some well-known results in the literature.     

Estimation of the Scale Parameter of the Selected Gamma Population Under the Entropy Loss Function

Let X ₁, X ₂,…, X _k be k (≥2) independent random variables from gamma populations Π₁, Π₂,…, Π _k with common known shape parameter α and unknown scale parameter θ _i , i = 1,2,…,k, respectively. Let X _(i) denotes the ith order statistics of X ₁,X ₂,…,X _k . Suppose the population corresponding to largest X _(k) (or the smallest X ₍₁₎) observation is selected. We consider the problem of estimating the scale parameter θ _M (or θ _J ) of the selected population under the entropy loss function. For k ≥ 2, we obtain the Unique Minimum Risk Unbiased (UMRU) estimator of θ _M (and θ _J ). For k = 2, we derive the class of all linear admissible estimators of the form cX ₍₂₎ (and cX ₍₁₎) and show that the UMRU estimator of θ _M is inadmissible. The results are extended to some subclass of exponential family.     

Limiting behavior of randomly weighted averages of symmetric heavy-tailed random variables

In this paper we consider a sequence of independent continuous symmetric random variables X₁, X₂, …, with heavy-tailed distributions. Then we focus on limiting behavior of randomly weighted averages S_n = R⁽ⁿ⁾₁X₁ + ??? + R⁽ⁿ⁾_nX_n, where the random weights R⁽ⁿ⁾₁, …, R_n⁽ⁿ⁾ which are independent of X₁, X₂, …, X_n, are the cuts of (0, 1) by the n ? 1 order statistics from a uniform distribution. Indeed we prove that c_nS_n converges in distribution to a symmetric α-stable random variable with c_n = n^{1 ? 1/α}/Γ^1/α(α + 1).     

Comparing the BLUEs Under Two Linear Models

In this article, we consider two linear models, ?₁ = {y, X β, V ₁} and ?₂ = {y, X β, V ₂}, which differ only in their covariance matrices. Our main focus lies on the difference of the best linear unbiased estimators, BLUEs, of X β under these models. The corresponding problems between the models {y, X β, I _n } and {y, X β, V}, i.e., between the OLSE (ordinary least squares estimator) and BLUE, are pretty well studied. Our purpose is to review the corresponding considerations between the BLUEs of X β under ?₁ and ?₂. This article is an expository one presenting also new results.     

Concomitants of multivariate order statistics from multivariate elliptical distributions

ABSTRACT

In this article, we consider a (k + 1)n-dimensional elliptically contoured random vector (X^T₁, X₂^T, …, X^T_k, Z^T)^T = (X₁₁, …, X_1n, …, X_k1, …, X_kn, Z₁, …, Z_n)^T and derive the distribution of concomitant of multivariate order statistics arising from X₁, X₂, …, X_k. Specially, we derive a mixture representation for concomitant of bivariate order statistics. The joint distribution of the concomitant of bivariate order statistics is also obtained. Finally, the usefulness of our result is illustrated by a real-life data.     

Uniform asymptotic linearity in a regression parameter of a process based on a rank statistic

For X₁, …, X_N a random sample from a distribution F, let the process S^δ_N(t) be defined as where K²_N = σ^N_i=1(c_i ? c?)² and R x_i, + Δd, is the rank of X_i + Δd_i, among X₁ + Δd₁, …, X_N + Δd_N. The purpose of this note is to prove that, under certain regularity conditions on F and on the constants c_i and d_i, S^Δ_N (t) is asymptotically approximately a linear function of Δ, uniformly in t and in Δ, |Δ| ≤ C. The special case of two samples is considered.     

Estimation of the location parameter and the average worth of the selected subset of two parameter exponential populations under LINEX loss function

Suppose a subset of populations is selected from k exponential populations with unknown location parameters θ₁, θ₂, …, θ_k and common known scale parameter σ. We consider the estimation of the location parameter of the selected population and the average worth of the selected subset under an asymmetric LINEX loss function. We show that the natural estimator of these parameters is biased and find the uniformly minimum risk-unbiased (UMRU) estimator of these parameters. In the case of k = 2, we find the minimax estimator of the location parameter of the smallest selected population. Furthermore, we compare numerically the risk of UMRU, minimax, and the natural estimators.     

Limiting distributions of Kolmogorov-Lévy-type statistics under the alternative

Let X_i, 1 ≤ i ≤ n, be independent identically distributed random variables with a common distribution function F, and let G be a smooth distribution function. We derive the limit distribution of □{ρ_α(F_n, G) - _α(F, G)}, where F_n is the empirical distribution function based on X₁,…,X_n and _α is a Kolmogorov-Lévy-type metric between distribution functions. For α ≤ 0 and two distribution functions F and G the metric p_α is given by p_α(F, G) = inf {? ≤ 0: G(x - α?) - ? F(x) ≤ G(x + α?) + ? for all x ?}.     

Exact distribution of the convolution of negative binomial random variables

In this note, we derive the exact distribution of S by using the method of generating function and BELL polynomials, where S = X₁ + X₂ + ??? + X_n, and each X_i follows the negative binomial distribution with arbitrary parameters. As a particular case, we also obtain the exact distribution of the convolution of geometric random variables.     

Generalized minimum distance estimators of a linear model with correlated errors

R^p of a linear regression model of the type Y = Xθ + ɛ, where X is the design matrix, Y the vector of the response variable and ɛ the random error vector that follows an AR(1) correlation structure. These estimators are asymptotically analyzed, by proving their strong consistency, asymptotic normality and asymptotic efficiency. In a simulation study, a better behaviour of the Mean Squared Error of the proposed estimator with respect to that of the generalized least squares estimators is observed. Received: November 16, 1998; revised version: May 10, 2000     

Locally minimax tests for multiple correlations

Let X be a normally distributed p-dimensional column vector with mean μ and positive definite covariance matrix σ. and let X α, α = 1,…, N, be a random sample of size N from this distribution. Partition X as ( X ₁, X ₍₂₎', X '₍₃₎)', where X₁ is one-dimension, X₍₂₎ is p₂- dimensional, and so 1 + p₁ + p₂ = p. Let ρ₁ and ρ be the multiple correlation coefficients of X₁ with X₍₂₎ and with ( X '₍₂₎, X '₍₃₎)', respectively. Write ρ2/2 = ρ² - ρ2/1. We shall cosider the following two problems     

Randomly weighted sums of linearly wide quadrant-dependent random variables with heavy tails

This paper investigates tail behavior of the randomly weighted sum ∑ⁿ_{k = 1}θ_kX_k and reaches an asymptotic formula, where X_k, 1 ? k ? n, are real-valued linearly wide quadrant-dependent (LWQD) random variables with a common heavy-tailed distribution, and θ_k, 1 ? k ? n, independent of X_k, 1 ? k ? n, are n non-negative random variables without any dependence assumptions. The LWQD structure includes the linearly negative quadrant-dependent structure, the negatively associated structure, and hence the independence structure. On the other hand, it also includes some positively dependent random variables and some other random variables. The obtained result coincides with the existing ones.