Asymptotic Properties of Random Weighted Empirical Distribution Function

This article studies the asymptotic properties of the random weighted empirical distribution function of independent random variables. Suppose X₁, X₂, ???, X_n is a sequence of independent random variables, and this sequence is not required to be identically distributed. Denote the empirical distribution function of the sequence by F_n(x). Based on the random weighting method and F_n(x), the random weighted empirical distribution function H_n(x) is constructed and the asymptotic properties of H_n are discussed. Under weak conditions, the Glivenko–Cantelli theorem and the central limit theorem for the random weighted empirical distribution function are obtained. The obtained results have also been applied to study the distribution functions of random errors of multiple sensors.     

Precise Large Deviations for Sums of Independent Random Variables with Consistently Varying Tails

In this article, we investigate the precise large deviations for a sum of independent but not identical distributed random variables. {X _n , n ≥ 1} are independent non-negative random variables with distribution functions {F _n , n ≥ 1}. We assume that the average of right tails of distribution functions F _n is equivalent to some distribution function F with consistently varying tails. In applications, we apply our main results to a realistic example (Pareto-type distribution) and obtain a specific result.     

A remark on estimating the mean of a normal distribution with known coefficient of variation

Let X₁, X₂, …, X_n be iid N(μ, aμ²) (a>0) random variables with an unknown mean μ>0 and known coefficient of variation (CV) √a. The estimation of μ is revisited and it is shown that a modified version of an unbiased estimator of μ [cf. Khan RA. A note on estimating the mean of a normal distribution with known CV. J Am Stat Assoc. 1968;63:1039–1041] is more efficient. A certain linear minimum mean square estimator of Gleser and Healy [Estimating the mean of a normal distribution with known CV. J Am Stat Assoc. 1976;71:977–981] is also modified and improved. These improved estimators are being compared with the maximum likelihood estimator under squared-error loss function. Based on asymptotic consideration, a large sample confidence interval is also mentioned.     

New estimators of distribution functions

ABSTRACT

This article considers the estimation of a distribution function F_X(x) based on a random sample X₁, X₂, …, X_n when the sample is suspected to come from a close-by distribution F₀(x). The new estimators, namely the preliminary test (PTE) and Stein-type estimator (SE) are defined and compared with the “empirical distribution function” (edf) under local departure. In this case, we show that Stein-type estimators are superior to edf and PTE is superior to edf when it is close to F₀(x). As a by-product similar estimators are proposed for population quantiles.     

Some novel results on pairwise quasi-asymptotical independence with applications to risk theory

In this article we obtain some novel results on pairwise quasi-asymptotically independent (pQAI) random variables. Concretely speaking, let X₁, …, X_n be n real-valued pQAI random variables, and W₁, …, W_n be another n non negative and arbitrarily dependent random variables, but independent of X₁, …, X_n. Under some mild conditions, we prove that W₁X₁, …, W_nX_n are still pQAI as well. Our result is in a general setting whether the primary random variables X₁, …, X_n are heavy-tailed or not. Finally, a special case of above result is applied to risk theory for investigating the finite-time ruin probability for a discrete-time risk model with a wide type of dependence structure.     

Convergence properties for weighted sums of NSD random variables

Abstract

Let {X_n, n ? 1} be a sequence of negatively superadditive dependent (NSD, in short) random variables and {b_ni, 1 ? i ? n, n ? 1} be an array of real numbers. In this article, we study the strong law of large numbers for the weighted sums ∑ⁿ_{i = 1}b_niX_i without identical distribution. We present some sufficient conditions to prove the strong law of large numbers. As an application, the Marcinkiewicz-Zygmund strong law of large numbers for NSD random variables is obtained. In addition, the complete convergence for the weighted sums of NSD random variables is established. Our results generalize and improve some corresponding ones for independent random variables and negatively associated random variables.     

A note on the admissibility of hammersley's estimator of an integer mean

Let X₁, X₂, …, X_n be identically, independently distributed N(i,1) random variables, where i = 0, ±1, ±2, … Hammersley (1950) showed that d = [X?_n], the nearest integer to the sample mean, is the maximum likelihood estimator of i. Khan (1973) showed that d is minimax and admissible with respect to zero-one loss. This note now proves a conjecture of Stein to the effect that in the class of integer-valued estimators d is minimax and admissible under squared-error loss.     

PORT Hill and Moment Estimators for Heavy-Tailed Models

In this article, we use the peaks over random threshold (PORT)-methodology, and consider Hill and moment PORT-classes of extreme value index estimators. These classes of estimators are invariant not only to changes in scale, like the classical Hill and moment estimators, but also to changes in location. They are based on the sample of excesses over a random threshold, the order statistic X _[np]+1:n , 0 ≤ p < 1, being p a tuning parameter, which makes them highly flexible. Under convenient restrictions on the underlying model, these classes of estimators are consistent and asymptotically normal for adequate values of k, the number of top order statistics used in the semi-parametric estimation of the extreme value index γ. In practice, there may however appear a stability around a value distant from the target γ when the minimum is chosen for the random threshold, and attention is drawn for the danger of transforming the original data through the subtraction of the minimum. A new bias-corrected moment estimator is also introduced. The exact performance of the new extreme value index PORT-estimators is compared, through a large-scale Monte-Carlo simulation study, with the original Hill and moment estimators, the bias-corrected moment estimator, and one of the minimum-variance reduced-bias (MVRB) extreme value index estimators recently introduced in the literature. As an empirical example we estimate the tail index associated to a set of real data from the field of finance.     

On the Influence of Record Terms in the Addition of Independent Random Variables

We discuss some problems connected with the role of record values and maximal values generated by sequences of random variables X₁, X₂,…, X _n in the process of the growth of sums X₁ +···+ X_n, n = 1, 2,….     

EMPIRICAL BAYES ESTIMATION WITH NON-IDENTICAL COMPONENTS. CONTINUOUS CASE.

In this paper a variant of the standard empirical Bayes estimation problem is considered where the component problems in the sequence are not identical in that the conditional distribution of the observations may vary with the component problems. Let {(Θ_n, X_n)} be a sequence of independent random vectors where Θ_n? G and, given Θ_n=Θ_n, X_n -P_Θ,m(n) with {m(n)} a sequence of positive integers where m(n)≤m? < ∞ for all n. With P_Θ,m in a continuous exponential family of distributions, asymptotically optimal empirical Bayes procedures are exhibited which depend on uniform approximations of certain functions on compact sets by polynomials in e^Θ. Such approximations have been explicitly calculated in the case of normal and gamma families. In the case of normal families, asymptotically optimal linear empirical Bayes estimators in the class of all linear estimators are derived and shown to have rate O(n^-1/2).     

The Consistency and Robustness of Modified Cramér–Von Mises and Kolmogorov–Cramér Estimators

This article focuses on the minimum distance estimators under two newly introduced modifications of Cramér–von Mises distance. The generalized power form of Cramér–von Mises distance is defined together with the so-called Kolmogorov–Cramér distance which includes both standard Kolmogorov and Cramér–von Mises distances as limiting special cases. We prove the consistency of Kolmogorov-Cramér estimators in the (expected) L₁-norm by direct technique employing domination relations between statistical distances. In our numerical simulation we illustrate the quality of consistency property for sample sizes of the most practical range from n = 10 to n = 500. We study dependence of consistency in L₁-norm on ?-contamination neighborhood of the true model and further the robustness of these two newly defined estimators for normal families and contaminated samples. Numerical simulations are used to compare statistical properties of the minimum Kolmogorov–Cramér, generalized Cramér–von Mises, standard Kolmogorov, and Cramér–von Mises distance estimators of the normal family scale parameter. We deal with the corresponding order of consistency and robustness. The resulting graphs are presented and discussed for the cases of the contaminated and uncontaminated pseudo-random samples.     

Dependence Structure of Spacings of Order Statistics

Let X_1:n ≤ X_2:n ≤···≤ X_n:n denote the order statistics of a sample of n independent random variables X₁, X₂,…, X_n, all identically distributed as some X. It is shown that if X has a log-convex [log-concave] density function, then the general spacing vector (X_k1:n, X_k2:n ? X_k1:n,…, X_kr:n ? X_kr?1:n) is MTP₂ [S-MRR₂] whenever 1 ≤ k₁ < k₂ <···< k_r ≤ n and 1 ≤ r ≤ n. Multivariate likelihood ratio ordering of such general spacing vectors corresponding to two random samples is also considered. These extend some of the results in the literature for usual spacing vectors.     

Limiting behavior of randomly weighted averages of symmetric heavy-tailed random variables

In this paper we consider a sequence of independent continuous symmetric random variables X₁, X₂, …, with heavy-tailed distributions. Then we focus on limiting behavior of randomly weighted averages S_n = R⁽ⁿ⁾₁X₁ + ??? + R⁽ⁿ⁾_nX_n, where the random weights R⁽ⁿ⁾₁, …, R_n⁽ⁿ⁾ which are independent of X₁, X₂, …, X_n, are the cuts of (0, 1) by the n ? 1 order statistics from a uniform distribution. Indeed we prove that c_nS_n converges in distribution to a symmetric α-stable random variable with c_n = n^{1 ? 1/α}/Γ^1/α(α + 1).     

Multiparameter estimation of discrete exponential distributions

Let X₁, …, X_p be independent random variables, all having the same distribution up to a possibly varying unspecified parameter, where each of the p distributions belongs to the family of one parameter discrete exponential distributions. The problem is to estimate the unknown parameters simultaneously. Hudson (1978) shows that the minimum variance unbiased estimator (MVUE) of the parameters is inadmissible under squared error loss, and estimators better than the MVUE are proposed. Essentially, these estimators shrink the MVUE towards the origin. In this paper, we indicate that estimators shifting the MVUE towards a point different from the origin or a point determined by the observations can be obtained.     

The Rate of Convergence of some Asymptotic Expansions for Distribution Approximations via an Esseen Type Estimate

Some asymptotic expansions not necessarily related to the central limit theorem are studied. We first observe that the smoothing inequality of Esseen implies the proximity, in the Kolmogorov distance sense, of the distributions of the random variables of two random sequences satisfying a sort of general asymptotic relation. We then present several instances of this observation. A first example, partially motivated by the the statistical theory of high precision measurements, is given by a uniform asymptotic approximation to (g(X + μ _n )) _n∈?, where g is some smooth function, X is a random variable and (μ _n ) _n∈? is a sequence going to infinity; a multivariate version is also stated and proved. We finally present a second class of examples given by a randomization of the interesting parameter in some classical asymptotic formulas; namely, a generic Laplace's type integral, randomized by the sequence (μ _n X) _n∈?, X being a Gamma distributed random variable.     

Randomly weighted average with Dirichlet component proportions

This article introduces a new average of n independent continuous random variables X₁, …, X_n weighted by Dirichlet random components. A relation between the Cauchy–Stieltjes transforms of the distribution functions of this weighted average and X₁, …, X_n is established. Several examples illustrate usefulness and applicability of the result.     

On the Moments of a Semi-Markovian Random Walk with Gaussian Distribution of Summands

In this article, a semi-Markovian random walk with delay and a discrete interference of chance (X(t)) is considered. It is assumed that the random variables ζ _n , n = 1, 2,…, which describe the discrete interference of chance form an ergodic Markov chain with ergodic distribution which is a gamma distribution with parameters (α, λ). Under this assumption, the asymptotic expansions for the first four moments of the ergodic distribution of the process X(t) are derived, as λ → 0. Moreover, by using the Riemann zeta-function, the coefficients of these asymptotic expansions are expressed by means of numerical characteristics of the summands, when the process considered is a semi-Markovian Gaussian random walk with small drift β.     

BAYESIAN SMOOTHING WITH OCCASIONAL JUMPS

Consider a sequence of independent random variables X ₁, X ₂,…,X _n observed at n equally spaced time points where X _i has a probability distribution which is known apart from the values of a parameter θ _i ∈ R which may change from observation to observation. We consider the problem of estimating θ = (θ₁, θ₂,…,θ _n ) given the observed values of X ₁, X ₂,…,X _n . The paper proposes a prior distribution for the parameters θ for which sets of parameter values exhibiting no change, or no change apart from a few sudden large changes, or lots of small changes, all have positive prior probability. Markov chain sampling may be used to calculate Bayes estimates of the parameters. We report the results of a Monte Carlo study based on Poisson distributed data which compares the Bayes estimator with estimators obtained using cubic splines and with estimators derived from the Schwarz criterion. We conclude that the Bayes method is preferable in a minimax sense since it never produces the disastrously large errors of the other methods and pays only a modest price for this degree of safety. All three methods are used to smooth mortality rates for oesophageal cancer in Irish males aged 65–69 over the period 1955 through 1994.     

Randomly weighted sums of linearly wide quadrant-dependent random variables with heavy tails

This paper investigates tail behavior of the randomly weighted sum ∑ⁿ_{k = 1}θ_kX_k and reaches an asymptotic formula, where X_k, 1 ? k ? n, are real-valued linearly wide quadrant-dependent (LWQD) random variables with a common heavy-tailed distribution, and θ_k, 1 ? k ? n, independent of X_k, 1 ? k ? n, are n non-negative random variables without any dependence assumptions. The LWQD structure includes the linearly negative quadrant-dependent structure, the negatively associated structure, and hence the independence structure. On the other hand, it also includes some positively dependent random variables and some other random variables. The obtained result coincides with the existing ones.