An application of linear feature selection to estimation of proportions

Let X be a random n-vector whose density function is given by a mixture of known multivariate normal density functions where the corresponding mixture proportions (a priori probabilities) are unknown. We present a numerically tractable method for obtaining estimates of the mixture proportions based on the linear feature selection technique of Guseman, Peters and Walker (1975).     

Statistical Inference and Applications of Mixture of Varying Coefficient Models

In this paper, we consider a new mixture of varying coefficient models, in which each mixture component follows a varying coefficient model and the mixing proportions and dispersion parameters are also allowed to be unknown smooth functions. We systematically study the identifiability, estimation and inference for the new mixture model. The proposed new mixture model is rather general, encompassing many mixture models as its special cases such as mixtures of linear regression models, mixtures of generalized linear models, mixtures of partially linear models and mixtures of generalized additive models, some of which are new mixture models by themselves and have not been investigated before. The new mixture of varying coefficient model is shown to be identifiable under mild conditions. We develop a local likelihood procedure and a modified expectation–maximization algorithm for the estimation of the unknown non‐parametric functions. Asymptotic normality is established for the proposed estimator. A generalized likelihood ratio test is further developed for testing whether some of the unknown functions are constants. We derive the asymptotic distribution of the proposed generalized likelihood ratio test statistics and prove that the Wilks phenomenon holds. The proposed methodology is illustrated by Monte Carlo simulations and an analysis of a CO₂‐GDP data set.     

The uniform convergence of the nadaraya-watson regression function estimate

If (X₁,Y₁), …, (X_n,Y_n) is a sequence of independent identically distributed R_d × R-valued random vectors then Nadaraya (1964) and Watson (1964) proposed to estimate the regression function m(x) = ? {Y₁|X₁ = x{ by where K is a known density and {h_n} is a sequence of positive numbers satisfying certain properties. In this paper a variety of conditions are given for the strong convergence to 0 of ess_Xsup|m_n (X)-m(X)| (here X is independent of the data and distributed as X₁). The theorems are valid for all distributions of X₁ and for all sequences {h_n} satisfying h_n → 0 and nh/log n→0.     

Nonlinear regression in a trivariate elliptical distribution via a linear combination of order statistics

In this paper, by assuming that (X, Y ₁, Y ₂)^T has a trivariate elliptical distribution, we derive the exact joint distribution of X and a linear combination of order statistics from (Y ₁, Y ₂)^T and show that it is a mixture of unified bivariate skew-elliptical distributions. We then derive the corresponding marginal and conditional distributions for the special case of t kernel. We also present these results for an exchangeable case with t kernel and illustrate the established results with an air-pollution data.     

On hypothesis tests in misspecified change-point problems for a Poisson process

Consider an inhomogeneous Poisson process X on [0, T] whose unk-nown intensity function “switches” from a lower function g_* to an upper function h_* at some unknown point ?_* that has to be identified. We consider two known continuous functions g and h such that g_*(t) ? g(t) < h(t) ? h_*(t) for 0 ? t ? T. We describe the behavior of the generalized likelihood ratio and Wald’s tests constructed on the basis of a misspecified model in the asymptotics of large samples. The power functions are studied under local alternatives and compared numerically with help of simulations. We also show the following robustness result: the Type I error rate is preserved even though a misspecified model is used to construct tests.     

Implications of survey design for generalized regression estimation of linear functions

The paper presents a general randomization theory approach to point and interval estimation of Q linear functions T_q = Σ^N₁c_kqY_k(q = 1,…,Q), where Y₁,…,Y_N are values of a variable of interest Y in a finite population. Such linear functions include population and domain means and totals, population regression coefficients, etc. We assume that some auxiliary information can be exploited. This suggests the generalized regression technique based on the fit of a linear model, whereby is created approximately design unbiased estimators T?_q. The paper focuses on estimation of the variance-covariance matrix of the T?_q for single stage and two stage designs. Two techniques based on Taylor expansions are compared. Results of Monte-Carlo experiments (not reported here) show that the coverage properties are good of normal-theory confidence intervals flowing from one or the other variance estimate.     

Estimation of the derivative of a density and related functions

Let Y₁,…,Y _n, (Y₁ <Y₂<…<Y _n) be the order statistics of a random sample from a distribution F with density f on the realline. This paper gives a class of estimators of the derivativef'(x) of the density f at points x for which f has

a continuoussecond derivative. These estimators are based on spacings inthe order statistics Y_j+kn -y _j j = 1,…,n-k_n,k_n<n.     

Estimation of the mean of the selected gamma population

Let л₁ and л₂ denote two independent gamma populations G(α₁, p) and G(α₂, p) respectively. Assume α(i=1,2)are unknown and the common shape parameter p is a known positive integer. Let Y_i denote the sample mean based on a random sample of size n from the i-th population. For selecting the population with the larger mean, we consider, the natural rule according to which the population corresponding to the larger Y_i is selected. We consider? in this paper, the estimation of M, the mean of the selected population. It is shown that the natural estimator is positively biased. We obtain the uniformly minimum variance unbiased estimator(UMVE) of M. We also consider certain subclasses of estikmators of the form c₁x₍₁₎ +c₁x₍₂₎ and derive admissible estimators in these classes. The minimazity of certain estimators of interest is investigated. Itis shown that p(p+1)^-1x₍₁₎ is minimax and dominates the UMVUE. Also UMVUE is not minimax.     

New sensitivity analysis subordinated to a contrast

ABSTRACT

In a model of the form Y = h(X₁, …, X_d) where the goal is to estimate a parameter of the probability distribution of Y, we define new sensitivity indices which quantify the importance of each variable X_i with respect to this parameter of interest. The aim of this paper is to define goal oriented sensitivity indices and we will show that Sobol indices are sensitivity indices associated to a particular characteristic of the distribution Y. We name the framework we present as Goal Oriented Sensitivity Analysis (GOSA).     

Sequential Fixed-Width Confidence Interval for a Function of the Parameters

Let X₁…, X_m and Y₁…, Y_n be two independent sequences of i.i.d. random variables with distribution functions F_x(.|θ) and F_y(. | φ) respectively. Let g(θ, φ) be a real-valued function of the unknown parameters θ and φ. The purpose of this paper is to suggest a sequential procedure which gives a fixed-width confidence interval for g(θ, φ) so that the coverage probability is approximately α (preas-signed). Certain asymptotic optimality properties of the sequential procedure are established. A Monte Carlo study is presented.     

Nonparametric estimation of survival functions for incomplete observations when the life time distribution is proportionally related ot the censoring time distribution

Let X₁, X₂…,X_n be a random sample from [ILM0001] and let Y₁, …,Y_n be a random sample from [ILM0002]. Then instead of observing a complete sample X₁,…X_n, we can only observe the pairs Z_i. = min(X_i.,Y_i) and [ILM0003] In this paper, we consider estimation of survival function [ILM0004] when [ILM0005], where β is an unknown positive real number.

     

Estimation of reliability of a component subjected to bivariate exponential stress

In this paper, we estimate the reliability of a component subjected to two different stresses which are independent of the strength of a component. We assume that the distribution of stresses follow a bivariate exponential (BVE) distribution. If X is the strength of a component subjected to two stresses (Y ₁,Y ₂), then the reliability of a component is given by R=P[Y ₁+Y ₂<X]. We estimate R when (Y ₁,Y ₂) follow different BVE models proposed by Marshall-Olkin (1967), Block-Basu-(1974), Freund (1961) and Proschan-Sullo (1974). The distribution of X is assumed to be exponential. The asymptotic normal (AN) distributions of these estimates of R are obtained.     

Nonparametric estimation of a multivariate multiple regression function

Let (X₁, X₂, Y₁, Y₂) be a four dimensional random variable having the joint probability density function f(x₁, x₂, y₁, y₂). In this paper we consider the problem of estimating the regression function \({{E[(_{Y_2 }^{Y_1 } )} \mathord{\left/ {\vphantom {{E[(_{Y_2 }^{Y_1 } )} {_{X_2 = X_2 }^{X_1 = X_1 } }}} \right. \kern-0em} {_{X_2 = X_2 }^{X_1 = X_1 } }}]\) on the basis of a random sample of size n. We have proved that under certain regularity conditions the kernel estimate of this regression function is uniformly strongly consistent. We have also shown that under certain conditions the estimate is asymptotically normally distributed.     

On A strongly consistent nonparametric density estimator for the deconvolution problem

The problem of nonparametric estimation of a probability density function is studied when the sample observations are contaminated with random noise. Previous authors have proposed estimators which use kernel density and deconvolution techniques. The appearance and properties of the previously proposed estimators are affected by constants M_n and h_n which the user may choose. However, the optimal choices of these constants depend on the sample size n, the noise distribution and the unknown distribution which is being estimated. Hence, in practice, M_n and h_n are optimally selected as functions of the data. In this paper it is shown that a class of the proposed estimators are uniformly, strongly consistent when M_n and h_n are allowed to be random variables. Even when M_n and h_n are constants, these results are new findings.     

On Censored Bivariate Random Variables: Copula,Characterization, and Estimation

Let (X, Y) be a bivariate random vector with joint distribution function F_{X, Y}(x, y) = C(F(x), G(y)), where C is a copula and F and G are marginal distributions of X and Y, respectively. Suppose that (X_i, Y_i), i = 1, 2, …, n is a random sample from (X, Y) but we are able to observe only the data consisting of those pairs (X_i, Y_i) for which X_i ? Y_i. We denote such pairs as (X*_i, Y_i*), i = 1, 2, …, ν, where ν is a random variable. The main problem of interest is to express the distribution function F_{X, Y}(x, y) and marginal distributions F and G with the distribution function of observed random variables X* and Y*. It is shown that if X and Y are exchangeable with marginal distribution function F, then F can be uniquely determined by the distributions of X* and Y*. It is also shown that if X and Y are independent and absolutely continuous, then F and G can be expressed through the distribution functions of X* and Y* and the stress–strength reliability P{X ? Y}. This allows also to estimate P{X ? Y} with the truncated observations (X*_i, Y_i*). The copula of bivariate random vector (X*, Y*) is also derived.     

Consistent deconvolution in density estimation

Suppose we have n observations from X = Y + Z, where Z is a noise component with known distribution, and Y has an unknown density f. When the characteristic function of Z is nonzero almost everywhere, we show that it is possible to construct a density estimate f_n such that for all f, Iim_n| |=0.     

Inference procedures in some bivariate exponential models under hybrid random censoring

We consider a life testing experiment in whichn units are put on test, successive lifetimes (X ₁,X ₂) of both componentsC ₁ andC ₂ are recorded and the observation is terminated either at ther-th order statistic ofY _i =Min(X _1i ,X _2i ),i=1,…,n i.e.Y _(r) or a random timeT _i whichever is reached first. This mixture of random censoring and type-II censoring schemes, we call as hybrid random censoring which is of wide use. We use this censoring scheme and obtain maximum likelihood estimation of the parameters and develop large sample tests in bivariate exponential (BVE) models proposed by Marshall-Olkin (1967), Block-Basu (1974), Freund (1961) and Preschan-Sullo (1974).     

Identification of power distribution mixtures through regression of exponentials

Given two independent non-degenerate positive random variables X and Y, Lukacs (Ann Math Stat 26:319–324, 1955) proved that X/(X + Y) and X + Y are independent if and only if X and Y are gamma distributed with the same scale parameter. In this work, under the assumption X/U and U are independent, and X/U has a ${{\mathcal Be}(p,\,q)}$ distribution, we characterize the distribution of (U, X) by the condition E(h(U ? X)|X) = b, where h is allowed to be a linear combination of exponential functions. Since the assumption for X and U above is equivalent to X|U being ${\mathcal{B}e(p,\,1)}$ scaled by U, hence our results can be viewed as identification of a power distribution mixture.     

Asymptotic distribution of data-driven smoothers in density and regression estimation under dependence

We consider automatic data-driven density, regression and autoregression estimates, based on any random bandwidth selector h/_T. We show that in a first-order asymptotic approximation they behave as well as the related estimates obtained with the “optimal” bandwidth h_T as long as h_T/h_T → 1 in probability. The results are obtained for dependent observations; some of them are also new for independent observations.     

Evaluation of a method for setting confidence intervals on the common mean of two normal populations

Let X₁, , X₂, …, X be distributed N(µ, σ² _x), let Y₁, Y₂, …, Y"_n be distributed N(µ, σ² _y), and let X , X , … X_m, Y₁, Y₂, …, Y_n be mutually independent. In this paper a method for setting confidence intervals on the common mean µ is proposed and evaluated.