Conditional estimation of average on the basis of weighting data

LetF(x,y) be a distribution function of a two dimensional random variable (X,Y). We assume that a distribution functionF _x(x) of the random variableX is known. The variableX will be called an auxiliary variable. Our purpose is estimation of the expected valuem=E(Y) on the basis of two-dimensional simple sample denoted by:U=[(X ₁, Y₁)…(X_n, Y_n)]=[X Y]. LetX=[X ₁…X _n]andY=[Y ₁…Y _n].This sample is drawn from a distribution determined by the functionF(x,y). LetX _(k)be the k-th (k=1, …,n) order statistic determined on the basis of the sampleX. The sampleU is truncated by means of this order statistic into two sub-samples: % MathType!End!2!1! and % MathType!End!2!1!.Let % MathType!End!2!1! and % MathType!End!2!1! be the sample means from the sub-samplesU _k,1 andU _k,2, respectively. The linear combination % MathType!End!2!1! of these means is the conditional estimator of the expected valuem. The coefficients of this linear combination depend on the distribution function of auxiliary variable in the pointx _(k).We can show that this statistic is conditionally as well as unconditionally unbiased estimator of the averagem. The variance of this estimator is derived. The variance of the statistic % MathType!End!2!1! is compared with the variance of the order sample mean. The generalization of the conditional estimation of the mean is considered, too.     

Efficiency comparison of M-estimates for scale at t-distributions

Using Fisher's information fort-distributions, the absolute asymptotic efficiency of some M-estimates for scale with known location parameter is calculated and graphically illustrated. The compared estimators are the standard deviationS _*, the mean absolute deviation, called mean deviationD _*, the median absolute deviation, called MAD_*, and some M-estimates for scale, one, which is very robust, and another one with high asymptotic efficiency fort-distributions close to the normal. The last one is considered with monotone (in the positive field) and with very late redescending χ-function too. Also the , an alternative and generalized excess measure defined as the double relative asymptotic variance of the underlying scale estimator in the previous paper, is calculated fort-distributions and graphically illustrated, because there is the relation that the higher the asymptotic efficiency of is, the lower is the corresponding .     

Improvement of the Liu estimator in linear regression model

In the presence of stochastic prior information, in addition to the sample, Theil and Goldberger (1961) introduced a Mixed Estimator for the parameter vector β in the standard multiple linear regression model (T,Xβ,σ² I). Recently, the Liu estimator which is an alternative biased estimator for β has been proposed by Liu (1993). In this paper we introduce another new Liu type biased estimator called Stochastic restricted Liu estimator for β, and discuss its efficiency. The necessary and sufficient conditions for mean squared error matrix of the Stochastic restricted Liu estimator to exceed the mean squared error matrix of the mixed estimator will be derived for the two cases in which the parametric restrictions are correct and are not correct. In particular we show that this new biased estimator is superior in the mean squared error matrix sense to both the Mixed estimator and to the biased estimator introduced by Liu (1993).     

Adaptive wavelet series estimation in separable nonparametric regression models

It is well-known that multivariate curve estimation suffers from the curse of dimensionality. However, reasonable estimators are possible, even in several dimensions, under appropriate restrictions on the complexity of the curve. In the present paper we explore how much appropriate wavelet estimators can exploit a typical restriction on the curve such as additivity. We first propose an adaptive and simultaneous estimation procedure for all additive components in additive regression models and discuss rate of convergence results and data-dependent truncation rules for wavelet series estimators. To speed up computation we then introduce a wavelet version of functional ANOVA algorithm for additive regression models and propose a regularization algorithm which guarantees an adaptive solution to the multivariate estimation problem. Some simulations indicate that wavelets methods complement nicely the existing methodology for nonparametric multivariate curve estimation.     

Constructing an unbiased estimator of population mean in finite populations using auxiliary information

The objective of this paper is to construct an unbiased estimator (up to order 0(1/n)) of the population mean of the study variatey which is more efficient than the sample mean of the ‘n’ obsrvedy-values. In particular, the unbiased estimators are discussed for the cases of positive and negative correlations of the study variatey and the auxiliary variatex.     

Density estimation via the random forest method

The problem of density estimation arises naturally in many contexts. In this paper, we consider the approach using a piecewise constant function to approximate the underlying density. We present a new density estimation method via the random forest method based on the Bayesian Sequential Partition (BSP) (Lu, Jiang, and Wong 2013 Lu, L., H. Jiang, and W. H. Wong, 2013. Multivariate density estimation by Bayesian Sequential Partitioning. Journal of the American Statistical Association 108(504):1402–10.[Taylor &; Francis Online], [Web of Science ®] , [Google Scholar]). Extensive simulations are carried out with comparison to the kernel density estimation method, BSP method, and four local kernel density estimation methods. The experiment results show that the new method is capable of providing accurate and reliable density estimation, even at the boundary, especially for i.i.d. data. In addition, the likelihood of the out-of-bag density estimation, which is a byproduct of the training process, is an effective hyperparameter selection criterion.     

Implicit Estimation for the Stochastic Volatility Model

Efficient, accurate, and fast Markov Chain Monte Carlo estimation methods based on the Implicit approach are proposed. In this article, we introduced the notion of Implicit method for the estimation of parameters in Stochastic Volatility models.

Implicit estimation offers a substantial computational advantage for learning from observations without prior knowledge and thus provides a good alternative to classical inference in Bayesian method when priors are missing.

Both Implicit and Bayesian approach are illustrated using simulated data and are applied to analyze daily stock returns data on CAC40 index.     

Estimation of a normal mean relative to balanced loss functions

LetX ₁,…,X _nbe a random sample from a normal distribution with mean θ and variance σ². The problem is to estimate θ with Zellner's (1994) balanced loss function, % MathType!End!2!1!, where 0<ω<1. It is shown that the sample mean % MathType!End!2!1!, is admissible. More generally, we investigate the admissibility of estimators of the form % MathType!End!2!1! under % MathType!End!2!1!. We also consider the weighted balanced loss function, % MathType!End!2!1!, whereq(θ) is any positive function of θ, and the class of admissible linear estimators is obtained under such loss withq(θ) =e ^θ .     

A family of shrinkage estimators for the square of mean in normal distribution

This paper is devoted to the problem of estimating the square of population mean (μ²) in normal distribution when a prior estimate or guessed value σ₀ ² of the population variance σ² is available. We have suggested a family of shrinkage estimators , say, for μ² with its mean squared error formula. A condition is obtained in which the suggested estimator is more efficient than Srivastava et al’s (1980) estimator T_min. Numerical illustrations have been carried out to demonstrate the merits of the constructed estimator over T_min. It is observed that some of these estimators offer improvements over T_min particularly when the population is heterogeneous and σ² is in the vicinity of σ₀ ².     

Kernel density classification and boosting: an L2 analysis

Kernel density estimation is a commonly used approach to classification. However, most of the theoretical results for kernel methods apply to estimation per se and not necessarily to classification. In this paper we show that when estimating the difference between two densities, the optimal smoothing parameters are increasing functions of the sample size of the complementary group, and we provide a small simluation study which examines the relative performance of kernel density methods when the final goal is classification.A relative newcomer to the classification portfolio is boosting, and this paper proposes an algorithm for boosting kernel density classifiers. We note that boosting is closely linked to a previously proposed method of bias reduction in kernel density estimation and indicate how it will enjoy similar properties for classification. We show that boosting kernel classifiers reduces the bias whilst only slightly increasing the variance, with an overall reduction in error. Numerical examples and simulations are used to illustrate the findings, and we also suggest further areas of research.     

Estimation for exponential distribution based on competing risk middle censored data

Abstract

For a general censoring scheme called “middle censoring” scheme which was proposed by Jammalamadaka and Mangalam (2003 Jammalamadaka, S.R., Mangalam, V. (2003). Nonparametric estimation for middle censored data. J. Nonparametric Statist. 15:253–265.[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]) in nonparametric set up. In this article, point and interval estimation problems are considered for the exponential distribution when the failure data is middle censored with two independent competing failure risks. Different methods are introduced to estimate the unknown model parameters such as maximum likelihood estimation, midpoint approximation, equivalent quantities estimation. The Bayesian estimation is also considered with gamma priors. Two numerical examples are analyzed to show the performance of the proposed methods.     

Confidence Intervals for the Scale Parameter of the Power-Law Process

The power-law process (PLP) is a two-parameter model widely used for modeling repairable system reliability. Results on exact point estimation for both parameters as well as exact interval estimation for the shape parameter are well known. In this paper, we investigate the interval estimation for the scale parameter. Asymptotic confidence intervals are derived using Fisher information matrix and theoretical results by Cocozza-Thivent (1997 Cocozza-Thivent , C. ( 1997 ). Processus Stochastiques et Fiabilité des Systèmes . Berlin : Springer-Verlag . [Google Scholar]). The accuracy of the interval estimation for finite samples is studied by simulation methods.     

Doubly reweighted estimators for the parameters of the multivariate t-distribution

The t-distribution (univariate and multivariate) has many useful applications in robust statistical analysis. The parameter estimation of the t-distribution is carried out using maximum likelihood (ML) estimation method, and the ML estimates are obtained via the Expectation-Maximization (EM) algorithm. In this article, we will use the maximum Lq-likelihood (MLq) estimation method introduced by Ferrari and Yang (2010 Ferrari, D., and Y. Yang. 2010. Maximum lq-likelihood estimation. The Annals of Statistics 38 (2):753–83.[Crossref], [Web of Science ®] , [Google Scholar]) to estimate all the parameters of the multivariate t-distribution. We modify the EM algorithm to obtain the MLq estimates. We provide a simulation study and a real data example to illustrate the performance of the MLq estimators over the ML estimators.     

On moment stability properties for a class of state-dependent stochastic networks

We consider a class of stochastic networks with state-dependent arrival and service rates. The state dependency is described via multi-dimensional birth/death processes, where the birth/death rates are dependent upon the current population size in the system. Under the uniform (in state) stability condition, we establish several moment stability properties of the system:

• (i) 

  the existence of a moment generating function in a neighborhood of zero, with respect to the unique invariant measure of the state process;

• (ii) 

  the convergence of the expected value of unbounded functionals of the state process to the expectation under the invariant measure, at an exponential rate;

• (iii) 

  uniform (in time and initial condition) estimates on exponential moments of the process;

• (iv) 

  growth estimates of polynomial moments of the process as a function of the initial conditions.

Our approach provides elementary proofs of these stability properties without resorting to the convergence of the scaled process to a stable fluid limit model.