Flexible empirical Bayes estimation for wavelets

Wavelet shrinkage estimation is an increasingly popular method for signal denoising and compression. Although Bayes estimators can provide excellent mean-squared error (MSE) properties, the selection of an effective prior is a difficult task. To address this problem, we propose empirical Bayes (EB) prior selection methods for various error distributions including the normal and the heavier-tailed Student t -distributions. Under such EB prior distributions, we obtain threshold shrinkage estimators based on model selection, and multiple-shrinkage estimators based on model averaging. These EB estimators are seen to be computationally competitive with standard classical thresholding methods, and to be robust to outliers in both the data and wavelet domains. Simulated and real examples are used to illustrate the flexibility and improved MSE performance of these methods in a wide variety of settings.     

Estimation of parameters of the gamma distribution in the presence of outliers

The maximum likelihood estimators and moment estimators are derived for samples from the Gamma distribution in the presence of outliers. These estimators are compared empirically when all the three parameters are unknown and when one of the three parameters is known; their bias and mean square error (MSE) are investigated with the help of numerical technique.     

A general class of chain estimators for ratio and product of two means of a finite population

This paper proposes a class of estimators for estimating ratio and product of two means of a finite population using information on two auxiliary characters. Asymptotic expression to terms of order 0(n^-1) for bias and mean square error (MSE) of the proposed class of estimators are derived. Optimum conditions are obtained under which the proposed class of estimators has the minimum MSE. An empirical study is carried out to compare the performance of various estimators of ratio with the conventional estimators.     

A comparison of biased regression estimators using a pitman nearness criterion

Biased regression estimators have traditionally benn studied using the Mean Square Error (MSE) criterion. Usually these comparisons have been based on the sum of the MSE's of each of the individual parameters, i.e., a scaler valued measure that is the trace of the MSE matrix. However, since this summed MSE does not consider the covariance structure of the estimators, we propose the use of a Pitman Measure of Closeness (PMC) criterion (Keating and Gupta, 1984; Keating and Mason, 1985). In this paper we consider two versions of PMC. One of these compares the estimates and the other compares the resultant predicted values for 12 different regression estimators. These estimators represent three classes of estimators, namely, ridge, shrunken, and principal component estimators. The comparisons of these estimators using the PMC criteria are contrasted with the usual MSE criteria as well as the prediction mean square error. Included in the estimators is a relatively new estimator termed the generalized principal component estimator proposed by Jolliffe. This estimator has previously received little attention in the literature.     

Two-stage estimation of inequality-constrained marginal linear models with longitudinal data

Inequality-constrained regression models have received increased attention in longitudinal analysis during recent years. Regression parameters are usually obtained from iteration algorithms. An analytical formulae of the estimators cannot be provided. Therefore, the asymptotic behavior of estimators has not been fully clarified yet. This paper presents a TS estimation (TS for short) and the asymptotic distribution of the estimators. Simulations are conducted to compare constrained TS estimation, constrained ordinary least squares (OLS) estimation and TS estimation in terms of sample bias, sample mean-square error (MSE) and sample variance of the estimators.     

A new method of imputation in survey sampling

In this paper, an alternative estimator of population mean in the presence of non-response has been suggested which comes in the form of Walsh's estimator. The estimator of mean obtained from the proposed technique remains better than the estimators obtained from ratio or mean methods of imputation. The mean-squared error (MSE) of the resultant estimator is less than that of the estimator obtained on the basis of ratio method of imputation for the optimum choice of parameters. An estimator for estimating a parameter involved in the process of new method of imputation has been discussed. A suggestion to form ‘warm deck’ method of imputation has been suggested. The MSE expressions for the proposed estimators have been derived analytically and compared empirically. The work has been extended to the case of multi-auxiliary information to be used for imputation. Numerical illustrations are also provided.     

A Jackknifed estimators for the negative binomial regression model

Shrinkage estimator is a commonly applied solution to the general problem caused by multicollinearity. Recently, the ridge regression (RR) estimators for estimating the ridge parameter k in the negative binomial (NB) regression have been proposed. The Jackknifed estimators are obtained to remedy the multicollinearity and reduce the bias. A simulation study is provided to evaluate the performance of estimators. Both mean squared error (MSE) and the percentage relative error (PRE) are considered as the performance criteria. The simulated result indicated that some of proposed Jackknifed estimators should be preferred to the ML method and ridge estimators to reduce MSE and bias.     

Asymptotic distribution of regression type estimators of parameters of stable laws

Asymptotic distributions of regression-type estimators for the parameters of stable distributions am obtained. The asymptotic normalized standard deviations of the estimators are computed for various values of the parameters and various choices of the number of points used in getting the regression estimates.     

Analysis of Type-II hybrid censored competing risks data

Kundu and Gupta [Analysis of hybrid life-tests in presence of competing risks. Metrica. 2007;65:159–170] provided the analysis of Type-I hybrid censored competing risks data, when the lifetime distributions of the competing cause of failures follows exponential distribution. In this paper, we consider the analysis of Type-II hybrid censored competing risks data. It is assumed that latent lifetime distributions of the competing causes of failures follow independent exponential distributions with different scale parameters. It is observed that the maximum likelihood estimators of the unknown parameters do not always exist. We propose the modified estimators of the scale parameters, which coincide with the corresponding maximum likelihood estimators when they exist, and asymptotically they are equivalent. We obtain the exact distribution of the proposed estimators. Using the exact distributions of the proposed estimators, associated confidence intervals are obtained. The asymptotic and bootstrap confidence intervals of the unknown parameters are also provided. Further, Bayesian inference of some unknown parametric functions under a very flexible Beta-Gamma prior is considered. Bayes estimators and associated credible intervals of the unknown parameters are obtained using the Monte Carlo method. Extensive Monte Carlo simulations are performed to see the effectiveness of the proposed estimators and one real data set has been analysed for the illustrative purposes. It is observed that the proposed model and the method work quite well for this data set.     

On the Estimation of Parameters of Kumaraswamy-G Distributions

Cordeiro and de Castro proposed a new family of generalized distributions based on the Kumaraswamy distribution (denoted as Kw-G). Nadarajah et al. showed that the density function of the new family of distributions can be expressed as a linear combination of the density of exponentiated family of distributions. They derived some properties of Kw-G distributions and discussed estimation of parameters using the maximum likelihood (ML) method. Cheng and Amin and Ranneby introduced a new method of estimating parameters based on Kullback–Leibler divergence (the maximum spacing (MSP) method). In this article, the estimates of parameters of Kw-G distributions are obtained using the MSP method. For some special Kw-G distributions, the new estimators are compared with ML estimators. It is shown by simulations and a real data application that MSP estimators have better properties than ML estimators.     

On the small sample properties of norm-restricted maximum likelihood estimators for logistic regression models

This paper develops alternatives to maximum likelihood estimators (MLE) for logistic regression models and compares the mean squared error (MSE) of the estimators. The MLE for the vector of underlying success probabilities has low MSE only when the true probabilities are extreme (i.e., near 0 or 1). Extreme probabilities correspond to logistic regression parameter vectors which are large in norm. A competing “restricted” MLE and an empirical version of it are suggested as estimators with better performance than the MLE for central probabilities. An approximate EM-algorithm for estimating the restriction is described. As in the case of normal theory ridge estimators, the proposed estimators are shown to be formally derivable by Bayes and empirical Bayes arguments. The small sample operating characteristics of the proposed estimators are compared to the MLE via a simulation study; both the estimation of individual probabilities and of logistic parameters are considered.     

Estimation of scale parameters in mixture distributions

Simultaneous estimation of scale parameters is considered in mixture distributions under squared-error loss. A general class of estimators is obtained which dominates the componentwise best multiple estimators and the moment estimators. As special cases, improved estimators are obtained for the multivariate t-distribution and the p-variate Lomax distribution.     

Maximum likelihood estimation of variance components of heteroscedastic random anova model

the estimation of variance components of heteroscedastic random model is discussed in this paper. Maximum Likelihood (ML) is described for one-way heteroscedastic random models. The proportionality condition that cell variance is proportional to the cell sample size, is used to eliminate the efffect of heteroscedasticity. The algebraic expressions of the estimators are obtained for the model. It is seen that the algebraic expressions of the estimators depend mainly on the inverse of the variance-covariance matrix of the observation vector. So, the variance-covariance matrix is obtained and the formulae for the inversions are given. A Monte Carlo study is conducted. Five different variance patterns with different numbers of cells are considered in this study. For each variance pattern, 1000 Monte Carlo samples are drawn. Then the Monte Carlo biases and Monte Carlo MSE’s of the estimators of variance components are calculated. In respect of both bias and MSE, the Maximum Likelihood (ML) estimators of variance components are found to be sufficiently good.     

Unbiased estimation of the MSE matrices of improved estimators in linear regression

Stein-rule and other improved estimators have scarcely been used in empirical work. One major reason is that it is not easy to obtain precision measures for these estimators. In this paper, we derive unbiased estimators for both the mean squared error (MSE) and the scaled MSE matrices of a class of Stein-type estimators. Our derivation provides the basis for measuring the estimators' precision and constructing confidence bands. Comparisons are made between these MSE estimators and the least squares covariance estimator. For illustration, the methodology is applied to data on energy consumption.     

A generalized class of estimators under two-phase stratified sampling for non response

In this paper, we propose a generalized class of estimators for finite population mean using two auxiliary variables in two-phase stratified sampling for non response. We identify 17 estimators as special cases of the proposed class of estimators. Expressions for the bias and mean squared error (MSE) of estimators are obtained up to first order of approximation. A data set is used for efficiency comparisons.     

Geeta distribution and its properties

A new discrete distribution defined over all the positive integers and with the name of Geeta distribution is described. It is L-shaped like the logarithmic series distribution, Yule distribution and the discrete Pareto distribution but is far more versatile than them as it has two parameters. It belongs to the classes of location parameter distributions, modified power series distributions, Lagrange series distributions and exponential distributions. Its mean fi, variance a2 and two recurrence formulae for higher central moments are obtained. Convolution theorem and variations in the model with changes in the parameters have been considered. ML estimators, MVU estimators and estimators based of mean and variance and on mean and first frequency have been derived.     

The Superiorities of Empirical Bayes Estimation of Variance Components in Random Effects Model

In this article, the Bayes estimators of variance components are derived and the parametric empirical Bayes estimators (PEBE) for the balanced one-way classification random effects model are constructed. The superiorities of the PEBE over the analysis of variance (ANOVA) estimators are investigated under the mean square error (MSE) criterion, some simulation results for the PEBE are obtained. Finally, a remark for the main results is given.     

Improved two phase sampling exponential ratio and product type estimators for population mean of study character in the presence of non response

Improved two phase sampling exponential ratio and product type estimators for population mean using known coefficient of variation of study character in the presence of non response have been proposed and their properties are studied under large sample approximation. The proposed estimators are compared with the other existing estimators by using the MSE criterion and the conditions under which the proposed estimators perform better are obtained. An empirical study is also given to judge the performance of the proposed estimators. At the end, simulation studies have been carried out to verify the superiority to the proposed estimators.     

Bayes estimation for the Block and Basu bivariate and multivariate Weibull distributions

Block and Basu bivariate exponential distribution is one of the most popular absolute continuous bivariate distributions. Recently, Kundu and Gupta [A class of absolute continuous bivariate distributions. Statist Methodol. 2010;7:464–477] introduced Block and Basu bivariate Weibull (BBBW) distribution, which is a generalization of the Block and Basu bivariate exponential distribution, and provided the maximum likelihood estimators using EM algorithm. In this paper, we consider the Bayesian inference of the unknown parameters of the BBBW distribution. The Bayes estimators are obtained with respect to the squared error loss function, and the prior distributions allow for prior dependence among the unknown parameters. Prior independence also can be obtained as a special case. It is observed that the Bayes estimators of the unknown parameters cannot be obtained in explicit forms. We propose to use the importance sampling technique to compute the Bayes estimates and also to construct the associated highest posterior density credible intervals. The analysis of two data sets has been performed for illustrative purposes. The performances of the proposed estimators are quite satisfactory. Finally, we generalize the results for the multivariate case.     

Estimation of location parameters of several exponential distributions

In this paper we address the problem of simultaneous estimation of location parameters of several exponential distributions assuming that the scale parameters are unknown and possibly unequal. From a decision theoretic point of view it is shown that the standard estimators are inadmissible and the improved estimators are obtained when p, the number of populations, is more than one.