The General Expressions for the Moments of the Stochastic Shrinkage Parameters of the Liu Type Estimator

ABSTRACT

One of the problems with the Liu estimator is the appropriate value for the unknown biasing parameter d. In this article we consider the optimum value for d and give upper bound for the expected value of the estimator of this biasing parameter. We also derive the general expressions for the moments of the stochastic shrinkage parameters of the Liu estimator and the generalized Liu estimator. Numerical calculations are carried out to illustrate the behavior of the mean and variance of the biasing parameter. Also, a numerical example is given to illustrate the effect of the biasing parameter d, on the mean square error of the Liu estimator.     

Generalized preliminary test stochastic restricted estimator in the linear regression model

ABSTRACT

In this paper, we propose three generalized estimators, namely, generalized unrestricted estimator (GURE), generalized stochastic restricted estimator (GSRE), and generalized preliminary test stochastic restricted estimator (GPTSRE). The GURE can be used to represent the ridge estimator, almost unbiased ridge estimator (AURE), Liu estimator, and almost unbiased Liu estimator. When stochastic restrictions are available in addition to the sample information, the GSRE can be used to represent stochastic mixed ridge estimator, stochastic restricted Liu estimator, stochastic restricted almost unbiased ridge estimator, and stochastic restricted almost unbiased Liu estimator. The GPTSRE can be used to represent the preliminary test estimators based on mixed estimator. Using the GPTSRE, the properties of three other preliminary test estimators, namely preliminary test stochastic mixed ridge estimator, preliminary test stochastic restricted almost unbiased Liu estimator, and preliminary test stochastic restricted almost unbiased ridge estimator can also be discussed. The mean square error matrix criterion is used to obtain the superiority conditions to compare the estimators based on GPTSRE with some biased estimators for the two cases for which the stochastic restrictions are correct, and are not correct. Finally, a numerical example and a Monte Carlo simulation study are done to illustrate the theoretical findings of the proposed estimators.     

Extreme value index estimator using maximum likelihood and moment estimation

ABSTRACT

When a distribution function is in the max domain of attraction of an extreme value distribution, its tail can be well approximated by a generalized Pareto distribution. Based on this fact we use a moment estimation idea to propose an adapted maximum likelihood estimator for the extreme value index, which can be understood as a combination of the maximum likelihood estimation and moment estimation. Under certain regularity conditions, we derive the asymptotic normality of the new estimator and investigate its finite sample behavior by comparing with several classical or competitive estimators. A simulation study shows that the new estimator is competitive with other estimators in view of average bias, average MSE, and coefficient of variance of the new device for the optimal selection of the threshold.     

Inference on the Common Variance of Correlated Normal Random Variables

ABSTRACT

Scale equivariant estimators of the common variance σ², of correlated normal random variables, have mean squared errors (MSE) which depend on the unknown correlations. For this reason, a scale equivariant estimator of σ² which uniformly minimizes the MSE does not exist. For the equi-correlated case, we have developed three equivariant estimators of σ²: a Bayesian estimator for invariant prior as well as two non-Bayesian estimators. We then generalized these three estimators for the case of several variables with multiple unknown correlations. In addition, we developed a system of confidence intervals which produce the desired coverage probability while being efficient in terms of expected length.     

Feasible robust estimator in restricted semiparametric regression models based on the LTS approach

Under some nonstochastic linear restrictions based on either additional information or prior knowledge in a semiparametric regression model, a family of feasible generalized robust estimators for the regression parameter is proposed. The least trimmed squares (LTS) method proposed by Rousseeuw as a highly robust regression estimator is a statistical technique for fitting a regression model based on the subset of h observations (out of n) whose least-square fit possesses the smallest sum of squared residuals. The coverage h may be set between n/2 and n. The LTS estimator involves computing the hyperplane that minimizes the sum of the smallest h squared residuals. For practical purpose, it is assumed that the covariance matrix of the error term is unknown and thus feasible estimators are replaced. Then, we develop an algorithm for the LTS estimator based on feasible methods. Through the Monte Carlo simulation studies and a real data example, performance of the feasible type of robust estimators is compared with the classical ones in restricted semiparametric regression models.     

A Note on Prediction Error with Collinearity

Abstract

Least squares (LS) estimator is the best linear unbiased estimator for linear models. It is well known that LS performs poorly in estimation when collinearity is present among regressors. However, it is not fully understood and is even controversial whether LS performs well in prediction. To address this controversy, we study the mean and variance of the prediction squared error (PSE) of LS estimator, and conclude theoretically that although the mean PSE remains invariant regardless of the collinearity, the variance of PSE increases with the collinearity. Thus the prediction error is sensitive to the location in the feature space.     

Efficiency of the generalized difference-based Liu estimators in semiparametric regression models with correlated errors

In this paper, a generalized difference-based estimator is introduced for the vector parameter β in the semiparametric regression model when the errors are correlated. A generalized difference-based Liu estimator is defined for the vector parameter β in the semiparametric regression model. Under the linear nonstochastic constraint Rβ=r, the generalized restricted difference-based Liu estimator is given. The risk function for the β?_GRD(η) associated with weighted balanced loss function is presented. The performance of the proposed estimators is evaluated by a simulated data set.     

Asymptotic Theory for the Multiscale Wavelet Density Derivative Estimator

Abstract

In this paper we consider the wavelet-based estimation of density derivatives. The multiscale density derivative estimator is proposed which is constructed by using a number of scaling functions. Asymptotic theory is developed in which asymptotic expressions for the bias, the variance and the mean integrated squared error are included. In addition, asymptotic normality of the proposed estimator is proved. Theoretical and numerical comparisons with the usual kernel-based estimators are also reported.     

Ratio and product estimators in stratified random sampling

Khoshnevisan et al. [2007. A general family of estimators for estimating population mean using known value of some population parameter(s). Far East Journal of Theoretical Statistics 22, 181–191] have introduced a family of estimators using auxiliary information in simple random sampling. They have showed that these estimators are more efficient than the classical ratio estimator and that the minimum value of the mean square error (MSE) of this family is equal to the value of MSE of regression estimator. In this article, we adapt the estimators in this family to the stratified random sampling and motivated by the estimator in Searls [1964. Utilization of known coefficient of kurtosis in the estimation procedure of variance. Journal of the American Statistical Association 59, 1225–1226], we also propose a new family of estimators for the stratified random sampling. The expressions of bias and MSE of the adapted and proposed families are derived in a general form. Besides, considering the minimum cases of these MSE equations, the efficient conditions between the adapted and proposed families are obtained. Moreover, these theoretical findings are supported by a numerical example with original data.     

Quasi-maximum exponential likelihood estimation for a non stationary GARCH(1,1) model

ABSTRACT

This article investigates a quasi-maximum exponential likelihood estimator(QMELE) for a non stationary generalized autoregressive conditional heteroscedastic (GARCH(1,1)) model. Asymptotic normality of this estimator is derived under a non stationary condition. A simulation study and a real example are given to evaluate the performance of QMELE for this model.     

Efficiency of the generalized-difference-based weighted mixed almost unbiased two-parameter estimator in partially linear model

In this paper, a generalized difference-based estimator is introduced for the vector parameter β in partially linear model when the errors are correlated. A generalized-difference-based almost unbiased two-parameter estimator is defined for the vector parameter β. Under the linear stochastic constraint r = Rβ + e, we introduce a new generalized-difference-based weighted mixed almost unbiased two-parameter estimator. The performance of this new estimator over the generalized-difference-based estimator and generalized- difference-based almost unbiased two-parameter estimator in terms of the MSEM criterion is investigated. The efficiency properties of the new estimator is illustrated by a simulation study. Finally, the performance of the new estimator is evaluated for a real dataset.     

Paired double-ranked set sampling

Abstract

In environmental monitoring and assessment, the main focus is to achieve observational economy and to collect data with unbiased, efficient and cost-effective sampling methods. Ranked set sampling (RSS) is one traditional method that is mostly used for accomplishing observational economy. In this article, we propose an unbiased sampling scheme, named paired double RSS (PDRSS) for estimating the population mean. We study the performance of the mean estimators under PDRSS based on perfect and imperfect rankings. It is shown that, for perfect ranking, the variance of the mean estimator under PDRSS is always less than the variance of mean estimator based on simple random sampling, paired RSS and RSS. The mean estimators under RSS, median RSS, PDRSS, and double RSS are also compared with the regression estimator of population mean based on SRS. The procedure is also illustrated with a case study using a real data set.     

On moments of dual generalized order statistics from Topp-Leone distribution

In this paper, we have derived exact and explicit expressions for the ratio and inverse moments of dual generalized order statistics from Topp-Leone distribution. This result includes the single and product moments of order statistics and lower records . Further, based on n dual generalized order statistics, we have deduced the expression for Maximum likelihood estimator (MLE) and Uniformly minimum variance unbiased estimator (UMVUE) for the shape parameter of Topp-Leone distribution. Finally, based on order statistics and lower records, a simulation study is being carried out to check the efficiency of these estimators.     

A Simple Variance Estimator for Unequal Probability Sampling without Replacement

Survey sampling textbooks often refer to the Sen–Yates–Grundy variance estimator for use with without-replacement unequal probability designs. This estimator is rarely implemented because of the complexity of determining joint inclusion probabilities. In practice, the variance is usually estimated by simpler variance estimators such as the Hansen–Hurwitz with replacement variance estimator; which often leads to overestimation of the variance for large sampling fractions that are common in business surveys. We will consider an alternative estimator: the Hájek (1964 Hájek J 1981 Sampling from a Finite Population New York: Marcel Dekker  [Google Scholar]) variance estimator that depends on the first-order inclusion probabilities only and is usually more accurate than the Hansen–Hurwitz estimator. We review this estimator and show its practical value. We propose a simple alternative expression; which is as simple as the Hansen–Hurwitz estimator. We also show how the Hájek estimator can be easily implemented with standard statistical packages.     

ESTIMATION OF EXPONENTIATED WEIBULL SHAPE PARAMETERS UNDER LINEX LOSS FUNCTION

ABSTRACT

The paper deals with Bayes estimation of the exponentiated Weibull shape parameters under linex loss function when independent non-informative type of priors are available for the parameters. Generalized maximum likelihood estimators have also been obtained. Performances of the proposed Bayes estimator, generalized maximum likelihood estimators, posterior mean (i.e., Bayes estimator under squared error loss function) and maximum likelihood estimators have been studied on the basis of their risks under linex loss function. The comparison is based on a simulation study because the expressions for risk functions of these estimators cannot be obtained in nice closed forms.     

Estimation of common location parameter of several heterogeneous exponential populations based on generalized order statistics

In this article, several independent populations following exponential distribution with common location parameter and unknown and unequal scale parameters are considered. From these populations, several independent samples of generalized order statistics (gos) are drawn. Under the setup of gos, the problem of estimation of common location parameter is discussed and various estimators of common location parameter are derived. The authors obtained maximum likelihood estimator (MLE), modified MLE and uniformly minimum variance unbiased estimator of common location parameter. Furthermore, under scaled-squared error loss function, a general inadmissibility result of invariant estimator is proposed. The derived results are further reduced for upper record values which is a special case of gos. Finally, simulation study and real life example are reported to show the performances of various competing estimators in terms of percentage risk improvement.     

Comparison of the estimators of the intra-cluster correlation for the nested error regression model

The intra-cluster correlation is insisted on nested error regression model that, in practice, is rarely known. This article demonstrates the size in generalized least squares (GLS) F-test using Fuller–Battese transformation and modification F-test. For the balanced case, the former using strictly positive, analysis of covariance (ANCOVA) and analysis of variance (ANOVA) estimators of intra-cluster correlation can control the size for moderate intra-cluster correlations. For small intra-cluster correlation, they perform well when the numbers of cluster are large. The latter using the ANOVA estimator performs well except for small numbers of cluster. When intra-cluster correlation is large, it cannot control the size. For the unbalanced case, the GLS F-test using the Fuller–Battese transformation and the modification F-test using the strictly positive, the ANCOVA and the ANOVA estimators maintain the significance level for small total sample size and small intra-cluster correlations when there is a large variation in cluster sizes, but they perform well in controlling the size for large total sample size and small different variation in cluster sizes. Besides, Henderson’s method 3 estimator maintains the significance level for a few situations.     

Inference on proportional hazard rate model parameter under Type-I progressively hybrid censoring scheme

ABSTRACT

In this paper, under Type-I progressive hybrid censoring sample, we obtain maximum likelihood estimator of unknown parameter when the parent distribution belongs to proportional hazard rate family. We derive the conditional probability density function of the maximum likelihood estimator using moment-generating function technique. The exact confidence interval is obtained and compared by conducting a Monte Carlo simulation study for burr Type XII distribution. Finally, we obtain the Bayes and posterior regret gamma minimax estimates of the parameter under a precautionary loss function with precautionary index k = 2 and compare their behavior via a Monte Carlo simulation study.     

On estimation of stress–strength parameter using record values from proportional hazard rate models

ABSTRACT

Based on record values, this article deals with inference for stress–strength reliability, R = P(X < Y), where the distributions of X and Y follow proportional hazard rate models but having different parameters. Maximum likelihood estimator, uniformly minimum variance unbiased estimator, Bayes estimator, and different confidence intervals for R are obtained. Numerical computations and simulation study are presented for illustrative purposes.     

Choosing a robustness tuning parameter

A novel method is proposed for choosing the tuning parameter associated with a family of robust estimators. It consists of minimising estimated mean squared error, an approach that requires pilot estimation of model parameters. The method is explored for the family of minimum distance estimators proposed by [Basu, A., Harris, I.R., Hjort, N.L. and Jones, M.C., 1998, Robust and efficient estimation by minimising a density power divergence. Biometrika, 85, 549–559.] Our preference in that context is for a version of the method using the L ₂ distance estimator [Scott, D.W., 2001, Parametric statistical modeling by minimum integrated squared error. Technometrics, 43, 274–285.] as pilot estimator.