An Asymmetric Kernel Estimator of Density Function for Stationary Associated Sequences

Here, we apply the smoothing technique proposed by Chaubey et al. (2007 Chaubey , Y. P. , Sen , A. , Sen , P. K. ( 2007 ). A new smooth density estimator for non-negative random variables. Technical Report No. 1/07. Department of Mathematics and Statistics, Concordia University, Montreal, Canada . [Google Scholar]) for the empirical survival function studied in Bagai and Prakasa Rao (1991 Bagai , I. , Prakasa Rao , B. L. S. ( 1991 ). Estimation of the survival function for stationary associated processes . Statist. Probab. Lett. 12 : 385 – 391 .[Crossref], [Web of Science ®] , [Google Scholar]) for a sequence of stationary non-negative associated random variables.The derivative of this estimator in turn is used to propose a nonparametric density estimator. The asymptotic properties of the resulting estimators are studied and contrasted with some other competing estimators. A simulation study is carried out comparing the recent estimator based on the Poisson weights (Chaubey et al., 2011 Chaubey , Y. P. , Dewan , I. , Li , J. ( 2011 ). Smooth estimation of survival and density functions for a stationary associated process using poisson weights . Statist. Probab. Lett. 81 : 267 – 276 .[Crossref], [Web of Science ®] , [Google Scholar]) showing that the two estimators have comparable finite sample global as well as local behavior.     

Kernel Density Estimator From Ranked Set Samples

We study kernel density estimator from the ranked set samples (RSS). In the kernel density estimator, the selection of the bandwidth gives strong influence on the resulting estimate. In this article, we consider several different choices of the bandwidth and compare their asymptotic mean integrated square errors (MISE). We also propose a plug-in estimator of the bandwidth to minimize the asymptotic MISE. We numerically compare the MISE of the proposed kernel estimator (having the plug-in bandwidth estimator) to its simple random sampling counterpart. We further propose two estimators for a symmetric distribution, and show that they outperform in MISE all other estimators not considering symmetry. We finally apply the methods in this article to analyzing the tree height data from Platt et al. (1988 Platt, W.J., Evans, G.M., Rathbun, S.L. (1988). The population dynamics of long-lived conifer (Pinus plaustris) (1988). Amer. Natrualist 131:491–525.[Crossref], [Web of Science ®] , [Google Scholar]) and Chen et al. (2003 Chen, Z., Bai, Z., Sinha, B.K. (2003). Ranked Set Sampling: Theory and Applications. New York: Springer. [Google Scholar]).     

Ratio-Cum-Product Type Exponential Estimator of Finite Population Mean in Stratified Random Sampling

This article addresses the problem of estimating the finite population mean in stratified random sampling using auxiliary information. Motivated by Singh (1967 Singh , M. P. ( 1967 ). Ratio cum product method of estimation . Metrika 12 : 34 – 42 .[Crossref] , [Google Scholar]) and Bahl and Tuteja (1991 Bahl , S. , Tuteja , R. K. ( 1991 ). Ratio and product type exponential estimator . Inform. Optimiz. Sci. 12 ( 1 ): 159 – 163 .[Taylor &; Francis Online] , [Google Scholar]) a ratio-cum-product type exponential estimator has been suggested and its bias and mean squared error have been derived under large sample approximation. Suggested estimator has been compared with usual unbiased estimator of population mean in stratified random sampling, combined ratio estimator, combined product estimator, ratio and product type exponential estimator of Singh et al. (2008 Singh , R. , Kumar , M. , Singh , R. D. , Chaudhary , M. K. ( 2008 ). Exponential ratio type estimators in stratified random sampling. Presented in International Symposium on Optimisation and Statistics (I.S.O.S) at A.M.U., Aligarh, India, during 29–31 Dec . [Google Scholar]). Conditions under which suggested estimator is more efficient than other considered estimators have been obtained. A numerical illustration is given in support of the theoretical findings.     

A Stochastic Restricted Two-Parameter Estimator in Linear Regression Model

Özkale and Kaciranlar (2007 Özakle , M. R. , Kaciranlar , S. ( 2007 ). The restricted and unrestricted two-parameter estimators . Commun. Statist. Theor. Meth. 36 : 2707 – 2725 . [Google Scholar]) proposed a two-parameter estimator (TPE) for the unknown parameter vector in linear regression when exact restrictions are assumed to hold. In this article, under the assumption that the errors are not independent and identically distributed, we introduce a new estimator by combining the ideas underlying the mixed estimator (ME) and the two-parameter estimator when stochastic linear restrictions are assumed to hold. The new estimator is called the stochastic restricted two-parameter estimator (SRTPE) and necessary and sufficient conditions for the superiority of the SRTPE over the ME and TPE are derived by the mean squared error matrix (MSEM) criterion. Furthermore, selection of the biasing parameters is discussed and a numerical example is given to illustrate some of the theoretical results.     

A New Two-Parameter Estimator in Linear Regression

This article is concerned with the parameter estimation in linear regression model. To overcome the multicollinearity problem, a new two-parameter estimator is proposed. This new estimator is a general estimator which includes the ordinary least squares (OLS) estimator, the ridge regression (RR) estimator, and the Liu estimator as special cases. Necessary and sufficient conditions for the superiority of the new estimator over the OLS, RR, Liu estimators, and the two-parameter estimator proposed by Ozkale and Kaciranlar (2007 Ozkale , M. R. , Kaciranlar , S. ( 2007 ). The restricted and unrestricted two-parameter estimators . Commun. Statist. Theor. Meth. 36 : 2707 – 2725 .[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]) in the mean squared error matrix (MSEM) sense are derived. Furthermore, we obtain the estimators of the biasing parameters and give a numerical example to illustrate some of the theoretical results.     

Jackknifing the Ridge Regression Estimator: A Revisit

Singh et al. (1986 Singh, B., Chaubey, Y.P., Dwivedi, T.D. (1986). An almost unbiased ridge estimator. Sankhya B48: 34236. [Google Scholar]) proposed an almost unbiased ridge estimator using Jackknife method that required transformation of the regression parameters. This article shows that the same method can be used to derive the Jackknifed ridge estimator of the original (untransformed) parameter without transformation. This method also leads in deriving easily the second-order Jackknifed ridge that may reduce the bias further. We further investigate the performance of these estimators along with a recent method by Batah et al. (2008 Batah, F. S.M., Ramanathan, T.V., Gore, S.D. (2008). The efficiency of modified Jack-knife and ridge type regression estimators: a comparison. Surv. Math. Applic. 3:111122. [Google Scholar]) called modified Jackknifed ridge theoretically as well as numerically.     

MSE Performance of a Heterogeneous Pre-Test Ridge Regression Estimator

This article describes how diagnostic procedures were derived for symmetrical nonlinear regression models, continuing the work carried out by Cysneiros and Vanegas (2008 Cysneiros , F. J. A. , Vanegas , L. H. ( 2008 ). Residuals and their statistical properties in symmetrical nonlinear models . Statist. Probab. Lett. 78 : 3269 – 3273 .[Crossref], [Web of Science ®] , [Google Scholar]) and Vanegas and Cysneiros (2010 Vanegas , L. H. , Cysneiros , F. J. A. ( 2010 ). Assesment of diagnostic procedures in symmetrical nonlinear regression models . Computat. Statist. Data Anal. 54 : 1002 – 1016 .[Crossref], [Web of Science ®] , [Google Scholar]), who showed that the parameters estimates in nonlinear models are more robust with heavy-tailed than with normal errors. In this article, we focus on assessing if the robustness of this kind of models is also observed in the inference process (i.e., partial F-test). Symmetrical nonlinear regression models includes all symmetric continuous distributions for errors covering both light- and heavy-tailed distributions such as Student-t, logistic-I and -II, power exponential, generalized Student-t, generalized logistic, and contaminated normal. Firstly, a statistical test is shown to evaluating the assumption that the error terms all have equal variance. The results of simulation studies which describe the behavior of the test for heteroscedasticity proposed in the presence of outliers are then given. To assess the robustness of inference process, we present the results of a simulation study which described the behavior of partial F-test in the presence of outliers. Also, some diagnostic procedures are derived to identify influential observations on the partial F-test. As ilustration, a dataset described in Venables and Ripley (2002 Venables , W. N. , Ripley , B. D. ( 2002 ). Modern Applied with S. , 4th ed. New York : Springer .[Crossref] , [Google Scholar]), is also analyzed.     

Robustness of the Affine Equivariant Scatter Estimator Based on the Spatial Rank Covariance Matrix

Visuri et al. (2000 Visuri, S., Koivunen, V., Oja, H. (2000). Sign and rank covariance matrices. J. Stat. Plann. Inference 91:557–575.[Crossref], [Web of Science ®] , [Google Scholar]) proposed a technique for robust covariance matrix estimation based on different notions of multivariate sign and rank. Among them, the spatial rank based covariance matrix estimator that utilizes a robust scale estimator is especially appealing due to its high robustness, computational ease, and good efficiency. Also, it is orthogonally equivariant under any distribution and affinely equivariant under elliptically symmetric distributions. In this paper, we study robustness properties of the estimator with respective to two measures: breakdown point and influence function. More specifically, the upper bound of the finite sample breakdown point can be achieved by a proper choice of univariate robust scale estimator. The influence functions for eigenvalues and eigenvectors of the estimator are derived. They are found to be bounded under some assumptions. Moreover, finite sample efficiency comparisons to popular robust MCD, M, and S estimators are reported.     

The Restricted and Unrestricted Two-Parameter Estimators

In this article, we introduce a new two-parameter estimator by grafting the contraction estimator into the modified ridge estimator proposed by Swindel (1976 Swindel , B. F. ( 1976 ). Good ridge estimators based on prior information . Commun. Statist. Theor. Meth. A5 : 1065 – 1075 .[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]). This new two-parameter estimator is a general estimator which includes the ordinary least squares, the ridge, the Liu, and the contraction estimators as special cases. Furthermore, by setting restrictions Rβ = r on the parameter values we introduce a new restricted two-parameter estimator which includes the well-known restricted least squares, the restricted ridge proposed by Groß (2003 Groß , J. ( 2003 ). Restricted ridge estimation . Statist. Probab. Lett. 65 : 57 – 64 .[Crossref], [Web of Science ®] , [Google Scholar]), the restricted contraction estimators, and a new restricted Liu estimator which we call the modified restricted Liu estimator different from the restricted Liu estimator proposed by Kaç?ranlar et al. (1999 Kaç?ranlar , S. , Sakall?o?lu , S. , Akdeniz , F. , Styan , G. P. H. , Werner , H. J. ( 1999 ). A new biased estimator in linear regression and a detailed analysis of the widely-analysed dataset on Portland cement . Sankhya Ser. B., Ind. J. Statist. 61 : 443 – 459 . [Google Scholar]). We also obtain necessary and sufficient condition for the superiority of the new two-parameter estimator over the ordinary least squares estimator and the comparison of the new restricted two-parameter estimator to the new two-parameter estimator is done by the criterion of matrix mean square error. The estimators of the biasing parameters are given and a simulation study is done for the comparison as well as the determination of the biasing parameters.     

A New Estimator of Population Mean in Stratified Sampling

Kadilar and Cingi (2005 Kadilar , C. , Cingi , H. ( 2005 ). A new ratio estimator in stratified sampling . Comm. Statist. Theory Meth. 34 : 1 – 6 . [CSA] [Taylor & Francis Online], [Web of Science ®] , [Google Scholar]) have suggested a new ratio estimator in stratified sampling. The efficiency of this estimator is compared with the traditional combined ratio estimator on the basis of mean square error (MSE). We propose another estimator by utilizing a simple transformation introduced by Bedi (1996 Bedi , P. K. ( 1996 ). Efficient utilization of auxiliary information at estimation stage . Biomet. J. 38 ( 8 ): 973 – 976 . [CSA] [Crossref], [Web of Science ®] , [Google Scholar]). The proposed estimator is found to be more efficient than the traditional combined ratio estimator as well as the Kadilar and Cingi (2005 Kadilar , C. , Cingi , H. ( 2005 ). A new ratio estimator in stratified sampling . Comm. Statist. Theory Meth. 34 : 1 – 6 . [CSA] [Taylor & Francis Online], [Web of Science ®] , [Google Scholar]) ratio estimator.     

Shrinkage Estimators for Prediction Out-of-Sample: Conditional Performance

We find that, in a linear model, the James–Stein estimator, which dominates the maximum-likelihood estimator in terms of its in-sample prediction error, can perform poorly compared to the maximum-likelihood estimator in out-of-sample prediction. We give a detailed analysis of this phenomenon and discuss its implications. When evaluating the predictive performance of estimators, we treat the regressor matrix in the training data as fixed, i.e., we condition on the design variables. Our findings contrast those obtained by Baranchik (1973 Baranchik , A. J. ( 1973 ). Inadmissibility of maximum likelihood estimators in some multiple regression problems with three or more independent variables . Ann. Statist. 1 ( 2 ): 312 – 321 .[Crossref], [Web of Science ®] , [Google Scholar]) and, more recently, by Dicker (2012 Dicker , L. ( 2012 ). Dense signals, linear estimators, and out-of-sample prediction for high-dimensional linear models. arXiv:1102.2952 [math.ST].  [Google Scholar]) in an unconditional performance evaluation.     

Estimation of the Mean of a Sensitive Variable in the Presence of Auxiliary Information

Sousa et al. (2010 Sousa , R. , Shabbir , J. , Real , P. C. , Gupta , S. ( 2010 ). Ratio estimation of the mean of a sensitive variable in the presence of auxiliary information . J. Statist. Theor. Prac. 4 ( 3 ): 495 – 507 .[Taylor & Francis Online] , [Google Scholar]) introduced a ratio estimator for the mean of a sensitive variable and showed that this estimator performs better than the ordinary mean estimator based on a randomized response technique (RRT). In this article, we introduce a regression estimator that performs better than the ratio estimator even for modest correlation between the primary and the auxiliary variables. The underlying assumption is that the primary variable is sensitive in nature but a non sensitive auxiliary variable exists that is positively correlated with the primary variable. Expressions for the Bias and MSE (Mean Square Error) are derived based on the first order of approximation. It is shown that the proposed regression estimator performs better than the ratio estimator and the ordinary RRT mean estimator (that does not utilize the auxiliary information). We also consider a generalized regression-cum-ratio estimator that has even smaller MSE. An extensive simulation study is presented to evaluate the performances of the proposed estimators in relation to other estimators in the study. The procedure is also applied to some financial data: purchase orders (a sensitive variable) and gross turnover (a non sensitive variable) in 2009 for a population of 5,336 companies in Portugal from a survey on Information and Communication Technologies (ICT) usage.     

MSE Performance and Minimax Regret Significance Points for a HPT Estimator when each Individual Regression Coefficient is Estimated

In this article, we consider a heterogeneous preliminary test (HPT) estimator whose components are the OLS and feasible ridge regression (FRR) estimators, and derive the exact formulae for the moments of the HPT estimator using mathematical method. Since we cannot examine the MSE of the HPT estimator analytically, we execute the numerical evaluation to investigate the MSE performance of the HPT estimator, and compare the MSE performance of the HPT estimator with those of the FRR estimator and the usual OLS estimator. Furthermore, using the minimax regret criterion proposed by Sawa and Hiromatsu (1973 Sawa , T. , Hiromatsu , T. ( 1973 ). Minimax regret significance points for a preliminary test in regression analysis . Econometrica 41 : 1093 – 1101 .[Crossref], [Web of Science ®] , [Google Scholar]), we derive the optimal critical points of the preliminary F test. Our results show that the optimal significance points are greater than 19% and the optimal signicance points decrease as the denominator degrees of freedom of the preliminary F test statistic increases.     

Improved Exponential Type Estimators of the Mean of a Sensitive Variable in the Presence of Nonsensitive Auxiliary Information

Recently, Koyuncu et al. (2013 Koyuncu, N., Gupta, S., Sousa, R. (2014). Exponential type estimators of the mean of a sensitive variable in the presence of non-sensitive auxiliary information. Communications in Statistics- Simulation and Computation[PubMed], [Web of Science ®] , [Google Scholar]) proposed an exponential type estimator to improve the efficiency of mean estimator based on randomized response technique. In this article, we propose an improved exponential type estimator which is more efficient than the Koyuncu et al. (2013 Koyuncu, N., Gupta, S., Sousa, R. (2014). Exponential type estimators of the mean of a sensitive variable in the presence of non-sensitive auxiliary information. Communications in Statistics- Simulation and Computation[PubMed], [Web of Science ®] , [Google Scholar]) estimator, which in turn was shown to be more efficient than the usual mean estimator, ratio estimator, regression estimator, and the Gupta et al. (2012 Gupta, S., Shabbir, J., Sousa, R., Corte-Real, P. (2012). Regression estimation of the mean of a sensitive variable in the presence of auxiliary information. Communications in Statistics – Theory and Methods 41:2394–2404.[Taylor &; Francis Online], [Web of Science ®] , [Google Scholar]) estimator. Under simple random sampling without replacement (SRSWOR) scheme, bias and mean square error expressions for the proposed estimator are obtained up to first order of approximation and comparisons are made with the Koyuncu et al. (2013 Koyuncu, N., Gupta, S., Sousa, R. (2014). Exponential type estimators of the mean of a sensitive variable in the presence of non-sensitive auxiliary information. Communications in Statistics- Simulation and Computation[PubMed], [Web of Science ®] , [Google Scholar]) estimator. A simulation study is used to observe the performances of these two estimators. Theoretical findings are also supported by a numerical example with real data. We also show how to, extend the proposed estimator to the case when more than one auxiliary variable is available.     

Inversion Theorem Based Kernel Density Estimation for the Ordinary Least Squares Estimator of a Regression Coefficient

The traditional confidence interval associated with the ordinary least squares estimator of linear regression coefficient is sensitive to non-normality of the underlying distribution. In this article, we develop a novel kernel density estimator for the ordinary least squares estimator via utilizing well-defined inversion based kernel smoothing techniques in order to estimate the conditional probability density distribution of the dependent random variable. Simulation results show that given a small sample size, our method significantly increases the power as compared with Wald-type CIs. The proposed approach is illustrated via an application to a classic small data set originally from Graybill (1961 Graybill, F.A. (1961). Introduction to Linear Statistical Models. Vol. 1. New York: McGraw-Hill Book Company. [Google Scholar]).     

Nonparametric Estimation for Risk in Value-at-Risk Estimator

Abstract

Value-at-Risk (VaR) has become the standard tool used by many financial institutions to measure market risk. However, the performance of a VaR estimator may be affected by sample variation or estimation risk caused from heavy-tailed distributions. After surveying several existing procedures proposed by Jorin (Jorion, P. (1996 Jorion, P. 1996. Risk²—measuring the risk in value at risk. Financial Analysis Journal, 52: 47–56. [Taylor & Francis Online] , [Google Scholar]). Risk²—Measuring the risk in value at risk. Financial Analysis Journal 52:47–56), Huschens (Huschens, S. (1997 Huschens, S. 1997. “Confidence intervals for the value-at-risk”. In Risk Measurement, Econometrics and Neural Networks Edited by: Bol, G., Nakhaeizadeh, G. and Vollmer, K. H. 233–244. Heidelberg: Physica-Verlag.  [Google Scholar]). Confidence intervals for the value-at-risk. In: Bol, G., Nakhaeizadeh, G., Vollmer, K. H., eds. Risk Measurement, Econometrics and Neural Networks. Heidelberg: Physica-Verlag, pp. 233–244), and Ridder (Ridder, T. (1997 Ridder, T. 1997. “Basics of statistical VaR–estimation”. In Risk Measurement, Econometrics and Neural Networks Edited by: Bol, G., Nakhaeizadeh, G. and Vollmer, K. H. 161–187. Heidelberg: Physica-Verlag.  [Google Scholar]). Basics of statistical VaR-estimation. In: Bol, G., Nakhaeizadeh, G., Vollmer, K. H., eds. Risk Measurement, Econometrics and Neural Networks. Heidelberg: Physica-Verlag, pp. 161–187) etc., this article strives to propose several new estimators in measuring the risk involved in VaR estimation. We compare the performance of these VaR models through Monte Carlo simulation studies. We find that the newly proposed methods provide better accuracy and robustness in the estimation of the risk in VaR estimator.     

A new estimator of finite population mean based on the dual use of the auxiliary information

When a sufficient correlation between the study variable and the auxiliary variable exists, the ranks of the auxiliary variable are also correlated with the study variable, and thus, these ranks can be used as an effective tool in increasing the precision of an estimator. In this paper, we propose a new improved estimator of the finite population mean that incorporates the supplementary information in forms of: (i) the auxiliary variable and (ii) ranks of the auxiliary variable. Mathematical expressions for the bias and the mean-squared error of the proposed estimator are derived under the first order of approximation. The theoretical and empirical studies reveal that the proposed estimator always performs better than the usual mean, ratio, product, exponential-ratio and -product, classical regression estimators, and Rao (1991 Rao, T.J. (1991). On certail methods of improving ration and regression estimators. Commun. Stat. Theory Methods 20(10):3325–3340.[Taylor &; Francis Online], [Web of Science ®] , [Google Scholar]), Singh et al. (2009 Singh, R., Chauhan, P., Sawan, N., Smarandache, F. (2009). Improvement in estimating the population mean using exponential estimator in simple random sampling. Int. J. Stat. Econ. 3(A09):13–18. [Google Scholar]), Shabbir and Gupta (2010 Shabbir, J., Gupta, S. (2010). On estimating finite population mean in simple and stratified random sampling. Commun. Stat. Theory Methods 40(2):199–212.[Taylor &; Francis Online], [Web of Science ®] , [Google Scholar]), Grover and Kaur (2011 Grover, L.K., Kaur, P. (2011). An improved estimator of the finite population mean in simple random sampling. Model Assisted Stat. Appl. 6(1):47–55. [Google Scholar], 2014) estimators.     

Bahadur Representation of Linear Kernel Quantile Estimator for Stationary Processes

In this article, we discuss the method of linear kernel quantile estimator proposed by Parzen (1979 Parzen, E. (1979). Nonparametric statistical data modeling. J. Amer. Statist. Assoc. 74:105121.[Taylor &; Francis Online], [Web of Science ®] , [Google Scholar]). We establish a Bahadur representation in sense of almost surely convergence with the rate log^{? α}n under the case of S-mixing random variable sequence which was proposed by Berkes (2009 Berkes, I., Hörmann, S., (2009). Asymptotic results for the itpirical process of stationary sequences. Stoch. Process. Their Applic. 119:12981324.[Crossref], [Web of Science ®] , [Google Scholar]). We also obtain the strong consistence of this estimator and its convergence rate.     

Tuning Parameter Selection and Various Good Fitting Characteristics for the Liu-Type Estimator in Linear Regression

Liu (2003 Liu , K. ( 2003 ). Using Liu-Type estimator to combat collinearity . Commun. Statist. Theor. Meth. 32 ( 5 ): 1009 – 1020 .[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]) proposed the Liu-Type estimator (LTE) to combat the well-known multicollinearity problem in linear regression. In this article, various better fitting characteristics of the LTE than those of the ordinary ridge regression estimator (Hoerl and Kennard, 1970 Hoerl , A. E. , Kennard , R. W. ( 1970 ). Ridge regression: Biased estimation for non-orthogonal problems . Technometrics 12 : 55 – 67 .[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]) are considered. In particular, we derived two methods to determine the parameter d for the LTE and find that the ridge parameter k could serve for regularization of an ill-conditioned design matrix, while the other parameter d could be used for tuning the fit quality. In addition, the coefficients of regression, coefficient of multiple determination, residual error variance, and generalized cross validation (GCV) of the prediction quality are very stable, and as the ridge parameter increases they eventually reach asymptotic levels, which produces robust regression models. Furthermore, a Monte Carlo evaluation of these features is also given to illustrate some of the theoretical results.