Strong uniform consistency rates of kernel estimators of cumulative distribution functions

In this paper we consider the uniform strong consistency, along with a rate, of the cumulative distribution function (CDF) estimator. We extend the extended Glivenko–Cantelli lemma (for empirical distribution function) in Fabian and Hannan (1985 Fabian, V., Hannan, J. (1985). Introduction to Probability and Mathematical Statistics. New York: Wiley, ISBN-13:978-0471250234. [Google Scholar], pp. 80–83) to the kernel estimator of the CDF.     

The smooth colonel and the reverend find common ground

A semiparametric regression estimator that exploits categorical (i.e., discrete-support) kernel functions is developed for a broad class of hierarchical models including the pooled regression estimator, the fixed-effects estimator familiar from panel data, and the varying coefficient estimator, among others. Separate shrinking is allowed for each coefficient. Regressors may be continuous or discrete. The estimator is motivated as an intuitive and appealing generalization of existing methods. It is then supported by demonstrating that it can be realized as a posterior mean in the Lindley and Smith (1972 Lindley, D. V., Smith, A. F. M. (1972). Bayes estimates for the linear model. Journal of the Royal Statistical Society 34:1–41. [Google Scholar]) framework. As a demonstration of the flexibility of the proposed approach, the model is extended to nonparametric hierarchical regression based on B-splines.     

Skewing and Generalized Jackknifing in Kernel Density Estimation

Abstract

Kernel methods are very popular in nonparametric density estimation. In this article we suggest a simple estimator which reduces the bias to the fourth power of the bandwidth, while the variance of the estimator increases only by at most a moderate constant factor. Our proposal turns out to be a fourth order kernel estimator and may be regarded as a new version of the generalized jackknifing approach (Schucany W. R., Sommers, J. P. (1977 Schucany, W. R. and Sommers, J. P. 1977. Improvement of kernel type estimators. Journal of the American Statistical Association, 72: 420–423. [Taylor & Francis Online], [Web of Science ®] , [Google Scholar]). Improvement of Kernal type estimators. Journal of the American Statistical Association 72:420–423.) applied to kernel density estimation.     

The Restricted and Unrestricted Two-Parameter Estimators

In this article, we introduce a new two-parameter estimator by grafting the contraction estimator into the modified ridge estimator proposed by Swindel (1976 Swindel , B. F. ( 1976 ). Good ridge estimators based on prior information . Commun. Statist. Theor. Meth. A5 : 1065 – 1075 .[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]). This new two-parameter estimator is a general estimator which includes the ordinary least squares, the ridge, the Liu, and the contraction estimators as special cases. Furthermore, by setting restrictions Rβ = r on the parameter values we introduce a new restricted two-parameter estimator which includes the well-known restricted least squares, the restricted ridge proposed by Groß (2003 Groß , J. ( 2003 ). Restricted ridge estimation . Statist. Probab. Lett. 65 : 57 – 64 .[Crossref], [Web of Science ®] , [Google Scholar]), the restricted contraction estimators, and a new restricted Liu estimator which we call the modified restricted Liu estimator different from the restricted Liu estimator proposed by Kaç?ranlar et al. (1999 Kaç?ranlar , S. , Sakall?o?lu , S. , Akdeniz , F. , Styan , G. P. H. , Werner , H. J. ( 1999 ). A new biased estimator in linear regression and a detailed analysis of the widely-analysed dataset on Portland cement . Sankhya Ser. B., Ind. J. Statist. 61 : 443 – 459 . [Google Scholar]). We also obtain necessary and sufficient condition for the superiority of the new two-parameter estimator over the ordinary least squares estimator and the comparison of the new restricted two-parameter estimator to the new two-parameter estimator is done by the criterion of matrix mean square error. The estimators of the biasing parameters are given and a simulation study is done for the comparison as well as the determination of the biasing parameters.     

A Note on the Comparison of the Stein Estimator and the James-Stein Estimator

The seminal work of Stein (1956 Stein, C. (1956). Inadmissibility of the usual estimator for the mean of a multivariate normal distribution. Proc. Third Berkeley Symp. Mathemat. Statist. Probab., University of California Press, 1:197–206. [Google Scholar]) showed that the maximum likelihood estimator (MLE) of the mean vector of a p-dimensional multivariate normal distribution is inadmissible under the squared error loss function when p ? 3 and proposed the Stein estimator that dominates the MLE. Later, James and Stein (1961 James, W., Stein, C. (1961). Estimation with quadratic loss. Proc. Fourth Berkeley Symp. Mathemat. Statist. Probab., University of California Press, 1:361–379. [Google Scholar]) proposed the James-Stein estimator for the same problem and received much more attention than the original Stein estimator. We re-examined the Stein estimator and conducted an analytic comparison with the James-Stein estimator. We found that the Stein estimator outperforms the James-Stein estimator under certain scenarios and derived the sufficient conditions.     

SECOND-ORDER ASYMPTOTICS FOR SCORE TESTS IN HETEROSKEDASTIC t REGRESSION MODELS

ABSTRACT

This paper develops corrected score tests for heteroskedastic t regression models, thus generalizing results by Cordeiro, Ferrari and Paula[1] Cordeiro, G.M., Ferrari, S.L.P. and Paula, G.A. 1993. Improved Score Tests for Generalized Linear Models. Journal of the Royal Statistical Society B, 55: 661–674.  [Google Scholar] and Cribari-Neto and Ferrari[2] Cribari-Neto, F. and Ferrari, S.L.P. 1995. Second-order Asymptotics for Score Tests in Generalised Linear Models. Biometrika, 82: 426–432. [Crossref], [Web of Science ®] , [Google Scholar] for normal regression models and by Ferrari and Arellano-Valle[3] Ferrari, S.L.P. and Arellano-Valle, R. 1996. Modified Likelihood Ratio and Score Tests in Linear Regression Models Using the t Distribution. Brazilian Journal of Probability and Statistics, 10: 15–33.  [Google Scholar] for homoskedastic t regression models. We present, in matrix notation, Bartlett-type correction formulae to improve score tests in this class of models. The corrected score statistics have a chi-squared distribution to order n ^?1, where n is the sample size. We apply our main result to a few special models and present simulation results comparing the performance of the usual score tests and their corrected versions.     

First difference transformation in panel VAR models: Robustness,estimation, and inference

This article considers estimation of Panel Vector Autoregressive Models of order 1 (PVAR(1)) with focus on fixed T consistent estimation methods in First Differences (FD) with additional strictly exogenous regressors. Additional results for the Panel FD ordinary least squares (OLS) estimator and the FDLS type estimator of Han and Phillips (2010 Han, C., Phillips, P. C. B. (2010). Gmm estimation for dynamic panels with fixed effects and strong instruments at unity. Econometric Theory 26:119–151.[Crossref], [Web of Science ®] , [Google Scholar]) are provided. Furthermore, we simplify the analysis of Binder et al. (2005 Binder, M., Hsiao, C., Pesaran, M. H. (2005). Estimation and inference in short panel vector autoregressions with unit root and cointegration. Econometric Theory 21:795–837.[Crossref], [Web of Science ®] , [Google Scholar]) by providing additional analytical results and extend the original model by taking into account possible cross-sectional heteroscedasticity and presence of strictly exogenous regressors. We show that in the three wave panel the log-likelihood function of the unrestricted Transformed Maximum Likelihood (TML) estimator might violate the global identification assumption. The finite-sample performance of the analyzed methods is investigated in a Monte Carlo study.     

The raise estimator estimation,inference, and properties

Several methods using different approaches have been developed to remedy the consequences of collinearity. To the best of our knowledge, only the raise estimator proposed by García et al. (2010 García, C.B., García, J., Soto, J. (2010). The raise method: An alternative procedure to estimate the parameters in presence of collinearity. Qual. Quantity 45(2):403–423.[Crossref], [Web of Science ®] , [Google Scholar]) deals with this problem from a geometric perspective. This article fully develops the raise estimator for a model with two standardized explanatory variables. Inference in the raise estimator is examined, showing that it can be obtained from ordinary least squares methodology. In addition, contrary to what happens in ridge regression, the raise estimator maintains the coefficient of determination value constant. The expression of the variance inflation factor for the raise estimator is also presented. Finally, a comparative study of the raise and ridge estimators is carried out using an example.     

Limiting bias-reduced Amoroso kernel density estimators for non-negative data

The Amoroso kernel density estimator (Igarashi and Kakizawa 2017 Igarashi, G., and Y. Kakizawa. 2017. Amoroso kernel density estimation for nonnegative data and its bias reduction. Department of Policy and Planning Sciences Discussion Paper Series No. 1345, University of Tsukuba. [Google Scholar]) for non-negative data is boundary-bias-free and has the mean integrated squared error (MISE) of order O(n^{? 4/5}), where n is the sample size. In this paper, we construct a linear combination of the Amoroso kernel density estimator and its derivative with respect to the smoothing parameter. Also, we propose a related multiplicative estimator. We show that the MISEs of these bias-reduced estimators achieve the convergence rates n^{? 8/9}, if the underlying density is four times continuously differentiable. We illustrate the finite sample performance of the proposed estimators, through the simulations.     

A New Two-Parameter Estimator in Linear Regression

This article is concerned with the parameter estimation in linear regression model. To overcome the multicollinearity problem, a new two-parameter estimator is proposed. This new estimator is a general estimator which includes the ordinary least squares (OLS) estimator, the ridge regression (RR) estimator, and the Liu estimator as special cases. Necessary and sufficient conditions for the superiority of the new estimator over the OLS, RR, Liu estimators, and the two-parameter estimator proposed by Ozkale and Kaciranlar (2007 Ozkale , M. R. , Kaciranlar , S. ( 2007 ). The restricted and unrestricted two-parameter estimators . Commun. Statist. Theor. Meth. 36 : 2707 – 2725 .[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]) in the mean squared error matrix (MSEM) sense are derived. Furthermore, we obtain the estimators of the biasing parameters and give a numerical example to illustrate some of the theoretical results.     

Additive Risk Model Using Piecewise Constant Hazard Function

We study a weighted least squares estimator for Aalen's additive risk model with right-censored survival data which allows for a very flexible handling of covariates. We divide the follow-up period into intervals and assume a constant hazard rate in each interval. The model is motivated as a piecewise approximation of a hazard function composed of three parts: arbitrary nonparametric functions for some covariate effects, smoothly varying functions for others, and known (or constant) functions for yet others. The proposed estimator is an extension of the grouped data version of the Huffer and McKeague (1991 Huffer , F. W. , McKeague , I. W. ( 1991 ). Weighted least squares estimation for Aalen's additive risk model . Journal of the American Statistical Association 86 : 114 – 129 .[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]) estimator. For our model, since the number of parameters is finite (although large), conventional approaches (such as maximum likelihood) are easy to formulate and implement. The approach is illustrated by simulations, and is compared to the previous studies. The method is also applied to the Framingham study data.     

Discussion of “Simple Estimators for Invertible Index Models” by H. Ahn,H. Ichimura,J. Powell,and P. Ruud

This is an interesting article that considers the question of inference on unknown linear index coefficients in a general class of models where reduced form parameters are invertible function of one or more linear index. Interpretable sufficient conditions such as monotonicity and or smoothness for the invertibility condition are provided. The results generalize some work in the previous literature by allowing the number of reduced form parameters to exceed the number of indices. The identification and estimation expand on the approach taken in previous work by the authors. Examples include Ahn, Powell, and Ichimura (2004 Ahn, H., Powell, J., and Ichimura, H. (2004), “Simple Estimators for Monotone Index Models,” UC Berkeley Working Paper. [Google Scholar]) for monotone single-index regression models to a multi-index setting and extended by Blundell and Powell (2004 Blundell, R. W., and Powell, J. L. (2004), “Endogeneity in Semiparametric Binary Response Models,” The Review of Economic Studies, 71, 655–679.[Crossref], [Web of Science ®] , [Google Scholar]) and Powell and Ruud (2008 Powell, J., and Ruud, P. (2008), “Simple Estimators for Semiparametric Multinomial Choice Models,” UC Berkeley Working Paper. [Google Scholar]) to models with endogenous regressors and multinomial response, respectively. A key property of the inference approach taken is that the estimator of the unknown index coefficients (up to scale) is computationally simple to obtain (relative to other estimators in the literature) in that it is closed form. Specifically, unifying an approach for all models considered in this article, the authors propose an estimator, which is the eigenvector of a matrix (defined in terms of a preliminary estimator of the reduced form parameters) corresponding to its smallest eigenvalue. Under suitable conditions, the proposed estimator is shown to be root-n-consistent and asymptotically normal.     

Estimation of the Mean of a Sensitive Variable in the Presence of Auxiliary Information

Sousa et al. (2010 Sousa , R. , Shabbir , J. , Real , P. C. , Gupta , S. ( 2010 ). Ratio estimation of the mean of a sensitive variable in the presence of auxiliary information . J. Statist. Theor. Prac. 4 ( 3 ): 495 – 507 .[Taylor & Francis Online] , [Google Scholar]) introduced a ratio estimator for the mean of a sensitive variable and showed that this estimator performs better than the ordinary mean estimator based on a randomized response technique (RRT). In this article, we introduce a regression estimator that performs better than the ratio estimator even for modest correlation between the primary and the auxiliary variables. The underlying assumption is that the primary variable is sensitive in nature but a non sensitive auxiliary variable exists that is positively correlated with the primary variable. Expressions for the Bias and MSE (Mean Square Error) are derived based on the first order of approximation. It is shown that the proposed regression estimator performs better than the ratio estimator and the ordinary RRT mean estimator (that does not utilize the auxiliary information). We also consider a generalized regression-cum-ratio estimator that has even smaller MSE. An extensive simulation study is presented to evaluate the performances of the proposed estimators in relation to other estimators in the study. The procedure is also applied to some financial data: purchase orders (a sensitive variable) and gross turnover (a non sensitive variable) in 2009 for a population of 5,336 companies in Portugal from a survey on Information and Communication Technologies (ICT) usage.     

Kernel Density Estimator From Ranked Set Samples

We study kernel density estimator from the ranked set samples (RSS). In the kernel density estimator, the selection of the bandwidth gives strong influence on the resulting estimate. In this article, we consider several different choices of the bandwidth and compare their asymptotic mean integrated square errors (MISE). We also propose a plug-in estimator of the bandwidth to minimize the asymptotic MISE. We numerically compare the MISE of the proposed kernel estimator (having the plug-in bandwidth estimator) to its simple random sampling counterpart. We further propose two estimators for a symmetric distribution, and show that they outperform in MISE all other estimators not considering symmetry. We finally apply the methods in this article to analyzing the tree height data from Platt et al. (1988 Platt, W.J., Evans, G.M., Rathbun, S.L. (1988). The population dynamics of long-lived conifer (Pinus plaustris) (1988). Amer. Natrualist 131:491–525.[Crossref], [Web of Science ®] , [Google Scholar]) and Chen et al. (2003 Chen, Z., Bai, Z., Sinha, B.K. (2003). Ranked Set Sampling: Theory and Applications. New York: Springer. [Google Scholar]).     

Stein-like 2SLS estimator

ABSTRACT

Maasoumi (1978 Maasoumi, E. (1978). A modified Stein-like estimator for the reduced form coefficients of simultaneous equations. Econometrica 46:695–703.[Crossref], [Web of Science ®] , [Google Scholar]) proposed a Stein-like estimator for simultaneous equations and showed that his Stein shrinkage estimator has bounded finite sample risk, unlike the three-stage least square estimator. We revisit his proposal by investigating Stein-like shrinkage in the context of two-stage least square (2SLS) estimation of a structural parameter. Our estimator follows Maasoumi (1978 Maasoumi, E. (1978). A modified Stein-like estimator for the reduced form coefficients of simultaneous equations. Econometrica 46:695–703.[Crossref], [Web of Science ®] , [Google Scholar]) in taking a weighted average of the 2SLS and ordinary least square estimators, with the weight depending inversely on the Hausman (1978 Hausman, J. A. (1978). Specification tests in econometrics. Econometrica 46:1251–1271.[Crossref], [Web of Science ®] , [Google Scholar]) statistic for exogeneity. Using a local-to-exogenous asymptotic theory, we derive the asymptotic distribution of the Stein estimator and calculate its asymptotic risk. We find that if the number of endogenous variables exceeds 2, then the shrinkage estimator has strictly smaller risk than the 2SLS estimator, extending the classic result of James and Stein (1961 James W, ., Stein, C. M. (1961). Estimation with quadratic loss. Proceedings of the Fourth Berkeley Symposium on Mathematical Statistics and Probability 1:361–380. [Google Scholar]). In a simple simulation experiment, we show that the shrinkage estimator has substantially reduced finite sample median squared error relative to the standard 2SLS estimator.     

SCAD-Penalized Least Absolute Deviation Regression in High-Dimensional Models

When outliers and/or heavy-tailed errors exist in linear models, the least absolute deviation (LAD) regression is a robust alternative to the ordinary least squares regression. Existing variable-selection methods in linear models based on LAD regression either only consider the finite number of predictors or lack the oracle property associated with the estimator. In this article, we focus on the variable selection via LAD regression with a diverging number of parameters. The rate of convergence of the LAD estimator with the smoothly clipped absolute deviation (SCAD) penalty function is established. Furthermore, we demonstrate that, under certain regularity conditions, the penalized estimator with a properly selected tuning parameter enjoys the oracle property. In addition, the rank correlation screening method originally proposed by Li et al. (2011 Li, G.R., Peng, H., Zhu, L.X. (2011). Nonconcave penalized M-estimation with a diverging number of parameters. Statistica Sinica 21:391–419.[Web of Science ®] , [Google Scholar]) is applied to deal with ultrahigh dimensional data. Simulation studies are conducted for revealing the finite sample performance of the estimator. We further illustrate the proposed methodology by a real example.     

Discriminant analysis under the common principal components model

For two or more populations of which the covariance matrices have a common set of eigenvectors, but different sets of eigenvalues, the common principal components (CPC) model is appropriate. Pepler et al. (2015 Pepler, P. T., Uys, D. W. and Nel, D. G. (2015). Regularised covariance matrix estimation under the common principal components model. Communications in Statistics: Simulation and Computation. (In press). [Google Scholar]) proposed a regularized CPC covariance matrix estimator and showed that this estimator outperforms the unbiased and pooled estimators in situations, where the CPC model is applicable. This article extends their work to the context of discriminant analysis for two groups, by plugging the regularized CPC estimator into the ordinary quadratic discriminant function. Monte Carlo simulation results show that CPC discriminant analysis offers significant improvements in misclassification error rates in certain situations, and at worst performs similar to ordinary quadratic and linear discriminant analysis. Based on these results, CPC discriminant analysis is recommended for situations, where the sample size is small compared to the number of variables, in particular for cases where there is uncertainty about the population covariance matrix structures.     

Uniformly strong consistency of frequency polygons for negatively associated samples

In this article, the frequency polygon studied by Scott (1985 Scott, D. W. (1985). Frequency polygons: Theory and application. Journal of the American Statistical Association 80(390):348–354.[Taylor &; Francis Online], [Web of Science ®] , [Google Scholar]) is investigated as a nonparametric estimator for negatively associated samples. By the Bernstein type inequality, we give the uniformly strong consistency of the estimator and obtain the corresponding rate under some mild conditions.     

Statistical Properties of Threshold Models

This article focuses the attention on the Self Exciting Threshold Autoregressive Moving Average model (SETARMA) proposed in Tong (1983 Tong , H. ( 1983 ). Threshold Models in Nonlinear Time Series Analysis . London : Springer-Verlag .[Crossref] , [Google Scholar]). The stochastic structure of the model is discussed and different specifications are presented. Starting from one of them, we give sufficient conditions for the weak stationarity of the model that are discussed and critically compared to other results given in literature. In particular, after showing that the SETARMA model belongs to the class of the Random Coefficients Autoregressive models, widely discussed in Nicholls and Quinn (1982 Nicholls , D. F. , Quinn , B. G. (1982). Random Coefficients Autoregressive Models. An Introduction . New York : Springer-Verlag.[Crossref] , [Google Scholar]), we give some issues on the weak stationarity of its stochastic structure that are more general than those given in the existing literature and appear not affected by the moving average component.