Model selection in regression based on pre-smoothing

In this paper, we investigate the effect of pre-smoothing on model selection. Christóbal et al 6 Christóbal Christóbal, J. A., Faraldo Roca, P. and González Manteiga, W. 1987. A class of linear regression parameter estimators constructed by nonparametric estimation. Ann. Statist.,, 15: 603–609. [Crossref], [Web of Science ®] [Google Scholar] showed the beneficial effect of pre-smoothing on estimating the parameters in a linear regression model. Here, in a regression setting, we show that smoothing the response data prior to model selection by Akaike's information criterion can lead to an improved selection procedure. The bootstrap is used to control the magnitude of the random error structure in the smoothed data. The effect of pre-smoothing on model selection is shown in simulations. The method is illustrated in a variety of settings, including the selection of the best fractional polynomial in a generalized linear model.     

On Asymptotic Normality of the Local Polynomial Regression Estimator with Stochastic Bandwidths

Nonparametric density and regression estimators commonly depend on a bandwidth. The asymptotic properties of these estimators have been widely studied when bandwidths are non stochastic. In practice, however, in order to improve finite sample performance of these estimators, bandwidths are selected by data driven methods, such as cross-validation or plug-in procedures. As a result, nonparametric estimators are usually constructed using stochastic bandwidths. In this article, we establish the asymptotic equivalence in probability of local polynomial regression estimators under stochastic and nonstochastic bandwidths. Our result extends previous work by Boente and Fraiman (1995 Boente , G. , Fraiman , R. ( 1995 ). Asymptotic distribution of data-driven smoothers in density and regression estimation under dependence . Can. J. Statist. 23 : 383 – 397 .[Crossref], [Web of Science ®] , [Google Scholar]) and Ziegler (2004 Ziegler , K. ( 2004 ). Adaptive kernel estimation of the mode in nonparametric random design regression model . Probab. Mathemat. Statist. 24 : 213 – 235 . [Google Scholar]).     

Performance of Some Ridge Parameters for Probit Regression: With Application to Swedish Job Search Data

In ridge regression, the estimation of the ridge parameter is an important issue. This article generalizes some methods for estimating the ridge parameter for probit ridge regression (PRR) model based on the work of Kibria et al. (2011 Kibria, B. M. G., Månsson, K. and Shukur, G. 2011. Performance of some logistic ridge regression parameters. Computational Economics, DOI: 10.1007/s10614-011-9275-x [Google Scholar]). The performance of these new estimators is judged by calculating the mean squared error (MSE) using Monte Carlo simulations. In the design of the experiment, we chose to vary the sample size and the number of regressors. Furthermore, we generate explanatory variables that are linear combinations of other regressors, which is a common situation in economics. In an empirical application regarding Swedish job search data, we also illustrate the benefits of the new method.     

Asymptotics of the Lp-Norms of Density Estimators in the Nonlinear Autoregressive Models

This article investigates the asymptotic behavior of the error density function in nonlinear autoregressive stationary time series regression models. For any 1 ? p < ∞, the kernel density estimator of residuals is shown to be consistent for the error estimator concerning the L_p-distance, which extends the result developed by Cheng and Sun (2008 Cheng, F. X. (2005). Asymptotic distributions of error density estimators in first-order autoregression models. Sankhy Ind. J. Statist. 67:553–567. [Google Scholar]) in L₂-norm. Moreover, the result developed in this article is extended the results of Horváth and Zitikis (2003 Horváth, L., Zitikis, R. (2003). Asymptotics of the L_p-norms of density estimators in the first-order autoregressive models. Statist. Probab. Lett. 65:331342.[Crossref], [Web of Science ®] , [Google Scholar]) to nonlinear autoregressive models.     

A Generalized Correlation Coefficient for the General Two-Treatment Crossover Design

This article extends the correlation methodology developed by Chinchilli et al. (2005 Chinchilli , V. M. , Phillips , B. R. , Mauger , D. T. , Szefler , S. J. ( 2005 ). A general class of correlation coefficients for the 2 × 2 crossover design . Biometr. J. 47 : 1 – 10 . [Google Scholar]) for the 2 × 2 crossover design to more complex crossover designs for clinical trials. We describe how the methodology can be adapted to a general type of two-treatment crossover design which includes either at least two sequences or at least two treatment periods or both. We then derive the asymptotic theory for the corresponding correlation statistics, investigate the statistical accuracy of the estimators via bootstrap analyses, and demonstrate their use with two real data examples.     

Adaptive Estimation of Causal Periodic Autoregressive Model

This article deals with the adaptive estimation of a periodic autoregressive model, with unspecified innovation density satisfying only some general technical assumptions. We first establish, while verifying the adapted sufficient conditions of Swensen (1985 Swensen , A. R. ( 1985 ). The asymptotic distribution of the likelihood ratio for autoregressive time series with a regression trend . Journal of Multivariate Analysis 16 : 54 – 70 .[Crossref], [Web of Science ®] , [Google Scholar]) to our model, the Local Asymptotic Normality (LAN), the Local Asymptotic Quadratic (LAQ), and the Local Asymptotic properties satisfied by its central sequence. Secondly, the Locally Asymptotically Minimax (LAM) estimators are constructed. Using these results, we construct the adaptive estimators of the unknown autoregressive parameters. The performances of the established estimators are shown, via simulation studies.     

Hartley-Ross Type Estimators for Population Mean Using Known Parameters of Auxiliary Variate

This article proposes Hartley-Ross type unbiased estimators of finite population mean using information on known parameters of auxiliary variate when the study variate and auxiliary variate are positively correlated. The variances of the proposed unbiased estimators are obtained. It has been shown that the proposed estimators are more efficient than the simple mean estimator, usual ratio estimator and estimators proposed by Sisodia and Dwivedi (1981 Sisodia , B. V. S. , Dwivedi , V. K. ( 1981 ). A modified ratio estimator using coefficient of variation of auxiliary variable . J. Indian Soc. Agricultural Statist. 33 ( 1 ): 13 – 18 . [Google Scholar]), Kadilar and Cingi (2006 Kadilar , C. , Cingi , H. ( 2006 ). A new ratio estimator using correlation coefficient . Int. Statist. 1 – 11 . [Google Scholar]), and Kadilar et al. (2007 Kadilar , C. , Candan , M. , Cingi , H. ( 2007 ). Ratio estimators using robust regression . Hacet. J. Math. Statist. 36 ( 2 ): 181 – 188 .[Web of Science ®] , [Google Scholar]) under certain realistic conditions. Empirical studies are also carried out to demonstrate the merits of the proposed unbiased estimators over other estimators considered in this article.     

A new log-location regression model: estimation,influence diagnostics and residual analysis

We introduce a log-linear regression model based on the odd log-logistic generalized half-normal distribution [7 G.M. Cordeiro, M. Alizadeh, R.R. Pescim, and E.M.M. Ortega, The odd log-logistic generalized half-normal lifetime distribution: Properties and applications, Comm. Statist. Theory Methods (2015), accepted for publication. [Google Scholar]]. Some of its structural properties including explicit expressions for the density function, quantile and generating functions and ordinary moments are derived. We estimate the model parameters by the maximum likelihood method. For different parameter settings, proportion of censoring and sample size, some simulations are performed to investigate the behavior of the estimators. We derive the appropriate matrices for assessing local influence diagnostics on the parameter estimates under different perturbation schemes. We also define the martingale and modified deviance residuals to detect outliers and evaluate the model assumptions. In addition, we demonstrate that the extended regression model can be very useful in the analysis of real data and provide more realistic fits than other special regression models. The potentiality of the new regression model is illustrated by means of a real data set.     

Jackknifing the Ridge Regression Estimator: A Revisit

Singh et al. (1986 Singh, B., Chaubey, Y.P., Dwivedi, T.D. (1986). An almost unbiased ridge estimator. Sankhya B48: 34236. [Google Scholar]) proposed an almost unbiased ridge estimator using Jackknife method that required transformation of the regression parameters. This article shows that the same method can be used to derive the Jackknifed ridge estimator of the original (untransformed) parameter without transformation. This method also leads in deriving easily the second-order Jackknifed ridge that may reduce the bias further. We further investigate the performance of these estimators along with a recent method by Batah et al. (2008 Batah, F. S.M., Ramanathan, T.V., Gore, S.D. (2008). The efficiency of modified Jack-knife and ridge type regression estimators: a comparison. Surv. Math. Applic. 3:111122. [Google Scholar]) called modified Jackknifed ridge theoretically as well as numerically.     

Discrete Beta-Exponential Distribution

Consider the estimation of the regression parameters in the usual linear model. For design densities with infinite support, it has been shown by Faraldo Roca and González Manteiga [1] Faraldo Roca, P. and González Manteiga, W. 1987. “Efficiency of a new class of linear regression estimates obtained by preliminary nonparametric estimation”. In New Perspectives in Theoretical and Applied Statistics Edited by: Puri, M. L., Vilaplana, J. P. and Wertz, W. 229–242. New York: John Wiley.  [Google Scholar] that it is possible to modify the classical least squares procedure and to obtain estimators for the regression parameters whose MSE's (mean squared errors) are smaller than those of the usual least squares estimators. The modification consists of presmoothing the response variables by a kernel estimator of the regression function. These authors also show that the gain in efficiency is not possible for a design density with compact support. We show that in this case local linear presmoothing does not fix this inefficiency problem, in spite of the well known fact that local linear fitting automatically corrects the bias in the endpoints of the (design density) support. We demonstrate on a theoretical basis how this inefficiency problem can be rectified in the compact design case: we prove that presmoothing with boundary kernels studied in Müller [2] Müller, H.-G. 1991. Smooth optimum kernel estimators near endpoints. Biometrika, 78: 521–530. [Crossref], [Web of Science ®] , [Google Scholar] and Müller and Wang [3] Müller, H.-G. and Wang, J.-L. 1994. Hazard rate estimation under random censoring with varying kernels and bandwidths. Biometrics, 50: 61–76. [Crossref], [PubMed], [Web of Science ®] , [Google Scholar] leads to regression estimators which are superior over the least squares estimators. A very careful analytic treatment is needed to arrive at these asymptotic results.     

Estimation of finite population mean using two auxiliary variables in stratified two-phase sampling

We propose a new ratio type estimator for estimating the finite population mean using two auxiliary variables in stratified two-phase sampling. Expressions for bias and mean squared error of the proposed estimator are derived up to the first order of approximation. The proposed estimator is more efficient than the usual stratified sample mean estimator, traditional stratified ratio estimator and some other stratified estimators including Bahl and Tuteja (1991 Bahl, S., Tuteja, R. K. (1991). Ratio and product type exponential estimators. Information and Optimization Sciences 12:159–163. [Google Scholar]), Chami et al. (2012 Chami, P. S., Singh, B., Thomas, D. (2012). A two-prameter ratio-product-ratio estimator using auxiliary information. ISRN Probability and Statistics 2012:1–15, doi: 10.5402/2012/103860.[Crossref] , [Google Scholar]), Chand (1975 Chand, L. (1975) Some Ratio Type Estimator Based on two or more Auxiliary Variables, Ph.D. dissertation, Iowa State University, Ames, Iowa (unpublished). [Google Scholar]), Choudhury and Singh (2012 Choudhury, S., Singh, B. K. (2012). A class of chain ratio-product type estimators with two auxiliary variables under double sampling scheme. Journal of the Korean Statistical Society 41:247–256. [Google Scholar]), Hamad et al. (2013 Hamad, N., Hanif, M., Haider, N. (2013). A regression type estimator with two auxiliary variables for two-phase sampling. Open Journal of Statistics, 3:74–78. [Google Scholar]), Vishwakarma and Gangele (2014 Vishwakarma, G. K., Gangele, R. K. (2014). A class of chain ratio-type exponential estimators in double sampling using two auxiliary variates. Applied Mathematics and Computation 227:171–175. [Google Scholar]), Sanaullah et al. (2014 Sanaullah, A., Ali, H. M., Noor ul Amin, M., Hanif, M. (2014). Generalized exponential chain ratio estimators under stratified two-phase random sampling. Applied Mathematics and Computation 226:541–547. [Google Scholar]), and Chanu and Singh (2014 Chanu, W. K., Singh, B. K. (2014). Improved class of ratio-cum-product estimators of finite population mean in two phase sampling. Global Journal of Science Frontier Research: F Mathematics and Decision Sciences 14(2):1–14. [Google Scholar]).     

Geometric View of Measurement Errors

The slope of the best fit line from minimizing the sum of the squared oblique errors is the root of a polynomial of degree four. This geometric view of measurement errors is used to give insight into the performance of various slope estimators for the measurement error model including an adjusted fourth moment estimator introduced by Gillard and Iles (2005 Gillard , J. , Iles , T. ( 2005 ). Method of moments estimation in linear regression with errors in both variables, Cardiff University School of Mathematics Technical Report, Cardiff, Wales, UK . [Google Scholar]) to remove the jump discontinuity in the estimator of Copas (1972 Copas , J. ( 1972 ). The likelihood surface in the linear functional relationship problem . Journal of the Royal Statistical Society. Series B (Methodological) 34 : 274 – 278 . [Google Scholar]). The polynomial of degree four is associated with a minimun deviation estimator. A simulation study compares these estimators showing improvement in bias and mean squared error.     

Locally Most Powerful Rank Tests for Comparison of Two Failure Rates Based on Multiple Type-II Censored Data

This article deals with the locally most powerful rank tests for testing the hypothesis that two failure rates are equal against the alternative that one failure rate is greater than the other, when the combined ordered sample is multiple Type-II censored. A modified version of the Dupa? and Hájek (1969 Dupa? , V. , Hájek , J. (1969). Asymptotic normality of simple linear rank statistics under alternatives II. Ann. Math. Statist. 40:1992–2017.[Crossref] , [Google Scholar]) theorem is used to establish their asymptotic normality under fixed alternative since the scores generating functions associated with these rank test statistics have a finite number of jump discontinuities. The modified version that leads to a simpler centering constant, is proved by Dupa? (1970 Dupa? , V. ( 1970 ). A contribution to the asymptotic normality of simple linear rank statistics. In: Puri, M. L., ed. Nonparametric Techniques in Statistical Inference. Cambridge: Cambridge University Press . [Google Scholar]) using the results of Hájek (1968 Hájek , J. ( 1968 ). Asymptotic normality of simple linear rank statistics under alternatives . Ann. Math. Statist. 39 : 325 – 346 .[Crossref] , [Google Scholar]). The Pitman AREs of these rank tests based on censored data relative to the corresponding tests based on complete data are obtained under some Lehmann-type alternative distributions such that their failure rates dominate the failure rates of the respective null distributions. The AREs are computed numerically for single (left or right) and double censored data, and the extent of loss due to these censoring schemes is discussed. The rank tests considered here include among them the Mann-Whiney-Wilcoxon (MWW) test, the Savage test, and the linear combination of these two tests. In the case of all the tests, except the MWW test, it is found that the loss of efficiency due to left censoring is considerably less than that due to right censoring. In the case of finite samples, Monte Carlo simulation results showing the empirical levels and empirical powers against some Lehmann alternatives are presented.     

Some Classes of Estimators for the Population Median Using Auxiliary Information

This article considers some classes of estimators of the population median of the study variable using information on an auxiliary variable with their properties under large sample approximation. Asymptotic optimum estimator (AOE) in each class of estimators has been investigated along with the approximate mean square error formulae. It has been shown that the proposed classes of estimators are better than these considered by Gross (1980 Gross , T. S. ( 1980 ). Median estimation in sample surveys. Proc. Surv. Res. Meth. Sect. Amer. Statist. Assoc. 181–184 . [Google Scholar]), Kuk and Mak (1989 Kuk , A. Y. C. , Mak , T. K. ( 1989 ). Median estimation in the presence of auxiliary information . J. Roy. Statist. Soc. Ser. B51 : 261 – 269 . [Google Scholar]), Singh et al. (2003a Singh , H. P. , Singh , S. , Joarder , A. H. ( 2003a ). Estimation of population median when mode of an auxiliary variable is known . J. Statist. Res. 37 ( 1 ): 57 – 63 . [Google Scholar]), and Al and Cingi (2009 Al , S. , Cingi , H. ( 2009 ). New estimators for the population median in simple random sampling. Tenth Islamic Countries Conference on Statistical Sciences, held in New Cairo, Egypt . [Google Scholar]). An empirical study is carried out to judge the merits of the suggested class of estimators over other existing estimators.     

Ratio-Cum-Product Type Exponential Estimator of Finite Population Mean in Stratified Random Sampling

This article addresses the problem of estimating the finite population mean in stratified random sampling using auxiliary information. Motivated by Singh (1967 Singh , M. P. ( 1967 ). Ratio cum product method of estimation . Metrika 12 : 34 – 42 .[Crossref] , [Google Scholar]) and Bahl and Tuteja (1991 Bahl , S. , Tuteja , R. K. ( 1991 ). Ratio and product type exponential estimator . Inform. Optimiz. Sci. 12 ( 1 ): 159 – 163 .[Taylor &; Francis Online] , [Google Scholar]) a ratio-cum-product type exponential estimator has been suggested and its bias and mean squared error have been derived under large sample approximation. Suggested estimator has been compared with usual unbiased estimator of population mean in stratified random sampling, combined ratio estimator, combined product estimator, ratio and product type exponential estimator of Singh et al. (2008 Singh , R. , Kumar , M. , Singh , R. D. , Chaudhary , M. K. ( 2008 ). Exponential ratio type estimators in stratified random sampling. Presented in International Symposium on Optimisation and Statistics (I.S.O.S) at A.M.U., Aligarh, India, during 29–31 Dec . [Google Scholar]). Conditions under which suggested estimator is more efficient than other considered estimators have been obtained. A numerical illustration is given in support of the theoretical findings.     

A Simulation Study of Some Ridge Regression Estimators under Different Distributional Assumptions

Based on the work of Khalaf and Shukur (2005 Khalaf , G. , Shukur , G. ( 2005 ). Choosing ridge parameters for regression problems . Communications in Statistics – Theory and Methods 34 : 1177 – 1182 .[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]), Alkhamisi et al. (2006 Alkhamisi , M. , Khalaf , G. , Shukur , G. ( 2006 ). Some modifications for choosing ridge parameters . Communications in Statistics – Theory and Methods 35 : 2005 – 2020 .[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]), and Muniz et al. (2010 Muniz , G. , Kibria , B. M. G. , Shukur , G. ( 2010 ). On developing ridge regression parameters: a graphical Investigation. Submitted for Publication . [Google Scholar]), this article considers several estimators for estimating the ridge parameter k. This article differs from aforementioned articles in three ways: (1) Data are generated from Normal, Student's t, and F distributions with appropriate degrees of freedom; (2) The number of regressors considered are from 4–12 instead of 2–4, which are the usual practice; (3) Both mean square error (MSE) and prediction sum of square (PRESS) are considered as the performance criterion. A simulation study has been conducted to compare the performance of the estimators. Based on the simulation study we found that, increasing the correlation between the independent variables has negative effect on the MSE and PRESS. However, increasing the number of regressors has positive effect on MSE and PRESS. When the sample size increases the MSE decreases even when the correlation between the independent variables is large. It is interesting to note that the dominance pictures of the estimators are remained the same under both the MSE and PRESS criterion. However, the performance of the estimators depends on the choice of the assumption of the error distribution of the regression model.     

A Note on Estimation of Parameters for Branching Processes with Immigration

It is proved that under certain conditions the conditional least-squares estimator of the offspring mean for a sequence of nearly critical Ji?ina processes with immigration is consistent but not asymptotically normal and the conditional least-squares estimator of the immigration mean is not consistent. These results differ from the existing results in the case where the initial values are zero (see Ispány et al., 2005 Ispány , M. , Pap , G. , Zuijlen , M. V. ( 2005 ). Fluctuation limit of branching processes with immigration and estimation of the means . Adv. Appl. Probab. 37 : 523 – 538 . [Google Scholar]).     

Bayes minimax ridge regression estimators

The problem of estimating of the vector β of the linear regression model y = Aβ + ? with ? ～ N_p(0, σ²I_p) under quadratic loss function is considered when common variance σ² is unknown. We first find a class of minimax estimators for this problem which extends a class given by Maruyama and Strawderman (2005 Maruyama, Y., and W. E. Strawderman. 2005. A new class of generalized Bayes minimax ridge regression estimators. Annals of Statistics 33:1753–70.[Crossref], [Web of Science ®] , [Google Scholar]) and using these estimators, we obtain a large class of (proper and generalized) Bayes minimax estimators and show that the result of Maruyama and Strawderman (2005 Maruyama, Y., and W. E. Strawderman. 2005. A new class of generalized Bayes minimax ridge regression estimators. Annals of Statistics 33:1753–70.[Crossref], [Web of Science ®] , [Google Scholar]) is a special case of our result. We also show that under certain conditions, these generalized Bayes minimax estimators have greater numerical stability (i.e., smaller condition number) than the least-squares estimator.     

Efficient Ratio and Product Estimators in Stratified Random Sampling

This paper suggests an efficient class of ratio and product estimators for estimating the population mean in stratified random sampling using auxiliary information. It is interesting to mention that, in addition to many, Koyuncu and Kadilar (2009 Koyuncu , N. , Kadilar , C. ( 2009 ). Ratio and product estimators in stratified random sampling . J. Statist. Plann. Infer. 139 : 2552 – 2558 .[Crossref], [Web of Science ®] , [Google Scholar]), Kadilar and Cingi (2003 Kadilar , C. , Cingi , H. ( 2003 ). Ratio estimator in stratified sampling . Biometr. J. 45 : 218 – 225 .[Crossref], [Web of Science ®] , [Google Scholar], 2005 Kadilar , C. , Cingi , H. ( 2005 ). A new estimator in stratified random sampling . Commun. Statist. Theor. Meth. 34 : 597 – 602 .[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]), and Singh and Vishwakarma (2007 Singh , H. P. , Vishwakarma , G. K. ( 2007 ). Modified exponential ratio and product estimators for finite population mean in double sampling . Austr. J. Statist. 36 ( 3 ): 217 – 225 . [Google Scholar]) estimators are identified as members of the proposed class of estimators. The expressions of bias and mean square error (MSE) of the proposed estimators are derived under large sample approximation in general form. Asymptotically optimum estimator (AOE) in the class is identified alongwith its MSE formula. It has been shown that the proposed class of estimators is more efficient than combined regression estimator and Koyuncu and Kadilar (2009 Koyuncu , N. , Kadilar , C. ( 2009 ). Ratio and product estimators in stratified random sampling . J. Statist. Plann. Infer. 139 : 2552 – 2558 .[Crossref], [Web of Science ®] , [Google Scholar]) estimator. Moreover, theoretical findings are supported through a numerical example.     

An Improved Class of Estimators in Two-Phase Sampling Using Two Auxiliary Variables

This article suggests an improved class of estimators under the general framework of two-phase sampling scheme in presence of two auxiliary variables. This class includes a large number of estimators (Chand, 1975 Chand , L. ( 1975 ). Some Ratio-Type Estimator Based on Two or More Auxiliary Variables. Unpublished Ph.D. dissertation, Iowa State University, Iowa . [Google Scholar]; Kiregyera, 1980 Kiregyera , B. ( 1980 ). A chain ratio-type estimator in finite population double sampling using two auxiliary variables . Metrika 27 : 217 – 223 .[Crossref] , [Google Scholar], 3; Mukharjee et al., 1987 Mukharjee , R. , Rao , T. J. , Vijayan , K. ( 1987 ). Regression-type estimators using multiple auxiliary information . Aust. J. Statist. 29 : 244 – 254 . [Google Scholar]) and also the class of estimators suggested by Sahoo et al. (1993 Sahoo , J. , Sahoo , L. N. , Mohanty , S. ( 1993 ). A regression approach to estimation in two phase sampling using two auxiliary variables . Curr. Sci. 65 ( 1 ): 73 – 75 . [Google Scholar]).