Nonparametric Bayes factors based on empirical likelihood ratios

Bayes methodology provides posterior distribution functions based on parametric likelihoods adjusted for prior distributions. A distribution-free alternative to the parametric likelihood is use of empirical likelihood (EL) techniques, well known in the context of nonparametric testing of statistical hypotheses. Empirical likelihoods have been shown to exhibit many of the properties of conventional parametric likelihoods. In this paper, we propose and examine Bayes factors (BF) methods that are derived via the EL ratio approach. Following Kass and Wasserman (1995), we consider Bayes factors type decision rules in the context of standard statistical testing techniques. We show that the asymptotic properties of the proposed procedure are similar to the classical BF's asymptotic operating characteristics. Although we focus on hypothesis testing, the proposed approach also yields confidence interval estimators of unknown parameters. Monte Carlo simulations were conducted to evaluate the theoretical results as well as to demonstrate the power of the proposed test.     

Extended BIC for linear regression models with diverging number of relevant features and high or ultra-high feature spaces

In many conventional scientific investigations with high or ultra-high dimensional feature spaces, the relevant features, though sparse, are large in number compared with classical statistical problems, and the magnitude of their effects tapers off. It is reasonable to model the number of relevant features as a diverging sequence when sample size increases. In this paper, we investigate the properties of the extended Bayes information criterion (EBIC) (Chen and Chen, 2008) for feature selection in linear regression models with diverging number of relevant features in high or ultra-high dimensional feature spaces. The selection consistency of the EBIC in this situation is established. The application of EBIC to feature selection is considered in a SCAD cum EBIC procedure. Simulation studies are conducted to demonstrate the performance of the SCAD cum EBIC procedure in finite sample cases.     

Estimation of covariance matrices based on hierarchical inverse-Wishart priors

This paper focuses on Bayesian shrinkage methods for covariance matrix estimation. We examine posterior properties and frequentist risks of Bayesian estimators based on new hierarchical inverse-Wishart priors. More precisely, we give the conditions for the existence of the posterior distributions. Advantages in terms of numerical simulations of posteriors are shown. A simulation study illustrates the performance of the estimation procedures under three loss functions for relevant sample sizes and various covariance structures.     

Maximum likelihood estimation of parameter structures for the Wishart distribution using constraints

Maximum likelihood estimation under constraints for estimation in the Wishart class of distributions, is considered. It provides a unified approach to estimation in a variety of problems concerning covariance matrices. Virtually all covariance structures can be translated to constraints on the covariances. This includes covariance matrices with given structure such as linearly patterned covariance matrices, covariance matrices with zeros, independent covariance matrices and structurally dependent covariance matrices. The methodology followed in this paper provides a useful and simple approach to directly obtain the exact maximum likelihood estimates. These maximum likelihood estimates are obtained via an estimation procedure for the exponential class using constraints.     

Nonparametric smooth estimation of the expected inactivity time function

The expected inactivity time (EIT) function (also known as the mean past lifetime function) is a well known reliability function which has application in many disciplines such as survival analysis, actuarial studies and forensic science, to name but a few. In this paper, we use a fixed design local polynomial fitting technique to obtain estimators for the EIT function when the lifetime random variable has an unknown distribution. It will be shown that the proposed estimators are asymptotically unbiased, consistent and also, when standardized, has an asymptotic normal distribution. An optimal bandwidth, which minimizes the AMISE (asymptotic mean integrated squared error) of the estimator, is derived. Numerical examples based on simulated samples from various lifetime distributions common in reliability studies will be presented to evaluate the performances of these estimators. Finally, three real life applications will also be presented to further illustrate the wide applicability of these estimators.     

Model-based confidence bands for survival functions

This paper focuses on a novel method of developing one-sample confidence bands for survival functions from right censored data. The approach is model-based, relying on a parametric model for the conditional expectation of the censoring indicator given the observed minimum, and derives its strength from easy access to a good-fitting model among a plethora of choices available for binary response data. The substantive methodological contribution is in exploiting a semiparametric estimator of the survival function to produce improved simultaneous confidence bands. To obtain critical values for computing the confidence bands, a two-stage bootstrap approach that combines the classical bootstrap with the more recent model-based regeneration of censoring indicators is proposed and a justification of its asymptotic validity is also provided. Several different confidence bands are studied using the proposed approach. Numerical studies, including robustness of the proposed bands to misspecification, are carried out to check efficacy. The method is illustrated using two lung cancer data sets.     

Prediction Techniques for Box–Cox Regression Models

This article reviews several techniques useful for forming point and interval predictions in regression models with Box-Cox transformed variables. The techniques reviewed—plug-in, mean squared error analysis, predictive likelihood, and stochastic simulation—take account of nonnormality and parameter uncertainty in varying degrees. A Monte Carlo study examining their small-sample accuracy indicates that uncertainty about the Box–Cox transformation parameter may be relatively unimportant. For certain parameters, deterministic point predictions are biased, and plug-in prediction intervals are also biased. Stochastic simulation, as usually carried out, leads to badly biased predictions. A modification of the usual approach renders stochastic simulation predictions largely unbiased.     

Semiparametric ARCH Models

This article introduces a semiparametric autoregressive conditional heteroscedasticity (ARCH) model that has conditional first and second moments given by autoregressive moving average and ARCH parametric formulations but a conditional density that is assumed only to be sufficiently smooth to be approximated by a nonparametric density estimator. For several particular conditional densities, the relative efficiency of the quasi-maximum likelihood estimator is compared with maximum likelihood under correct specification. These potential efficiency gains for a fully adaptive procedure are compared in a Monte Carlo experiment with the observed gains from using the proposed semiparametric procedure, and it is found that the estimator captures a substantial proportion of the potential. The estimator is applied to daily stock returns from small firms that are found to exhibit conditional skewness and kurtosis and to the British pound to dollar exchange rate.     

Estimation of Parameters of Mixed Failure Time Distribution Based on an Extended Modified Sampling Scheme

Abstract

The problem of estimation of parameters of a mixture of degenerate (at zero) and exponential distribution is considered by Dixit and Prasad [Dixit, V. U. (Nee: Jayade, V. D.), Prasad, M. S. (1990 Dixit, V. U. and Prasad, M. S. 1990. Estimation of parameters of mixed failure time distribution. Commun.in Statist.-Theory Meth, 19(12): 4667–4678. (Nee: Jayade, V. D.) [Google Scholar]). Estimation of parameters of mixed failure time distribution. Commun.in Statist.-Theory Meth., 19(12):4667–4678]. The sampling scheme proposed in it is extended to k positive observations in Dixit [Dixit, V. U. (1993 Dixit, V. U. 1993. “Statistical Inference for AR (1) Process with Mixed Errors”. Kolhapur, , India: Shivaji University. Unpublished Ph.D. thesis [Google Scholar]). Statistical Inference for AR (1) Process with Mixed Errors. Unpublished Ph.D. thesis, Shivaji University Kolhapur, India] and moment estimator, MLE and UMVUE based on it are obtained and their finite sample and asymptotic properties are studied. These results are presented in this paper. It is interesting to mention that the sampling scheme proposed by Shinde and Shanubhogue [Shinde, R. L., Shanubhogue, A. (2000 Shinde, R. L. and Shanubhogue, A. 2000. Estimation of parameters and the mean life of a mixed failure time distribution. Commun. Statist.-Theory Meth, 29(11): 2621–2642. [Taylor & Francis Online], [Web of Science ®] , [Google Scholar]). Estimation of parameters and the mean life of a mixed failure time distribution. Commun. Statist.-Theory Meth. 29(11):2621–2642] is a particular case of the sampling scheme proposed in Dixit [Dixit, V. U. (1993 Dixit, V. U. 1993. “Statistical Inference for AR (1) Process with Mixed Errors”. Kolhapur, , India: Shivaji University. Unpublished Ph.D. thesis [Google Scholar]). Statistical Inference for AR (1) Process with Mixed Errors. Unpublished Ph.D. thesis, Shivaji University Kolhapur, India] for n = k.     

Parametric Nonlinear Regression with Endogenous Switching

Based on the insightful work of Olsen (1980 Olsen , R. J. ( 1980 ). A least squares correction for selectivity bias . Econometrica 48 : 1815 – 1820 .[Crossref], [Web of Science ®] , [Google Scholar]) for the linear context, a generic and unifying framework is developed that affords a simple extension of the classical method of Heckman (1974 Heckman , J. ( 1974 ). Shadow prices, market wages, and labor supply . Econometrica 42 : 679 – 694 .[Crossref], [Web of Science ®] , [Google Scholar], 1976 Heckman , J. ( 1976 ). The common structure of statistical models of truncation sample selection and limited dependent variables and a simple estimator for such models . Annals of Economic and Social Measurement 5 : 475 – 492 . [Google Scholar], 1978 Heckman , J. ( 1978 ). Dummy endogenous variables in a simultaneous equation system . Econometrica 46 : 931 – 959 .[Crossref], [Web of Science ®] , [Google Scholar], 1979 Heckman , J. ( 1979 ). Sample selection bias as a specification error . Econometrica 47 : 153 – 161 .[Crossref], [Web of Science ®] , [Google Scholar]) to a broad class of nonlinear regression models involving endogenous switching and its two most common incarnations, endogenous sample selection and endogenous treatment effects. The approach should be appealing to applied researchers for three reasons. First, econometric applications involving endogenous switching abound. Secondly, the approach requires neither linearity of the regression function nor full parametric specification of the model. It can, in fact, be applied under the minimal parametric assumptions—i.e., specification of only the conditional means of the outcome and switching variables. Finally, it is amenable to relatively straightforward estimation methods. Examples of applications of the method are discussed.