Objective Bayesian Analysis for Linear Degradation Models

We propose an objective Bayesian approach to analyze degradation models. For the linear degradation models, two reference priors are derived, and based on this we show the posterior distributions are proper. Since the lifetime of the product is of interest in practice, a transformation is introduced to obtain the reference priors of the medium lifetime. In the posterior analysis, we explore two sampling procedures: Monte Carlo (MC) procedure and Monte Carlo Markov Chain (MCMC) procedure. A real data from Takeda and Suzuki (1983 Takeda , E. , Suzuki , N. ( 1983 ). An empirical model for device degradation due to hot-carrier injection . IEEE Electron Dev. Lett. 4 : 111 – 113 .[Crossref], [Web of Science ®] , [Google Scholar]) is analyzed, and we find the results obtained by both procedures are close to the given literature.     

Fiducial Inferences for the Truncated Exponential Distribution

Lindqvist and Taraldsen (2005 Lindqvist , B. H. , Taraldsen , G. ( 2005 ). Monte Carlo conditioning on a sufficient statistic . Biometrika 92 : 451 – 464 .[Crossref], [Web of Science ®] , [Google Scholar]) introduced an interesting parametric family of distributions in the unit interval. In this note, inference procedures are given, both from the classical and the Bayesian view point. It is shown numerically through various examples that the posterior distribution for the parameter and the induced fiducial distribution are almost equivalent. The parametric family under study is a regular member of the Natural Exponential Family and so use of this fact permits induction of a unique fiducial in terms of the minimal sufficient statistic.     

Bayesian Inference for the Precision Matrix for Scale Mixtures of Normal Distributions

Baysian inference is considered for the precision matrix of the multivariate regression model with distribution of the random responses belonging to the multivariate scale mixtures of normal distributions. The posterior distribution and some identities involving expectations taken with respect to this posterior distribution are derived when the prior distribution of the parameters is from the conjugate family. The results are specialized to the case where the random responses have a matrix-t distribution and thus generalizing the results of Zellner (1976 Zellner , A. ( 1976 ). Bayesian and non-Bayesian analysis of the regression model with multivariate Student-t error terms . J. Amer. Statist. Assoc. 71 : 400 – 405 .[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]) and Muirhead (1986 Muirhead , R. J. ( 1986 ). A note on some Wishart expectations . Metrika 33 : 247 – 251 .[Crossref] , [Google Scholar]).     

Expected Posterior Priors in Selecting the Largest Mean of the Exponential Distributions

In reliability theory or survival analysis, selecting the largest mean among many exponential distributions is an important issue. Such a problem can also be viewed as a model selection problem via the Bayesian approach. It is well known that Bayes factors under proper priors have been very successful in Bayesian model selection or testing problems. However, Bayes factors are typically invalid with respect to improper noninformative priors. Objective Bayesian criteria are thus desired. In this work, we consider to use the expected posterior priors originally proposed by Pérez and Berger (2002 Pérez , J. M. , Berger , J. ( 2002 ). Expected posterior prior distributions for model selection . Biometrika 89 : 491 – 512 .[Crossref], [Web of Science ®] , [Google Scholar]) to select the largest exponential mean. Specific expected posterior priors are derived in recursive formulas. Some simulation results are also given to illustrate the method.     

Online Control Charts for Process Averages Based on Repeated Median Filters

Two types of estimates of process level, namely repeated median estimates (Siegel, 1982 Siegel , A. F. ( 1982 ). Robust regression using repeated medians . Biometrika 69 : 242 – 244 .[Crossref], [Web of Science ®] , [Google Scholar]) and full online estimates (Gather et al., 2006 Gather , U. , Schettlinger , K. , Fried , R. ( 2006 ). Online signal extraction by robust linear regression . Computational Statistics 21 : 33 – 51 .[Crossref], [Web of Science ®] , [Google Scholar]) based on repeated median filters, are used to develop control charts. The distributional properties of the estimates are studied using simulation and these are found to closely follow normal distribution. The repeated median being robust against outliers with asymptotically 50% breakdown value and having small standard deviation is found to be useful as a basis for monitoring process averages. The control charts using repeated median estimates have been recommended for general use.     

On Rates of Convergence for Posterior Distributions Under Misspecification

We extend the approach of Walker (2003 Walker , S. ( 2003 ). On sufficient conditions for Bayesian consistency . Biometrika 90 ( 2 ): 482 – 488 .[Crossref], [Web of Science ®] , [Google Scholar]); (2004 Walker , S. ( 2004 ). New approaches to Bayesian consistency . Ann. Statist. 32 ( 5 ): 2028 – 2043 .[Crossref], [Web of Science ®] , [Google Scholar]) to the case of misspecified models. A sufficient condition for establishing rates of convergence is given based on a key identity involving martingales, which does not require construction of tests. We also show roughly that the result obtained by using tests can also be obtained by our approach, which demonstrates the potential wider applicability of this method.     

Permutation Matrix with Application to Optimal Invariant Quadratic Prediction in Finite Populations

In this article, we primarily aim to apply the permutation matrix techniques to the problem of the optimal invariant quadratic prediction in a finite population. An alternative to the work of Liu and Rong (2007 Liu , X. , Rong , J. ( 2007 ). Quadratic prediction problems in finite populations . Statist. Probab. Lett. 77 : 483 – 489 .[Crossref], [Web of Science ®] , [Google Scholar]) is offered. In addition, we derive the OIQP for the population variance and show that it has less PMSE than the ordinary optimal unbiased predictor.     

The Exact General Formulas for the Moments of a Ridge Regression Estimator when the Regression Error Terms Follow a Multivariate t Distribution

Huang (1999 Huang , J. C. ( 1999 ). Improving the estimation precision for a selected parameter in multiple regression analysis: an algebraic approach . Econ. Lett. 62 : 261 – 264 .[Crossref], [Web of Science ®] , [Google Scholar]) proposed a feasible ridge regression (FRR) estimator to estimate a specific regression coefficient. Assuming that the error terms follow a normal distribution, Huang (1999 Huang , J. C. ( 1999 ). Improving the estimation precision for a selected parameter in multiple regression analysis: an algebraic approach . Econ. Lett. 62 : 261 – 264 .[Crossref], [Web of Science ®] , [Google Scholar]) examined the small sample properties of the FRR estimator. In this article, assuming that the error terms follow a multivariate t distribution, we derive an exact general formula for the moments of the FRR estimator to estimate a specific regression coefficient. Using the exact general formula, we obtain exact formulas for the bias, mean squared error (MSE), skewness, and kurtosis of the FRR estimator. Since these formulas are very complex, we compare the bias, MSE, skewness, and kurtosis of the FRR estimator with those of ordinary least square (OLS) estimator by numerical evaluations. Our numerical results show that the range of MSE dominance of the FRR estimator over the OLS estimator is widen under a fat tail distributional assumption.     

Correlation Structure and Model Selection for Negative Binomial Distribution in GEE

A new model selection criterion, termed as the “quasi-likelihood under the independence model criterion” (QIC), was proposed by Pan (2001 Pan , W. ( 2001 ). Akaike's information criterion in generalized estimating equations . Biometrics 57 : 120 – 125 .[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]) for GEE models. Cui (2007 Cui , J. ( 2007 ). QIC program and model selection in GEE analyses . Stata Journal 7 : 209 – 220 .[Web of Science ®] , [Google Scholar]) developed a general computing program to implement the QIC method for a range of statistical distributions. However, only a special case of the negative binomial distribution was considered in Cui (2007 Cui , J. ( 2007 ). QIC program and model selection in GEE analyses . Stata Journal 7 : 209 – 220 .[Web of Science ®] , [Google Scholar]), where the dispersion parameter equals to unity. This article introduces a new computing program that can be applied for the general negative binomial model, where the dispersion parameter can be any fixed value. An example is also given in this article.     

The Research on Two Kinds of Restricted Biased Estimators Based on Mean Squared Error Matrix

Sakall?oglu et al. (2001 Sakall?oglu , Kaç?ranlar , Akdeniz ( 2001 ). Mean squared error comparisons of some biased estimators . Commun. Statist. Theor. Meth. 30 : 347 – 361 .[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]) dealt with the comparisons among the ridge estimator, Liu estimator, and iteration estimator. Akdeniz and Erol (2003 Akdeniz , F. , Erol , H. ( 2003 ). Mean squared error matrix comparisons of some biased estimators in linear regression . Commun. Statist. Theor. Meth. 32 : 2389 – 2413 .[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]) have compared the (almost unbiased) generalized ridge regression estimator with the (almost unbiased) generalized Liu estimator in the matrix mean squared error sense. In this article, we study the ridge estimator and Liu estimator with respect to linear equality restriction, and establish some sufficient conditions for the superiority of the restricted ridge estimator over the restricted Liu estimator and the superiority of the restricted Liu estimator over the restricted ridge estimator under mean squared error matrix, respectively. Furthermore, we give a numerical example.     

Bayesian Robustness of the Positive False Discovery Rate

The positive false discovery rate was introduced by Storey (2003 Storey , J. D. (2003). The positive false discovery rate: a Bayesian interpretation and the q-value. Ann. Statist. 31:2013–2035.[Crossref], [Web of Science ®] , [Google Scholar]) as an alternative to the family wise error rate for the case in which we are simultaneously testing a large amount of hypotheses. The positive false discovery rate has a very nice Bayesian interpretation (as it was shown by Storey, 2003 Storey , J. D. (2003). The positive false discovery rate: a Bayesian interpretation and the q-value. Ann. Statist. 31:2013–2035.[Crossref], [Web of Science ®] , [Google Scholar]) and its robustness is analyzed. The emphasis is on the ε-contamination class (one of the most used classes of priors for Bayesian robustness) and it is shown that robustness is not obtained when the basic prior concentrates the probability on the null hypothesis.     

Parametric Nonlinear Regression with Endogenous Switching

Based on the insightful work of Olsen (1980 Olsen , R. J. ( 1980 ). A least squares correction for selectivity bias . Econometrica 48 : 1815 – 1820 .[Crossref], [Web of Science ®] , [Google Scholar]) for the linear context, a generic and unifying framework is developed that affords a simple extension of the classical method of Heckman (1974 Heckman , J. ( 1974 ). Shadow prices, market wages, and labor supply . Econometrica 42 : 679 – 694 .[Crossref], [Web of Science ®] , [Google Scholar], 1976 Heckman , J. ( 1976 ). The common structure of statistical models of truncation sample selection and limited dependent variables and a simple estimator for such models . Annals of Economic and Social Measurement 5 : 475 – 492 . [Google Scholar], 1978 Heckman , J. ( 1978 ). Dummy endogenous variables in a simultaneous equation system . Econometrica 46 : 931 – 959 .[Crossref], [Web of Science ®] , [Google Scholar], 1979 Heckman , J. ( 1979 ). Sample selection bias as a specification error . Econometrica 47 : 153 – 161 .[Crossref], [Web of Science ®] , [Google Scholar]) to a broad class of nonlinear regression models involving endogenous switching and its two most common incarnations, endogenous sample selection and endogenous treatment effects. The approach should be appealing to applied researchers for three reasons. First, econometric applications involving endogenous switching abound. Secondly, the approach requires neither linearity of the regression function nor full parametric specification of the model. It can, in fact, be applied under the minimal parametric assumptions—i.e., specification of only the conditional means of the outcome and switching variables. Finally, it is amenable to relatively straightforward estimation methods. Examples of applications of the method are discussed.     

From Ordinary to Shrinkage Square-Root Estimators

Consider a skewed population. Suppose an intelligent guess could be made about an interval that contains the population mean. There may exist biased estimators with smaller mean squared error than the arithmetic mean within such an interval. This article indicates when it is advisable to shrink the arithmetic mean towards a guessed interval using root estimators. The goal is to obtain an estimator that is better near the average of natural origins. An estimator proposed. This estimator contains the Thompson (1968 Thompson , J. R. ( 1968 ). Accuracy borrowing in the estimation of the mean by shrinkage towards an interval . J. Amer. Statist. Assoc. 63 : 953 – 963 . [CSA] [CROSSREF] [Taylor & Francis Online], [Web of Science ®] , [Google Scholar]) ordinary shrinkage estimator, the Jenkins et al. (1973 Jenkins , O. C. , Ringer , L. J. , Hartley , H. O. ( 1973 ). Root estimators . J Amer. Statist. Assoc. 68 : 414 – 419 . [CSA] [CROSSREF] [Taylor & Francis Online], [Web of Science ®] , [Google Scholar]) square-root estimator, and the arithmetic sample mean as special cases. The bias and the mean squared error of the proposed more general estimator is compared with the three special cases. Shrinkage coefficients that yield minimum mean squared error estimators are obtained. The proposed estimator is considerably more efficient than the three special cases. This remains true for highly skewed populations. The merits of the proposed shrinkage square-root estimator are supported by the results of numerical and simulation studies.     

Least Median of Squares Solution of Multiple Linear Regression Models Through the Origin

Barreto and Maharry (2006 Barreto , H. , Maharry , D. ( 2006 ). Least median of squares and regression through the origin . Comput. Statist. Data Anal. 50 : 1391 – 1397 .[Crossref], [Web of Science ®] , [Google Scholar]) showed that PROGRESS algorithm fails to find a correct minimum “Least Median of Squares/LMS” estimate for bivariate regression models which have no intercept. Kayhan and Gunay (2008 Kayhan , Y. , Gunay , S. ( 2008 ). A new approach to least median of squares and regression through the origin . Commun. Statist. Theor. Meth. 37 ( 5 ): 773 – 781 .[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]) presented a different approach for the regression models through the origin which includes at most two unknown parameters. However, LMS estimate for multiple linear regression models still remains an open issue. The aim of this study is to show that finding true LMS estimate for zero intercept multiple linear regression models can be treated as a convex optimization problem and to provide a more general algorithm for any dimensional linear regression models.     

Improved strategy to collect sensitive data by using geometric distribution as a randomization device

Abstract

In this article, we improvise Singh and Grewal (2013 Singh, S., and I. S. Grewal. 2013. Geometric distribution as a randomization device implemented in the Kuk’s model. International Journal of Contemporary Mathematical Sciences 8:243–8.[Crossref] , [Google Scholar]) and Hussain et al. (2016 Hussain, Z., J. Shabbir, Z. Pervez, S. F. Shah, and M. Khan. 2016. Generalized geometric distribution of order k: A flexible choice to randomize the response. Communications in Statistics: Simulation and Computation 46:4708–21.[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]) techniques by introducing a new two-stage randomization response process. Using the proposed new technique, we achieve better efficiency and increasing protection of privacy of respondents than the Kuk (1990 Kuk, A. Y. C. 1990. Asking sensitive questions indirectly. Biometrika 77 (2):436–8.[Crossref], [Web of Science ®] , [Google Scholar]), Singh and Grewal (2013 Singh, S., and I. S. Grewal. 2013. Geometric distribution as a randomization device implemented in the Kuk’s model. International Journal of Contemporary Mathematical Sciences 8:243–8.[Crossref] , [Google Scholar]) and Hussain et al. (2016 Hussain, Z., J. Shabbir, Z. Pervez, S. F. Shah, and M. Khan. 2016. Generalized geometric distribution of order k: A flexible choice to randomize the response. Communications in Statistics: Simulation and Computation 46:4708–21.[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]) models. The relative efficiency and protection of the respondents of the proposed two-stage randomization device have been investigated through simulation study, and the situations are reported where the proposed estimator performs better than its competitors. The SAS code used to investigate the performance of the proposed strategy are also provided.     

Bayesian Capture-Recapture Analysis: An Application in Modeling Semelparity of a Neotropical Didelphid Marsupial

We develop a series of Bayesian statistical models for estimating survival of a neotropic didelphid marsupial, the Brazilian gracile mouse opossum (Gracilinanus microtarsus). These models are based on the Cormack–Jolly–Seber model (Cormack, 1964 Cormack , R. M. ( 1964 ). Estimates of survival from the sighting of marked animals . Biometrika 51 : 429 – 438 .[Crossref], [Web of Science ®] , [Google Scholar]; Jolly 1965 Jolly , G. M. ( 1965 ). Explicit estimates from capture-recapture data with both death and immigration stochastic model . Biometrika 52 : 225 – 247 .[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]; Seber 1965 Seber , G. A. F. ( 1965 ). A note on the multiple recapture census . Biometrika 52 : 249 – 259 .[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]) with both survival and recapture rates expressed as a function of covariates using a logit link. The proposed models allow taking into account heterogeneity in capture probability caused by the existence of different groups of individuals in the population. The models were applied to two cohorts (Cohort, 2000, 2001) with the first one including 14 and the second one 15 sampling occasions. The best models for each of the cohorts indicate that G. microtarsus is best described as partially semelparous, a condition in which mortality after the first mating is high but graded over time, with a fraction of males surviving for a second breeding season (Boonstra, 2005 Boonstra , R. ( 2005 ). Equipped for life: the adaptive role of the stress axis in male mammals . Journal of Mammalogy 86 : 236 – 247 .[Crossref], [Web of Science ®] , [Google Scholar]).     

Relations for Moments of Progressively Type-II Censored Order Statistics from Log-Logistic Distribution with Applications to Inference

In this article, we establish several recurrence relations for the single and product moments of progressively Type-II right censored order statistics from a log-logistic distribution. The use of these relations in a systematic recursive manner would enable the computation of all the means, variances and covariances of progressively Type-II right censored order statistics from the log-logistic distribution for all sample sizes n, effective sample sizes m, and all progressive censoring schemes (R ₁,…, R _m ). The results established here generalize the corresponding results for the usual order statistics due to Balakrishnan and Malik (1987 Balakrishnan , N. , Malik , H. J. ( 1987 ). Moments of order statistics from truncated log-logistic distribution . J. Statist. Plann. Infer. 17 : 251 – 267 .[Crossref], [Web of Science ®] , [Google Scholar]) and Balakrishnan et al. (1987 Balakrishnan , N. , Malik , H. J. , Puthenpura , S. ( 1987 ). Best linear unbiased estimation of location and scale parameters of the log-logistic distribution . Commun. Statist. Theor. Meth. 16 : 3477 – 3495 .[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]). The moments so determined are then utilized to derive best linear unbiased estimators for the scale- and location-scale log-logistic distributions. A comparison of these estimates with the maximum likelihood estimates is made through Monte Carlo simulation. The best linear unbiased predictors of progressively censored failure times is then discussed briefly. Finally, a numerical example is presented to illustrate all the methods of inference developed here.     

A Note on Testing Homogeneity of Several Exponential Location Parameters

In this article, the problems of testing homogeneity of several exponential location parameters against simple and tree ordered alternatives are considered separately. Test procedures for both the alternatives are proposed using restricted maximum likelihood estimators (RMLE) of exponential location parameters under the respective orderings. Critical constants for the implementation of the proposed procedures are tabulated. Power comparison of the proposed test procedure under the simple ordered alternative with the procedure of Chen (1982 Chen , H. J. ( 1982 ). A new range statistic for comparisons of several exponential location parameters . Biometrika 69 ( 1 ): 257 – 260 .[Crossref], [Web of Science ®] , [Google Scholar]) and of Dhawan and Gill (1999 Dhawan , A. K. , Gill , A. N. ( 1999 ). A one-sided test for testing homogeneity of scale parameters against ordered alternative . Communication in Statistics—Theory and Methods 28 ( 10 ): 2417 – 2439 .[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]) is carried out using Monte-Carlo simulation.     

A Bayes Factor for Replications of ANOVA Results

ABSTRACT

With an increasing number of replication studies performed in psychological science, the question of how to evaluate the outcome of a replication attempt deserves careful consideration. Bayesian approaches allow to incorporate uncertainty and prior information into the analysis of the replication attempt by their design. The Replication Bayes factor, introduced by Verhagen and Wagenmakers (2014 Verhagen, J., and Wagenmakers, E.-J. (2014), “Bayesian Tests to Quantify the Result of a Replication Attempt,” Journal of Experimental Psychology: General, 143, 1457–1475. DOI: 10.1037/a0036731.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]), provides quantitative, relative evidence in favor or against a successful replication. In previous work by Verhagen and Wagenmakers (2014 Verhagen, J., and Wagenmakers, E.-J. (2014), “Bayesian Tests to Quantify the Result of a Replication Attempt,” Journal of Experimental Psychology: General, 143, 1457–1475. DOI: 10.1037/a0036731.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]), it was limited to the case of t-tests. In this article, the Replication Bayes factor is extended to F-tests in multigroup, fixed-effect ANOVA designs. Simulations and examples are presented to facilitate the understanding and to demonstrate the usefulness of this approach. Finally, the Replication Bayes factor is compared to other Bayesian and frequentist approaches and discussed in the context of replication attempts. R code to calculate Replication Bayes factors and to reproduce the examples in the article is available at https://osf.io/jv39h/.     

On Testing Sample Selection Bias Under the Multicollinearity Problem

ABSTRACT

This paper reviews and extends the literature on the finite sample behavior of tests for sample selection bias. Monte Carlo results show that, when the “multicollinearity problem” identified by Nawata (1993 Nawata , K. ( 1993 ). A note on the estimation of models with sample-selection biases . Economics Letters 42 : 15 – 24 . [CSA] [CROSSREF] [Crossref], [Web of Science ®] , [Google Scholar]) is severe, (i) the t-test based on the Heckman–Greene variance estimator can be unreliable, (ii) the Likelihood Ratio test remains powerful, and (iii) nonnormality can be interpreted as severe sample selection bias by Maximum Likelihood methods, leading to negative Wald statistics. We also confirm previous findings (Leung and Yu, 1996 Leung , S. F. , Yu , S. ( 1996 ). On the choice between sample selection and two-part models . Journal of Econometrics 72 : 197 – 229 . [CSA] [CROSSREF] [Crossref], [Web of Science ®] , [Google Scholar]) that the standard regression-based t-test (Heckman, 1979 Heckman , J. J. ( 1979 ). Sample selection bias as a specification error . Econometrica 47 : 153 – 161 . [CSA] [Crossref], [Web of Science ®] , [Google Scholar]) and the asymptotically efficient Lagrange Multiplier test (Melino, 1982 Melino , A. ( 1982 ). Testing for sample selection bias . Review of Economic Studies 49 : 151 – 153 . [CSA] [Crossref], [Web of Science ®] , [Google Scholar]), are robust to nonnormality but have very little power.