Consistency of maximum likelihood estimators for the regime-switching GARCH model

The regime-switching GARCH (generalized autoregressive conditionally heteroscedastic) model incorporates the idea of Markov switching into the more restrictive GARCH model, which significantly extends the GARCH model. However, the statistical inference for such an extended model is rather difficult because observations at any time point then depend on the whole regime path and the likelihood becomes intractable quickly as the length of observations increases. In this paper, by transforming it into an infinite order ARCH model, we obtain the possibility of writing a likelihood which can be handled directly and the consistency of the maximum likelihood estimators is proved. Simulation studies to illustrate the consistency and asymptotic normality of the estimators (for both Gaussian and non-Gaussian innovations) and a model specification problem are presented.     

Three strings of inequalities among six Bayes estimators

We discover three interesting strings of inequalities among six Bayes estimators, where for the parameter space (0, 1), (0, ∞), and ( ? ∞, ∞), each case has a string of inequalities. The three strings of inequalities only depend on the loss functions, and the inequalities are independent of the chosen models and the used priors provided the Bayes estimators exist. Therefore, they exist in a general setting which makes them quite interesting. Finally, the numerical simulations exemplify the two strings of inequalities defined on (0, 1) and (0, ∞), and that there does not exist a string of inequalities among the six smallest posterior expected losses.     

Bayes Factor Consistency for One-way Random Effects Model

In this article, we consider Bayesian hypothesis testing for the balanced one-way random effects model. A special choice of the prior formulation for the ratio of variance components is shown to yield an explicit closed-form Bayes factor without integral representation. Furthermore, we study the consistency issue of the resulting Bayes factor under three asymptotic scenarios: either the number of units goes to infinity, the number of observations per unit goes to infinity, or both go to infinity. Finally, the behavior of the proposed approach is illustrated by simulation studies.     

Bayes estimators of the average failure rates

In the present paper we have proposed a Bayesian approach for making inferences from accelerated life tests which do not require distributional assumptions     

Alternative Bayes factors for model selection

Several alternative Bayes factors have been recently proposed in order to solve the problem of the extreme sensitivity of the Bayes factor to the priors of models under comparison. Specifically, the impossibility of using the Bayes factor with standard noninformative priors for model comparison has led to the introduction of new automatic criteria, such as the posterior Bayes factor (Aitkin 1991), the intrinsic Bayes factors (Berger and Pericchi 1996b) and the fractional Bayes factor (O'Hagan 1995). We derive some interesting properties of the fractional Bayes factor that provide justifications for its use additional to the ones given by O'Hagan. We further argue that the use of the fractional Bayes factor, originally introduced to cope with improper priors, is also useful in a robust analysis. Finally, using usual classes of priors, we compare several alternative Bayes factors for the problem of testing the point null hypothesis in the univariate normal model.     

Consistency of Bayesian linear model selection with a growing number of parameters

Linear models with a growing number of parameters have been widely used in modern statistics. One important problem about this kind of model is the variable selection issue. Bayesian approaches, which provide a stochastic search of informative variables, have gained popularity. In this paper, we will study the asymptotic properties related to Bayesian model selection when the model dimension p is growing with the sample size n. We consider p≤n and provide sufficient conditions under which: (1) with large probability, the posterior probability of the true model (from which samples are drawn) uniformly dominates the posterior probability of any incorrect models; and (2) the posterior probability of the true model converges to one in probability. Both (1) and (2) guarantee that the true model will be selected under a Bayesian framework. We also demonstrate several situations when (1) holds but (2) fails, which illustrates the difference between these two properties. Finally, we generalize our results to include g-priors, and provide simulation examples to illustrate the main results.     

Bayes estimators in the presence of a guess value

The paper deals with the problem of parameter estimation in the presence of a guess value and attempts to justify the use of Bayes estimators as an alternative to ordinary shrinkage estimators. Finally, certain Bayes estimators of exponential parameters are obtained under type II censoring, and these are compared with the corresponding MLEs and ordinary shrinkage estimators using a Monte Carlo study.     

A hierarchical Bayes analysis for one-shot device testing experiment under the assumption of exponentiality

The article considers a two-stage hierarchical Bayes technique to analyze a dataset coming from a “one-shot” device testing experiment. The development is based on the assumption of exponential model for the lifetimes with failure rate regressed according to the Cox proportional hazards model. The Bayes implementation is done through a Gibbs–Metropolis hybridization scheme that easily entertains the missing data cases as well. Lastly, numerical illustration is provided based on a real data example on electro-explosive devices. The results show that the Bayesian method performs considerably well for such type of experiments.     

Proper Bayes minimax estimators of the normal mean matrix with common unknown variances

This paper addresses the problem of estimating a matrix of the normal means, where the variances are unknown but common. The approach to this problem is provided by a hierarchical Bayes modeling for which the first stage prior for the means is matrix-variate normal distribution with mean zero matrix and a covariance structure and the second stage prior for the covariance is similar to Jeffreys’ rule. The resulting hierarchical Bayes estimators relative to the quadratic loss function belong to a class of matricial shrinkage estimators. Certain conditions are obtained for admissibility and minimaxity of the hierarchical Bayes estimators.     

Consistency of non parametric estimators of the area under the ROC curve

ABSTRACT

The area under the receiver operating characteristic (ROC) curve is a popular summary index that measures the accuracy of a continuous-scale diagnostic test to measure its accuracy. Under certain conditions on estimators of distribution functions, we prove a theorem on strong consistency of the non parametric “plugin” estimators of the area under the ROC curve. Based on this theorem, we construct some new “plugin” consistent estimators. The performance of the non parametric estimators considered is illustrated numerically and the estimators are compared in terms of bias, variance, and mean square error.     

Bootstrapping estimators for the seemingly unrelated regressions model

In this paper we consider the possibility of using the bootstrap to estimate the finite sample variability of feasible generalized least squares and improved estimators applied to the seemingly unrelated regressions model. The improved estimators we employ include members of the Stein-rule family and a hierarchical Bayes estimator proposed by Blattberg and George (1991). Simulation experiments are carried out using several SUR examples as well as a very large example based on the price-promotion model, and data, from marketing research.     

Probability model choice in single samples from exponential families using Poisson log-linear modelling,and model comparison using Bayes and posterior Bayes factors

This paper describes a method due to Lindsey (1974a) for fitting different exponential family distributions for a single population to the same data, using Poisson log-linear modelling of the density or mass function. The method is extended to Efron's (1986) double exponential family, giving exact ML estimation of the two parameters not easily achievable directly. The problem of comparing the fit of the non-nested models is addressed by both Bayes and posterior Bayes factors (Aitkin, 1991). The latter allow direct comparisons of deviances from the fitted distributions.     

Bayes and Empirical Bayes Estimation of the Parameter n in a Binomial Distribution

The problem of estimating the total number of trials n in a binomial distribution is reconsidered in this article for both cases of known and unknown probability of success p from the Bayesian viewpoint. Bayes and empirical Bayes point estimates for n are proposed under the assumption of a left-truncated prior distribution for n and a beta prior distribution for p. Simulation studies are provided in this article in order to compare the proposed estimate with the most familiar n estimates.     

Consistency and robustness of tests and estimators based on depth

In this paper it is shown that data depth does not only provide consistent and robust estimators but also consistent and robust tests. Thereby, consistency of a test means that the Type I (α$\alpha$) error and the Type II (β$\beta$) error converge to zero with growing sample size in the interior of the nullhypothesis and the alternative, respectively. Robustness is measured by the breakdown point which depends here on a so-called concentration parameter. The consistency and robustness properties are shown for cases where the parameter of maximum depth is a biased estimator and has to be corrected. This bias is a disadvantage for estimation but an advantage for testing. It causes that the corresponding simplicial depth is not a degenerated U-statistic so that tests can be derived easily. However, the straightforward tests have a very poor power although they are asymptotic α-level$\alpha \mathrm{-}\mathrm{level}$ tests. To improve the power, a new method is presented to modify these tests so that even consistency of the modified tests is achieved. Examples of two-dimensional copulas and the Weibull distribution show the applicability of the new method.     

Bayes and empirical bayes estimation of the probability that z > x + y

Let X, Y and Z be independent random variables with common unknown distribution F. Using the Dirichlet process prior for F and squared erro loss function, the Bayes and empirical Bayes estimators of the parameters λ(F). the probability that Z > X + Y, are derived. The limiting Bayes estimator of λ(F) under some conditions on the parameter of the process is shown to be asymptotically normal. The aysmptotic optimality of the empirical Bayes estimator of λ(F) is established. When X, Y and Z have support on the positive real line, these results are derived for randomly right censored data. This problem relates to testing whether than used discussed by Hollander and Proshcan (1972) and Chen, Hollander and Langberg (1983).     

Consistency of semiparametric maximum likelihood estimators for two‐phase sampling

Semiparametric maximum likelihood estimators have recently been proposed for a class of two‐phase, outcome‐dependent sampling models. All of them were “restricted” maximum likelihood estimators, in the sense that the maximization is carried out only over distributions concentrated on the observed values of the covariate vectors. In this paper, the authors give conditions for consistency of these restricted maximum likelihood estimators. They also consider the corresponding unrestricted maximization problems, in which the “absolute” maximum likelihood estimators may then have support on additional points in the covariate space. Their main consistency result also covers these unrestricted maximum likelihood estimators, when they exist for all sample sizes.     

An application of a minimax Bayes rule and shrinkage estimators to the portofolio selection problem under the Bayesian approach

This paper shows that a minimax Bayes rule and shrinkage estimators can be effectively applied to portfolio selection under the Bayesian approach. Specifically, it is shown that the portfolio selection problem can result in a statistical decision problem in some situations. Following that, we present a method for solving a problem involved in portfolio selection under the Bayesian approach.