Properties and Applications of the Generalized Likelihood as a Summary Function for Prediction Problems

The generalized likelihood plays an important role in parametric inference for prediction and empirical Bayesian models. This paper emphasizes the utility of the generalized likelihood as a summarization procedure in general prediction models. Properties of the generalized likelihood when used in this setting, and examples of its use as a data analytic tool are given in a series of numerical examples.     

A Comparison Between Maximum Likelihood and Bayesian Estimation of Stochastic Frontier Production Models

In this paper, the finite sample properties of the maximum likelihood and Bayesian estimators of the half-normal stochastic frontier production function are analyzed and compared through a Monte Carlo study. The results show that the Bayesian estimator should be used in preference to the maximum likelihood owing to the fact that the mean square error performance is substantially better in the Bayesian framework.     

A new approach to choose acceptance cutoff for approximate Bayesian computation

The approximate Bayesian computation (ABC) algorithm is used to estimate parameters from complicated phenomena, where likelihood is intractable. Here, we report the development of an algorithm to choose the tolerance level for ABC. We have illustrated the performance of our proposed method by simulating the estimation of scaled mutation and recombination rates. The result shows that the proposed algorithm performs well.     

A Composite Likelihood Approach to Multivariate Survival Data

This paper is about the statistical analysis of multivariate survival data. We discuss the additive and multiplicative frailty models which have been the most popular models for multivariate survival data. As an alternative to the additive and multiplicative frailty models, we propose basing inference on a composite likelihood function that only requires modelling of the marginal distribution of pairs of failure times. Each marginal distribution of a pair of failure times is here assumed to follow a shared frailty model. The method is illustrated with a real-life example.     

Maximum Likelihood Estimation for Stochastic Differential Equations with Random Effects

Abstract. We consider N independent stochastic processes (X _i (t), t ∈ [0,T _i ]), i=1,…, N, defined by a stochastic differential equation with drift term depending on a random variable φ _i . The distribution of the random effect φ _i depends on unknown parameters which are to be estimated from the continuous observation of the processes X_i. We give the expression of the exact likelihood. When the drift term depends linearly on the random effect φ _i and φ _i has Gaussian distribution, an explicit formula for the likelihood is obtained. We prove that the maximum likelihood estimator is consistent and asymptotically Gaussian, when T _i =T for all i and N tends to infinity. We discuss the case of discrete observations. Estimators are computed on simulated data for several models and show good performances even when the length time interval of observations is not very large.     

On Quasi Likelihood Equations with Non-parametric Weights

To apply the quasi likelihood method one needs both the mean and the variance functions to determine its optimal weights. If the variance function is unknown, then the weights should be acquired from the data. One way to do so is by adaptive estimation, which involves non-parametric estimation of the variance function. Adaptation, however, also brings in noise that hampers its improvement for moderate samples. In this paper we introduce an alternative method based not on the estimation of the variance function, but on the penalized minimization of the asymptotic variance of the estimator. By doing so we are able to retain a restricted optimality under the smoothness condition, however strong that condition may be. This is important because for moderate sample sizes we need to impose a strong smoothness constraint to damp the noise—often stronger than would be adequate for the adaptive method. We will give a rigorous development of the related asymptotic theory, and provide the simulation evidence for the advantage of this method.     

Mixture of Distributions in the Biparametric Exponential Family: A Bayesian Approach

In this article we propose mixture of distributions belonging to the biparametric exponential family, considering joint modeling of the mean and variance (or dispersion) parameters. As special cases we consider mixtures of normal and gamma distributions. A novel Bayesian methodology, using Markov Chain Monte Carlo (MCMC) methods, is proposed to obtain the posterior summaries of interest. We include simulations and real data examples to illustrate de performance of the proposal.     

Bayesian sequential inference for nonlinear multivariate diffusions

In this paper, we adapt recently developed simulation-based sequential algorithms to the problem concerning the Bayesian analysis of discretely observed diffusion processes. The estimation framework involves the introduction of m−1 latent data points between every pair of observations. Sequential MCMC methods are then used to sample the posterior distribution of the latent data and the model parameters on-line. The method is applied to the estimation of parameters in a simple stochastic volatility model (SV) of the U.S. short-term interest rate. We also provide a simulation study to validate our method, using synthetic data generated by the SV model with parameters calibrated to match weekly observations of the U.S. short-term interest rate.     

Bayesian Estimation and Prediction of Stochastic Volatility Models via INLA

In this article, we assess Bayesian estimation and prediction using integrated Laplace approximation (INLA) on a stochastic volatility (SV) model. This was performed through a Monte Carlo study with 1,000 simulated time series. To evaluate the estimation method, two criteria were considered: the bias and square root of the mean square error (smse). The criteria used for prediction are the one step ahead forecast of volatility and the one day Value at Risk (VaR). The main findings are that the INLA approximations are fairly accurate and relatively robust to the choice of prior distribution on the persistence parameter. Additionally, VaR estimates are computed and compared for three financial time series returns indexes.     

A Bayesian Approach to Selecting Covariates for Prediction

We consider the problem of selecting a regression model from a large class of possible models in the case where no true model is believed to exist. In practice few statisticians, or scientists who employ statistical methods, believe that a true model exists, but nonetheless they seek to select a model as a proxy from which they want to predict. Unlike much of the recent work in this area we address this problem explicitly. We develop Bayesian predictive model selection techniques when proper conjugate priors are used and obtain an easily computed expression for the model selection criterion. We also derive expressions for updating the value of the statistic when a predictor is dropped from the model and apply this approach to a large well-known data set.     

Empirical Likelihood for Non-Smooth Criterion Functions

Abstract.  Suppose that X ₁ ,…,  X _n is a sequence of independent random vectors, identically distributed as a d -dimensional random vector X . Let     be a parameter of interest and     be some nuisance parameter. The unknown, true parameters ( μ ₀ , ν ₀ ) are uniquely determined by the system of equations E { g ( X , μ ₀ , ν ₀ )} =   0 , where g  =  ( g ₁ ,…, g _{p + q} ) is a vector of p + q functions. In this paper we develop an empirical likelihood (EL) method to do inference for the parameter μ ₀ . The results in this paper are valid under very mild conditions on the vector of criterion functions g . In particular, we do not require that g ₁ ,…, g _{p + q} are smooth in μ or ν . This offers the advantage that the criterion function may involve indicators, which are encountered when considering, e.g. differences of quantiles, copulas, ROC curves, to mention just a few examples. We prove the asymptotic limit of the empirical log-likelihood ratio, and carry out a small simulation study to test the performance of the proposed EL method for small samples.     

An Empirical Likelihood Estimate of the Finite Population Correlation Coefficient

In this article, the problem of the estimation of finite population correlation coefficient is considered using the empirical likelihood method. A new estimator that makes the use of both the known mean and variance of an auxiliary variable is proposed. The percent relative bias and percent relative efficiency of the proposed new estimator with respect to the usual estimator of the correlation coefficient is investigated through extensive simulation study for values of the correlation coefficient from ?0.90 to +0.90. The proposed estimator is found to perform better than the simple correlation coefficient from both the bias and relative efficiency points of views, for the population, considered in the investigation. At the end, the proposed estimator has been extended to complex survey designs. Supplementary materials for this article are available online.     

Stochastic models for greenhouse gas emission rate estimation from hydroelectric reservoirs: a Bayesian hierarchical approach

Herein, we propose a fully Bayesian approach to the greenhouse gas emission problem. The goal of this work is to estimate the emission rate of polluting gases from the area flooded by hydroelectric reservoirs. We present models for gas concentration evolution in two ways: first, by proposing them from ordinary differential equation solutions and, second, by using stochastic differential equations with a discretization scheme. Finally, we present techniques to estimate the emission rate for the entire reservoir. In order to carry out the inference, we use the Bayesian framework with Monte Carlo via Markov Chain methods. Discretization schemes over continuous differential equations are used when necessary. These models applied to greenhouse gas emission and Bayesian inference for this purpose are completely new in statistical literature, as far as we know, and contribute to estimate the amount of polluting gases released from hydroelectric reservoirs in Brazil. The proposed models are applied in a real data set and results are presented.     

Semiparametric Likelihood Based Method for Goodness of Fit Tests and Estimation in Upgraded Mixture Models

We use Owen's (1988, 1990) empirical likelihood method in upgraded mixture models. Two groups of independent observations are available. One is z ₁, ..., z _n which is observed directly from a distribution F ( z ). The other one is x ₁, ..., x _m which is observed indirectly from F ( z ), where the x _i s have density ∫ p ( x | z ) dF ( z ) and p ( x | z ) is a conditional density function. We are interested in testing H ₀: p ( x | z ) = p ( x | z ; θ ), for some specified smooth density function. A semiparametric likelihood ratio based statistic is proposed and it is shown that it converges to a chi-squared distribution. This is a simple method for doing goodness of fit tests, especially when x is a discrete variable with finitely many values. In addition, we discuss estimation of θ and F ( z ) when H ₀ is true. The connection between upgraded mixture models and general estimating equations is pointed out.     

Bayesian methods for mark-resighting surveys

We consider the problem of estimating the size of a closed population based on the results of a certain type of mark-resighting sampling design. The design is similar to the commonly used multiple capture-recapture design, yet in some cases economically more feasible and easy to use. Sampling is done by first tagging a number of randomly selected animals with visible markers and later randomly sighting them (for instance, for large animals by visually sampling from a helicopter) and counting the number of tagged animals. In this paper, we look at Bayesian methods for point and interval estimation of population size for this design. An example involving estimation of mountain sheep, a couple of simulated examples and simulation studies are given to demonstrate the advantages of the proposed procedure over the other available approximate procedures.     

Bayesian Approach to Multicentre Sparse Data

In a 2 × 2 contingency table, when the sample size is small, there may be a number of cells that contain few or no observations, usually referred to as sparse data. In such cases, a common recommendation in the conventional frequentist methods is adding a small constant to every cell of the observed table to find the estimates of the unknown parameters. However, this approach is based on asymptotic properties of the estimates and may work poorly for small samples. An alternative approach would be to use Bayesian methods in order to provide better insight into the problem of sparse data coupled with fewer centers, which would otherwise be difficult to carry out the analysis. In this article, an attempt has been made to use hierarchical Bayesian model to a multicenter data on the effect of a surgical treatment with standard foot care among leprosy patients with posterior tibial nerve damage which is summarized as seven 2 × 2 tables. Monte Carlo Markov Chain (MCMC) techniques are applied in estimating the parameters of interest under sparse data setup.     

A Simple Approach to Fitting Bayesian Survival Models

There has been much recent work on Bayesian approaches to survival analysis, incorporating features such as flexible baseline hazards, time-dependent covariate effects, and random effects. Some of the proposed methods are quite complicated to implement, and we argue that as good or better results can be obtained via simpler methods. In particular, the normal approximation to the log-gamma distribution yields easy and efficient computational methods in the face of simple multivariate normal priors for baseline log-hazards and time-dependent covariate effects. While the basic method applies to piecewise-constant hazards and covariate effects, it is easy to apply importance sampling to consider smoother functions.     

A simple approach to the estimation of Tukey's gh distribution

ABSTRACT

The Tukey's gh distribution is widely used in situations where skewness and elongation are important features of the data. As the distribution is defined through a quantile transformation of the normal, the likelihood function cannot be written in closed form and exact maximum likelihood estimation is unfeasible. In this paper we exploit a novel approach based on a frequentist reinterpretation of Approximate Bayesian Computation for approximating the maximum likelihood estimates of the gh distribution. This method is appealing because it only requires the ability to sample the distribution. We discuss the choice of the input parameters by means of simulation experiments and provide evidence of superior performance in terms of Root-Mean-Square-Error with respect to the standard quantile estimator. Finally, we give an application to operational risk measurement.     

The Block Empirical Likelihood Method of the Semivarying Coefficient Model with Application to Longitudinal Data

In this article, we consider a semivarying coefficient model with application to longitudinal data. In order to accommodate the within-group correlation, we apply the block empirical likelihood procedure to semivarying coefficient longitudinal data model, and prove a nonparametric version of Wilks' theorem which can be used to construct the block empirical likelihood confidence region with asymptotically correct coverage probability for the parametric component. In comparison with normal approximations, the proposed method does not require a consistent estimator for the asymptotic covariance matrix, making it easier to conduct inference for the model's parametric component. Simulations demonstrate how the proposed method works.     

Sieve Empirical Likelihood and Extensions of the Generalized Least Squares

The empirical likelihood cannot be used directly sometimes when an infinite dimensional parameter of interest is involved. To overcome this difficulty, the sieve empirical likelihoods are introduced in this paper. Based on the sieve empirical likelihoods, a unified procedure is developed for estimation of constrained parametric or non-parametric regression models with unspecified error distributions. It shows some interesting connections with certain extensions of the generalized least squares approach. A general asymptotic theory is provided. In the parametric regression setting it is shown that under certain regularity conditions the proposed estimators are asymptotically efficient even if the restriction functions are discontinuous. In the non-parametric regression setting the convergence rate of the maximum estimator based on the sieve empirical likelihood is given. In both settings, it is shown that the estimator is adaptive for the inhomogeneity of conditional error distributions with respect to predictor, especially for heteroscedasticity.