Semiparametric ARCH Models

This article introduces a semiparametric autoregressive conditional heteroscedasticity (ARCH) model that has conditional first and second moments given by autoregressive moving average and ARCH parametric formulations but a conditional density that is assumed only to be sufficiently smooth to be approximated by a nonparametric density estimator. For several particular conditional densities, the relative efficiency of the quasi-maximum likelihood estimator is compared with maximum likelihood under correct specification. These potential efficiency gains for a fully adaptive procedure are compared in a Monte Carlo experiment with the observed gains from using the proposed semiparametric procedure, and it is found that the estimator captures a substantial proportion of the potential. The estimator is applied to daily stock returns from small firms that are found to exhibit conditional skewness and kurtosis and to the British pound to dollar exchange rate.     

Finite sample properties of maximum likelihood and quasi-maximum likelihood estimators of egarch models

In this paper I examine finite sample properties of the maximum likelihood and quasi-maximum likelihood estimators of EGARCH(1,1) processes using Monte Carlo methods. I use response surface methodology to summarize the results of a wide array of experiments which suggest that the maximum likelihood estimator has reasonable finite sample properties. The Gaussian quasi-maximum likelihood estimator has poor finite sample properties when the data generating process has conditional excess kurtosis. Some of these poor properties appear to be asymptotic in nature.     

Finite sample properties of maximum likelihood and quasi-maximum likelihood estimators of egarch models

In this paper I examine finite sample properties of the maximum likelihood and quasi-maximum likelihood estimators of EGARCH(1,1) processes using Monte Carlo methods. I use response surface methodology to summarize the results of a wide array of experiments which suggest that the maximum likelihood estimator has reasonable finite sample properties. The Gaussian quasi-maximum likelihood estimator has poor finite sample properties when the data generating process has conditional excess kurtosis. Some of these poor properties appear to be asymptotic in nature.     

Pairwise conditional score functions: a generalization of the Mantel–Haenszel estimator

Pairwise conditional score functions are proposed and explored. They provide us with an interpretation on the Mantel–Haenszel estimator, and are applicable to deriving the Mantel–Haenszel-type estimators under the exponential dispersion model with multiple strata. Explicit forms of the estimating functions are presented, and the asymptotic relative efficiency is examined in the cases of the exponential and the geometric distributions. The derivation and the numerical results suggest that the derived estimators are fairly robust and show high efficiency as the Mantel–Haenszel estimator.     

Quasi-Maximum Likelihood Estimation of GARCH Models With Heavy-Tailed Likelihoods

The non-Gaussian maximum likelihood estimator is frequently used in GARCH models with the intention of capturing heavy-tailed returns. However, unless the parametric likelihood family contains the true likelihood, the estimator is inconsistent due to density misspecification. To correct this bias, we identify an unknown scale parameter η_f that is critical to the identification for consistency and propose a three-step quasi-maximum likelihood procedure with non-Gaussian likelihood functions. This novel approach is consistent and asymptotically normal under weak moment conditions. Moreover, it achieves better efficiency than the Gaussian alternative, particularly when the innovation error has heavy tails. We also summarize and compare the values of the scale parameter and the asymptotic efficiency for estimators based on different choices of likelihood functions with an increasing level of heaviness in the innovation tails. Numerical studies confirm the advantages of the proposed approach.     

On length and area-biased Maxwell distributions

This article addresses the various properties and different methods of estimation of the unknown parameter of length and area-biased Maxwell distributions. Although, our main focus is on estimation from both frequentist and Bayesian point of view, yet, various mathematical and statistical properties of length and area-biased Maxwell distributions (such as moments, moment-generating function (mgf), hazard rate function, mean residual lifetime function, residual lifetime function, reversed residual life function, conditional moments and conditional mgf, stochastic ordering, and measures of uncertainty) are derived. We briefly describe different frequentist approaches, namely, maximum likelihood estimator, moments estimator, least-square and weighted least-square estimators, maximum product of spacings estimator and compare them using extensive numerical simulations. Next we consider Bayes estimation under different types of loss function (symmetric and asymmetric loss functions) using inverted gamma prior for the scale parameter. Furthermore, Bayes estimators and their respective posterior risks are computed and compared using Markov chain Monte Carlo (MCMC) algorithm. Also, bootstrap confidence intervals using frequentist approaches are provided to compare with Bayes credible intervals. Finally, a real dataset has been analyzed for illustrative purposes.     

A novel weighted likelihood estimation with empirical Bayes flavor

We propose a novel approach to estimation, where a set of estimators of a parameter is combined into a weighted average to produce the final estimator. The weights are chosen to be proportional to the likelihood evaluated at the estimators. We investigate the method for a set of estimators obtained by using the maximum likelihood principle applied to each individual observation. The method can be viewed as a Bayesian approach with a data-driven prior distribution. We provide several examples illustrating the new method and argue for its consistency, asymptotic normality, and efficiency. We also conduct simulation studies to assess the performance of the estimators. This straightforward methodology produces consistent estimators comparable with those obtained by the maximum likelihood method. The method also approximates the distribution of the estimator through the “posterior” distribution.     

Empirical Uncertain Bayes Methods in Area‐level Models

Random effects model can account for the lack of fitting a regression model and increase precision of estimating area‐level means. However, in case that the synthetic mean provides accurate estimates, the prior distribution may inflate an estimation error. Thus, it is desirable to consider the uncertain prior distribution, which is expressed as the mixture of a one‐point distribution and a proper prior distribution. In this paper, we develop an empirical Bayes approach for estimating area‐level means, using the uncertain prior distribution in the context of a natural exponential family, which we call the empirical uncertain Bayes (EUB) method. The regression model considered in this paper includes the Poisson‐gamma and the binomial‐beta, and the normal‐normal (Fay–Herriot) model, which are typically used in small area estimation. We obtain the estimators of hyperparameters based on the marginal likelihood by using a well‐known expectation‐maximization algorithm and propose the EUB estimators of area means. For risk evaluation of the EUB estimator, we derive a second‐order unbiased estimator of a conditional mean squared error by using some techniques of numerical calculation. Through simulation studies and real data applications, we evaluate a performance of the EUB estimator and compare it with the usual empirical Bayes estimator.     

Mixtures of autoregressive-autoregressive conditionally heteroscedastic models: semi-parametric approach

We propose data generating structures which can be represented as a mixture of autoregressive-autoregressive conditionally heteroscedastic models. The switching between the states is governed by a hidden Markov chain. We investigate semi-parametric estimators for estimating the functions based on the quasi-maximum likelihood approach and provide sufficient conditions for geometric ergodicity of the process. We also present an expectation–maximization algorithm for calculating the estimates numerically.     

Semiparametric Approach to a Random Effects Quantile Regression Model

We consider a random effects quantile regression analysis of clustered data and propose a semiparametric approach using empirical likelihood. The random regression coefficients are assumed independent with a common mean, following parametrically specified distributions. The common mean corresponds to the population-average effects of explanatory variables on the conditional quantile of interest, while the random coefficients represent cluster specific deviations in the covariate effects. We formulate the estimation of the random coefficients as an estimating equations problem and use empirical likelihood to incorporate the parametric likelihood of the random coefficients. A likelihood-like statistical criterion function is yield, which we show is asymptotically concave in a neighborhood of the true parameter value and motivates its maximizer as a natural estimator. We use Markov Chain Monte Carlo (MCMC) samplers in the Bayesian framework, and propose the resulting quasi-posterior mean as an estimator. We show that the proposed estimator of the population-level parameter is asymptotically normal and the estimators of the random coefficients are shrunk toward the population-level parameter in the first order asymptotic sense. These asymptotic results do not require Gaussian random effects, and the empirical likelihood based likelihood-like criterion function is free of parameters related to the error densities. This makes the proposed approach both flexible and computationally simple. We illustrate the methodology with two real data examples.     

Estimation and Testing in Elliptical Functional Measurement Error Models

The purpose of this article is to investigate estimation and hypothesis testing by maximum likelihood and method of moments in functional models within the class of elliptical symmetric distributions. The main results encompass consistency and asymptotic normality of the method of moments estimators. Also, the asymptotic covariance matrix of the maximum likelihood estimator is derived, extending some existing results in elliptical distributions. A measure of asymptotic relative efficiency is reported. Wald-type statistics are considered and numerical results obtained by Monte Carlo simulation to investigate the performance of estimators and tests are provided for Student-t and contaminated normal distributions. An application to a real dataset is also included.     

Normal Mixture Quasi-maximum Likelihood Estimator for GARCH Models

Abstract.  The generalized autoregressive conditional heteroscedastic (GARCH) model has been popular in the analysis of financial time series data with high volatility. Conventionally, the parameter estimation in GARCH models has been performed based on the Gaussian quasi-maximum likelihood. However, when the innovation terms have either heavy-tailed or skewed distributions, the quasi-maximum likelihood estimator (QMLE) does not function well. In order to remedy this defect, we propose the normal mixture QMLE (NM-QMLE), which is obtained from the normal mixture quasi-likelihood, and demonstrate that the NM-QMLE is consistent and asymptotically normal. Finally, we present simulation results and a real data analysis in order to illustrate our findings.     

Estimating the common hazard rate of two exponential distributions with ordered location parameters

This paper is concerned with estimating the common hazard rate of two exponential distributions with unknown and ordered location parameters under a general class of bowl-shaped scale invariant loss functions. The inadmissibility of the best affine equivariant estimator is established by deriving an improved estimator. Another estimator is obtained which improves upon the best affine equivariant estimator. A class of improving estimators is derived using the integral expression of risk difference approach of Kubokawa [A unified approach to improving equivariant estimators. Ann Statist. 1994;22(1):290–299]. These results are applied to specific loss functions. It is further shown that these estimators can be derived for four important sampling schemes: (i) complete and i.i.d. sample, (ii) record values, (iii) type-II censoring, and (iv) progressive Type-II censoring. A simulation study is carried out for numerically comparing the risk performance of these proposed estimators.     

A Profile Conditional Likelihood Approach for the Semiparametric Transformation Regression Model with Missing Covariates

We propose a profile conditional likelihood approach to handle missing covariates in the general semiparametric transformation regression model. The method estimates the marginal survival function by the Kaplan-Meier estimator, and then estimates the parameters of the survival model and the covariate distribution from a conditional likelihood, substituting the Kaplan-Meier estimator for the marginal survival function in the conditional likelihood. This method is simpler than full maximum likelihood approaches, and yields consistent and asymptotically normally distributed estimator of the regression parameter when censoring is independent of the covariates. The estimator demonstrates very high relative efficiency in simulations. When compared with complete-case analysis, the proposed estimator can be more efficient when the missing data are missing completely at random and can correct bias when the missing data are missing at random. The potential application of the proposed method to the generalized probit model with missing continuous covariates is also outlined.     

An empirical investigation of different operating characteristics of several estimators of the intraclass correlation in the analysis of binary data

This paper is concerned with properties (bias, standard deviation, mean square error and efficiency) of twenty six estimators of the intraclass correlation in the analysis of binary data. Our main interest is to study these properties when data are generated from different distributions. For data generation we considered three over-dispersed binomial distributions, namely, the beta-binomial distribution, the probit normal binomial distribution and a mixture of two binomial distributions. The findings regarding bias, standard deviation and mean squared error of all these estimators, are that (a) in general, the distributions of biases of most of the estimators are negatively skewed. The biases are smallest when data are generated from the beta-binomial distribution and largest when data are generated from the mixture distribution; (b) the standard deviations are smallest when data are generated from the beta-binomial distribution; and (c) the mean squared errors are smallest when data are generated from the beta-binomial distribution and largest when data are generated from the mixture distribution. Of the 26, nine estimators including the maximum likelihood estimator, an estimator based on the optimal quadratic estimating equations of Crowder (1987), and an analysis of variance type estimator is found to have least amount of bias, standard deviation and mean squared error. Also, the distributions of the bias, standard deviation and mean squared error for each of these estimators are, in general, more symmetric than those of the other estimators. Our findings regarding efficiency are that the estimator based on the optimal quadratic estimating equations has consistently high efficiency and least variability in the efficiency results. In the important range in which the intraclass correlation is small (≤0 5), on the average, this estimator shows best efficiency performance. The analysis of variance type estimator seems to do well for larger values of the intraclass correlation. In general, the estimator based on the optimal quadratic estimating equations seems to show best efficiency performance for data from the beta-binomial distribution and the probit normal binomial distribution, and the analysis of variance type estimator seems to do well for data from the mixture distribution.     

ESTIMATION OF THE CONCENTRATION PARAMETERS OF THE FISHER MATRIX DISTRIBUTION ON 50(3) AND THE BINGHAM DISTRIBUTION ON Sq, q≥ 2

Two procedures are considered for estimating the concentration parameters of the Fisher matrix distribution for rotations or orientations in three dimensions. The first is maximum likelihood. The use of a convenient 1-dimensional integral representation of the normalising constant, which greatly simplifies the computation, is suggested. The second approach exploits the equivalence of the Fisher distribution for rotations in three dimensions, and the Bingham distribution for axes in four dimensions. We describe a pseudo likelihood procedure which works for the Bingham distribution in any dimension. This alternative approach does not require numerical integration. Results on the asymptotic efficiency of the pseudo likelihood estimator relative to the maximum likelihood estimator are given, and the two estimators are compared in the analysis of a well-known vectorcardiography dataset.     

Doubly robust empirical likelihood inference in covariate-missing data problems

Missing covariate data occurs often in regression analysis. We study methods for estimating the regression coefficients in an assumed conditional mean function when some covariates are completely observed but other covariates are missing for some subjects. We adopt the semiparametric perspective of Robins et al. [Estimation of regression coefficients when some regressors are not always observed. J Amer Statist Assoc. 1994;89:846–866] on regression analyses with missing covariates, in which they pioneered the use of two working models, the working propensity score model and the working conditional score model. A recent approach to missing covariate data analysis is the empirical likelihood method of Qin et al. [Empirical likelihood in missing data problems. J Amer Statist Assoc. 2009;104:1492–1503], which effectively combines unbiased estimating equations. In this paper, we consider an alternative likelihood approach based on the full likelihood of the observed data. This full likelihood-based method enables us to generate estimators for the vector of the regression coefficients that are (a) asymptotically equivalent to those of Qin et al. [Empirical likelihood in missing data problems. J Amer Statist Assoc. 2009;104:1492–1503] when the working propensity score model is correctly specified, and (b) doubly robust, like the augmented inverse probability weighting (AIPW) estimators of Robins et al. [Estimation of regression coefficients when some regressors are not always observed. J Am Statist Assoc. 1994;89:846–866]. Thus, the proposed full likelihood-based estimators improve on the efficiency of the AIPW estimators when the working propensity score model is correct but the working conditional score model is possibly incorrect, and also improve on the empirical likelihood estimators of Qin, Zhang and Leung [Empirical likelihood in missing data problems. J Amer Statist Assoc. 2009;104:1492–1503] when the reverse is true, that is, the working conditional score model is correct but the working propensity score model is possibly incorrect. In addition, we consider a regression method for estimation of the regression coefficients when the working conditional score model is correctly specified; the asymptotic variance of the resulting estimator is no greater than the semiparametric variance bound characterized by the theory of Robins et al. [Estimation of regression coefficients when some regressors are not always observed. J Amer Statist Assoc. 1994;89:846–866]. Finally, we compare the finite-sample performance of various estimators in a simulation study.     

Local Estimation of the Second-Order Parameter in Extreme Value Statistics and Local Unbiased Estimation of the Tail Index

We develop and study in the framework of Pareto-type distributions a class of nonparametric kernel estimators for the conditional second order tail parameter. The estimators are obtained by local estimation of the conditional second order parameter using a moving window approach. Asymptotic normality of the proposed class of kernel estimators is proven under some suitable conditions on the kernel function and the conditional tail quantile function. The nonparametric estimators for the second order parameter are subsequently used to obtain a class of bias-corrected kernel estimators for the conditional tail index. In particular it is shown how for a given kernel function one obtains a bias-corrected kernel function, and that replacing the second order parameter in the latter with a consistent estimator does not change the limiting distribution of the bias-corrected estimator for the conditional tail index. The finite sample behavior of some specific estimators is illustrated with a simulation experiment. The developed methodology is also illustrated on fire insurance claim data.     

Construdtion of shrinkage estimators for the regression coefficient matrix in the gmanova model

This paper extensively investigates the theory of estimating the regression coefficient matrix in the normal GM.4KOVA model. We explicitly construct estimators which improve upon the maximum likelihood estimator under an invariant scalar loss function. These include the double shrinkage estimatois and those shrinking the maximum likelihood estimators directly. The underlying method is the decomposition of the problem into the conditional subproblems due to Kariya, Konno, and Strawderman(l996) and application of integration-by-parts technique to derive an unbiased estimate of the risk for certain class of invariant estimators.     

Improved Empirical Bayes Estimation in Group Testing Procedure for Small Proportions

Group testing has been long recognized as an efficient method to classify all the experimental units into two mutually exclusive categories: defective or not defective. In recent years, more attention has been brought to the estimation of the population prevalence rate p of a disease, or of some property, using group testing. In this article, we propose two scaled squared-error loss functions, which improve the Bayesian approach to estimating p in terms of minimizing the mean squared error (MSE) of the Bayes estimators of p for small p. We show that the new estimators are preferred over the estimator from the usual squared-error loss function and the maximum likelihood estimator (MLE) for small p.