Empirical Likelihood-based Inference in Linear Models with Missing Data

The missing response problem in linear regression is studied. An adjusted empirical likelihood approach to inference on the mean of the response variable is developed. A non-parametric version of Wilks's theorem for the adjusted empirical likelihood is proved, and the corresponding empirical likelihood confidence interval for the mean is constructed. With auxiliary information, an empirical likelihood-based estimator with asymptotic normality is defined and an adjusted empirical log-likelihood function with asymptotic χ² is derived. A simulation study is conducted to compare the adjusted empirical likelihood methods and the normal approximation methods in terms of coverage accuracies and average lengths of the confidence intervals. Based on biases and standard errors, a comparison is also made between the empirical likelihood-based estimator and related estimators by simulation. Our simulation indicates that the adjusted empirical likelihood methods perform competitively and the use of auxiliary information provides improved inferences.     

Empirical likelihood for linear regression models under imputation for missing responses

The authors study the empirical likelihood method for linear regression models. They show that when missing responses are imputed using least squares predictors, the empirical log‐likelihood ratio is asymptotically a weighted sum of chi‐square variables with unknown weights. They obtain an adjusted empirical log‐likelihood ratio which is asymptotically standard chi‐square and hence can be used to construct confidence regions. They also obtain a bootstrap empirical log‐likelihood ratio and use its distribution to approximate that of the empirical log‐likelihood ratio. A simulation study indicates that the proposed methods are comparable in terms of coverage probabilities and average lengths of confidence intervals, and perform better than a normal approximation based method.     

Parameter Estimation for Hidden Markov Models with Intractable Likelihoods

Approximate Bayesian computation (ABC) is a popular technique for analysing data for complex models where the likelihood function is intractable. It involves using simulation from the model to approximate the likelihood, with this approximate likelihood then being used to construct an approximate posterior. In this paper, we consider methods that estimate the parameters by maximizing the approximate likelihood used in ABC. We give a theoretical analysis of the asymptotic properties of the resulting estimator. In particular, we derive results analogous to those of consistency and asymptotic normality for standard maximum likelihood estimation. We also discuss how sequential Monte Carlo methods provide a natural method for implementing our likelihood‐based ABC procedures.     

Strictly monotone and smooth nonparametric regression for two or more variables

The authors propose a new monotone nonparametric estimate for a regression function of two or more variables. Their method consists in applying successively one‐dimensional isotonization procedures on an initial, unconstrained nonparametric regression estimate. In the case of a strictly monotone regression function, they show that the new estimate and the initial one are first‐order asymptotic equivalent; they also establish asymptotic normality of an appropriate standardization of the new estimate. In addition, they show that if the regression function is not monotone in one of its arguments, the new estimate and the initial one have approximately the same L^p‐norm. They illustrate their approach by means of a simulation study, and two data examples are analyzed.     

Asymptotic properties of a quast-maximum likelihood estimator in truncated regression model with serial correlation

Robinson (1982a) presented a general approach to serial correlation in limited dependent variable models and proved the strong consistency and asymptotic normality of the quasi-maximum likelihood estimator (QMLE) for the Tobit model with serial correlation, obtained under the assumption of independent errors. This paper proves the strong consistency and asymptotic normality of the QMLE based on independent errors for the truncated regression model with serial correlation and gives consistent estimators for the limiting covariance matrix of the QMLE.     

Asymptotic properties of a quast-maximum likelihood estimator in truncated regression model with serial correlation

Robinson (1982a) presented a general approach to serial correlation in limited dependent variable models and proved the strong consistency and asymptotic normality of the quasi-maximum likelihood estimator (QMLE) for the Tobit model with serial correlation, obtained under the assumption of independent errors. This paper proves the strong consistency and asymptotic normality of the QMLE based on independent errors for the truncated regression model with serial correlation and gives consistent estimators for the limiting covariance matrix of the QMLE.     

Corrected local polynomial estimation in varying‐coefficient models with measurement errors

The authors study a varying‐coefficient regression model in which some of the covariates are measured with additive errors. They find that the usual local linear estimator (LLE) of the coefficient functions is biased and that the usual correction for attenuation fails to work. They propose a corrected LLE and show that it is consistent and asymptotically normal, and they also construct a consistent estimator for the model error variance. They then extend the generalized likelihood technique to develop a goodness of fit test for the model. They evaluate these various procedures through simulation studies and use them to analyze data from the Framingham Heart Study.     

On the robustness of empirical likelihood ratio confidence intervals for location

The authors examine the robustness of empirical likelihood ratio (ELR) confidence intervals for the mean and M‐estimate of location. They show that the ELR interval for the mean has an asymptotic breakdown point of zero. They also give a formula for computing the breakdown point of the ELR interval for M‐estimate. Through a numerical study, they further examine the relative advantages of the ELR interval to the commonly used confidence intervals based on the asymptotic distribution of the M‐estimate.     

Simple linear regression with multiple level shifts

The authors study the properties of the ordinary least squares trend estimator in a simple linear regression model with multiple known level shift times. The error component in the model is taken to be a general short‐memory stationary time series. The authors establish the consistency and asymptotic normality of the estimator. They also present a climatological application in which the multiple level shifts are prominent features.     

Estimation of the mixtures of GLMs with covariate-dependent mixing proportions

ABSTRACT

In this article, we study the estimation for a class of semiparametric mixtures of generalized linear models where mixing proportions depend on a covariate non parametrically. We investigate a backfitting estimation procedure and show the asymptotic normality of the proposed estimators under mild conditions. We conduct simulation to show the good performance of our methodology and give a real data analysis as an illustration.     

Local Linear Regression for Non Grid Spatiotemporal Models with Autoregressive Errors

In various environmental studies, spatiotemporal correlated data are involved, so there has been increasing demand of proposing spatiotemporal estimation methods that capture spatiotemporal correlation so as to improve the accuracy of estimation. In this article, we construct estimators for non grid spatiotemporal models with autoregressive errors. It is proved that the estimators are asymptotic normality. Simulation results also show the estimators perform well.     

Asymptotic normality of the posterior given a statistic

The authors establish the asymptotic normality and determine the limiting variance of the posterior density for a multivariate parameter, given the value of a consistent and asymptotically Gaussian statistic satisfying a uniform local central limit theorem. Their proof is given in the continuous case but generalizes to lattice‐valued random variables. It hinges on a uniform Edgeworth expansion used to control the behaviour of the conditioning statistic. They provide examples and show how their result can help in identifying reference priors.     

Asymptotic optimality of estimators of a linear functional eeiation if the ratio of the error variances is known 2

For the problem of estimating a linear functional relation when the ratio of the error variances is known a general class of estimators is introduced. They include as special cases the instrumental variable and replication cases and some others. Conditions are given for consistency, asymptotic normality and asymptotic optimality within this class based on the variance of the limit distribution. Fisheb's lower bound for asymptotic variances is established, and under normality the asymptotically optimal estimators are shown to be best asymptotically normal. For an inhomogeneous linear relation only estimators which are invariant with respect to a translation of the origin are considered, and asymptotically optimal invariant and, under normality, best asymptotically normal invariant estimators are obtained. Several special cases are discussed.     

The weighted likelihood

The authors consider a weighted version of the classical likelihood that applies when the need is felt to diminish the role of some of the data in order to trade bias for precision. They propose an axiomatic derivation of the weighted likelihood, for which they show that aspects of classical theory continue to obtain. They suggest a data‐based method of selecting the weights and show that it leads to the James‐Stein estimator in various contexts. They also provide applications.     

Improved log‐linear model estimators of abundance in capture‐recapture experiments

The authors review log‐linear models for estimating the size of a closed population and propose a new log‐linear estimator for experiments having between animal heterogeneity and a behavioral response. They give a general formula for evaluating the asymptotic biases of estimators of abundance derived from log‐linear models. They propose simple frequency modifications for reducing these asymptotic biases and investigate the modifications in a Monte Carlo experiment which reveals that they reduce both the bias and the mean squared error of abundance estimators.     

Modeling nonlinear time series with local mixtures of generalized linear models

The authors consider a novel class of nonlinear time series models based on local mixtures of regressions of exponential family models, where the covariates include functions of lags of the dependent variable. They give conditions to guarantee consistency of the maximum likelihood estimator for correctly specified models, with stationary and nonstationary predictors. They show that consistency of the maximum likelihood estimator still holds under model misspecification. They also provide probabilistic results for the proposed model when the vector of predictors contains only lags of transformations of the modeled time series. They illustrate the consistency of the maximum likelihood estimator and the probabilistic properties via Monte Carlo simulations. Finally, they present an application using real data.     

On quasi‐likelihood inference in generalized linear mixed models with two components of dispersion

The authors propose a quasi‐likelihood approach analogous to two‐way analysis of variance for the estimation of the parameters of generalized linear mixed models with two components of dispersion. They discuss both the asymptotic and small‐sample behaviour of their estimators, and illustrate their use with salamander mating data.     

LOCAL POLYNOMIAL QUASI-LIKELIHOOD REGRESSION ON RANDOM FIELDS

In this paper, local quasi‐likelihood regression is considered for stationary random fields of dependent variables. In the case of independent data, local polynomial quasi‐likelihood regression is known to have several appealing features such as minimax efficiency, design adaptivity and good boundary behaviour. These properties are shown to carry over to the case of random fields. The asymptotic normality of the regression estimator is established and explicit formulae for its asymptotic bias and variance are derived for strongly mixing stationary random fields. The extension to multi‐dimensional covariates is also provided in full generality. Moreover, evaluation of the finite sample performance is made through a simulation study.     

Model‐based linear clustering

The authors propose a profile likelihood approach to linear clustering which explores potential linear clusters in a data set. For each linear cluster, an errors‐in‐variables model is assumed. The optimization of the derived profile likelihood can be achieved by an EM algorithm. Its asymptotic properties and its relationships with several existing clustering methods are discussed. Methods to determine the number of components in a data set are adapted to this linear clustering setting. Several simulated and real data sets are analyzed for comparison and illustration purposes. The Canadian Journal of Statistics 38: 716–737; 2010 © 2010 Statistical Society of Canada     

Asymptotic theory for fractionally integrated asymmetric power ARCH models

Consistency and asymptotic normality of quasi-maximum likelihood estimators (QMLEs) for the fractionally integrated asymmetric power ARCH (FIAPARCH) process are proved. The moment conditions are assumed only for standardized errors. We show the properties for a wide range of QMLEs including Gaussian QMLE.