Empirical likelihood for high-dimensional partially linear model with martingale difference errors

In this paper, we focus on the empirical likelihood (EL) inference for high-dimensional partially linear model with martingale difference errors. An empirical log-likelihood ratio statistic of unknown parameter is constructed and is shown to have asymptotically normality distribution under some suitable conditions. This result is different from those derived before. Furthermore, an empirical log-likelihood ratio for a linear combination of unknown parameter is also proposed and its asymptotic distribution is chi-squared. Based on these results, the confidence regions both for unknown parameter and a linear combination of parameter can be obtained. A simulation study is carried out to show that our proposed approach performs better than normal approximation-based method.     

Local power of some tests in exponential family nonlinear models

In this paper we obtain asymptotic expansions up to order n^−1/2 for the nonnull distribution functions of the likelihood ratio, Wald, score and gradient test statistics in exponential family nonlinear models (Cordeiro and Paula, 1989), under a sequence of Pitman alternatives. The asymptotic distributions of all four statistics are obtained for testing a subset of regression parameters and for testing the dispersion parameter, thus generalising the results given in Cordeiro et al. (1994) and Ferrari et al. (1997). We also present Monte Carlo simulations in order to compare the finite-sample performance of these tests.     

Large Deviation Results for Statistics of Short- and Long-memory Gaussian Processes

This paper discusses the large deviation principle of several important statistics for short- and long-memory Gaussian processes. First, large deviation theorems for the log-likelihood ratio and quadratic forms for a short-memory Gaussian process with mean function are proved. Their asymptotics are described by the large deviation rate functions. Since they are complicated, they are numerically evaluated and illustrated using the Maple V system (Char et al ., 1991a,b). Second, the large deviation theorem of the log-likelihood ratio statistic for a long-memory Gaussian process with constant mean is proved. The asymptotics of the long-memory case differ greatly from those of the short-memory case. The maximum likelihood estimator of a spectral parameter for a short-memory Gaussian stationary process is asymptotically efficient in the sense of Bahadur.     

Empirical likelihood inference for error density estimators in first-order autoregression models

In this paper we apply empirical likelihood method to the error density estimators in first-order autoregressive models under some mild conditions. The log-likelihood ratio statistic is shown to be asymptotically chi-squared distributed at a fixed point. In simulation, we show that the empirical likelihood produces confidence intervals having theoretical coverage accuracy which is better than normal approximation.     

Asymptotics of the weighted least squares estimation for AR(1) processes with applications to confidence intervals

For the first-order autoregressive model, we establish the asymptotic theory of the weighted least squares estimations whether the underlying autoregressive process is stationary, unit root, near integrated or even explosive under a weaker moment condition of innovations. The asymptotic limit of this estimator is always normal. It is shown that the empirical log-likelihood ratio at the true parameter converges to the standard chi-square distribution. An empirical likelihood confidence interval is proposed for interval estimations of the autoregressive coefficient. The results improve the corresponding ones of Chan et al. (Econ Theory 28:705–717, 2012). Some simulations are conducted to illustrate the proposed method.     

Empirical likelihood for the difference of quantiles under censorship

In this paper, we use a smoothed empirical likelihood method to investigate the difference of quantiles under censorship. An empirical log-likelihood ratio is derived and its asymptotic distribution is shown to be chi-squared. Approximate confidence regions based on this method are constructed. Simulation studies are used to compare the empirical likelihood and the normal approximation method in terms of its coverage accuracy. It is found that the empirical likelihood method provides a much better performance. The research is supported by NSFC (10231030) and RFDP.     

Likelihood-Based Inference for Weak Exogeneity in I(2) Cointegrated VAR Models

This article develops limit theory for likelihood analysis of weak exogeneity in I(2) cointegrated vector autoregressive (VAR) models incorporating deterministic terms. Conditions for weak exogeneity in I(2) VAR models are reviewed, and the asymptotic properties of conditional maximum likelihood estimators and a likelihood-based weak exogeneity test are then investigated. It is demonstrated that weak exogeneity in I(2) VAR models allows us to conduct asymptotic conditional inference based on mixed Gaussian distributions. It is then proved that a log-likelihood ratio test statistic for weak exogeneity in I(2) VAR models is asymptotically χ² distributed. The article also presents an empirical illustration of the proposed test for weak exogeneity using Japan's macroeconomic data.     

A Note on Local Influence Based on Normal Curvature

Object functions other than the likelihood displacement, such as a parameter estimate or a test statistic, can also be used in local influence analysis. The normal curvatures of these object functions have been studied in situations where the slopes were non-zero. In these situations, we show that the normal curvature is not scale invariant and thus ambiguous conclusions will be drawn. Comments on the application of the general normal curvature formula are presented.     

Empirical likelihood for single index model with missing covariates at random

In this paper, we investigate the empirical-likelihood-based inference for the construction of confidence intervals and regions of the parameters of interest in single index models with missing covariates at random. An augmented inverse probability weighted-type empirical likelihood ratio for the parameters of interest is defined such that this ratio is asymptotically standard chi-squared. Our approach is to directly calibrate the empirical log-likelihood ratio, and does not need multiplication by an adjustment factor for the original ratio. Our bias-corrected empirical likelihood is self-scale invariant and no plug-in estimator for the limiting variance is needed. Some simulation studies are carried out to assess the performance of our proposed method.     

Estimating changes in a multi-parameter exponential family

A two-stage procedure is studied for estimating changes in the parameters of the multi-parameter exponential family, given a sample X ₁,…,X _n. The first step is a likelihood ratio test of the hypothesis H_oof no change. Upon rejection of this hypothesis, the change point index and pre- and post-change parameters are estimated by maximum likelihood. The asymptotic (n → ∞) distribution of the log-likelihood ratio statistic is obtained under both H_oand local alternatives. The m.l.e.fs o of the pre- and post-change parameters are shown to be asymptotically jointly normal. The distribution of the change point estimate is obtained under local alternatives. Performance of the procedure for moderate samples is studied by Monte Carlo methods.     

Empirical likelihood inference in mixture of semiparametric varying-coefficient models for longitudinal data with non-ignorable dropout

In this paper, empirical likelihood inference in mixture of semiparametric varying-coefficient models for longitudinal data with non-ignorable dropout is investigated. We estimate the non-parametric function based on the estimating equations and the local linear profile-kernel method. An empirical log-likelihood ratio statistic for parametric components is proposed to construct confidence regions and is shown to be an asymptotically chi-squared distribution. The non-parametric version of Wilk's theorem is also derived. A simulation study is undertaken to illustrate the finite sample performance of the proposed method.     

Likelihood Based Inference in Non-linear Regression Models Using the p* and R* Approach

We develop second order asymptotic results for likelihood-based inference in Gaussian non-linear regression models. We provide an approximation to the conditional density of the maximum likelihood estimator given an approximate ancillary statistic (the affine ancillary). From this approximation, we derive a statistic to test an hypothesis on one component of the parameter. This test statistic is an adjustment of the signed log-likelihood ratio statistic. The distributional approximations (for the maximum likelihood estimator and for the test statistic) are of second order in large deviation regions.     

A test for abrupt change in hazard regression models with Weibull baselines

We develop a likelihood ratio test for an abrupt change point in Weibull hazard functions with covariates, including the two-piece constant hazard as a special case. We first define the log-likelihood ratio test statistic as the supremum of the profile log-likelihood ratio process over the interval which may contain an unknown change point. Using local asymptotic normality (LAN) and empirical measure, we show that the profile log-likelihood ratio process converges weakly to a quadratic form of Gaussian processes. We determine the critical values of the test and discuss how the test can be used for model selection. We also illustrate the method using the Chronic Granulomatous Disease (CGD) data.     

Comparisons of approximate confidence intervals for the smallest extreme value distribution simple linear regression model under time censoring

Exact confidence interval estimation for accelerated life regression models with censored smallest extreme value (or Weibull) data is often impractical. This paper evaluates the accuracy of approximate confidence intervals based on the asymptotic normality of the maximum likelihood estimator, the asymptotic X²distribution of the likelihood ratio statistic, mean and variance correction to the likelihood ratio statistic, and the so-called Bartlett correction to the likelihood ratio statistic. The Monte Carlo evaluations under various degrees of time censoring show that uncorrected likelihood ratio intervals are very accurate in situations with heavy censoring. The benefits of mean and variance correction to the likelihood ratio statistic are only realized with light or no censoring. Bartlett correction tends to result in conservative intervals. Intervals based on the asymptotic normality of maximum likelihood estimators are anticonservative and should be used with much caution.     

Weighted composite quantile regression method via empirical likelihood for non linear models

In this paper, we investigate empirical likelihood (EL) inferences via weighted composite quantile regression for non linear models. Under regularity conditions, we establish that the proposed empirical log-likelihood ratio is asymptotically chi-squared, and then the confidence intervals for the regression coefficients are constructed. The proposed method avoids estimating the unknown error density function involved in the asymptotic covariance matrix of the estimators. Simulations suggest that the proposed EL procedure is more efficient and robust, and a real data analysis is used to illustrate the performance.     

Global convergence of the log-concave MLE when the true distribution is geometric

Let X₁, …, X_n be i.i.d. from a discrete probability mass function (pmf) p. In Balabdaoui et al. [(2013), ‘Asymptotic Distribution of the Discrete Log-Concave mle and Some Applications’, JRSS-B, in press], the pointwise limit distribution of the log-concave maximum-likelihood estimator (MLE) was derived in both the well- and misspecified settings. In the well-specified setting, the geometric distribution was excluded, classified as being degenerate. In this article, we establish the global asymptotic theory of the log-concave MLE of a geometric pmf in all ?_q distances for q∈{1, 2, …}∪{∞}. We also show how these asymptotic results could be used in testing whether a pmf is geometric.     

Effects of model misspecification on tests of no randomized treatment effect arising from Cox's proportional hazards model

We examine the asymptotic and small sample properties of model-based and robust tests of the null hypothesis of no randomized treatment effect based on the partial likelihood arising from an arbitrarily misspecified Cox proportional hazards model. When the distribution of the censoring variable is either conditionally independent of the treatment group given covariates or conditionally independent of covariates given the treatment group, the numerators of the partial likelihood treatment score and Wald tests have asymptotic mean equal to 0 under the null hypothesis, regardless of whether or how the Cox model is misspecified. We show that the model-based variance estimators used in the calculation of the model-based tests are not, in general, consistent under model misspecification, yet using analytic considerations and simulations we show that their true sizes can be as close to the nominal value as tests calculated with robust variance estimators. As a special case, we show that the model-based log-rank test is asymptotically valid. When the Cox model is misspecified and the distribution of censoring depends on both treatment group and covariates, the asymptotic distributions of the resulting partial likelihood treatment score statistic and maximum partial likelihood estimator do not, in general, have a zero mean under the null hypothesis. Here neither the fully model-based tests, including the log-rank test, nor the robust tests will be asymptotically valid, and we show through simulations that the distortion to test size can be substantial.     

Statistical Inference in Partially Linear Varying-Coefficient Models with Missing Responses at Random

This article considers statistical inference for partially linear varying-coefficient models when the responses are missing at random. We propose a profile least-squares estimator for the parametric component with complete-case data and show that the resulting estimator is asymptotically normal. To avoid to estimate the asymptotic covariance in establishing confidence region of the parametric component with the normal-approximation method, we define an empirical likelihood based statistic and show that its limiting distribution is chi-squared distribution. Then, the confidence regions of the parametric component with asymptotically correct coverage probabilities can be constructed by the result. To check the validity of the linear constraints on the parametric component, we construct a modified generalized likelihood ratio test statistic and demonstrate that it follows asymptotically chi-squared distribution under the null hypothesis. Then, we extend the generalized likelihood ratio technique to the context of missing data. Finally, some simulations are conducted to illustrate the proposed methods.     

On the equivalence of some test criteria based on BAN estimators for the multivariate exponential family

For the general multivariate exponential family of distributions it is shown that Rao's test criterion based on efficient scores is algebraically identical to the general chi-squared criterion based on maximum likelihood estimates and, similarly, that the Wald statistic is algebraically identical to the general minimum modified chi-squared statistic using linearization; these results are valid also for the multisample versions. Thus, these are extensions to the general exponential family of the findings due to Silvey (1970) and Bhapkar (1966), respectively, for the special case of the multinomial family.It is also shown that the general forms of the chi-squared and modified chi-squared criteria reduce to their respective well-known forms for the multivariate symmetric power series distribution. This finding is, thus, an extension of results noted by Ferguson (1958) and Clickner (1976) for the special case of the multinomial distribution.     

SOME SECOND ORDER ASYMPTOTICS IN EXPONENTIAL FAMILY NON-LINEAR REGRESSION MODELS (A GEOMETRIC APPROACH)

The differential geometric framework of Amari (1982a, 1985) is applied to the study of some second order asymptotics related to the curvatures for exponential family nonlinear regression models, in which the observations are independent but not necessarily identically distributed. This paper presents a set of reasonable regularity conditions which are needed to study asymptotics from a geometric point of view in regression models. A new stochastic expansion of a first order efficient estimator is derived and used to study several asymptotic problems related to Fisher information in terms of curvatures. The bias and the covariance of the first order efficient estimator are also calculated according to the expansion.