Bayesian estimation of renewal function for inverse Gaussian renewal process

Two approximation methods are used to obtain the Bayes estimate for the renewal function of inverse Gaussian renewal process. Both approximations use a gamma-type conditional prior for the location parameter, a non-informative marginal prior for the shape parameter, and a squared error loss function. Simulations compare the accuracy of the estimators and indicate that the Tieney and Kadane (T–K)-based estimator out performs Maximum Likelihood (ML)- and Lindley (L)-based estimator. Computations for the T–K-based Bayes estimate employ the generalized Newton's method as well as a recent modified Newton's method with cubic convergence to maximize modified likelihood functions. The program is available from the author.     

A family of IDMRL tests with unknown turning point

In this paper we propose a family of tests for exponentiality against the IDMRL alternative. Here we assume that the turning point or the proportion before the turning point is unknown. We derive the asymptotic null distributions of the test statistics and obtain their asymptotic critical values based on Durbin's approximation method. A simulation study is conducted to evaluate the proposed tests.     

The estimation of treatment effect for the censored bivariate data under the univariate censoring

This paper establishes a nonparametric estimator for the treatment effect on censored bivariate data under unvariate censoring. This proposed estimator is based on the one from Lin and Ying(1993)'s nonparametric bivariate survival function estimator, which is itself a generalized version of Park and Park(1995)' quantile estimator. A Bahadur type representation of quantile functions were obtained from the marginal survival distribution estimator of Lin and Ying' model. The asymptotic property of this estimator is shown below and the simulation studies are also given     

Estimation of the linear EV model with censored data

In this paper, a censored linear errors-in-variables model is investigated. The asymptotic normality of the unknown parameter's estimator is obtained. Two empirical log-likelihood ratio statistics for the unknown parameter in the model are suggested. It is proved that the proposed statistics are asymptotically chi-squared under some mild conditions, and hence can be used to construct the confidence regions of the parameter of interest. Finite sample performance of the proposed method is illustrated in a simulation study.     

Some pitfalls of tests of separate families of hypotheses: normality vs. lognormality

It is often desirable to test non-nested hypotheses. Cox (1961, 1962) proposed forming a log-likelihood ratio from their maxima and then comparing this value to its expected value under the null hypothesis. Pitfalls exists when we apply Cox's test to the special case of testing normality versus lognormality. Pesaran (1981) and Kotz (1973) pointed out the slow convergence rate of the Cox's test. In this paper, this fact has been reemphasized; moreover, we propose an alternative likelihood ratio test which remedies problems arising from negative estimates of the asymptotic variance of Cox's test statistic and is uniformly more powerful than most commonly used tests.     

Goodness-of-fit tests for binomial AR(1) processes

The binomial AR(1) model describes a nonlinear process with a first-order autoregressive (AR(1)) structure and a binomial marginal distribution. To develop goodness-of-fit tests for the binomial AR(1) model, we investigate the observed marginal distribution of the binomial AR(1) process, and we tackle its autocorrelation structure. Motivated by the family of power-divergence statistics for handling discrete multivariate data, we derive the asymptotic distribution of certain categorized power-divergence statistics for the case of a binomial AR(1) process. Then we consider Bartlett's formula, which is widely used in time series analysis to provide estimates of the asymptotic covariance between sample autocorrelations, but which is not applicable when the underlying process is nonlinear. Hence, we derive a novel Bartlett-type formula for the asymptotic distribution of the sample autocorrelations of a binomial AR(1) process, which is then applied to develop tests concerning the autocorrelation structure. Simulation studies are carried out to evaluate the size and power of the proposed tests under diverse alternative process models. Several real examples are used to illustrate our methods and findings.     

Statistical inference for Cox proportional hazards models with a diverging number of covariates

For statistical inference on regression models with a diverging number of covariates, the existing literature typically makes sparsity assumptions on the inverse of the Fisher information matrix. Such assumptions, however, are often violated under Cox proportion hazards models, leading to biased estimates with under-coverage confidence intervals. We propose a modified debiased lasso method, which solves a series of quadratic programming problems to approximate the inverse information matrix without posing sparse matrix assumptions. We establish asymptotic results for the estimated regression coefficients when the dimension of covariates diverges with the sample size. As demonstrated by extensive simulations, our proposed method provides consistent estimates and confidence intervals with nominal coverage probabilities. The utility of the method is further demonstrated by assessing the effects of genetic markers on patients' overall survival with the Boston Lung Cancer Survival Cohort, a large-scale epidemiology study investigating mechanisms underlying the lung cancer.     

An Elementary Introduction to Maximum Likelihood Estimation for Multinomial Models: Birch's Theorem and the Delta Method

A fairly complete introduction to the large sample theory of parametric multinomial models, suitable for a second-year graduate course in categorical data analysis, can be based on Birch's theorem (1964) and the delta method (Bishop, Fienberg, and Holland 1975). I present an elementary derivation of a version of Birch's theorem using the implicit function theorem from advanced calculus, which allows the presentation to be relatively self-contained. The use of the delta method in deriving asymptotic distributions is illustrated by Rao's (1973) result on the distribution of standardized residuals, which complements the presentation in Bishop, Fienberg, and Holland. The asymptotic theory is illustrated by two examples.     

A test for equality of variances with censored samples

A variance homogeneity test for type II right-censored samples is proposed. The test is based on Bartlett's statistic. The asymptotic distribution of the statistic is investigated. The limiting distribution is that of a linear combination of i.i.d. chi-square variables with 1 degree of freedom. By using simulation, the critical values of the null distribution of the modified Bartlett's statistic for testing the homogeneity of variances of two normal populations are obtained when the sample sizes and censoring levels are not equal. Also, we investigate the properties of the proposed test (size, power and robustness). Results show that the distribution of the test statistic depends on the censoring level. An example of the use of the new methodology in animal science involving reproduction in ewes is provided.     

Laplace approximations to means and variances with asymptotic modes

The moment-generating function method, which is proposed by Tierney et al. [1989a. Fully exponential Laplace approximations to expectations and variances of nonpositive functions. J. Amer. Statist. Assoc. 84, 710–716], is an asymptotic technique of approximating a posterior mean of a general function by approximating the moment-generating function (MGF), and then differentiating it. In this article, we give approximations to the posterior means and variances by combining the MGF method and the Laplace approximations with asymptotic modes. We prove that asymptotic errors of the approximate means and variances are of order n^-2$n^{-2}$ and of order n^-3$n^{-3}$, respectively. Our approximation is closely related to a standard-form approximation, and is given without evaluating the exact posterior mode and third derivatives of the log-likelihood function. The MGF method also improves numerical instability of the fully exponential Laplace approximation for a predictive mean in logistic regression.     

A general procedure for deriving distributions

A general procedure for deriving the exact and asymptotic distributions of a certain class of test statistics in multivariate analysis is proposed. The method is based on an asymptotic expansion of gamma ratios in terms of generalized Bernoulli polynomials. The exact and asymptotic results are obtained and the method is illustrated in the problem of testing linear hypotheses in the multinomial case. In this problem the method yields Box's (1949) expansion as a special case.     

Empirical likelihood for parameters in an additive partially linear errors-in-variables model with longitudinal data

Empirical likelihood inferences for the parameter component in an additive partially linear errors-in-variables model with longitudinal data are investigated in this article. A corrected-attenuation block empirical likelihood procedure is used to estimate the regression coefficients, a corrected-attenuation block empirical log-likelihood ratio statistic is suggested and its asymptotic distribution is obtained. Compared with the method based on normal approximations, our proposed method does not require any consistent estimator for the asymptotic variance and bias. Simulation studies indicate that our proposed method performs better than the method based on normal approximations in terms of relatively higher coverage probabilities and smaller confidence regions. Furthermore, an example of an air pollution and health data set is used to illustrate the performance of the proposed method.     

Mixtures of Gaussian copula factor analyzers for clustering high dimensional data

Mixtures of factor analyzers is a useful model-based clustering method which can avoid the curse of dimensionality in high-dimensional clustering. However, this approach is sensitive to both diverse non-normalities of marginal variables and outliers, which are commonly observed in multivariate experiments. We propose mixtures of Gaussian copula factor analyzers (MGCFA) for clustering high-dimensional clustering. This model has two advantages; (1) it allows different marginal distributions to facilitate fitting flexibility of the mixture model, (2) it can avoid the curse of dimensionality by embedding the factor-analytic structure in the component-correlation matrices of the mixture distribution.An EM algorithm is developed for the fitting of MGCFA. The proposed method is free of the curse of dimensionality and allows any parametric marginal distribution which fits best to the data. It is applied to both synthetic data and a microarray gene expression data for clustering and shows its better performance over several existing methods.     

Multivariate regression models for discrete and continuous repeated measurements

A general class of multivariate regression models is considered for repeated measurements with discrete and continuous outcome variables. The proposed model is based on the seemingly unrelated regression model (Zellner, 1962) and an extension of the model of Park and Woolson(1992). The regression parameters of the model are consistently estimated using the two-stage least squares method. When the out come variables are multivariate normal, the two-stage estimator reduces to Zellner’s two-stage estimator. As a special case, we consider the marginal distribution described by Liang and Zeger (1986). Under this this distributional assumption, we show that the two-stage estimator has similar asymptotic properties and comparable small sample properties to Liang and Zeger's estimator. Since the proposed approach is based on the least squares method, however, any distributional assumption is not required for variables outcome variables. As a result, the proposed estimator is more robust to the marginal distribution of outcomes.     

Nonparametric Independence Screening in Sparse Ultra-High Dimensional Additive Models

A variable screening procedure via correlation learning was proposed in Fan and Lv (2008) to reduce dimensionality in sparse ultra-high dimensional models. Even when the true model is linear, the marginal regression can be highly nonlinear. To address this issue, we further extend the correlation learning to marginal nonparametric learning. Our nonparametric independence screening is called NIS, a specific member of the sure independence screening. Several closely related variable screening procedures are proposed. Under general nonparametric models, it is shown that under some mild technical conditions, the proposed independence screening methods enjoy a sure screening property. The extent to which the dimensionality can be reduced by independence screening is also explicitly quantified. As a methodological extension, a data-driven thresholding and an iterative nonparametric independence screening (INIS) are also proposed to enhance the finite sample performance for fitting sparse additive models. The simulation results and a real data analysis demonstrate that the proposed procedure works well with moderate sample size and large dimension and performs better than competing methods.     

Further Results on the Limiting Distribution of GMM Sample Moment Conditions

In this article, we examine the limiting behavior of generalized method of moments (GMM) sample moment conditions and point out an important discontinuity that arises in their asymptotic distribution. We show that the part of the scaled sample moment conditions that gives rise to degeneracy in the asymptotic normal distribution is T-consistent and has a nonstandard limiting distribution. We derive the appropriate asymptotic (weighted chi-squared) distribution when this degeneracy occurs and show how to conduct asymptotically valid statistical inference. We also propose a new rank test that provides guidance on which (standard or nonstandard) asymptotic framework should be used for inference. The finite-sample properties of the proposed asymptotic approximation are demonstrated using simulated data from some popular asset pricing models.     

Ultrastructural elliptical models

Dolby's (1976) ultrastructural model with no replications is investigated within the class of the elliptical distributions. General asymptotic results are given for the sample covariance matrix S in the presence of incidental parameters. These results are used to study the asymptotic behaviour of some estimators of the slope parameter, unifying and extending existing results in the literature. In particular, under some regularity conditions they are shown to be consistent and asymptotically normal. For the special case of the structural model, some asymptotic relative efficiencies are also reported which show that generalized least squares and the method of moment estimators can be highly inefficient under nonnormality.     

Empirical likelihood dimension reduction inference for partially non-linear error-in-responses models with validation data

ABSTRACT

In this article, partially non linear models when the response variable is measured with error and explanatory variables are measured exactly are considered. Without specifying any error structure equation, a semiparametric dimension reduction technique is employed. Two estimators of unknown parameter in non linear function are obtained and asymptotic normality is proved. In addition, empirical likelihood method for parameter vector is provided. It is shown that the estimated empirical log-likelihood ratio has asymptotic Chi-square distribution. A simulation study indicates that, compared with normal approximation method, empirical likelihood method performs better in terms of coverage probabilities and average length of the confidence intervals.     

Penalized proportion estimation for non parametric mixture of regressions

Abstract

In this article, we propose a penalized local log-likelihood method to locally select the number of components in non parametric finite mixture of regression models via proportion shrinkage method. Mean functions and variance functions are estimated simultaneously. We show that the number of components can be estimated consistently, and further establish asymptotic normality of functional estimates. We use a modified EM algorithm to estimate the unknown functions. Simulations are conducted to demonstrate the performance of the proposed method. We illustrate our method via an empirical analysis of the housing price index data of United States.     

Likelihood-Based Inference for Weak Exogeneity in I(2) Cointegrated VAR Models

This article develops limit theory for likelihood analysis of weak exogeneity in I(2) cointegrated vector autoregressive (VAR) models incorporating deterministic terms. Conditions for weak exogeneity in I(2) VAR models are reviewed, and the asymptotic properties of conditional maximum likelihood estimators and a likelihood-based weak exogeneity test are then investigated. It is demonstrated that weak exogeneity in I(2) VAR models allows us to conduct asymptotic conditional inference based on mixed Gaussian distributions. It is then proved that a log-likelihood ratio test statistic for weak exogeneity in I(2) VAR models is asymptotically χ² distributed. The article also presents an empirical illustration of the proposed test for weak exogeneity using Japan's macroeconomic data.