Estimation of odds ratios under order restrictions

A new method for estimating a set of odds ratios under an order restriction based on estimating equations is proposed. The method is applied to those of the conditional maximum likelihood estimators and the Mantel-Haenszel estimators. The estimators derived from the conditional likelihood estimating equations are shown to maximize the conditional likelihoods. It is also seen that the restricted estimators converge almost surely to the respective odds ratios when the respective sample sizes become large regularly. The restricted estimators are compared with the unrestricted maximum likelihood estimators by a Monte Carlo simulation. The simulation studies show that the restricted estimates improve the mean squared errors remarkably, while the Mantel-Haenszel type estimates are competitive with the conditional maximum likelihood estimates, being slightly worse.     

Semiparametric Estimation of Stochastic Production Frontier Models

This article extends the linear stochastic frontier model proposed by Aigner, Lovell, and Schmidt to a semiparametric frontier model in which the functional form of the production frontier is unspecified and the distributions of the composite error terms are of known form. Pseudolikelihood estimators of the parameters characterizing the two error terms of the model are constructed based on kernel estimation of the conditional mean function. The Monte Carlo results show that the proposed estimators perform well in finite samples. An empirical application is presented. Extensions to a partially linear frontier function and to more flexible one-sided error distributions than the half-normal are discussed     

Estimation of parameters of the gamma distribution in the presence of outliers

The maximum likelihood estimators and moment estimators are derived for samples from the Gamma distribution in the presence of outliers. These estimators are compared empirically when all the three parameters are unknown and when one of the three parameters is known; their bias and mean square error (MSE) are investigated with the help of numerical technique.     

真实固定效应空间随机前沿模型的贝叶斯估计

忽略个体效应和空间效应会严重干扰效率测算,其中忽略个体效应使得技术无效率项发生偏移,忽略空间相关性导致估计量有偏且不一致。本文基于真实固定效应随机前沿模型（引入了个体效应）,引入因变量和双边误差项的空间滞后项,构建了适用性更佳的真实固定效应空间随机前沿模型。对模型进行组内变化以消除额外参数,使用贝叶斯方法（需推导未知参数的后验分布并执行MCMC抽样）估计参数和技术效率。该方法真正克服了额外参数问题,比同类方法直观、简便。数值模拟结果表明,本文方法对参数、个体截距项及技术无效率项的估计精度均较高,且增加样本容量,估计精度变优。     

Fitting Variance Components Model and Fixed Effects Model for One-Way Analysis of Variance to Complex Survey Data

Under complex survey sampling, in particular when selection probabilities depend on the response variable (informative sampling), the sample and population distributions are different, possibly resulting in selection bias. This article is concerned with this problem by fitting two statistical models, namely: the variance components model (a two-stage model) and the fixed effects model (a single-stage model) for one-way analysis of variance, under complex survey design, for example, two-stage sampling, stratification, and unequal probability of selection, etc. Classical theory underlying the use of the two-stage model involves simple random sampling for each of the two stages. In such cases the model in the sample, after sample selection, is the same as model for the population; before sample selection. When the selection probabilities are related to the values of the response variable, standard estimates of the population model parameters may be severely biased, leading possibly to false inference. The idea behind the approach is to extract the model holding for the sample data as a function of the model in the population and of the first order inclusion probabilities. And then fit the sample model, using analysis of variance, maximum likelihood, and pseudo maximum likelihood methods of estimation. The main feature of the proposed techniques is related to their behavior in terms of the informativeness parameter. We also show that the use of the population model that ignores the informative sampling design, yields biased model fitting.     

A Comparison Between Maximum Likelihood and Bayesian Estimation of Stochastic Frontier Production Models

In this paper, the finite sample properties of the maximum likelihood and Bayesian estimators of the half-normal stochastic frontier production function are analyzed and compared through a Monte Carlo study. The results show that the Bayesian estimator should be used in preference to the maximum likelihood owing to the fact that the mean square error performance is substantially better in the Bayesian framework.     

Bayesian,MLE, and GMM Estimation of a Spot Rate Model

ABSTRACT

We develop Markov chain Monte Carlo algorithms for estimating the parameters of the short-term interest rate model. Using Monte Carlo experiments we compare the Bayes estimators with the maximum likelihood and generalized method of moments estimators. We estimate the model using the Japanese overnight call rate data.     

Weighted exponential distribution: properties and different methods of estimation

In this article, we investigate various properties and methods of estimation of the Weighted Exponential distribution. Although, our main focus is on estimation (from both frequentist and Bayesian point of view) yet, the stochastic ordering, the Bonferroni and the Lorenz curves, various entropies and order statistics are derived first time for the said distribution. Different types of loss functions are considered for Bayesian estimation. Furthermore, the Bayes estimators and their respective posterior risks are computed and compared using Gibbs sampling. The different reliability characteristics including hazard function, stress and strength analysis, and mean residual life function are also derived. Monte Carlo simulations are performed to compare the performances of the proposed methods of estimation and two real data sets have been analysed for illustrative purposes.     

Efficient Estimation of Fixed and Time-varying Covariate Effects in Multiplicative Intensity Models

The proportional hazards assumption of the Cox model does sometimes not hold in practise. An example is a treatment effect that decreases with time. We study a general multiplicative intensity model allowing the influence of each covariate to vary non-parametrically with time. An efficient estimation procedure for the cumulative parameter functions is developed. Its properties are studied using the martingale structure of the problem. Furthermore, we introduce a partly parametric version of the general non-parametric model in which the influence of some of the covariates varies with time while the effects of the remaining covariates are constant. This semiparametric model has not been studied in detail before. An efficient procedure for estimating the parametric as well as the non-parametric components of this model is developed. Again the martingale structure of the model allows us to describe the asymptotic properties of the suggested estimators. The approach is applied to two different data sets, and a Monte Carlo simulation is presented.     

有测量误差时空间自回归模型的估计与检验

近年来运用空间计量经济模型进行实证分析的文献都普遍采用空间自回归(SAR)形式的设定,对参数的估计也多采用极大似然(MLE)的方法。在经典多元线性回归模型中,仅有被解释变量的测量误差并不会影响系数估计的一致性。本文证明对于SAR模型,即使仅当被解释变量存在测量误差时,且无论该测量误差是否与模型本身的扰动项相关,普遍采用的MLE都将是不一致的。为此,Hausman型的设定检验被推广到SAR模型中用以判别是否存在被解释变量的测量误差。当零假设被拒绝时,我们说明由Kelejian&Prucha(1998), Lee(2003)提出的二阶段最小二乘法仍然可以得到参数的一致估计。Monte Carlo模拟的结果与我们的理论预期一致。最后我们用一个估计地方环境支出外溢效应的实例说明如何运用本文所提的方法来检验应用空间自回归模型时可能存在的测量误差。     

Admissible Estimation for Linear Combination of Fixed and Random Effects in General Mixed Linear Models

The general mixed linear model can be denoted by y  =  X β +  Z u  +  e , where β is a vector of fixed effects, u is a vector of random effects, and e is a vector of random errors. In this article, the problem of admissibility of Q y and Q y  +  q for estimating linear functions, ? =  L ′β +  M ′ u , of the fixed and random effects is considered, and the necessary and sufficient conditions for Q y (resp. Q y  +  q ) to be admissible in the set of homogeneous (resp. potentially inhomogeneous) linear estimators with respect to the MSE and MSEM criteria are investigated. We provide a straightforward alternative proof to the method that was utilized by Wu (1988 Wu , Q. G. ( 1988 ). Several results on admissibility of a linear estimate of stochastic regression coefficients and parameters . Acta Mathemaica Applicatae Sinica 11 ( 1 ): 95 – 106 . (in Chinese)  [Google Scholar]), Baksalary and Markiewicz (1990 Baksalary , J. K. , Markiewicz , A. ( 1990 ). Admissible linear estimators of an arbitrary vector of parametric functions in the general Gauss–Markov model . J. Stat. Plann. Infer. 26 : 161 – 171 . [Google Scholar]), and Groß and Markiewicz (1999 Groß , J. , Markiewicz , A. ( 1999 ). On admissibility of linear estimators with respect to the mean square error matrix criterion under the general mixed linear model . Statistics 33 : 57 – 71 .[Taylor & Francis Online] , [Google Scholar]). In addition, we derive the corresponding results on the admissibility problem under the generalized MSE criterion.     

Variable Selection in Joint Location and Scale Models of the Skew-t-Normal Distribution

Variable selection is an important issue in all regression analysis, and in this article, we investigate the simultaneous variable selection in joint location and scale models of the skew-t-normal distribution when the dataset under consideration involves heavy tail and asymmetric outcomes. We propose a unified penalized likelihood method which can simultaneously select significant variables in the location and scale models. Furthermore, the proposed variable selection method can simultaneously perform parameter estimation and variable selection in the location and scale models. With appropriate selection of the tuning parameters, we establish the consistency and the oracle property of the regularized estimators. These estimators are compared by simulation studies.     

Large Deviation Results for Statistics of Short- and Long-memory Gaussian Processes

This paper discusses the large deviation principle of several important statistics for short- and long-memory Gaussian processes. First, large deviation theorems for the log-likelihood ratio and quadratic forms for a short-memory Gaussian process with mean function are proved. Their asymptotics are described by the large deviation rate functions. Since they are complicated, they are numerically evaluated and illustrated using the Maple V system (Char et al ., 1991a,b). Second, the large deviation theorem of the log-likelihood ratio statistic for a long-memory Gaussian process with constant mean is proved. The asymptotics of the long-memory case differ greatly from those of the short-memory case. The maximum likelihood estimator of a spectral parameter for a short-memory Gaussian stationary process is asymptotically efficient in the sense of Bahadur.     

Efficiency and Validity Analyses of Two-Stage Estimation Procedures and Derived Testing Procedures in Quantitative Linear Models with AR(1) Errors

Abstract

In a quantitative linear model with errors following a stationary Gaussian, first-order autoregressive or AR(1) process, Generalized Least Squares (GLS) on raw data and Ordinary Least Squares (OLS) on prewhitened data are efficient methods of estimation of the slope parameters when the autocorrelation parameter of the error AR(1) process, ρ, is known. In practice, ρ is generally unknown. In the so-called two-stage estimation procedures, ρ is then estimated first before using the estimate of ρ to transform the data and estimate the slope parameters by OLS on the transformed data. Different estimators of ρ have been considered in previous studies. In this article, we study nine two-stage estimation procedures for their efficiency in estimating the slope parameters. Six of them (i.e., three noniterative, three iterative) are based on three estimators of ρ that have been considered previously. Two more (i.e., one noniterative, one iterative) are based on a new estimator of ρ that we propose: it is provided by the sample autocorrelation coefficient of the OLS residuals at lag 1, denoted r(1). Lastly, REstricted Maximum Likelihood (REML) represents a different type of two-stage estimation procedure whose efficiency has not been compared to the others yet. We also study the validity of the testing procedures derived from GLS and the nine two-stage estimation procedures. Efficiency and validity are analyzed in a Monte Carlo study. Three types of explanatory variable x in a simple quantitative linear model with AR(1) errors are considered in the time domain: Case 1, x is fixed; Case 2, x is purely random; and Case 3, x follows an AR(1) process with the same autocorrelation parameter value as the error AR(1) process. In a preliminary step, the number of inadmissible estimates and the efficiency of the different estimators of ρ are compared empirically, whereas their approximate expected value in finite samples and their asymptotic variance are derived theoretically. Thereafter, the efficiency of the estimation procedures and the validity of the derived testing procedures are discussed in terms of the sample size and the magnitude and sign of ρ. The noniterative two-stage estimation procedure based on the new estimator of ρ is shown to be more efficient for moderate values of ρ at small sample sizes. With the exception of small sample sizes, REML and its derived F-test perform the best overall. The asymptotic equivalence of two-stage estimation procedures, besides REML, is observed empirically. Differences related to the nature, fixed or random (uncorrelated or autocorrelated), of the explanatory variable are also discussed.