Estimating a uniform distribution when data are measured with a normal additive error with unknown variance

The problem of estimating the width of a symmetric uniform distribution on the line together with the error variance, when data are measured with normal additive error, is considered. The main purpose is to analyse the maximum-likelihood (ML) estimator and to compare it with the moment-method estimator. It is shown that this two-parameter model is regular so that the ML estimator is asymptotically efficient. Necessary and sufficient conditions are given for the existence of the ML estimator. As numerical problems are known to frequently occur while computing the ML estimator in this model, useful suggestions for computing the ML estimator are also given.     

Moving Average-Based Estimators of Integrated Variance

We examine moving average (MA) filters for estimating the integrated variance (IV) of a financial asset price in a framework where high-frequency price data are contaminated with market microstructure noise. We show that the sum of squared MA residuals must be scaled to enable a suitable estimator of IV. The scaled estimator is shown to be consistent, first-order efficient, and asymptotically Gaussian distributed about the integrated variance under restrictive assumptions. Under more plausible assumptions, such as time-varying volatility, the MA model is misspecified. This motivates an extensive simulation study of the merits of the MA-based estimator under misspecification. Specifically, we consider nonconstant volatility combined with rounding errors and various forms of dependence between the noise and efficient returns. We benchmark the scaled MA-based estimator to subsample and realized kernel estimators and find that the MA-based estimator performs well despite the misspecification.     

Comparative Study of Blu and ML Estimators of Location and Scale Parameters of an Extreme Value Distribution for Small Samples and Type I Censorship

The Maximum Likelihood (ML) and Best Linear Unbiased (BLU) estimators of the location and scale parameters of an extreme value distribution (Lawless [1982]) are compared under conditions of small sample sizes and Type I censorship. The comparisons were made in terms of the mean square error criterion. According to this criterion, the ML estimator of σ in the case of very small sample sizes (n < 10) and heavy censorship (low censoring time) proved to be more efficient than the corresponding BLU estimator. However, the BLU estimator for σ attains parity with the corresponding ML estimator when the censoring time increases even for sample sizes as low as 10. The BLU estimator of σ attains equivalence with the ML estimator when the sample size increases above 10, particularly when the censoring time is also increased. The situation is reversed when it came to estimating the location parameter μ, as the BLU estimator was found to be consistently more efficient than the ML estimator despite the improved performance of the ML estimator when the sample size increases. However, computational ease and convenience favor the ML estimators.     

Moving Average-Based Estimators of Integrated Variance

We examine moving average (MA) filters for estimating the integrated variance (IV) of a financial asset price in a framework where high-frequency price data are contaminated with market microstructure noise. We show that the sum of squared MA residuals must be scaled to enable a suitable estimator of IV. The scaled estimator is shown to be consistent, first-order efficient, and asymptotically Gaussian distributed about the integrated variance under restrictive assumptions. Under more plausible assumptions, such as time-varying volatility, the MA model is misspecified. This motivates an extensive simulation study of the merits of the MA-based estimator under misspecification. Specifically, we consider nonconstant volatility combined with rounding errors and various forms of dependence between the noise and efficient returns. We benchmark the scaled MA-based estimator to subsample and realized kernel estimators and find that the MA-based estimator performs well despite the misspecification.     

Asymptotic properties of the ols and grls estimator for the replicated functional relationship model

For the simple linear functional relationship model with replication, the asymptotic properties of the ordinary (OLS) and grouping least squares (GRLS) estimator of the slope are investi- gated under the assumption of normally distributed errors with unknown covariance matrix. The relative performance of the OLS and GRLS estimator is compared in terms of the asymptotic mean square error, and a set of critical parameters are identified for determining the dominance of one estimator over the other. It is also shown that the GRLS estimator is asymptoticallyequivalent to the maximum likelihood (ML) estimator under the given assumptions.     

Estimation of the SURE model

The paper presents the essentials of the SURE model and the estimation of its parameters β and ω. Two alternative compact representations of the model are being used. The parameter β is estimated by least squares (LS), generalized least squares (GLS) and maximum likelihood (ML) (under normality). For ω two estimators are being considered, viz an LS-related estimator and a maximum likelihood estimator (under normality). Attention is being given to the study of asymptotic properties of all estimators examined. It turns out that the LS-related and ML estimators of ω follow the same asymptotic (normal) distribution. Efficiency comparisons for the various estimators of β conclude the paper.     

Efficient Estimation of the PDF and the CDF of the Weibull Extension Model

The Weibull extension model is a useful extension of the Weibull distribution, allowing for bathtub shaped hazard rates among other things. Here, we consider estimation of the PDF and the CDF of the Weibull extension model. The following estimators are considered: uniformly minimum variance unbiased (UMVU) estimator, maximum likelihood (ML) estimator, percentile (PC) estimator, least squares (LS) estimator, and weighted least squares (WLS) estimator. Analytical expressions are derived for the bias and the mean squared error. Simulation studies and real data applications show that the ML estimator performs better than others.     

A comparison of LS/ML and GMM estimation in a simple AR(1) model

This paper compares least squares (LS)/maximum likelihood (ML) and generalised method of moments (GMM) estimation in a simple. Gaussian autoregressive of order one (AR(1)) model. First, we show that the usual LS/ML estimator is a corner solution to a general minimisation problem that involves two moment conditions, while the new GMM we devise is not. Secondly, we examine asymptotic and finite sample properties of the new GMM estimator in comparison to the usual LS/ML estimator in a simple AR(1) model. For both stable and unstable (unit root) specifications, we show asymptotic equivalence of the distributions of the two estimators. However, in finite samples, the new GMM estimator performs better.     

A Tobit Ridge Regression Estimator

This article analyzes the effects of multicollienarity on the maximum likelihood (ML) estimator for the Tobit regression model. Furthermore, a ridge regression (RR) estimator is proposed since the mean squared error (MSE) of ML becomes inflated when the regressors are collinear. To investigate the performance of the traditional ML and the RR approaches we use Monte Carlo simulations where the MSE is used as performance criteria. The simulated results indicate that the RR approach should always be preferred to the ML estimation method.     

Errors in variables: consistent adjusted least squares (cals) estimation

A single equation errors-in-variables model is considered. Exact restrictions on the parameters in the model are assumed to be available such that the model is just-identified. A Consistent Adjusted Least Squares (CALS) estimator for this model is proposed and its asymptotic distribution is given. Special cases are given as illustrations. CALS is identical to the Method of Moments (MM), and to Maximum Likelihood (ML) under the structural interpretation. Under the functional interpretation it is identical to ML in cases where the latter method is consistent.     

A two-parameter estimator in the negative binomial regression model

In this article, a two-parameter estimator is proposed to combat multicollinearity in the negative binomial regression model. The proposed two-parameter estimator is a general estimator which includes the maximum likelihood (ML) estimator, the ridge estimator (RE) and the Liu estimator as special cases. Some properties on the asymptotic mean-squared error (MSE) are derived and necessary and sufficient conditions for the superiority of the two-parameter estimator over the ML estimator and sufficient conditions for the superiority of the two-parameter estimator over the RE and the Liu estimator in the asymptotic mean-squared error (MSE) matrix sense are obtained. Furthermore, several methods and three rules for choosing appropriate shrinkage parameters are proposed. Finally, a Monte Carlo simulation study is given to illustrate some of the theoretical results.     

Estimation of time-varying coefficient dynamic panel data models

In this paper, we consider dynamic panel data models where the autoregressive parameter changes over time. We propose the GMM and ML estimators for this model. We conduct Monte Carlo simulation to compare the performance of these two estimators. The simulation results show that the ML estimator outperforms the GMM estimator.     

On the performance of some new Liu parameters for the gamma regression model

The maximum likelihood (ML) method is used to estimate the unknown Gamma regression (GR) coefficients. In the presence of multicollinearity, the variance of the ML method becomes overstated and the inference based on the ML method may not be trustworthy. To combat multicollinearity, the Liu estimator has been used. In this estimator, estimation of the Liu parameter d is an important problem. A few estimation methods are available in the literature for estimating such a parameter. This study has considered some of these methods and also proposed some new methods for estimation of the d. The Monte Carlo simulation study has been conducted to assess the performance of the proposed methods where the mean squared error (MSE) is considered as a performance criterion. Based on the Monte Carlo simulation and application results, it is shown that the Liu estimator is always superior to the ML and recommendation about which best Liu parameter should be used in the Liu estimator for the GR model is given.     

Empirical distribution function under heteroscedasticity

Neglecting heteroscedasticity of error terms may imply the wrong identification of a regression model (see appendix). Employment of (heteroscedasticity resistent) White's estimator of covariance matrix of estimates of regression coefficients may lead to the correct decision about the significance of individual explanatory variables under heteroscedasticity. However, White's estimator of covariance matrix was established for least squares (LS)-regression analysis (in the case when error terms are normally distributed, LS- and maximum likelihood (ML)-analysis coincide and hence then White's estimate of covariance matrix is available for ML-regression analysis, tool). To establish White's-type estimate for another estimator of regression coefficients requires Bahadur representation of the estimator in question, under heteroscedasticity of error terms. The derivation of Bahadur representation for other (robust) estimators requires some tools. As the key too proved to be a tight approximation of the empirical distribution function (d.f.) of residuals by the theoretical d.f. of the error terms of the regression model. We need the approximation to be uniform in the argument of d.f. as well as in regression coefficients. The present paper offers this approximation for the situation when the error terms are heteroscedastic.     

The Consistency of Estimators in Finite Mixture Models

The parameters of a finite mixture model cannot be consistently estimated when the data come from an embedded distribution with fewer components than that being fitted, because the distribution is represented by a subset in the parameter space, and not by a single point. Feng & McCulloch (1996) give conditions, not easily verified, under which the maximum likelihood (ML) estimator will converge to an arbitrary point in this subset. We show that the conditions can be considerably weakened. Even though embedded distributions may not be uniquely represented in the parameter space, estimators of quantities of interest, like the mean or variance of the distribution, may nevertheless actually be consistent in the conventional sense. We give an example of some practical interest where the ML estimators are root of n -consistent.
Similarly consistent statistics can usually be found to test for a simpler model vs a full model. We suggest a test statistic suitable for a general class of model and propose a parameter-based bootstrap test, based on this statistic, for when the simpler model is correct.     

Efficient Estimation of the PDF and the CDF of the Exponentiated Gumbel Distribution

The exponentiated Gumbel model has been shown to be useful in climate modeling including global warming problem, flood frequency analysis, offshore modeling, rainfall modeling, and wind speed modeling. Here, we consider estimation of the probability density function (PDF) and the cumulative distribution function (CDF) of the exponentiated Gumbel distribution. The following estimators are considered: uniformly minimum variance unbiased (UMVU) estimator, maximum likelihood (ML) estimator, percentile (PC) estimator, least-square (LS) estimator, and weighted least-square (WLS) estimator. Analytical expressions are derived for the bias and the mean squared error. Simulation studies and real data applications show that the ML estimator performs better than others.     

A robust closed-form estimator for the GARCH(1,1) model

In this paper we extend the closed-form estimator for the generalized autoregressive conditional heteroscedastic (GARCH(1,1)) proposed by Kristensen and Linton [A closed-form estimator for the GARCH(1,1) model. Econom Theory. 2006;22:323–337] to deal with additive outliers. It has the advantage that is per se more robust that the maximum likelihood estimator (ML) often used to estimate this model, it is easy to implement and does not require the use of any numerical optimization procedure. The robustification of the closed-form estimator is done by replacing the sample autocorrelations by a robust estimator of these correlations and by estimating the volatility using robust filters. The performance of our proposal in estimating the parameters and the volatility of the GARCH(1,1) model is compared with the proposals existing in the literature via intensive Monte Carlo experiments and the results of these experiments show that our proposal outperforms the ML and quasi-maximum likelihood estimators-based procedures. Finally, we fit the robust closed-form estimator and the benchmarks to one series of financial returns and analyse their performances in estimating and forecasting the volatility and the value-at-risk.     

Functional time series approach for forecasting very short-term electricity demand

This empirical paper presents a number of functional modelling and forecasting methods for predicting very short-term (such as minute-by-minute) electricity demand. The proposed functional methods slice a seasonal univariate time series (TS) into a TS of curves; reduce the dimensionality of curves by applying functional principal component analysis before using a univariate TS forecasting method and regression techniques. As data points in the daily electricity demand are sequentially observed, a forecast updating method can greatly improve the accuracy of point forecasts. Moreover, we present a non-parametric bootstrap approach to construct and update prediction intervals, and compare the point and interval forecast accuracy with some naive benchmark methods. The proposed methods are illustrated by the half-hourly electricity demand from Monday to Sunday in South Australia.     

Oracle GMM estimation for misspecified models via thresholding

We propose a thresholding generalized method of moments (GMM) estimator for misspecified time series moment condition models. This estimator has the following oracle property: its asymptotic behavior is the same as of any efficient GMM estimator obtained under the a priori information that the true model were known. We propose data adaptive selection methods for thresholding parameter using multiple testing procedures. We determine the limiting null distributions of classical parameter tests and show the consistency of the corresponding block-bootstrap tests used in conjunction with thresholding GMM inference. We present the results of a simulation study for a misspecified instrumental variable regression model and for a vector autoregressive model with measurement error. We illustrate an application of the proposed methodology to data analysis of a real-world dataset.     

Maximum likelihood revisited under a semi-parametric context - estimation of the tail index

In this paper, and in a context of regularly varying tails, we study computationally the classical Maximum Likelihood (ML) estimator based on the Paretian behaviour of the excesses over a high threshold, denoted PML-estimator, a type II Censoring estimator based specifically on a Fréchet parent, denoted CENS-estimator, and two ML estimators based on the scaled log-spacings, and denoted SLS-estimators. These estimators are considered under a semi-parametric set-up, and compared with the classical Hill estimator and a Generalized Jackknife (GJ) estimator, which has essentially in mind a reduction of the bias of Hill's estimator.