Data skeletons: simultaneous estimation of multiple quantiles for massive streaming datasets with applications to density estimation

We consider the problem of density estimation when the data is in the form of a continuous stream with no fixed length. In this setting, implementations of the usual methods of density estimation such as kernel density estimation are problematic. We propose a method of density estimation for massive datasets that is based upon taking the derivative of a smooth curve that has been fit through a set of quantile estimates. To achieve this, a low-storage, single-pass, sequential method is proposed for simultaneous estimation of multiple quantiles for massive datasets that form the basis of this method of density estimation. For comparison, we also consider a sequential kernel density estimator. The proposed methods are shown through simulation study to perform well and to have several distinct advantages over existing methods.     

改进的Gompertz模型参数估计方法比较研究

讨论改进的Gompertz模型两种参数估计方法:三和法和非线性最小二乘估计法,并通过蒙特卡洛实验比较两种估计方法的精度和收敛率,得出非线性最小二乘估计法在估计精度和估计的成功率两方面都优于三和法的结论;利用Gompertz曲线拟合中国电影票房数据并对其未来发展作出预测:中国电影票房最终可以在2025年左右到达饱和状态,饱和状态总规模大约为1 676.5亿元。     

Comparison of estimation methods for the Weibull distribution

Weibull distributions have received wide ranging applications in many areas including reliability, hydrology and communication systems. Many estimation methods have been proposed for Weibull distributions. But there has not been a comprehensive comparison of these estimation methods. Most studies have focused on comparing the maximum likelihood estimation (MLE) with one of the other approaches. In this paper, we first propose an L-moment estimator for the Weibull distribution. Then, a comprehensive comparison is made of the following methods: the method of maximum likelihood estimation (MLE), the method of logarithmic moments, the percentile method, the method of moments and the method of L-moments.     

Inference for Type II bivariate Pólya–Aeppli distribution

In this article, we discuss the estimation of model parameters of the Type II bivariate Pólya–Aeppli distribution using the method of moments and the maximum likelihood method. We also compare some interval estimation methods. We then carry out a Monte Carlo simulation study to evaluate the performance of the proposed point and interval estimation methods. Finally, we present an example to illustrate all the inferential methods developed here.     

A comparison of the parameter estimation methods for bimodal mixture Weibull distribution with complete data

Bimodal mixture Weibull distribution being a special case of mixture Weibull distribution has been used recently as a suitable model for heterogeneous data sets in many practical applications. The bimodal mixture Weibull term represents a mixture of two Weibull distributions. Although many estimation methods have been proposed for the bimodal mixture Weibull distribution, there is not a comprehensive comparison. This paper presents a detailed comparison of five kinds of numerical methods, such as maximum likelihood estimation, least-squares method, method of moments, method of logarithmic moments and percentile method (PM) in terms of several criteria by simulation study. Also parameter estimation methods are applied to real data.     

内生性随机前沿模型估计方法研究：无需工具变量的Copula方法

内生性是常见的计量问题，忽略内生性会导致估计量有偏且不一致。现有部分文献研究了内生性随机前沿模型的估计，但实现的前提是能够为内生性自变量寻找到合适的工具变量，而实际情况下合适的工具变量通常不容易获取。本文研究了在难以找到合适的工具变量的情况下内生性随机前沿模型的估计问题：结合Copula方法和极大模拟似然方法估计参数。此外，本文还构造了技术无效率的新的点估计，该点估计额外利用了内生自变量的信息，通常比JLMS法对应的点估计更有效。数值模拟表明，相比于已有研究，本文提出的方法估计精度更高。     

The Extent of Gross Errors Eliminated by Robust Multiple Linear Regressions

Robust estimation methods can effectively eliminate the influence of gross errors on parameter estimation. However, the extent of gross errors eliminated (EGEE) by robust estimation methods is far-reaching. This article presents a new approach to determine EGEE by robust estimation method. Taking multiple linear regressions (2–5) as examples, simulation experiments were conducted to compare the EGEE of 14 frequently used robust estimation methods. This article confirms several additional efficient robust estimation methods for dealing with multiple linear regressions, as well as the minimum number of observations needed to eliminate gross errors in certain ranges completely.     

Estimation for the Parameters of Generalized Half-normal Distribution Based on Progressive Type-I Interval Censoring

Based on progressively Type-I interval censored sample, the problem of estimating unknown parameters of a two parameter generalized half-normal(GHN) distribution is considered. Different methods of estimation are discussed. They include the maximum likelihood estimation, midpoint approximation method, approximate maximum likelihood estimation, method of moments, and estimation based on probability plot. Several Bayesian estimates with respect to different symmetric and asymmetric loss functions such as squared error, LINEX, and general entropy is calculated. The Lindley’s approximation method is applied to determine Bayesian estimates. Monte Carlo simulations are performed to compare the performances of the different methods. Finally, analysis is also carried out for a real dataset.     

稳健高维协方差矩阵估计及其投资组合应用——基于中心正则化算法

高维协方差矩阵的估计问题现已成为大数据统计分析中的基本问题,传统方法要求数据满足正态分布假定且未考虑异常值影响,当前已无法满足应用需要,更加稳健的估计方法亟待被提出。针对高维协方差矩阵,一种稳健的基于子样本分组的均值-中位数估计方法被提出且简单易行,然而此方法估计的矩阵并不具备正定稀疏特性。基于此问题,本文引进一种中心正则化算法,弥补了原始方法的缺陷,通过在求解过程中对估计矩阵的非对角元素施加L1范数惩罚,使估计的矩阵具备正定稀疏的特性,显著提高了其应用价值。在数值模拟中,本文所提出的中心正则稳健估计有着更高的估计精度,同时更加贴近真实设定矩阵的稀疏结构。在后续的投资组合实证分析中,与传统样本协方差矩阵估计方法、均值-中位数估计方法和RA-LASSO方法相比,基于中心正则稳健估计构造的最小方差投资组合收益率有着更低的波动表现。     

A new hybrid estimation method for the generalized pareto distribution

ABSTRACT

The generalized Pareto distribution (GPD) is important in the analysis of extreme values, especially in modeling exceedances over thresholds. Most of the existing methods for estimating the scale and shape parameters of the GPD suffer from theoretical and/or computational problems. A new hybrid estimation method is proposed in this article, which minimizes a goodness-of-fit measure and incorporates some useful likelihood information. Compared with the maximum likelihood method and other leading methods, our new hybrid estimation method retains high efficiency, reduces the estimation bias, and is computation friendly.     

Concerning several methods for estimating crop acreages using remote sensing data

The objective of this paper is to present a comprehensive survey of the proportion estimation methods so far found in the literature and a newly proposed method based on the concept of statistically equivalent blocks. All methods are restricted to the case of normal mixtures only. Graphical and semigraphical techniques are excluded. Several proportion estimation methods have been described and their properties discussed.     

分层抽样估计方法新探

The paper puts forward two ways of thinking on stratified sampling estimation, the longitudinal auto-egression and multi-compound estimation method. The longitudinal auto-regression method probes into estimate of population mean based on the linear regression relationship between the means of the strata under investigation and ancillary characteristics. The multi-compound estimation method estimates the means of the strata separately by different methods and the population parameter is taken from these estimates. The paper further analyses conditions for the application of these methods; estimates and their error term; advantages and disadvantages and other problems of the two problems.     

Estimation for the three-parameter gamma distribution based on progressively censored data

Some work has been done in the past on the estimation for the three-parameter gamma distribution based on complete and censored samples. In this paper, we develop estimation methods based on progressively Type-II censored samples from a three-parameter gamma distribution. In particular, we develop some iterative methods for the determination of the maximum likelihood estimates (MLEs) of all three parameters. It is shown that the proposed iterative scheme converges to the MLEs. In this context, we propose another method of estimation which is based on missing information principle and moment estimators. Simple alternatives to the above two methods are also suggested. The proposed estimation methods are then illustrated with a numerical example. We also consider the interval estimation based on large-sample theory and examine the actual coverage probabilities of these confidence intervals in case of small samples using a Monte Carlo simulation study.     

Using data augmentation to correct for non-ignorable non-response when surrogate data are available: an application to the distribution of hourly pay

Summary.  The paper develops a data augmentation method to estimate the distribution function of a variable, which is partially observed, under a non-ignorable missing data mechanism, and where surrogate data are available. An application to the estimation of hourly pay distributions using UK Labour Force Survey data provides the main motivation. In addition to considering a standard parametric data augmentation method, we consider the use of hot deck imputation methods as part of the data augmentation procedure to improve the robustness of the method. The method proposed is compared with standard methods that are based on an ignorable missing data mechanism, both in a simulation study and in the Labour Force Survey application. The focus is on reducing bias in point estimation, but variance estimation using multiple imputation is also considered briefly.     

Markov chain Monte Carlo methods for parameter estimation of the modified Weibull distribution

In this paper, the Markov chain Monte Carlo (MCMC) method is used to estimate the parameters of a modified Weibull distribution based on a complete sample. While maximum-likelihood estimation (MLE) is the most used method for parameter estimation, MCMC has recently emerged as a good alternative. When applied to parameter estimation, MCMC methods have been shown to be easy to implement computationally, the estimates always exist and are statistically consistent, and their probability intervals are convenient to construct. Details of applying MCMC to parameter estimation for the modified Weibull model are elaborated and a numerical example is presented to illustrate the methods of inference discussed in this paper. To compare MCMC with MLE, a simulation study is provided, and the differences between the estimates obtained by the two algorithms are examined.     

Nonparametric versus Parametric Estimation of the Cure Fraction Using Interval Censored Data

This article discusses estimation of the cure rate by means of the bounded cumulative hazard (BCH) model using interval censored data. The parametric and nonparametric estimation methods within the framework of the EM algorithm were employed for cure rate estimation and their results compared. The Turnbull estimator was used in the nonparametric estimation while in parametric method both the exponential and Weibull distributions were considered. We show via simulation that the nonparametric method is a viable alternative to the parametric one when the censoring rate is rapidly increasing.     

Empirical likelihood estimation for linear regression models with AR(p) error terms with numerical examples

Linear regression models are useful statistical tools to analyze data sets in different fields. There are several methods to estimate the parameters of a linear regression model. These methods usually perform under normally distributed and uncorrelated errors. If error terms are correlated the Conditional Maximum Likelihood (CML) estimation method under normality assumption is often used to estimate the parameters of interest. The CML estimation method is required a distributional assumption on error terms. However, in practice, such distributional assumptions on error terms may not be plausible. In this paper, we propose to estimate the parameters of a linear regression model with autoregressive error term using Empirical Likelihood (EL) method, which is a distribution free estimation method. A small simulation study is provided to evaluate the performance of the proposed estimation method over the CML method. The results of the simulation study show that the proposed estimators based on EL method are remarkably better than the estimators obtained from CML method in terms of mean squared errors (MSE) and bias in almost all the simulation configurations. These findings are also confirmed by the results of the numerical and real data examples.     

Simultaneous estimation for semi-parametric multi-index models

Estimation of a general multi-index model comprises determining the number of linear combinations of predictors (structural dimension) that are related to the response, estimating the loadings of each index vector, selecting the active predictors and estimating the underlying link function. These objectives are often achieved sequentially at different stages of the estimation process. In this study, we propose a unified estimation approach under a semi-parametric model framework to attain these estimation goals simultaneously. The proposed estimation method is more efficient and stable than many existing methods where the estimation error in the structural dimension may propagate to the estimation of the index vectors and variable selection stages. A detailed algorithm is provided to implement the proposed method. Comprehensive simulations and a real data analysis illustrate the effectiveness of the proposed method.     

Exponentiated Chen distribution: Properties and estimation

This article addresses various properties and estimation methods for the Exponentiated Chen distribution. Although, our main focus is on estimation from frequentist point of view, yet, some statistical and reliability characteristics for the model are derived. We briefly describe different estimation procedures, namely, the method of maximum likelihood estimation, percentile estimation, least square and weighted least-square estimation, maximum product of spacings estimation, Cramér-von-Mises estimation, Anderson–Darling, and right-tail Anderson–Darling estimation. Monte Carlo simulations are performed to compare the performances of the proposed methods of estimation for both small and large samples. Finally, the potentiality of the model is analyzed by means of three real datasets.     

问卷分割设计的模拟研究——小域估计的一种应用

针对长问卷存在无回答率和回答负担,从而导致统计调查精度降低的问题,采用问卷分割法解决该问题,并且通过小域估计的方法进行参数估计。模拟研究表明,利用小域估计方法对分割问卷进行参数估计显然优于用多重插补法进行参数估计。研究结果表明,运用小域估计方法对分割问卷进行参数估计,能显著提高统计调查的精度。