New shrinkage-type estimators in a linear regression model when multicollinearity is severe

For the linear regression model y=Xβ+e with severe multicollinearity, we put forward three shrinkage-type estimators based on the ordinary least-squares estimator including two types of independent factor estimators and a seemingly convex combination. The simulation study shows that the new estimators are not good enough when multicollinearity is mild to moderate, but perform very well when multicollinearity is severe to very severe.     

An extension of Franklin's randomized response technique for multi-proportions

ABSTRACT

In this article, we introduce six estimators, three based on row averages and the remaining three on column averages of population proportions for trichotomous population when randomized response sampling with a normal randomizing distribution is used. The estimators have been obtained using the method of moments. All the proposed estimators are shown to be unbiased and their variances have been worked out. The percent relative efficiencies of the column total based estimators with respect to row total based estimators are investigated through empirical study.     

On mitigating collinearity through mixtures

In linear models having near collinear columns of X, ridge and surrogate estimators often are used to mitigate collinearity. A new class of estimators is based on mixtures, either of X and a design minimal in an ordered class or of the Fisher information and a scalar matrix. Comparisons are drawn among choices for the mixing parameter, and the estimators are found to be admissible relative to ordinary least squares. Case studies demonstrate that selected mixture designs are perturbed from the original design to a lesser extent than are those of the surrogate method, while retaining reasonable efficiency characteristics.     

Modified regression estimators using robust regression methods and covariance matrices in stratified random sampling

Abstract

This article proposes new regression-type estimators by considering Tukey-M, Hampel M, Huber MM, LTS, LMS and LAD robust methods and MCD and MVE robust covariance matrices in stratified sampling. Theoretically, we obtain the mean square error (MSE) for these estimators. We compare the efficiencies based on MSE equations, between the proposed estimators and the traditional combined and separate regression estimators. As a result of these comparisons, we observed that our proposed estimators give more efficient results than traditional approaches. And, these theoretical results are supported with the aid of numerical examples and simulation based on data sets that include outliers.     

Estimation of parameters of SDE driven by fractional Brownian motion with polynomial drift

ABSTRACT

Strongly consistent and asymptotically normal estimators of the Hurst index and volatility parameters of solutions of stochastic differential equations with polynomial drift are proposed. The estimators are based on discrete observations of the underlying processes.     

Best linear unbiased and invariant estimation in location-scale families based on double-ranked set sampling

Abstract

In this article, we propose the best linear unbiased estimators (BLUEs) and best linear invariant estimators (BLIEs) for the unknown parameters of location-scale family of distributions based on double-ranked set sampling (DRSS) using perfect and imperfect rankings. These estimators are then compared with the BLUEs and BLIEs based on ranked set sampling (RSS). It is shown that under perfect ranking, the proposed estimators are uniformly better than the BLUEs and BLIEs obtained via RSS. We also propose the best linear unbiased quantile (BLUQ) and the best linear invariant quantile (BLIQ) estimators for normal distribution under DRSS. It is observed that the proposed quantile estimators are more efficient than the BLUQ and BLIQ estimators based on RSS for both perfect and imperfect orderings.     

Estimation of the Generalized Lambda Distribution Parameters for Grouped Data

Abstract

In this article we consider the problem of fitting a five-parameter generalization of the lambda distribution to data given in the form of a grouped frequency table. The estimation of parameters is done by six different procedures: percentiles, moments, probability-weighted moments, minimum Cramér-Von Mises, maximum likelihood, and pseudo least squares. These methods are evaluated and compared using a Monte Carlo study where the parent populations were generalized lambda distribution (GLD) approximations of Normal, Beta, Gamma random variables, and for nine combinations of sample sizes and number of classes. Of the estimators analyzed it is concluded that, although the method of pseudo least squares suffers from a number of limitations, it appears to be the candidate procedure to estimate the parameters of a GLD from grouped data.     

An asymptotic equivalence of the cross-data and predictive estimators

Abstract

Estimators using multiplicative tuning parameters for maximum likelihood estimators in cross-validation are called cross-data estimators in this paper. Single-sample versions of the cross-data estimators have been called predictive estimators in literatures, which are given by maximizing the expected log-likelihood, where the two-fold expectations are taken over the distributions of future and current data using maximum likelihood estimators based on current data. An asymptotic equivalence of the cross-data and predictive estimators is shown, which guarantees an optimality of the predictive estimator when an unknown population parameter vector is replaced by the sample counterpart. Examples using typical statistical distributions are shown.     

Two new estimators of entropy for testing normality

ABSTRACT

We present two new estimators for estimating the entropy of absolutely continuous random variables. Some properties of them are considered, specifically consistency of the first is proved. The introduced estimators are compared with the existing entropy estimators. Also, we propose two new tests for normality based on the introduced entropy estimators and compare their powers with the powers of other tests for normality. The results show that the proposed estimators and test statistics perform very well in estimating entropy and testing normality. A real example is presented and analyzed.     

Asymptotics in the β-model for networks with a differentially private degree sequence

Abstract

The β-model is a natural model for characterizing the degree heterogeneity that widely exists in the network data. The estimators of the model parameters in the differentially private β-model with the denoised process have been shown to be consistent and asymptotically normal. In this paper, we show that the moment estimators of the parameters based on the differentially private degree sequence without the denoised process is consistent and asymptotically normal.     

ESTIMATION OF EXPONENTIATED WEIBULL SHAPE PARAMETERS UNDER LINEX LOSS FUNCTION

ABSTRACT

The paper deals with Bayes estimation of the exponentiated Weibull shape parameters under linex loss function when independent non-informative type of priors are available for the parameters. Generalized maximum likelihood estimators have also been obtained. Performances of the proposed Bayes estimator, generalized maximum likelihood estimators, posterior mean (i.e., Bayes estimator under squared error loss function) and maximum likelihood estimators have been studied on the basis of their risks under linex loss function. The comparison is based on a simulation study because the expressions for risk functions of these estimators cannot be obtained in nice closed forms.     

Maximum likelihood revisited under a semi-parametric context - estimation of the tail index

In this paper, and in a context of regularly varying tails, we study computationally the classical Maximum Likelihood (ML) estimator based on the Paretian behaviour of the excesses over a high threshold, denoted PML-estimator, a type II Censoring estimator based specifically on a Fréchet parent, denoted CENS-estimator, and two ML estimators based on the scaled log-spacings, and denoted SLS-estimators. These estimators are considered under a semi-parametric set-up, and compared with the classical Hill estimator and a Generalized Jackknife (GJ) estimator, which has essentially in mind a reduction of the bias of Hill's estimator.     

Inference for IZAWA’S Bivariate Gamma Distribution

Abstract

In this article, we aim to establish some theoretical properties of Izawa’s bivariate gamma distribution having equal shape parameters. First, we propose a procedure to obtain the maximum likelihood estimates and derive an expression for the Fisher information. Simulation studies illuminate the properties of maximum likelihood estimators. We also establish an asymptotic test for independence based on the limiting distribution of maximum likelihood estimators.     

HAZARD RATE ESTIMATION FOR CENSORED DATA BY WAVELET METHODS

ABSTRACT

We study the estimation of a hazard rate function based on censored data by non-linear wavelet method. We provide an asymptotic formula for the mean integrated squared error (MISE) of nonlinear wavelet-based hazard rate estimators under randomly censored data. We show this MISE formula, when the underlying hazard rate function and censoring distribution function are only piecewise smooth, has the same expansion as analogous kernel estimators, a feature not available for the kernel estimators. In addition, we establish an asymptotic normality of the nonlinear wavelet estimator.     

Non-parametric estimation of copula based mutual information

Abstract

Mutual information is a measure for investigating the dependence between two random variables. The copula based estimation of mutual information reduces the complexity because it is depend only on the copula density. We propose two estimators and discuss the asymptotic properties. To compare the performance of the estimators a simulation study is carried out. The methods are illustrated using real data sets.     

Estimation of ratio of population means in two-occasion successive sampling

ABSTRACT

This article considers the problem of estimation of the ratio of population means at the current occasion based on the samples selected over two occasions. Using auxiliary information on both the occasions, some classes of estimators have been proposed. Properties of the proposed estimators have been studied and their respective optimum replacement strategies are discussed. The gains in efficiency of the proposed classes of estimators over the direct estimator where no past information is used are computed. Theoretical results have been interpreted through empirical studies which are followed by suitable recommendations.     

Estimator Choice and Fisher's Paradox: A Monte Carlo Study

Abstract

This paper argues that Fisher's paradox can be explained away in terms of estimator choice. We analyse by means of Monte Carlo experiments the small sample properties of a large set of estimators (including virtually all available single-equation estimators), and compute the critical values based on the empirical distributions of the t-statistics, for a variety of Data Generation Processes (DGPs), allowing for structural breaks, ARCH effects etc. We show that precisely the estimators most commonly used in the literature, namely OLS, Dynamic OLS (DOLS) and non-prewhitened FMLS, have the worst performance in small samples, and produce rejections of the Fisher hypothesis. If one employs the estimators with the most desirable properties (i.e., the smallest downward bias and the minimum shift in the distribution of the associated t-statistics), or if one uses the empirical critical values, the evidence based on US data is strongly supportive of the Fisher relation, consistently with many theoretical models.     

Lasso with convex loss: Model selection consistency and estimation

Abstract

Variable selection is a fundamental challenge in statistical learning if one works with data sets containing huge amount of predictors. In this artical we consider procedures popular in model selection: Lasso and adaptive Lasso. Our goal is to investigate properties of estimators based on minimization of Lasso-type penalized empirical risk with a convex loss function, in particular nondifferentiable. We obtain theorems concerning rate of convergence in estimation, consistency in model selection and oracle properties for Lasso estimators if the number of predictors is fixed, i.e. it does not depend on the sample size. Moreover, we study properties of Lasso and adaptive Lasso estimators on simulated and real data sets.     

Regression model with elliptically contoured errors

For the regression model y=X β+ε where the errors follow the elliptically contoured distribution, we consider the least squares, restricted least squares, preliminary test, Stein-type shrinkage and positive-rule shrinkage estimators for the regression parameters, β.

We compare the quadratic risks of the estimators to determine the relative dominance properties of the five estimators.     

Some calibration estimators for finite population mean in two-stage stratified random sampling

Abstract

In the present article, an effort has been made to develop calibration estimators of the population mean under two-stage stratified random sampling design when auxiliary information is available at primary stage unit (psu) level. The properties of the developed estimators are derived in-terms of design based approximate variance and approximate consistent design based estimator of the variance. Some simulation studies have been conducted to investigate the relative performance of calibration estimator over the usual estimator of the population mean without using auxiliary information in two-stage stratified random sampling. Proposed calibration estimators have outperformed the usual estimator without using auxiliary information.