Gamma mixture of generalized error distribution

Abstract

A new symmetric heavy-tailed distribution, namely gamma mixture of generalized error distribution is defined by scaling generalized error distribution with gamma distribution, its probability density function, k-moment, skewness and kurtosis are derived. After tedious calculation, we also give the Fisher information matrix, moment estimators and maximum likelihood estimators for the parameters of gamma mixture of generalized error distribution. In order to evaluate the effectiveness of the point estimators and the stability of Fisher information matrix, extensive simulation experiments are carried out in three groups of parameters. Additionally, the new distribution is applied to Apple Inc. stock (AAPL) data and compared with normal distribution, F-S skewed standardized t distribution and generalized error distribution. It is found that the new distribution has better fitting effect on the data under the Akaike information criterion (AIC). To a certain extent, our results enrich the probability distribution theory and develop the scale mixture distribution, which will provide help and reference for financial data analysis.     

Estimation of entropy-type integral functionals

ABSTRACT

Entropy-type integral functionals of densities are widely used in mathematical statistics, information theory, and computer science. Examples include measures of closeness between distributions (e.g., density power divergence) and uncertainty characteristics for a random variable (e.g., Rényi entropy). In this paper, we study U-statistic estimators for a class of such functionals. The estimators are based on ε-close vector observations in the corresponding independent and identically distributed samples. We prove asymptotic properties of the estimators (consistency and asymptotic normality) under mild integrability and smoothness conditions for the densities. The results can be applied in diverse problems in mathematical statistics and computer science (e.g., distribution identification problems, approximate matching for random databases, two-sample problems).     

ASYMPTOTIC PROPERTIES FOR MAXIMUM LIKELIHOOD ESTIMATORS FOR RELIABILITY AND FAILURE RATES OF MARKOV CHAINS

ABSTRACT

In this paper, we shall study a homogeneous ergodic, finite state, Markov chain with unknown transition probability matrix. Starting from the well known maximum likelihood estimator of transition probability matrix, we define estimators of reliability and its measurements. Our aim is to show that these estimators are uniformly strongly consistent and converge in distribution to normal random variables. The construction of the confidence intervals for availability, reliability, and failure rates are also given. Finally we shall give a numerical example for illustration and comparing our results with the usual empirical estimator results.     

Some simple estimators for the two-parameter gamma distribution

ABSTRACT

In this paper, we propose two new simple estimation methods for the two-parameter gamma distribution. The first one is a modified version of the method of moments, whereas the second one makes use of some key properties of the distribution. We then derive the asymptotic distributions of these estimators. Also, bias-reduction methods are suggested to reduce the bias of these estimators. The performance of the estimators are evaluated through a Monte Carlo simulation study. The probability coverages of confidence intervals are also discussed. Finally, two examples are used to illustrate the proposed methods.     

Inverse probability weighted estimators for single-index models with missing covariates

Abstract

In this article, we consider the inverse probability weighted estimators for a single-index model with missing covariates when the selection probabilities are known or unknown. It is shown that the estimator for the index parameter by using estimated selection probabilities has a smaller asymptotic variance than that with true selection probabilities, thus is more efficient. Therefore, the important Horvitz-Thompson property is verified for the index parameter in single index model. However, this difference disappears for the estimators of the link function. Some numerical examples and a real data application are also conducted to illustrate the performances of the estimators.     

Discrete associated kernels method and extensions

Discrete kernel estimation of a probability mass function (p.m.f.), often mentioned in the literature, has been far less investigated in comparison with continuous kernel estimation of a probability density function (p.d.f.). In this paper, we are concerned with a general methodology of discrete kernels for smoothing a p.m.f. f. We give a basic of mathematical tools for further investigations. First, we point out a generalizable notion of discrete associated kernel which is defined at each point of the support of f and built from any parametric discrete probability distribution. Then, some properties of the corresponding estimators are shown, in particular pointwise and global (asymptotical) properties. Other discrete kernels are constructed from usual discrete probability distributions such as Poisson, binomial and negative binomial. For small samples sizes, underdispersed discrete kernel estimators are more interesting than the empirical estimator; thus, an importance of discrete kernels is illustrated. The choice of smoothing bandwidth is classically investigated according to cross-validation and, novelly, to excess of zeros methods. Finally, a unification way of this method concerning the general probability function is discussed.     

A zero frequency alternative method to the moment method of estimation in finite poisson mixtures

The method of moments (MM) has been widely used for parametric estimation, as it is often computationally simple. Our interest focuses on the case of finite Poisson mixtures. The inefficiency of the method of moments relative to the Maximum Likelihood (ML) method is studied. Both the asymptotic efficiency as well as the small sample efficiency is examined. The case of samples that fail to lead to MM estimates is also considered. The results discourage the use of the MM estimators for two reasons; the first is that they are inefficient relative to the ML estimators and the second is the high probability of failing to lead to valid estimates. Another method, which considers replacing the third'moment by the zero frequency, is examined. This method turns out to be more efficient than the moment method and not very demanding computationally.     

Comparison of improved regression estimators with and without moments

For estimating the coefficients in a linear regression model, the double k–class estimators are considered and the small disturbance asymptotic approximation for their density function is obtained. Then employing the criterion of concentration probability around the true parameter values, a comparison is made between the estimators possessing finite moments and the estimators having no finite moments.     

Asymptotic normality of conditional density estimation under truncated,censored and dependent data

Abstract

In this paper, we focus on the left-truncated and right-censored model, and construct the local linear and Nadaraya-Watson type estimators of the conditional density. Under suitable conditions, we establish the asymptotic normality of the proposed estimators when the observations are assumed to be a stationary α-mixing sequence. Finite sample behavior of the estimators is investigated via simulations too.     

Lindley first-order autoregressive model with applications

ABSTRACT

A new stationary first-order autoregressive process with Lindley marginal distribution, denoted as LAR(1) is introduced. We derive the probability function for the innovation process. We consider many properties of this process, involving spectral density, some multi-step ahead conditional measures, run probabilities, stationary solution, uniqueness and ergodicity. We estimate the unknown parameters of the process using three methods of estimation and investigate properties of the estimators with some numerical results to illustrate them. Some applications of the process are discussed to two real data sets and it is shown that the LAR(1) model fits better than other known non Gaussian AR(1) models.     

Modified skew-slash distribution

Abstract

In this work, we introduce a new skewed slash distribution. This modification of the skew-slash distribution is obtained by the quotient of two independent random variables. That quotient consists on a skew-normal distribution divided by a power of an exponential distribution with scale parameter equal to two. In this way, the new skew distribution has a heavier tail than that of the skew-slash distribution. We give the probability density function expressed by an integral, but we obtain some important properties useful for making inferences, such as moment estimators and maximum likelihood estimators. By way of illustration and by using real data, we provide maximum likelihood estimates for the parameters of the modified skew-slash and the skew-slash distributions. Finally, we introduce a multivariate version of this new distribution.     

Bias reduction in kernel density estimation

In this paper, we propose two kernel density estimators based on a bias reduction technique. We study the properties of these estimators and compare them with Parzen–Rosenblatt's density estimator and Mokkadem, A., Pelletier, M., and Slaoui, Y. (2009, ‘The stochastic approximation method for the estimation of a multivariate probability density’, J. Statist. Plann. Inference, 139, 2459–2478) is density estimators. It turns out that, with an adequate choice of the parameters of the two proposed estimators, the rate of convergence of two estimators will be faster than the two classical estimators and the asymptotic MISE (Mean Integrated Squared Error) will be smaller than the two classical estimators. We corroborate these theoretical results through simulations.     

Optimal estimation for the Pareto distribution

This paper proposes an optimal estimation method for the shape parameter, probability density function and upper tail probability of the Pareto distribution. The new method is based on a weighted empirical distribution function. The exact efficiency functions of the estimators relative to the existing estimators are derived. The paper gives L ₁-optimal and L ₂-optimal weights for the new weighted estimator. Monte Carlo simulation results confirm the theoretical conclusions. Both theoretical and simulation results show that the new estimation method is more efficient relative to several existing methods in many situations.     

Non-parametric estimation of copula based mutual information

Abstract

Mutual information is a measure for investigating the dependence between two random variables. The copula based estimation of mutual information reduces the complexity because it is depend only on the copula density. We propose two estimators and discuss the asymptotic properties. To compare the performance of the estimators a simulation study is carried out. The methods are illustrated using real data sets.     

Nonparametric estimators for quantile density function under length-biased sampling

Abstract

In this article, the strong uniform consistency of two nonparametric estimators for the quantile density function is established under length-biased sampling. The rate of the strong approximation of the resulting processes of these estimators will be presented as well. A Monte Carlo simulation study is carried out to compare the proposed estimators with each other in terms of mean squared errors.     

An estimator of population total in multiple characteristics and its robustness to product moment correlation coefficient

We developed an alternative estimator for the probability proportional to size with replacement sampling scheme when certain characteristics under study have low correlation with the size measured used for sample selection. The performance of the proposed estimator has been studied with other related alternative estimators by comparing biases and the variances of respective alternative estimators. Most of the alternative estimators assume the knowledge of the product moment correlation coefficient. Therefore an empirical study, with the help of wide variety of populations, has been carried out to study their respective efficiency when correlation coefficient is departed from its true value.     

Penalized inverse probability weighted estimators for weighted rank regression with missing covariates

Abstract

In this article, we study the variable selection and estimation for linear regression models with missing covariates. The proposed estimation method is almost as efficient as the popular least-squares-based estimation method for normal random errors and empirically shown to be much more efficient and robust with respect to heavy tailed errors or outliers in the responses and covariates. To achieve sparsity, a variable selection procedure based on SCAD is proposed to conduct estimation and variable selection simultaneously. The procedure is shown to possess the oracle property. To deal with the covariates missing, we consider the inverse probability weighted estimators for the linear model when the selection probability is known or unknown. It is shown that the estimator by using estimated selection probability has a smaller asymptotic variance than that with true selection probability, thus is more efficient. Therefore, the important Horvitz-Thompson property is verified for penalized rank estimator with the covariates missing in the linear model. Some numerical examples are provided to demonstrate the performance of the estimators.     

Statistical inference for varying-coefficient partially linear errors-in-variables models with missing data

Abstract

The purpose of this paper is twofold. First, we investigate estimations in varying-coefficient partially linear errors-in-variables models with covariates missing at random. However, the estimators are often biased due to the existence of measurement errors, the bias-corrected profile least-squares estimator and local liner estimators for unknown parametric and coefficient functions are obtained based on inverse probability weighted method. The asymptotic properties of the proposed estimators both for the parameter and nonparametric parts are established. Second, we study asymptotic distributions of an empirical log-likelihood ratio statistic and maximum empirical likelihood estimator for the unknown parameter. Based on this, more accurate confidence regions of the unknown parameter can be constructed. The methods are examined through simulation studies and illustrated by a real data analysis.     

Inference on the Common Variance of Correlated Normal Random Variables

ABSTRACT

Scale equivariant estimators of the common variance σ², of correlated normal random variables, have mean squared errors (MSE) which depend on the unknown correlations. For this reason, a scale equivariant estimator of σ² which uniformly minimizes the MSE does not exist. For the equi-correlated case, we have developed three equivariant estimators of σ²: a Bayesian estimator for invariant prior as well as two non-Bayesian estimators. We then generalized these three estimators for the case of several variables with multiple unknown correlations. In addition, we developed a system of confidence intervals which produce the desired coverage probability while being efficient in terms of expected length.     

LARGE AND MODERATE DEVIATIONS PRINCIPLES FOR KERNEL ESTIMATION OF A MULTIVARIATE DENSITY AND ITS PARTIAL DERIVATIVES

This paper studies the large deviations behaviour of the kernel estimator of a probability density f, by considering the case when the kernel takes negative values. It establishes large and moderate deviations principles for the kernel estimators of the partial derivatives of f. The estimators of the derivatives exhibit a quadratic behaviour for both the large and the moderate deviations scales, whereas for the density estimator there is a classical gap between the large deviations and the moderate deviations asymptotics.