Berry–Esseen type bound of conditional mode estimation under truncation and strong mixing assumptions

ABSTRACT

In order to investigate the convergence rate of the asymptotic normality for the estimator of the conditional mode function for the left-truncation model, we derive a Berry–Esseen type bound of the estimator when the lifetime observations with multivariate covariates form a stationary α-mixing sequence. The finite sample performance of the estimator of the conditional mode function is explored through simulations.     

Berry–Esseen type bounds for trimmed U-statistics

Trimmed U  -statistics can be constructed in two different ways: by basing the statistic on a trimmed sample or by averaging the trimmed set of kernel values. Mild conditions are given to ensure the rate of convergence to normality is O(n^-1/2)$\mathrm{O}(n^{-1/2})$ in both cases.     

Robust parameter estimation for the Ornstein–Uhlenbeck process

In this paper, we derive elementary M- and optimally robust asymptotic linear (AL)-estimates for the parameters of an Ornstein–Uhlenbeck process. Simulation and estimation of the process are already well-studied, see Iacus (Simulation and inference for stochastic differential equations. Springer, New York, 2008). However, in order to protect against outliers and deviations from the ideal law the formulation of suitable neighborhood models and a corresponding robustification of the estimators are necessary. As a measure of robustness, we consider the maximum asymptotic mean square error (maxasyMSE), which is determined by the influence curve (IC) of AL estimates. The IC represents the standardized influence of an individual observation on the estimator given the past. In a first step, we extend the method of M-estimation from Huber (Robust statistics. Wiley, New York, 1981). In a second step, we apply the general theory based on local asymptotic normality, AL estimates, and shrinking neighborhoods due to Kohl et?al. (Stat Methods Appl 19:333–354, 2010), Rieder (Robust asymptotic statistics. Springer, New York, 1994), Rieder (2003), and Staab (1984). This leads to optimally robust ICs whose graph exhibits surprising behavior. In the end, we discuss the estimator construction, i.e. the problem of constructing an estimator from the family of optimal ICs. Therefore we carry out in our context the One-Step construction dating back to LeCam (Asymptotic methods in statistical decision theory. Springer, New York, 1969) and compare it by means of simulations with MLE and M-estimator.     

Point estimation of the stress–strength reliability parameter for parallel system with independent and non-identical components

In this article, the estimation problem of the multicomponent stress–strength reliability parameter is considered where the stress and the strength systems have arbitrary fixed numbers of independent and non-identical parallel components. It is assumed that the distribution functions of the stress and the strength components satisfy the proportional reversed hazard rate model. The study is done in more details when the baseline distributions are exponential. Maximum likelihood and uniformly minimum variance unbiased estimators are obtained and compared. Also, Bayes and empirical Bayes estimators are discussed and Monte Carlo simulations are carried out to compare their performances.     

Berry–Esseen type bounds in heteroscedastic errors-in-variables model

ABSTRACT

Consider the heteroscedastic partially linear errors-in-variables (EV) model y_i = x_iβ + g(t_i) + ε_i, ξ_i = x_i + μ_i (1 ? i ? n), where ε_i = σ_ie_i are random errors with mean zero, σ²_i = f(u_i), (x_i, t_i, u_i) are non random design points, x_i are observed with measurement errors μ_i. When f( · ) is known, we derive the Berry–Esseen type bounds for estimators of β and g( · ) under {e_i,?1 ? i ? n} is a sequence of stationary α-mixing random variables, when f( · ) is unknown, the Berry–Esseen type bounds for estimators of β, g( · ), and f( · ) are discussed under independent errors.     

EM-based maximum likelihood parameter estimation for multivariate generalized hyperbolic distributions with fixed λ

Generalized Hyperbolic distribution (Barndorff-Nielsen 1977) is a variance-mean mixture of a normal distribution with the Generalized Inverse Gaussian distribution. Recently subclasses of these distributions (e.g., the hyperbolic distribution and the Normal Inverse Gaussian distribution) have been applied to construct stochastic processes in turbulence and particularly in finance, where multidimensional problems are of special interest. Parameter estimation for these distributions based on an i.i.d. sample is a difficult task even for a specified one-dimensional subclass (subclass being uniquely defined by ) and relies on numerical methods. For the hyperbolic subclass ( = 1), computer program hyp (Blæsild and Sørensen 1992) estimates parameters via ML when the dimensionality is less than or equal to three. To the best of the author's knowledge, no successful attempts have been made to fit any given subclass when the dimensionality is greater than three. This article proposes a simple EM-based (Dempster, Laird and Rubin 1977) ML estimation procedure to estimate parameters of the distribution when the subclass is known regardless of the dimensionality. Our method relies on the ability to numerically evaluate modified Bessel functions of the third kind and their logarithms, which is made possible by currently available software. The method is applied to fit the five dimensional Normal Inverse Gaussian distribution to a series of returns on foreign exchange rates.     

Semi-parametric estimation of the autoregressive parameter in non-Gaussian Ornstein–Uhlenbeck processes

ABSTRACT

This paper considers the problem of estimating the autoregressive parameter in discretely observed Ornstein–Uhlenbeck processes. Two consistent estimators are proposed: one obtained by maximizing a kernel-based likelihood function, and another by minimizing a Kolmogorov-type distance from independence. After establishing the consistency of these estimators, their finite-sample performance and possible normality in large samples, is investigated by means of extensive simulations. An illustrative example to credit rating is discussed.     

Shortening the distance between Edgeworth and Berry–Esseen in the classical case

We obtain near optimal Berry–Esseen bounds for standardized sums of independent identically distributed random variables. This is achieved by distinguishing the lattice and the non-lattice cases, as one-term Edgeworth expansions do. The main tool is an easy inequality involving the usual second modulus of continuity, in substitution of Esseen's smoothing inequality. An illustrative example concerning the exponential distribution is also considered.     

Optimal designs for the Michaelis–Menten model with correlated observations

In this paper we investigate the problem of designing experiments for generalized least-squares analysis in the Michaelis–Menten model. We study the structure of exact D-optimal designs in a model with an autoregressive error structure. Explicit results for locally D-optimal designs are derived for the case where two observations can be taken per subject. Additionally standardized maximin D-optimal designs are obtained in this case. The results illustrate the enormous difficulties to find exact optimal designs explicitly for nonlinear regression models with correlated observations.     

A shift parameter estimation based on smoothed Kolmogorov–Smirnov

A new procedure of shift parameter estimation in the two-sample location problem is investigated and compared with existing estimators. The proposed procedure smooths the empirical distribution functions of each random sample and replaces empirical distribution functions in the two-sample Kolmogorov–Smirnov method. The smoothed Kolmogorov–Smirnov is minimized with respect to an arbitrary shift variable in order to find an estimate of the shift parameter. The proposed procedure can be considered the smoothed version of a very little known method of shift parameter estimation from Rao-Schuster-Littell (RSL) [Rao et al., Estimation of shift and center of symmetry based on Kolmogorov–Smirnov statistics, Ann. Stat. 3(4) (1975), pp. 862–873]. Their estimator will be discussed and compared with the proposed estimator in this paper. An example and simulation studies have been performed to compare the proposed procedure with existing shift parameter estimators such as Hodges–Lehmann (H–L) and least squares in addition to RSL's estimator. The results show that the proposed estimator has lower mean-squared error as well as higher relative efficiency against RSL's estimator under normal or contaminated normal model assumptions. Moreover, the proposed estimator performs competitively against H–L and least-squares shift estimators. Smoother function and bandwidth selections are also discussed and several alternatives are proposed in the study.     

Efficient von Mises–Fisher concentration parameter estimation using Taylor series

A simple method is outlined for constructing a Taylor series for the Maximum Likelihood Estimate of the von Mises–Fisher concentration parameter based around an initial heuristic estimate. While existing treatments require multiple computationally intensive calculations of a Bessel ratio, this method provides accurate results using only one such calculation. The accuracy of the method is tested extensively, and the reuse of the Taylor series for multiple calculations is explored.     

On estimation of stress–strength parameter using record values from proportional hazard rate models

ABSTRACT

Based on record values, this article deals with inference for stress–strength reliability, R = P(X < Y), where the distributions of X and Y follow proportional hazard rate models but having different parameters. Maximum likelihood estimator, uniformly minimum variance unbiased estimator, Bayes estimator, and different confidence intervals for R are obtained. Numerical computations and simulation study are presented for illustrative purposes.     

Tukey’s M-estimator of the Poisson parameter with a special focus on small means

We treat robust M-estimators for independent and identically distributed Poisson data. We introduce modified Tukey M-estimators with bias correction and compare them to M-estimators based on the Huber function as well as to weighted likelihood and other estimators by simulation in case of clean data and data with outliers. In particular, we investigate the problem of combining robustness and high efficiencies at small Poisson means caused by the strong asymmetry of such Poisson distributions and propose a further estimator based on adaptive trimming. The advantages of the constructed estimators are illustrated by an application to smoothing count data with a time varying mean and level shifts.     

Marshall–Olkin distribution: parameter estimation and application to cancer data

In this study, as alternatives to the maximum likelihood (ML) and the frequency estimators, we propose robust estimators for the parameters of Zipf and Marshall–Olkin Zipf distributions. A small simulation study is given to illustrate the performance of the proposed estimators. We apply the proposed estimators to a real data set from cancer research to illustrate the performance of the proposed estimators over the ML, moments and frequency estimators. We observe that the robust estimators have superiority over the frequency estimators based on classical sample mean.     

Admissible minimax estimators for the shape parameter of Topp–Leone distribution

Abstract

The shape parameter of Topp–Leone distribution is estimated in this article from the Bayesian viewpoint under the assumption of known scale parameter. Bayes and empirical Bayes estimates of the unknown parameter are proposed under non informative and suitable conjugate priors. These estimates are derived under the assumption of squared and linear-exponential error loss functions. The risk functions of the proposed estimates are derived in analytical forms. It is shown that the proposed estimates are minimax and admissible. The consistency of the proposed estimates under the squared error loss function is also proved. Numerical examples are provided.