Confidence intervals for the length of a vector mean

Suppose we have a random sample of size n from a multivariate distribution with finite moments, for which a parametric form is not available. We wish to obtain a confidence interval (CI) for the length of its mean. The usual method is to Studentize. The resulting CIs are not exact. The error in their nominal levels is ～n ^?1/2 and ～n ^?1 in the one-sided and two-sided cases. We show how to reduce these errors to ～n ^?3/2 and ～n ^?2.     

Uniformly strong consistency and Berry-Esseen bound of frequency polygons for α-mixing samples

In this article, the frequency polygon investigated by Scott is studied as a nonparametric estimator for α-mixing samples. By some known exponent and moment inequalities, we obtain the uniformly strong consistency and Berry-Esseen bound of the estimator. The present results relax the relevant conditions used by Carbon et al. Furthermore, the convergence rate of the uniformly asymptotic normality is derived, which is O(n^{? 1/11}) under the given conditions.     

Bias reduction of the maximum-likelihood estimator for a conditional Gaussian MA(1) model

In this paper, we consider an estimation for the unknown parameters of a conditional Gaussian MA(1) model. In the majority of cases, a maximum-likelihood estimator is chosen because the estimator is consistent. However, for small sample sizes the error is large, because the estimator has a bias of O(n^{? 1}). Therefore, we provide a bias of O(n^{? 1}) for the maximum-likelihood estimator for the conditional Gaussian MA(1) model. Moreover, we propose new estimators for the unknown parameters of the conditional Gaussian MA(1) model based on the bias of O(n^{? 1}). We investigate the properties of the bias, as well as the asymptotical variance of the maximum-likelihood estimators for the unknown parameters, by performing some simulations. Finally, we demonstrate the validity of the new estimators through this simulation study.     

Estimation and Inference for Linear Panel Data Models Under Misspecification When Both n and T are Large

This article considers fixed effects (FE) estimation for linear panel data models under possible model misspecification when both the number of individuals, n, and the number of time periods, T, are large. We first clarify the probability limit of the FE estimator and argue that this probability limit can be regarded as a pseudo-true parameter. We then establish the asymptotic distributional properties of the FE estimator around the pseudo-true parameter when n and T jointly go to infinity. Notably, we show that the FE estimator suffers from the incidental parameters bias of which the top order is O(T^{? 1}), and even after the incidental parameters bias is completely removed, the rate of convergence of the FE estimator depends on the degree of model misspecification and is either (nT)^{? 1/2} or n^{? 1/2}. Second, we establish asymptotically valid inference on the (pseudo-true) parameter. Specifically, we derive the asymptotic properties of the clustered covariance matrix (CCM) estimator and the cross-section bootstrap, and show that they are robust to model misspecification. This establishes a rigorous theoretical ground for the use of the CCM estimator and the cross-section bootstrap when model misspecification and the incidental parameters bias (in the coefficient estimate) are present. We conduct Monte Carlo simulations to evaluate the finite sample performance of the estimators and inference methods, together with a simple application to the unemployment dynamics in the U.S.     

On the exponential inequalities for widely orthant-dependent random variables

ABSTRACT

In this work, we establish some exponential inequalities for widely orthant-dependent random variables. We also obtain the convergence rate O(n^{? 1/2}ln?^1/2n) for the strong law of large numbers for widely orthant-dependent random variables.     

Convergence Rate of Strong Consistency of the Maximum Likelihood Estimator in Exponential Family Nonlinear Models

This article proposes some regularity conditions. On the basis of the proposed regularity conditions, we show the strong consistency of the maximum likelihood estimator (MLE) in exponential family nonlinear models (EFNM) and give its convergence rate. In an important case, we obtain the convergence rate O(n ^?1/2(log log n)^1/2)—the rate as that in the Law of the Iterated Logarithm (LIL) for iid partial sums and thus cannot be improved anymore.     

Matching Three Moments with Minimal Acyclic Phase Type Distributions

Abstract

A number of approximate analysis techniques are based on matching moments of continuous time phase type (PH) distributions. This paper presents an explicit method to compose minimal order continuous time acyclic phase type (APH) distributions with a given first three moments. To this end we also evaluate the bounds for the first three moments of order n APH distributions (APH(n)). The investigations of these properties are based on a basic transformation, which extends the APH(n ? 1) class with an additional phase in order to describe the APH(n) class.     

On improving convergence rate of Bernstein polynomial density estimator

This paper is concerned with the Bernstein estimator [Vitale, R.A. (1975), ‘A Bernstein Polynomial Approach to Density Function Estimation’, in Statistical Inference and Related Topics, ed. M.L. Puri, 2, New York: Academic Press, pp. 87–99] to estimate a density with support [0, 1]. One of the major contributions of this paper is an application of a multiplicative bias correction [Terrell, G.R., and Scott, D.W. (1980), ‘On Improving Convergence Rates for Nonnegative Kernel Density Estimators’, The Annals of Statistics, 8, 1160–1163], which was originally developed for the standard kernel estimator. Moreover, the renormalised multiplicative bias corrected Bernstein estimator is studied rigorously. The mean squared error (MSE) in the interior and mean integrated squared error of the resulting bias corrected Bernstein estimators as well as the additive bias corrected Bernstein estimator [Leblanc, A. (2010), ‘A Bias-reduced Approach to Density Estimation Using Bernstein Polynomials’, Journal of Nonparametric Statistics, 22, 459–475] are shown to be O(n^?8/9) when the underlying density has a fourth-order derivative, where n is the sample size. The condition under which the MSE near the boundary is O(n^?8/9) is also discussed. Finally, numerical studies based on both simulated and real data sets are presented.     

An Asymptotic Linear Representation for the Breslow Estimator

We provide an asymptotic linear representation for the Breslow estimator of the baseline cumulative hazard function in the Cox model. Our representation consists of an average of independent random variables and a term involving the difference between the maximum partial likelihood estimator and the underlying regression parameter. The order of the remainder term is arbitrarily close to n ^?1.     

Integral Representation of a Distribution Associated with a Pure Birth Process

ABSTRACT

This article deals with a distribution associated with a pure birth process starting with no individuals, with birth rates λ _n  = λ for n = 0, 2,…, m ? 1 and λ _n  = μ for n ≥ m. The probability mass function is expressed in terms of an integral that is very convenient for computing probabilities, moments, generating functions, and others. Using this representation, the kth factorial moments of the distribution is obtained. Some other forms of this distribution are also given.     

An asymptotic representation of a ratio of two statistics and its applications

Some statistics in common use take a form of a ratio of two statistics.In this paper, we will discuss asymptotic properties of the ratio statistic.We obtain an asymptotic representation of the ratio with remainder term o _p(n ^-1) and a Edgeworth expansion with remainder term o(n ^-1/2) And as example, the asymptotic representation and the Edgeworth expansion of the jackknife skewness estimator for U-statistics are established and we discuss the biases of the skewness estimator theoretically.We also apply the result to an estimator of Pearson’s coefficient of variation and the sample correlation coefficient.     

Improved minimax estimation of a normal precision matrix

Let S_{p × p} have a Wishart distribution with parameter matrix Σ and n degrees of freedom. We consider here the problem of estimating the precision matrix Σ^?1 under the loss functions L₁(σ) tr (σ) - log |σ| and L₂(σ) = tr (σ). James-Stein-type estimators have been derived for an arbitrary p. We also obtain an orthogonal invariant and a diagonal invariant minimax estimator under both loss functions. A Monte-Carlo simulation study indicates that the risk improvement of the orthogonal invariant estimators over the James-Stein type estimators, the Haff (1979) estimator, and the “testimator” given by Sinha and Ghosh (1987) is substantial.     

On shrinking minimax convergence in nonparametric statistics

‘?…?if we are prepared to assume that the unknown density has k derivatives, then?…?the optimal mean integrated squared error is of order n^{?2 k/(2 k+1)}?…?’ The citation is from Silverman [(1986), Density Estimation for Statistics and Data Analysis, London: Chapman &; Hall] and its assertion is based on a classical minimax lower bound which is the pillar of the modern nonparametric statistics. This paper proposes a new minimax methodology that implies a faster decreasing minimax lower bound that is attainable by a data-driven estimator, and the same estimator is also minimax under the classical approach. The recommendation is to test performance of estimators via the new and classical minimax approaches.     

Strong Gaussian Approximations of Product-Limit and Quantile Processes for Strong Mixing and Censored Data

In this article, we consider the product-limit quantile estimator of an unknown quantile function under a censored dependent model. This is a parallel problem to the estimation of the unknown distribution function by the product-limit estimator under the same model. Simultaneous strong Gaussian approximations of the product-limit process and product-limit quantile process are constructed with rate O[(log n)^?λ] for some λ > 0. The strong Gaussian approximation of the product-limit process is then applied to derive the laws of the iterated logarithm for product-limit process.     

Confidence intervals for lognormal regression and a non-parametric alternative

Approximate confidence intervals are given for the lognormal regression problem. The error in the nominal level can be reduced to O(n ^?2), where n is the sample size. An alternative procedure is given which avoids the non-robust assumption of lognormality. This amounts to finding a confidence interval based on M-estimates for a general smooth function of both ? and F, where ? are the parameters of the general (possibly nonlinear) regression problem and F is the unknown distribution function of the residuals. The derived intervals are compared using theory, simulation and real data sets.     

Optimal Nonparametric Quantile Estimators. Towards a General Theory. A Survey

“Nonparametric” in the title is used to say that observations X ₁,…,X _n come from an unknown distribution F ∈ ? with ? being the class of all continuous and strictly increasing distribution functions. The problem is to estimate the quantile of a given order q ∈ (0,1) of the distribution F. The class ? of distributions is very large; it is so large that even X _nq:n , where nq is an integer, may be very poor estimator of the qth quantile. To assess the performance of estimators no properties based on moments may be used: expected values of estimators should be replaced by their medians, their variances—by some characteristics of concentration of distributions around the median. If an estimator is median-biased for one of distributions, the bias of the estimator may be infinitely large for other distributions. In the note optimal estimators with respect to various criteria of optimality are presented. The pivotal function F(T) of the estimator T is introduced which enables us to apply the classical statistical approach.     

Bias Correction in the Type I Generalized Logistic Distribution

Four strategies for bias correction of the maximum likelihood estimator of the parameters in the Type I generalized logistic distribution are studied. First, we consider an analytic bias-corrected estimator, which is obtained by deriving an analytic expression for the bias to order n ^?1; second, a method based on modifying the likelihood equations; third, we consider the jackknife bias-corrected estimator; and fourth, we consider two bootstrap bias-corrected estimators. All bias correction estimators are compared by simulation. Finally, an example with a real data set is also presented.     

Orthogonal polynomials generated by random vectors

Every random q-vector with finite moments generates a set of orthonormal polynomials. These are generated from the basis functions xn = xn11…xnqq using Gram–Schmidt orthogonalization. One can cycle through these basis functions using any number of ways. Here, we give results using minimum cycling. The polynomials look simpler when centered about the mean of X, and still simpler form when X is symmetric about zero. This leads to an extension of the multivariate Hermite polynomial for a general random vector symmetric about zero. As an example, the results are applied to the multivariate normal distribution.     

Adjusted Pearson residuals in beta regression models

In this paper, matrix formulae of order n^?1, where n is the sample size, for the first two moments of Pearson residuals are obtained in beta regression models. Adjusted Pearson residuals are also obtained, having, to this order, expected value zero and variance one. Monte Carlo simulation results are presented illustrating the behaviour of both adjusted and unadjusted residuals.     

Control variates and importance sampling for efficient bootstrap simulations

Importance sampling and control variates have been used as variance reduction techniques for estimating bootstrap tail quantiles and moments, respectively. We adapt each method to apply to both quantiles and moments, and combine the methods to obtain variance reductions by factors from 4 to 30 in simulation examples.We use two innovations in control variates—interpreting control variates as a re-weighting method, and the implementation of control variates using the saddlepoint; the combination requires only the linear saddlepoint but applies to general statistics, and produces estimates with accuracy of order n ^-1/2 B ^-1, where n is the sample size and B is the bootstrap sample size.We discuss two modifications to classical importance sampling—a weighted average estimate and a mixture design distribution. These modifications make importance sampling robust and allow moments to be estimated from the same bootstrap simulation used to estimate quantiles.