Estimation in inverse Gaussian regression: comparison of asymptotic and bootstrap distributions

This paper presents a brief review of the asymptotic properties of the pseudo-maximum likelihood estimator in the regression model where the reciprocal of the mean of the dependent variable is considered to be a linear function of the regressor variables, and the observations on the dependent variable are assumed to have an inverse Gaussian distribution. The large sample theory for the pseudo-maximum likelihood estimator presented in Babu and Chaubey (1996) is highlighted and a simulation study is carried out to compare the approximation yielded by the bootstrap distribution to that of the asymptotic distribution.     

NONPARAMETRIC ESTIMATION OF MULTIVARIATE CONVEX-TRANSFORMED DENSITIES

We study estimation of multivariate densities p of the form p(x) = h(g(x)) for x ∈ ?(d) and for a fixed monotone function h and an unknown convex function g. The canonical example is h(y) = e(-y) for y ∈ ?; in this case, the resulting class of densities [Formula: see text]is well known as the class of log-concave densities. Other functions h allow for classes of densities with heavier tails than the log-concave class.We first investigate when the maximum likelihood estimator p? exists for the class P(h) for various choices of monotone transformations h, including decreasing and increasing functions h. The resulting models for increasing transformations h extend the classes of log-convex densities studied previously in the econometrics literature, corresponding to h(y) = exp(y).We then establish consistency of the maximum likelihood estimator for fairly general functions h, including the log-concave class P(e(-y)) and many others. In a final section, we provide asymptotic minimax lower bounds for the estimation of p and its vector of derivatives at a fixed point x(0) under natural smoothness hypotheses on h and g. The proofs rely heavily on results from convex analysis.     

A Limit Theorem for Solutions of Inequalities

Let H ( p ) be the set { x ∈ X : h ( x ) ≤ p } where h is a real-valued lower semicontinuous function on a locally compact separable metric space X . This paper presents a general limit theorem for the sequence of random sets H _n ( p ) = { x ∈ X : h _n ( x ) ≤ p } n ≥ 1, where h _n , n ≥ 1, are functions that estimate h     

Estimation of an Ergodic Diffusion from Discrete Observations

We consider a one-dimensional diffusion process X , with ergodic property, with drift b ( x , θ) and diffusion coefficient a ( x , σ) depending on unknown parameters θ and σ. We are interested in the joint estimation of (θ, σ). For that purpose, we dispose of a discretized trajectory, observed at n equidistant times tⁿ_i = ih_n , 1 ≤ i ≤ n . We assume that h_n ← 0 and nh_n ←∞. Under the condition nh_n^p ← 0 for an arbitrary integer p , we exhibit a contrast dependent on p which provides us with an asymptotically normal and efficient estimator of (θ, σ).     

Setting confidence intervals by ratio estimator

For the survey population total of a variable y when values of an auxiliary variable x are available a popular procedure is to employ the ratio estimator on drawing a simple random sample without replacement (SRSWOR) especially when the size of the sample is large. To set up a confidence interval for the total, various variance estimators are available to pair with the ratio estimator. We add a few more variance estimators studded with asymptotic design-cum-model properties. The ratio estimator is traditionally known to be appropriate when the regression of y on x is linear through the origin and the conditional variance of y given x is proportional to x. But through a numerical exercise by simulation we find the confidence intervals to fare better if the regression line deviates from the origin or if the conditional variance is disproportionate with x. Also, comparing the confidence intervals using alternative variance estimators we find our newly proposed variance estimators to yield favourably competitive results.     

Estimation for Discretely Observed Small Diffusions Based on Approximate Martingale Estimating Functions

Abstract.  We consider an asymptotically efficient estimator of the drift parameter for a multi-dimensional diffusion process with small dispersion parameter ɛ . In the situation where the sample path is observed at equidistant times k / n , k  = 0, 1, …,  n , we study asymptotic properties of an M -estimator derived from an approximate martingale estimating function as ɛ tends to 0 and n tends to ∞ simultaneously.     

On Optimality of Bayesian Wavelet Estimators

Abstract.  We investigate the asymptotic optimality of several Bayesian wavelet estimators, namely, posterior mean, posterior median and Bayes Factor, where the prior imposed on wavelet coefficients is a mixture of a mass function at zero and a Gaussian density. We show that in terms of the mean squared error, for the properly chosen hyperparameters of the prior, all the three resulting Bayesian wavelet estimators achieve optimal minimax rates within any prescribed Besov space     for p  ≥ 2. For 1 ≤  p  < 2, the Bayes Factor is still optimal for (2 s +2)/(2 s +1) ≤  p  < 2 and always outperforms the posterior mean and the posterior median that can achieve only the best possible rates for linear estimators in this case.     

A TWO-PHASE SAMPLING ESTIMATOR IN SAMPLE SURVEYS

A two-phase sampling estimator of the ratio-type for estimating the mean of a finite population, has been considered where the value of ρC_y/C_x can be guessed or estimated in advance. Here C_y and C_x denote respectively the coefficients of variation of the characteristic under study, y, and the auxiliary characteristic x and ρ denotes the coefficient of correlation between y and x. When the value of ρC_y/C_x is guessed or estimated exactly, the estimator has a smaller large-sample variance compared with either an ordinary ratio estimator or an ordinary linear regression estimator in two-phase sampling in the case where the first-phase sample is drawn independently from the second-phase sample. If the sample at the second phase is a subsample of the first-phase sample, the estimator has variance equal to that of the linear regression estimator. The largest value of the difference between the assumed value and the actual value of ρC_y/C_x has been obtained so as not to result in the variance of the estimator being larger than the variances of either an ordinary ratio estimator or an ordinary linear regression estimator.     

Estimating means when sampling gives probabilities as well as values or “Looking a gift horse in the mouth”

Consider the random sampling of a discrete population. The observations, as they are collected one by one, are enhanced in that the probability mass associated with each observation is also observed. The goal is to estimate the population mean. Without this extra information about probability mass, the best general purpose estimator is the arithmetic average of the observations, XBAR. The issue is whether or not the extra information can be used to improve on XBAR. This paper examines the issues and offers four new estimators, each with its own strengths and liabilities. Some comparative performances of the four with XBAR are made.The motivating application is a Monte Carlo simulation that proceeds in two stages. The first stage independently samples n characteristics to obtain a configuration of some kind, together with a configuration probability p obtained, if desired, as a product of n individual probabilities. A relatively expensive calculation then determines an output X as a function of the configuration. A random sample of X could simply be averaged to estimate the mean output, but there are possibly more efficient estimators on account of the known configuration probabilities.     

Computation of probability and non-centrality parameter of a non-central f-distribution

The small sample properties of the score function approximation to the maximum likelihood estimator for the three-parameter lognormal distribution using an alternative parameterization are considered. The new set of parameters is a continuous function of the usual parameters. However, unlike with the usual parameterization, the score function technique for this parameterization is extremely insensitive to starting values. Further, it is shown that whenever the sample third moment is less than zero, a local maximum to the likelihood function exists at a boundary point. For the usual parameterization, this point is unattainable. However, the alternative parameter space can be expanded to include these boundary points. This procedure results in good estimates of the expected value, variance, extreme percentiles and other parameters of the distribution even in samples where, with the typical parameterization, the estimation procedure fails to converge.     

Root-n-consistent Estimation in Partial Linear Models with Long-memory Errors

We consider estimation of β in the semiparametric regression model y ( i ) - x ^T( i )β + f ( i / n ) + ε( i ) where x ( i ) = g ( i )/ n ) + e ( i , f and g are unknown smooth functions and the processes ε( i ) and e ( i ) are stationary with short- or long-range dependence. For the case of i.i.d. errors, Speckman (1988) proposed a √ n –consistent estimator of β. In this paper it is shown that, under suitable regularity conditions, this estimator is asymptotically unbiased and √ n –consistent even if the errors exhibit long-range dependence. The orders of the finite sample bias and of the required bandwidth depend on the long-memory parameters. Simulations and a data example illustrate the method     

Detecting changes in the mean of functional observations

Summary.  Principal component analysis has become a fundamental tool of functional data analysis. It represents the functional data as X _i ( t )= μ ( t )+Σ_{1≤ l <∞} η _{i ,  l} +  v _l ( t ), where μ is the common mean, v _l are the eigenfunctions of the covariance operator and the η _{i ,  l} are the scores. Inferential procedures assume that the mean function μ ( t ) is the same for all values of i . If, in fact, the observations do not come from one population, but rather their mean changes at some point(s), the results of principal component analysis are confounded by the change(s). It is therefore important to develop a methodology to test the assumption of a common functional mean. We develop such a test using quantities which can be readily computed in the R package fda. The null distribution of the test statistic is asymptotically pivotal with a well-known asymptotic distribution. The asymptotic test has excellent finite sample performance. Its application is illustrated on temperature data from England.     

Estimation of generalized linear latent variable models

Summary.  Generalized linear latent variable models (GLLVMs), as defined by Bartholomew and Knott, enable modelling of relationships between manifest and latent variables. They extend structural equation modelling techniques, which are powerful tools in the social sciences. However, because of the complexity of the log-likelihood function of a GLLVM, an approximation such as numerical integration must be used for inference. This can limit drastically the number of variables in the model and can lead to biased estimators. We propose a new estimator for the parameters of a GLLVM, based on a Laplace approximation to the likelihood function and which can be computed even for models with a large number of variables. The new estimator can be viewed as an M -estimator, leading to readily available asymptotic properties and correct inference. A simulation study shows its excellent finite sample properties, in particular when compared with a well-established approach such as LISREL. A real data example on the measurement of wealth for the computation of multidimensional inequality is analysed to highlight the importance of the methodology.     

Some unbiased estimators versus mean per unit and ratio estimators in finite population sample surveys

We present some unbiased estimators at the population mean in a finite population sample surveys with simple random sampling design where information on an auxiliary variance x positively correlated with the main variate y is available. Exact variance and unbiased estimate of the variance are computed for any sample size. These estimators are compared for their precision with the mean per unit and the ratio estimators. Modifications of the estimators are suggested to make them more precise than the mean per unit estimator or the ratio estimator regardless of the value of the population correlation coefficient between the variates x and y. Asymptotic distribution of our estimators and confidnece intervals for the population mean are also obtained.     

Strong Consistency of the Maximum Likelihood Estimator for Finite Mixtures of Location–Scale Distributions When Penalty is Imposed on the Ratios of the Scale Parameters

Abstract.  In finite mixtures of location–scale distributions, if there is no constraint or penalty on the parameters, then the maximum likelihood estimator does not exist because the likelihood is unbounded. To avoid this problem, we consider a penalized likelihood, where the penalty is a function of the minimum of the ratios of the scale parameters and the sample size. It is shown that the penalized maximum likelihood estimator is strongly consistent. We also analyse the consistency of a penalized maximum likelihood estimator where the penalty is imposed on the scale parameters themselves.     

Hazard-based nonparametric survivor function estimation

Summary.  A representation is developed that expresses the bivariate survivor function as a function of the hazard function for truncated failure time variables. This leads to a class of nonparametric survivor function estimators that avoid negative mass. The transformation from hazard function to survivor function is weakly continuous and compact differentiable, so that such properties as strong consistency, weak convergence to a Gaussian process and bootstrap applicability for a hazard function estimator are inherited by the corresponding survivor function estimator. The set of point mass assignments for a survivor function estimator is readily obtained by using a simple matrix calculation on the set of hazard rate estimators. Special cases arise from a simple empirical hazard rate estimator, and from an empirical hazard rate estimator following the redistribution of singly censored observations within strips. The latter is shown to equal van der Laan's repaired nonparametric maximum likelihood estimator, for which a Greenwood-like variance estimator is given. Simulation studies are presented to compare the moderate sample performance of various nonparametric survivor function estimators.     

MINIMUM MSE ESTIMATION BY LINEAR COMBINATIONS OF ORDER STATISTICS1

In this paper we assume that in a random sample of size ndrawn from a population having the pdf f(x; θ) the smallest r₁ observations and the largest r₂ observations are censored (r₁0, r₂0). We consider the problem of estimating θ on the basis of the middle n-r₁-r₂ observations when either f(x;θ)=θ^-1f(x/θ) or f(x;θ) = (aθ)¹f(x-θ)/aθ) where f(·) is a known pdf, a (<0) is known and θ (>0) is unknown. The minimum mean square error (MSE) linear estimator of θ proposed in this paper is a “shrinkage” of the minimum variance linear unbiased estimator of θ. We obtain explicit expressions of these estimators and their mean square errors when (i) f(·) is the uniform pdf defined on an interval of length one and (ii) f(·) is the standard exponential pdf, i.e., f(x) = exp(–x), x0. Various special cases of censoring from the left (right) and no censoring are considered.     

Non-parametric Estimation of a Survival Function with Two-stage Design Studies

Abstract.  The two-stage design is popular in epidemiology studies and clinical trials due to its cost effectiveness. Typically, the first stage sample contains cheaper and possibly biased information, while the second stage validation sample consists of a subset of subjects with accurate and complete information. In this paper, we study estimation of a survival function with right-censored survival data from a two-stage design. A non-parametric estimator is derived by combining data from both stages. We also study its large sample properties and derive pointwise and simultaneous confidence intervals for the survival function. The proposed estimator effectively reduces the variance and finite-sample bias of the Kaplan–Meier estimator solely based on the second stage validation sample. Finally, we apply our method to a real data set from a medical device postmarketing surveillance study.