Semiparametric methods for response-selective and missing data problems in regression

Suppose that data are generated according to the model f ( y | x ; θ ) g ( x ), where y is a response and x are covariates. We derive and compare semiparametric likelihood and pseudolikelihood methods for estimating θ for situations in which units generated are not fully observed and in which it is impossible or undesirable to model the covariate distribution. The probability that a unit is fully observed may depend on y , and there may be a subset of covariates which is observed only for a subsample of individuals. Our key assumptions are that the probability that a unit has missing data depends only on which of a finite number of strata that ( y , x ) belongs to and that the stratum membership is observed for every unit. Applications include case–control studies in epidemiology, field reliability studies and broad classes of missing data and measurement error problems. Our results make fully efficient estimation of θ feasible, and they generalize and provide insight into a variety of methods that have been proposed for specific problems.     

A NOTE ON ESTIMATING THE LOCATION AND SCALE PARAMETERS OF THE EXPONENTIAL DISTRIBUTION FROM A CENSORED SAMPLE

   
Replacing f (x)/F (x) by α+β(x- θ)/σ in the maximum likelihood equations ∂L/∂θ and ∂L/∂σ calculated from a censored sample, a pair of estimators θ^e and σ^e, is obtained. The variances and covariances of these estimators are calculated and compared with the corresponding values for the best linear unbiassed (BLU) estimators.     

Semiparametric regression under long-range dependent errors

In this paper, we consider a semiparametric regression model under long-range dependent errors. By approximating the nonparametric component by a finite series sum, we construct consistent estimators for both parametric and nonparametric components. Meanwhile, convergence rates for the consistent estimators are also investigated. Additionally, an optimal truncation parameter selection procedure is proposed.     

Simple and Explicit Estimating Functions for a Discretely Observed Diffusion Process

We consider a one-dimensional diffusion process X , with ergodic property, with drift b ( x , θ) and diffusion coefficient a ( x , θ) depending on an unknown parameter θ that may be multidimensional. We are interested in the estimation of θ and dispose, for that purpose, of a discretized trajectory, observed at n equidistant times t_i = iΔ , i = 0, ..., n . We study a particular class of estimating functions of the form ∑ f (θ, X _{t i −1}) which, under the assumption that the integral of f with respect to the invariant measure is null, provide us with a consistent and asymptotically normal estimator. We determine the choice of f that yields the estimator with minimum asymptotic variance within the class and indicate how to construct explicit estimating functions based on the generator of the diffusion. Finally the theoretical study is completed with simulations.     

Nonparametric estimation of the canonical measure for infinitely divisible distributions

Infinitely divisible distributions (i.d.d.'s) with a finite variance have a characteristic function of a particular form. The exponent is written in terms of the canonical or Kolmogorov measure. This paper considers a nonparametric estimate of the Kolmogorov measure based on the empirical characteristic function (e.c.f.) and a truncation. The weak convergence of this estimator is studied. The raw form of the estimator is a functional of the e.c.f., but to be useful in a finite sample it requires some additional smoothing. Thus smoothed estimators are considered. A dynamic data dependent method of truncation is given. A simulation study is undertaken to show how the Kolmogorov measure can be estimated, as well as giving an illustration of the numerical stability questions. It is also seen that a large sample size is needed.     

A class of local likelihood methods and near-parametric asymptotics

The local maximum likelihood estimate θ^ _t of a parameter in a statistical model f ( x , θ) is defined by maximizing a weighted version of the likelihood function which gives more weight to observations in the neighbourhood of t . The paper studies the sense in which f ( t , θ^ _t ) is closer to the true distribution g ( t ) than the usual estimate f ( t , θ^) is. Asymptotic results are presented for the case in which the model misspecification becomes vanishingly small as the sample size tends to ∞. In this setting, the relative entropy risk of the local method is better than that of maximum likelihood. The form of optimum weights for the local likelihood is obtained and illustrated for the normal distribution.     

Efficient Estimation of the Partly Linear Additive Hazards Model with Current Status Data

This paper focuses on efficient estimation, optimal rates of convergence and effective algorithms in the partly linear additive hazards regression model with current status data. We use polynomial splines to estimate both cumulative baseline hazard function with monotonicity constraint and nonparametric regression functions with no such constraint. We propose a simultaneous sieve maximum likelihood estimation for regression parameters and nuisance parameters and show that the resultant estimator of regression parameter vector is asymptotically normal and achieves the semiparametric information bound. In addition, we show that rates of convergence for the estimators of nonparametric functions are optimal. We implement the proposed estimation through a backfitting algorithm on generalized linear models. We conduct simulation studies to examine the finite‐sample performance of the proposed estimation method and present an analysis of renal function recovery data for illustration.     

Improved minimax estimation of a normal precision matrix

Let S_{p × p} have a Wishart distribution with parameter matrix Σ and n degrees of freedom. We consider here the problem of estimating the precision matrix Σ^?1 under the loss functions L₁(σ) tr (σ) - log |σ| and L₂(σ) = tr (σ). James-Stein-type estimators have been derived for an arbitrary p. We also obtain an orthogonal invariant and a diagonal invariant minimax estimator under both loss functions. A Monte-Carlo simulation study indicates that the risk improvement of the orthogonal invariant estimators over the James-Stein type estimators, the Haff (1979) estimator, and the “testimator” given by Sinha and Ghosh (1987) is substantial.     

Semiparametric Likelihood Based Method for Goodness of Fit Tests and Estimation in Upgraded Mixture Models

We use Owen's (1988, 1990) empirical likelihood method in upgraded mixture models. Two groups of independent observations are available. One is z ₁, ..., z _n which is observed directly from a distribution F ( z ). The other one is x ₁, ..., x _m which is observed indirectly from F ( z ), where the x _i s have density ∫ p ( x | z ) dF ( z ) and p ( x | z ) is a conditional density function. We are interested in testing H ₀: p ( x | z ) = p ( x | z ; θ ), for some specified smooth density function. A semiparametric likelihood ratio based statistic is proposed and it is shown that it converges to a chi-squared distribution. This is a simple method for doing goodness of fit tests, especially when x is a discrete variable with finitely many values. In addition, we discuss estimation of θ and F ( z ) when H ₀ is true. The connection between upgraded mixture models and general estimating equations is pointed out.     

IMPROVING UPON THE BEST INVARIANT ESTIMATOR IN MULTIVARIATE LOCATION PROBLEMS

We are concerned with estimators which improve upon the best invariant estimator, in estimating a location parameter θ. If the loss function is L(θ - a) with L convex, we give sufficient conditions for the inadmissibility of δ₀(X) = X. If the loss is a weighted sum of squared errors, we find various classes of estimators δ which are better than δ₀. In general, δ is the convolution of δ₁ (an estimator which improves upon δ₀ outside of a compact set) with a suitable probability density in R^p. The critical dimension of inadmissibility depends on the estimator δ₁ We also give several examples of estimators δ obtained in this way and state some open problems.     

Nonlinear regression analysis for complex surveys 1

In a clustered finite population, it is assumed that a given function depending on an unknown parameter may be adopted to reveal the relationship among the variables of interest. The finite population parameter corresponding to this unknown parameter is defined as a solution of an estimating equation defined by a properly chosen population loss function. An estimation procedure that takes sample weights into account is considered. Use of this function in estimating the population mean per cluster is discussed. Large sample properties of estimators are investigated.     

Local orthogonal polynomial expansion for density estimation

A local orthogonal polynomial expansion (LOrPE) of the empirical density function is proposed as a novel method to estimate the underlying density. The estimate is constructed by matching localised expectation values of orthogonal polynomials to the values observed in the sample. LOrPE is related to several existing methods, and generalises straightforwardly to multivariate settings. By manner of construction, it is similar to local likelihood density estimation (LLDE). In the limit of small bandwidths, LOrPE functions as kernel density estimation (KDE) with high-order (effective) kernels inherently free of boundary bias, a natural consequence of kernel reshaping to accommodate endpoints. Consistency and faster asymptotic convergence rates follow. In the limit of large bandwidths LOrPE is equivalent to orthogonal series density estimation (OSDE) with Legendre polynomials, thereby inheriting its consistency. We compare the performance of LOrPE to KDE, LLDE, and OSDE, in a number of simulation studies. In terms of mean integrated squared error, the results suggest that with a proper balance of the two tuning parameters, bandwidth and degree, LOrPE generally outperforms these competitors when estimating densities with sharply truncated supports.     

Confidence Intervals for Scale

This paper explains the approach to parameter estimation based on the idea of simultaneous models. Instead of using a single shape—as for example the normal distribution—a simultaneous model uses a finite number of distinct shapes F, G, etc. Such simultaneous systems are tools in gauging the finite sample behavior of estimators. And they can be applied in the design of an estimator with prescribed desirable properties. The problem considered in this paper is interval estimation for a scale parameter. We discuss among other things the computation of optimal estimators in simultaneous models and study more closely the case of protecting against heavy-tailed error distributions.     

Analysis of transformation models with right-truncated data

In many applications, statistical data are frequently observed subject to a retrospective sampling criterion resulting in right-truncated data. In this article, a general class of semiparametric transformation models that include proportional hazards model and proportional odds model as special cases is studied for the analysis of right-truncated data. We proposed two estimators for regression coefficients. The first estimator is based on martingale estimating equations. The second estimator is based on the conditional likelihood function given the truncation times. The asymptotic properties of both estimators are derived. The finite sample performance is examined through a simulation study.     

Nonparametric recursive estimation in stationary markov processes

This paper deals with a class of recursive kernel estimators of the transition probability density function t(y|x) of a stationary Markov process. A sufficient condition for such estimators to be weakly and strongly 2 consistent for almost all (x,y)∈R² is given. Further an L, convergence result is obtained. No continuity conditions are imposed on t(y|x).     

Understanding Estimators of Treatment Effects in Regression Discontinuity Designs

In this paper, we propose two new estimators of treatment effects in regression discontinuity designs. These estimators can aid understanding of the existing estimators such as the local polynomial estimator and the partially linear estimator. The first estimator is the partially polynomial estimator which extends the partially linear estimator by further incorporating derivative differences of the conditional mean of the outcome on the two sides of the discontinuity point. This estimator is related to the local polynomial estimator by a relocalization effect. Unlike the partially linear estimator, this estimator can achieve the optimal rate of convergence even under broader regularity conditions. The second estimator is an instrumental variable estimator in the fuzzy design. This estimator will reduce to the local polynomial estimator if higher order endogeneities are neglected. We study the asymptotic properties of these two estimators and conduct simulation studies to confirm the theoretical analysis.     

Series estimation for single‐index models under constraints

In this paper, a semi‐parametric single‐index model is investigated. The link function is allowed to be unbounded and has unbounded support that answers a pending issue in the literature. Meanwhile, the link function is treated as a point in an infinitely many dimensional function space which enables us to derive the estimates for the index parameter and the link function simultaneously. This approach is different from the profile method commonly used in the literature. The estimator is derived from an optimisation with the constraint of identification condition for the index parameter, which addresses an important problem in the literature of single‐index models. In addition, making use of a property of Hermite orthogonal polynomials, an explicit estimator for the index parameter is obtained. Asymptotic properties for the two estimators of the index parameter are established. Their efficiency is discussed in some special cases as well. The finite sample properties of the two estimates are demonstrated through an extensive Monte Carlo study and an empirical example.     

Stabilizing the Performance of Kurtosis Estimator of Multivariate Data

The estimation of the kurtosis parameter of the underlying distribution plays a central role in many statistical applications. The central theme of the article is to improve the estimation of the kurtosis parameter using a priori information. More specifically, we consider the problem of estimating kurtosis parameter of a multivariate population when some prior information regarding the the parameter is available. The rationale is that the sample estimator of the kurtosis parameter has a large estimation error. In this situation we consider shrinkage and pretest estimation methodologies and reappraise their statistical properties. The estimation based on these strategies yield relatively smaller estimation error in comparison with the sample estimator in the candidate subspace. A large sample theory of the suggested estimators are developed and compared. The results demonstrate that suggested estimators outperform the estimator based on the sample data only in the candidate subspace. In an effort to appreciate the relative behavior of the estimators in a finite sample scenario, a Monte-carlo simulation study is planned and performed. The result of simulation study strongly corroborates the asymptotic result. To illustrate the application of the estimators, some example are showcased based on recently published data.     

Reducing component estimation for varying coefficient models

The estimation problem for varying coefficient models has been studied by many authors. We consider the problem in the case that the unknown functions admit different degrees of smoothness. In this paper we propose a reducing component local polynomial method to estimate the unknown functions. It is shown that all of our estimators achieve the optimal convergence rates. The asymptotic distributions of our estimators are also derived. The established asymptotic results and the simulation results show that our estimators outperform the the existing two-step estimators when the coefficient functions admit different degrees of smoothness. We also develop methods to speed up the estimation of the model and the selection of the bandwidths.     

Robust estimation and design procedures for the random effects model

The authors discuss two robust estimators for estimating variance components in the random effects model, and they obtain finite‐sample breakdown points for the estimators. Based on the finite‐sample breakdown point, they propose a criterion for selecting robust designs. With robust designs, one can get efficient and reliable estimates for variance components regardless of outliers which may happen in the experiment. The authors give examples to show the performance of robust estimators and to compare robust designs with optimal designs based on the traditional analysis of variance estimation method.