Local polynomial estimation of Poisson intensities in the presence of reporting delays

Summary.  The system for monitoring suicides in Hong Kong has considerable delays in reporting as the cause of death needs to be determined by a coroner's investigation. However, timely estimates of suicide rates are desirable to assist in the formulation of public health policies. This motivated us to develop a non-parametric procedure to estimate the intensity function of a Poisson process in the presence of reporting delays. We give closed form estimators of the Poisson intensity and the delay distribution, conduct simulation studies to evaluate the method proposed and derive their asymptotic properties. The method proposed is applied to estimate the intensity of suicide in Hong Kong.     

Approximation of density functions by orthogonal series with grouped data

Summary Letg(x) andf(x) be continuous density function on (a, b) and let {ϕ_j} be a complete orthonormal sequence of functions onL ₂(g), which is the set of squared integrable functions weighted byg on (a, b). Suppose that over (a, b). Given a grouped sample of sizen fromf(x), the paper investigates the asymptotic properties of the restricted maximum likelihood estimator of density, obtained by setting all but the firstm of the ϑ_j’s equal to0. Practical suggestions are given for performing estimation via the use of Fourier and Legendre polynomial series. Research partially supported by: CNR grant, n. 93. 00837. CT10.     

Results concerning the generalized partially linear single-index model

The central topic of this article is the estimation of parameters of the generalized partially linear single-index model (GPLSIM). Two numerical optimization procedures are presented and an S-plus program based on these procedures is compared to a program by Wand in a simulation setting. The results from these simulations indicate that the estimates for the new procedures are as good, if not better, than Wand's. Also, this program is much more flexible than Wand's since it can handle more general models. Other simulations are also conducted. The first compares the effects of using linear interpolation versus spline interpolation in an optimization procedure. The results indicate that by using spline interpolation one gets more stable estimates at a cost of increased computational time. A second simulation was conducted to assess the performance of a method for estimating the variance of alpha. A third set of simulations is carried out to determine the best criterion for testing that one of the elements of alpha is equal to zero. The GPLSIM is applied to a water quality data set and the results indicate an interesting relationship between gastrointestinal illness and turbidity (cloudiness) of drinking water.     

Toward an integrated Bayesian network approach to measurement error detection and correction

In this article, the quality of data produced by national statistical institutes and by governmental institutions is considered. In particular, the problem of measurement error is analyzed and an integrated Bayesian network decision support system based on non-parametric Bayesian networks is proposed for its detection and correction. Non-parametric Bayesian networks are graphical models expressing dependence structure via bivariate copulas associated to the edges of the graph. The network structure and the misreport probability are estimated using a validation sample. The Bayesian network model is proposed to decide: (i) which records have to be corrected; (ii) the kind and amount of correction to be adopted. The proposed correction procedure is applied to the Banca d’Italia Survey on Household Income and Wealth and, specifically, the bond amounts are analyzed. Finally, the sensitivity of the conditional distribution of the true value random variable given the observed one to different evidence configurations is studied.     

Recovery of functions from transformed moments: A unified approach

Two approximations recovering the functions from their transformed moments are proposed. The upper bounds for the uniform rate of convergence are derived. In addition, the comparisons of the estimates of the cumulative distribution function and its density function with the empirical distribution and the kernel density estimates are conducted via a simulation study. The plots of recovered functions are presented for several examples as well.     

Exponential tilt models for two-group comparison with censored data

We study application of the Exponential Tilt Model (ETM) to compare survival distributions in two groups. The ETM assumes a parametric form for the density ratio of the two distributions. It accommodates a broad array of parametric models such as the log-normal and gamma models and can be sufficiently flexible to allow for crossing hazard and crossing survival functions. We develop a nonparametric likelihood approach to estimate ETM parameters in the presence of censoring and establish related asymptotic results. We compare the ETM to the Proportional Hazards Model (PHM) in simulation studies. When the proportional hazards assumption is not satisfied but the ETM assumption is, the ETM has better power for testing the hypothesis of no difference between the two groups. And, importantly, when the ETM relation is not satisfied but the PHM assumption is, the ETM can still have power reasonably close to that of the PHM. Application of the ETM is illustrated by a gastrointestinal tumor study.     

Semiparametric Bayesian classification with longitudinal markers

Summary.  We analyse data from a study involving 173 pregnant women. The data are observed values of the β human chorionic gonadotropin hormone measured during the first 80 days of gestational age, including from one up to six longitudinal responses for each woman. The main objective in this study is to predict normal versus abnormal pregnancy outcomes from data that are available at the early stages of pregnancy. We achieve the desired classification with a semiparametric hierarchical model. Specifically, we consider a Dirichlet process mixture prior for the distribution of the random effects in each group. The unknown random-effects distributions are allowed to vary across groups but are made dependent by using a design vector to select different features of a single underlying random probability measure. The resulting model is an extension of the dependent Dirichlet process model, with an additional probability model for group classification. The model is shown to perform better than an alternative model which is based on independent Dirichlet processes for the groups. Relevant posterior distributions are summarized by using Markov chain Monte Carlo methods.     

基于生存分析的边境地区人口外流及影响研究

本文依据国家计生委2011年对吉林省中朝边境地区人口流动的抽样调查数据,运用非参数及半参数的生存分析模型对外流人口特征、流动影响因素进行研究,同时分析了人口外流对该地区经济及社会发展的影响。实证结果表明：年轻、受过良好教育的个体是外流人口中的主力,且韩国为其主要流入地;民族因素显著的影响个体选择,但性别影响并不显著;最后,尽管外出个体汇款对该地区GDP有一定贡献,但劳动力的严重流失不仅抑制了当地经济长期发展,同时也导致了人口老龄化等社会问题。因此,为了发展地方特色经济,当地政府在为吸引高端人才、招商引资创造条件的同时,还应采取措施避免受过良好教育的劳动力进一步外流,以期促进当地经济持续发展。     

Sparse additive models

Summary.  We present a new class of methods for high dimensional non-parametric regression and classification called sparse additive models. Our methods combine ideas from sparse linear modelling and additive non-parametric regression. We derive an algorithm for fitting the models that is practical and effective even when the number of covariates is larger than the sample size. Sparse additive models are essentially a functional version of the grouped lasso of Yuan and Lin. They are also closely related to the COSSO model of Lin and Zhang but decouple smoothing and sparsity, enabling the use of arbitrary non-parametric smoothers. We give an analysis of the theoretical properties of sparse additive models and present empirical results on synthetic and real data, showing that they can be effective in fitting sparse non-parametric models in high dimensional data.     

Non-parametric recursive estimates of a probability density function and its derivatives

Recursive estimates of a probability density function (pdf) are known. This paper presents recursive estimates of a derivative of any desired order of a pdf. Let f be a pdf on the real line and p?0 be any desired integer. Based on a random sample of size n from f, estimators f^(p)_n of f^(p), the pth order derivatives of f, are exhibited. These estimators are of the form $\text{n}{}^{\mathrm{?1}}\text{∑n}\text{j=1}\text{δ}{}_{\mathrm{jp}}$, where δ_jp depends only on p and the jth observation in the sample, and hence can be computed recursively as the sample size increases. These estimators are shown to be asymptotically unbiased, mean square consistent and strongly consistent, both at a point and uniformly on the real line. For pointwise properties, the conditions on f^(p) have been weakened with a little stronger assumption on the kernel function.