Consistent maximum likelihood estimation of a unimodal density using shape restrictions

It is well known that the unimodal maximum likelihood estimator of a density is consistent everywhere but at the mode. The authors review various ways to solve this problem and propose a new estimator that is concave over an interval containing the mode; this interval may be chosen by the user or through an algorithm. The authors show how to implement their solution and compare it to other approaches through simulations. They show that the new estimator is consistent everywhere and determine its rate of convergence in the Hellinger metric.     

Monotonic change point estimation of generalized linear model-based regression profiles

In this article, a maximum likelihood estimator is derived in the generalized linear model-based regression profiles under monotonic change in Phase II. The performance of the proposed estimator is comprehensively investigated through some special cases, and compared with estimators under step change and drift. The results show that the proposed estimator has better performance in small and medium shifts under different increasing changes. Finally, the applicability of the proposed estimator is illustrated using a real case.     

人口数目估计中的独立双系统估计量研究

利用存在统计相依关系的两份人口登记名单构造的非独立双系统估计量是目前估计总体实际人口数的前沿方法。该估计量由最初用于估计一个区域内的野生动物数目的捕获-再捕获模型移植而来。非独立双系统估计量的一个明显缺陷是低估总体实际人口数。用独立双系统估计量替代非独立双系统估计量属于人口数目估计领域的理论创新研究。采用数理分析与实证分析相结合的方法研究独立双系统估计量及其方差估计量。为便于读者理解,通过一个实证案例全面演示了独立双系统估计量的计算过程。研究表明,独立双系统估计量所估计的人口数平均接近于实际人口数,建议在未来人口数目估计中应用独立双系统估计量。     

Estimation of the Average Survival Function Using a Censored Data Regression Model

In the presence of covariates information, assuming the linear relationship between a transformation of survival time and covariates, we propose a new estimator of survival function and show its consistency. In addition, a comparison of the proposed estimator with the product-limit estimator introduced by Kaplan and Meier (1958) is performed through Monte Carlo simulation studies. We illustrate the proposed estimator with the updated Stanford heart transplant data.     

Second-order least squares estimation of censored regression models

This paper proposes the second-order least squares estimation, which is an extension of the ordinary least squares method, for censored regression models where the error term has a general parametric distribution (not necessarily normal). The strong consistency and asymptotic normality of the estimator are derived under fairly general regularity conditions. We also propose a computationally simpler estimator which is consistent and asymptotically normal under the same regularity conditions. Finite sample behavior of the proposed estimators under both correctly and misspecified models are investigated through Monte Carlo simulations. The simulation results show that the proposed estimator using optimal weighting matrix performs very similar to the maximum likelihood estimator, and the estimator with the identity weight is more robust against the misspecification.     

Empirical likelihood inference for a common mean in the presence of heteroscedasticity

The authors develop empirical likelihood (EL) based methods of inference for a common mean using data from several independent but nonhomogeneous populations. For point estimation, they propose a maximum empirical likelihood (MEL) estimator and show that it is n‐consistent and asymptotically optimal. For confidence intervals, they consider two EL based methods and show that both intervals have approximately correct coverage probabilities under large samples. Finite‐sample performances of the MEL estimator and the EL based confidence intervals are evaluated through a simulation study. The results indicate that overall the MEL estimator and the weighted EL confidence interval are superior alternatives to the existing methods.     

A more efficient mean estimator for judgement post-stratification

Meeden and Lee [More efficient inferences using ranking information obtained from judgment sampling. J Surv Stat Methodol. 2014;2:38–57] recently showed that one can improve upon the standard unbiased mean estimator for judgement post-stratification (JPS) by using the ordering information in the sample. We propose an alternate mean estimator that uses this same information. This alternate estimator is far simpler to compute than the estimator of Meeden and Lee (2014), and we show through simulations that it typically outperforms the Meeden and Lee (2014) estimator in cases where the rankings are sufficiently good that JPS is useful.     

A Class of Sampling Two Units with Probability Proportional to Size

A class of sampling two units without replacement with inclusion probability proportional to size is proposed in this article. Many different well known probability proportional to size sampling designs are special cases from this class. The first and second inclusion probabilities of this class satisfy important properties and provide a non-negative variance estimator of the Horvitz and Thompson estimator for the population total. Suitable choice for the first and second inclusion probabilities from this class can be used to reduce the variance estimator of the Horvitz and Thompson estimator. Comparisons between different proportional to size sampling designs through real data and artificial examples are given. Examples show that the minimum variance of the Horvitz and Thompson estimator obtained from the proposed design is not attainable for the most cases at any of the well known designs.     

Robust estimation for zero-inflated poisson autoregressive models based on density power divergence

In this study, we consider a robust estimation for zero-inflated Poisson autoregressive models using the minimum density power divergence estimator designed by Basu et al. [Robust and efficient estimation by minimising a density power divergence. Biometrika. 1998;85:549–559]. We show that under some regularity conditions, the proposed estimator is strongly consistent and asymptotically normal. The performance of the estimator is evaluated through Monte Carlo simulations. A real data analysis using New South Wales crime data is also provided for illustration.     

Asymptotic Properties of Marginal Least-Square Estimator for Ultrahigh-Dimensional Linear Regression Models with Correlated Errors

In this article, we discuss asymptotic properties of marginal least-square estimator for ultrahigh-dimensional linear regression models. We are specifically interested in probabilistic consistency of the marginal least-square estimator in the presence of correlated errors. We show that under a partial orthogonality condition, the marginal least-square estimator can achieve variable selection consistency. In addition, we demonstrate that if a mutual orthogonality holds, the marginal least-square estimator satisfies estimation consistency. The discussed theories are exemplified through extensive simulation studies.     

A Semiparametric Estimation Approach for Linear Mixed Models

Maximum likelihood approach is the most frequently employed approach for the inference of linear mixed models. However, it relies on the normal distributional assumption of the random effects and the within-subject errors, and it is lack of robustness against outliers. This article proposes a semiparametric estimation approach for linear mixed models. This approach is based on the first two marginal moments of the response variable, and does not require any parametric distributional assumptions of random effects or error terms. The consistency and asymptotically normality of the estimator are derived under fairly general conditions. In addition, we show that the proposed estimator has a bounded influence function and a redescending property so it is robust to outliers. The methodology is illustrated through an application to the famed Framingham cholesterol data. The finite sample behavior and the robustness properties of the proposed estimator are evaluated through extensive simulation studies.     

Likelihood-based Estimation of the Regression Model with Scrambled Responses

A significant problem in the collection of responses to potentially sensitive questions, such as relating to illegal, immoral or embarrassing activities, is non-sampling error due to refusal to respond or false responses. Eichhorn & Hayre (1983) suggested the use of scrambled responses to reduce this form of bias. This paper considers a linear regression model in which the dependent variable is unobserved but for which the sum or product with a scrambling random variable of known distribution, is known. The performance of two likelihood-based estimators is investigated, namely of a Bayesian estimator achieved through a Markov chain Monte Carlo (MCMC) sampling scheme, and a classical maximum-likelihood estimator. These two estimators and an estimator suggested by Singh, Joarder & King (1996) are compared. Monte Carlo results show that the Bayesian estimator out-performs the classical estimators in all cases, and the relative performance of the Bayesian estimator improves as the responses become more scrambled.     

On Bayesian estimators in multistage binomial designs

A new class of Bayesian estimators for a proportion in multistage binomial designs is considered. Priors belong to the beta-J distribution family, which is derived from the Fisher information associated with the design. The transposition of the beta parameters of the Haldane and the uniform priors in fixed binomial experiments into the beta-J distribution yields bias-corrected versions of these priors in multistage designs. We show that the estimator of the posterior mean based on the corrected Haldane prior and the estimator of the posterior mode based on the corrected uniform prior have good frequentist properties. An easy-to-use approximation of the estimator of the posterior mode is provided. The new Bayesian estimators are compared to Whitehead's and the uniformly minimum variance estimators through several multistage designs. Last, the bias of the estimator of the posterior mode is derived for a particular case.     

Functional calibration estimation by the maximum entropy on the mean principle

We extend the problem of obtaining an estimator for the finite population mean parameter incorporating complete auxiliary information through calibration estimation in survey sampling under a functional data framework. The functional calibration sampling weights of the estimator are obtained by matching the calibration estimation problem with the maximum entropy on the mean – MEM – principle. In particular, the calibration estimation is viewed as an infinite-dimensional linear inverse problem following the structure of the MEM approach. We give a precise theoretical setting and estimate the functional calibration weights assuming, as prior measures, the centred Gaussian and compound Poisson random measures. Additionally, through a simple simulation study, we show that the proposed functional calibration estimator improves its accuracy compared with the Horvitz–Thompson one.     

Asymptotic expansion for nonparametric M-estimator in a nonlinear regression model with long-memory errors

We consider asymptotic expansion of the nonparametric M-estimator in a fixed-design nonlinear regression model when the errors are generated by long-memory linear processes. Under mild conditions, we show that the nonparametric M-estimator is first-order equivalent to the Nadaraya-Watson (NW) estimator, which implies that the nonparametric M-estimator has the same asymptotic distribution as that of the NW estimator. Furthermore, we study the second-order asymptotic expansion of the nonparametric M-estimator and show that the difference between the nonparametric M-estimator and the NW estimator has a limiting distribution after suitable standardization. The nature of the limiting distribution depends on the range of long-memory parameter α. We also compare the finite sample behavior of the two estimators through a numerical example when the errors are long-memory.     

On multivariate separating Hill estimator under estimated location and scatter

We consider estimating the tail-index of a distribution under the assumption of multivariate ellipticity. Recently, a separating Hill estimator for multivariate elliptical distributions was proposed. This estimator is an affine invariant alternative to using the marginal observations in tail-index estimation and is hence unaffected by, e.g. change of units of measurement. However, the separating Hill estimator depends on the location and scatter of the elliptical distribution, which, in practice, have to be estimated. The effect of replacing the true location and scatter of the distribution by estimates has previously been only examined through simulations. In this article we show that the error caused by replacing the location and scatter of the distribution by estimates indeed is asymptotically negligible. This fact is essential for the practicality of the separating Hill estimator. In addition to providing the theoretical results, we present simulation results on the asymptotic behaviour of the estimators.     

Variable selection in the high-dimensional continuous generalized linear model with current status data

In survival studies, current status data are frequently encountered when some individuals in a study are not successively observed. This paper considers the problem of simultaneous variable selection and parameter estimation in the high-dimensional continuous generalized linear model with current status data. We apply the penalized likelihood procedure with the smoothly clipped absolute deviation penalty to select significant variables and estimate the corresponding regression coefficients. With a proper choice of tuning parameters, the resulting estimator is shown to be a root n/p_n-consistent estimator under some mild conditions. In addition, we show that the resulting estimator has the same asymptotic distribution as the estimator obtained when the true model is known. The finite sample behavior of the proposed estimator is evaluated through simulation studies and a real example.     

Adaptive Nonparametric Comparison of Regression Curves

In this article, we develop a new and novel kernel density estimator for a sum of weighted averages from a single population based on utilizing the well defined kernel density estimator in conjunction with classic inversion theory. This idea is further developed for a kernel density estimator for the difference of weighed averages from two independent populations. The resulting estimator is “bootstrap-like” in terms of its properties with respect to the derivation of approximate confidence intervals via a “plug-in” approach. This new approach is distinct from the bootstrap methodology in that it is analytically and computationally feasible to provide an exact estimate of the distribution function through direct calculation. Thus, our approach eliminates the error due to Monte Carlo resampling that arises within the context of simulation based approaches that are oftentimes necessary in order to derive bootstrap-based confidence intervals for statistics involving weighted averages of i.i.d. random variables. We provide several examples and carry forth a simulation study to show that our kernel density estimator performs better than the standard central limit theorem based approximation in term of coverage probability.     

Covariate adjustment and estimation of mean response in randomised trials

Analyses of randomised trials are often based on regression models which adjust for baseline covariates, in addition to randomised group. Based on such models, one can obtain estimates of the marginal mean outcome for the population under assignment to each treatment, by averaging the model‐based predictions across the empirical distribution of the baseline covariates in the trial. We identify under what conditions such estimates are consistent, and in particular show that for canonical generalised linear models, the resulting estimates are always consistent. We show that a recently proposed variance estimator underestimates the variance of the estimator around the true marginal population mean when the baseline covariates are not fixed in repeated sampling and provide a simple adjustment to remedy this. We also describe an alternative semiparametric estimator, which is consistent even when the outcome regression model used is misspecified. The different estimators are compared through simulations and application to a recently conducted trial in asthma.     

Application of Bernstein Polynomials for smooth estimation of a distribution and density function

The empirical distribution function is known to have optimum properties as an estimator of the underlying distribution function. However, it may not be appropriate for estimating continuous distributions because of its jump discontinuities. In this paper, we consider the application of Bernstein polynomials for approximating a bounded and continuous function and show that it can be naturally adapted for smooth estimation of a distribution function concentrated on the interval [0,1] by a continuous approximation of the empirical distribution function. The smoothness of the approximating polynomial is further used in deriving a smooth estimator of the corresponding density. The asymptotic properties of the resulting estimators are investigated. Specifically, we obtain strong consistency and asymptotic normality under appropriate choice of the degree of the polynomial. The case of distributions with other compact and non-compact support can be dealt through transformations. Thus, this paper gives a general method for non-parametric density estimation as an alternative to the current estimators. A small numerical investigation shows that the estimator proposed here may be preferable to the popular kernel-density estimator.