Adaptive Estimation Using Weighted Least Squares

This paper proposes an adaptive estimator that is more precise than the ordinary least squares estimator if the distribution of random errors is skewed or has long tails. The adaptive estimates are computed using a weighted least squares approach with weights based on the lengths of the tails of the distribution of residuals. Smaller weights are assigned to those observations that have residuals in the tails of long-tailed distributions and larger weights are assigned to observations having residuals in the tails of short-tailed distributions. Monte Carlo methods are used to compare the performance of the proposed estimator and the performance of the ordinary least squares estimator. The estimates that were studied in this simulation include the difference between the means of two populations, the mean of a symmetric distribution, and the slope of a regression line. The adaptive estimators are shown to have lower mean squared errors than those for the ordinary least squares estimators for short-tailed, long-tailed, and skewed distributions, provided the sample size is at least 20. The ordinary least squares estimator has slightly lower mean squared error for normally distributed errors. The adaptive estimator is recommended for general use for studies having sample sizes of at least 20 observations unless the random errors are known to be normally distributed.     

Estimation of finite population mean in stratified sampling using scrambled responses in the presence of measurement errors

This study focuses on the estimation of population mean of a sensitive variable in stratified random sampling based on randomized response technique (RRT) when the observations are contaminated by measurement errors (ME). A generalized estimator of population mean is proposed by using additively scrambled responses for the sensitive variable. The expressions for the bias and mean square error (MSE) of the proposed estimator are derived. The performance of the proposed estimator is evaluated both theoretically and empirically. Results are also applied to a real data set.     

Consistent Estimation of the Regression Coefficient Through Weighted Arithmetic Mean of the Inconsistent Estimators in Replicated Ultrastructural Model

The problem of consistent estimation of the slope parameter in an ultrastructural model with replicated observations is considered in this article. A consistent estimator based on a weighted arithmetic mean of two inconsistent least squares estimators is proposed which is independent of any unknown quantity. The efficiency properties of this estimator are studied.     

An Equivalence of Conditional and Unconditional Maximum Likelihood Estimators via Infinite Replication of Observations

Motivated by an application with complex survey data, we show that for logistic regression with a simple matched-pairs design, infinitely replicating observations and maximizing the conditional likelihood results in an estimator exactly identical to the unconditional maximum likelihood estimator based on the original sample, which is inconsistent. Therefore, applying conditional likelihood methods to a pseudosample with observations replicated a large number of times can lead to an inconsistent estimator; this casts doubt on one possible approach to conditional logistic regression with complex survey data. We speculate that for more general designs, an asymptotic equivalence holds.     

Semiparametric regression estimation for longitudinal data in models with martingale difference error's structure

An inherent characteristic of longitudinal data is the dependence among the observations within the same subject. For exhibiting dependencies among the observations within the same subject, this paper considers a semiparametric partially linear regression model for longitudinal data based on martingale difference error's structure. We establish a strong consistency for the least squares estimator of a parametric component and the estimator of a non-parametric function under some mild conditions. A simulation study shows the performance of the proposed estimator in finite samples.     

Maximum likelihood drift estimation for a threshold diffusion

We study the maximum likelihood estimator of the drift parameters of a stochastic differential equation, with both drift and diffusion coefficients constant on the positive and negative axis, yet discontinuous at zero. This threshold diffusion is called drifted oscillating Brownian motion. For this continuously observed diffusion, the maximum likelihood estimator coincides with a quasi-likelihood estimator with constant diffusion term. We show that this estimator is the limit, as observations become dense in time, of the (quasi)-maximum likelihood estimator based on discrete observations. In long time, the asymptotic behaviors of the positive and negative occupation times rule the ones of the estimators. Differently from most known results of the literature, we do not restrict ourselves to the ergodic framework: indeed, depending on the signs of the drift, the process may be ergodic, transient, or null recurrent. For each regime, we establish whether or not the estimators are consistent; if they are, we prove the convergence in long time of the properly rescaled difference of the estimators towards a normal or mixed normal distribution. These theoretical results are backed by numerical simulations.     

Asymptotic misspecification biases for heckman's two step estimator

Asymptotic bias formulae are obtained for Heckman's two step estimator under misspecification of the single equation Tobit modelj and the two equation sample selection model. Asymptotic biases are also obtained for the ordinary least squares estimator based on uncensored observations only. Omitted variables, errors in variables, and heteroskedasticity are considered as sources of misspecification. The biases are illustrated by numerical examples, in which the Tobit maximum likelihood estimator is also included. Severe consequences for the two step estimator are indicated.     

A Non‐Parametric Estimator of the Spectral Density of a Continuous‐Time Gaussian Process Observed at Random Times

Abstract. In numerous applications data are observed at random times and an estimated graph of the spectral density may be relevant for characterizing and explaining phenomena. By using a wavelet analysis, one derives a non‐parametric estimator of the spectral density of a Gaussian process with stationary increments (or a stationary Gaussian process) from the observation of one path at random discrete times. For every positive frequency, this estimator is proved to satisfy a central limit theorem with a convergence rate depending on the roughness of the process and the moment of random durations between successive observations. In the case of stationary Gaussian processes, one can compare this estimator with estimators based on the empirical periodogram. Both estimators reach the same optimal rate of convergence, but the estimator based on wavelet analysis converges for a different class of random times. Simulation examples and an application to biological data are also provided.     

Estimation of the linear-plateau segmented regression model in the presence of measurement error

It is well known that when the true values of the independent variable are unobservable due to measurement error, the least squares estimator for a regression model is biased and inconsistent. When repeated observations on each x_i are taken, consistent estimators for the linear-plateau model can be formed. The repeated observations are required to classify each observation to the appropriate line segment. Two cases of repeated observations are treated in detail. First, when a single value of y_i is observed with the repeated observations of x_i the least squares estimator using the mean of the repeated x_i observations is consistent and asymptotically normal. Second, when repeated observations on the pair (x_i, y_i ) are taken the least squares estimator is inconsistent, but two consistent estimators are proposed: one that consistently estimates the bias of the least squares estimator and adjusts accordingly; the second is the least squares estimator using the mean of the repeated observations on each pair.     

A Bayesian nonparametric estimator based on left censored data

Summary This paper introduces a Bayesian nonparametric estimator for an unknown distribution function based on left censored observations. Hjort (1990)/Lo (1993) introduced Bayesian nonparametric estimators derived from beta/beta-neutral processes which allow for right censoring. These processes are taken as priors from the class ofneutral to the right processes (Doksum, 1974). The Kaplan-Meier nonparametric product limit estimator can be obtained from these Bayesian nonparametric estimators in the limiting case of a vague prior. The present paper introduces what can be seen as the correspondingleft beta/beta-neutral process prior which allow for left censoring. The Bayesian nonparametyric estimator is obtained as in the corresponding product limit estimator based on left censored data.     

Estimation of regression parameters in the presence of outliers in the response

In this paper, we consider a regression model with non-spherical covariance structure and outliers in the response. The generalized least squares estimator obtained from the full data set is generally not used in the presence of outliers and an estimator based on only the non-outlying observations is preferred. Here we propose as an estimator a convex combination of the full set and the deleted set estimators and compare its performance with the other two.     

Efficient Covariance Estimation for Asynchronous Noisy High‐Frequency Data

Abstract. We focus on estimating the integrated covariance of log‐price processes in the presence of market microstructure noise. We construct a consistent asymptotically unbiased estimator for the quadratic covariation of two Itô processes in the case where high‐frequency asynchronous discrete returns under market microstructure noise are observed. This estimator is based on synchronization and multi‐scale methods and attains the optimal rate of convergence. A lower bound for the rate of convergence is derived from the local asymptotic normality property of the simpler parametric model with equidistant and synchronous observations. A Monte Carlo study analyses the finite sample size characteristics of our estimator.     

Estimating the correlation coefficient in the presence of correlated observations from a bivariate normal population

Estimation of the correlation coefficient between two variates (p) in the presence of correlated observations from a bivar iate normal population is considered The estimated maximum likelihood estimator (EMLE), an estimate based on the maximum likelihood estimator (MLE), is proposed and studied for the estimation of p For the large sample case , approximate expressions foi the variance and the bias of the Pearson estimate of the correlation coefficient are derived. These expressions suggests that the Pearson’s estimator possesses high mean square error (MSE) in estimating ρ in comparison to the MLE The MSE is particularly high when the observations within clusters aie highly correlated. The Pearson’s estimate, the MLE, and the EMLE aie evaluated in a simulation study This study shows that the proposed EMLE pefoims bettei than the Pearson’s correlation coefficient except when the number of clusters is small.     

Selected Ranked Set Sampling

This paper proposes a sampling procedure called selected ranked set sampling (SRSS), in which only selected observations from a ranked set sample (RSS) are measured. This paper describes the optimal linear estimation of location and scale parameters based on SRSS, and for some distributions it presents the required tables for optimal selections. For these distributions, the optimal SRSS estimators are compared with the other popular simple random sample (SRS) and RSS estimators. In every situation the estimators based on SRSS are found advantageous at least in some respect, compared to those obtained from SRS or RSS. The SRSS method with errors in ranking is also described. The relative precision of the estimator of the population mean is investigated for different degrees of correlations between the actual and erroneous ranking. The paper reports the minimum value of the correlation coefficient between the actual and the erroneous ranking required for achieving better precision with respect to the usual SRS estimator and with respect to the RSS estimator.     

A nonparametric estimator of the number of classes based on a stratified random sample

Under stratified random sampling, we develop a k^th-order bootstrap bias-corrected estimator of the number of classes θ which exist in a study region. This research extends Smith and van Belle’s (1984) first-order bootstrap bias-corrected estimator under simple random sampling. Our estimator has applicability for many settings including: estimating the number of animals when there are stratified capture periods, estimating the number of species based on stratified random sampling of subunits (say, quadrats) from the region, and estimating the number of errors/defects in a product based on observations from two or more types of inspectors. When the differences between the strata are large, utilizing stratified random sampling and our estimator often results in superior performance versus the use of simple random sampling and its bootstrap or jackknife [Burnham and Overton (1978)] estimator. The superior performance is often associated with more observed classes, and we provide insights into optimal designation of the strata and optimal allocation of sample sectors to strata.     

Maximum likeihood estimation of an intraclass correlation in a bivariate normal distribution with missing observations

The maximum likeihood estimate is considered for an intraclass correlation coefficent in a bivariate normal distribution when some observations on either of the varibles are missuing. The estimate is given as the soulution of a polynomial equation of degree seven. An approximate confidence interval and a test procedure for the intraclass correlation are constricted based on an asymptotic variance stabilizing transformation of the resulting estimator. The distributional results are also considered under violation of the normality assumption. A Monte Carlo study was performed to examine the finite sample properties of the maximum likelihood estimator and to evaluate the proposed procedures for hypotheses testing and interval estimation.     

Statistical Inference for a Relative Risk Measure

ABSTRACT

For monitoring systemic risk from regulators’ point of view, this article proposes a relative risk measure, which is sensitive to the market comovement. The asymptotic normality of a nonparametric estimator and its smoothed version is established when the observations are independent. To effectively construct an interval without complicated asymptotic variance estimation, a jackknife empirical likelihood inference procedure based on the smoothed nonparametric estimation is provided with a Wilks type of result in case of independent observations. When data follow from AR-GARCH models, the relative risk measure with respect to the errors becomes useful and so we propose a corresponding nonparametric estimator. A simulation study and real-life data analysis show that the proposed relative risk measure is useful in monitoring systemic risk.     

Efficient Estimation and Robust Inference of Linear Regression Models in the Presence of Heteroscedastic Errors and High Leverage Points

It is common for linear regression models that the error variances are not the same for all observations and there are some high leverage data points. In such situations, the available literature advocates the use of heteroscedasticity consistent covariance matrix estimators (HCCME) for the testing of regression coefficients. Primarily, such estimators are based on the residuals derived from the ordinary least squares (OLS) estimator that itself can be seriously inefficient in the presence of heteroscedasticity. To get efficient estimation, many efficient estimators, namely the adaptive estimators are available but their performance has not been evaluated yet when the problem of heteroscedasticity is accompanied with the presence of high leverage data. In this article, the presence of high leverage data is taken into account to evaluate the performance of the adaptive estimator in terms of efficiency. Furthermore, our numerical work also evaluates the performance of the robust standard errors based on this efficient estimator in terms of interval estimation and null rejection rate (NRR).     

NONPARAMETRIC ESTIMATORS FOR CENSORED CORRELATED DATA

ABSTRACT

In the context of failure time data, over the long run, dependent observations that might be censored are commonly encountered in practice. The main objective of this paper is to make inference about the common marginal distribution of the failure times. To this end, one nonparametric estimator, namely, the Nelson-Aalen estimator is modified to incorporate the dependence among the observations. The modified estimator is the weighted moving average (WMA) version of the existing estimator used for independent data. It has been shown that the new version is better in the sense of minimizing the one-step ahead forecast errors. Also, the new estimator can be used as a crude measure for checking independence among observations.     

Deconvolution Estimation of Onset of Pregnancy with Replicate Observations

In general, the precise date of onset of pregnancy is unknown and may only be estimated from ultrasound biometric measurements of the embryo. We want to estimate the density of the random variables corresponding to the interval between last menstrual period and true onset of pregnancy. The observations correspond to the variables of interest up to an additive noise. We suggest an estimation procedure based on deconvolution. It requires the knowledge of the density of the noise which is not available. But we have at our disposal another specific sample with replicate observations for twin pregnancies. This allows both to estimate the noise density and to improve the deconvolution step. Convergence rates of the final estimator are studied and compared with other settings. Our estimator involves a cut‐off parameter for which we propose a cross‐validation type procedure. Lastly, we estimate the target density in spontaneous pregnancies with an estimation of the noise obtained from replicate observations in twin pregnancies.