Wavelets for Nonparametric Stochastic Regression with Mixing Stochastic Process

We propose a wavelet based stochastic regression function estimator for the estimation of the regression function for a sequence of mixing stochastic process with a common one-dimensional probability density function. Some asymptotic properties of the proposed estimator are investigated. It is found that the estimators have similar properties to their counterparts studied earlier in literature.     

Inference for Mixtures

In this article, we consider the problem of estimating certain “parameters” in a mixture of probability measures. We show that a single sample is typically suitable for estimating the component measures, but not suitable for estimating the mixing measures, especially when consistency is required. To have consistent estimators of the mixing measure, several samples with increasing size are needed in general.     

Nonparametric estimation of the derivatives of a density by the method of wavelet for mixing sequences

The problem of estimation of the derivative of a probability density f is considered, using wavelet orthogonal bases. We consider an important kind of dependent random variables, the so-called mixing random variables and investigate the precise asymptotic expression for the mean integrated error of the wavelet estimators. We show that the mean integrated error of the proposed estimator attains the same rate as when the observations are independent, under certain week dependence conditions imposed to the {X _i }, defined in {Ω, N, P}.     

Estimating the parameters of a bathtub-shaped distribution under progressive type-II censoring

We consider the problem of estimating unknown parameters, reliability function and hazard function of a two parameter bathtub-shaped distribution on the basis of progressive type-II censored sample. The maximum likelihood estimators and Bayes estimators are derived for two unknown parameters, reliability function and hazard function. The Bayes estimators are obtained against squared error, LINEX and entropy loss functions. Also, using the Lindley approximation method we have obtained approximate Bayes estimators against these loss functions. Some numerical comparisons are made among various proposed estimators in terms of their mean square error values and some specific recommendations are given. Finally, two data sets are analyzed to illustrate the proposed methods.     

Nonparametric regression estimates with censored data based on block thresholding method

Here we consider wavelet-based identification and estimation of a censored nonparametric regression model via block thresholding methods and investigate their asymptotic convergence rates. We show that these estimators, based on block thresholding of empirical wavelet coefficients, achieve optimal convergence rates over a large range of Besov function classes, and in particular enjoy those rates without the extraneous logarithmic penalties that are usually suffered by term-by-term thresholding methods. This work is extension of results in Li et al. (2008). The performance of proposed estimator is investigated by a numerical study.     

Reweighted estimators for additive hazard model with censoring indicators missing at random

Survival data with missing censoring indicators are frequently encountered in biomedical studies. In this paper, we consider statistical inference for this type of data under the additive hazard model. Reweighting methods based on simple and augmented inverse probability are proposed. The asymptotic properties of the proposed estimators are established. Furthermore, we provide a numerical technique for checking adequacy of the fitted model with missing censoring indicators. Our simulation results show that the proposed estimators outperform the simple and augmented inverse probability weighted estimators without reweighting. The proposed methods are illustrated by analyzing a dataset from a breast cancer study.     

Optimal spacing of quantiles for the estimation of the mixing parameters in a mixture of two exponential distributions

Methods for estimating the mixing parameters in a mixture of two exponential distributions are proposed. The estimators proposed are consistent and BAN(best asymptotically normal). The optimal spacings for estimating these mixture parameters are calculated.     

On simple wavelet estimators of random signals and their small-sample properties

In the paper we suggest certain nonparametric estimators of random signals based on the wavelet transform. We consider stochastic signals embedded in white noise and extractions with wavelet denoizing algorithms utilizing the non-decimated discrete wavelet transform and the idea of wavelet scaling. We evaluate properties of these estimators via extensive computer simulations and partially also analytically. Our wavelet estimators of random signals have clear advantages over parametric maximum likelihood methods as far as computational issues are concerned, while at the same time they can compete with these methods in terms of precision of estimation in small samples. An illustrative example concerning smoothing of survey data is also provided.     

A semi-parametric cox’s regression model for zero-inflated left-censored time to event data

Abstract

In some clinical, environmental, or economical studies, researchers are interested in a semi-continuous outcome variable which takes the value zero with a discrete probability and has a continuous distribution for the non-zero values. Due to the measuring mechanism, it is not always possible to fully observe some outcomes, and only an upper bound is recorded. We call this left-censored data and observe only the maximum of the outcome and an independent censoring variable, together with an indicator. In this article, we introduce a mixture semi-parametric regression model. We consider a parametric model to investigate the influence of covariates on the discrete probability of the value zero. For the non-zero part of the outcome, a semi-parametric Cox’s regression model is used to study the conditional hazard function. The different parameters in this mixture model are estimated using a likelihood method. Hereby the infinite dimensional baseline hazard function is estimated by a step function. As results, we show the identifiability and the consistency of the estimators for the different parameters in the model. We study the finite sample behaviour of the estimators through a simulation study and illustrate this model on a practical data example.     

Proportional hazards model for competing risks data with missing cause of failure

We consider the semiparametric proportional hazards model for the cause-specific hazard function in analysis of competing risks data with missing cause of failure. The inverse probability weighted equation and augmented inverse probability weighted equation are proposed for estimating the regression parameters in the model, and their theoretical properties are established for inference. Simulation studies demonstrate that the augmented inverse probability weighted estimator is doubly robust and the proposed method is appropriate for practical use. The simulations also compare the proposed estimators with the multiple imputation estimator of Lu and Tsiatis (2001). The application of the proposed method is illustrated using data from a bone marrow transplant study.     

Semiparametric Mixtures of Symmetric Distributions

We consider in this paper the semiparametric mixture of two unknown distributions equal up to a location parameter. The model is said to be semiparametric in the sense that the mixed distribution is not supposed to belong to a parametric family. To insure the identifiability of the model, it is assumed that the mixed distribution is zero symmetric, the model being then defined by the mixing proportion, two location parameters and the probability density function of the mixed distribution. We propose a new class of M‐estimators of these parameters based on a Fourier approach and prove that they are ‐consistent under mild regularity conditions. Their finite sample properties are illustrated by a Monte Carlo study, and a benchmark real dataset is also studied with our method.     

Wavelet-based estimation of regression function with strong mixing errors under fixed design

We consider wavelet-based non linear estimators, which are constructed by using the thresholding of the empirical wavelet coefficients, for the mean regression functions with strong mixing errors and investigate their asymptotic rates of convergence. We show that these estimators achieve nearly optimal convergence rates within a logarithmic term over a large range of Besov function classes B^s_{p, q}. The theory is illustrated with some numerical examples.

A new ingredient in our development is a Bernstein-type exponential inequality, for a sequence of random variables with certain mixing structure and are not necessarily bounded or sub-Gaussian. This moderate deviation inequality may be of independent interest.     

Parametric estimation of mixtures of two uniform distributions

In this paper, we consider a mixture of two uniform distributions and derive L-moment estimators of its parameters. Three possible ways of mixing two uniforms, namely with neither overlap nor gap, with overlap, and with gap, are studied. The performance of these L-moment estimators in terms of bias and efficiency is compared to that obtained by means of the conventional method of moments (MM), modified maximum likelihood (MML) method and the usual maximum likelihood (ML) method. These intensive simulations reveal that MML estimators are the best in most of the cases, and the L-moment estimators are less subject to bias in estimation for some mixtures and more efficient in most of the cases than the conventional MM estimators. The L-moment estimators are, in some cases, more efficient than the ML and MML estimators.     

Nonparametric estimation of the bivariate survival function with left-truncated and right-censored data

In this note, we consider estimating the bivariate survival function when both components are subject to left truncation and right censoring. We propose two types of estimators as generalizations of the Dabrowska and Campbell and Földes estimators. The consistency of the proposed estimators is established. A simple bootstrap method is used for obtaining precision estimation of the proposed estimators. A simulation study is conducted to investigate the performance of the proposed estimators.     

Bernstein conditional density estimation with application to conditional distribution and regression functions

In this paper we propose a smooth nonparametric estimation for the conditional probability density function based on a Bernstein polynomial representation. Our estimator can be written as a finite mixture of beta densities with data-driven weights. Using the Bernstein estimator of the conditional density function, we derive new estimators for the distribution function and conditional mean. We establish the asymptotic properties of the proposed estimators, by proving their asymptotic normality and by providing their asymptotic bias and variance. Simulation results suggest that the proposed estimators can outperform the Nadaraya–Watson estimator and, in some specific setups, the local linear kernel estimators. Finally, we use our estimators for modeling the income in Italy, conditional on year from 1951 to 1998, and have another look at the well known Old Faithful Geyser data.     

Estimation of the bivariate cause-specific distribution function with doubly censored competing risks data

In this article, we consider estimating the bivariate cause-specific distribution function when both components are subject to double censoring. We propose two types of estimators as generalizations of the Dabrowska and Campbell and Földes estimators. The asymptotical properties of the proposed estimators are established. A simulation study is conducted to investigate the performance of the proposed estimators.     

Cure-rate estimation under Case-1 interval censoring

We consider nonparametric estimation of cure-rate based on mixture model under Case-1 interval censoring. We show that the nonparametric maximum-likelihood estimator (NPMLE) of cure-rate is non-unique as well as inconsistent, and propose two estimators based on the NPMLE of the distribution function under this censoring model. We present a cross-validation method for choosing a ‘cut-off’ point needed for the estimators. The limiting distributions of the latter are obtained using extreme-value theory. Graphical illustration of the procedures based on simulated data is provided.     

Efficient inverse probability weighting method for quantile regression with nonignorable missing data

Quantitle regression (QR) is a popular approach to estimate functional relations between variables for all portions of a probability distribution. Parameter estimation in QR with missing data is one of the most challenging issues in statistics. Regression quantiles can be substantially biased when observations are subject to missingness. We study several inverse probability weighting (IPW) estimators for parameters in QR when covariates or responses are subject to missing not at random. Maximum likelihood and semiparametric likelihood methods are employed to estimate the respondent probability function. To achieve nice efficiency properties, we develop an empirical likelihood (EL) approach to QR with the auxiliary information from the calibration constraints. The proposed methods are less sensitive to misspecified missing mechanisms. Asymptotic properties of the proposed IPW estimators are shown under general settings. The efficiency gain of EL-based IPW estimator is quantified theoretically. Simulation studies and a data set on the work limitation of injured workers from Canada are used to illustrated our proposed methodologies.     

Estimation and prediction for a Burr type-III distribution with progressive censoring

We consider estimation of unknown parameters and reliability characteristics of a Burr type-III distribution under progressive censoring. Predictive estimates for censored observations and the associated prediction intervals are also obtained. We derive maximum-likelihood estimators of unknown quantities using the EM algorithm and then also obtain the observed Fisher information matrix. We provide various Bayes estimators for unknown parameters under the squared error loss function. Highest posterior density and asymptotic intervals are also constructed. We evaluate performance of proposed methods using simulations. Finally, an illustrative example is presented in support of the methods discussed.     

Amplitude modulated model for analyzing non-stationary speech signals

Recently amplitude modulated (AM) model in presence of additive white noise was used to analyze certain non-stationary speech data. It is observed that the assumption of white noise may not be proper in many cases. In this article, we consider the AM signal model in presence of stationary noise. We consider the least squares estimators and the estimators obtained by maximizing the Periodogram function. The two estimators are asymptotically equivalent. We study the theoretical properties of both estimators and observe their performances through numerical simulations. One speech data is analyzed and it is observed that the performance of the proposed estimators is quite satisfactory.