Implementation of recursive nonparametric kernel estimation and a monte carlo study on its finite sample properties

The recursive estimator for the conditional mean of a nonparametric regression model with independent observations was thoroughly explored by Ahmad and Lin (1976), and Singh and Ullah (1986). Their studies are mainly concerned with the estimator's asymptotic behaviour. However, they do not include much discussion on the strategy of computing the estimates. In this paper, we provide a convenient implementation of the recursive estimator and examine its finite sample properties through simulation studies. Our study has demonstrated that for relatively short length of recursive updating, the estimates are generally equivalent to their fixed window width counterparts However, we found that substantial recursive updating can seriously lower the estimator's efficiency even though it is a consistent estimator.     

Estimation of a standard measuring error by repeated measurements and sortings

A sorting-and-measuring machine (SMM) measures and sorts (classifies) on-line produced items into several groups according to their size. The measuring devices of the SMM perceive the actual item size with a random error ε and classify the item as being smaller than b iff z+ε<b. Here ε is a normal zero-mean r.v. with unknown standard deviation σ which is the main parameter characterizing the precision and technical condition of an SMM. The paper gives the following method of estimating σ. N₀ items are measured and N₁ of them are recognized by the SMM as belonging to the group a<z≤b. These N₁ items are sorted again and N₂ of them return to this group, these are sorted again, and so on. The estimation of σ is based on the statistics N_m/N_n. Moments of the ratio statistics N_m/N_n and their distributional properties are investigated. It turns out that the expected value of N_m/N_n depends almost linearly on σ which allows us to construct ‘almost’ unbiased estimators of type $\text{σ}\text{?}{}_{\mathrm{mn}}\text{=A}\textcolor{red}{}\text{N}{}_{\mathrm{m}}\text{/N}{}_{\mathrm{n}}\text{+B}$ with good propert including robustness with respect to the distribution of item size. Convex combinations of $\text{σ}\text{?}{}_{\mathrm{mn}}$ statistics are considered to obtain an estimator with minimal variance.     

Biased estimation of a variance

Summary Let , whereX _i are i.i.d. random variables with a finite variance σ² and is the usual estimate of the mean ofX _i. We consider the problem of finding optimal α with respect to the minimization of the expected value of |S ²(σ)−σ²|^k for variousk and with respect to Pitman's nearness criterion. For the Gaussian case analytical results are obtained and for some non-Gaussian cases we present Monte Carlo results regarding Pitman's criteron. This research was supported by Science Fund of Serbia, grant number 04M03, through Mathematical Institute, Belgrade.     

The order statistics of exponential,power function and pareto distributions and some applications

Some relations between the exponential, the Pareto and the Power function distributions and their order statistics are given. These relations are employed to obtain some characterization theorems of Pareto and Power distributions.     

A First-Order Spatial Integer-Valued Autoregressive SINAR(1, 1) Model

Binomial thinning operator has a major role in modeling one-dimensional integer-valued autoregressive time series models. The purpose of this article is to extend the use of such operator to define a new stationary first-order spatial non negative, integer-valued autoregressive SINAR(1, 1) model. We study some properties of this model like the mean, variance and autocorrelation function. Yule-Walker estimator of the model parameters is also obtained. Some numerical results of the model are presented and, moreover, this model is applied to a real data set.     

Information criteria for the predictive evaluation of bayesian models

As a natural successor of the information criteria AIC and ABIC, information criteria for the Bayes models were developed by evaluating the bias of the log likelihood of the predictive distribution as an estimate of its expected log-likelihood. Considering two specific situations for the true distribution, two information criteria, PIC₁ and PIC₂ are derived. Linear Gaussian cases are considered in details and the evaluation of the maximum a posteriori estimator is also considered. By a simple example of estimating the signal to noise ratio, it was shown that the PIC₂ is a good approximation to the expected log-likelihood in the entire region of the signal to noise ratio. On the other hand, PIC₁ performs good only for the smaller values of the variance ratio. For illustration, the problems of trend estimation and seasonal adjustment are considered. Examples show that the hyper-parameters estimated by the new criteria are usually closer to the best ones than those by the ABIC.     

Estimation of sample selection bias models

Econometric models with sample selection biases are widely used in various fields of economics, such as labor economics. The Maximum Likelihood Estimator (MLE) is seldom used to estimate models because of computational difficulty, while Heckman's two-step estimator is widely used to estimate these models. However, Heckman's two-step estimator sometimes performs poorly. In this paper, methods of calculating the MLE are analysed, and finite sample properties of the MLE and Heckman's two-step estimator are compared using Monte Carlo experiments and empirical examples.     

A necessary and sufficient condition for an estimator to be optimal

A necessary condition for an estimator δ₀ to be optimal in a class Δ of estimators is derived. Thic condition becomes also sufficient when the loss function is convex.     

A Comparative Study of Semiparametric Estimation in Partially Linear Single-index Models

We consider a semiparametric method based on partial splines for estimating the unknown function and partially linear regression parameters in partially linear single-index models. Three methods—project pursuit regression (PPR), average derivative estimation (ADE), and a boosting method—are considered for estimating the single-index parameters. Simulations revealed that PPR with partial splines was superior in estimating single-index parameters, while the boosting method with partial splines performed no better than PPR and ADE. All three methods performed similarly in estimating the partially linear regression parameters. The relative performances of the methods are also illustrated using a real-world data example.     

Partial Ordering and Aging Properties of Order Statistics When the Sample Size is Random: A Brief Review

In many practical situations, order statistics arise naturally with random sample size. In this article, we review results on partial orderings and aging properties of such order statistics. The comparison of order statistics for different sample sizes is also discussed here.