Bias Reduction using Stochastic Approximation

The paper studies stochastic approximation as a technique for bias reduction. The proposed method does not require approximating the bias explicitly, nor does it rely on having independent identically distributed (i.i.d.) data. The method always removes the leading bias term, under very mild conditions, as long as auxiliary samples from distributions with given parameters are available. Expectation and variance of the bias-corrected estimate are given. Examples in sequential clinical trials (non-i.i.d. case), curved exponential models (i.i.d. case) and length-biased sampling (where the estimates are inconsistent) are used to illustrate the applications of the proposed method and its small sample properties.     

Testing Chaos Based on Empirical Distribution Function: A Simulation Study

It is well known that many classical statistical tests of randomness generally fail to distinguish chaos generated by some lower-dimensional deterministic dynamical systems from independent and identically distributed (i.i.d.) random series. In this paper, we suggest a powerful statistical testing method based on empirical distribution function that can well detect chaos and i.i.d. random series.     

Mean intergrated squared error properties and optimal kernels when estimating a diatribution function

Let X₁,X₂,… X_n be a sample of independent identically distributed (i.i.d)random variables having an unknown absolutely continuous distribution function f with density f the twofold aim of his paper consists in, firstly deriving asymptotic expressions of the mean intergrated squared error (MISE) of a kernel estimator of F when f is either assumed to be continuous everywhere or problem of finding optimal kernels in these two cases is studied in detail.     

Large Deviations Limit Theorems for the Kernel Density Estimator

We establish pointwise and uniform large deviations limit theorems of Chernoff-type for the non-parametric kernel density estimator based on a sequence of independent and identically distributed random variables. The limits are well-identified and depend upon the underlying kernel and density function. We derive then some implications of our results in the study of asymptotic efficiency of the goodness-of-fit test based on the maximal deviation of the kernel density estimator as well as the inaccuracy rate of this estimate     

A semiparametric estimator of the distribution function of a variable measured with error

The estimation of the distribution functon of a random variable X measured with error is studied. Let the i-th observation on X be denoted by Y_iX_i+ε_i where ε_i is the measuremen error. Let {Y_i} (i=1,2,…,n) be a sample of independent observations. It is assumed that {X_i} and {∈_i} are mutually independent and each is identically distributed. As is standard in the literature for this problem, the distribution of e is assumed known in the development of the methodology. In practice, the measurement error distribution is estimated from replicate observations.

The proposed semiparametric estimator is derived by estimating the quantises of X on a set of n transformed V-values and smoothing the estimated quantiles using a spline function. The number of parameters of the spline function is determined by the data with a simple criterion, such as AIC. In a simulation study, the semiparametric estimator dominates an optimal kernel estimator and a normal mixture estimator for a wide class of densities.

The proposed estimator is applied to estimate the distribution function of the mean pH value in a field plot. The density function of the measurement error is estimated from repeated measurements of the pH values in a plot, and is treated as known for the estimation of the distribution function of the mean pH value.     

Tail behavior of the generalized Maxwell distribution

Abstract

In this article, we investigate the tail propertiesof the generalized Maxwell distribution and gain an asymptoticbehavior of its Mills-type ratio. Meanwhile, we show two applications. The first application thinks about the asymptotic property of the ratio of density functions and the ratio of the tails of the generalized Maxwell and classical Maxwell distributions. Another application obtains the asymptotic distribution of the partial maximum of an independent and identically distributed sequence from the distribution.     

Nonparametric regression with additional measurement errors in the dependent variable

Estimation of a regression function from data which consists of an independent and identically distributed sample of the underlying distribution with additional measurement errors in the dependent variable is considered. It is allowed that the measurement errors are not independent and have nonzero mean. It is shown that the rate of convergence of least-squares estimates applied to this data is similar to the rate of convergence of least-squares estimates applied to an independent and identically distributed sample of the underlying distribution as long as the measurement errors are small. As an application, estimation of conditional variance functions from residuals is considered.     

Bayesian inference and prediction of the Pareto distribution based on ordered ranked set sampling

In this paper, order statistics from independent and non identically distributed random variables is used to obtain ordered ranked set sampling (ORSS). Bayesian inference of unknown parameters under a squared error loss function of the Pareto distribution is determined. We compute the minimum posterior expected loss (the posterior risk) of the derived estimates and compare them with those based on the corresponding simple random sample (SRS) to assess the efficiency of the obtained estimates. Two-sample Bayesian prediction for future observations is introduced by using SRS and ORSS for one- and m-cycle. A simulation study and real data are applied to show the proposed results.     

Ma system identification using higher order cumulants application to modelling solar radiation

The main goal of this investigation is to elaborate an accurate and efficient algorithm able to estimate the moving average (MA) parameters in noisy environment. So, we address the problem of estimating the parameters of a MA--non-minimum phase (NMP)-system from the output observation when the system is excited by an unobservable independent identically distributed (i.i.d.) sequence. A new procedure, based on third and fourth order cumulants, to estimate the parameters of MA process when the order is known, is presented. This procedure was tested for various examples of MA (NMP) system, and for different order and different signal-to-noise-ratio (SNR). A comparison with some existing methods was also performed and the result shows the efficiency of the proposed algorithm. For validation purpose this method is used to search for a model able to describe and to predict the data set representing the daily solar radiation.     

A new robust Kalman filter for filtering the microstructure noise

We propose a robust Kalman filter (RKF) to estimate the true but hidden return when microstructure noise is present. Following Zhou's definition, we assume the observed return Y_t is the result of adding microstructure noise to the true but hidden return X_t. Microstructure noise is assumed to be independent and identically distributed (i.i.d.); it is also independent of X_t. When X_t is sampled from a geometric Brownian motion process to yield Y_t, the Kalman filter can produce optimal estimates of X_t from Y_t. However, the covariance matrix of microstructure noise and that of X_t must be known for this claim to hold. In practice, neither covariance matrix is known so they must be estimated. Our RKF, in contrast, does not need the covariance matrices as input. Simulation results show that the RKF gives essentially identical estimates to the Kalman filter, which has access to the covariance matrices. As applications, estimated X_t can be used to estimate the volatility of X_t.     

A study on geographically weighted spatial autoregression models with spatial autoregressive disturbances

Abstract

Spatial heterogeneity and correlation are both considered in the geographical weighted spatial autoregressive model. At present, this kind of model has aroused the attention of some scholars. For the estimation of the model, the existing research is based on the assumption that the error terms are independent and identically distributed. In this article we use a computationally simple procedure for estimating the model with spatially autoregressive disturbance terms, both the estimates of constant coefficients and variable coefficients are obtained. Finally, we give the large sample properties of the estimators under some ordinary conditions. In addition, application study of the estimation methods involved will be further explored in a separate study.     

Asymptotic properties of kernel density estimation with complex survey data

Kernel density estimation has been used with great success with data that may be assumed to be generated from independent and identically distributed (iid) random variables. The methods and theoretical results for iid data, however, do not directly apply to data from stratified multistage samples. We present finite-sample and asymptotic properties of a modified density estimator introduced in Buskirk (Proceedings of the Survey Research Methods Section, American Statistical Association (1998), pp. 799–801) and Bellhouse and Stafford (Statist. Sin. 9 (1999) 407–424); this estimator incorporates both the sampling weights and the kernel weights. We present regularity conditions which lead the sample estimator to be consistent and asymptotically normal under various modes of inference used with sample survey data. We also introduce a superpopulation structure for model-based inference that allows the population model to reflect naturally occurring clustering. The estimator, and confidence bands derived from the sampling design, are illustrated using data from the US National Crime Victimization Survey and the US National Health and Nutrition Examination Survey.     

A note on the conditional residual lifetime of a coherent system under double monitoring

In this note, we derive some mixture representations for the reliability function of the conditional residual lifetime of a coherent system with n independent and identically distributed (i.i.d.) components under the condition that at time t₁ the jth failures has occurred and at time t₂ the kth failures (j < k) have not occurred yet. Based on the mixture representations, we then discuss the stochastic comparisons of the conditional residual lifetimes of two coherent systems with i.i.d. components.     

Stopping times of one-sample rank order sequential probability ratio tests

Weed, Bradley and Grovindarajulu (1974) propose one-sample probability ratio tests based on Lehmann alternatives. They also study the finite sure termination of the stopping times. Motivated by Stein's proof of (1946) of the termination of a sequential probability ratio test (SPRT) in the case of independent and identically distributed (i.i.d.) random variables and the work of Sethuraman (1970) for the two- sample rank order SPRT, we obtain a very mild condition (namely, that a certain random variable U(Z) is not identically zero) for the finite sure termination of the existence of the moment generating function (m.g.f.) for the stopping time of one- sample rank order SPRT's.     

Testing change in the variance with epidemic alternatives

ABSTRACT

In this paper we consider the dyadic increments statistics (of type DI) based on independent not identically distributed or α-mixing random variables. We obtain their limit distributions under the null hypothesis and we present application for testing epidemic change in the variance in each case. Finally, numerical simulations are done to illustrate these results.     

Conditional residual lifetimes of coherent systems under double monitoring

In this paper, we obtain a mixture representation for the reliability function of the conditional residual lifetime of a coherent system with n independent and identically distributed (i.i.d.) components under double monitoring. We suppose that at time t₁, j components have failed while at time t₂ the system is still alive. Based on these mixture representation, we then study stochastic comparisons of the conditional residual lifetimes of two coherent systems with independent and identical components.     

Asymptotic Results for Spatial ARMA Models

Causal quadrantal-type spatial ARMA(p, q) models with independent and identically distributed innovations are considered. In order to select the orders (p, q) of these models and estimate their autoregressive parameters, estimators of the autoregressive coefficients, derived from the extended Yule–Walker equations are defined. Consistency and asymptotic normality are obtained for these estimators. Then, spatial ARMA model identification is considered and simulation study is given.     

Estimating a frequency distribution when the sampling is biased

A simple random sample on a random variable A allows its density to be consistently estimated, by a histogram or preferably a kernel density estimate. When the sampling is biased towards certain x-values these methods instead estimate a weighted version of the density function. This article proposes a method for estimating both the density and the sampling bias simultaneously. The technique requires two independent samples and utilises ideas from mark-recapture experiments. An estimator of the size of the sampled population also follows simply from this density estimate.     

Deconvolution of supersmooth densities with smooth noise

The author considers the estimation of the common probability density of independent and identically distributed random variables observed with added white noise. She assumes that the unknown density belongs to some class of supersmooth functions, and that the error distribution is ordinarily smooth, meaning that its characteristic function decays polynomially asymptotically. In this context, the author evaluates the minimax rate of convergence of the pointwise risk and describes a kernel estimator having this rate. She computes upper bounds for the L₂ risk of this estimator.     

INDEPENDENCE DISTRIBUTION-PRESERVING NONNEGATIVE-DEFINITE COVARIANCE STRUCTURES FOR THE SAMPLE VARIANCE

This paper explicitly characterizes the general nonnegative-definite covariance structure for a multivariate normal random vector such that the univariate sample variance is distributed exactly as if the sample observations are normal independent and identically distributed (i.i.d.). This work extends the results of Baldessari (1965) and Stadje (1984) who have characterized the general positive-definite covariance matrix such that the univariate sample variance is distributed exactly as if the sample observations are normal i.i.d.