Random weighting estimation of sampling distributions via importance resampling

This paper presents a new random weighting-based adaptive importance resampling method to estimate the sampling distribution of a statistic. A random weighting-based cross-entropy procedure is developed to iteratively calculate the optimal resampling probability weights by minimizing the Kullback-Leibler distance between the optimal importance resampling distribution and a family of parameterized distributions. Subsequently, the random weighting estimation of the sampling distribution is constructed from the obtained optimal importance resampling distribution. The convergence of the proposed method is rigorously proved. Simulation and experimental results demonstrate that the proposed method can effectively estimate the sampling distribution of a statistic.     

An example of applying the asymptotic quasi-likelihood to dimension estimation for random spatial patterns

With reference to a specific example of a random spatial fractal and the modified box-counting method of dimension estimation, this paper aims to examine firstly the estimation of pointwise dimension via modification of the box-counting procedure, secondly the regression inspired estimation procedure, including generalised least squares and, finally, to develop a new estimation procedure – the asymptotic quasi-likelihood method – for the estimation of pointwise dimension. The main focus is on practicality – to arrive at an estimation method which is easy to use and robust.     

A new procedure for steepest ascent

The procedure of steepest ascent consists of performing a sequence of sets of trials. Each set of trials is obtained as a result of proceeding sequentially along the path of maximum increase in response. Until now there has been no formal stopping rule, When response values are subject to random error, the decision to stop can be premature due to a “false” drop in the observed response.

A new stopping rule procedure for steepest ascent is intro-duced that takes into account the random error variation in response values. The new procedure protects against taking too many observations when the true mean response is decreasing, it also protects against stopping. prematurely when the true mean response is increasing, A numerical example is given which illus-trates the method.     

Estimation and variable selection for partially functional linear models

In this paper, a new estimation procedure based on composite quantile regression and functional principal component analysis (PCA) method is proposed for the partially functional linear regression models (PFLRMs). The proposed estimation method can simultaneously estimate both the parametric regression coefficients and functional coefficient components without specification of the error distributions. The proposed estimation method is shown to be more efficient empirically for non-normal random error, especially for Cauchy error, and almost as efficient for normal random errors. Furthermore, based on the proposed estimation procedure, we use the penalized composite quantile regression method to study variable selection for parametric part in the PFLRMs. Under certain regularity conditions, consistency, asymptotic normality, and Oracle property of the resulting estimators are derived. Simulation studies and a real data analysis are conducted to assess the finite sample performance of the proposed methods.     

Penalized Pseudolikelihood Inference in Spatial Interaction Models with Covariates

Given spatially located observed random variables ( x , z = {( x _i , z _i )} _i , we propose a new method for non-parametric estimation of the potential functions of a Markov random field p ( x | z ), based on a roughness penalty approach. The new estimator maximizes the penalized log-pseudolikelihood function and is a natural cubic spline. The calculations involved do not rely on Monte Carlo simulation. We suggest the use of B-splines to stabilize the numerical procedure. An application in Bayesian image reconstruction is described.     

A nonparametric statistical approach in noisy chaos identification

Data resulting from some deterministic dynamic systems may appear to be random. To distinguish these kinds of data from random data is a new challenge for statisticians. This paper develops a nonparametric statistical test procedure for distinguishing noisy chaos from i. i. d. random processes. The procedure can be easily implemented by computer and is very effective in identifying low dimensional chaos in certain instances.     

New systematic sampling

In this paper a new systematic sampling procedure has been suggested which provides the unbiased estimator of sampling variance, besides maintaining simplicity. On comparing the efficiency of the suggested procedure with usual systematic sampling and simple random sampling, it has been observed that in situations where usual systematic sampling performs better than simple random sampling the suggested procedure also leads to similar results, and for some situations it may provide better results than even usual systematic sampling.     

ON ESTIMATION OF THE POPULATION SPECTRAL DISTRIBUTION FROM A HIGH‐DIMENSIONAL SAMPLE COVARIANCE MATRIX

Sample covariance matrices play a central role in numerous popular statistical methodologies, for example principal components analysis, Kalman filtering and independent component analysis. However, modern random matrix theory indicates that, when the dimension of a random vector is not negligible with respect to the sample size, the sample covariance matrix demonstrates significant deviations from the underlying population covariance matrix. There is an urgent need to develop new estimation tools in such cases with high‐dimensional data to recover the characteristics of the population covariance matrix from the observed sample covariance matrix. We propose a novel solution to this problem based on the method of moments. When the parametric dimension of the population spectrum is finite and known, we prove that the proposed estimator is strongly consistent and asymptotically Gaussian. Otherwise, we combine the first estimation method with a cross‐validation procedure to select the unknown model dimension. Simulation experiments demonstrate the consistency of the proposed procedure. We also indicate possible extensions of the proposed estimator to the case where the population spectrum has a density.     

Variable selection of the quantile varying coefficient regression models

As a useful supplement to mean regression, quantile regression is a completely distribution-free approach and is more robust to heavy-tailed random errors. In this paper, a variable selection procedure for quantile varying coefficient models is proposed by combining local polynomial smoothing with adaptive group LASSO. With an appropriate selection of tuning parameters by the BIC criterion, the theoretical properties of the new procedure, including consistency in variable selection and the oracle property in estimation, are established. The finite sample performance of the newly proposed method is investigated through simulation studies and the analysis of Boston house price data. Numerical studies confirm that the newly proposed procedure (QKLASSO) has both robustness and efficiency for varying coefficient models irrespective of error distribution, which is a good alternative and necessary supplement to the KLASSO method.     

Simultaneous Inferences on the Cumulative Distribution Function of a Normal Distribution

This paper addresses the problem of constructing simultaneous confidence intervals for the cumulative distribution function of a normal distribution at several specified points. The procedure is based upon the observation of a random sample of independent observations from a normal distribution with an unknown mean and variance. A new methodology is proposed for obtaining confidence intervals with a specified overall simultaneous confidence level through the inversion of acceptance sets. Both one-sided and two-sided confidence intervals are considered. Some illustrations of the new method are provided, and comparisons are made with other approaches to the problem.     

Bootstrapping with auxiliary information

In the nonparametric setting, the standard bootstrap method is based on the empirical distribution function of a random sample. The author proposes, by means of the empirical likelihood technique, an alternative bootstrap procedure under a nonparametric model in which one has some auxiliary information about the population distribution. By proving the almost sure weak convergence of the modified bootstrapped empirical process, the validity of the proposed bootstrap procedure is established. This new result is used to obtain bootstrap confidence bands for the population distribution function and to perform the bootstrap Kolmogorov test in the presence of auxiliary information. Other applications include bootstrapping means and variances with auxiliary information. Three simulation studies are presented to demonstrate the performance of the proposed bootstrap procedure for small samples.     

Simulation and Analytical Approach to the Identification of Significant Factors

We develop our previous works concerning the identification of the collection of significant factors determining some, in general, nonbinary random response variable. Such identification is important, e.g., in biological and medical studies. Our approach is to examine the quality of response variable prediction by functions in (certain part of) the factors. The prediction error estimation requires some cross-validation procedure, certain prediction algorithm, and estimation of the penalty function. Using simulated data, we demonstrate the efficiency of our method. We prove a new central limit theorem for introduced regularized estimates under some natural conditions for arrays of exchangeable random variables.     

Inferences on regression coefficients in a regression model under heteroscedasticity and robustness with respect to departure from normality

In this paper we consider a simple linear regression model under heteroscedasticity and nonnormality. A statistical test for testing the regression coefficient is then derived by assuming normality for the random disturbances and by applying Welch's method. Some Monte Carlo studies are generated for assessing robustness of this test. By combining Tiku's robust procedure with the new test, a robust but more powerful test is developed.     

Focused Information Criterion and Model Averaging in Quantile Regression

In this article, we study model selection and model averaging in quantile regression. Under general conditions, we develop a focused information criterion and a frequentist model average estimator for the parameters in quantile regression model, and examine their theoretical properties. The new procedures provide a robust alternative to the least squares method or likelihood method, and a major advantage of the proposed procedures is that when the variance of random error is infinite, the proposed procedure works beautifully while the least squares method breaks down. A simulation study and a real data example are presented to show that the proposed method performs well with a finite sample and is easy to use in practice.     

Monitoring correlation change in a sequence of random variables

We propose a monitoring procedure to test for the constancy of the correlation coefficient of a sequence of random variables. The idea of the method is that a historical sample is available and the goal is to monitor for changes in the correlation as new data become available. We introduce a detector which is based on the first hitting time of a CUSUM-type statistic over a suitably constructed threshold function. We derive the asymptotic distribution of the detector and show that the procedure detects a change with probability approaching unity as the length of the historical period increases. The method is illustrated by Monte Carlo experiments and the analysis of a real application with the log-returns of the Standard & Poor's 500 (S&P 500) and IBM stock assets.     

Adaptive m estimation of symmetric distribution location

An adaptive M esitmation procedure for using a random sample to estimate the location parameter of an unknown symmetric distribution is developed. The procedure may be applied to samples from distributions with tail lenghts at least as heavy as normal distribution tails. Simulation studies demonstrate the potential of the new estimator for producing good location estimates.     

Data-driven sensitivity analysis to detect missing data mechanism with applications to structural equation modelling

Missing data are a common problem in almost all areas of empirical research. Ignoring the missing data mechanism, especially when data are missing not at random (MNAR), can result in biased and/or inefficient inference. Because MNAR mechanism is not verifiable based on the observed data, sensitivity analysis is often used to assess it. Current sensitivity analysis methods primarily assume a model for the response mechanism in conjunction with a measurement model and examine sensitivity to missing data mechanism via the parameters of the response model. Recently, Jamshidian and Mata (Post-modelling sensitivity analysis to detect the effect of missing data mechanism, Multivariate Behav. Res. 43 (2008), pp. 432–452) introduced a new method of sensitivity analysis that does not require the difficult task of modelling the missing data mechanism. In this method, a single measurement model is fitted to all of the data and to a sub-sample of the data. Discrepancy in the parameter estimates obtained from the the two data sets is used as a measure of sensitivity to missing data mechanism. Jamshidian and Mata describe their method mainly in the context of detecting data that are missing completely at random (MCAR). They used a bootstrap type method, that relies on heuristic input from the researcher, to test for the discrepancy of the parameter estimates. Instead of using bootstrap, the current article obtains confidence interval for parameter differences on two samples based on an asymptotic approximation. Because it does not use bootstrap, the developed procedure avoids likely convergence problems with the bootstrap methods. It does not require heuristic input from the researcher and can be readily implemented in statistical software. The article also discusses methods of obtaining sub-samples that may be used to test missing at random in addition to MCAR. An application of the developed procedure to a real data set, from the first wave of an ongoing longitudinal study on aging, is presented. Simulation studies are performed as well, using two methods of missing data generation, which show promise for the proposed sensitivity method. One method of missing data generation is also new and interesting in its own right.     

A new sequential approximation method

A sequential method for estimating the expected value of a random variable is proposed. Using a parametric model, the updating formula is based on the maximum likelihood estimators of the roots of the expected value function. Under certain conditions, it is demonstrated that the estimators of the roots are consistent, when a two-parameter logit model version of the procedure is used for binary data. In addition, the estimators of the logit parameters have an asymptotic normal distribution. A simulation study is performed to evaluate the effectiveness of the new method for small to medium sample sizes. Compared to other sequential approximation methods, the proposed method performed well, especially when estimating several roots simultaneously.     

One-sided tolerance limits for unbalanced one-way random effects models: a generalized Mee and Owen procedure

This article proposes a new procedure for obtaining one-sided tolerance limits in unbalanced random effects models. The procedure is a generalization of that proposed by Mee and Owen for the balanced situation, and can be easily implemented, because it only needs a non-central-t table. Two simulation studies are carried out to assess the performance of the new procedure and to compare it with one of the other procedures laid out in previous statistical literature. The article findings show that the new procedure is much simpler to compute and performs better than the previous ones, having inferior values of the gamma bias in a wide range of situations, representative of many actual industrial applications, and behaving also reasonably well in more extreme sampling situations. The use of the new limits is illustrated by an application to an actual example from the steel industry.     

An Alpha Half Normal Slash Distribution for Analyzing Non Negative Data

In this paper, we study a new class of slash distribution. We define the distribution through means of a stochastic representation as the mixture of an alpha half normal random variable with respect to the power of a uniform random variable. Properties involving moments and moment generating function are derived. The usefulness and flexibility of the proposed distribution is illustrated through a real application by maximum likelihood procedure.