Simultaneous closeness among order statistics to population quantiles

We derive expressions for the probability that an individual order statistic is closest to the target parameter among the order statistics from a complete random sample. Results are given for random variables with bounded and complete support. We then apply these general results to location-scale parameter families of distributions with specific applications to estimation of percentiles. In this case, simultaneous-closeness probabilities depend upon the parameters through the value of p in the percentile and the sample size, n. Results are finally illustrated with the estimation of percentiles for normal and exponential distributions.     

Second order tail behaviour of randomly weighted heavy-tailed sums and their maxima

Abstract

In this paper the second order asymptotics of the tail probabilities of randomly weighted sums and their maxima are established in the case that the underlying primary random variables are subexponential. No any assumption is made on the dependence structure between the random weights, but we assume these weights are bounded away from zero and infinity.     

Sample moments of the autocorrelations of moving average processes and a modification to bartlett'sasymptotic variance formula

In this paper we express the sample autocorrelations for a moving average process of order q as a function of its own theoretical autocorrelations and the sample autocorrelations for the generating white noise series. Approximate analytic expressions are then obtained forthe moments of the sample autocorrelations of the moving average process.

Using these expressions, together with numerical evidence, we show that Bartlett's asymptotic formula for the variance of the sample autocorrelations of moving average processes, which is used widely in identifying these processes, is a large overestimate when considering finitesample sizes.

Our approach is for motivational purposes and so is purely formal, the amount of mathematics presented being kept to a minimum.     

Estimating standard error of intra-class correlation coefficients up to three level unbalanced nested clinical trials

ABSTRACT

Very often researchers plan a balanced design for cluster randomization clinical trials in conducting medical research, but unavoidable circumstances lead to unbalanced data. By adopting three or more levels of nested designs, they usually ignore the higher level of nesting and consider only two levels, this situation leads to underestimation of variance at higher levels. While calculating the sample size for three-level nested designs, in order to achieve desired power, intra-class correlation coefficients (ICCs) at individual level as well as higher levels need to be considered and must be provided along with respective standard errors. In the present paper, the standard errors of analysis of variance (ANOVA) estimates of ICCs for three-level unbalanced nested design are derived. To conquer the strong appeal of distributional assumptions, balanced design, equality of variances between clusters and large sample, general expressions for standard errors of ICCs which can be deployed in unbalanced cluster randomization trials are postulated. The expressions are evaluated on real data as well as highly unbalanced simulated data.     

Maximum Entropy Approximations for Asymptotic Distributions of Smooth Functions of Sample Means

Abstract. We propose an information‐theoretic approach to approximate asymptotic distributions of statistics using the maximum entropy (ME) densities. Conventional ME densities are typically defined on a bounded support. For distributions defined on unbounded supports, we use an asymptotically negligible dampening function for the ME approximation such that it is well defined on the real line. We establish order n^?1 asymptotic equivalence between the proposed method and the classical Edgeworth approximation for general statistics that are smooth functions of sample means. Numerical examples are provided to demonstrate the efficacy of the proposed method.     

Bayes and Empirical Bayes Inference in Changepoint Problems

ABSTRACT

In the case of the random design nonparametric regression, the double smoothing technique is applied to estimate the multivariate regression function. The proposed estimator has desirable properties in both the finite sample and the asymptotic cases. In the finite sample case, it has bounded conditional (and unconditional) bias and variance. On the other hand, in the asymptotic case, it has the same mean square error as the local linear estimator in Fan (Design-Adaptive Nonparametric Regression. Journal of the American Statistical Association 1992, 87, 998–1004; Local Linear Regression Smoothers and Their Minimax Efficiencies. Annals of Statistics 1993, 21, 196–216). Simulation studies demonstrate that the proposed estimator is better than the local linear estimator, because it has a smaller sample mean integrated square error and gives smoother estimates.     

The effect of temporal aggregation on the estimation accuracy of ARMA models

ABSTRACT

Autoregressive Moving Average (ARMA) time series model fitting is a procedure often based on aggregate data, where parameter estimation plays a key role. Therefore, we analyze the effect of temporal aggregation on the accuracy of parameter estimation of mixed ARMA and MA models. We derive the expressions required to compute the parameter values of the aggregate models as functions of the basic model parameters in order to compare their estimation accuracy. To this end, a simulation experiment shows that aggregation causes a severe accuracy loss that increases with the order of aggregation, leading to poor accuracy.     

Inference Based on Order Statistics from the Generalized Pareto Distribution and Application

ABSTRACT

In this article, we derive exact explicit expressions for the single, double, triple, and quadruple moments of order statistics from the generalized Pareto distribution (GPD). Also, we obtain the best linear unbiased estimates of the location and scale parameters (BLUE's) of the GPD. We then use these results to determine the mean, variance, and coefficients of skewness and kurtosis of certain linear functions of order statistics. These are then utilized to develop approximate confidence intervals for the generalized Pareto parameters using Edgeworth approximation and compare them with those based on Monte Carlo simulations. To show the usefulness of our results, we also present a numerical example. Finally, we give an application to real data.     

Maximum entropy in the mean methods in propensity score matching for interval and noisy data

Abstract

In this paper, we propose maximum entropy in the mean methods for propensity score matching classification problems. We provide a new methodological approach and estimation algorithms to handle explicitly cases when data is available: (i) in interval form; (ii) with bounded measurement or observational errors; or (iii) both as intervals and with bounded errors. We show that entropy in the mean methods for these three cases generally outperform benchmark error-free approaches.     

Comparison among non parametric prediction intervals of order statistics

Abstract

In this article, we are interested in conducting a comparison study between different non parametric prediction intervals of order statistics from a future sample based on an observed order statistics. Typically, coverage probabilities of well-known non parametric prediction intervals may not reach the preassigned probability levels. Moreover, prediction intervals for predicting future order statistics are no longer available in some cases. For this, we propose different methods involving random indices and fractional order statistics. In each case, we find the optimal prediction intervals. Numerical computations are presented to assess the performances of the so-obtained intervals. Finally, a real-life data set is presented and analyzed for illustrative purposes.     

The exponentiated Fréchet regression: an alternative model for actuarial modelling purposes

ABSTRACT

In this paper we introduce the exponentiated Fréchet regression for modelling positive responses having a long-tailed distribution in a regression model, which are common in actuarial statistics. We propose two parameterizations each of which links the regression parameters with the explanatory variables. We then discuss the maximum likelihood estimation of the parameters both theoretically and empirically. In order to meet the needs of an actuary, closed-form expressions for certain risk measures for the exponentiated Fréchet distribution are also derived. We employ the proposed model to a motorcycle claim size data set.     

Order identification for gaussian moving averages using the covariation

In the traditional Box-Jenkins procedure for fitting ARMA time series models to data, the first step is order identification. The sample autocorrelation function can be used to identify pure moving average behavior. In this paper we consider using the autocovariation function identify the order of a univariate Gaussian time series. Simulation evidence indicates the suggested method may be a superior order identification tool when at least 100 observations are taken.     

Bayesian estimation and prediction based on generalized Type-II hybrid censored sample

ABSTRACT

In this paper, we consider a general form for the underlying distribution and a general conjugate prior, and develop a general procedure for deriving the maximum likelihood and Bayesian estimators based on an observed generalized Type-II hybrid censored sample. The problems of predicting the future order statistics from the same sample and that from a future sample are also discussed from a Bayesian viewpoint. For the illustration of the developed results, the exponential and Pareto distributions are used as examples. Finally, two numerical examples are presented for illustrating all the inferential procedures developed here.     

Practical performance of local likelihood for circular density estimation

ABSTRACT

Local likelihood has been mainly developed from an asymptotic point of view, with little attention to finite sample size issues. The present paper provides simulation evidence of how likelihood density estimation practically performs from two points of view. First, we explore the impact of the normalization step of the final estimate, second we show the effectiveness of higher order fits in identifying modes present in the population when small sample sizes are available. We refer to circular data, nevertheless it is easily seen that our findings straightforwardly extend to the Euclidean setting, where they appear to be somehow new.     

Survival Estimation with Missing Censoring Times for the Generalized Koziol–Green Model

ABSTRACT

When analyzing time-to-event data, there are various situations in which right censoring times for unfailed units are missing. In that context, by taking a supplementary sample of a convenient percentage of unfailed units, we propose a semi-parametric method for estimating a survival function under the natural extension of the Koziol–Green model to double random censoring. Some large sample properties of this estimator are derived. We prove uniform strong consistency and asymptotic weak convergence to a Gaussian process. A simulation study is also presented in order to analyze the behavior of the proposed estimator.     

On the exact distribution of the MLEs based on Type-II progressively hybrid censored data from exponential distributions

ABSTRACT

Distributions of the maximum likelihood estimators (MLEs) in Type-II (progressive) hybrid censoring based on two-parameter exponential distributions have been obtained using a moment generating function approach. Although resulting in explicit expressions, the representations are complicated alternating sums. Using the spacings-based approach of Cramer and Balakrishnan [On some exact distributional results based on Type-I progressively hybrid censored data from exponential distributions. Statist Methodol. 2013;10:128–150], we derive simple expressions for the exact density and distribution functions of the MLEs in terms of B-spline functions. These representations can be easily implemented on a computer and provide an efficient method to compute density and distribution functions as well as moments of Type-II (progressively) hybrid censored order statistics.     

On the Kullback–Leibler information of hybrid censored data

ABSTRACT

A hybrid censoring is a mixture of Type I and Type II censoring where the experiment terminates when either rth failure or predetermined censoring time comes first or later. In this article, we consider order statistics of the Type I censored data and provide a simple expression for their Kullback–Leibler (KL) information. Then, we provide the expressions for the KL information of the Type I and Type II hybrid censored data.     

A characterization of the dilation order and its applications

LetX andY be two random variables with finite expectationsE X andE Y, respectively. ThenX is said to be smaller thanY in the dilation order ifE[ϕ(X-E X)]≤E[ϕ(Y-E Y)] for any convex functionϕ for which the expectations exist. In this paper we obtain a new characterization of the dilation order. This characterization enables us to give new interpretations to the dilation order, and using them we identify conditions which imply the dilation order. A sample of applications of the new characterization is given. Partially supported by MURST 40% Program on Non-Linear Systems and Applications. Partially supported by “Gruppo Nazionale per l'Analisi Funzionale e sue Applicazioni”—CNR.     

Characterizing Relationships Between Estimations Under a General Linear Model with Explicit and Implicit Restrictions by Rank of Matrix

In the investigation of the restricted linear model ? _r  = {y, X β | A β = b, σ² Σ}, the parameter constraints A β = b are often handled by transforming the model into certain implicitly restricted model. Any estimation derived from the explicitly and implicitly restricted models on the vector β and its functions should be equivalent, although the expressions of the estimation under the two models may be different. However, people more likely want to directly compare different expressions of estimations and yield a conclusion on their equivalence by using some algebraic operations on expressions of estimations. In this article, we give some results on equivalence of the well-known OLSEs and BLUEs under the explicitly and implicitly restricted linear models by using some expansion formulas for ranks of matrices.     

A note on Markov chain Monte Carlo sweep strategies

Markov chain Monte Carlo (MCMC) routines have become a fundamental means for generating random variates from distributions otherwise difficult to sample. The Hastings sampler, which includes the Gibbs and Metropolis samplers as special cases, is the most popular MCMC method. A number of implementations are available for running these MCMC routines varying in the order through which the components or blocks of the random vector of interest X are cycled or visited. The two most common implementations are the deterministic sweep strategy, whereby the components or blocks of X are updated successively and in a fixed order, and the random sweep strategy, whereby the coordinates or blocks of X are updated in a randomly determined order. In this article, we present a general representation for MCMC updating schemes showing that the deterministic scan is a special case of the random scan. We also discuss decision criteria for choosing a sweep strategy.