Small sample confidence intervals for survival functions under the proportional hazards model

We develop a saddlepoint-based method for generating small sample confidence bands for the population surviival function from the Kaplan-Meier (KM), the product limit (PL), and Abdushukurov-Cheng-Lin (ACL) survival function estimators, under the proportional hazards model. In the process we derive the exact distribution of these estimators and developed mid-ppopulation tolerance bands for said estimators. Our saddlepoint method depends upon the Mellin transform of the zero-truncated survival estimator which we derive for the KM, PL, and ACL estimators. These transforms are inverted via saddlepoint approximations to yield highly accurate approximations to the cumulative distribution functions of the respective cumulative hazard function estimators and these distribution functions are then inverted to produce our saddlepoint confidence bands. For the KM, PL and ACL estimators we compare our saddlepoint confidence bands with those obtained from competing large sample methods as well as those obtained from the exact distribution. In our simulation studies we found that the saddlepoint confidence bands are very close to the confidence bands derived from the exact distribution, while being much easier to compute, and outperform the competing large sample methods in terms of coverage probability.     

Optimal distribution-free confidence bands for a distribution function

Distribution-free confidence bands for a distribution function are typically obtained by inverting a distribution-free hypothesis test. We propose an alternate strategy in which the upper and lower bounds of the confidence band are chosen to minimize a narrowness criterion. We derive necessary and sufficient conditions for optimality with respect to such a criterion, and we use these conditions to construct an algorithm for finding optimal bands. We also derive uniqueness results, with the Brunn–Minkowski Inequality from the theory of convex bodies playing a key role in this work. We illustrate the optimal confidence bands using some galaxy velocity data, and we also show that the optimal bands compare favorably to other bands both in terms of power and in terms of area enclosed.     

Confidence bands from censored samples

Several types of asymptotic confidence bands have been proposed in the literature when the data are randomly censored on the right. Introducing new classes of bands, we place the old bands and their relationship to one another within a comprehensive theory of bands. A thorough analysis yields narrower bands and two kinds of modifications which are asymptotically distribution- and censor-free. One of these is useful when the interval on which the bands are constructed is predetermined and the width of the bands is random; the other, when there is a predetermined bound on the width and the interval is random. We illustrate our bands on the Szeged pacemaker data. These methods also provide a general modification of the Kolmogorov band in the uncensored case.     

Bootstrap confidence bands for the CDF using ranked-set sampling

In ranked-set sampling (RSS), a stratification by ranks is used to obtain a sample that tends to be more informative than a simple random sample of the same size. Previous work has shown that if the rankings are perfect, then one can use RSS to obtain Kolmogorov–Smirnov type confidence bands for the CDF that are narrower than those obtained under simple random sampling. Here we develop Kolmogorov–Smirnov type confidence bands that work well whether the rankings are perfect or not. These confidence bands are obtained by using a smoothed bootstrap procedure that takes advantage of special features of RSS. We show through a simulation study that the coverage probabilities are close to nominal even for samples with just two or three observations. A new algorithm allows us to avoid the bootstrap simulation step when sample sizes are relatively small.     

Nonparametric asymptotic confidence intervals for extreme quantiles

In this paper, we propose new asymptotic confidence intervals for extreme quantiles, that is, for quantiles located outside the range of the available data. We restrict ourselves to the situation where the underlying distribution is heavy-tailed. While asymptotic confidence intervals are mostly constructed around a pivotal quantity, we consider here an alternative approach based on the distribution of order statistics sampled from a uniform distribution. The convergence of the coverage probability to the nominal one is established under a classical second-order condition. The finite sample behavior is also examined and our methodology is applied to a real dataset.     

Constant width simultaneous confidence bands in multiple linear regression with predictor variables constrained in intervals

In the last fifty years, a great deal of research effort has been made on the construction of simultaneous confidence bands for a linear regression function. Two most frequently quoted confidence bands in the statistics literature are the Scheffé type and constant width bands over a given rectangular region of the predictor variables. For the constant width bands, a method is given by Gafarian [Gafarian, A.V., 1964, Confidence bands in straight line regression. Journal of the American Statistical Association, 59, 182–213.] for the calculation of critical constants only for the special case of one predictor variable. In this article, a method is proposed to construct constant width bands when there are any number of predictor variables. A new criterion for assessing a confidence band is also proposed; it is the probability that a confidence band excludes a false regression function and can be viewed as the power function of a test associated, naturally, with a confidence band. Under this criterion, a numerical comparison between the Scheffé type and constant width bands is then carried out. It emerges from this comparison that the constant width bands can be better than the Scheffé type bands for certain designs.     

Estimation with right‐censored observations under a semi‐Markov model

The semi‐Markov process often provides a better framework than the classical Markov process for the analysis of events with multiple states. The purpose of this paper is twofold. First, we show that in the presence of right censoring, when the right end‐point of the support of the censoring time is strictly less than the right end‐point of the support of the semi‐Markov kernel, the transition probability of the semi‐Markov process is nonidentifiable, and the estimators proposed in the literature are inconsistent in general. We derive the set of all attainable values for the transition probability based on the censored data, and we propose a nonparametric inference procedure for the transition probability using this set. Second, the conventional approach to constructing confidence bands is not applicable for the semi‐Markov kernel and the sojourn time distribution. We propose new perturbation resampling methods to construct these confidence bands. Different weights and transformations are explored in the construction. We use simulation to examine our proposals and illustrate them with hospitalization data from a recent cancer survivor study. The Canadian Journal of Statistics 41: 237–256; 2013 © 2013 Statistical Society of Canada     

A MONTE CARLO COMPARISON OF VARIOUS ASYMPTOTIC APPROXIMATIONS TO THE DISTRIBUTION OF INSTRUMENTAL VARIABLES ESTIMATORS

We examine empirical relevance of three alternative asymptotic approximations to the distribution of instrumental variables estimators by Monte Carlo experiments. We find that conventional asymptotics provides a reasonable approximation to the actual distribution of instrumental variables estimators when the sample size is reasonably large. For most sample sizes, we find Bekker[11] asymptotics provides reasonably good approximation even when the first stage R² is very small. We conclude that reporting Bekker[11] confidence interval would suffice for most microeconometric (cross-sectional) applications, and the comparative advantage of Staiger and Stock[5] asymptotic approximation is in applications with sample sizes typical in macroeconometric (time series) applications.     

Empirical Likelihood Inference for the Cox Model with Time-dependent Coefficients via Local Partial Likelihood

Abstract.  The Cox model with time-dependent coefficients has been studied by a number of authors recently. In this paper, we develop empirical likelihood (EL) pointwise confidence regions for the time-dependent regression coefficients via local partial likelihood smoothing. The EL simultaneous confidence bands for a linear combination of the coefficients are also derived based on the strong approximation methods. The EL ratio is formulated through the local partial log-likelihood for the regression coefficient functions. Our numerical studies indicate that the EL pointwise/simultaneous confidence regions/bands have satisfactory finite sample performances. Compared with the confidence regions derived directly based on the asymptotic normal distribution of the local constant estimator, the EL confidence regions are overall tighter and can better capture the curvature of the underlying regression coefficient functions. Two data sets, the gastric cancer data and the Mayo Clinic primary biliary cirrhosis data, are analysed using the proposed method.     

The large-sample distribution of the most fundamental of statistical summaries

We consider one of the most fundamental of statistical problems, namely that of inference for the mean, standard deviation and coefficients of skewness and kurtosis of an unknown univariate distribution. Assuming the distributional form of the parent population to be unknown, we focus our attention on moment-based inference. As is well-known, the method of moments estimates of the population measures under consideration are the sample mean, standard deviation and coefficients of skewness and kurtosis. Despite being some of the most frequently used of all statistical summaries, it comes as a surprise to find that their full joint distribution has not previously been studied in the literature. We derive a very general theoretical result for the large-sample asymptotic joint distribution of the four estimators and use simulation to explore the validity of the result as a means of approximating the biases, variances and covariances of the estimators for finite sample sizes. The theoretical result is then used to obtain asymptotically distribution-free inferential procedures for the population measures of original interest. Specifically, we propose and investigate the efficacy of bias-corrected and non-bias-corrected methods for point estimation and confidence set construction. We also discuss the relevance of the developed methodology both as an end in itself and as an aid to model formulation.     

Confidence bands for the laplace distribution

Based on a random sample from the Laplace population with unknown shape and scale parameters, one- and two-sided confidence bands on the entire cumulative distribution function and simultaneous confidence intervals for the interval probabilities under the distribution are constructed using Kolmogorov–Smirnov type statistics. Small sample and asymptotic percentiles of the relevant statistics are provided.     

Setting confidence intervals by ratio estimator

For the survey population total of a variable y when values of an auxiliary variable x are available a popular procedure is to employ the ratio estimator on drawing a simple random sample without replacement (SRSWOR) especially when the size of the sample is large. To set up a confidence interval for the total, various variance estimators are available to pair with the ratio estimator. We add a few more variance estimators studded with asymptotic design-cum-model properties. The ratio estimator is traditionally known to be appropriate when the regression of y on x is linear through the origin and the conditional variance of y given x is proportional to x. But through a numerical exercise by simulation we find the confidence intervals to fare better if the regression line deviates from the origin or if the conditional variance is disproportionate with x. Also, comparing the confidence intervals using alternative variance estimators we find our newly proposed variance estimators to yield favourably competitive results.     

Small sample equivalence tests for exponentiality

We consider small sample equivalence tests for exponentialy. Statistical inference in this setting is particularly challenging since equivalence testing procedures typically require much larger sample sizes, in comparison with classical “difference tests,” to perform well. We make use of Butler's marginal likelihood for the shape parameter of a gamma distribution in our development of small sample equivalence tests for exponentiality. We consider two procedures using the principle of confidence interval inclusion, four Bayesian methods, and the uniformly most powerful unbiased (UMPU) test where a saddlepoint approximation to the intractable distribution of a canonical sufficient statistic is used. We perform small sample simulation studies to assess the bias of our various tests and show that all of the Bayes posteriors we consider are integrable. Our simulation studies show that the saddlepoint-approximated UMPU method performs remarkably well for small sample sizes and is the only method that consistently exhibits an empirical significance level close to the nominal 5% level.     

Model averaging for M-estimation

M-estimation is a widely used technique for robust statistical inference. In this paper, we study model selection and model averaging for M-estimation to simultaneously improve the coverage probability of confidence intervals of the parameters of interest and reduce the impact of heavy-tailed errors or outliers in the response. Under general conditions, we develop robust versions of the focused information criterion and a frequentist model average estimator for M-estimation, and we examine their theoretical properties. In addition, we carry out extensive simulation studies as well as two real examples to assess the performance of our new procedure, and find that the proposed method produces satisfactory results.     

Procedure for determining sample size at each stage in group sequential test

The purpose of our study is to propose a. procedure for determining the sample size at each stage of the repeated group significance, tests intended to compare the efficacy of two treatments when a response variable is normal. It is necessary to devise a procedure for reducing the maximum sample size because a large number of sample size are often used in group sequential test. In order to reduce the sample size at each stage, we construct the repeated confidence boundaries which enable us to find which of the two treatments is the more effective at an early stage. Thus we use the recursive formulae of numerical integrations to determine the sample size at the intermediate stage. We compare our procedure with Pocock's in terms of maximum sample size and average sample size in the simulations.     

Spline Confidence Bands for Functional Derivatives

We develop in this paper a new procedure to construct simultaneous confidence bands for derivatives of mean curves in functional data analysis. The technique involves polynomial splines that provide an approximation to the derivatives of the mean functions, the covariance functions and the associated eigenfunctions. We show that the proposed procedure has desirable statistical properties. In particular, we first show that the proposed estimators of derivatives of the mean curves are semiparametrically efficient. Second, we establish consistency results for derivatives of covariance functions and their eigenfunctions. Most importantly, we show that the proposed spline confidence bands are asymptotically efficient as if all random trajectories were observed with no error. Finally, the confidence band procedure is illustrated through numerical simulation studies and a real life example.     

Adjusted Confidence Bands in Nonparametric Regression

Suppose we have {(x _i , y _i )} i = 1, 2,…, n, a sequence of independent observations. We wish to find approximate 1 ? α simultaneous confidence bands for the regression curve. Many previous confidence bands in the literature have practical difficulties. In this article, the local linear smoother is used to estimate the regression curve. The bias of the estimator is considered. Different methods of constructing confidence bands are discussed. Finally, a possible method incorporating logistic regression in an innovative way is proposed to construct the bands for random designs. Simulations are used to study the performance or properties of the methods. The procedure for constructing confidence bands is entirely data-driven. The advantage of the proposed method is that it is simple to use and can be applied to random designs. It can be considered as a practically useful and efficient method.     

Optimal simultaneous confidence bands in simple linear regression

A simultaneous confidence band provides useful information on the plausible range of an unknown regression model. For simple linear regression models, the most frequently quoted bands in the statistical literature include the hyperbolic band and the three-segment bands. One interesting question is whether one can construct confidence bands better than the hyperbolic and three-segment bands. The optimality criteria for confidence bands include the average width criterion considered by Gafarian (1964) and Naiman (1984) among others, and the minimum area confidence set (MACS) criterion of Liu and Hayter (2007). In this paper, two families of exact 1−α$1-\alpha$ confidence bands, the inner-hyperbolic bands and the outer-hyperbolic bands, which include the hyperbolic and three-segment bands as special cases, are introduced in simple linear regression. Under the MACS criterion, the best confidence band within each family is found by numerical search and compared with the hyperbolic band, the best three-segment band and with each other. The methodologies are illustrated with a numerical example and the Matlab programs used are available upon request.     

Nonparametric estimation of the expected duration of old age

A definition of the expected old age duration based on the concept of mean residual lifetime is proposed. A nonparametric estimation approach is then presented and shown to have asymptotically normal distribution which enables us to construct asymptotically distribution free confidence bands for the expected duration of old age.