Semiparametric inference for survival models with step process covariates

The authors consider Bayesian methods for fitting three semiparametric survival models, incorporating time‐dependent covariates that are step functions. In particular, these are models due to Cox [Cox ( 1972 ) Journal of the Royal Statistical Society, Series B, 34, 187–208], Prentice & Kalbfleisch and Cox & Oakes [Cox & Oakes ( 1984 ) Analysis of Survival Data, Chapman and Hall, London]. The model due to Prentice & Kalbfleisch [Prentice & Kalbfleisch ( 1979 ) Biometrics, 35, 25–39], which has seen very limited use, is given particular consideration. The prior for the baseline distribution in each model is taken to be a mixture of Polya trees and posterior inference is obtained through standard Markov chain Monte Carlo methods. They demonstrate the implementation and comparison of these three models on the celebrated Stanford heart transplant data and the study of the timing of cerebral edema diagnosis during emergency room treatment of diabetic ketoacidosis in children. An important feature of their overall discussion is the comparison of semi‐parametric families, and ultimate criterion based selection of a family within the context of a given data set. The Canadian Journal of Statistics 37: 60–79; © 2009 Statistical Society of Canada     

Variable selection for additive model via cumulative ratios of empirical strengths total

We propose a data-driven method to select significant variables in additive model via spline estimation. The additive structure of the regression model is imposed to overcome the ‘curse of dimensionality’, while the spline estimators provide a good approximation to the additive components of the model. The additive components are ordered according to their empirical strengths, and the significant variables are chosen at the first crossing of a predetermined threshold by the CUmulative Ratios of Empirical Strengths Total of the components. Consistency of the proposed method is established when the number of variables are allowed to diverge with sample size, while extensive Monte-Carlo study demonstrates superior performance of the proposed method and its advantages over the BIC method of Huang and Yang [(2004), ‘Identification of Nonlinear: Additive Autoregressive Models’, Journal of the Royal Statistical Society Series B, 66, 463–477] in terms of speed and accuracy.     

Nonparametric estimation of the shape function in a Gamma process for degradation data

The author considers estimation under a Gamma process model for degradation data. The setting for degradation data is one in which n independent units, each with a Gamma process with a common shape function and scale parameter, are observed at several possibly different times. Covariates can be incorporated into the model by taking the scale parameter as a function of the covariates. The author proposes using the maximum pseudo‐likelihood method to estimate the unknown parameters. The method requires usage of the Pool Adjacent Violators Algorithm. Asymptotic properties, including consistency, convergence rate and asymptotic distribution, are established. Simulation studies are conducted to validate the method and its application is illustrated by using bridge beams data and carbon‐film resistors data. The Canadian Journal of Statistics 37: 102‐118; 2009 © 2009 Statistical Society of Canada     

André Dabrowski's work on limit theorems and weak dependence

André Robert Dabrowski, Professor of Mathematics and Dean of the Faculty of Sciences at the University of Ottawa, died October 7, 2006, after a short battle with cancer. The author of the present paper, a long‐term friend and collaborator of André Dabrowski, gives a survey of André's work on weak dependence and limit theorems in probability theory. The Canadian Journal of Statistics 37: 307–326; 2009 © 2009 Statistical Society of Canada     

Empirical likelihood for the varying‐coefficient single‐index model

In this article the author investigates the application of the empirical‐likelihood‐based inference for the parameters of varying‐coefficient single‐index model (VCSIM). Unlike the usual cases, if there is no bias correction the asymptotic distribution of the empirical likelihood ratio cannot achieve the standard chi‐squared distribution. To this end, a bias‐corrected empirical likelihood method is employed to construct the confidence regions (intervals) of regression parameters, which have two advantages, compared with those based on normal approximation, that is, (1) they do not impose prior constraints on the shape of the regions; (2) they do not require the construction of a pivotal quantity and the regions are range preserving and transformation respecting. A simulation study is undertaken to compare the empirical likelihood with the normal approximation in terms of coverage accuracies and average areas/lengths of confidence regions/intervals. A real data example is given to illustrate the proposed approach. The Canadian Journal of Statistics 38: 434–452; 2010 © 2010 Statistical Society of Canada     

Assessing additivity in nonparametric models —A kernel‐based method

In this article, we address the testing problem for additivity in nonparametric regression models. We develop a kernel‐based consistent test of a hypothesis of additivity in nonparametric regression, and establish its asymptotic distribution under a sequence of local alternatives. Compared to other existing kernel‐based tests, the proposed test is shown to effectively ameliorate the influence from estimation bias of the additive component of the nonparametric regression, and hence increase its efficiency. Most importantly, it avoids the tuning difficulties by using estimation‐based optimal criteria, while there is no direct tuning strategy for other existing kernel‐based testing methods. We discuss the usage of the new test and give numerical examples to demonstrate the practical performance of the test. The Canadian Journal of Statistics 39: 632–655; 2011. © 2011 Statistical Society of Canada     

Interim analysis of clinical trials based on urn models

Clinical trials usually involve efficient and ethical objectives such as maximizing the power and minimizing the total failure number. Interim analysis is now a standard technique in practice to achieve these objectives. Randomized urn models have been extensively studied in the literature. In this paper, we propose to perform interim analysis on clinical trials based on urn models and study its properties. We show that the urn composition, allocation of patients and parameter estimators can be approximated by a joint Gaussian process. Consequently, sequential test statistics of the proposed procedure converge to a Brownian motion in distribution and the sequential test statistics asymptotically satisfy the canonical joint distribution defined in Jennison & Turnbull (Jennison & Turnbull 2000. Group Sequential Methods with Applications to Clinical Trials, Chapman and Hall/CRC). These results provide a solid foundation and open a door to perform the interim analysis on randomized clinical trials with urn models in practice. Furthermore, we demonstrate our proposal through examples and simulations by applying sequential monitoring and stochastic curtailment techniques. The Canadian Journal of Statistics 40: 550–568; 2012 © 2012 Statistical Society of Canada     

Improved likelihood inference for the shape parameter in Weibull regression

We obtain adjustments to the profile likelihood function in Weibull regression models with and without censoring. Specifically, we consider two different modified profile likelihoods: (i) the one proposed by Cox and Reid [Cox, D.R. and Reid, N., 1987, Parameter orthogonality and approximate conditional inference. Journal of the Royal Statistical Society B, 49, 1–39.], and (ii) an approximation to the one proposed by Barndorff–Nielsen [Barndorff–Nielsen, O.E., 1983, On a formula for the distribution of the maximum likelihood estimator. Biometrika, 70, 343–365.], the approximation having been obtained using the results by Fraser and Reid [Fraser, D.A.S. and Reid, N., 1995, Ancillaries and third-order significance. Utilitas Mathematica, 47, 33–53.] and by Fraser et al. [Fraser, D.A.S., Reid, N. and Wu, J., 1999, A simple formula for tail probabilities for frequentist and Bayesian inference. Biometrika, 86, 655–661.]. We focus on point estimation and likelihood ratio tests on the shape parameter in the class of Weibull regression models. We derive some distributional properties of the different maximum likelihood estimators and likelihood ratio tests. The numerical evidence presented in the paper favors the approximation to Barndorff–Nielsen's adjustment.     

Does bias reduction with external estimator of second order parameter work for endpoint?

Bias reduction estimation for tail index has been studied in the literature. One method is to reduce bias with an external estimator of the second order regular variation parameter; see Gomes and Martins [2002. Asymptotically unbiased estimators of the tail index based on external estimation of the second order parameter. Extremes 5(1), 5–31]. It is known that negative extreme value index implies that the underlying distribution has a finite right endpoint. As far as we know, there exists no bias reduction estimator for the endpoint of a distribution. In this paper, we study the bias reduction method with an external estimator of the second order parameter for both the negative extreme value index and endpoint simultaneously. Surprisingly, we find that this bias reduction method for negative extreme value index requires a larger order of sample fraction than that for positive extreme value index. This finding implies that this bias reduction method for endpoint is less attractive than that for positive extreme value index. Nevertheless, our simulation study prefers the proposed bias reduction estimators to the biased estimators in Hall [1982. On estimating the endpoint of a distribution. Ann. Statist. 10, 556–568].     

The Royal Statistical Society Speech Delivered at the 125th Anniversary Dinner

The Statistical Society of London was founded on March 15, 1834, with the Marquis of Lansdowne in the Chair. The Society began with 313 “original members”. The Royal Charter was granted in 1887 following its fiftieth anniversary. The number of fellows reached 1000 in 1924, 2000 in 1949, and promises to reach 3000 in the current year.

The Anniversary Dinner was held on March 17, 1959. The Prime Minister proposed the toast to the Royal Statistical Society and the President of the Society, Sir Harry Campion, responded. Other speakers at the dinner were Lord Piercy and Prof. A. Bradford Hill (Past Presidents of the Society), Sir Harold Gillett (Lord Mayor of London) and Sir Maurice Bowra (President of the British Academy).

Dr. Churchill Eisenhart, Vice-President of the ASA, represented the Association at the Anniversary Dinner. The Prime Minister's press release and the banquet program (from which this note was compiled) were transmitted to THE AMERICAN STATISTICIAN by Dr. Eisenhart.

A full account of the Dinner, with the report of the speeches, is to be published in the Journal of the Royal Statistical Society, Series A (General), Part III (1959).     

Applied regression analysis bibliography update 1990-91

The 25-page Bibliography in Applied Regression Analysis, 2nd edition, by N.R. Draper and H. Smith, published by Wiley in 1981, was previously extended by a list of selected references available during 1988-89, plus a few older references. See Communications in Statistics - Theory and Methods, 19(4), 1205-1229 (1990). Here is a further update covering the years 1990-91, and following the same format. As before, items were chosen on the basis of their perceived relevance to practical applications (sometimes rather widely interpreted). The classification system used is that of the book.

The references were selected mostly from the issues of these journals: Annals of Statistics; Applied Statistics; Biometrika; Canadian Journal of Statistics; Bulletin of the International Statistical Institute; Journal of the American Statistical Association; Journal of Quality Technology; Journal of the Royal Statistical Society, Series A and B; and Technometrics.     

Likelihood‐based inference for correlated diffusions

The authors address the problem of likelihood‐based inference for correlated diffusions. Such a task presents two issues; the positive definite constraints of the diffusion matrix and the likelihood intractability. The first issue is handled by using the Cholesky factorization on the diffusion matrix. To deal with the likelihood unavailability, a generalization of the data augmentation framework of Roberts and Stramer [Roberts and Stramer (2001) Biometrika 88(3), 603–621] to d‐dimensional correlated diffusions, including multivariate stochastic volatility models, is given. The methodology is illustrated through simulated and real data sets. The Canadian Journal of Statistics 39: 52–72; 2011 © 2011 Statistical Society of Canada     

Applied regression analysis bibliography update 1988-89

The 25-page Bibliography in Applied Regression Analysis, 2nd edition, by N.R. Draper and H. Smith, published by Wiley in 1981, is extended by a list of selected references available during 1988-89, and a few older references inadvertently omitted from previous lists. It is hoped that this will be useful to regression practictioners. Items were chosen on the basis of their perceived relevance to practical applications (sometimes rather widely interpreted). The classification system used is that of the book.

The references were selected mostly from the issues of these journals: Annals of Statistics; Applied Statistics: Biometrika; Canadian Journal of Statistics; Bulletin of the International Statistical Institute; Journal of the American Statistical Association; Journal of Quality Technology; Journal of the Royal Statistical Society, Series A and B; and Technometrics.

The author would appreciate being notified of errors, however slight, so that these do not persist in future compilations.     

Data‐driven choice of the smoothing parametrization for kernel density estimators

There are several levels of sophistication when specifying the bandwidth matrix H to be used in a multivariate kernel density estimator, including H to be a positive multiple of the identity matrix, a diagonal matrix with positive elements or, in its most general form, a symmetric positive‐definite matrix. In this paper, the author proposes a data‐based method for choosing the smoothing parametrization to be used in the kernel density estimator. The procedure is fully illustrated by a simulation study and some real data examples. The Canadian Journal of Statistics © 2009 Statistical Society of Canada     

Local linear fitting and improved estimation near peaks

The authors look into the problem of estimating regression functions that exhibit jump irregularities in the first derivative. They investigate the behaviour of the bias in the local linear fit and show the superior performance of appropriate one‐sided versions of the local linear fit near such irregularities. They then propose an improved estimation procedure based on data‐driven selection of a conventional or one‐sided local linear fit according to a residual sum of squares type of criterion. The authors provide theoretical results and illustrate the method both on simulated and real‐life data examples. The Canadian Journal of Statistics 37: 453–475; 2009 © 2009 Statistical Society of Canada     

Some notes on poisson limits for empirical point processes

The authors define the scaled empirical point process. They obtain the weak limit of these point processes through a novel use of a dimension‐free method based on the convergence of compensators of multiparameter martingales. The method extends previous results in several directions. They obtain limits at points where the density may be zero, but has regular variation. The joint limit of the empirical process evaluated at distinct points is given by independent Poisson processes. They provide applications both to nearest‐neighbour density estimation in high dimensions, and to the asymptotic behaviour of multivariate extremes such as those arising from bivariate normal copulas. The Canadian Journal of Statistics 37: 347–360; 2009 © 2009 Statistical Society of Canada     

Information borrowing methods for covariate‐adjusted ROC curve

In medical diagnostic testing problems, the covariate adjusted receiver operating characteristic (ROC) curves have been discussed recently for achieving the best separation between disease and control. Due to various restrictions such as cost, the availability of patients, and ethical issues quite frequently only limited information is available. As a result, we are unlikely to have a large enough overall sample size to support reliable direct estimations of ROCs for all the underlying covariates of interest. For example, some genetic factors are less commonly observable compared with others. To get an accurate covariate adjusted ROC estimation, novel statistical methods are needed to effectively utilize the limited information. Therefore, it is desirable to use indirect estimates that borrow strength by employing values of the variables of interest from neighbouring covariates. In this paper we discuss two semiparametric exponential tilting models, where the density functions from different covariate levels share a common baseline density, and the parameters in the exponential tilting component reflect the difference among the covariates. With the proposed models, the estimated covariate adjusted ROC is much smoother and more efficient than the nonparametric counterpart without borrowing information from neighbouring covariates. A simulation study and a real data application are reported. The Canadian Journal of Statistics 40: 569–587; 2012 © 2012 Statistical Society of Canada     

Imputation for statistical inference with coarse data

Coarse data is a general type of incomplete data that includes grouped data, censored data, and missing data. The likelihood‐based estimation approach with coarse data is challenging because the likelihood function is in integral form. The Monte Carlo EM algorithm of Wei & Tanner [Wei & Tanner (1990). Journal of the American Statistical Association, 85, 699–704] is adapted to compute the maximum likelihood estimator in the presence of coarse data. Stochastic coarse data is also covered and the computation can be implemented using the parametric fractional imputation method proposed by Kim [Kim (2011). Biometrika, 98, 119–132]. Results from a limited simulation study are presented. The proposed method is also applied to the Korean Longitudinal Study of Aging (KLoSA). The Canadian Journal of Statistics 40: 604–618; 2012 © 2012 Statistical Society of Canada     

Locally efficient semiparametric estimators for a class of Poisson models with measurement error

The presence of measurement error may cause bias in parameter estimation and can lead to incorrect conclusions in data analyses. Despite a large body of literature on general measurement error problems, relatively few works exist to handle Poisson models. In this article we thoroughly study Poisson models with errors in covariates and propose consistent and locally efficient semiparametric estimators. We assess the finite sample performance of the estimators through extensive simulation studies and illustrate the proposed methodologies by analyzing data from the Stroke Recovery in Underserved Populations Study. The Canadian Journal of Statistics 47: 157–181; 2019 © 2019 Statistical Society of Canada     

An efficient nonparametric test for bivariate two-sample location problem

We propose a new test for the two-sample bivariate location problem. The proposed test statistic has a U-statistic representation with a degenerate kernel. The limiting distribution is found for the proposed test statistic. The power of the test is compared using Monte Carlo simulation to the tests of Blumen [I. Blumen, A new bivariate sign-test for location, Journal of the American Statistical Association 53 (1958) 448–456], Mardia [K.V. Mardia, A non-parametric test for the bivariate two-sample location problem, Journal of the Royal Statistical Society, Series B 29 (1967) 320–342], Peters and Randles [D. Peters, R.H. Randles, A bivariate signed-rank test for the two-sample location problem, Journal of the Royal Statistical Society, Series B 53 (1991) 493–504], LaRocque, Tardif and van Eeden [D. LaRocque, S. Tardif, C. van Eeden, An affine-invariant generalization of the Wilcoxon signed-rank test for the bivariate location problem, Australian and New Zealand Journal of Statistics 45 (2003) 153–165], and Baringhaus and Franz [L. Baringhaus, C. Franz, On a new multivariate two-sample test, Journal of Multivariate Analysis 88 (2004) 190–206]. Under the bivariate normal and bivariate t distributions the proposed test was more powerful than the competitors for almost every change in location. Under the other distributions the proposed test reached the desired power of one at a faster rate than the other tests in the simulation study. Application of the test is presented using bivariate data from a synthetic and a real-life data set.