Penalized least squares smoothing of two-dimensional mortality tables with imposed smoothness

This paper presents a method to estimate mortality trends of two-dimensional mortality tables. Comparability of mortality trends for two or more of such tables is enhanced by applying penalized least squares and imposing a desired percentage of smoothness to be attained by the trends. The smoothing procedure is basically determined by the smoothing parameters that are related to the percentage of smoothness. To quantify smoothness, we employ an index defined first for the one-dimensional case and then generalized to the two-dimensional one. The proposed method is applied to data from member countries of the OECD. We establish as goal the smoothed mortality surface for one of those countries and compare it with some other mortality surfaces smoothed with the same percentage of two-dimensional smoothness. Our aim is to be able to see whether convergence exists in the mortality trends of the countries under study, in both year and age dimensions.     

Trend estimation of multivariate time series with controlled smoothness

This paper extends the univariate time series smoothing approach provided by penalized least squares to a multivariate setting, thus allowing for joint estimation of several time series trends. The theoretical results are valid for the general multivariate case, but particular emphasis is placed on the bivariate situation from an applied point of view. The proposal is based on a vector signal-plus-noise representation of the observed data that requires the first two sample moments and specifying only one smoothing constant. A measure of the amount of smoothness of an estimated trend is introduced so that an analyst can set in advance a desired percentage of smoothness to be achieved by the trend estimate. The required smoothing constant is determined by the chosen percentage of smoothness. Closed form expressions for the smoothed estimated vector and its variance-covariance matrix are derived from a straightforward application of generalized least squares, thus providing best linear unbiased estimates for the trends. A detailed algorithm applicable for estimating bivariate time series trends is also presented and justified. The theoretical results are supported by a simulation study and two real applications. One corresponds to Mexican and US macroeconomic data within the context of business cycle analysis, and the other one to environmental data pertaining to a monitored site in Scotland.     

Adaptive modelling of dose–response relationships using smoothing splines

We consider the use of smoothing splines for the adaptive modelling of dose–response relationships. A smoothing spline is a nonparametric estimator of a function that is a compromise between the fit to the data and the degree of smoothness and thus provides a flexible way of modelling dose–response data. In conjunction with decision rules for which doses to continue with after an interim analysis, it can be used to give an adaptive way of modelling the relationship between dose and response. We fit smoothing splines using the generalized cross‐validation criterion for deciding on the degree of smoothness and we use estimated bootstrap percentiles of the predicted values for each dose to decide upon which doses to continue with after an interim analysis. We compare this approach with a corresponding adaptive analysis of variance approach based upon new simulations of the scenarios previously used by the PhRMA Working Group on Adaptive Dose‐Ranging Studies. The results obtained for the adaptive modelling of dose–response data using smoothing splines are mostly comparable with those previously obtained by the PhRMA Working Group for the Bayesian Normal Dynamic Linear model (GADA) procedure. These methods may be useful for carrying out adaptations, detecting dose–response relationships and identifying clinically relevant doses. Copyright © 2009 John Wiley & Sons, Ltd.     

Convergence rates for smoothing spline estimators in varying coefficient models

We consider the estimation of a multiple regression model in which the coefficients change slowly in “time”, with “time” being an additional covariate. Under reasonable smoothness conditions, we prove the usual expected mean square error bounds for the smoothing spline estimators of the coefficient functions.     

Trend smoothness achieved by penalized least squares with the smoothing parameter chosen by optimality criteria

This work presents a study about the smoothness attained by the methods more frequently used to choose the smoothing parameter in the context of splines: Cross Validation, Generalized Cross Validation, and corrected Akaike and Bayesian Information Criteria, implemented with Penalized Least Squares. It is concluded that the amount of smoothness strongly depends on the length of the series and on the type of underlying trend, while the presence of seasonality even though statistically significant is less relevant. The intrinsic variability of the series is not statistically significant and its effect is taken into account only through the smoothing parameter.     

Theory & Methods: Krige,Smooth, Both or Neither?

Both kriging and non-parametric regression smoothing can model a non-stationary regression function with spatially correlated errors. However comparisons have mainly been based on ordinary kriging and smoothing with uncorrelated errors. Ordinary kriging attributes smoothness of the response to spatial autocorrelation whereas non-parametric regression attributes trends to a smooth regression function. For spatial processes it is reasonable to suppose that the response is due to both trend and autocorrelation. This paper reviews methodology for non-parametric regression with autocorrelated errors which is a natural compromise between the two methods. Re-analysis of the one-dimensional stationary spatial data of Laslett (1994) and a clearly non-stationary time series demonstrates the rather surprising result that for these data, ordinary kriging outperforms more computationally intensive models including both universal kriging and correlated splines for spatial prediction. For estimating the regression function, non-parametric regression provides adaptive estimation, but the autocorrelation must be accounted for in selecting the smoothing parameter.     

Bayesian Recovery of the Initial Condition for the Heat Equation

We study a Bayesian approach to recovering the initial condition for the heat equation from noisy observations of the solution at a later time. We consider a class of prior distributions indexed by a parameter quantifying “smoothness” and show that the corresponding posterior distributions contract around the true parameter at a rate that depends on the smoothness of the true initial condition and the smoothness and scale of the prior. Correct combinations of these characteristics lead to the optimal minimax rate. One type of priors leads to a rate-adaptive Bayesian procedure. The frequentist coverage of credible sets is shown to depend on the combination of the prior and true parameter as well, with smoother priors leading to zero coverage and rougher priors to (extremely) conservative results. In the latter case, credible sets are much larger than frequentist confidence sets, in that the ratio of diameters diverges to infinity. The results are numerically illustrated by a simulated data example.     

Automatic locally adaptive smoothing for tree-based set estimation

Tree-based methods similar to CART have recently been utilized for problems in which the main goal is to estimate some set of interest. It is often the case that the boundary of the true set is smooth in some sense, however tree-based estimates will not be smooth, as they will be a union of ‘boxes’. We propose a general methodology for smoothing such sets that allows for varying levels of smoothness on the boundary automatically. The method is similar to the idea underlying support vector machines, which is applying a computationally simple technique to data after a non-linear mapping to produce smooth estimates in the original space. In particular, we consider the problem of level-set estimation for regression functions and the dyadic tree-based method of Willett and Nowak [Minimax optimal level-set estimation, IEEE Trans. Image Process. 16 (2007), pp. 2965–2979].     

Effect of autocorrelation when estimating the trend of a time series via penalized least squares with controlled smoothness

This paper studies the effect of autocorrelation on the smoothness of the trend of a univariate time series estimated by means of penalized least squares. An index of smoothness is deduced for the case of a time series represented by a signal-plus-noise model, where the noise follows an autoregressive process of order one. This index is useful for measuring the distortion of the amount of smoothness by incorporating the effect of autocorrelation. Different autocorrelation values are used to appreciate the numerical effect on smoothness for estimated trends of time series with different sample sizes. For comparative purposes, several graphs of two simulated time series are presented, where the estimated trend is compared with and without autocorrelation in the noise. Some findings are as follows, on the one hand, when the autocorrelation is negative (no matter how large) or positive but small, the estimated trend gets very close to the true trend. Even in this case, the estimation is improved by fixing the index of smoothness according to the sample size. On the other hand, when the autocorrelation is positive and large the simulated and estimated trends lie far away from the true trend. This situation is mitigated by fixing an appropriate index of smoothness for the estimated trend in accordance to the sample size at hand. Finally, an empirical example serves to illustrate the use of the smoothness index when estimating the trend of Mexico’s quarterly GDP.     

Nonparametric estimation of discrete hazard functions

A smoothing procedure for discrete time failure data is proposed which allows for the inclusion of covariates. This purely nonparametric method is based on discrete or continuous kernel smoothing techniques that gives a compromise between the data and smoothness. The method may be used as an exploratory tool to uncover the underlying structure or as an alternative to parametric methods when prediction is the primary objective. Confidence intervals are considered and alternative techniques of cross validation based choices of smoothing parameters are investigated.     

A note on asymptotics for quantile smoothing splines

When cubic smoothing splines are used to estimate the conditional quantile function, thereby balancing fidelity to the data with a smoothness requirement, the resulting curve is the solution to a quadratic program. Using this quadratic characterization and through comparison with the sample conditional quan-tiles, we show strong consistency and asymptotic normality for the quantile smoothing spline.     

A model-averaging approach for smoothing spline regression

ABSTRACT

This article considers nonparametric regression problems and develops a model-averaging procedure for smoothing spline regression problems. Unlike most smoothing parameter selection studies determining an optimum smoothing parameter, our focus here is on the prediction accuracy for the true conditional mean of Y given a predictor X. Our method consists of two steps. The first step is to construct a class of smoothing spline regression models based on nonparametric bootstrap samples, each with an appropriate smoothing parameter. The second step is to average bootstrap smoothing spline estimates of different smoothness to form a final improved estimate. To minimize the prediction error, we estimate the model weights using a delete-one-out cross-validation procedure. A simulation study has been performed by using a program written in R. The simulation study provides a comparison of the most well known cross-validation (CV), generalized cross-validation (GCV), and the proposed method. This new method is straightforward to implement, and gives reliable performances in simulations.     

Confidence intervals for nonparametric quantile regression: an emphasis on smoothing splines approach

In this paper we consider the problem of constructing confidence intervals for nonparametric quantile regression with an emphasis on smoothing splines. The mean‐based approaches for smoothing splines of Wahba (1983) and Nychka (1988) may not be efficient for constructing confidence intervals for the underlying function when the observed data are non‐Gaussian distributed, for instance if they are skewed or heavy‐tailed. This paper proposes a method of constructing confidence intervals for the unknown τth quantile function (0<τ<1) based on smoothing splines. In this paper we investigate the extent to which the proposed estimator provides the desired coverage probability. In addition, an improvement based on a local smoothing parameter that provides more uniform pointwise coverage is developed. The results from numerical studies including a simulation study and real data analysis demonstrate the promising empirical properties of the proposed approach.     

On two-step estimation for varying coefficient models

In this note we discuss two-step kernel estimation of varying coefficient regression models that have a common smoothing variable. The method allows one to use different bandwidths for different coefficient functions. We consider local polynomial fitting and present explicit formulas for the asymptotic biases and variances of the estimators.     

Reducing component estimation for varying coefficient models

The estimation problem for varying coefficient models has been studied by many authors. We consider the problem in the case that the unknown functions admit different degrees of smoothness. In this paper we propose a reducing component local polynomial method to estimate the unknown functions. It is shown that all of our estimators achieve the optimal convergence rates. The asymptotic distributions of our estimators are also derived. The established asymptotic results and the simulation results show that our estimators outperform the the existing two-step estimators when the coefficient functions admit different degrees of smoothness. We also develop methods to speed up the estimation of the model and the selection of the bandwidths.     

Smoothing fertility trends in agricultural field experiments

Fertility trend within blocks and local variations are the major obstacles to estimate cultivar contrasts in agricultural field trials. This paper examines methods of smoothing fertility trends in field trials using the P-spline. We begin by smoothing trend within block and for each block, and proceeds to demonstrate how it can be extended to smooth trends in trials with two-dimensional setting. We propose simultaneous modelling of trends and local variation. We use Papadakis [J.S. Papadakis, Comparison de differentes methds d'expermentation phytotechnique, Rev. Argen. Agronom. 7 (1940), pp. 297–362.] and kriged covariate to model local variation. We emphasize on the benefit of using P-spline to compromise between parametric and non-parametric approaches. Data sets from wheat and barley trials, designed as randomized complete block design and row-column, are analyzed. We set out a simple strategy of choosing between additive model and two-dimensional setting. We explore different estimation methods and offer some generalizations. The results show importance of the P-spline in modelling trend and the need to choose between additive and two-dimensional settings.     

Testing in mixed-effects FANOVA models

We consider the testing problem in the mixed-effects functional analysis of variance models. We develop asymptotically optimal (minimax) testing procedures for testing the significance of functional global trend and the functional fixed effects based on the empirical wavelet coefficients of the data. Wavelet decompositions allow one to characterize various types of assumed smoothness conditions on the response function under the nonparametric alternatives. The distribution of the functional random-effects component is defined in the wavelet domain and captures the sparseness of wavelet representation for a wide variety of functions. The simulation study presented in the paper demonstrates the finite sample properties of the proposed testing procedures. We also applied them to the real data from the physiological experiments.     

Spline smoothing over difficult regions

Summary. It is occasionally necessary to smooth data over domains in R ² with complex irregular boundaries or interior holes. Traditional methods of smoothing which rely on the Euclidean metric or which measure smoothness over the entire real plane may then be inappropriate. This paper introduces a bivariate spline smoothing function defined as the minimizer of a penalized sum-of-squares functional. The roughness penalty is based on a partial differential operator and is integrated only over the problem domain by using finite element analysis. The method is motivated by and applied to two sample smoothing problems and is compared with the thin plate spline.     

A consistent estimator of the smoothing operator in the functional Hodrick–Prescott filter

In this article, we consider a version of the functional Hodrick–Prescott filter for functional time series. We show that the associated optimal smoothing operator preserves the “noise-to-signal ratio” structure. Moreover, as the main result, we propose a consistent estimator of this optimal smoothing operator.     

A Case Study for Modelling Cancer Incidence Using Bayesian Spatio‐Temporal Models

Researchers familiar with spatial models are aware of the challenge of choosing the level of spatial aggregation. Few studies have been published on the investigation of temporal aggregation and its impact on inferences regarding disease outcome in space–time analyses. We perform a case study for modelling individual disease outcomes using several Bayesian hierarchical spatio‐temporal models, while taking into account the possible impact of spatial and temporal aggregation. Using longitudinal breast cancer data from South East Queensland, Australia, we consider both parametric and non‐parametric formulations for temporal effects at various levels of aggregation. Two temporal smoothness priors are considered separately; each is modelled with fixed effects for the covariates and an intrinsic conditional autoregressive prior for the spatial random effects. Our case study reveals that different model formulations produce considerably different model performances. For this particular dataset, a classical parametric formulation that assumes a linear time trend produces the best fit among the five models considered. Different aggregation levels of temporal random effects were found to have little impact on model goodness‐of‐fit and estimation of fixed effects.