Curve prediction and clustering with mixtures of Gaussian process functional regression models

Shi, Wang, Murray-Smith and Titterington (Biometrics 63:714–723, 2007) proposed a Gaussian process functional regression (GPFR) model to model functional response curves with a set of functional covariates. Two main problems are addressed by their method: modelling nonlinear and nonparametric regression relationship and modelling covariance structure and mean structure simultaneously. The method gives very good results for curve fitting and prediction but side-steps the problem of heterogeneity. In this paper we present a new method for modelling functional data with ‘spatially’ indexed data, i.e., the heterogeneity is dependent on factors such as region and individual patient’s information. For data collected from different sources, we assume that the data corresponding to each curve (or batch) follows a Gaussian process functional regression model as a lower-level model, and introduce an allocation model for the latent indicator variables as a higher-level model. This higher-level model is dependent on the information related to each batch. This method takes advantage of both GPFR and mixture models and therefore improves the accuracy of predictions. The mixture model has also been used for curve clustering, but focusing on the problem of clustering functional relationships between response curve and covariates, i.e. the clustering is based on the surface shape of the functional response against the set of functional covariates. The model is examined on simulated data and real data.     

Local functional data model for characterizing shape variation of similar curves

“Similar curves” in the present article refers to a family of curves whose major shape are similar, but who have variation coming from curve-specific sources. The goal here is to develop a general methodology to describe small changes among similar curves. Previous methods mainly focus on dimension reduction through FPCA, which are not appropriate for quantifying local variation. Here, we consider a local functional data model which divides data into segments adaptively and models each segment with a shape invariant model. Such model has great flexibility in characterizing local variation of curves, as illustrated by simulation and real data examples.     

Hierarchical Bayesian models for predicting spatially correlated curves

Functional data analysis has emerged as a new area of statistical research with a wide range of applications. In this paper, we propose novel models based on wavelets for spatially correlated functional data. These models enable one to regularize curves observed over space and predict curves at unobserved sites. We compare the performance of these Bayesian models with several priors on the wavelet coefficients using the posterior predictive criterion. The proposed models are illustrated in the analysis of porosity data.     

Empirical likelihood inference for partial functional linear model with missing responses

In this paper, we consider the empirical likelihood inferences of the partial functional linear model with missing responses. Two empirical log-likelihood ratios of the parameters of interest are constructed, and the corresponding maximum empirical likelihood estimators of parameters are derived. Under some regularity conditions, we show that the proposed two empirical log-likelihood ratios are asymptotic standard Chi-squared. Thus, the asymptotic results can be used to construct the confidence intervals/regions for the parameters of interest. We also establish the asymptotic distribution theory of corresponding maximum empirical likelihood estimators. A simulation study indicates that the proposed methods are comparable in terms of coverage probabilities and average lengths of confidence intervals. An example of real data is also used to illustrate our proposed methods.     

The historical functional linear model

The authors develop a functional linear model in which the values at time t of a sample of curves yi (t) are explained in a feed‐forward sense by the values of covariate curves xi(s) observed at times s ±.t. They give special attention to the case s ± [t — δ, t], where the lag parameter δ is estimated from the data. They use the finite element method to estimate the bivariate parameter regression function β(s, t), which is defined on the triangular domain s ± t. They apply their model to the problem of predicting the acceleration of the lower lip during speech on the basis of electromyographical recordings from a muscle depressing the lip. They also provide simulation results to guide the calibration of the fitting process.     

A functional coefficient GARCH-M model

ABSTRACT

Motivated by the time varying property of the risk aversion and the functional coefficient regression model, a functional coefficient GARCH-M model is studied. The proposed GARCH-M type model gives a way to study the relationship between risk aversion and certain variable. An approach is given to estimate the model and some theoretical results are obtained. Simulations demonstrate that the method performs well. From the empirical studies, it is shown that the proposed model can better fit the considered data compared to the usual parametric models.     

Estimation in a model for a semi-Markov process with covariates under right-censoring

A semi-Markov model with covariates is proposed for a multi-state process with a finite number of states such that the transition probabilities between the states and the distribution functions of the duration times between the occurrence of two states depend on a discrete covariate. The hazard rates for the time elapsed between two successive states depend on the covariate through a proportional hazards model involving a set of regression parameters, while the transition probabilities depend on the covariate in an unspecified way. We propose estimators for these parameters and for the cumulative hazard functions of the sojourn times. A difficulty comes from the fact that when a sojourn time in a state is right-censored, the next state is unknown. We prove that our estimators are consistent and asymptotically Gaussian under the model constraints.     

The nested joint clustering via Dirichlet process mixture model

This article focuses on the clustering problem based on Dirichlet process (DP) mixtures. To model both time invariant and temporal patterns, different from other existing clustering methods, the proposed semi-parametric model is flexible in that both the common and unique patterns are taken into account simultaneously. Furthermore, by jointly clustering subjects and the associated variables, the intrinsic complex shared patterns among subjects and among variables are expected to be captured. The number of clusters and cluster assignments are directly inferred with the use of DP. Simulation studies illustrate the effectiveness of the proposed method. An application to wheal size data is discussed with an aim of identifying novel temporal patterns among allergens within subject clusters.     

The conditional cumulative distribution function in single functional index model

ABSTRACT

We consider the estimation of the conditional cumulative distribution function of a scalar response variable Y given a Hilbertian random variable X when the observations are linked via a single-index structure. We establish the pointwise and the uniform almost complete convergence (with the rate) of the kernel estimate of this model. As an application, we show how our result can be applied in the prediction problem via the conditional median estimate. Also, the choice of the functional index via the cross-validation procedure is also discussed but not attacked.     

Asymptotic properties of MLE for partially observed fractional diffusion system with dependent noises

The paper studies long time asymptotic properties of the maximum likelihood estimator (MLE) for the signal drift parameter in a partially observed fractional diffusion system with dependent noise. Using the method of weak convergence of likelihoods due to Ibragimov and Khasminskii [1981. Statistics of Random Processes. Springer, New-York], consistency, asymptotic normality and convergence of the moments are established for MLE. The proof is based on Laplace transform computations which was introduced in Brouste and Kleptsyna [2008. Asymptotic properties of MLE for partially observed fractional diffusion system, preprint].     

Least absolute relative error estimation for functional quadratic multiplicative model

ABSTRACT

As an alternative to the functional quadratic model due to Yao and Müller (2010 Yao, F., Müller, H.-G. (2010). Functional quadratic regression. Biometrika 97:49–64.[Crossref], [Web of Science ®] , [Google Scholar]), we consider a functional quadratic multiplicative model. This multiplicative model provides a useful alternative when the relative error is considered for analyzing data with positive responses. The existing work for functional models are mainly based on absolute errors. The commonly used least squares criterion is just such an example. In many practical applications, however, people concern on the size of relative error rather than that of error itself. Therefore, the estimation procedure based on least absolute relative errors, which is proposed by Chen et al. (2010 Chen, K., Guo, S., Lin, Y., Ying, Z. (2010). Least absolute relative error estimation. J. Am. Stat. Assoc. 105:1104–1112.[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]) for the linear multiplicative model, is developed for functional quadratic multiplicative model. The asymptotic behaviors of the proposed estimators are established. Some simulation studies show that the estimation procedure has good prediction performance. Moreover, a real data set is analyzed for illustrating the proposed methods.     

Inference in smoothing spline analysis of variance

Summary. Smoothing spline analysis of variance decomposes a multivariate function into additive components. This decomposition not only provides an efficient way to model a multivariate function but also leads to meaningful inference by testing whether a certain component equals 0. No formal procedure is yet available to test such a hypothesis. We propose an asymptotic method based on the likelihood ratio to test whether a functional component is 0. This test allows us to choose an optimal model and to compare groups of curves. We first develop the general theory by exploiting the connection between mixed effects models and smoothing splines. We then apply this to compare two groups of curves and to select an optimal model in a two-dimensional problem. A small simulation is used to assess the finite sample performance of the likelihood ratio test.     

Approximation spline de la prevision d'un processus fonctionnel autorégressif d'ordre 1

ABSTRACT We present a method to approximate and forecast, on an entire interval, a continuous-time process. For this purpose, we use the modelization of ARH(l) processes, defined by Bosq (1991). We deal with the practical problem of the discretization of the observed trajectories and approximate them by means of spline functions. We show by simulations that for well-chosen smoothing parameters, good prediction can be obtained in comparison with the “predictable” part of the process. Finally, we apply this model to forecast road traffic and compare it with a SARIMA model.     

Analysis of functional status transitions by using a semi-Markov process model in the presence of left-censored spells

Summary.  To analyse functional status transitions in the older population better, we fit a semi-Markov process model to data from the 1992–2002 Medicare Current Beneficiary Survey. We used an analogue of the stochastic EM algorithm to address the problem of left censoring of spells in longitudinal data. The iterative algorithm converged robustly under various initial values for the unobserved elapsed durations of spells in progress at base-line. Results on life expectancy and recovery from functional limitations based on the semi-Markov process model differ from those based on the traditional multistate life-table method. The proposed treatment of left-censored spells has the potential to expand the modelling capability that is available to researchers in fields where left censoring is a concern.     

Rank estimation for the functional linear model

This article discusses the estimation of the parameter function for a functional linear regression model under heavy-tailed errors' distributions and in the presence of outliers. Standard approaches of reducing the high dimensionality, which is inherent in functional data, are considered. After reducing the functional model to a standard multiple linear regression model, a weighted rank-based procedure is carried out to estimate the regression parameters. A Monte Carlo simulation and a real-world example are used to show the performance of the proposed estimator and a comparison made with the least-squares and least absolute deviation estimators.     

基于状态空间模型的中国煤炭价格长期趋势预测

预测中国煤炭价格的长期变动趋势,对煤炭生产和使用链中各企业规避价格风险和调整经营战略,对国家进行宏观经济管理和保障能源安全具有重要的参考价值。通过构建煤炭价格的状态空间模型,并预测中国煤炭价格指数的长期变动趋势,表明状态空间模型对煤炭价格具有良好的预测性能;中国的煤炭工业品出厂价格指数将从2010年1月的248．5持续上涨到2020年12月的315．2,上涨幅度为26．8％,但上涨速度将从2011年的3．5％逐年递减至2020年的0．6％。     

Robust group-Lasso for functional regression model

In this article, we consider the problem of selecting functional variables using the L1 regularization in a functional linear regression model with a scalar response and functional predictors, in the presence of outliers. Since the LASSO is a special case of the penalized least-square regression with L1 penalty function, it suffers from the heavy-tailed errors and/or outliers in data. Recently, Least Absolute Deviation (LAD) and the LASSO methods have been combined (the LAD-LASSO regression method) to carry out robust parameter estimation and variable selection simultaneously for a multiple linear regression model. However, variable selection of the functional predictors based on LASSO fails since multiple parameters exist for a functional predictor. Therefore, group LASSO is used for selecting functional predictors since group LASSO selects grouped variables rather than individual variables. In this study, we propose a robust functional predictor selection method, the LAD-group LASSO, for a functional linear regression model with a scalar response and functional predictors. We illustrate the performance of the LAD-group LASSO on both simulated and real data.     

Computation aspects of the parameter estimates of linear mixed effects model in multivariate repeated measures set-up

The number of parameters mushrooms in a linear mixed effects (LME) model in the case of multivariate repeated measures data. Computation of these parameters is a real problem with the increase in the number of response variables or with the increase in the number of time points. The problem becomes more intricate and involved with the addition of additional random effects. A multivariate analysis is not possible in a small sample setting. We propose a method to estimate these many parameters in bits and pieces from baby models, by taking a subset of response variables at a time, and finally using these bits and pieces at the end to get the parameter estimates for the mother model, with all variables taken together. Applying this method one can calculate the fixed effects, the best linear unbiased predictions (BLUPs) for the random effects in the model, and also the BLUPs at each time of observation for each response variable, to monitor the effectiveness of the treatment for each subject. The proposed method is illustrated with an example of multiple response variables measured over multiple time points arising from a clinical trial in osteoporosis.     

A latent process model for dementia and psychometric tests

We jointly model longitudinal values of a psychometric test and diagnosis of dementia. The model is based on a continuous-time latent process representing cognitive ability. The link between the latent process and the observations is modeled in two phases. Intermediate variables are noisy observations of the latent process; scores of the psychometric test and diagnosis of dementia are obtained by categorizing these intermediate variables. We propose maximum likelihood inference for this model and we propose algorithms for performing this task. We estimated the parameters of such a model using the data of the 5 year follow-up of the PAQUID study. In particular this analysis yielded interesting results about the effect of educational level on both latent cognitive ability and specific performance in the mini mental test examination. The predictive ability of the model is illustrated by predicting diagnosis of dementia at the 8 year follow-up of the PAQUID study based on the information from the first 5 years.     

Rate of uniform consistency for nonparametric estimates with functional variables

In this paper we investigate nonparametric estimation of some functionals of the conditional distribution of a scalar response variable Y given a random variable X taking values in a semi-metric space. These functionals include the regression function, the conditional cumulative distribution, the conditional density and some other ones. The literature on nonparametric functional statistics is only concerning pointwise consistency results, and our main aim is to prove the uniform almost complete convergence (with rate) of the kernel estimators of these nonparametric models. Unlike in standard multivariate cases, the gap between pointwise and uniform results is not immediate. So, suitable topological considerations are needed, implying changes in the rates of convergence which are quantified by entropy considerations. These theoretical uniform consistency results are (or will be) key tools for many further developments in functional data analysis.