Short-term forecasting with a computationally efficient nonparametric transfer function model

In this paper a semi-parametric approach is developed to model non-linear relationships in time series data using polynomial splines. Polynomial splines require very little assumption about the functional form of the underlying relationship, so they are very flexible and can be used to model highly non-linear relationships. Polynomial splines are also computationally very efficient. The serial correlation in the data is accounted for by modelling the noise as an autoregressive integrated moving average (ARIMA) process, by doing so, the efficiency in nonparametric estimation is improved and correct inferences can be obtained. The explicit structure of the ARIMA model allows the correlation information to be used to improve forecasting performance. An algorithm is developed to automatically select and estimate the polynomial spline model and the ARIMA model through backfitting. This method is applied on a real-life data set to forecast hourly electricity usage. The non-linear effect of temperature on hourly electricity usage is allowed to be different at different hours of the day and days of the week. The forecasting performance of the developed method is evaluated in post-sample forecasting and compared with several well-accepted models. The results show the performance of the proposed model is comparable with a long short-term memory deep learning model.     

Confidence sets in a linear regression model for interval data

The construction of confidence sets for the parameters of a flexible simple linear regression model for interval-valued random sets is addressed. For that purpose, the asymptotic distribution of the least-squares estimators is analyzed. A simulation study is conducted to investigate the performance of those confidence sets. In particular, the empirical coverages are examined for various interval linear models. The applicability of the procedure is illustrated by means of a real-life case study.     

An efficient algorithm for Harrison-Stevens forecasting using the multi-process multivariate dynamic linear model

This paper develops a computationally efficient algorithm for Harrison-Stevens forecasting in a multivariate time series which has correlated errors. The algorithm uses the observation vector one component at a time on the multiprocess multivariate dynamic linear model. This gives a computationally efficient, robust, quick adapting forecasting method for non stationary multivariate time series.     

A simplified estimation procedure based on the EM algorithm for the power series cure rate model

The family of power series cure rate models provides a flexible modeling framework for survival data of populations with a cure fraction. In this work, we present a simplified estimation procedure for the maximum likelihood (ML) approach. ML estimates are obtained via the expectation-maximization (EM) algorithm where the expectation step involves computation of the expected number of concurrent causes for each individual. It has the big advantage that the maximization step can be decomposed into separate maximizations of two lower-dimensional functions of the regression and survival distribution parameters, respectively. Two simulation studies are performed: the first to investigate the accuracy of the estimation procedure for different numbers of covariates and the second to compare our proposal with the direct maximization of the observed log-likelihood function. Finally, we illustrate the technique for parameter estimation on a dataset of survival times for patients with malignant melanoma.     

Robust and efficient parameter estimation based on censored data with stochastic covariates

Analysis of random censored life-time data along with some related stochastic covariables is of great importance in many applied sciences. The parametric estimation technique commonly used under this set-up is based on the efficient but non-robust likelihood approach. In this paper, we propose a robust parametric estimator for censored data with stochastic covariates based on the minimum density power divergence approach. The resulting estimator also has competitive efficiency with respect to the maximum likelihood estimator under pure data. The strong robustness property of the proposed estimator with respect to the presence of outliers is examined and illustrated through an appropriate real data example and simulation studies. Further, the theoretical asymptotic properties of the proposed estimator are also derived in terms of a general class of M-estimators based on the estimating equation.     

Robust estimation for finite populations based on a working model

A common scenario in finite population inference is that it is possible to find a working superpopulation model which explains the main features of the population but which may not capture all the fine details. In addition, there are often outliers in the population which do not follow the assumed superpopulation model. In situations like these, it is still advantageous to make use of the working model to estimate finite population quantities, provided that we do it in a robust manner. The approach that we suggest is first to fit the working model to the sample and then to fine-tune for departures from the model assumed by estimating the conditional distribution of the residuals as a function of the auxiliary variable. This is a more direct approach to handling outliers and model misspecification than the Huber approach that is currently being used. Two simple methods, stratification and nearest neighbour smoothing, are used to estimate the conditional distributions of the residuals, which result in two modifications to the standard model-based estimator of the population distribution function. The estimators suggested perform very well in simulation studies involving two types of model departure and have small variances due to their model-based construction as well as acceptable bias. The potential advantage of the proposed robustified model-based approach over direct nonparametric regression is also demonstrated.     

An autoregressive model based on the generalized hyperbolic distribution

We define a nonlinear autoregressive time series model based on the generalized hyperbolic distribution in an attempt to model time series with non-Gaussian features such as skewness and heavy tails. We show that the resulting process has a simple condition for stationarity and it is also ergodic. An empirical example with a forecasting experiment is presented to illustrate the features of the proposed model.     

Autoregressive model selection based on a prediction perspective

The autoregressive (AR) model is a popular method for fitting and prediction in analyzing time-dependent data, where selecting an accurate model among considered orders is a crucial issue. Two commonly used selection criteria are the Akaike information criterion and the Bayesian information criterion. However, the two criteria are known to suffer potential problems regarding overfit and underfit, respectively. Therefore, using them would perform well in some situations, but poorly in others. In this paper, we propose a new criterion in terms of the prediction perspective based on the concept of generalized degrees of freedom for AR model selection. We derive an approximately unbiased estimator of mean-squared prediction errors based on a data perturbation technique for selecting the order parameter, where the estimation uncertainty involved in a modeling procedure is considered. Some numerical experiments are performed to illustrate the superiority of the proposed method over some commonly used order selection criteria. Finally, the methodology is applied to a real data example to predict the weekly rate of return on the stock price of Taiwan Semiconductor Manufacturing Company and the results indicate that the proposed method is satisfactory.     

Estimation and tests for a longitudinal regression model based on the Markov chain

In this paper, the dependence of transition probabilities on covariates and a test procedure for covariate dependent Markov models are examined. The nonparametric test for the role of waiting time proposed by Jones and Crowley [M. Jones, J. Crowley, Nonparametric tests of the Markov model for survival data Biometrika 79 (3) (1992) 513–522] has been extended here to transitions and reverse transitions. The limitation of the Jones and Crowley method is that it does not take account of other covariates that might have association with the probabilities of transition. A simple test procedure is proposed that can be employed for testing: (i) the significance of association between covariates and transition probabilities, and (ii) the impact of waiting time on the transition probabilities. The procedure is illustrated using panel data on hospitalization of the elderly population in the USA from the Health and Retirement Survey (HRS).     

Nonparametric estimation of waiting time distributions in a Markov model based on current status data

We construct nonparametric estimators of state waiting time distribution functions in a Markov multistate model using current status data. This is a particularly difficult problem since neither the entry nor the exit times of a given state are directly observed. These estimators are obtained, using the Markov property, from estimators of counting processes of state entry and exit times, as well as, the size of “at risk” sets of state entry and transitions out of that state. Consistency of our estimators is established. Finite-sample behavior of our estimators is studied by simulation, in which we show that our estimators based on current status data compare well with those based on complete data. We also illustrate our method using a pubertal development data set obtained from the NHANES III [1997. NHANES III Reference Manuals and Reports (CD-ROM). Analytic and Reporting Guidelines: The Third National Health and Nutrition Examination Survey (1988–94). National Center for Health Statistics, Centers for Disease Control and Prevention, Hyattsville, MD] study.     

An INAR(1) model based on a mixed dependent and independent counting series

A mixed integer-valued autoregressive model of order one, based on the binomial and the generalized binomial thinning operator is introduced. Geometric marginal distribution is considered. Properties of the model are analysed, unknown parameters are estimated and some numerical results of the estimates are obtained. Finally, model is applied on two real data sets and compared to some relevant models.     

Best linear unbiased estimators of parameters of a simple linear regression model based on ordered ranked set samples

As an alternative to an estimation based on a simple random sample (BLUE-SRS) for the simple linear regression model, Moussa-Hamouda and Leone [E. Moussa-Hamouda and F.C. Leone, The o-blue estimators for complete and censored samples in linear regression, Technometrics, 16 (3) (1974), pp. 441–446.] discussed the best linear unbiased estimators based on order statistics (BLUE-OS), and showed that BLUE-OS is more efficient than BLUE-SRS for normal data. Using the ranked set sampling, Barreto and Barnett [M.C.M. Barreto and V. Barnett, Best linear unbiased estimators for the simple linear regression model using ranked set sampling. Environ. Ecoll. Stat. 6 (1999), pp. 119–133.] derived the best linear unbiased estimators (BLUE-RSS) for simple linear regression model and showed that BLUE-RSS is more efficient for the estimation of the regression parameters (intercept and slope) than BLUE-SRS for normal data, but not so for the estimation of the residual standard deviation in the case of small sample size. As an alternative to RSS, this paper considers the best linear unbiased estimators based on order statistics from a ranked set sample (BLUE-ORSS) and shows that BLUE-ORSS is uniformly more efficient than BLUE-RSS and BLUE-OS for normal data.