An optimal k of kth MA-ARIMA models under MA(q) models

In this article, we discuss finding the optimal k of (i) kth simple moving average, (ii) kth weighted moving average, and (iii) kth exponential weighted moving average based on simulated MA(q) model. We run a simulation using the three above examining methods under specific conditions. The main finding is that, 5th Exponential Weighted Moving Average (5-th EWMA) Autoregressive Integrated Moving Average (ARIMA) model is the best forecasting model among others, which means the optimal k = 5. For Turkish Telecommunications (TTKOM), stock market real data reveals the similar results of the simulation study.     

An optimal k of kth MA-ARIMA models under AR(p) models

In this article, we discuss finding the optimal k of (i) kth simple moving average, (ii) kth weighted moving average, and (iii) kth exponential weighted moving average based on simulated autoregressive AR(p) model. We run a simulation using the three above examining method under specific conditions. The main finding is that the optimal k = 4 and then k = 3. Especially, the fourth WMA ARIMA model, fourth EWMA ARIMA model, and third EWMA ARIMA model are the best forecasting models among others, respectively. For all the six real data reveal the similar results of simulation study.     

Multivariate time series prediction using a hybridization of VARMA models and Bayesian networks

In this paper, a new hybrid model of vector autoregressive moving average (VARMA) models and Bayesian networks is proposed to improve the forecasting performance of multivariate time series. In the proposed model, the VARMA model, which is a popular linear model in time series forecasting, is specified to capture the linear characteristics. Then the errors of the VARMA model are clustered into some trends by K-means algorithm with Krzanowski–Lai cluster validity index determining the number of trends, and a Bayesian network is built to learn the relationship between the data and the trend of its corresponding VARMA error. Finally, the estimated values of the VARMA model are compensated by the probabilities of their corresponding VARMA errors belonging to each trend, which are obtained from the Bayesian network. Compared with VARMA models, the experimental results with a simulation study and two multivariate real-world data sets indicate that the proposed model can effectively improve the prediction performance.     

A comparative study of series arima/mlp hybrid models for stock price forecasting

ABSTRACT

Series hybrid models are one of the most widely-used hybrid models that in which a time series is assumed to be composed of two linear and nonlinear components. In this paper, the performance of two types of these hybrid models is evaluated for predicting stock prices in order to introduce the more reliable series hybrid model. For this purpose, ARIMA and MLPs are elected for constructing series hybrid models. Empirical results for forecasting three benchmark data sets indicate that despite of more popularity of the conventional ARIMA-ANN model, the ANN-ARIMA hybrid model can overall achieved more accurate results.     

An algorithm for the exact likelihood of periodic autoregressive moving average models

An algorithm to compute the autocovariance functions of periodic autoregressive moving average models is proposed. As a result, an easily implemented algorithm for the exact likelihood of these models is rendered possible.     

Distribution of the cross-correlations of squared residuals in ARIMA models

ABSTRACT The distribution of the cross-correlations of squared residuals from Box-Jenkins models is considered in very general conditions, and the asymptotic distribution is derived. A test for a lagged relationship in volatility for economic time series under instantaneous causality is proposed, and its empirical behaviour is studied. An example involving the international stock market's volatility is studied, and an interesting result is observed.     

Discrimination of AR,MA and ARMA time series models

The problem of discrimination between two stationary ARMA time series models is considered, and in particular AR(p), MA(p), ARMA(1,1) models. The discriminant based on the likelihood ration leads to a quadratic form that is generally too complicated to evaluated explicitly. The discriminant can be expressed approximately as a linear combination of independent chi–squared random varianles each with one degree of freedom, the coefficients, of which are eigenvalues of cumbersome matrices. An analytical solution which gives the coefficients approximately is suggested.     

Stochastic models of failure in random environments

Stochastic models of failure modes of frequent occurrence in the engineering sciences are considered. The failure-producing stress environment is modelled as a stationary stochastic process. Using theoretical properties of the sample paths of these processes, failure-time distributions which belong to the Birnbaum-Saunders family are obtained. Several examples of particular engineering relevance are treated.     

The evaluation of exact maximum likelihood estimates for varma models

This paper describes an algorithm for the evaluation of the exact likelihood function in order to obtain estimates of the coefficients of vector autoregressive moving average (VARMA) models. The use of the algorithm is illustrated by a Monte Carlo experiment and an application to the analysis of a set of bivariate animal population data. Fanally it is shown how to extend the algorithm, in a simple manner, to obtain exact maximum likelihood estimates of the coefficients of vector autoregressive moving average models with included exogenous variables.     

A simulation study of l1:estimation of a seasonal moving average time series model

A detailed simulation study is reported on the application of l₁:estimations to a seasonal moving average model. It is found that the asymptotic normal distribution is a nonapproximation to the finite sample distribution. However, the expected benefits of l₁:estimation relative to l₂:are partially realised for nonnormal innovative distributions.     

Identification of seasonal arima models using a filtering method

This paper proposes an identification method of ARIMA models for seasonal time series using an intermediary model and a filtering method. This method is found to be useful when conventional methods, such as using sample ACF and PACF, fail to reveal a clear-cut model. This filtering identification method is also found to be particularly effective when a seasonal time series is subjected to calendar variations, moving-holiday effects, and interventions.     

Asymptotics for a class of dynamic recurrent event models

Asymptotic properties, both consistency and weak convergence, of estimators arising in a general class of dynamic recurrent event models are presented. The class of models take into account the impact of interventions after each event occurrence, the impact of accumulating event occurrences, the induced informative and dependent right-censoring mechanism due to the data-accrual scheme, and the effect of covariate processes on the recurrent event occurrences. The class of models subsumes as special cases many of the recurrent event models that have been considered in biostatistics, reliability, and in the social sciences. The asymptotic properties presented have the potential of being useful in developing goodness-of-fit and model validation procedures, confidence intervals and confidence bands constructions, and hypothesis testing procedures for the finite- and infinite-dimensional parameters of a general class of dynamic recurrent event models, albeit the models without frailties.     

A Statistical Method for the Determination of the Appropriate Order in a General Class of Time Series Models

Abstract

We propose a method to determine the order q of a model in a general class of time series models. For the subset of linear moving average models (MA(q)), our method is compared with that of the sample autocorrelations. Since the sample autocorrelation is meant to detect a linear structure of dependence between random variables, it turns out to be more suitable for the linear case. However, our method presents a competitive option in that case, and for nonlinear models (NLMA(q)) it is shown to work better. The main advantages of our approach are that it does not make assumptions on the existence of moments and on the distribution of the noise involved in the moving average models. We also include an example with real data corresponding to the daily returns of the exchange rate process of mexican pesos and american dollars.     

An evaluation of the bootstrap for model validation in mixture models

Bootstrapping has been used as a diagnostic tool for validating model results for a wide array of statistical models. Here we evaluate the use of the non-parametric bootstrap for model validation in mixture models. We show that the bootstrap is problematic for validating the results of class enumeration and demonstrating the stability of parameter estimates in both finite mixture and regression mixture models. In only 44% of simulations did bootstrapping detect the correct number of classes in at least 90% of the bootstrap samples for a finite mixture model without any model violations. For regression mixture models and cases with violated model assumptions, the performance was even worse. Consequently, we cannot recommend the non-parametric bootstrap for validating mixture models.

The cause of the problem is that when resampling is used influential individual observations have a high likelihood of being sampled many times. The presence of multiple replications of even moderately extreme observations is shown to lead to additional latent classes being extracted. To verify that these replications cause the problems we show that leave-k-out cross-validation where sub-samples taken without replacement does not suffer from the same problem.     

A new test for residual randomness in a class of dynamic autocorrelated econometric models

This paper presents a new test statistic for dynamic or stochastic mis-specification for the dynamic demand or dynamic adjustment class of economic models. The test statistic is based on residual autocorrelations, asymptotically X² and is suspected to be of low power. The test is illustrated with an example from recent econometric literature.     

Semiparametric Whittle estimation of a cyclical long-memory time series based on generalised exponential models

This paper considers a semiparametric estimation of the memory parameter in a cyclical long-memory time series, which exhibits a strong dependence on cyclical behaviour, using the Whittle likelihood based on generalised exponential (GEXP) models. The proposed estimation is included in the so-called broadband or global method and uses information from the spectral density at all frequencies. We establish the consistency and the asymptotic normality of the estimated memory parameter for a linear process and thus do not require Gaussianity. A simulation study conducted using Monte Carlo experiments shows that the proposed estimation works well compared to other existing semiparametric estimations. Moreover, we provide an empirical application of the proposed estimation, applying it to the growth rate of Japan's industrial production index and detecting its cyclical persistence.     

An exact decomposition for a class of exponential dispersion models: Application to sequential testing

We define the Wishart distribution on the cone of positive definite matrices and an exponential distribution on the Lorentz cone as exponential dispersion models. We show that these two distributions possess a property of exact decomposition, and we use this property to solve the following problem: given q samples (y_il,… y_iNj), i = l,…,q, from a N(μ_i,Σ_i,) distribution, test H:Σ₁ = Σ₂ = … = σ_q. Using the exact decomposition property, the classical test statistic for H, involving q parameters p_i = (N_i, - l)/2, i = 1,…,q, is replaced by a sequence of q - l test statistics for the sequence of tests H_i,:σ₁ =σ₂ = … =σ_i given that H_i-1 is true, i = 2,…,q. Each one of these test statistics involves two parameters only, p._i-1 = p₁ + … + p_i-1 and p_i. We also use the exact decomposition property to test equality of the “direction parameters” for q sample points from the exponential distribution on the Lorentz cone. We give a table of critical values for the distribution on the three-dimensional Lorentz cone. Tables of critical values in higher dimensions can easily be computed following the same method as in dimension three.     

Sequential testing procedures for a class of distributions representing various life-testing models

A class of probability density functions is considered, which covers several life-testing models as specific cases. Sequential probability ratio tests are developed for testing simple and composite hypotheses regarding the parameters of the probabilistic model. Expressions for the operating characteristic and the average sample number functions are derived and their behaviour is studied by means of graph-plotting.     

Likelihood analysis for a class of beta mixed models

Beta regression is a suitable choice for modelling continuous response variables taking values on the unit interval. Data structures such as hierarchical, repeated measures and longitudinal typically induce extra variability and/or dependence and can be accounted for by the inclusion of random effects. In this sense, Statistical inference typically requires numerical methods, possibly combined with sampling algorithms. A class of Beta mixed models is adopted for the analysis of two real problems with grouped data structures. We focus on likelihood inference and describe the implemented algorithms. The first is a study on the life quality index of industry workers with data collected according to an hierarchical sampling scheme. The second is a study assessing the impact of hydroelectric power plants upon measures of water quality indexes up, downstream and at the reservoirs of the dammed rivers, with a nested and longitudinal data structure. Results from different algorithms are reported for comparison including from data-cloning, an alternative to numerical approximations which also allows assessing identifiability. Confidence intervals based on profiled likelihoods are compared with those obtained by asymptotic quadratic approximations, showing relevant differences for parameters related to the random effects. In both cases, the scientific hypothesis of interest was investigated by comparing alternative models, leading to relevant interpretations of the results within each context.     

A class of partially linear transformation models for recurrent gap times

In this article, we propose a general class of partially linear transformation models for recurrent gap time data, which extends the linear transformation models by incorporating non linear covariate effects and includes the partially linear proportional hazards and the partially linear proportional odds models as special cases. Both global and local estimating equations are developed to estimate the parametric and non parametric covariate effects, and the asymptotic properties of the resulting estimators are established. The finite-sample behavior of the proposed estimators is evaluated through simulation studies, and an application to a clinic study on chronic granulomatous disease is provided.