A comparative study of series arima/mlp hybrid models for stock price forecasting

ABSTRACT

Series hybrid models are one of the most widely-used hybrid models that in which a time series is assumed to be composed of two linear and nonlinear components. In this paper, the performance of two types of these hybrid models is evaluated for predicting stock prices in order to introduce the more reliable series hybrid model. For this purpose, ARIMA and MLPs are elected for constructing series hybrid models. Empirical results for forecasting three benchmark data sets indicate that despite of more popularity of the conventional ARIMA-ANN model, the ANN-ARIMA hybrid model can overall achieved more accurate results.     

A mixed-integer programming approach to the clustering problem

A mixed-integer programing formulation for clustering is proposed, one that encompasses a wider range of objectives--and side conditions--than standard clustering approaches. The flexibility of the formulation is demonstrated in diagrams of sample problems and solutions. Preliminary computational tests in a practical setting confirm the usefulness of the formulation.     

Numerical treatment of restricted gauss-markov model 1

The singular value decomposition (SVD) has been widely used in the ordinary linear model and other statistical problems. In this paper, we shall introduce the generalized singular value decomposition (GSVD) of any two matrices X and H having the same number of columns to moti-vate the numerical treatment of large scale restricted Gauss-Markov model (y,XβHβ = r,σ²1), a situation to reveal the relationship (or restriction) existing among the parameters of the model. Many approaches to restricted linear model are already available. Those approaches apply the generalized inverse of matrices and emphasize the the-oretical solution of the problem rather than the development of efficient and numerical stable algorithm for the computation of estimators. The possible merit of the method present here might lie in the facts that they directly lead to an efficient, numerically stable and easily programmed algorithm for     

On Small Sample Properties of the Wald,LR and LM Tests in a Linear Model with AR(1) Errors

When the error terms are autocorrelated, the conventional t-tests for individual regression coefficients mislead us to over-rejection of the null hypothesis. We examine, by Monte Carlo experiments, the small sample properties of the unrestricted estimator of ρ and of the estimator of ρ restricted by the null hypothesis. We compare the small sample properties of the Wald, likelihood ratio and Lagrange multiplier test statistics for individual regression coefficients. It is shown that when the null hypothesis is true, the unrestricted estimator of ρ is biased. It is also shown that the Lagrange multiplier test using the maximum likelihood estimator of ρ performs better than the Wald and likelihood ratio tests.     

Multiple Hypothesis Testing for Variable Selection

We propose two new procedures based on multiple hypothesis testing for correct support estimation in high‐dimensional sparse linear models. We conclusively prove that both procedures are powerful and do not require the sample size to be large. The first procedure tackles the atypical setting of ordered variable selection through an extension of a testing procedure previously developed in the context of a linear hypothesis. The second procedure is the main contribution of this paper. It enables data analysts to perform support estimation in the general high‐dimensional framework of non‐ordered variable selection. A thorough simulation study and applications to real datasets using the R package mht shows that our non‐ordered variable procedure produces excellent results in terms of correct support estimation as well as in terms of mean square errors and false discovery rate, when compared to common methods such as the Lasso, the SCAD penalty, forward regression or the false discovery rate procedure (FDR).     

Robust group non-convex estimations for high-dimensional partially linear models

High-dimensional data with a group structure of variables arise always in many contemporary statistical modelling problems. Heavy-tailed errors or outliers in the response often exist in these data. We consider robust group selection for partially linear models when the number of covariates can be larger than the sample size. The non-convex penalty function is applied to achieve both goals of variable selection and estimation in the linear part simultaneously, and we use polynomial splines to estimate the nonparametric component. Under regular conditions, we show that the robust estimator enjoys the oracle property. Simulation studies demonstrate the performance of the proposed method with samples of moderate size. The analysis of a real example illustrates that our method works well.     

Generalized linear spatial models in epidemiology: A case study of zoonotic cutaneous leishmaniasis in Tunisia

Generalized linear spatial models (GLSM) are used here to study spatial characters of zoonotic cutaneous leishmaniasis (ZCL) in Tunisia. The response variable stands for the number of affected by district during the period 2001–2002. The model covariates are: climates (temperature and rainfall), humidity and surrounding vegetation status. As the environmental and weather data are not available for all the studied districts, Kriging based on linear interpolation was used to estimate the missing data. To account for unexplained spatial variation in the model, we include a stationary Gaussian process S with a powered exponential spatial correlation function. Moran coefficient, DIC criterion and residuals variograms are used to show the high goodness-of-fit of the GLSM. When compared with the statistical tools used in the previous ZCL studies, the optimal GLSM found here yields a better assessment of the impact of the risk factors, a better prediction of ZCL evolution and a better comprehension of the disease transmission. The statistical results show the progressive increase in the number of affected in zones with high temperature, low rainfall and high surrounding vegetation index. Relative humidity does not seem to affect the distribution of the disease in Tunisia. The results of the statistical analyses stress the important risk of misleading epidemiological conclusions when non-spatial models are used to analyse spatially structured data.     

Linear approximate ML estimation in scaled Type I generalized logistic distribution based on Type-II censored samples

The scaled (two-parameter) Type I generalized logistic distribution (GLD) is considered with the known shape parameter. The ML method does not yield an explicit estimator for the scale parameter even in complete samples. In this article, we therefore construct a new linear estimator for scale parameter, based on complete and doubly Type-II censored samples, by making linear approximations to the intractable terms of the likelihood equation using least-squares (LS) method, a new approach of linearization. We call this as linear approximate maximum likelihood estimator (LAMLE). We also construct LAMLE based on Taylor series method of linear approximation and found that this estimator is slightly biased than that based on the LS method. A Monte Carlo simulation is used to investigate the performance of LAMLE and found that it is almost as efficient as MLE, though biased than MLE. We also compare unbiased LAMLE with BLUE based on the exact variances of the estimators and interestingly this new unbiased LAMLE is found just as efficient as the BLUE in both complete and Type-II censored samples. Since MLE is known as asymptotically unbiased, in large samples we compare unbiased LAMLE with MLE and found that this estimator is almost as efficient as MLE. We have also discussed interval estimation of the scale parameter from complete and Type-II censored samples. Finally, we present some numerical examples to illustrate the construction of the new estimators developed here.     

Estimating and testing group effects from type i censored normal samples in experimental design

The maximum likelihood (ML) equations calculated from censored normal samples do not admit explicit solutions. A principle of modification is given and modified maximum likelihood (MML) equations, which admit explicit solutions, are defined. This approach makes it possible to tackle the hitherto unresolved problem of estimating and testing hypotheses about group-effects in one-way classification experimental designs based on Type I censored normal samples. The MML estimators of group-effects are obtained as explicit functions of sample observations and shown to be asymptotically identical with the ML estimators and hence BAN (best asymptotic normal) estimators. A statistic t is defined to test a linear contrast of group-effects and shown to be asymptotically normally distributed. A numerical example is presented which illustrates the procedure.     

Arbitrary hypotheses in linear mod fi.S with unbalanced data

The Statistical Analysis System (SAS) procedure entitled General Linear Model (GLM) includes in its output four types of estimable functions that have certain arbitrariness (represented by the letter L) in their coefficients. This paper shows how such arbitrary estimable functions are derived from the known, general expressions for hypotheses tested by traditional-style F-statisties in analysis of variance calculations that are often made for unbalanced data (i.e., data having unequal numbers of observations in their subclasses).