Forecasting ARMA models: a comparative study of information criteria focusing on MDIC

This paper deals with the implementation of model selection criteria to data generated by ARMA processes. The recently introduced modified divergence information criterion is used and compared with traditional selection criteria like the Akaike information criterion (AIC) and the Schwarz information criterion (SIC). The appropriateness of the selected model is tested for one- and five-step ahead predictions with the use of the normalized mean squared forecast errors (NMSFE).     

STAR模型的滞后阶数选择与稳健性研究

本文讨论了六种信息准则在STAR模型滞后阶数选择中的适应性及稳健性问题。Monte Carlo模拟结果显示,在多数情况下,数据生成过程中的误差项分布并不影响信息准则正确识别模型最大滞后阶数的能力;对于短STAR模型,ACC准则具有较高的正确识别率,并且对不同平滑转移系数及不同门限值具有很好的稳健性;而对于长STAR模型,SC准则及ACC准则具有更高的正确率及良好的稳健性。     

THE CHOICE BETWEEN SETS OF REGRESSORS

This paper examines the choice of critical values for testing both non-sequential and nested sequential sets of constraints in the standard linear regression model. Modest increases in (e.g.) t-ratio critical values relative to their one-off values are often sufficient to maintain proper size. A Bayesian decision-theoretic approach, highlighted by the Schwarz (1978) criterion, provides a framework for deriving consistency and asymptotic local power properties of both forms of testing (data mining) algorithms.     

Empirical information criteria for time series forecasting model selection

In this article, we propose a new empirical information criterion (EIC) for model selection which penalizes the likelihood of the data by a non-linear function of the number of parameters in the model. It is designed to be used where there are a large number of time series to be forecast. However, a bootstrap version of the EIC can be used where there is a single time series to be forecast. The EIC provides a data-driven model selection tool that can be tuned to the particular forecasting task.

We compare the EIC with other model selection criteria including Akaike’s information criterion (AIC) and Schwarz’s Bayesian information criterion (BIC). The comparisons show that for the M3 forecasting competition data, the EIC outperforms both the AIC and BIC, particularly for longer forecast horizons. We also compare the criteria on simulated data and find that the EIC does better than existing criteria in that case also.     

Schwarz information criterion based tests for a change-point in regression models

Standard Schwarz information criterion for testing a change-point in regression models is considered and two new test procedures are evolved. The case of small sample size is investigated. Numerical approximations to the power against various alternatives are given and compared with powers of tests based on r-ahead recursive residuals and of the CUSUM of squares test. Application of these procedures to some real data is also provided.     

Change Point Analysis for Generalized Lambda Distribution

In this article, we study the detection of multiple change points of parameters of generalized lambda distributions (GLD). The advantage of studying GLD is that the GLD family is broad and flexible. Compared to the other distributions, there are fewer restrictions on the distribution while fitting data. We combine the binary segmentation procedure together with the Schwarz information criterion (SIC) to search for all possible change points in the data. The method is applied on fibroblast cancer cell line data which is publicly available, and the change points are successfully located.     

Information approach for a lifetime change-point model based on the exponential-logarithmic distribution

ABSTRACT

The exponential-logarithmic distribution is a distribution which has a decreasing failure function and various applications such as in biological and engineering fields. In this paper, we study a change-point problem of this distribution. A procedure based on Schwarz information criterion is proposed to detect changes in parameters of this distribution. Simulations are conducted to indicate the performance of the proposed procedure under different scenarios. Applications on two real data are provided to illustrate the detection procedure.     

On the skew-normal calibration model

In this article, we present the EM-algorithm for performing maximum likelihood estimation of an asymmetric linear calibration model with the assumption of skew-normally distributed error. A simulation study is conducted for evaluating the performance of the calibration estimator with interpolation and extrapolation situations. As one application in a real data set, we fitted the model studied in a dimensional measurement method used for calculating the testicular volume through a caliper and its calibration by using ultrasonography as the standard method. By applying this methodology, we do not need to transform the variables to have symmetrical errors. Another interesting aspect of the approach is that the developed transformation to make the information matrix nonsingular, when the skewness parameter is near zero, leaves the parameter of interest unchanged. Model fitting is implemented and the best choice between the usual calibration model and the model proposed in this article was evaluated by developing the Akaike information criterion, Schwarz’s Bayesian information criterion and Hannan–Quinn criterion.     

Goodness-of-fit tests for lifetime distributions based on Type II censored data

In this article, the general test statistic introduced by Alizadeh Noughabi and Balakrishnan [Goodness of fit using a new estimate of Kullback-Leibler information based on Type II censored data. IEEE Trans Reliab. 2015;64:627–635.] is applied for testing goodness of fit of lifetime distributions based on Type II censored data. The test statistic is constructed based on an estimate of Kullback–Leibler (KL) information. We investigate the properties of the proposed test statistic such as the test statistic is nonnegative, just like KL information. We apply this test statistic to following distributions: Exponential, Weibull, Log-normal and Pareto. The critical values and Type I error of the proposed tests are obtained. It is shown that the proposed tests have an excellent Type I error and hence can be used confidently in practice. Then, by Monte Carlo simulations, the power values of the proposed tests are computed against several alternatives and compared with those of the existing tests. Finally, some real-world reliability data are used for illustrative purpose.     

Statistical inference of risk difference in K correlated 2×2 tables with structural zero

K correlated 2×2 tables with structural zero are commonly encountered in infectious disease studies. A hypothesis test for risk difference is considered in K independent 2×2 tables with structural zero in this paper. Score statistic, likelihood ratio statistic and Wald‐type statistic are proposed to test the hypothesis on the basis of stratified data and pooled data. Sample size formulae are derived for controlling a pre‐specified power or a pre‐determined confidence interval width. Our empirical results show that score statistic and likelihood ratio statistic behave better than Wald‐type statistic in terms of type I error rate and coverage probability, sample sizes based on stratified test are smaller than those based on the pooled test in the same design. A real example is used to illustrate the proposed methodologies. Copyright © 2009 John Wiley & Sons, Ltd.     

On a modified test of equality of scale parameters of exponential distributions

In this paper, an exact distribution of a modifier likelihood ratio criterion for testing the equality of scale parameters of several two parameter exponential distributions is obtained for the case of unequal sample size in a computational form. A short table of critical values of the proposed statistic is also presented.     

Rank-based multiple change-point detection

Abstract

A nonparametric procedure is proposed to estimate multiple change-points of location changes in a univariate data sequence by using ranks instead of the raw data. While existing rank-based multiple change-point detection methods are mostly based on sequential tests, we treat it as a model selection problem. We derive the corresponding Schwarz’s information criterion for rank-statistics, theoretically prove the consistency of the change-point estimator and use a pruned dynamic programing algorithm to achieve the change-point estimator. Simulation studies show our method’s robustness, effectiveness and efficiency in detecting mean-changes. We also apply the method to a gene dataset as an illustration.     

Objective Bayesian multiple comparisons for normal variances

This paper considers the multiple comparisons problem for normal variances. We propose a solution based on a Bayesian model selection procedure to this problem in which no subjective input is considered. We construct the intrinsic and fractional priors for which the Bayes factors and model selection probabilities are well defined. The posterior probability of each model is used as a model selection tool. The behaviour of these Bayes factors is compared with the Bayesian information criterion of Schwarz and some frequentist tests.     

Improved predictive model selection

This paper introduces a new information criterion for model selection, based on a predictive distribution which improves the estimative one. The selection statistic is defined as a first-order estimator for the expected Kullback–Leibler information between the true model and the fitted one, obtained by means of the improved predictive procedure. The criterion turns out to be a simple, non-computationally demanding, alternative to the Takeuchi information criterion. Whenever the information identity holds, the Akaike information criterion is recovered as a particular case. The results are obtained in the case of independent, but not necessarily identically distributed, observations. Some applications, related to exponential families of distributions and regression models, are presented.     

Testing of homogeneity of diagonal blocks with blockwise independence

In this paper the likelihood ratio test criterion for testing the equality of block covariance matrices for the multivariate multisamplesphericity model has been derived. The distribution of the test statistic, its moments and percentage points are also given.     

Detection and estimation of structural change in heavy-tailed sequence

In this paper, bootstrap detection and ratio estimation are proposed to analysis mean change in heavy-tailed distribution. First, the test statistic is constructed into a ratio form on the CUSUM process. Then, the asymptotic distribution of test statistic is obtained and the consistency of the test is proved. To solve the problem that the null distribution of the test statistic contains unknown tail index, we present a bootstrap approximation method to determine the critical values of the null distribution. We also discuss how to estimate change point based on ratio method. The consistency and rate of convergence for the change-point estimator are established. Finally, the excellent performance of our method is demonstrated through simulations using artificial and real data sets. Especially the simulation results of bootstrap test are better than those of another existing method.     

Testing equality of correlation coefficients for paired binary data from multiple groups

Paired binary data arise naturally when paired body parts are investigated in clinical trials. One of the widely used models for dealing with this kind of data is the equal correlation coefficients model. Before using this model, it is necessary to test whether the correlation coefficients in each group are actually equal. In this paper, three test statistics (likelihood ratio test, Wald-type test, and Score test) are derived for this purpose. The simulation results show that the Score test statistic maintains type I error rate and has satisfactory power, and therefore is recommended among the three methods. The likelihood ratio test is over conservative in most cases, and the Wald-type statistic is not robust with respect to empirical type I error. Three real examples, including a multi-centre Phase II double-blind placebo randomized controlled trial, are given to illustrate the three proposed test statistics.     

Partially linear models and their applications to change point detection of chemical process data

In many chemical data sets, the amount of radiation absorbed (absorbance) is related to the concentration of the element in the sample by Lambert–Beer's law. However, this relation changes abruptly when the variable concentration reaches an unknown threshold level, the so-called change point. In the context of analytical chemistry, there are many methods that describe the relationship between absorbance and concentration, but none of them provide inferential procedures to detect change points. In this paper, we propose partially linear models with a change point separating the parametric and nonparametric components. The Schwarz information criterion is used to locate a change point. A back-fitting algorithm is presented to obtain parameter estimates and the penalized Fisher information matrix is obtained to calculate the standard errors of the parameter estimates. To examine the proposed method, we present a simulation study. Finally, we apply the method to data sets from the chemistry area. The partially linear models with a change point developed in this paper are useful supplements to other methods of absorbance–concentration analysis in chemical studies, for example, and in many other practical applications.     

Mutual information and redundancy for categorical data

Most methods for describing the relationship among random variables require specific probability distributions and some assumptions concerning random variables. Mutual information, based on entropy to measure the dependency among random variables, does not need any specific distribution and assumptions. Redundancy, which is an analogous version of mutual information, is also proposed as a method. In this paper, the concepts of redundancy and mutual information are explored as applied to multi-dimensional categorical data. We found that mutual information and redundancy for categorical data can be expressed as a function of the generalized likelihood ratio statistic under several kinds of independent log-linear models. As a consequence, mutual information and redundancy can also be used to analyze contingency tables stochastically. Whereas the generalized likelihood ratio statistic to test the goodness-of-fit of the log-linear models is sensitive to the sample size, the redundancy for categorical data does not depend on sample size but depends on its cell probabilities.