Locally and maximin optimal designs for multi-factor nonlinear models

This paper considers the search for locally and maximin optimal designs for multi-factor nonlinear models from optimal designs for sub-models of a lower dimension. In particular, sufficient conditions are given so that maximin D-optimal designs for additive multi-factor nonlinear models can be built from maximin D-optimal designs for their sub-models with a single factor. Some examples of application are models involving exponential decay in several variables.     

A theorem for selecting oa-based latin hypercubes using a distance criterion

The maximin distance criterion is used for the selection of an OA-based Latin hypercube. For the case in which the underlying orthogonal array is a full factorial design without replication, we construct an OA-based Latin hypercube that reaches the same distance as its parent array.     

Efficient designs for constrained mixture experiments

Many practical experiments on mixtures (where the components sum to one) include additional lower or upper bounds on components, or on linear combinations of them. Usually theory cannot be used to obtain a good design, and algorithmic methods are necessary. Some of the available methods are discussed. Their performance is evaluated on some examples, and the form of the optimal design is investigated.     

A simple method for constructing confounded designs for mixed factorial experiments

This paper presents the sinplesr procedure that uses wodular aryithmetic for constructing confounded designs for mixed factorial experiments. The present procedure and the classical one for confounding in symmetrical factorial experiments are both at the same mathema.tical level. The present procedure is written for

practitioners and is lllustrared with several examples.     

Using the chinese remainder theorem in constructing confounded designs for mixed factorial experiments

A procedure for constructing confounded designs for mixed factorial experiments derived from the Chinese Remainder Theorem is presented. The present procedure as well as others, all through use of modular arithmetic, are compared.     

Adaptive-Cox model averaging for right-censored data

In medical studies, Cox proportional hazards model is a commonly used method to deal with the right-censored survival data accompanied by many explanatory covariates. In practice, the Akaike's information criterion (AIC) or the Bayesian information criterion (BIC) is usually used to select an appropriate subset of covariates. It is well known that neither the AIC criterion nor the BIC criterion dominates for all situations. In this paper, we propose an adaptive-Cox model averaging procedure to get a more robust hazard estimator. First, by applying AIC and BIC criteria to perturbed datasets, we obtain two model averaging (MA) estimated survival curves, called AIC-MA and BIC-MA. Then, based on Kullback–Leibler loss, a better estimate of survival curve between AIC-MA and BIC-MA is chosen, which results in an adaptive-Cox estimate of survival curve. Simulation results show the superiority of our approach and an application of the proposed method is also presented by analyzing the German Breast Cancer Study dataset.     

An entropy test for the Rayleigh distribution and power comparison

In this paper, a goodness-of-fit test is proposed for the Rayleigh distribution. This test is based on the Kullback–Leibler discrimination methodology proposed by Song [2002, Goodness of fit tests based on Kullback–Leibler discrimination, IEEE Trans. Inf. Theory 48(5), pp. 1103–1117]. The critical values and powers for some alternatives are obtained by simulation. The proposed test is compared with other tests, namely Kolmogorov–Smirnov, Kuiper, Cramer–von Mises, Watson and Anderson–Darling. The use of the proposed test is shown in a real example.     

Projection designs for mixture experiments in orthogonal blocks

Mixture experiments are often carried out in the presence of process variables, such as days of the week or different machines in a manufacturing process, or different ovens in bread and cake making. In such experiments it is particularly useful to be able to arrange the design in orthogonal blocks, so that the model in tue mixture vanauies may ue iitteu inucpenuentiy or tne UIOCK enects mtrouuceu to take account of the changes in the process variables. It is possible in some situations that some of the ingredients in the mixture, such as additives or flavourings, are present in soian quantities, pernaps as iuw a.s 5% ur even !%, resulting in the design space being restricted to only part of the mixture simplex. Hau and Box (1990) discussed the construction of experimental designs for situations where constraints are placed on the design variables. They considered projecting standard response surface designs, including factorial designs and central composite designs, into the restricted design space, and showed that the desirable property of block orthogonality is preserved by the projections considered. Here we present a number of examples of projection designs and illustrate their use when some of the ingredients are restricted to small values, such that the design space is restricted to a sub-region within the usual simplex in the mixture variables.     

Particle Learning for Fat-Tailed Distributions

It is well known that parameter estimates and forecasts are sensitive to assumptions about the tail behavior of the error distribution. In this article, we develop an approach to sequential inference that also simultaneously estimates the tail of the accompanying error distribution. Our simulation-based approach models errors with a t_ν-distribution and, as new data arrives, we sequentially compute the marginal posterior distribution of the tail thickness. Our method naturally incorporates fat-tailed error distributions and can be extended to other data features such as stochastic volatility. We show that the sequential Bayes factor provides an optimal test of fat-tails versus normality. We provide an empirical and theoretical analysis of the rate of learning of tail thickness under a default Jeffreys prior. We illustrate our sequential methodology on the British pound/U.S. dollar daily exchange rate data and on data from the 2008–2009 credit crisis using daily S&P500 returns. Our method naturally extends to multivariate and dynamic panel data.     

Non-orthogonal designs for measuring dispersion effects in sequential factor screening experiments using search linear models

“Dispersion” effects are considered in addition to “Location” effects of factors in the inferential procedure of sequential factor screening experiments with m factors each at two levels under search linear models. Search designs in measuring "Dispersion" and "Location" effects of factors are presented for both stage one and stage two of factor screening experiments with 4 ≤ m ≤ 10.     

Consistency of information criteria for model selection with missing data

ABSTRACT

In this paper, we investigate the consistency of the Expectation Maximization (EM) algorithm-based information criteria for model selection with missing data. The criteria correspond to a penalization of the conditional expectation of the complete data log-likelihood given the observed data and with respect to the missing data conditional density. We present asymptotic properties related to maximum likelihood estimation in the presence of incomplete data and we provide sufficient conditions for the consistency of model selection by minimizing the information criteria. Their finite sample performance is illustrated through simulation and real data studies.     

Tests of fit for the Laplace distribution based on correcting moments of entropy estimators

ABSTRACT

In this paper, we first consider the entropy estimators introduced by Vasicek [A test for normality based on sample entropy. J R Statist Soc, Ser B. 1976;38:54–59], Ebrahimi et al. [Two measures of sample entropy. Stat Probab Lett. 1994;20:225–234], Yousefzadeh and Arghami [Testing exponentiality based on type II censored data and a new cdf estimator. Commun Stat – Simul Comput. 2008;37:1479–1499], Alizadeh Noughabi and Arghami [A new estimator of entropy. J Iran Statist Soc. 2010;9:53–64], and Zamanzade and Arghami [Goodness-of-fit test based on correcting moments of modified entropy estimator. J Statist Comput Simul. 2011;81:2077–2093], and the nonparametric distribution functions corresponding to them. We next introduce goodness-of-fit test statistics for the Laplace distribution based on the moments of nonparametric distribution functions of the aforementioned estimators. We obtain power estimates of the proposed test statistics with Monte Carlo simulation and compare them with the competing test statistics against various alternatives. Performance of the proposed new test statistics is illustrated in real cases.     

Power-divergence-type measure of departure from diagonals-parameter symmetry for square contingency tables with ordered categories

For the analysis of square contingency tables with ordered categories, Goodman considered the diagonals-parameter symmetry (DPS) model. This paper proposes a measure to represent the degree of departure from the DPS model. The proposed measure is expressed by applying Read and Cressie’s power-divergence or Patil and Taillie’s diversity index. The measure would be useful for comparing the degree of departure from the DPS model in several tables. Examples are given.     

Discrimination Measures for Fractional Integrated Models Based on Wavelets

Discrimination measures have been well developed for stationary time series. However in a large number of phenomena, long-term dependencies are involved. In this article, we are dealing with discrimination of fractional integrated models. Kullback–Leibler and Chernoff's discrimination measures are approximated, using the discrete wavelet transform (DWT) for discrimination of these time series classes. The simulation study indicates low misclassification rate, related to the approximations of Kullback–Leibler and Chernoff discrimination measures. Application to problem of classifying seismic data showed that our procedure performs as well as other procedures.     

On the Choice of Nonparametric Entropy Estimator in Entropy-Based Goodness-of-Fit Test Statistics

Entropy-based goodness-of-fit test statistics can be established by estimating the entropy difference or Kullback–Leibler information, and several entropy-based test statistics based on various entropy estimators have been proposed. In this article, we first give comments on some problems resulting from not satisfying the moment constraints. We then study the choice of the entropy estimator by noting the reason why a test based on a better entropy estimator does not necessarily provide better powers.     

Some properties of Lin–Wong divergence on the past lifetime data

Measures of statistical divergence are used to assess mutual similarities between distributions of multiple variables through a variety of methodologies including Shannon entropy and Csiszar divergence. Modified measures of statistical divergence are introduced throughout the present article. Those modified measures are related to the Lin–Wong (LW) divergence applied on the past lifetime data. Accordingly, the relationship between Fisher information and the LW divergence measure was explored when applied on the past lifetime data. Throughout this study, a number of relations are proposed between various assessment methods which implement the Jensen–Shannon, Jeffreys, and Hellinger divergence measures. Also, relations between the LW measure and the Kullback–Leibler (KL) measures for past lifetime data were examined. Furthermore, the present study discusses the relationship between the proposed ordering scheme and the distance interval between LW and KL measures under certain conditions.     

Normalization of the origin-shifted exponential distribution for control chart construction

This study demonstrates that a location parameter of an exponential distribution significantly influences normalization of the exponential. The Kullback–Leibler information number is shown to be an appropriate index for measuring data normality using a location parameter. Control charts based on probability limits and transformation are compared for known and estimated location parameters. The probabilities of type II error (β-risks) and average run length (ARL) without a location parameter indicate an ability to detect an out-of-control signal of an individual chart using a power transformation similar to using probability limits. The β-risks and ARL of control charts with an estimated location parameter deviate significantly from their theoretical values when a small sample size of n≤50 is used. Therefore, without taking into account of the existence of a location parameter, the control charts result in inaccurate detection of an out-of-control signal regardless of whether a power or natural logarithmic transformation is used. The effects of a location parameter should be eliminated before transformation. Two examples are presented to illustrate these findings.     

Statistical Evidence in Experiments and in Record Values

According to the law of likelihood, statistical evidence for one (simple) hypothesis against another is measured by their likelihood ratio. When the experimenter can choose between two or more experiments (of approximately the same cost) to obtain data, he would want to know which experiment provides (on average) stronger true evidence for one hypothesis against another. In this article, after defining a pre-experimental criterion for the potential strength of evidence provided by an experiment, based on entropy distance, we compare the potential statistical evidence in lower record values with that in the same number of iid observations from the same parent distribution. We also establish a relation between Fisher information and Kullback–Leibler distance.     

Measure of departure from symmetry for the analysis of collapsed square contingency tables with ordered categories

For square contingency tables with ordered categories, there may be some cases that one wants to analyze them by considering collapsed tables with some adjacent categories combined in the original table. This paper considers the symmetry model for collapsed square contingency tables and proposes a measure to represent the degree of departure from symmetry. The proposed measure is defined as the arithmetic mean of submeasures each of which represents the degree of departure from symmetry for each collapsed 3×3 table. Each submeasure also represents the mean of power-divergence or diversity index for each collapsed table. Examples are given.     

On entropy of a Pareto distribution in the presence of outliers

ABSTRACT

The aim of this paper is obtaining the amount of information there exists in the Pareto distribution in the presence of outliers. For the sake of this purpose, Shannon entropy, ?-entropy, Fisher information, and Kullback–Leibler distance are computed. Furthermore, a section has been devoted to compare these quantities in these two cases of the Pareto distribution (with outliers and the homogenous case). At the end of this paper, two actual examples, which are related to insurance companies, are brought. A brief summary of which is done in this work is also reported.