An evaluation by simulation of alternative estimators for the marginal Fisher distribution

The Fisher distribution is a standard model for directional data (or spherical data). In some cases though, only the co-latitudes can be observed, resulting in a sample of observations from the corresponding marginal distribution. This paper reports on an extensive simulation to compare and evaluate the robustness of 11 test-statistics corresponding to various estimators of the parameters of this distribution. The estimators include Maximum Likelihood and Moment-type estimators, as well as sample means and variances based on approximations to the marginal Fisher distribution. Of the test-statistics considered, the Likelihood-Ratio statistic was the only one whose sampling distribution remained close to its asymptotic distribution for all parameter values and sample sizes considered. In general, the other statistics were close to their approximate distributions only when ksin2?0, was fairly large. The paper includes details on the computational methods for finding the Maximum Likelihood and Moment estimators, and concludes with some practical advice on the choice of estimation procedure.     

Parameter estimation for switched counting processes

The paper investigates parameter estimation problems in special Markov modulated counting processes. The events occuring at any state of an underlying Markov chain can be equipped with marks performing additional information on the events. Specifying the model to the case of two-state Markov chain modulation, the so-called switched counting process, some statistical problems are studied:maximum likelihood estimators, Rao-Blackwell optimal estimators, test of equality of the counting intensities of the two states and minimax estimation procedures. Tne consideration could be applied in various practical problems, in particular, in queueing and in reliability models, for example in failure-repair processes with alternatively operating repair systems.     

On testing hypotheses with divergence statistics

Using divergence measures based on entropy functions, a procedure to test statistical hypotheses is proposed. Replacing the parameters by suitable estimators in the expresion of the divergence measure, the test statistics are obtained. Asymptotic distributions for these statistics are given in several cases when maximum likelihood estimators are considered, so they can be used to construct confidence intervals and to test statistical hypotheses based on one or more samples. These results can also be applied to multinomial populations. Tests of goodness of fit and tests of homogeneity can be constructed.     

Meta-analysis,pretest, and shrinkage estimation of kurtosis parameters

An asymptotic theory for the improved estimation of kurtosis parameter vector is developed for multi-sample case using uncertain prior information (UPI) that several kurtosis parameters are the same. Meta-analysis is performed to obtain pooled estimator, as it is a statistical methodology for pooling quantitative evidence. Pooled estimator is a good choice when assumption of homogeneity holds but it becomes inconsistent as assumption violates, therefore pretest and Stein-type shrinkage estimators are proposed as they combine sample and nonsample information in a superior way. Asymptotic properties of suggested estimators are discussed and their risk comparisons are also mentioned.     

Statistical Inference on a Stochastic Epidemic Model

In this work, we develop statistical inference for the parameters of a discrete-time stochastic SIR epidemic model. We use a Markov chain for describing the dynamic behavior of the epidemic. Specifically, we propose estimators for the contact and removal rates based on the maximum likelihood and martingale methods, and establish their asymptotic distributions. The obtained results are applied in the statistical analysis of the basic reproduction number, a quantity that is useful in establishing vaccination policies. In order to evaluate the population size for which the results are useful, a numerical study is carried out. Finally, a comparison of the maximum likelihood and martingale estimators is conducted by means of Monte Carlo simulations.     

Nonparametric estimation of transition probabilities in a non-Markov illness–death model

In this paper we consider nonparametric estimation of transition probabilities for multi-state models. Specifically, we focus on the illness-death or disability model. The main novelty of the proposed estimators is that they do not rely on the Markov assumption, typically assumed to hold in a multi-state model. We investigate the asymptotic properties of the introduced estimators, such as their consistency and their convergence to a normal law. Simulations demonstrate that the new estimators may outperform Aalen–Johansen estimators (the classical nonparametric tool for estimating the transition probabilities) in non-Markov situation. An illustration through real data analysis is included.     

Development of Specific hypothesis tests for estimated markov chains

We develop and evaluate the validity and power of two specific tests for the transition probabilities in a Markov chain estimated from aggregate frequency data. The two null hypotheses considered are (1) constancy of the diagonal elements of the one-step transition probability matrix and (2) an arbitrarily chosen transition probability’s being equal to a specific value. The formation of tests uses a general framework for statistical inference on estimated Markov processes; we also indicate how this framework can be used to form tests for a variety of other hypotheses. The validity and power performance of the two tests formed in this paper are examined in factorially designed Monte Carlo experiments. The results indicate that the proposed tests lead to type I error probabilities which are close to the desired levels and to high power against even small deviations from the null hypotheses considered.     

Bivariate Semi-Markov Process for Counterparty Credit Risk

We consider the problem of constructing an appropriate multivariate model to study counterparty credit risk in the credit rating migration problem. For this financial problem different multivariate Markov chain models were proposed. However, the Markovian assumption may be inappropriate for the study of the dynamics of credit ratings, which typically show non Markovian-like behavior. In this article, we develop a semi-Markov approach to study the counterparty credit risk by defining a new multivariate semi-Markov chain model. Methods are given for computing the transition probabilities, reliability functions and the price of a risky Credit Default Swap.     

Statistical inference for reciprocal gamma diffusion process

We consider the problem of parameter estimation for an ergodic diffusion with reciprocal gamma invariant distribution. Spectral decomposition of the transition density of such a Markov process is presented in terms of a finite number of discrete eigenfunctions (Bessel polynomials) and eigenfunctions related to a continuous part of the spectrum of the negative infinitesimal generator of reciprocal gamma diffusion. Consistency and asymptotical normality of proposed estimators are presented. Based on the Stein equation for reciprocal gamma diffusion and Bessel polynomials, the hypothesis testing procedure is considered.     

Estimation of the Entropy Rate of a Countable Markov Chain

We consider here ergodic homogeneous Markov chains with countable state spaces. The entropy rate of the chain is an explicit function of its transition and stationary distributions. We construct estimators for this entropy rate and for the entropy of the stationary distribution of the chain, in the parametric and nonparametric cases. We study estimation from one sample with long length and from many independent samples with given length. In the parametric case, the estimators are deduced by plug-in from the maximum likelihood estimator of the parameter. In the nonparametric case, the estimators are deduced by plug-in from the empirical estimators of the transition and stationary distributions. They are proven to have good asymptotic properties.     

Inference on effect size indices from several two-armed experiments

The statistical inference problem on effect size indices is addressed using a series of independent two-armed experiments from k arbitrary populations. The effect size parameter simply quantifies the difference between two groups. It is a meaningful index to be used when data are measured on different scales. In the context of bivariate statistical models, we define estimators of the effect size indices and propose large sample testing procedures to test the homogeneity of these indices. The null and non-null distributions of the proposed testing procedures are derived and their performance is evaluated via Monte Carlo simulation. Further, three types of interval estimation of the proposed indices are considered for both combined and uncombined data. Lower and upper confidence limits for the actual effect size indices are obtained and compared via bootstrapping. It is found that the length of the intervals based on the combined effect size estimator are almost half the length of the intervals based on the uncombined effect size estimators. Finally, we illustrate the proposed procedures for hypothesis testing and interval estimation using a real data set.     

Application of a non-homogeneous Markov chain with seasonal transition probabilities to ozone data

In this work, we assume that the sequence recording whether or not an ozone exceedance of an environmental threshold has occurred in a given day is ruled by a non-homogeneous Markov chain of order one. In order to account for the possible presence of cycles in the empirical transition probabilities, a parametric form incorporating seasonal components is considered. Results show that even though some covariates (namely, relative humidity and temperature) are not included explicitly in the model, their influence is captured in the behavior of the transition probabilities. Parameters are estimated using the Bayesian point of view via Markov chain Monte Carlo algorithms. The model is applied to ozone data obtained from the monitoring network of Mexico City, Mexico. An analysis of how the methodology could be used as an aid in the decision-making is also given.     

Parameter estimation and prediction of order statistics for the Burr Type XII distribution with Type II censoring

This article deals with the statistical inference and prediction on Burr Type XII parameters based on Type II censored sample. It is observed that the maximum likelihood estimators (MLEs) cannot be obtained in closed form. We use the expectation-maximization algorithm to compute the MLEs. We also obtain the Bayes estimators under symmetric and asymmetric loss functions such as squared error and Linex By applying Lindley's approximation and Markov chain Monte Carlo (MCMC) technique. Further, MCMC samples are used to calculate the highest posterior density credible intervals. Monte Carlo simulation study and two real-life data-sets are presented to illustrate all of the methods developed here. Furthermore, we obtain a prediction of future order statistics based on the observed ordered because of its important application in different fields such as medical and engineering sciences. A numerical example carried out to illustrate the procedures obtained for prediction of future order statistics.     

Monte Carlo integration with Markov chain

There are two conceptually distinct tasks in Markov chain Monte Carlo (MCMC): a sampler is designed for simulating a Markov chain and then an estimator is constructed on the Markov chain for computing integrals and expectations. In this article, we aim to address the second task by extending the likelihood approach of Kong et al. for Monte Carlo integration. We consider a general Markov chain scheme and use partial likelihood for estimation. Basically, the Markov chain scheme is treated as a random design and a stratified estimator is defined for the baseline measure. Further, we propose useful techniques including subsampling, regulation, and amplification for achieving overall computational efficiency. Finally, we introduce approximate variance estimators for the point estimators. The method can yield substantially improved accuracy compared with Chib's estimator and the crude Monte Carlo estimator, as illustrated with three examples.     

ASYMPTOTIC PROPERTIES FOR MAXIMUM LIKELIHOOD ESTIMATORS FOR RELIABILITY AND FAILURE RATES OF MARKOV CHAINS

ABSTRACT

In this paper, we shall study a homogeneous ergodic, finite state, Markov chain with unknown transition probability matrix. Starting from the well known maximum likelihood estimator of transition probability matrix, we define estimators of reliability and its measurements. Our aim is to show that these estimators are uniformly strongly consistent and converge in distribution to normal random variables. The construction of the confidence intervals for availability, reliability, and failure rates are also given. Finally we shall give a numerical example for illustration and comparing our results with the usual empirical estimator results.     

A Markov chain model used in analyzing disease history applied to a stroke study

In clinical research, study subjects may experience multiple events that are observed and recorded periodically. To analyze transition patterns of disease processes, it is desirable to use those multiple events over time in the analysis. This study proposes a multi-state Markov model with piecewise transition probability, which is able to accommodate periodically observed clinical data without a time homogeneity assumption. Models with ordinal outcomes that incorporate covariates are also discussed. The proposed models are illustrated by an analysis of the severity of morbidity in a monthly follow-up study for patients with spontaneous intracerebral hemorrhage.     

Markov switching model of nonlinear autoregressive with skew-symmetric innovations

We consider data generating structures which can be represented as a Markov switching of nonlinear autoregressive model with considering skew-symmetric innovations such that switching between the states is controlled by a hidden Markov chain. We propose semi-parametric estimators for the nonlinear functions of the proposed model based on a maximum likelihood (ML) approach and study sufficient conditions for geometric ergodicity of the process. Also, an Expectation-Maximization type optimization for obtaining the ML estimators are presented. A simulation study and a real world application are also performed to illustrate and evaluate the proposed methodology.     

Asymptotics of cross-validated risk estimation in estimator selection and performance assessment

Risk estimation is an important statistical question for the purposes of selecting a good estimator (i.e., model selection) and assessing its performance (i.e., estimating generalization error). This article introduces a general framework for cross-validation and derives distributional properties of cross-validated risk estimators in the context of estimator selection and performance assessment. Arbitrary classes of estimators are considered, including density estimators and predictors for both continuous and polychotomous outcomes. Results are provided for general full data loss functions (e.g., absolute and squared error, indicator, negative log density). A broad definition of cross-validation is used in order to cover leave-one-out cross-validation, V-fold cross-validation, Monte Carlo cross-validation, and bootstrap procedures. For estimator selection, finite sample risk bounds are derived and applied to establish the asymptotic optimality of cross-validation, in the sense that a selector based on a cross-validated risk estimator performs asymptotically as well as an optimal oracle selector based on the risk under the true, unknown data generating distribution. The asymptotic results are derived under the assumption that the size of the validation sets converges to infinity and hence do not cover leave-one-out cross-validation. For performance assessment, cross-validated risk estimators are shown to be consistent and asymptotically linear for the risk under the true data generating distribution and confidence intervals are derived for this unknown risk. Unlike previously published results, the theorems derived in this and our related articles apply to general data generating distributions, loss functions (i.e., parameters), estimators, and cross-validation procedures.     

Comparing two treatments in terms of the likelihood ratio order

In this paper new families of test-statistics are introduced and studied for the problem of comparing two treatments in terms of the likelihood ratio order. The considered families are based on φ-divergence measures and arise as natural extensions of the classical likelihood ratio test and Pearson test-statistics. It is proven that their asymptotic distribution is a common chi-bar random variable. An illustrative example is presented and the performance of these statistics is analysed through a simulation study. Through a simulation study it is shown that, for most of the proposed scenarios adjusted to be small or moderate, some members of this new family of test-statistic display clearly better performance with respect to the power in comparison to the classical likelihood ratio and the Pearson's chi-square test while the exact size remains closed to the nominal size. In view of the exact powers and significance levels, the study also shows that the Wilcoxon test-statistic is not as good as the two classical test-statistics.