Estimating models based on Markov jump processes given fragmented observation series

We consider the problem of estimating the rate matrix governing a finite-state Markov jump process given a number of fragmented time series. We propose to concatenate the observed series and to employ the emerging non-Markov process for estimation. We describe the bias arising if standard methods for Markov processes are used for the concatenated process, and provide a post-processing method to correct for this bias. This method applies to discrete-time Markov chains and to more general models based on Markov jump processes where the underlying state process is not observed directly. This is demonstrated in detail for a Markov switching model. We provide applications to simulated time series and to financial market data, where estimators resulting from maximum likelihood methods and Markov chain Monte Carlo sampling are improved using the presented correction.     

Multivariate online regression analysis with heterogeneous streaming data

New data collection and storage technologies have given rise to a new field of streaming data analytics, called real-time statistical methodology for online data analyses. Most existing online learning methods are based on homogeneity assumptions, which require the samples in a sequence to be independent and identically distributed. However, inter-data batch correlation and dynamically evolving batch-specific effects are among the key defining features of real-world streaming data such as electronic health records and mobile health data. This article is built under a state-space mixed model framework in which the observed data stream is driven by a latent state process that follows a Markov process. In this setting, online maximum likelihood estimation is made challenging by high-dimensional integrals and complex covariance structures. In this article, we develop a real-time Kalman-filter-based regression analysis method that updates both point estimates and their standard errors for fixed population average effects while adjusting for dynamic hidden effects. Both theoretical justification and numerical experiments demonstrate that our proposed online method has statistical properties similar to those of its offline counterpart and enjoys great computational efficiency. We also apply this method to analyze an electronic health record dataset.     

Modified tightened two-level continuous sampling plans

In this paper, a modification is proposed on the tightened two-level continuous sampling plan. The tightened two-level plan is one of the three tightened multi-level continuous sampling plans of Derman et al. (1957) with two sampling levels. A modified tightened two-level continuous sampling plan is considered, for which the rules concerning partial inspection depend, in part, on the length of time it takes to decide that the process quality is good enough that 100% inspection may be suspended (e.g. the time required to find i consecutive items free of defects). Using a Markov chain model, expressions for the performance measures of the modified MLP-T-2 plan are derived. The modified MLP-T-2 plan is shown to be identical to the MLP-T-2 plan. Tables are also presented for the selection of the modified MLP-T-2 plan when the AQL or LQL and AOQL are specified.     

A latent Gaussian Markov random-field model for spatiotemporal rainfall disaggregation

Summary. Rainfall data are often collected at coarser spatial scales than required for input into hydrology and agricultural models. We therefore describe a spatiotemporal model which allows multiple imputation of rainfall at fine spatial resolutions, with a realistic dependence structure in both space and time and with the total rainfall at the coarse scale consistent with that observed. The method involves the transformation of the fine scale rainfall to a thresholded Gaussian process which we model as a Gaussian Markov random field. Gibbs sampling is then used to generate realizations of rainfall efficiently at the fine scale. Results compare favourably with previous, less elegant methods.     

Joint modeling of multivariate longitudinal mixed measurements and time to event data using a Bayesian approach

In many longitudinal studies multiple characteristics of each individual, along with time to occurrence of an event of interest, are often collected. In such data set, some of the correlated characteristics may be discrete and some of them may be continuous. In this paper, a joint model for analysing multivariate longitudinal data comprising mixed continuous and ordinal responses and a time to event variable is proposed. We model the association structure between longitudinal mixed data and time to event data using a multivariate zero-mean Gaussian process. For modeling discrete ordinal data we assume a continuous latent variable follows the logistic distribution and for continuous data a Gaussian mixed effects model is used. For the event time variable, an accelerated failure time model is considered under different distributional assumptions. For parameter estimation, a Bayesian approach using Markov Chain Monte Carlo is adopted. The performance of the proposed methods is illustrated using some simulation studies. A real data set is also analyzed, where different model structures are used. Model comparison is performed using a variety of statistical criteria.     

Economically optimal markovian sampling policies for process monitoring

A variable delay process sampling procedure is considered in a Markov chain structure. The paper extends the basic sampling method given in Arnold (1970). Analytic properties of the process are developed for expected sample size and distribution of the sample size. A primary concern in the paper is the development of an objective function to enhance ability to select optimal sampling policies. The objective function involves cost due to sampling and protection costs for detecting undesirable conditions.     

交易成本视角下B2C电子商务网络购物的感知风险研究

中国绝大多数网民并不通过网络进行购物,因为消费者对网络购物的感知风险太高。以交易成本理论为视角,在对网络购物的感知风险进行文献综述的基础上,提出消费者感知的各种交易成本对感知风险和购买意愿影响的研究假设,通过实地调研收集资料,对假设进行验证。实证分析结果表明,消费者网络购物感知的学习成本、搜索成本、时间成本、货币成本和风险成本影响感知风险以及最终购买意愿,企业可以通过降低消费者感知的各种交易成本降低感知风险。     

Robust Bayesian analysis of loss reserving data using scale mixtures distributions

It is vital for insurance companies to have appropriate levels of loss reserving to pay outstanding claims and related settlement costs. With many uncertainties and time lags inherently involved in the claims settlement process, loss reserving therefore must be based on estimates. Existing models and methods cannot cope with irregular and extreme claims and hence do not offer an accurate prediction of loss reserving. This paper extends the conventional normal error distribution in loss reserving modeling to a range of heavy-tailed distributions which are expressed by certain scale mixtures forms. This extension enables robust analysis and, in addition, allows an efficient implementation of Bayesian analysis via Markov chain Monte Carlo simulations. Various models for the mean of the sampling distributions, including the log-Analysis of Variance (ANOVA), log-Analysis of Covariance (ANCOVA) and state space models, are considered and the straightforward implementation of scale mixtures distributions is demonstrated using OpenBUGS.     

Matrix-analytic Models and their Analysis

We survey phase-type distributions and Markovian point processes, aspects of how to use such models in applied probability calculations and how to fit them to observed data. A phase-type distribution is defined as the time to absorption in a finite continuous time Markov process with one absorbing state. This class of distributions is dense and contains many standard examples like all combinations of exponential in series/parallel. A Markovian point process is governed by a finite continuous time Markov process (typically ergodic), such that points are generated at a Poisson intensity depending on the underlying state and at transitions; a main special case is a Markov-modulated Poisson process. In both cases, the analytic formulas typically contain matrix-exponentials, and the matrix formalism carried over when the models are used in applied probability calculations as in problems in renewal theory, random walks and queueing. The statistical analysis is typically based upon the EM algorithm, viewing the whole sample path of the background Markov process as the latent variable.     

A semi‐Markov model for binary longitudinal responses subject to misclassification

The authors propose a two‐state continuous‐time semi‐Markov model for an unobservable alternating binary process. Another process is observed at discrete time points that may misclassify the true state of the process of interest. To estimate the model's parameters, the authors propose a minimum Pearson chi‐square type estimating approach based on approximated joint probabilities when the true process is in equilibrium. Three consecutive observations are required to have sufficient degrees of freedom to perform estimation. The methodology is demonstrated on parasitic infection data with exponential and gamma sojourn time distributions.     

Rate estimation in partially observed Markov jump processes with measurement errors

We present a simulation methodology for Bayesian estimation of rate parameters in Markov jump processes arising for example in stochastic kinetic models. To handle the problem of missing components and measurement errors in observed data, we embed the Markov jump process into the framework of a general state space model. We do not use diffusion approximations. Markov chain Monte Carlo and particle filter type algorithms are introduced which allow sampling from the posterior distribution of the rate parameters and the Markov jump process also in data-poor scenarios. The algorithms are illustrated by applying them to rate estimation in a model for prokaryotic auto-regulation and the stochastic Oregonator, respectively.     

LOCATION OF THE OPTIMAL SAMPLING POINT FOR THE QUALITY ASSESSMENT OF CONTINUOUS STREAMS

The paper makes an appraisal of the most appropriate sampling point for situations where a single sample must be used to estimate the mean flow of a continuous stream during a set time interval. Taking ‘optimal’ to mean the point at which the estimation error variance is minimised, optimal sampling locations are obtained for constant, linear and exponential flow rates when the process variogram is assumed linear or exponential. Numerical results illustrate the significance of failing to sample at the optimal point.     

Costing Mixed Coxian Phase-type Systems with Poisson Arrivals

Previously, we developed a modeling framework which classifies individuals with respect to their length of stay (LOS) in the transient states of a continuous-time Markov model with a single absorbing state; phase-type models are used for each class of the Markov model. We here add costs and obtain results for moments of total costs in (0, t], for an individual, a cohort arriving at time zero and when arrivals are Poisson. Based on stroke patient data from the Belfast City Hospital we use the overall modelling framework to obtain results for total cost in a given time interval.     

Bayesian semiparametric modeling for stochastic precedence,with applications in epidemiology and survival analysis

We propose a prior probability model for two distributions that are ordered according to a stochastic precedence constraint, a weaker restriction than the more commonly utilized stochastic order constraint. The modeling approach is based on structured Dirichlet process mixtures of normal distributions. Full inference for functionals of the stochastic precedence constrained mixture distributions is obtained through a Markov chain Monte Carlo posterior simulation method. A motivating application involves study of the discriminatory ability of continuous diagnostic tests in epidemiologic research. Here, stochastic precedence provides a natural restriction for the distributions of test scores corresponding to the non-infected and infected groups. Inference under the model is illustrated with data from a diagnostic test for Johne’s disease in dairy cattle. We also apply the methodology to the comparison of survival distributions associated with two distinct conditions, and illustrate with analysis of data on survival time after bone marrow transplantation for treatment of leukemia.     

GENERALIZED EXTREME VALUE ADDITIVE MODEL ANALYSIS VIA MEAN FIELD VARIATIONAL BAYES

We develop Mean Field Variational Bayes methodology for fast approximate inference in Bayesian Generalized Extreme Value additive model analysis. Such models are useful for flexibly assessing the impact of continuous predictor variables on sample extremes. The new methodology allows large Bayesian models to be fitted and assessed without the significant computing costs of Markov Chain Monte Carlo methods. We illustrate our new methodology with maximum rainfall data from the Sydney, Australia, hinterland. Comparisons are made between the Mean Field Variational Bayes and Markov Chain Monte Carlo approaches.     

Stochastic models of geriatric patient bed occupancy behaviour

This paper considers a census approach to the modelling of the time that geriatric patients spend in hospital and subsequently in the community by using a stochastic compartmental Markov model. A selection process is developed using maximum likelihood estimation to fit the model to daily census data on the duration spent in the hospital or the community. Census data are used as they are easy to collect and therefore maximize the usability of the model. The model is fitted to an extensive 16-year data-set and shown to provide realistic estimates of movements of patients by using only a single day's census result.     

An (s,k, S) fluid inventory model with exponential leadtimes and order cancellations

We consider a stochastic fluid inventory model based on a (s, k, S) policy. The content level W = {W(t): t ≥ 0} increases or decreases according to a fluid-flow rate modulated by an n-state continuous time Markov chain (CTMC). W starts at W(0) = S; whenever W(t) drops to level s, an order is placed to take the inventory back to level S, which the supplier will carry out after an exponential leadtime. However, if during the leadtime the content level reaches k, the order is suppressed. We obtain explicit formulas for the expected discounted costs. The derivations are based on the optional sampling theorem (OST) to the multidimensional martingale and on fluid flow techniques.     

Modified CSP-C Continuous Sampling Plan for Consumer Protection

Dodge (1943) introduced a single level attribute continuous sampling plan designated as CSP-1 for the application of continuous production processes. Govindaraju & Kandasamy (2000) developed a new single level continuous sampling plan whose sampling inspection phase is characterized by a maximum allowable number of non-conforming units c, and a constant sampling rate f and was designated as CSP-C. In this paper, a modification is proposed on the CSP-C continuous sampling plan. In this modified plan, sampling inspection is continued until the occurrence of c+1 non-conforming units, provided the first m sampled units have been found conforming during the sampling phase. Using a Markov chain model, expressions for the performance measures of the modified CSP-C plan are derived. The main advantage of the modified plan is that it is possible to lower the average outgoing quality limit.     

BAYESIAN BETA REGRESSION: APPLICATIONS TO HOUSEHOLD EXPENDITURE DATA AND GENETIC DISTANCE BETWEEN FOOT-AND-MOUTH DISEASE VIRUSES

There is considerable interest in understanding how factors such as time and geographic distance between isolates might influence the evolutionary direction of foot‐and‐mouth disease. Genetic differences between viruses can be measured as the proportion of nucleotides that differ for a given sequence or gene. We present a Bayesian hierarchical regression model for the statistical analysis of continuous data with sample space restricted to the interval (0, 1). The data are modelled using beta distributions with means that depend on covariates through a link function. We discuss methodology for: (i) the incorporation of informative prior information into an analysis; (ii) fitting the model using Markov chain Monte Carlo sampling; (iii) model selection using Bayes factors; and (iv) semiparametric beta regression using penalized splines. The model was applied to two different datasets.