Mixing and moments properties of a non-stationary copula-based Markov process

Abstract

We provide conditions under which a non-stationary copula-based Markov process is geometric β-mixing and geometric ρ-mixing. Our results generalize some results of Beare who considers the stationary case. As a particular case we introduce a stochastic process, that we call convolution-based Markov process, whose construction is obtained by using the C-convolution operator which allows the increments to be dependent. Within this subclass of processes we characterize a modified version of the standard random walk where copulas and marginal distributions involved are in the same elliptical family. We study mixing and moments properties to identify the differences compared to the standard case.     

A non-iterative Bayesian sampling algorithm for censored Student-t linear regression models

ABSTRACT

In this paper, we consider an effective Bayesian inference for censored Student-t linear regression model, which is a robust alternative to the usual censored Normal linear regression model. Based on the mixture representation of the Student-t distribution, we propose a non-iterative Bayesian sampling procedure to obtain independently and identically distributed samples approximately from the observed posterior distributions, which is different from the iterative Markov Chain Monte Carlo algorithm. We conduct model selection and influential analysis using the posterior samples to choose the best fitted model and to detect latent outliers. We illustrate the performance of the procedure through simulation studies, and finally, we apply the procedure to two real data sets, one is the insulation life data with right censoring and the other is the wage rates data with left censoring, and we get some interesting results.     

Distribution of busy period in stochastic fluid models

We consider the busy period in a stochastic fluid flow model with infinite buffer where the input and output rates are controlled by a finite homogeneous Markov process. We derive an explicit expression for the distribution of the busy period and we obtain an algorithm to compute it which exhibits nice numerical properties.

     

Slowing time: Markov-modulated Brownian motions with a sticky boundary

We define a new family of stochastic processes called Markov modulated Brownian motions with a sticky boundary at zero. Intuitively, each process is a regulated Markov-modulated Brownian motion whose boundary behavior is modified to slow down at level zero.

To determine the stationary distribution of a sticky MMBM, we follow a Markov-regenerative approach similar to the one developed with great success in the context of quasi-birth-and-death processes and fluid queues. Our analysis also relies on recent work showing that Markov-modulated Brownian motions arise as limits of a parametrized family of fluid queues.     

The group inverse of finite homogeneous QBD processes

Generalized inverses of I?P, where P is a stochastic matrix, play an important role in the theory of Markov chains. In particular, the group inverse (I?P)^# has a probabilistic interpretation and is well suited for algorithmic implementation. We determine (I?P)^# for finite homogeneous quasi-birth-and-death (QBD) processes by exploiting both the structure of the process and the probabilistic properties of the group inverse.     

A continuous-time HMM approach to modeling the magnitude-frequency distribution of earthquakes

The magnitude-frequency distribution (MFD) of earthquake is a fundamental statistic in seismology. The so-called b-value in the MFD is of particular interest in geophysics. A continuous time hidden Markov model (HMM) is proposed for characterizing the variability of b-values. The HMM-based approach to modeling the MFD has some appealing properties over the widely used sliding-window approach. Often, large variability appears in the estimation of b-value due to window size tuning, which may cause difficulties in interpretation of b-value heterogeneities. Continuous-time hidden Markov models (CT-HMMs) are widely applied in various fields. It bears some advantages over its discrete time counterpart in that it can characterize heterogeneities appearing in time series in a finer time scale, particularly for highly irregularly-spaced time series, such as earthquake occurrences. We demonstrate an expectation–maximization algorithm for the estimation of general exponential family CT-HMM. In parallel with discrete-time hidden Markov models, we develop a continuous time version of Viterbi algorithm to retrieve the overall optimal path of the latent Markov chain. The methods are applied to New Zealand deep earthquakes. Before the analysis, we first assess the completeness of catalogue events to assure the analysis is not biased by missing data. The estimation of b-value is stable over the selection of magnitude thresholds, which is ideal for the interpretation of b-value variability.     

Inference for Adaptive Time Series Models: Stochastic Volatility and Conditionally Gaussian State Space Form

In this paper we model the Gaussian errors in the standard Gaussian linear state space model as stochastic volatility processes. We show that conventional MCMC algorithms for this class of models are ineffective, but that the problem can be alleviated by reparameterizing the model. Instead of sampling the unobserved variance series directly, we sample in the space of the disturbances, which proves to lower correlation in the sampler and thus increases the quality of the Markov chain.

Using our reparameterized MCMC sampler, it is possible to estimate an unobserved factor model for exchange rates between a group of n countries. The underlying n + 1 country-specific currency strength factors and the n + 1 currency volatility factors can be extracted using the new methodology. With the factors, a more detailed image of the events around the 1992 EMS crisis is obtained.

We assess the fit of competitive models on the panels of exchange rates with an effective particle filter and find that indeed the factor model is strongly preferred by the data.     

Interacting neighbour point processes: Some models for clustering

We introduce a class of spatial point processesinteracting neighbour point (INP) processes, where the density of the process can be written by means of local interactions between a point and subsets of its neighbourhood but where the processes may not be Ripley-Kelly Markov processes with respect to this neighbourhood. We show that the processes are iterated Markov processes defined by Hayat and Gubner (1996). Furthermore, we pay special attention to a subclass of interacting neighbour processes, where the density belongs to the exponential family and all neighbours of a point affect it simultaneously. A simulation study is presented to show that some simple processes of this subclass can produce clustered patterns of great variety. Finally, an empirical example is given.     

Stochastic monotonicity and comparability of Markov chains with block-monotone transition matrices and their applications to queueing systems

ABSTRACT

Motivated by various applications in queueing theory, this article is devoted to the stochastic monotonicity and comparability of Markov chains with block-monotone transition matrices. First, we introduce the notion of block-increasing convex order for probability vectors, and characterize the block-monotone matrices in the sense of the block-increasing order and block-increasing convex order. Second, we characterize the Markov chain with general transition matrix by martingale and provide a stochastic comparison of two block-monotone Markov chains under the two block-monotone orders. Third, the stochastic comparison results for the Markov chains corresponding to the discrete-time GI/G/1 queue with different service distributions under the two block-monotone orders are given, and the lower bound and upper bound of the Markov chain corresponding to the discrete-time GI/G/1 queue in the sense of the block-increasing convex order are found.     

Characterizing the BMAP/MAP/1 Departure Process via the ETAQA Truncation

Abstract

We propose a family of finite approximations for the departure process of a BMAP/MAP/1 queue. The departure process approximations are derived via an exact aggregate solution technique (called ETAQA) applied to M/G/1-type Markov processes. The proposed approximations are indexed by a parameter n(n > 1), which determines the size of the output model as n + 1 block levels of the M/G/1-type process. This output approximation preserves exactly the marginal distribution of the true departure process and the lag correlations of the interdeparture times up to lag n ? 2. Experimental results support the applicability of the proposed approximation in traffic-based decomposition of queueing networks.     

Convergence in the Wasserstein Metric for Markov Chain Monte Carlo Algorithms with Applications to Image Restoration

Abstract

In this paper, we show how the time for convergence to stationarity of a Markov chain can be assessed using the Wasserstein metric, rather than the usual choice of total variation distance. The Wasserstein metric may be more easily applied in some applications, particularly those on continuous state spaces. Bounds on convergence time are established by considering the number of iterations required to approximately couple two realizations of the Markov chain to within ε tolerance. The particular application considered is the use of the Gibbs sampler in the Bayesian restoration of a degraded image, with pixels that are a continuous grey-scale and with pixels that can only take two colours. On finite state spaces, a bound in the Wasserstein metric can be used to find a bound in total variation distance. We use this relationship to get a precise O(N log N) bound on the convergence time of the stochastic Ising model that holds for appropriate values of its parameter as well as other binary image models. Our method employing convergence in the Wasserstein metric can also be applied to perfect sampling algorithms involving coupling from the past to obtain estimates of their running times.     

A transient analysis of Markov fluid models with jumps

In this paper, we consider Markov fluid models with jumps which are useful for e.g. insurance risk modeling and the performance analysis of high-speed data networks. Recently, Ahn and Ramaswami [Ahn, S. & Ramaswami, V. (2004). Transient analysis of fluid flow models via stochastic coupling to a queue. Stochastic Models, 20 (1) 71–101] provided a transient analysis of the Markov modulated fluid flow model using stochastic coupling to a queueing model. Here we extend their results and provide a transient analysis of Markov fluid models with jumps. We also present some numerical examples.     

Robust variable selection for the varying coefficient model based on composite L 1–L 2 regression

The varying coefficient model (VCM) is an important generalization of the linear regression model and many existing estimation procedures for VCM were built on L ₂ loss, which is popular for its mathematical beauty but is not robust to non-normal errors and outliers. In this paper, we address the problem of both robustness and efficiency of estimation and variable selection procedure based on the convex combined loss of L ₁ and L ₂ instead of only quadratic loss for VCM. By using local linear modeling method, the asymptotic normality of estimation is driven and a useful selection method is proposed for the weight of composite L ₁ and L ₂. Then the variable selection procedure is given by combining local kernel smoothing with adaptive group LASSO. With appropriate selection of tuning parameters by Bayesian information criterion (BIC) the theoretical properties of the new procedure, including consistency in variable selection and the oracle property in estimation, are established. The finite sample performance of the new method is investigated through simulation studies and the analysis of body fat data. Numerical studies show that the new method is better than or at least as well as the least square-based method in terms of both robustness and efficiency for variable selection.     

Simultaneous sparse model selection and coefficient estimation for heavy-tailed autoregressive processes

We propose a sparse coefficient estimation and automated model selection procedure for autoregressive processes with heavy-tailed innovations based on penalized conditional maximum likelihood. Under mild moment conditions on the innovation processes, the penalized conditional maximum likelihood estimator satisfies a strong consistency, O_P(N^?1/2) consistency, and the oracle properties, where N is the sample size. We have the freedom in choosing penalty functions based on the weak conditions on them. Two penalty functions, least absolute shrinkage and selection operator and smoothly clipped average deviation, are compared. The proposed method provides a distribution-based penalized inference to AR models, which is especially useful when the other estimation methods fail or under perform for AR processes with heavy-tailed innovations [Feigin, Resnick. Pitfalls of fitting autoregressive models for heavy-tailed time series. Extremes. 1999;1:391–422]. A simulation study confirms our theoretical results. At the end, we apply our method to a historical price data of the US Industrial Production Index for consumer goods, and obtain very promising results.     

Consistent estimation for discretely observed Markov jump processes with an absorbing state

For a continuous-time Markov process, commonly, only discrete-time observations are available. We analyze multiple observations of a homogeneous Markov jump process with an absorbing state. We establish consistency of the maximum likelihood estimator, as the number of Markov processes increases. To accomplish uniform convergence in the continuous mapping theorem, we use the continuity of the transition probability in the parameters, the compactness of the parameter space and the boundedness of probabilities. We allow for a stochastic time-grid of observation points with different intensities for each observation process. Furthermore, we account for right censoring. The estimate is obtained via the EM algorithm with an E-step given in closed form. In our empirical application of credit rating histories, we fit the model of Weißbach and Mollenhauer (J Korean Stat Soc 40:469–485, 2011) and find marked differences, compared to the continuous-time analysis.     

Markov-switching BILINEAR − GARCH models: Structure and estimation

Markov-switching (MS) models are becoming increasingly popular as efficient tools of modeling various phenomena in different disciplines, in particular for non Gaussian time series. In this articlept", we propose a broad class of Markov-switching BILINEAR–GARCH processes (MS ? BLGARCH hereafter) obtained by adding to a MS ? GARCH model one or more interaction components between the observed series and its volatility process. This parameterization offers remarkably rich dynamics and complex behavior for modeling and forecasting financial time-series data which exhibit structural changes. In these models, the parameters of conditional variance are allowed to vary according to some latent time-homogeneous Markov chain with finite state space or “regimes.” The main aim of this new model is to capture asymmetric and hence purported to be able to capture leverage effect characterized by the negativity of the correlation between returns shocks and subsequent shocks in volatility patterns in different regimes. So, first, some basic structural properties of this new model including sufficient conditions ensuring the existence of stationary, causal, ergodic solutions, and moments properties are given. Second, since the second-order structure provides a useful information to identify an appropriate time-series model, we derive the expression of the covariance function of for MS ? BLGARCH and for its powers. As a consequence, we find that the second (resp. higher)-order structure is similar to some linear processes, and hence MS ? BLGARCH (resp. its powers) admit an ARMA representation. This finding allows us for parameter estimation via GMM procedure proved by a Monte Carlo study and applied to foreign exchange rate of the Algerian Dinar against the single European currency.     

Rate estimation in partially observed Markov jump processes with measurement errors

We present a simulation methodology for Bayesian estimation of rate parameters in Markov jump processes arising for example in stochastic kinetic models. To handle the problem of missing components and measurement errors in observed data, we embed the Markov jump process into the framework of a general state space model. We do not use diffusion approximations. Markov chain Monte Carlo and particle filter type algorithms are introduced which allow sampling from the posterior distribution of the rate parameters and the Markov jump process also in data-poor scenarios. The algorithms are illustrated by applying them to rate estimation in a model for prokaryotic auto-regulation and the stochastic Oregonator, respectively.     

Strong approximations for time-varying infinite-server queues with non-renewal arrival and service processes

In real stochastic systems, the arrival and service processes may not be renewal processes. For example, in many telecommunication systems such as internet traffic where data traffic is bursty, the sequence of inter-arrival times and service times are often correlated and dependent. One way to model this non-renewal behavior is to use Markovian Arrival Processes (MAPs) and Markovian Service Processes (MSPs). MAPs and MSPs allow for inter-arrival and service times to be dependent, while providing the analytical tractability of simple Markov processes. To this end, we prove fluid and diffusion limits for MAP_t/MSP_t/∞ queues by constructing a new Poisson process representation for the queueing dynamics and leveraging strong approximations for Poisson processes. As a result, the fluid and diffusion limit theorems illuminate how the dependence structure of the arrival or service processes can affect the sample path behavior of the queueing process. Finally, our Poisson representation for MAPs and MSPs is useful for simulation purposes and may be of independent interest.     

Long-Range Dependence of Markov Renewal Processes

This paper examines long‐range dependence (LRD) and asymptotic properties of Markov renewal processes generalizing results of Daley for renewal processes. The Hurst index and discrepancy function, which is the difference between the expected number of arrivals in (0, t] given a point at 0 and the number of arrivals in (0, t] in the time stationary version, are examined in terms of the moment index. The moment index is the supremum of the set of r > 0 such that the rth moment of the first return time to a state is finite, employing the solidarity results of Sgibnev. The results are derived for irreducible, regular Markov renewal processes on countable state spaces. The paper also derives conditions to determine the moment index of the first return times in terms of the Markov renewal kernel distribution functions of the process.     

Application of a Markovian process to the calculation of mean time equilibrium in a genetic drift model

The most common phenomena in the evolution process are natural selection and genetic drift. In this article, we propose a probabilistic method to calculate the mean and variance time for random genetic drift equilibrium, measured as number of generations, based on Markov process and a complex probabilistic model. We studied the case of a constant, panmictic population of diploid organisms, which had a demonstrated lack of mutation, selection or migration for a determined autonomic locus, and two possible alleles, H and h. The calculations presented in this article were based on a Markov process. They explain how genetic and genotypic frequencies changed in different generations and how the heterozygote alleles became extinguished after many generations. This calculation could be used in more evolutionary applications. Finally, some simulations are presented to illustrate the theoretical calculations presented using different basal situations.