Strong laws of large numbers for dependent heterogeneous processes: a synthesis of recent and new results

This paper surveys recent developments in the strong law of large numbers for dependent heterogeneous processes. We prove a generalised version of a recent strong law for Lz-mixingales, and also a new strong law for Lpmixingales. These results greatly relax the dependence and heterogeneity conditions relative to those currently cited, and introduce explicit trade-offs between dependence and heterogeneity. The results are applied to proving strong laws for near-epoch dependent functions of mixing processes. We contrast several methods for obtaining these results, including mapping directly to the mixingale properties, and applying a truncation argument.     

Strong laws of large numbers for dependent heterogeneous processes: a synthesis of recent and new results

This paper surveys recent developments in the strong law of large numbers for dependent heterogeneous processes. We prove a generalised version of a recent strong law for Lz-mixingales, and also a new strong law for Lpmixingales. These results greatly relax the dependence and heterogeneity conditions relative to those currently cited, and introduce explicit trade-offs between dependence and heterogeneity. The results are applied to proving strong laws for near-epoch dependent functions of mixing processes. We contrast several methods for obtaining these results, including mapping directly to the mixingale properties, and applying a truncation argument.     

Strong law of large numbers for generalized sample relative entropy of non homogeneous Markov chains

In this paper, we study the strong law of large numbers for the generalized sample relative entropy of non homogeneous Markov chains taking values from a finite state space. First, we introduce the definitions of generalized sample relative entropy and generalized sample relative entropy rate. Then, using a strong limit theorem for the delayed sums of the functions of two variables and a strong law of large numbers for non homogeneous Markov chains, we obtain the strong law of large numbers for the generalized sample relative entropy of non homogeneous Markov chains. As corollaries, we obtain some important results.     

Basic structure of the asymptotic theory in dynamic nonlineaerco nometric models,part i: consistency and approximation concepts

This is the first of two papers that provide an expository discussion of the basic structure of the asymptotic theory of M-estimators in dynamic nonlinear models and a revlew of the literature. In this paper we discuss consistency,uniform laws of large numbers and develop a new framework for laws of large numbers for dependent and heterogeneous processes, encompassing the theory of stochastically stable as well as near epoch dependent processes. This framework results in simplified catalogues of sufficient conditions for consistency. The second paper, Potscher and Prucha (1990b), deals with asymptotic distribution theory.     

Basic structure of the asymptotic theory in dynamic nonlineaerco nometric models, part i: consistency and approximation concepts

This is the first of two papers that provide an expository discussion of the basic structure of the asymptotic theory of M-estimators in dynamic nonlinear models and a revlew of the literature. In this paper we discuss consistency,uniform laws of large numbers and develop a new framework for laws of large numbers for dependent and heterogeneous processes, encompassing the theory of stochastically stable as well as near epoch dependent processes. This framework results in simplified catalogues of sufficient conditions for consistency. The second paper, Potscher and Prucha (1990b), deals with asymptotic distribution theory.     

The laws of large numbers for Pareto-type random variables with infinite means

In this paper, we consider the laws of large numbers for NSD random variables satisfying Pareto-type distributions with infinite means. Based on the Pareto-Zipf distributions, some weak laws of large numbers for weighted sums of NSD random variables are obtained. Meanwhile, we show that a weak law for Pareto-Zipf distributions cannot be extended to a strong law. Furthermore, based on the two tailed Pareto distribution, a strong law of large numbers for weighed NSD random variables is presented. Our results extend the corresponding earlier ones.     

Strong law of large numbers of the delayed sums for Markov Chains indexed by a Cayley tree

Abstract

In this paper, we will study the strong law of large numbers of the delayed sums for Markov chains indexed by a Cayley tree with countable state spaces. Firstly, we prove a strong limit theorem for the delayed sums of the bivariate functions for Markov chains indexed by a Cayley tree. Secondly, the strong law of large numbers for the frequencies of occurrence of states of the delayed sums is obtained. As a corollary, we obtain the strong law of large numbers for the frequencies of occurrence of states for countable Markov chains indexed by a Cayley tree.     

Weak and strong laws of large numbers for sub-linear expectation

Abstract

In this paper, we derive a new form of weak laws of large numbers for sub-linear expectation and establish the equivalence relation among this new form and the other two forms of weak laws of large numbers for sub-linear expectation. Moreover, we obtain the strong laws of large numbers for sub-linear expectation under a general moment condition by applying our new weak laws of large numbers.     

The strong laws of large numbers for countable non homogeneous hidden Markov models

In this article, we are going to study the strong laws of large numbers for countable non homogeneous hidden Markov models. First, we introduce the notion of countable non homogeneous hidden Markov models. Then, we obtain some properties for those Markov models. Finally, we establish two strong laws of large numbers for countable non homogeneous hidden Markov models. As corollaries, we obtain some known results of strong laws of large numbers for finite non homogeneous Markov chains.     

Strong laws of large numbers for sub-linear expectation without independence

In this paper, we investigate some strong laws of large numbers for sub-linear expectation without independence which generalize the classical ones. We give some strong laws of large numbers for sub-linear expectation on some moment conditions with respect to the partial sum and some conditions similar to Petrov’s. We can reduce the conclusion to a simple form when the the sequence of random variables is i.i.d. We also show a strong law of large numbers for sub-linear expectation with assumptions of quasi-surely.     

General strong convergence for negatively associated random variables

For negatively associated (NA) random variables, we obtain two general strong laws of large numbers (SLLN) in which the coefficient of sum and the weight are both general functions. As corollaries, we obtain Marcinkiewicz-type SLLN, the logarithmic SLLN and Marcinkiewicz SLLN for NA random variables.     

Asymptotic Normality for Regression Function Estimate Under Truncation and α-Mixing Conditions

In this article we establish pointwise asymptotic normality of nonparametric kernel estimator of regression function for a left truncation model. It is assumed that the lifetime observations with multivariate covariates form a stationary α-mixing sequence. Also, the asymptotic normality of the estimation of the covariable's density is considered. As a by-product, we obtain a uniform weak convergence rate for the product-limit estimator of the lifetime and truncated distributions under dependence, which is interesting independently. Finite sample behavior of the estimator of the regression function is investigated as well.     

Some results on the truncated multivariate t distribution

The use of truncated distributions arises often in a wide variety of scientific problems. In the literature, there are a lot of sampling schemes and proposals developed for various specific truncated distributions. So far, however, the study of the truncated multivariate t (TMVT) distribution is rarely discussed. In this paper, we first present general formulae for computing the first two moments of the TMVT distribution under the double truncation. We formulate the results as analytic matrix expressions, which can be directly computed in existing software. Results for the left and right truncation can be viewed as special cases. We then apply the slice sampling algorithm to generate random variates from the TMVT distribution by introducing auxiliary variables. This strategic approach can result in a series of full conditional densities that are of uniform distributions. Finally, several examples and practical applications are given to illustrate the effectiveness and importance of the proposed results.     

Asymptotic equipartition property for second-order circular Markov chains indexed by a two-rooted Cayley tree

In this paper, we introduce a model of a second-order circular Markov chain indexed by a two-rooted Cayley tree and establish two strong law of large numbers and the asymptotic equipartition property (AEP) for circular second-order finite Markov chains indexed by this homogeneous tree. In the proof, we apply a limit property for a sequence of multi-variable functions of a non homogeneous Markov chain indexed by such tree. As a corollary, we obtain the strong law of large numbers and AEP about the second-order finite homogeneous Markov chain indexed by the two-rooted homogeneous tree.     

A general strong law of large numbers for non-additive probabilities and its applications

In this paper, with the notion of independence for random variables under upper expectations, we derive a strong law of large numbers for non-additive probabilities. This result can be seen an extension version of Theorem 3.1 that Chen et al. [A strong law of large numbers for non-additive probabilities. Int J Approx Reason. 2013;54:365–377] yielded. Furthermore, two applications of our result are given.     

An inverse-probability-weighted approach to estimation of the bivariate survival function under left-truncation and right-censoring

In this note, we consider estimating the bivariate survival function when both survival times are subject to random left truncation and one of the survival times is subject to random right censoring. Motivated by Satten and Datta [2001. The Kaplan–Meier estimator as an inverse-probability-of-censoring weighted average. Amer. Statist. 55, 207–210], we propose an inverse-probability-weighted (IPW) estimator. It involves simultaneous estimation of the bivariate survival function of the truncation variables and that of the censoring variable and the truncation variable of the uncensored components. We prove that (i) when there is no censoring, the IPW estimator reduces to NPMLE of van der Laan [1996a. Nonparametric estimation of the bivariate survival function with truncated data. J. Multivariate Anal. 58, 107–131] and (ii) when there is random left truncation and right censoring on only one of the components and the other component is always observed, the IPW estimator reduces to the estimator of Gijbels and Gürler [1998. Covariance function of a bivariate distribution function estimator for left truncated and right censored data. Statist. Sin. 1219–1232]. Based on Theorem 3.1 of van der Laan [1996a. Nonparametric estimation of the bivariate survival function with truncated data. J. Multivariate Anal. 58, 107–131, 1996b. Efficient estimation of the bivariate censoring model and repairing NPMLE. Ann. Statist. 24, 596–627], we prove that the IPW estimator is consistent under certain conditions. Finally, we examine the finite sample performance of the IPW estimator in some simulation studies. For the special case that censoring time is independent of truncation time, a simulation study is conducted to compare the performances of the IPW estimator against that of the estimator proposed by van der Laan [1996a. Nonparametric estimation of the bivariate survival function with truncated data. J. Multivariate Anal. 58, 107–131, 1996b. Efficient estimation of the bivariate censoring model and repairing NPMLE. Ann. Statist. 24, 596–627]. For the special case (i), a simulation study is conducted to compare the performances of the IPW estimator against that of the estimator proposed by Huang et al. (2001. Nonnparametric estimation of marginal distributions under bivariate truncation with application to testing for age-of-onset application. Statist. Sin. 11, 1047–1068).     

Strong and weak consistency of LS estimators in the EV regression model with negatively superadditive-dependent errors

In this paper, the strong laws of large numbers for partial sums and weighted sums of negatively superadditive-dependent (NSD, in short) random variables are presented, especially the Marcinkiewicz–Zygmund type strong law of large numbers. Using these strong laws of large numbers, we further investigate the strong consistency and weak consistency of the LS estimators in the EV regression model with NSD errors, which generalize and improve the corresponding ones for negatively associated random variables. Finally, a simulation is carried out to study the numerical performance of the strong consistency result that we established.     

Chernoff distance for doubly truncated distributions

In a recent paper, Nair et al. [Stat Pap 52:893–909, 2011] proposed Chernoff distance measure for left/right-truncated random variables and studied their properties in the context of reliability analysis. Here we extend the definition of Chernoff distance for doubly truncated distributions. This measure may help the information theorists and reliability analysts to study the various characteristics of a system/component when it fails between two time points. We study some properties of this measure and obtain its upper and lower bounds. We also study the interval Chernoff distance between the original and weighted distributions. These results generalize and enhance the related existing results that are developed based on Chernoff distance for one-sided truncated random variables.     

Interval censored and truncated data: Rate of convergence of NPMLE of the density

We consider survival data that are both interval censored and truncated. Under appropriate assumptions on the involved distributions, the censoring, truncation and survival, we prove the consistency of the NPMLE of the density of the survival, and give the rate of convergence. Finally, we give an example where the joint law of the censoring and truncation can be explicitly computed.     

Exact percentage points for the Kolmogorov test on truncated versions of known continuous distributions with unknown truncation parameters

In this paper we deal with Kolmogorov-Smirnov testson uniformity with completely or partly unknown limits. Tables of exact percentage points are presented or referred using the wellknown determinant formula given by Steck (1971). It is shown that these tables also give the percentage points for the analogous statistics of the test on truncated versions of known continuous distributions with completely or partly unknown truncation limits. We will give some examples of these applications. Among these are the tests on exponentiality and on Pareto distribution with known shape parameter and unknown lower terminal.