Strong laws of large numbers for dependent heterogeneous processes: a synthesis of recent and new results

This paper surveys recent developments in the strong law of large numbers for dependent heterogeneous processes. We prove a generalised version of a recent strong law for Lz-mixingales, and also a new strong law for Lpmixingales. These results greatly relax the dependence and heterogeneity conditions relative to those currently cited, and introduce explicit trade-offs between dependence and heterogeneity. The results are applied to proving strong laws for near-epoch dependent functions of mixing processes. We contrast several methods for obtaining these results, including mapping directly to the mixingale properties, and applying a truncation argument.     

Testing for Choice Dynamics in Panel Data

This article applies different approaches to distinguish state dependence from unobserved heterogeneity and serial correlation and, hence, test for state dependence in consumer brand choices. First, we apply a simple method proposed by Chamberlain, which involves lagged exogenous variables only. Second, we also estimate a lagged-dependent-variable specification proposed by Wooldridge. Third, we use the estimation approach suggested by Wooldridge to estimate a model with both lagged dependent and exogenous variables to distinguish between the two different sources of choice dynamics, state dependence and lagged effects of the exogenous variables. Our analysis reveals that the best approach is to use models with both lagged dependent and exogenous variables. Our findings include strong evidence for state dependence in five out of the six product categories studied in this article.     

A Strong Law of Large Numbers for Strongly Mixing Processes

We prove a strong law of large numbers for a class of strongly mixing processes. Our result rests on recent advances in understanding of concentration of measure. It is simple to apply and gives finite-sample (as opposed to asymptotic) bounds, with readily computable rate constants. In particular, this makes it suitable for analysis of inhomogeneous Markov processes. We demonstrate how it can be applied to establish an almost-sure convergence result for a class of models that includes as a special case a class of adaptive Markov chain Monte Carlo algorithms.     

Some Asymptotic Results of Kernel Density Estimators Under Random Left-Truncation and Dependent Data

Problems with truncated data arise frequently in survival analyses and reliability applications. The estimation of the density function of the lifetimes is often of interest. In this article, the estimation of density function by the kernel method is considered, when truncated data are showing some kind of dependence. We apply the strong Gaussian approximation technique to study the strong uniform consistency for kernel estimators of the density function under a truncated dependent model. We also apply the strong approximation results to study the integrated square error properties of the kernel density estimators under the truncated dependent scheme.     

Strong invariance principles for triangular arrays of weakly dependent random variables

We establish a strong invariance principle for triangular arrays of a broad class of weakly dependent real random variables. We approximate the original array of dependent random variables by an array of rowwise independent standard normal variables. We demonstrate the functional central limit theorem and law of the iterated logarithm for the approximating array and thereby extend these results to the original array. Among several examples, we look at arrays used in describing the rate of convergence of estimators in regression analysis.     

Limit theorems for dependent Bernoulli variables with statistical inference

We consider a class of dependent Bernoulli variables where the conditional success probability is a linear combination of the last few trials and the original success probability. We obtain its limit theorems including the strong law of large numbers, weak invariance principle, and law of the iterated logarithm. We also derive some statistical inference results which make the model applicable. Simulation results are exhibited as well to show that with small sample size the convergence rate is satisfying and the proposed estimators behave well.     

Nonparametric regression for dependent data in the errors-in-variables problem

We consider the nonparametric estimation of the regression functions for dependent data. Suppose that the covariates are observed with additive errors in the data and we employ nonparametric deconvolution kernel techniques to estimate the regression functions in this paper. We investigate how the strength of time dependence affects the asymptotic properties of the local constant and linear estimators. We treat both short-range dependent and long-range dependent linear processes in a unified way and demonstrate that the long-range dependence (LRD) of the covariates affects the asymptotic properties of the nonparametric estimators as well as the LRD of regression errors does.     

Frequency domain bootstrap for ratio statistics under long-range dependence

A frequency domain bootstrap (FDB) is a common technique to apply Efron’s independent and identically distributed resampling technique (Efron, 1979) to periodogram ordinates – especially normalized periodogram ordinates – by using spectral density estimates. The FDB method is applicable to several classes of statistics, such as estimators of the normalized spectral mean, the autocorrelation (but not autocovariance), the normalized spectral density function, and Whittle parameters. While this FDB method has been extensively studied with respect to short-range dependent time processes, there is a dearth of research on its use with long-range dependent time processes. Therefore, we propose an FDB methodology for ratio statistics under long-range dependence, using semi- and nonparametric spectral density estimates as a normalizing factor. It is shown that the FDB approximation allows for valid distribution estimation for a broad class of stationary, long-range (or short-range) dependent linear processes, without any stringent assumptions on the distribution of the underlying process. The results of a large simulation study show that the FDB approximation using a semi- or nonparametric spectral density estimator is often robust for various values of a long-memory parameter reflecting magnitude of dependence. We apply the proposed procedure to two data examples.     

Dependent Lindeberg central limit theorem for the fidis of empirical processes of cluster functionals

Drees H. and Rootzén H. [Limit theorems for empirical processes of cluster functionals (EPCF). Ann Stat. 2010;38(4):2145–2186] have proven central limit theorems (CLTs) for EPCF built from β-mixing processes. However, this family of β-mixing processes is quite restrictive. We expand some of those results, for the finite-dimensional marginal distributions (fidis), to a more general dependent processes family, known as weakly dependent processes in the sense of Doukhan P. and Louhichi S. [A new weak dependence condition and applications to moment inequalities. Stoch. Proc. Appl. 1999;84:313–342]. In this context, the CLT for the fidis of EPCF is sufficient in some applications. For instance, we prove the convergence without mixing conditions of the extremogram estimator, including a small example with simulation of the extremogram of a weakly dependent random process but nonmixing, in order to confirm the efficacy of our result.     

Heterogeneous credit union production technologies with endogenous switching and correlated effects

Credit unions differ in the types of financial services they offer to their members. This article explicitly models this observed heterogeneity using a generalized model of endogenous ordered switching. Our approach captures the endogenous choice that credit unions make when adding new products to their financial services mix. The model that we consider also allows for the dependence between unobserved effects and regressors in both the selection and outcome equations and can accommodate the presence of predetermined covariates in the model. We use this model to estimate returns to scale for U.S. retail credit unions from 1996 to 2011. We document strong evidence of persistent technological heterogeneity among credit unions offering different financial service mixes, which, if ignored, can produce quite misleading results. Employing our model, we find that credit unions of all types exhibit substantial economies of scale.     

Measuring density dependence in survival from mark-recapture data

We discuss the analysis of mark-recapture data when the aim is to quantify density dependence between survival rate and abundance. We describe an analysis for a random effects model that includes a linear relationship between abundance and survival using an errors-in-variables regression estimator with analytical adjustment for approximate bias. The analysis is illustrated using data from short-tailed shearwaters banded for 48 consecutive years at Fisher Island, Tasmania, and Hutton's shearwater banded at Kaikoura, New Zealand for nine consecutive years. The Fisher Island data provided no evidence of a density dependence relationship between abundance and survival, and confidence interval widths rule out anything but small density dependent effects. The Hutton's shearwater data were equivocal with the analysis unable to rule out anything but a very strong density dependent relationship between survival and abundance.     

On the clustering term in ecological analysis: how do different prior specifications affect results?

We study how different prior assumptions on the spatially structured heterogeneity term of the convolution hierarchical Bayesian model for spatial disease data could affect the results of an ecological analysis when response and exposure exhibit a strong spatial pattern. We show that in this case the estimate of the regression parameter could be strongly biased, both by analyzing the association between lung cancer mortality and education level on a real dataset and by a simulation experiment. The analysis is based on a hierarchical Bayesian model with a time dependent covariate in which we allow for a latency period between exposure and mortality, with time and space random terms and misaligned exposure-disease data.     

Strong approximations for time-varying infinite-server queues with non-renewal arrival and service processes

In real stochastic systems, the arrival and service processes may not be renewal processes. For example, in many telecommunication systems such as internet traffic where data traffic is bursty, the sequence of inter-arrival times and service times are often correlated and dependent. One way to model this non-renewal behavior is to use Markovian Arrival Processes (MAPs) and Markovian Service Processes (MSPs). MAPs and MSPs allow for inter-arrival and service times to be dependent, while providing the analytical tractability of simple Markov processes. To this end, we prove fluid and diffusion limits for MAP_t/MSP_t/∞ queues by constructing a new Poisson process representation for the queueing dynamics and leveraging strong approximations for Poisson processes. As a result, the fluid and diffusion limit theorems illuminate how the dependence structure of the arrival or service processes can affect the sample path behavior of the queueing process. Finally, our Poisson representation for MAPs and MSPs is useful for simulation purposes and may be of independent interest.     

The convex hull of a dependent vector-valued process

An important problem in the study of animal behaviour is the determination of home range. This set can be estimated by the convex hull of the location of an animal at successive time points. However, this estimate is based on a sample of highly dependent observations when the time intervals between fixes are small. In this paper we quantify the effect of dependence on various properties of the convex hull of several dependent point processes in the plane using Monte-Carlo methods. We compare our results with the independent case and make some comments on the asymptotic behaviour of this set.     

Measuring density dependence in survival from mark-recapture data

We discuss the analysis of mark-recapture data when the aim is to quantify density dependence between survival rate and abundance. We describe an analysis for a random effects model that includes a linear relationship between abundance and survival using an errors-in-variables regression estimator with analytical adjustment for approximate bias. The analysis is illustrated using data from short-tailed shearwaters banded for 48 consecutive years at Fisher Island, Tasmania, and Hutton's shearwater banded at Kaikoura, New Zealand for nine consecutive years. The Fisher Island data provided no evidence of a density dependence relationship between abundance and survival, and confidence interval widths rule out anything but small density dependent effects. The Hutton's shearwater data were equivocal with the analysis unable to rule out anything but a very strong density dependent relationship between survival and abundance.     

The identifiability of the mixed proportional hazards competing risks model

Summary. We prove identification of dependent competing risks models in which each risk has a mixed proportional hazard specification with regressors, and the risks are dependent by way of the unobserved heterogeneity, or frailty, components. We show that the conditions for identification given by Heckman and Honoré can be relaxed. We extend the results to the case in which multiple spells are observed for each subject.     

Asymptotic Behaviors of the Lorenz Curve for Censored Data Under Strong Mixing

In this article, we consider a nonparametric estimator of the Lorenz curve under censored dependent model. We show that this estimator is uniformly strongly consistent for the associated Lorenz curve. Also, a strong Gaussian approximation for the associated Lorenz process are established under appropriate assumptions. A law of the iterated logarithm for the Lorenz process is also derived.     

Flexible Bivariate Count Data Regression Models

The article develops a semiparametric estimation method for the bivariate count data regression model. We develop a series expansion approach in which dependence between count variables is introduced by means of stochastically related unobserved heterogeneity components, and in which, unlike existing commonly used models, positive as well as negative correlations are allowed. Extensions that accommodate excess zeros, censored data, and multivariate generalizations are also given. Monte Carlo experiments and an empirical application to tobacco use confirms that the model performs well relative to existing bivariate models, in terms of various statistical criteria and in capturing the range of correlation among dependent variables. This article has supplementary materials online.     

Asymptotic properties of nonparametric M-estimation for mixing functional data

We investigate the asymptotic behavior of a nonparametric M-estimator of a regression function for stationary dependent processes, where the explanatory variables take values in some abstract functional space. Under some regularity conditions, we give the weak and strong consistency of the estimator as well as its asymptotic normality. We also give two examples of functional processes that satisfy the mixing conditions assumed in this paper. Furthermore, a simulated example is presented to examine the finite sample performance of the proposed estimator.     

Convergence properties for weighted sums of NSD random variables

Abstract

Let {X_n, n ? 1} be a sequence of negatively superadditive dependent (NSD, in short) random variables and {b_ni, 1 ? i ? n, n ? 1} be an array of real numbers. In this article, we study the strong law of large numbers for the weighted sums ∑ⁿ_{i = 1}b_niX_i without identical distribution. We present some sufficient conditions to prove the strong law of large numbers. As an application, the Marcinkiewicz-Zygmund strong law of large numbers for NSD random variables is obtained. In addition, the complete convergence for the weighted sums of NSD random variables is established. Our results generalize and improve some corresponding ones for independent random variables and negatively associated random variables.