Posterior consistency for the spectral density of non-Gaussian stationary time series

Various nonparametric approaches for Bayesian spectral density estimation of stationary time series have been suggested in the literature, mostly based on the Whittle likelihood approximation. A generalization of this approximation involving a nonparametric correction of a parametric likelihood has been proposed in the literature with a proof of posterior consistency for spectral density estimation in combination with the Bernstein–Dirichlet process prior for Gaussian time series. In this article, we will extend the posterior consistency result to non-Gaussian time series by employing a general consistency theorem for dependent data and misspecified models. As a special case, posterior consistency for the spectral density under the Whittle likelihood is also extended to non-Gaussian time series. Small sample properties of this approach are illustrated with several examples of non-Gaussian time series.     

Consistency of the GMLE with Mixed Case Interval-Censored Data

In this paper we consider an interval censorship model in which the endpoints of the censoring intervals are determined by a two stage experiment. In the first stage the value k of a random integer is selected; in the second stage the endpoints are determined by a case k interval censorship model. We prove the strong consistency in the L ₁( μ )-topology of the non-parametric maximum likelihood estimate of the underlying survival function for a measure μ which is derived from the distributions of the endpoints. This consistency result yields strong consistency for the topologies of weak convergence, pointwise convergence and uniform convergence under additional assumptions. These results improve and generalize existing ones in the literature.     

A bootstrap procedure in linear regression with nonstationary errors

In the context of linear regression with dependent and nonstationary errors, the classical moving-block bootstrap (MBB) fails to capture the nonstationarity of the errors. A new bootstrap procedure called the blocking external bootstrap (BEB) is proposed to overcome the problem. The consistency of the BEB in estimating the variance of the least-squares estimator is studied in the case of α-mixing and nonstationary sequence of errors. It is shown that the BEB only achieves partial correction if the block size is fixed. Complete consistency is achieved by the BEB when the block size is allowed to go to infinity. We also study the first-order consistency of the least squares estimator based on the BEB. A simulation study is carried out to assess the performance of the BEB versus the MBB in estimating the variance of the least-squares estimator. Finally, some open problems are discussed.     

On a problem with singularity in comparison of linear experiments

For consistency, the parameter space in the Gauss-Markov model with singular covariance matrix is usually restricted by observation vector. This restriction arises some difficulties in comparison of linear experiments. To avoid it we reduce the problem of comparison from singular to nonsingular case.     

On the Strong Consistency of M‐Estimates in Linear Models for Negatively Superadditive Dependent Errors

In this paper we discuss the strong consistency of M‐estimates of the regression parameters in a linear model with negatively superadditive dependent (NSD) random errors. The result improves the moment condition and generalises the case of independent random errors to that of NSD random errors.     

An efficient method for the estimation of multivariate moving averge models

Durbin's (1959) efficient method for the estimation of univariate moving average models is generalized to the vector case. Strong consistency and asymptotic normality of the estimator is proved. A simulation experiment is performed to illustrate the behaviour of the method in finite samples.     

Goodness of fit tests with interval censored data

Cramér–von Mises type goodness of fit tests for interval censored data case 2 are proposed based on a resampling method called the leveraged bootstrap, and their asymptotic consistency is shown. The proposed tests are computationally efficient, and in fact can be applied to other types of censored data, including right censored data, doubly censored data and (mixture of) case k interval censored data. Some simulation results and an example from AIDS research are presented.     

Estimation of a linear transformation and an associated distributional problem

A multivariate “errors in variables” regression model is proposed which generalizes a model previously considered by Gleser and Watson (1973). Maximum likelihood estimators [MLE's] for the parameters of this model are obtained, and the consistency properties of these estimators are investigated. Distribution of the MLE of the “error” variance is obtained in a simple case while the mean and the variance of the estimator are obtained in this case without appealing to the exact distribution.     

Wavelet density estimation for stratified size-biased sample

In this paper we consider the estimation of a density function on the basis of a random stratified sample from weighted distributions. We propose a linear wavelet density estimator and prove its consistency. The behavior of the proposed estimator and its smoothed versions is eventually illustrated by simulated examples and a case study involving alcohol blood level in DUI cases.     

On the consistency of rank transformed regression

Rank-transformed regression (RTR) was proposed by Iman and Conover (1979) as an alternative to isotonic regression. This paper studies the consistency of the estimate obtained by RTR and show that, in general case, the estimate is not mean-square-error (MSE) consistent. The bias of the estimate is also studied by simulation.     

Generalized least squares estimation of multivariate nonlinear models with missing data

The method of estimated generalized least squares estimation of multiple response models is extended to the randomly missing date case. This estimation procedure is computationally simply when there are many missing data but the number of distinct patterns of missing data for the response vectors is small. The consistency and asymptotic normality of the proposed estimators are established.     

Robust recursive estimation in nonlinear time series

Aase (1983) has dealt with recursive estimation in nonlinear time series of autoregressive type including its asymptotic properties. This contribution modifies the results for the case of nonlinear time series with outliers using the principle of M-estimation from robust statistics. Strong consistency of the robust recursive estimates is preserved under corresponding assumptions. Several types of such estimates are compared by means of a numerical simulation.     

Recursive procedures for multiple decisions: finite time memory and stepwise maximum likelihood procedure

A version of the multiple decsion problem is studied in which the procedure is based only on the current observation and the previous decision. A necessary and sufficient condition for inconsistency of the stepwise maximum likelihood procedure is shown to be the boundedness of the likelihood ratios. In the case of consistency the (typically slow) rate of convergence to zero of the error probabilities is determined.     

A Note on Inconsistency of NPMLE of the Distribution Function from Left Truncated and Case I Interval Censored Data

We show that under reasonable conditions the nonparametric maximum likelihood estimate (NPMLE) of the distribution function from left-truncated and case 1 interval-censored data is inconsistent, in contrast to the consistency properties of the NPMLE from only left-truncated data or only interval-censored data. However, the conditional NPMLE is shown to be consistent. Numerical examples are provided to illustrate their finite sample properties.     

An Estimate of a Change Point in Variance of Measurement Errors and Its Convergence Rate

In this article, an estimate of a change point in variance of measurement errors (ME) is given in terms of characteristic functions when the variances are known. Its modification is also given for the case that the variances are unknown. In addition, the consistency and convergence rates of the estimator and its modification are investigated. The simulation study shows that the proposed estimators perform well.     

Estimation of the characteristics of a Lévy process

We consider a Lévy process that is e.g. used in finance to model stock price developments. We want to estimate the characteristics of that process, based on historical data where we assume that we have discrete, high frequency observations. We introduce a threshold estimation method and show consistency and in the case of finite activity asymptotic normality of these estimators.     

Penalized regression models with autoregressive error terms

Penalized regression methods have recently gained enormous attention in statistics and the field of machine learning due to their ability of reducing the prediction error and identifying important variables at the same time. Numerous studies have been conducted for penalized regression, but most of them are limited to the case when the data are independently observed. In this paper, we study a variable selection problem in penalized regression models with autoregressive (AR) error terms. We consider three estimators, adaptive least absolute shrinkage and selection operator, bridge, and smoothly clipped absolute deviation, and propose a computational algorithm that enables us to select a relevant set of variables and also the order of AR error terms simultaneously. In addition, we provide their asymptotic properties such as consistency, selection consistency, and asymptotic normality. The performances of the three estimators are compared with one another using simulated and real examples.     

Asymptotics for L2-norm of ARCH innovation density estimator

In this paper we consider the asymptotic properties of the ARCH innovation density estimator. We obtain the asymptotic normality of the Bickel-Rosenblatt test statistic (based on our density estimator) under the null hypothesis, which is the same as in the case of the one sample set up (given in Bickel and Rosenblatt, 1973). We also show the strong consistency of the estimator for the true density in L2-norm.     

The strong consistency of M-estimates in linear models with extended negatively dependent errors

In this paper, we first establish the strong convergence for weighted sums of extended negatively dependent (END) random variables. Based on the strong convergence and Bernstein inequality, we obtain the strong consistency of M-estimates of the regression parameters in a linear model for END random errors under some mild moment conditions. The results generalize and improve the ones obtained in the literature to the case of END random errors.