Empirical likelihood for heteroscedastic partially linear errors-in-variables model with α-mixing errors

In this paper, we apply the empirical likelihood method to heteroscedastic partially linear errors-in-variables model. For the cases of known and unknown error variances, the two different empirical log-likelihood ratios for the parameter of interest are constructed. If the error variances are known, the empirical log-likelihood ratio is proved to be asymptotic chi-square distribution under the assumption that the errors are given by a sequence of stationary α-mixing random variables. Furthermore, if the error variances are unknown, we show that the proposed statistic is asymptotically standard chi-square distribution when the errors are independent. Simulations are carried out to assess the performance of the proposed method.     

Asymptotic properties for LS estimators in EV regression model with dependent errors

In this paper, we establish the strong consistency and asymptotic normality for the least square (LS) estimators in simple linear errors-in-variables (EV) regression models when the errors form a stationary α-mixing sequence of random variables. The quadratic-mean consistency is also considered.     

Asymptotic normality for the estimator of non parametric regression model under ϕ-mixing errors

In this article, by using the Rosenthal-type inequality and the Bernstein's big-block and small-block procedure, we establish the asymptotic normality for the estimators of non parametric regression model based on ?-mixing errors. The result obtained in the article generalizes some corresponding ones for some dependent random variables.     

On the rate of convergence of the Robbins–Monro's algorithm in a linear stochastic ill-posed problem with α-mixing data

In this paper we consider a recursive method of Robbins–Monro type to estimate the solution of the linear problem Ax = u, in which the second member is measured with α-mixing errors. We also show the almost complete convergence (a.co) of this algorithm specifying its convergence rate.     

Admissibility for linear estimators of regression coefficient in a general Gauss–Markoff model under balanced loss function

A generalization of Zellner's balanced loss function is proposed according to unified theory of least squares under a general Gauss–Markoff model. Admissibility of linear estimators is investigated under the balanced loss function. And necessary and sufficient conditions that linear estimators are admissible in a class of homogeneous and nonhomogeneous linear estimators are obtained, respectively.     

r − k Class estimator in the linear regression model with correlated errors

Autocorrelation in errors and multicollinearity among the regressors are serious problems in regression analysis. The aim of this paper is to examine multicollinearity and autocorrelation problems concurrently and to compare the r ? k class estimator to the generalized least squares estimator, the principal components regression estimator and the ridge regression estimator by the scalar and matrix mean square error criteria in the linear regression model with correlated errors.     

Asymptotic normality of Huber–Dutter estimators in a linear model with AR(1) processes

The paper studies a linear regression model with first order autoregressive (AR(1)) processes. The Huber–Dutter (HD) estimators of unknown parameters are given, and the asymptotic normality of the HD estimators is investigated. An example is presented to illustrate the proposed method.     

On risk comparisons of some estimators in a linear regression model under inagaki’S loss function and nonnormal error terms

In this paper we consider the risk performances of some estimators for both location and scale parameters in a linear regression model under Inagaki’s loss function We prove that the pre-test estimator for location parameter is dominated by the Stein-rule estimator under Inagaki’s loss function when the distribution of error terms is expressed by the scale mixture of normal distribution and the variance of error terms is unknown.. It is an extension of the results in Nagata (1983) to our situation Also we perform numerical calculations to draw the shapes of the risks.     

Optimality of quasi-score in the multivariate mean–variance model with an application to the zero-inflated Poisson model with measurement errors

In a multivariate mean–variance model, the class of linear score (LS) estimators based on an unbiased linear estimating function is introduced. A special member of this class is the (extended) quasi-score (QS) estimator. It is ‘extended’ in the sense that it comprises the parameters describing the distribution of the regressor variables. It is shown that QS is (asymptotically) most efficient within the class of LS estimators. An application is the multivariate measurement error model, where the parameters describing the regressor distribution are nuisance parameters. A special case is the zero-inflated Poisson model with measurement errors, which can be treated within this framework.     

Weak convergence for the conditional distribution function in a Koziol–Green model under dependent censoring

In this paper we consider the conditional Koziol–Green model of Braekers and Veraverbeke [2008. A conditional Koziol–Green model under dependent censoring. Statist. Probab. Lett., accepted for publication] in which they generalized the Koziol–Green model of Veraverbeke and Cadarso Suárez [2000. Estimation of the conditional distribution in a conditional Koziol–Green model. Test 9, 97–122] by assuming that the association between a censoring time and a time until an event is described by a known Archimedean copula function. They got in this way, an informative censoring model with two different types of informative censoring. Braekers and Veraverbeke [2008. A conditional Koziol–Green model under dependent censoring. Statist. Probab. Lett., accepted for publication] derived in this model a non-parametric Koziol–Green estimator for the conditional distribution function of the time until an event, for which they showed the uniform consistency and the asymptotic normality. In this paper we extend their results and prove the weak convergence of the process associated to this estimator. Furthermore we show that the conditional Koziol–Green estimator is asymptotically more efficient in this model than the general copula-graphic estimator of Braekers and Veraverbeke [2005. A copula-graphic estimator for the conditional survival function under dependent censoring. Canad. J. Statist. 33, 429–447]. As last result, we construct an asymptotic confidence band for the conditional Koziol–Green estimator. Through a simulation study, we investigate the small sample properties of this asymptotic confidence band. Afterwards we apply this estimator and its confidence band on a practical data set.     

Consistency of the Tikhonov’s regularization in an ill-posed problem with α-mixing random data

In this article, we establish exponential inequalities for the probability of the distance between the approximated solution and the exact one for an operator equation with an exact right-hand side. In addition, the second member of the operator equation is observed with α-mixing random errors. These inequalities yield the almost complete convergence of the approximate solution.     

The small sample performance of some limited information estimators of a dynamic structural equation with autocorrelated errors †

This paper examines the small sample properties of the following seven estimators of a dynamic structural equation with autocorrelated errors: (1) 2SLS; (2) Fair’s modification of Sargan’s 2SLS; (3) the Dhrymes, Berner and Cummins (1974) variant of 2SLS; (4) a modified Theil's (1958) generalized 2SLS; (5) three two-step estimators proposed by Hatanaka (1976). Our principal results are that for low degrees of autocorrelation 2SLS performs well whereas for high degrees of autocorrelation the Theil and Dhrymes estimators are best with two of Hatanaka’s estimators close behind. The Fair and the remaining Hatanaka estimator are always dominated by the others. This is of some practical interest because the Fair estimator is a standard option in some software packages.     

The almost sure convergence rate of the estimator of optimized certainty equivalent risk measure under α-mixing sequences

Conditional value-at-risk (CVaR) model is a kind of financial risk measure that is extensively supported and accepted by international financial community. Its optimized form can be regarded as an optimized certainty equivalent (OCE) risk measurement. In this paper, we mainly discuss and analyze the strong laws of large numbers and the convergence rate of OCE's estimator under α-mixing sequences. The result shows that the almost sure convergence rate of CVaR estimator is given by the results of OCE estimator. Its convergence rate is inversely proportional to the square root of the sample size under certain conditions. Its effectiveness is verified by simulation experiments for two classical α-mixing sequences.     

A class of chain ratio–product type estimators with two auxiliary variables under double sampling scheme

In this paper, a chain ratio–product type estimators has been developed for estimating population mean of the study variable using two auxiliary variables under double sampling scheme, when the information on another additional auxiliary character is available along with the main auxiliary character. The optimum property of the proposed strategy has been identified in two different cases with their variances. Theoretical and empirical studies have been done to demonstrate the efficiency of the proposed estimator over other estimators, which utilized the information on two auxiliary characteristics.     

Bayesian nonparametric modelling of the link function in the single-index model using a Bernstein–Dirichlet process prior

This paper proposes the use of the Bernstein–Dirichlet process prior for a new nonparametric approach to estimating the link function in the single-index model (SIM). The Bernstein–Dirichlet process prior has so far mainly been used for nonparametric density estimation. Here we modify this approach to allow for an approximation of the unknown link function. Instead of the usual Gaussian distribution, the error term is assumed to be asymmetric Laplace distributed which increases the flexibility and robustness of the SIM. To automatically identify truly active predictors, spike-and-slab priors are used for Bayesian variable selection. Posterior computations are performed via a Metropolis-Hastings-within-Gibbs sampler using a truncation-based algorithm for stick-breaking priors. We compare the efficiency of the proposed approach with well-established techniques in an extensive simulation study and illustrate its practical performance by an application to nonparametric modelling of the power consumption in a sewage treatment plant.     

A note on a transient queuing system of a linear birth–immigration process in presence of twin births

In this article, we consider a simple transient queuing system, i.e., a linear birth process with immigration in the presence of twin births. We find the differential-difference equation and also the probability-generating function (p.g.f.) for this process. Again, we generalize it into a linear birth process with immigration in the presence of both single birth or twin births and again for the case of multiple births. From the p.g.f. of linear birth process with immigration in the presence of twin births, we find some particular transient queuing processes like linear birth process with twin births and simple immigration process. Direct derivations of mean and variance of these processes are also discussed without using the generating functions.     

On the integrated maximum likelihood estimators for a closed population capture–recapture model with unequal capture probabilities

Nuisance parameter elimination is a central problem in capture–recapture modelling. In this paper, we consider a closed population capture–recapture model which assumes the capture probabilities varies only with the sampling occasions. In this model, the capture probabilities are regarded as nuisance parameters and the unknown number of individuals is the parameter of interest. In order to eliminate the nuisance parameters, the likelihood function is integrated with respect to a weight function (uniform and Jeffrey's) of the nuisance parameters resulting in an integrated likelihood function depending only on the population size. For these integrated likelihood functions, analytical expressions for the maximum likelihood estimates are obtained and it is proved that they are always finite and unique. Variance estimates of the proposed estimators are obtained via a parametric bootstrap resampling procedure. The proposed methods are illustrated on a real data set and their frequentist properties are assessed by means of a simulation study.     

Optimality of the quasi-score estimator in a mean–variance model with applications to measurement error models

We consider a regression of y$y$ on x$x$ given by a pair of mean and variance functions with a parameter vector θ$\theta$ to be estimated that also appears in the distribution of the regressor variable x$x$. The estimation of θ$\theta$ is based on an extended quasi-score (QS) function. We show that the QS estimator is optimal within a wide class of estimators based on linear-in-y$y$ unbiased estimating functions. Of special interest is the case where the distribution of x$x$ depends only on a subvector α$\alpha$ of θ$\theta$, which may be considered a nuisance parameter. In general, α$\alpha$ must be estimated simultaneously together with the rest of θ$\theta$, but there are cases where α$\alpha$ can be pre-estimated. A major application of this model is the classical measurement error model, where the corrected score (CS) estimator is an alternative to the QS estimator. We derive conditions under which the QS estimator is strictly more efficient than the CS estimator.