Locally asymptotically optimal tests for AR(p) against diagonal bilinear dependence

The problem of testing linear AR(p1) against diagonal bilinear BL(p1, 0; p2, p2) dependence is considered. Emphasis is put on local asymptotic optimality and the nonspecification of innovation densities. The tests we are deriving are asymptotically valid under a large class of densities, and locally asymptotically most stringent at some selected density f. They rely on generalized versions of residual autocorrelations (the spectrum), and generalized versions of the so-called cubic autocorrelations (the bispectrum). Local powers are explicitly provided. The local power of the Gaussian Lagrange multipliers method follows as a particular case.     

Sample quantiles and additive statistics: Information,sufficiency, estimation

The order of the increase in the Fisher information measure contained in a finite number k of additive statistics or sample quantiles, constructed from a sample of size n, as n → ∞, is investigated. It is shown that the Fisher information in additive statistics increases asymptotically in a manner linear with respect to n, if 2 + δ moments of additive statistics exist for some δ > 0. If this condition does not hold, the order of increase in this information is non-linear and the information may even decrease. The problem of asymptotic sufficiency of sample quantiles is investigated and some linear analogues of maximum likelihood equations are constructed.     

On the ABLUE of the normal mean from a censored sample

The asymptotically best linear unbiased estimate (ABLUE) of the normal mean is discussed. The estimate is based on k selected order statistics chosen from a singly or doubly censored large sample of size n(>k). The coefficients, the asymptotic relative efficiency of the estimate, and the optimum spacing of k real numbers between 0 and 1 which determines the optimum ranks of order statistics, are provided. A comparison between the ABLUE and the iterated maximum likelihood estimate is made.     

M-estimation in regression models for censored data

In this paper, we study M-estimators of regression parameters in semiparametric linear models for censored data. A class of consistent and asymptotically normal M-estimators is constructed. A resampling method is developed for the estimation of the asymptotic covariance matrix of the estimators.     

Optimal weighted two-sample t-test with partially paired data in a unified framework

In this paper, we provide a unified framework for two-sample t-test with partially paired data. We show that many existing two-sample t-tests with partially paired data can be viewed as special members in our unified framework. Some shortcomings of these t-tests are discussed. We also propose the asymptotically optimal weighted linear combination of the test statistics comparing all four paired and unpaired data sets. Simulation studies are used to illustrate the performance of our proposed asymptotically optimal weighted combinations of test statistics and compare with some existing methods. It is found that our proposed test statistic is generally more powerful. Three real data sets about CD4 count, DNA extraction concentrations, and the quality of sleep are also analyzed by using our newly introduced test statistic.     

Nonparametric estimation of linear functionals of a bivariate distribution under univariate censoring

In the presence of univariate censoring, a class of nonparametric estimators is proposed for linear functionals of a bivariate distribution of paired failure times. The estimators are shown to be root-n consistent and asymptotically normal. An adjusted empirical log-likelihood ratio statistic is developed and proved to follow a chi-square distribution asymptotically. Two types of confidence intervals, based on the normal approximation method and the empirical likelihood method, respectively, are constructed to make inference about the linear functionals. Their performance is evaluated in several simulation studies and a real example.     

Adaptation over parametric families of symmetric linear estimators

This paper treats an abstract parametric family of symmetric linear estimators for the mean vector of a standard linear model. The estimator in this family that has smallest estimated quadratic risk is shown to attain, asymptotically, the smallest risk achievable over all candidate estimators in the family. The asymptotic analysis is carried out under a strong Gauss–Markov form of the linear model in which the dimension of the regression space tends to infinity. Leading examples to which the results apply include: (a) penalized least squares fits constrained by multiple, weighted, quadratic penalties; and (b) running, symmetrically weighted, means. In both instances, the weights define a parameter vector whose natural domain is a continuum.     

Robust slippage rank tests for k location parameters in the presence of gross errors

A robust slippage test problem of k location parameters in the presence of gross errors is formulated from the point of view of Huber's robust test theory. Under an asymptotic model of the robust slippage test problem an asymptotic level α slippage rank test based on k linear rank statistics is constructed by applying majorization methods and its asymptotic minimum power is evaluated by applying weak majorization methods. It is also shown that the slippage rank test is asymptotically unbiased.     

Statistical inferences for partially linear single-index models with error-prone linear covariates

We consider statistical inference for partially linear single-index models (PLSIM) when some linear covariates are not observed, but ancillary variables are available. Based on the profile least-squared estimators of the unknowns, we study the testing problems for parametric components in the proposed models. It is to see whether the generalized likelihood ratio (GLR) tests proposed by Fan et al. (2001) are applicable to testing for the parametric components. We show that under the null hypothesis the proposed GLR statistics follow asymptotically the χ²-distributions with the scale constants and the degrees of freedom being independent of the nuisance parameters or functions, which is called the Wilks phenomenon. Simulated experiments are conducted to illustrate our proposed methodology.     

Second order asymptotic and non-asymptotic optimality properties of combined tests

Let p independent test statistics be available to test a null hypothesis concerned with the same parameter. The p are assumed to be similar tests. Asymptotic and non-asymptotic optimality properties of combined tests are studied. The asymptotic study centers around two notions. The first is Bahadur efficiency. The second is based on a notion of second order comparisons. The non-asymptotic study is concerned with admissibility questions. Most of the popular combining methods are considered along with a method not studied in the past. Among the results are the following: Assume each of the p statistics has the same Bahadur slope. Then the combined test based on the sum of normal transforms, is asymptotically best among all tests studied, by virtue of second order considerations. Most of the popular combined tests are inadmissible for testing the noncentrality parameter of chi-square, t, and F distributions. For chi-square a combined test is offered which is admissible, asymptotically optimal (first order), asymptotically optimal (second order) among all tests studied, and for which critical values are obtainable in special cases. Extensions of the basic model are given.     

Estimating the p-values of robust tests for the linear model

In this paper, we study the estimation of p-values for robust tests for the linear regression model. The asymptotic distribution of these tests has only been studied under the restrictive assumption of errors with known scale or symmetric distribution. Since these robust tests are based on robust regression estimates, Efron's bootstrap (1979) presents a number of problems. In particular, it is computationally very expensive, and it is not resistant to outliers in the data. In other words, the tails of the bootstrap distribution estimates obtained by re-sampling the data may be severely affected by outliers.We show how to adapt the Robust Bootstrap (Ann. Statist 30 (2002) 556; Bootstrapping MM-estimators for linear regression with fixed designs, http://mathstat.carleton.ca/~matias/pubs.html) to this problem. This method is very fast to compute, resistant to outliers in the data, and asymptotically correct under weak regularity assumptions. In this paper, we show that the Robust Bootstrap can be used to obtain asymptotically correct, computationally simple p-value estimates. A simulation study indicates that the tests whose p-values are estimated with the Robust Bootstrap have better finite sample significance levels than those obtained from the asymptotic theory based on the symmetry assumption.Although this paper is focussed on robust scores-type tests (in: Directions in Robust Statistics and Diagnostics, Part I, Springer, New York), our approach can be applied to other robust tests (for example, Wald- and dispersion-type also discussed in Markatou et al., 1991).     

Extremal memory of stochastic volatility with an application to tail shape inference

We characterize joint tails and tail dependence for a class of stochastic volatility processes. We derive the exact joint tail shape of multivariate stochastic volatility with innovations that have a regularly varying distribution tail. This is used to give four new characterizations of tail dependence. In three cases tail dependence is a non-trivial function of linear volatility memory parametrically represented by tail scales, while tail power indices do not provide any relevant dependence information. Although tail dependence is associated with linear volatility memory, tail dependence itself is nonlinear. In the fourth case a linear function of tail events and exceedances is linearly independent. Tail dependence falls in a class that implies the celebrated Hill (1975) tail index estimator is asymptotically normal, while linear independence of nonlinear tail arrays ensures the asymptotic variance is the same as the iid case. We illustrate the latter finding by simulation.     

Weighted local linear composite quantile estimation for the case of general error distributions

It is known that for nonparametric regression, local linear composite quantile regression (local linear CQR) is a more competitive technique than classical local linear regression since it can significantly improve estimation efficiency under a class of non-normal and symmetric error distributions. However, this method only applies to symmetric errors because, without symmetric condition, the estimation bias is non-negligible and therefore the resulting estimator is inconsistent. In this paper, we propose a weighted local linear CQR method for general error conditions. This method applies to both symmetric and asymmetric random errors. Because of the use of weights, the estimation bias is eliminated asymptotically and the asymptotic normality is established. Furthermore, by minimizing asymptotic variance, the optimal weights are computed and consequently the optimal estimate (the most efficient estimate) is obtained. By comparing relative efficiency theoretically or numerically, we can ensure that the new estimation outperforms the local linear CQR estimation. Finite sample behaviors conducted by simulation studies further illustrate the theoretical findings.     

Asymptotically optimum estimation of a probability in inverse binomial sampling under general loss functions

The optimum quality that can be asymptotically achieved in the estimation of a probability p using inverse binomial sampling is addressed. A general definition of quality is used in terms of the risk associated with a loss function that satisfies certain assumptions. It is shown that the limit superior of the risk for p asymptotically small has a minimum over all (possibly randomized) estimators. This minimum is achieved by certain non-randomized estimators. The model includes commonly used quality criteria as particular cases. Applications to the non-asymptotic regime are discussed considering specific loss functions, for which minimax estimators are derived.     

On nonparametric profile analysis of several multivariate samples

A unified development is offered for asymptotically distribution-free profile analysis of several multivariate samples. This includes as special cases procedures based on generalized U-statistics and also those based on linear rank statistics. Furthermore, it includes as special cases analysis of location profiles and also scalar profiles. Finally, asymptotic power and consistency properties are discussed for tests of hypotheses and subhypotheses of interest.     

Consistency and asymptotic unbiasedness of S2 in the serially correlated error components regression model for panel data

TheOLS-estimator of the disturbance variance in the linear regression model for panel data is shown to be asymptotically unbiased and weakly consistent when the disturbances follow an error component model with serially correlated time effects.     

Rank-order tests for the parallelism of several regression surfaces

For testing the hypothesis that several (s?2) linear regression surfaces X_ki=α_k+β_kc_ki+Z_ki (k=1,…,s) are parallel to one another, i.e., β₁=?=β_s, a class of rank-order tests are considered. The tests are shown to be asymptotically distribution-free, and their asymptotic efficiency relative to the general likelihood ratio test is derived. Asymptotic optimality in the sense of Wald is also discussed.     

Bayes sequential estimation for a Poisson process under a LINEX loss function

In this paper, within the framework of a Bayesian model, we consider the problem of sequentially estimating the intensity parameter of a homogeneous Poisson process with a linear exponential (LINEX) loss function and a fixed cost per unit time. An asymptotically pointwise optimal (APO) rule is proposed. It is shown to be asymptotically optimal for the arbitrary priors and asymptotically non-deficient for the conjugate priors in a similar sense of Bickel and Yahav [Asymptotically pointwise optimal procedures in sequential analysis, in Proceedings of the Fifth Berkeley Symposium on Mathematical Statistics and Probability, Vol. 1, University of California Press, Berkeley, CA, 1967, pp. 401–413; Asymptotically optimal Bayes and minimax procedures in sequential estimation, Ann. Math. Statist. 39 (1968), pp. 442–456] and Woodroofe [A.P.O. rules are asymptotically non-deficient for estimation with squared error loss, Z. Wahrsch. verw. Gebiete 58 (1981), pp. 331–341], respectively. The proposed APO rule is illustrated using a real data set.     

Empirical Likelihood for Linear Models Under Linear Process Errors

In this article, we study the construction of confidence intervals for regression parameters in a linear model under linear process errors by using the blockwise technique. It is shown that the blockwise empirical likelihood (EL) ratio statistic is asymptotically χ²-type distributed. The result is used to obtain EL based confidence regions for regression parameters. The finite-sample performance of the method is evaluated through a simulation study.     

Flexible mixture modelling using the multivariate skew-t-normal distribution

This paper presents a robust probabilistic mixture model based on the multivariate skew-t-normal distribution, a skew extension of the multivariate Student’s t distribution with more powerful abilities in modelling data whose distribution seriously deviates from normality. The proposed model includes mixtures of normal, t and skew-normal distributions as special cases and provides a flexible alternative to recently proposed skew t mixtures. We develop two analytically tractable EM-type algorithms for computing maximum likelihood estimates of model parameters in which the skewness parameters and degrees of freedom are asymptotically uncorrelated. Standard errors for the parameter estimates can be obtained via a general information-based method. We also present a procedure of merging mixture components to automatically identify the number of clusters by fitting piecewise linear regression to the rescaled entropy plot. The effectiveness and performance of the proposed methodology are illustrated by two real-life examples.