Flexible Copula Density Estimation with Penalized Hierarchical B‐splines

The paper introduces a new method for flexible spline fitting for copula density estimation. Spline coefficients are penalized to achieve a smooth fit. To weaken the curse of dimensionality, instead of a full tensor spline basis, a reduced tensor product based on so called sparse grids (Notes Numer. Fluid Mech. Multidiscip. Des., 31, 1991, 241‐251) is used. To achieve uniform margins of the copula density, linear constraints are placed on the spline coefficients, and quadratic programming is used to fit the model. Simulations and practical examples accompany the presentation.     

Renyi Entropy Properties of Order Statistics

In this article, we discuss some properties of Renyi entropy and Renyi information of order statistics. Some bounds for Renyi entropy of order statistics are obtained. Also, we relate Renyi entropy ordering of order statistics to Renyi entropy ordering and other well known orderings of parent random variables. Then it is proved that the Renyi information between order statistics and parent random variable is distribution free, and it is shown, as expected, the distance is minimum for the median.     

On the Multivariate Two-Sample Problem Using Strong Approximations of Empirical Copula Processes

In this article, we establish optimal rates for the strong approximation of empirical copula processes in ?² by sequences of Gaussian processes. These results are applied to investigate Cramér–von Mises-type statistics.     

Estimating Quantiles of Normal Populations with a Common Mean

Suppose independent random samples are available from two normal populations with a common mean and unequal variances. Estimation of a quantile of the first population is considered with respect to the quadratic loss. Some new estimators for the quantile are proposed using some previously known estimators of a common mean. Inadmissibility results are proved for estimators which are equivariant under affine and location groups of transformations. Risk values of various estimators of a quantile are compared numerically using a detailed simulation study.     

Adjusted Hazard Rate Estimator Based on a Known Censoring Probability

In most reliability studies involving censoring, one assumes that censoring probabilities are unknown. We derive a nonparametric estimator for the survival function when information regarding censoring frequency is available. The estimator is constructed by adjusting the Nelson–Aalen estimator to incorporate censoring information. Our results indicate significant improvements can be achieved if available information regarding censoring is used. We compare this model to the Koziol–Green model, which is also based on a form of proportional hazards for the lifetime and censoring distributions. Two examples of survival data help to illustrate the differences in the estimation techniques.     

On Nonparametric Estimation of a Reliability Function

This article considers the properties of a nonparametric estimator developed for a reliability function which is used in many reliability problems. Properties such as asymptotic unbiasedness and consistency are proven for the estimator and using U-statistics, weak convergence of the estimator to a normal distribution is shown. Finally, numerical examples based on an extensive simulation study are presented to illustrate the theory and compare the estimator developed in this article with another based directly on the ratio of two empirical distributions studied in Zardasht and Asadi (2010 Zardasht , V. , Asadi , M. ( 2010 ). Evaluation of P(X _t  > Y _t ) when both X _t and Y _t are residual lifetimes of two systems . Statistica Neerlandica 64 : 460 – 481 .[Crossref], [Web of Science ®] , [Google Scholar]).     

Nonnested Testing for Competing Autoregressive Dynamic Models Estimated by Instrumental Variables

In this work we investigate nonnested tests for two competing univariate dynamic linear models with autoregressive disturbances, where the motivation for instrumental variable estimation is mainly due to the recognized presence of current endogenous variables in the regression function, either in one or both models. As the previous transformation of both models yields regression functions which are nonlinear in the parameters, the attractive Gauss-Newton regression (GNR) approach, firstly advocated by Davidson and Mackinnon (1981 Davidson , R. , Mackinnon , J. G. ( 1981 ). Several tests for model specification in the presence of alternative hypotheses . Econometrica 49 : 781 – 93 .[Crossref], [Web of Science ®] , [Google Scholar]), will be used to obtain the results.     

On the Bias of the Maximum Likelihood Estimator for the Two-Parameter Lomax Distribution

The Lomax (Pareto II) distribution has found wide application in a variety of fields. We analyze the second-order bias of the maximum likelihood estimators of its parameters for finite sample sizes, and show that this bias is positive. We derive an analytic bias correction which reduces the percentage bias of these estimators by one or two orders of magnitude, while simultaneously reducing relative mean squared error. Our simulations show that this performance is very similar to that of a parametric bootstrap correction based on a linear bias function. Three examples with actual data illustrate the application of our bias correction.     

A Bivariate Generalization of Gamma Distribution

In this article, a bivariate generalisation of the gamma distribution is proposed by using an unsymmetrical bivariate characteristic function; an extension to the non central case also receives attention. The probability density functions of the product and ratio of the correlated components of this distribution are also derived. The benefits of introducing this generalized bivariate gamma distribution and the distributions of the product and the ratio of its components will be demonstrated by graphical representations of their density functions. An example of this generalized bivariate gamma distribution to rainfall data for two specific districts in the North West province is also given to illustrate the greater versatility of the new distribution.     

Kernel Density-Based Linear Regression Estimate

For linear regression models with non normally distributed errors, the least squares estimate (LSE) will lose some efficiency compared to the maximum likelihood estimate (MLE). In this article, we propose a kernel density-based regression estimate (KDRE) that is adaptive to the unknown error distribution. The key idea is to approximate the likelihood function by using a nonparametric kernel density estimate of the error density based on some initial parameter estimate. The proposed estimate is shown to be asymptotically as efficient as the oracle MLE which assumes the error density were known. In addition, we propose an EM type algorithm to maximize the estimated likelihood function and show that the KDRE can be considered as an iterated weighted least squares estimate, which provides us some insights on the adaptiveness of KDRE to the unknown error distribution. Our Monte Carlo simulation studies show that, while comparable to the traditional LSE for normal errors, the proposed estimation procedure can have substantial efficiency gain for non normal errors. Moreover, the efficiency gain can be achieved even for a small sample size.