Single-pass low-storage arbitrary quantile estimation for massive datasets

We present a single-pass, low-storage, sequential method for estimating an arbitrary quantile of an unknown distribution. The proposed method performs very well when compared to existing methods for estimating the median as well as arbitrary quantiles for a wide range of densities. In addition to explaining the method and presenting the results of the simulation study, we discuss intuition behind the method and demonstrate empirically, for certain densities, that the proposed estimator converges to the sample quantile.     

Nonparametric estimation of mean residual quantile function under right censoring

In this paper, we develop non-parametric estimation of the mean residual quantile function based on right-censored data. Two non-parametric estimators, one based on the empirical quantile function and the other using the kernel smoothing method, are proposed. Asymptotic properties of the estimators are discussed. Monte Carlo simulation studies are conducted to compare the two estimators. The method is illustrated with the aid of two real data sets.     

Semiparametric estimation of employment duration models

There are a variety of economic areas, such as studies of employment duration and of the durability of capital goods, in which data on important variables typically are censored. The standard techinques for estimating a model from censored data require the distributions of unobservable random components of the model to be specified a priori up to a finite set of parameters, and misspecification of these distributions usually leads to inconsistent parameter estimates. However, economic theory rarely gives guidance about distributions and the standard estimation techniques do not provide convenient methods for identifying distributions from censored data. Recently, several distribution-free or semiparametric methods for estimating censored regression models have been developed. This paper presents the results of using two such methods to estimate a model of employment duration. The paper reports the operating characteristics of the semiparametric estimators and compares the semiparametric estimates with those obtained from a standard parametric model.     

Improving extreme quantile estimation via a folding procedure

In many applications (geosciences, insurance, etc.), the peaks-over-thresholds (POT) approach is one of the most widely used methodology for extreme quantile inference. It mainly consists of approximating the distribution of exceedances above a high threshold by a generalized Pareto distribution (GPD). The number of exceedances which is used in the POT inference is often quite small and this leads typically to a high volatility of the estimates. Inspired by perfect sampling techniques used in simulation studies, we define a folding procedure that connects the lower and upper parts of a distribution. A new extreme quantile estimator motivated by this theoretical folding scheme is proposed and studied. Although the asymptotic behaviour of our new estimate is the same as the classical (non-folded) one, our folding procedure reduces significantly the mean squared error of the extreme quantile estimates for small and moderate samples. This is illustrated in the simulation study. We also apply our method to an insurance dataset.     

Multiple-output quantile regression through optimal quantization

A new nonparametric quantile regression method based on the concept of optimal quantization was developed recently and was showed to provide estimators that often dominate their classical, kernel-type, competitors. In the present work, we extend this method to multiple-output regression problems. We show how quantization allows approximating population multiple-output regression quantiles based on halfspace depth. We prove that this approximation becomes arbitrarily accurate as the size of the quantization grid goes to infinity. We also derive a weak consistency result for a sample version of the proposed regression quantiles. Through simulations, we compare the performances of our estimators with (local constant and local bilinear) kernel competitors. The results reveal that the proposed quantization-based estimators, which are local constant in nature, outperform their kernel counterparts and even often dominate their local bilinear kernel competitors. The various approaches are also compared on artificial and real data.     

A modified kernel quantile estimator under censoring

Based on right-censored data from a lifetime distribution F₀, a modification of the kernel quantile estimator is proposed. The advantage of this estimator is that the data play a role in the degree of smoothing of the estimator while retaining the desirable features of the kernel estimator. Convergence in probability and almost sure convergence of the estimator are discussed. Also, asymptotic normality and confidence bands are presented and some examples are given.     

Modified check loss for efficient estimation via model selection in quantile regression

The check loss function is used to define quantile regression. In cross-validation, it is also employed as a validation function when the true distribution is unknown. However, our empirical study indicates that validation with the check loss often leads to overfitting the data. In this work, we suggest a modified or L2-adjusted check loss which rounds the sharp corner in the middle of check loss. This has the effect of guarding against overfitting to some extent. The adjustment is devised to shrink to zero as sample size grows. Through various simulation settings of linear and nonlinear regressions, the improvement due to modification of the check loss by quadratic adjustment is examined empirically.     

Subsampling quantile estimators and uniformity criteria

Several asymptotically equivalent quantile estimators recently have been proposed as alternative to the conventional sample quantile. A variety of weight functions have been obtained either by subsampling considerations or by a kernel approach, analogous to density estimation techniques. Focusing on the former approach, a unified treatment of quantile estimators derived by subsampling is developed. Closely related to the generalized Harrell-Davis (HD) and Kaigh-Lachenbruch (KL) estimators, a new statistic performed well in Monte Carlo effiency comparisons presented here. Moreover, the new estimator shares certain desirable computational and finite-sample theeoretical properties with the KL estimator to yield convenient components representations for tests of uniformity and goodness-of-fit criteria. Similar analytic treatment for the HD statistics and kernel quantile estimators, however, is precluded by intractable eigenvalue problems.     

A target distribution model for nonparametric density estimation

In this paper a model is proposed which represents a wide class of continuous distributions. It is shown how the parameters of this model can be estimated leading to a distribution estimator and a corresponding density estimator. An important property of this estimator is that it can be structured to reflect a priori knowledge of the unknown distribution.

Finally, some examples are shown and some comparisons made with kernel and orthogonal series estimators.     

Composite kernel quantile regression

The composite quantile regression (CQR) has been developed for the robust and efficient estimation of regression coefficients in a liner regression model. By employing the idea of the CQR, we propose a new regression method, called composite kernel quantile regression (CKQR), which uses the sum of multiple check functions as a loss in reproducing kernel Hilbert spaces for the robust estimation of a nonlinear regression function. The numerical results demonstrate the usefulness of the proposed CKQR in estimating both conditional nonlinear mean and quantile functions.     

Local composite quantile regression estimation of time-varying parameter vector for multidimensional time-inhomogeneous diffusion models

This paper is dedicated to the study of the composite quantile regression (CQR) estimations of time-varying parameter vectors for multidimensional diffusion models. Based on the local linear fitting for parameter vectors, we propose the local linear CQR estimations of the drift parameter vectors, and verify their asymptotic biases, asymptotic variances and asymptotic normality. Moreover, we discuss the asymptotic relative efficiency (ARE) of the local linear CQR estimations with respect to the local linear least-squares estimations. We obtain that the local estimations that we proposed are much more efficient than the local linear least-squares estimations. Simulation studies are constructed to show the performance of the estimations proposed.     

A robust test of exogeneity based on quantile regressions

In this paper, we propose a robust test of exogeneity. The test statistics is constructed from quantile regression estimators, which are robust to heavy tails of errors. We derive the asymptotic distribution of the test statistic under the null hypothesis of exogeneity at a given quantile. The finite sample properties of the test are investigated through Monte Carlo simulations that exhibit not only good size and power properties, but also good robustness to outliers.     

A finite population quantile estimation by unequal probability sampling

Abstract

Using a model-assisted approach, this paper studies asymptotically design-unbiased (ADU) estimation of a population “distribution function” and extends to deriving an asymptotic and approximate unbiased estimator for a population quantile from a sample chosen with varying probabilities. The respective asymptotic standard errors and confidence intervals are then worked out. Numerical findings based on an actual data support the theory with efficient results.     

B-spline estimation for partially linear varying coefficient composite quantile regression models

Abstract

In this article, a new composite quantile regression estimation (CQR) approach is proposed for partially linear varying coefficient models (PLVCM) under composite quantile loss function with B-spline approximations. The major advantage of the proposed procedures over the existing ones is easy to implement using existing software, and it requires no specification of the error distributions. Under the regularity conditions, the consistency and asymptotic normality of the estimators are also derived. Finally, a simulation study and a real data application are undertaken to assess the finite sample performance of the proposed estimation procedure.     

A matching prior for extreme quantile estimation of the generalized Pareto distribution

Extreme quantile estimation plays an important role in risk management and environmental statistics among other applications. A popular method is the peaks-over-threshold (POT) model that approximate the distribution of excesses over a high threshold through generalized Pareto distribution (GPD). Motivated by a practical financial risk management problem, we look for an appropriate prior choice for Bayesian estimation of the GPD parameters that results in better quantile estimation. Specifically, we propose a noninformative matching prior for the parameters of a GPD so that a specific quantile of the Bayesian predictive distribution matches the true quantile in the sense of Datta et al. (2000).     

A new class of boundary kernels for distribution function estimation

In this note we introduce a new class of boundary kernels for distribution function estimation which shows itself to be especially performing when the classical kernel distribution function estimator suffers from severe boundary problems.     

Improved point estimation for the Kumaraswamy distribution

We develop nearly unbiased estimators for the Kumaraswamy distribution proposed by Kumaraswamy [Generalized probability density-function for double-bounded random-processes, J. Hydrol. 46 (1980), pp. 79–88], which has considerable attention in hydrology and related areas. We derive modified maximum-likelihood estimators that are bias-free to second order. As an alternative to the analytically bias-corrected estimators discussed, we consider a bias correction mechanism based on the parametric bootstrap. We conduct Monte Carlo simulations in order to investigate the performance of the corrected estimators. The numerical results show that the bias correction scheme yields nearly unbiased estimates.     

Parameter and quantile estimation for the three-parameter lognormal distribution based on statistics invariant to unknown location

Lognormal distribution is one of the popular distributions used for modelling positively skewed data, especially those encountered in economic and financial data. In this paper, we propose an efficient method for the estimation of parameters and quantiles of the three-parameter lognormal distribution, which avoids the problem of unbounded likelihood, by using statistics that are invariant to unknown location. Through a Monte Carlo simulation study, we then show that the proposed method performs well compared to other prominent methods in terms of both bias and mean-squared error. Finally, we present two illustrative examples.     

Cross-validating fit and predictive accuracy of nonlinear quantile regressions

The paper proposes a cross-validation method to address the question of specification search in a multiple nonlinear quantile regression framework. Linear parametric, spline-based partially linear and kernel-based fully nonparametric specifications are contrasted as competitors using cross-validated weighted L ₁-norm based goodness-of-fit and prediction error criteria. The aim is to provide a fair comparison with respect to estimation accuracy and/or predictive ability for different semi- and nonparametric specification paradigms. This is challenging as the model dimension cannot be estimated for all competitors and the meta-parameters such as kernel bandwidths, spline knot numbers and polynomial degrees are difficult to compare. General issues of specification comparability and automated data-driven meta-parameter selection are discussed. The proposed method further allows us to assess the balance between fit and model complexity. An extensive Monte Carlo study and an application to a well-known data set provide empirical illustration of the method.