Scale Checks in Censored Regression

Abstract. Suppose the random vector (X,Y) satisfies the regression model Y = m(X) + σ (X) ? , where m (?) and σ (?) are unknown location and scale functions and ? is independent of X. The response Y is subject to random right censoring, and the covariate X is completely observed. A new test for a specific parametric form of any scale function σ (?) (including the standard deviation function) is proposed. Its statistic is based on the distribution of the residuals obtained from the assumed regression model. Weak convergence of the corresponding process is obtained, and its finite sample behaviour is studied via simulations. Finally, characteristics of the test are illustrated in the analysis of a fatigue data set.     

Goodness-of-fit tests for parametric regression with selection biased data

Consider the nonparametric location-scale regression model Y=m(X)+σ(X)ε$Y=m(X)+\sigma (X)\epsilon$, where the error ε$\epsilon$ is independent of the covariate X$X$, and m$m$ and σ$\sigma$ are smooth but unknown functions. The pair (X,Y)$(X,Y)$ is allowed to be subject to selection bias. We construct tests for the hypothesis that m(·)$m(·)$ belongs to some parametric family of regression functions. The proposed tests compare the nonparametric maximum likelihood estimator (NPMLE) based on the residuals obtained under the assumed parametric model, with the NPMLE based on the residuals obtained without using the parametric model assumption. The asymptotic distribution of the test statistics is obtained. A bootstrap procedure is proposed to approximate the critical values of the tests. Finally, the finite sample performance of the proposed tests is studied in a simulation study, and the developed tests are applied on environmental data.     

Empirical Bayes estimation of P(Y < X) and characterizations of Burr-type X model

This paper deals with the estimation of R = P(Y < X) when Y and X are two independent but not identically distributed Burr-type X random variables. Maximum likelihood, Bayes and empirical Bayes techniques are used for this purpose. Monte-Carlo simulation is carried out to compare the three methods of estimation. Also, two characterizations of the Burr-type X distribution are presented. The first characterization is based on the recurrence relationships between two successively conditional moments of a certain function of the random variable, whereas the second one is given by the conditional variance of that function.     

Confidence Intervals for Nonparametric Regression Functions with Missing Data

Suppose that we have a nonparametric regression model Y = m(X) + ε with X ∈ R^p, where X is a random design variable and is observed completely, and Y is the response variable and some Y-values are missing at random. Based on the “complete” data sets for Y after nonaprametric regression imputation and inverse probability weighted imputation, two estimators of the regression function m(x₀) for fixed x₀ ∈ R^p are proposed. Asymptotic normality of two estimators is established, which is used to construct normal approximation-based confidence intervals for m(x₀). We also construct an empirical likelihood (EL) statistic for m(x₀) with limiting distribution of χ²₁, which is used to construct an EL confidence interval for m(x₀).     

Efficient Robust Estimation for Linear Models with Missing Response at Random

Coefficient estimation in linear regression models with missing data is routinely carried out in the mean regression framework. However, the mean regression theory breaks down if the error variance is infinite. In addition, correct specification of the likelihood function for existing imputation approach is often challenging in practice, especially for skewed data. In this paper, we develop a novel composite quantile regression and a weighted quantile average estimation procedure for parameter estimation in linear regression models when some responses are missing at random. Instead of imputing the missing response by randomly drawing from its conditional distribution, we propose to impute both missing and observed responses by their estimated conditional quantiles given the observed data and to use the parametrically estimated propensity scores to weigh check functions that define a regression parameter. Both estimation procedures are resistant to heavy‐tailed errors or outliers in the response and can achieve nice robustness and efficiency. Moreover, we propose adaptive penalization methods to simultaneously select significant variables and estimate unknown parameters. Asymptotic properties of the proposed estimators are carefully investigated. An efficient algorithm is developed for fast implementation of the proposed methodologies. We also discuss a model selection criterion, which is based on an IC_Q ‐type statistic, to select the penalty parameters. The performance of the proposed methods is illustrated via simulated and real data sets.     

Two remarks on order statistics

Let X₍₁₎,…,X_(n) be the order statistics of n iid distributed random variables. We prove that (X_(i)) have a certain Markov property for general distributions and secondly that the order statistics have monotone conditional regression dependence. Both properties are well known in the case of continuous distributions.     

A unified approach to characterization problems using conditional expectations

In recent years characterization problems have become of increasing interest. It is well known that mean residual life e(x) = E(X - x|X ⩾x) and right-censored mean function m_R(x) = E(X | X ⩽ x), uniquely determine the distribution function F(x) = P(X ⩽ x). In this paper, we study characterizations problems for general distributions, using the doubly censored mean function m(x, y) = E(X | x⩽X⩽y). We show that m(x, y) characterizes F(x), obtaining the explicit expression of F(x) from m(x, y). Moreover, we give properties that any function must verifies to be a doubly censored mean function and we obtain stability theorems for these characterizations.     

Estimation of an autoregressive semiparametric model with exogenous variables

In many autoregressive relationships, there are observed external influences. This paper deals with the estimation of the multivariate model X_t+1= φ(X_t,…,X_t−r+1) + ψ(Y_t) + ε_t, where φ(·) is an unknown nonlinear function, ∫ the exogenous variable concerning ψ(·). Two cases are considered: ψ(·) is linear ψ(Y_t) = AY_t, where A is an unknown parameter, and ψ(·) the nonlinear function corresponding to a series expansion. In the latter situation, the method of estimation is ‘seminonparametric’. We first isolate and estimate parametrically the exogenous part, and then estimate nonparametrically the endogenous part ψ(·).     

Likelihood-Based Inference for Weak Exogeneity in I(2) Cointegrated VAR Models

This article develops limit theory for likelihood analysis of weak exogeneity in I(2) cointegrated vector autoregressive (VAR) models incorporating deterministic terms. Conditions for weak exogeneity in I(2) VAR models are reviewed, and the asymptotic properties of conditional maximum likelihood estimators and a likelihood-based weak exogeneity test are then investigated. It is demonstrated that weak exogeneity in I(2) VAR models allows us to conduct asymptotic conditional inference based on mixed Gaussian distributions. It is then proved that a log-likelihood ratio test statistic for weak exogeneity in I(2) VAR models is asymptotically χ² distributed. The article also presents an empirical illustration of the proposed test for weak exogeneity using Japan's macroeconomic data.     

Empirical likelihood based confidence regions for first order parameters of heavy-tailed distributions

Let X₁,…,X_n be some i.i.d. observations from a heavy-tailed distribution F, i.e. the common distribution of the excesses over a high threshold u_n can be approximated by a generalized Pareto distribution G_γ,σn with γ>0. This paper deals with the problem of finding confidence regions for the couple (γ,σ_n): combining the empirical likelihood methodology with estimation equations (close but not identical to the likelihood equations) introduced by Zhang (2007), asymptotically valid confidence regions for (γ,σ_n) are obtained and proved to perform better than Wald-type confidence regions (especially those derived from the asymptotic normality of the maximum likelihood estimators). By profiling out the scale parameter, confidence intervals for the tail index are also derived.     

On the quantile process based on the autoregressive residuals

Let {X_t} be the stationary AR(p) process satisfying the difference equation X_t=β₁X_t−1 + … + β_pX_t−p+ε_t, where {ε_t} is a sequence of iid random variables with mean zero and finite variance. Motivated by a goodness of fit test on the true errors {ε_t}, we are led to study the asymptotic behavior of the quantile process based on residuals (the residual quantile process). Particularly, we concentrate on the deviations between the residual quantile process and the empirical process based on the true errors. In this asymptotic study, it is shown that the deviations converge to zero in probability uniformly over certain intervals with specific order as sample size increases. Here, these intervals are allowed to vary with the sample size n and converge to the unit interval as n goes to infinity. Then, based on our result and the strong approximation result of Csörgö and Révész (1978), we propose a goodness of fit test statistic of which limiting distribution is the same as of a functional form of a standard Brownian bridge.     

Empirical Likelihood Intervals for Conditional Value‐at‐Risk in Heteroscedastic Regression Models

Abstract. Non‐parametric regression models have been studied well including estimating the conditional mean function, the conditional variance function and the distribution function of errors. In addition, empirical likelihood methods have been proposed to construct confidence intervals for the conditional mean and variance. Motivated by applications in risk management, we propose an empirical likelihood method for constructing a confidence interval for the pth conditional value‐at‐risk based on the non‐parametric regression model. A simulation study shows the advantages of the proposed method.     

Characterization of weak convergence for smoothed empirical and quantile processes under ϕ-mixing

Let X_n, n ⩾ 1 be a sequence of ϕ-mixing random variables having a smooth common distribution function F. The smoothed empirical distribution function is obtained by integrating a kernel type density estimator. In this paper we provide necessary and sufficient conditions for the central limit theorem to hold for smoothed empirical distribution functions and smoothed sample quantiles. Also, necessary and sufficient conditions are given for weak convergence of the smoothed empirical process and the smoothed uniform quantile process.     

Empirical likelihood inference for parameters in a partially linear errors-in-variables model

In this paper, we consider the application of the empirical likelihood method to a partially linear model with measurement errors in the non-parametric part. It is shown that the empirical log-likelihood ratio at the true parameters converges to the standard chi-square distribution. Furthermore, we obtain the maximum empirical likelihood estimate of the unknown parameter by using the empirical log-likelihood ratio function, and the resulting estimator is shown to be asymptotically normal. Some simulations and an application are conducted to illustrate the proposed method.     

Asymptotic Properties of Random Weighted Empirical Distribution Function

This article studies the asymptotic properties of the random weighted empirical distribution function of independent random variables. Suppose X₁, X₂, ???, X_n is a sequence of independent random variables, and this sequence is not required to be identically distributed. Denote the empirical distribution function of the sequence by F_n(x). Based on the random weighting method and F_n(x), the random weighted empirical distribution function H_n(x) is constructed and the asymptotic properties of H_n are discussed. Under weak conditions, the Glivenko–Cantelli theorem and the central limit theorem for the random weighted empirical distribution function are obtained. The obtained results have also been applied to study the distribution functions of random errors of multiple sensors.     

Empirical likelihood ratio under infinite second moment

In this article, we show that the log empirical likelihood ratio statistic for the population mean converges in distribution to χ²₍₁₎ as n → ∞ when the population is in the domain of attraction of normal law but has infinite variance. The simulation results show that the empirical likelihood ratio method is applicable under the infinite second moment condition.     

Simultaneous confidence bands for expectile functions

Expectile regression, as a general M smoother, is used to capture the tail behaviour of a distribution. Let (X ₁,Y ₁),…,(X _n ,Y _n ) be i.i.d. rvs. Denote by v(x) the unknown τ-expectile regression curve of Y conditional on X, and by v _n (x) its kernel smoothing estimator. In this paper, we prove the strong uniform consistency rate of v _n (x) under general conditions. Moreover, using strong approximations of the empirical process and extreme value theory, we consider the asymptotic maximal deviation sup_0≤x≤1|v _n (x)?v(x)|. According to the asymptotic theory, we construct simultaneous confidence bands around the estimated expectile function. Furthermore, we apply this confidence band to temperature analysis. Taking Berlin and Taipei as an example, we investigate the temperature risk drivers to these two cities.     

The first-order random coefficient integer valued autoregressive process with the occasional level shift random noise based on dual empirical likelihood

Abstract

This paper investigates the first-order random coefficient integer valued autoregressive process with the occasional level shift random noise based on dual empirical likelihood. The limiting distribution of log empirical likelihood ratio statistic is constructed. Asymptotic convergence and confidence region results of empirical likelihood ratio are given. Hypothesis testing is considering, and maximum empirical likelihood estimation for parameter is acquired. Simulations are given to show that the maximum empirical likelihood estimation is more efficient than the conditional least squares estimation.     

Empirical likelihood for heteroscedastic partially linear errors-in-variables model with α-mixing errors

In this paper, we apply the empirical likelihood method to heteroscedastic partially linear errors-in-variables model. For the cases of known and unknown error variances, the two different empirical log-likelihood ratios for the parameter of interest are constructed. If the error variances are known, the empirical log-likelihood ratio is proved to be asymptotic chi-square distribution under the assumption that the errors are given by a sequence of stationary α-mixing random variables. Furthermore, if the error variances are unknown, we show that the proposed statistic is asymptotically standard chi-square distribution when the errors are independent. Simulations are carried out to assess the performance of the proposed method.