Distorted Copulas: Constructions and Tail Dependence

Given a copula C, we examine under which conditions on an order isomorphism ψ of [0, 1] the distortion C _ψ: [0, 1]² → [0, 1], C _ψ(x, y) = ψ{C[ψ^?1(x), ψ^?1(y)]} is again a copula. In particular, when the copula C is totally positive of order 2, we give a sufficient condition on ψ that ensures that any distortion of C by means of ψ is again a copula. The presented results allow us to introduce in a more flexible way families of copulas exhibiting different behavior in the tails.     

Estimated Generalized Least Squares for a Heteroscedastic Regression Model

This paper considers the general linear regression model yc = X₁β+u_t under the heteroscedastic structure E(u_t) = 0, E(u²) =σ²- (X_tβ)², E(u_t u_s) = 0, tæs, t, s= 1, T. It is shown that any estimated GLS estimator for β is asymptotically equivalent to the GLS estimator under some regularity conditions. A three-step GLS estimator, which calls upon the assumption E(u_t²) =s?²(X,β)² for the estimation of the disturbance covariance matrix, is considered.     

A non-iterative optimization method for smoothness in penalized spline regression

Typically, an optimal smoothing parameter in a penalized spline regression is determined by minimizing an information criterion, such as one of the C _p , CV and GCV criteria. Since an explicit solution to the minimization problem for an information criterion cannot be obtained, it is necessary to carry out an iterative procedure to search for the optimal smoothing parameter. In order to avoid such extra calculation, a non-iterative optimization method for smoothness in penalized spline regression is proposed using the formulation of generalized ridge regression. By conducting numerical simulations, we verify that our method has better performance than other methods which optimize the number of basis functions and the single smoothing parameter by means of the CV or GCV criteria.     

Testing the adequacy of a linear model VIA critical smoothing

An important problem for fitting local linear regression is the choice of the smoothing parameter. As the smoothing parameter becomes large, the estimator tends to a straight line, which is the least squares fit in the ordinary linear regression setting. This property may be used to assess the adequacy of a simple linear model. Motivated by Silverman's (1981) work in kernel density estimation, a suitable test statistic is the critical smoothing parameter where the estimate changes from nonlinear to linear, while linearity or non- linearity requires a more precise judgment. We define the critical smoothing parameter through the approximate F-tests by Hastie and Tibshirani (1990). To assess the significance, the “wild bootstrap” procedure is used to replicate the data and the proportion of bootstrap samples which give a nonlinear estimate when using the critical bandwidth is obtained as the p-value. Simulation results show that the critical smoothing test is useful in detecting a wide range of alternatives.     

Using a Truncated C p Statistic for Variable Selection in Multiple Linear Regression

In multiple linear regression analysis each lower-dimensional subspace L of a known linear subspace M of ? ⁿ corresponds to a non empty subset of the columns of the regressor matrix. For a fixed subspace L, the C _p statistic is an unbiased estimator of the mean square error if the projection of the response vector onto L is used to estimate the expected response. In this article, we consider two truncated versions of the C _p statistic that can also be used to estimate this mean square error. The C _p statistic and its truncated versions are compared in two example data sets, illustrating that use of the truncated versions may result in models different from those selected by standard C _p .     

On parameter estimation for locally stationary long-memory processes

We consider parameter estimation for time-dependent locally stationary long-memory processes. The asymptotic distribution of an estimator based on the local infinite autoregressive representation is derived, and asymptotic formulas for the mean squared error of the estimator, and the asymptotically optimal bandwidth are obtained. In spite of long memory, the optimal bandwidth turns out to be of the order n^-1/5$n^{-1/5}$ and inversely proportional to the square of the second derivative of d. In this sense, local estimation of d is comparable to regression smoothing with iid residuals.     

An asymptotic confidence interval for the process capability index Cpm

Abstract

The use of indices as an estimation tool of process capability is long-established among the statistical quality professionals. Numerous capability indices have been proposed in last few years. C_pm constitutes one of the most widely used capability indices and its estimation has attracted much interest. In this paper, we propose a new method for constructing an approximate confidence interval for the index C_pm. The proposed method is based on the asymptotic distribution of the index C_pm obtained by the Delta Method. Under some regularity conditions, the distribution of an estimator of the process capability index C_pm is asymptotically normal.     

A note on bias reduction in variable-kernel density estimates

It is well known that the inverse-square-root rule of Abramson (1982) for the bandwidth h of a variable-kernel density estimator achieves a reduction in bias from the fixed-bandwidth estimator, even when a nonnegative kernel is used. Without some form of “clipping” device similar to that of Abramson, the asymptotic bias can be much greater than O(h⁴) for target densities like the normal (Terrell and Scott 1992) or even compactly supported densities. However, Abramson used a nonsmooth clipping procedure intended for pointwise estimation. Instead, we propose a smoothly clipped estimator and establish a globally valid, uniformly convergent bias expansion for densities with uniformly continuous fourth derivatives. The main result extends Hall's (1990) formula (see also Terrell and Scott 1992) to several dimensions, and actually to a very general class of estimators. By allowing a clipping parameter to vary with the bandwidth, the usual O(h⁴) bias expression holds uniformly on any set where the target density is bounded away from zero.     

Cramér‐von Mises regression

Consider a linear regression model with unknown regression parameters β₀ and independent errors of unknown distribution. Block the observations into q groups whose independent variables have a common value and measure the homogeneity of the blocks of residuals by a Cramér‐von Mises q‐sample statistic T_q(β). This statistic is designed so that its expected value as a function of the chosen regression parameter β has a minimum value of zero precisely at the true value β₀. The minimizer β of T_q(β) over all β is shown to be a consistent estimate of β₀. It is also shown that the bootstrap distribution of T_q(β₀) can be used to do a lack of fit test of the regression model and to construct a confidence region for β₀     

Data-dependent probability matching priors of the second order

In this paper, we consider the preliminary test approach for the estimation of the regression parameter in a multiple regression model under a multicollinearity situation. The preliminary test two-parameter estimators based on the Wald (W), likelihood ratio, and Lagrangian multiplier tests are given, when it is suspected that the regression parameter may be restricted to a subspace and the regression error is distributed with multivariate Student's t distribution. The bias and mean square error of the proposed estimators are derived and compared. The conditions of superiority of the proposed estimators are obtained. Finally, we conclude that the optimum choice of the level of significance becomes the traditional choice by using the Wald test.     

Jackknifing in Categorical Data Analysis

Estimation of nonlinear functions of a multinomial parameter vector is necessary in many categorical data problems. The first and second order jackknife are explored for the purpose of reduction of bias. The second order jackknife of a function g(.) of a multinomial parameter is shown to be asymptotically normal if all second order partials ?²g( p )?dp_i?p_j obey a Hölder condition with exponent α>1/2. Numerical results for the estimation of the log odds ratio in a 2times2 table demonstrate the efficiency of the jackknife method for reduction of mean-square-error and the construction of approximate confidence intervals.     

About the Nonparametric Estimation of the Bernoulli Regression

The nonparametric estimation of the Bernoulli regression function is studied. The uniform consistency conditions are established and the limit theorems are proved for continuous functionals on C[a, 1 ? a], 0 < a < 1/2.     

Jump-detection and curve estimation methods for discontinuous regression functions based on the piecewise B-spline function

Jump-detection and curve estimation methods for the discontinuous regression function are proposed in this article. First, two estimators of the regression function based on B-splines are considered. The first estimator is obtained when the knot sequence is quasi-uniform; by adding a knot with multiplicity p + 1 at a fixed point x₀ on support [a, b], we can obtain the second estimator. Then, the jump locations are detected by the performance of the difference of the residual sum of squares DRSS(x₀) (x₀ ∈ (a, b)); subsequently the regression function with jumps can be fitted based on piecewise B-spline function. Asymptotic properties are established under some mild conditions. Several numerical examples using both simulated and real data are presented to evaluate the performance of the proposed method.     

Nonparametric Estimation of Volatility Function with Variable Bandwidth Parameter

In this article, we introduce a new method for the volatility function estimation of continuous-time diffusion process dX _t  = μ(X _t )dt + σ(X _t )dW _t , which is based on combining the idea of local linear smoother and variable bandwidth. We give the expressions for the conditional MSE and MISE of the estimator and obtain the optimal variable bandwidth. An explicit formula for the optimal variable bandwidth is presented by minimizing the MISE, which extends the related results in Fan and Gijbels (1992 Fan , J. Q. , Gijbels , I. ( 1992 ). Variable bandwidth and local linear regression smoother . Ann. Statist. 20 ( 4 ): 2008 – 2036 .[Crossref], [Web of Science ®] , [Google Scholar]), etc. Finally, some simulations show that the performance of the proposed estimator with optimal variable bandwidth is often much better than that of the local linear estimator with invariable bandwidth.     

Confidence Intervals for Nonparametric Regression Functions with Missing Data

Suppose that we have a nonparametric regression model Y = m(X) + ε with X ∈ R^p, where X is a random design variable and is observed completely, and Y is the response variable and some Y-values are missing at random. Based on the “complete” data sets for Y after nonaprametric regression imputation and inverse probability weighted imputation, two estimators of the regression function m(x₀) for fixed x₀ ∈ R^p are proposed. Asymptotic normality of two estimators is established, which is used to construct normal approximation-based confidence intervals for m(x₀). We also construct an empirical likelihood (EL) statistic for m(x₀) with limiting distribution of χ²₁, which is used to construct an EL confidence interval for m(x₀).     

Bayesian analysis of growth curves with AR(1) dependence

In this paper we consider Bayesian analysis of the generalized growth curve model when the covariance matrix Σ = σ²C where C = (ϱ^{i − j}), σ² > 0 and −1 < ϱ < 1 are unknown. We consider both parameter estimation and prediction of future values. Results are illustrated with real and simulated data.     

Efficient Robust Estimation for Linear Models with Missing Response at Random

Coefficient estimation in linear regression models with missing data is routinely carried out in the mean regression framework. However, the mean regression theory breaks down if the error variance is infinite. In addition, correct specification of the likelihood function for existing imputation approach is often challenging in practice, especially for skewed data. In this paper, we develop a novel composite quantile regression and a weighted quantile average estimation procedure for parameter estimation in linear regression models when some responses are missing at random. Instead of imputing the missing response by randomly drawing from its conditional distribution, we propose to impute both missing and observed responses by their estimated conditional quantiles given the observed data and to use the parametrically estimated propensity scores to weigh check functions that define a regression parameter. Both estimation procedures are resistant to heavy‐tailed errors or outliers in the response and can achieve nice robustness and efficiency. Moreover, we propose adaptive penalization methods to simultaneously select significant variables and estimate unknown parameters. Asymptotic properties of the proposed estimators are carefully investigated. An efficient algorithm is developed for fast implementation of the proposed methodologies. We also discuss a model selection criterion, which is based on an IC_Q ‐type statistic, to select the penalty parameters. The performance of the proposed methods is illustrated via simulated and real data sets.     

CRITICAL VALUES FOR INFERENCE ABOUT NORMAL DISPERSION1

Let F_N(.) be the density function of X²_N. Values of C₁/N, i= 1, 2, satisfying the twin conditions Pr (C₁≤X²_N≤C₂)=1-α and the conditional expectation of X²_N given C₁≤X²_N≤C₂ is N are tabulated for α=.2, .1, .05, .01, .005, .001, N=1(1)20(2)50(5)150(10)350. The second condition may be replaced by the condition f_N+2(C₁)=f_N+2V(C₂). The author has with him a bigger table giving C₁ and C₂ for α=.2, .1, .05, .01, .005, .001, N=1(1)350 to three decimals (to three significant digits, if some decimals are not significant). Several applications are mentioned. A practical application that is perhaps not obvious is to test whether two or more counts are distributed as independent Poisson variables. The new simple formulae used in the construction of the table are given and should prove useful in obtaining accurate values for omitted entries and in increasing the accuracy of entries.     

Application of the Bootstrap Approach to the Choice of Dimension and the α Parameter in the SIRα Method

To reduce the dimensionality of regression problems, sliced inverse regression approaches make it possible to determine linear combinations of a set of explanatory variables X related to the response variable Y in general semiparametric regression context. From a practical point of view, the determination of a suitable dimension (number of the linear combination of X) is important. In the literature, statistical tests based on the nullity of some eigenvalues have been proposed. Another approach is to consider the quality of the estimation of the effective dimension reduction (EDR) space. The square trace correlation between the true EDR space and its estimate can be used as goodness of estimation. In this article, we focus on the SIR_α method and propose a naïve bootstrap estimation of the square trace correlation criterion. Moreover, this criterion could also select the α parameter in the SIR_α method. We indicate how it can be used in practice. A simulation study is performed to illustrate the behavior of this approach.     

The Target Parameter of Adjusted R-Squared in Fixed-Design Experiments

R-squared (R²) and adjusted R-squared (R²_Adj) are sometimes viewed as statistics detached from any target parameter, and sometimes as estimators for the population multiple correlation. The latter interpretation is meaningful only if the explanatory variables are random. This article proposes an alternative perspective for the case where the x’s are fixed. A new parameter is defined, in a similar fashion to the construction of R², but relying on the true parameters rather than their estimates. (The parameter definition includes also the fixed x values.) This parameter is referred to as the “parametric” coefficient of determination, and denoted by ρ²_*. The proposed ρ²_* remains stable when irrelevant variables are removed (or added), unlike the unadjusted R², which always goes up when variables, either relevant or not, are added to the model (and goes down when they are removed). The value of the traditional R²_Adj may go up or down with added (or removed) variables, either relevant or not. It is shown that the unadjusted R² overestimates ρ²_*, while the traditional R²_Adj underestimates it. It is also shown that for simple linear regression the magnitude of the bias of R²_Adj can be as high as the bias of the unadjusted R² (while their signs are opposite). Asymptotic convergence in probability of R²_Adj to ρ²_* is demonstrated. The effects of model parameters on the bias of R² and R²_Adj are characterized analytically and numerically. An alternative bi-adjusted estimator is presented and evaluated.