Hierarchical CUB Models for Ordinal Variables

Hierarchical CUB models are a generalization of CUB models in which parameters are allowed to be random. The main feature that distinguishes such proposal from the standard one is the modeling of variation among groups. We illustrate the usefulness of these hierarchical structures by discussing model specification, inferential issues, and empirical results with reference to a real data set.     

Permutation Inference for a Class of Mixture Models

In statistical surveys, people are often asked to express evaluations on several topics or to make an ordered arrangement in a list of objects (items, services, sentences, etc.); thus, the analysis of ratings and rankings is receiving a growing interest in many fields. In this framework, we develop a testing procedure for a class of mixture models with covariates (defined as CUB models), proposed by Piccolo (2003 Piccolo , D. ( 2003 ). On the moments of a mixture of uniform and shifted binomial random variables . Quaderni di Statistica 5 : 85 – 104 . [Google Scholar]) and D'Elia and Piccolo (2005 D'Elia , A. , Piccolo , D. ( 2005 ). A mixture model for preference data analysis . Computat. Statist. Data Anal. 49 : 917 – 934 .[Crossref], [Web of Science ®] , [Google Scholar]) and generally developed in a parametric context. Instead, we propose a nonparametric solution to perform inference on CUB models, specifically on the coefficients of the covariates. A simulation study proves that this approach is more appropriate in some specific data settings, mostly for small sample sizes.     

Bayesian variable selection for correlated covariates via colored cliques

We propose a Bayesian method to select groups of correlated explanatory variables in a linear regression framework. We do this by introducing in the prior distribution assigned to the regression coefficients a random matrix $G$ that encodes the group structure. The groups can thus be inferred by sampling from the posterior distribution of $G$ . We then give a graph-theoretic interpretation of this random matrix $G$ as the adjacency matrix of cliques. We discuss the extension of the groups from cliques to more general random graphs, so that the proposed approach can be viewed as a method to find networks of correlated covariates that are associated with the response.     

Sparse group variable selection based on quantile hierarchical Lasso

The group Lasso is a penalized regression method, used in regression problems where the covariates are partitioned into groups to promote sparsity at the group level [27 M. Yuan and Y. Lin, Model selection and estimation in regression with grouped variables, J. R. Stat. Soc. Ser. B 68 (2006), pp. 49–67. doi: 10.1111/j.1467-9868.2005.00532.x[Crossref] , [Google Scholar]]. Quantile group Lasso, a natural extension of quantile Lasso [25 Y. Wu and Y. Liu, Variable selection in quantile regression, Statist. Sinica 19 (2009), pp. 801–817.[Web of Science ®] , [Google Scholar]], is a good alternative when the data has group information and has many outliers and/or heavy tails. How to discover important features that are correlated with interest of outcomes and immune to outliers has been paid much attention. In many applications, however, we may also want to keep the flexibility of selecting variables within a group. In this paper, we develop a sparse group variable selection based on quantile methods which select important covariates at both the group level and within the group level, which penalizes the empirical check loss function by the sum of square root group-wise L₁-norm penalties. The oracle properties are established where the number of parameters diverges. We also apply our new method to varying coefficient model with categorial effect modifiers. Simulations and real data example show that the newly proposed method has robust and superior performance.     

On likelihood ratio testing for penalized splines

Penalized spline regression using a mixed effects representation is one of the most popular nonparametric regression tools to estimate an unknown regression function $f(\cdot )$ . In this context testing for polynomial regression against a general alternative is equivalent to testing for a zero variance component. In this paper, we fill the gap between different published null distributions of the corresponding restricted likelihood ratio test under different assumptions. We show that: (1) the asymptotic scenario is determined by the choice of the penalty and not by the choice of the spline basis or number of knots; (2) non-standard asymptotic results correspond to common penalized spline penalties on derivatives of $f(\cdot )$ , which ensure good power properties; and (3) standard asymptotic results correspond to penalized spline penalties on $f(\cdot )$ itself, which lead to sizeable power losses under smooth alternatives. We provide simple and easy to use guidelines for the restricted likelihood ratio test in this context.     

Tolerance Factors in Multiple and Multivariate Linear Regressions

In this article, an improved method of computing tolerance factors for constructing tolerance regions in a multivariate linear regression model is proposed. The method is based on a chi-square approximation to the distribution of a linear function of noncentral chi-square variables and simulation. The merits of the proposed approach and the usual simulation method considered in Lee and Mathew (2004 Lee , Y. , Mathew , T. ( 2004 ). Tolerance regions in multivariate linear regression . Journal of Statistical Planning Inference 126 : 253 – 271 . [Google Scholar]) are evaluated using Monte Carlo simulation. The study indicates that the proposed approach is stable and accurate even for small samples, and better than available methods. For constructing two-sided tolerance intervals in multiple linear regression, coverage level adjusted one-sided tolerance factors are shown to be better than available approximate tolerance factors. The results based on the coverage level adjusted one-sided tolerance factors are as good as the ones based on the exact two-sided tolerance factors in many cases.     

Estimating and Validating Nonlinear Regression Metamodels in Simulation

Frequently, the main objective of statistically designed simulation experiments is to estimate and validate regression metamodels, where the regressors are functions of the design variables and the dependent variable is the system response. In this article, a weighted least squares procedure for estimating the unknown parameters of a nonlinear regression metamodel is formulated and evaluated. Since the validity of a fitted regression model must be tested, a method for validating nonlinear regression simulation metamodels is presented. This method is a generalization of the cross-validation test proposed by Kleijnen (1983 Kleijnen , J. P. C. ( 1983 ). Cross-validation using the t statistic . European Journal of Operational Research 13 : 133 – 141 .[Crossref] , [Google Scholar]) in the context of linear regression metamodels. One drawback of the cross-validation strategy is the need to perform a large number of nonlinear regressions, if the number of experimental points is large. In this article, cross-validation is implemented using only one nonlinear regression. The proposed statistical analysis allows us to obtain Scheffé-type simultaneous confidence intervals for linear combinations of the metamodel's unknown parameters. Using the well-known M/M/1 example, a metamodel is built and validated with the aid of the proposed procedure.     

Performance of Some Ridge Parameters for Probit Regression: With Application to Swedish Job Search Data

In ridge regression, the estimation of the ridge parameter is an important issue. This article generalizes some methods for estimating the ridge parameter for probit ridge regression (PRR) model based on the work of Kibria et al. (2011 Kibria, B. M. G., Månsson, K. and Shukur, G. 2011. Performance of some logistic ridge regression parameters. Computational Economics, DOI: 10.1007/s10614-011-9275-x [Google Scholar]). The performance of these new estimators is judged by calculating the mean squared error (MSE) using Monte Carlo simulations. In the design of the experiment, we chose to vary the sample size and the number of regressors. Furthermore, we generate explanatory variables that are linear combinations of other regressors, which is a common situation in economics. In an empirical application regarding Swedish job search data, we also illustrate the benefits of the new method.     

Some tests for the allometric extension model in regression

The allometric extension model is a multivariate regression model recently proposed by Tarpey and Ivey (2006 Tarpey, T., Ivey, C.T. (2006). Allometric extension for multivariate regression. J. Data Sci. 4:479–495. [Google Scholar]). This model holds when the matrix of covariances between the variables in the response vector y and the variables in the vector of regressors x has a particular structure. In this paper, we consider tests of hypotheses for this structure when (y′, x′)′ has a multivariate normal distribution. In particular, we investigate the likelihood ratio test and a Wald test.     

An Independence Point Method of Confidence Band Construction for Multiple Linear Regression Models

This article addresses the problem of confidence band construction for a standard multiple linear regression model. An “independence point” method of construction is developed which generalizes the method of Gafarian (1964) for a simple linear regression model to a multiple linear regression model. Wynn (1984 Wynn , H. P. ( 1984 ). An exact confidence band for one-dimensional polynomial regression . Biometrika 71 : 375 – 9 .[Crossref], [Web of Science ®] , [Google Scholar]) pioneered the approach of basing confidence bands for a polynomial regression on a set of nodes where the function estimates are independent, and this approach is exploited in this article. This method requires only critical points from t-distributions so that the confidence bands are easy to construct. Both one-sided and two-sided confidence bands can be constructed using this method. An illustration of the new method is provided, and comparisons are made with other procedures.     

Local influence in seemingly unrelated regression model with ridge estimate

Local influence is a well-known method for identifying the influential observations in a dataset and commonly needed in a statistical analysis. In this paper, we study the local influence on the parameters of interest in the seemingly unrelated regression model with ridge estimation, when there exists collinearity among the explanatory variables. We examine two types of perturbation schemes to identify influential observations: the perturbation of variance and the perturbation of individual explanatory variables. Finally, the efficacy of our proposed method is illustrated by analyzing [13 A. Munnell, Why has productivity declined? Productivity and public investment, New Engl. Econ. Rev. (1990), pp. 3–22. [Google Scholar]] productivity dataset.     

On the central limit theorem along subsequences of sums of i.i.d. random variables

Let \(\mathbb{N } = \{1, 2, 3, \ldots \}\) . Let \(\{X, X_{n}; n \in \mathbb N \}\) be a sequence of i.i.d. random variables, and let \(S_{n} = \sum _{i=1}^{n}X_{i}, n \in \mathbb N \) . Then \( S_{n}/\sqrt{n} \Rightarrow N(0, \sigma ^{2})\) for some \(\sigma ^{2} < \infty \) whenever, for a subsequence \(\{n_{k}; k \in \mathbb N \}\) of \(\mathbb N \) , \( S_{n_{k}}/\sqrt{n_{k}} \Rightarrow N(0, \sigma ^{2})\) . Motivated by this result, we study the central limit theorem along subsequences of sums of i.i.d. random variables when \(\{\sqrt{n}; n \in \mathbb N \}\) is replaced by \(\{\sqrt{na_{n}};n \in \mathbb N \}\) with \(\lim _{n \rightarrow \infty } a_{n} = \infty \) . We show that, for given positive nondecreasing sequence \(\{a_{n}; n \in \mathbb N \}\) with \(\lim _{n \rightarrow \infty } a_{n} = \infty \) and \(\lim _{n \rightarrow \infty } a_{n+1}/a_{n} = 1\) and given nondecreasing function \(h(\cdot ): (0, \infty ) \rightarrow (0, \infty )\) with \(\lim _{x \rightarrow \infty } h(x) = \infty \) , there exists a sequence \(\{X, X_{n}; n \in \mathbb N \}\) of symmetric i.i.d. random variables such that \(\mathbb E h(|X|) = \infty \) and, for some subsequence \(\{n_{k}; k \in \mathbb N \}\) of \(\mathbb N \) , \( S_{n_{k}}/\sqrt{n_{k}a_{n_{k}}} \Rightarrow N(0, 1)\) . In particular, for given \(0 < p < 2\) and given nondecreasing function \(h(\cdot ): (0, \infty ) \rightarrow (0, \infty )\) with \(\lim _{x \rightarrow \infty } h(x) = \infty \) , there exists a sequence \(\{X, X_{n}; n \in \mathbb N \}\) of symmetric i.i.d. random variables such that \(\mathbb E h(|X|) = \infty \) and, for some subsequence \(\{n_{k}; k \in \mathbb N \}\) of \(\mathbb N \) , \( S_{n_{k}}/n_{k}^{1/p} \Rightarrow N(0, 1)\) .     

Complete moment convergence of widely orthant dependent random variables

It is known that the dependence structure of widely orthant dependent (WOD) random variables is weaker than those of negatively associated (NA) random variables, negatively superadditive dependent (NSD) random variables, negatively orthant dependent (NOD) random variables, and extended negatively dependent (END) random variables. In this article, the results of complete moment convergence and complete convergence are presented for WOD sequence under the same moment conditions as independent sequence in classical result (Chow 1988 Chow, Y. (1988). On the rate of moment convergence of sample sums and extremes. Bull. Inst. Math. Acad. Sin. 16(3):177–201. [Google Scholar]).     

On the Uniform Strong Consistency of Local Polynomial Regression Under Dependence Conditions

Abstract

In this article, nonparametric estimators of the regression function, and its derivatives, obtained by means of weighted local polynomial fitting are studied. Consider the fixed regression model where the error random variables are coming from a stationary stochastic process satisfying a mixing condition. Uniform strong consistency, along with rates, are established for these estimators. Furthermore, when the errors follow an AR(1) correlation structure, strong consistency properties are also derived for a modified version of the local polynomial estimators proposed by Vilar-Fernández and Francisco-Fernández (Vilar-Fernández, J. M., Francisco-Fernández, M. (2002 Vilar-Fernández, J. M. and Francisco-Fernández, M. 2002. Local polynomial regression smoothers with AR-error structure. TEST, 11(2): 439–464.  [Google Scholar]). Local polynomial regression smoothers with AR-error structure. TEST 11(2):439–464).     

Consistent estimation approach to tackling collinearity and Berkson-type measurement error in linear regression using adjusted Wald-type estimator

This article proposes a consistent estimation approach in linear regression models for the case when the predictor variables are subject to collinearities and Berkson-type measurement errors simultaneously. Our presented procedure does not rely on ridge regression (RR) methods that have been widely addressed in the literature for ill-conditioned problems resulted from multicollinearity. Instead, we review and propose new consistent estimators due to Wald (1940 Wald, A. (1940). Fitting of straight lines if both variables are subject to error. Ann. Math. Stat. 11:284–300.[Crossref] , [Google Scholar]) so that, except finite fourth moments assumptions, no prior knowledge of parametric settings on observations and errors is used, and there is no need to solve estimating equations for coefficient parameters. The performance of the estimation procedure is compared with that of RR-based estimators by using a variety of numerical experiments through Monte Carlo simulation under estimated mean squared error (EMSE) criterion.     

Jackknifing the Ridge Regression Estimator: A Revisit

Singh et al. (1986 Singh, B., Chaubey, Y.P., Dwivedi, T.D. (1986). An almost unbiased ridge estimator. Sankhya B48: 34236. [Google Scholar]) proposed an almost unbiased ridge estimator using Jackknife method that required transformation of the regression parameters. This article shows that the same method can be used to derive the Jackknifed ridge estimator of the original (untransformed) parameter without transformation. This method also leads in deriving easily the second-order Jackknifed ridge that may reduce the bias further. We further investigate the performance of these estimators along with a recent method by Batah et al. (2008 Batah, F. S.M., Ramanathan, T.V., Gore, S.D. (2008). The efficiency of modified Jack-knife and ridge type regression estimators: a comparison. Surv. Math. Applic. 3:111122. [Google Scholar]) called modified Jackknifed ridge theoretically as well as numerically.     

Mixture Representation of the Maximum Entropy Density Through Archimedean Copulas

In this article, we obtain a mixture representation of the maximum entropy density introduced by Rodrigues (2004 Rodrigues , J. ( 2004 ). An entropy model for dependent variables . Commun. Statist. Theor. Meth. 4 ( 33 ): 979 – 990 . [Google Scholar]) via Laplace approximation. This representation suggests, as in Sklar (1959 Sklar , A. ( 1959 ). Fonctions de répartition à ndimensions et marges . Publications de l 'Université de Paris 8 : 229 – 231 . [Google Scholar]), a dependence structure through Archimedean copulas independently of the specified marginal distributions. This result can be used as a natural Bayesian and non Bayesian procedure to estimate the dependence function and the marginal, separately.     

Covariate-Adjusted Regression for Time Series

The main purpose of this article is to consider the covariate-adjusted regression (CAR) model for time series. The CAR model was initially proposed by Sentürk and Müller (2005 Sentürk , D. , Müller , H. G. ( 2005 ). Covariate-adjusted regression . Biometrika 92 : 75 – 89 .[Crossref], [Web of Science ®] , [Google Scholar]) for such situations where predictor and response variables are not directly observed, but are distorted by some common observable covariate. Despite CAR being originally designed for independent cross-sectional data, multiple works have extended this method to dependent data setting. In this article, the authors extend CAR to the distorted time series setting. This extension is meaningful in many fields such as econometrics, mathematical finance, and signal processing. The estimates of regression parameters are proposed by establishing connection with functional-coefficient time series model. The consistency and asymptotic normality of the proposed estimates are investigated under the α-mixing conditions. Real data and simulated examples are provided for illustration.     

Let us do the twist again

Krämer (Sankhy $\bar{\mathrm{a }}$ 42:130–131, 1980) posed the following problem: “Which are the $\mathbf{y}$ , given $\mathbf{X}$ and $\mathbf{V}$ , such that OLS and Gauss–Markov are equal?”. In other words, the problem aimed at identifying those vectors $\mathbf{y}$ for which the ordinary least squares (OLS) and Gauss–Markov estimates of the parameter vector $\varvec{\beta }$ coincide under the general Gauss–Markov model $\mathbf{y} = \mathbf{X} \varvec{\beta } + \mathbf{u}$ . The problem was later called a “twist” to Kruskal’s Theorem, which provides conditions necessary and sufficient for the OLS and Gauss–Markov estimates of $\varvec{\beta }$ to be equal. The present paper focuses on a similar problem to the one posed by Krämer in the aforementioned paper. However, instead of the estimation of $\varvec{\beta }$ , we consider the estimation of the systematic part $\mathbf{X} \varvec{\beta }$ , which is a natural consequence of relaxing the assumption that $\mathbf{X}$ and $\mathbf{V}$ are of full (column) rank made by Krämer. Further results, dealing with the Euclidean distance between the best linear unbiased estimator (BLUE) and the ordinary least squares estimator (OLSE) of $\mathbf{X} \varvec{\beta }$ , as well as with an equality between BLUE and OLSE are also provided. The calculations are mostly based on a joint partitioned representation of a pair of orthogonal projectors.     

Semiparametric Regression Analysis of Panel Count Data with Time-Dependent Covariates and Informative Observation and Censoring Times

In this article, we extend the joint frailty models proposed by Zhao and Tong (2011 Zhao , X. , Tong , X. ( 2011 ). Semiparametric regression analysis of panel count data with informative observation times . Comput. Statist. Data. Anal. 55 : 291 – 300 .[Crossref], [Web of Science ®] , [Google Scholar]) to panel count data with the time-dependent covariates and informative observation and censoring times. A novel estimating equation approach that does not depend on the distribution of frailty variables and the link function is proposed for estimation of parameters, and the asymptotic properties of the proposed estimators are established. Simulation studies demonstrate that the proposed inference procedure performs well. The analysis of a bladder tumor data is presented to illustrate the method.