On regressing regression coefficients

This paper considers a regression model in which coefficients obtained from a previous regression are themselves the object of analysis. It is shown that the parameters of interest can be obtained in two ways: pooling across observations and subsamples, or a two-stage process of first estimating the coefficients within each subsample, and then using these coefficients as dependent variables in a second stage regression. The relative properties of these estimators are analyzed, and the conditions under which the two estimators are equivalent are derived.     

More on the restricted ridge regression estimation

Several alternative methods for derivation of the restricted ridge regression estimator (RRRE) are provided. Theoretical comparison and relationship of RRRE with related methods for regression with the multicollinearity problem are described. We also find inter-connections among RRRE, ordinary ridge regression estimator (ORRE), restricted least squares estimator (RLSE), modified ridge regression estimator (MRRE) and restricted modified generalized ridge estimator (RMGRE). Finally, numerical comparison, in addition to theoretical derivation, is also conducted with a Monte Carlo simulation and a real data example.     

Collapsibility of regression coefficients and its extensions

Collapsibility with respect to a measure of association implies that the measure of association can be obtained from the marginal model. We first discuss model collapsibility and collapsibility with respect to regression coefficients for linear regression models. For parallel regression models, we give simple and different proofs of some of the known results and obtain also certain new results. For random coefficient regression models, we define (average) A$A$-collapsibility and obtain conditions under which it holds. We consider Poisson regression and logistic regression models also, and derive conditions for collapsibility and A$A$-collapsibility, respectively. These results generalize some of the results available in the literature. Some suitable examples are also discussed.     

Softly shrunk and partially shrunk rank-reduced estimation of the regression coefficients

In this paper we introduce strategies how the ordinary least square estimator of the coefficient vector of the multiple regression could be shrunk. One of the strategies shrinks all components while the other shrinks only some components. We show that the proposed shrunken estimators are admissibile. We also provide theoretical results on risk comparisons.     

Implications of survey design for generalized regression estimation of linear functions

The paper presents a general randomization theory approach to point and interval estimation of Q linear functions T_q = Σ^N₁c_kqY_k(q = 1,…,Q), where Y₁,…,Y_N are values of a variable of interest Y in a finite population. Such linear functions include population and domain means and totals, population regression coefficients, etc. We assume that some auxiliary information can be exploited. This suggests the generalized regression technique based on the fit of a linear model, whereby is created approximately design unbiased estimators T?_q. The paper focuses on estimation of the variance-covariance matrix of the T?_q for single stage and two stage designs. Two techniques based on Taylor expansions are compared. Results of Monte-Carlo experiments (not reported here) show that the coverage properties are good of normal-theory confidence intervals flowing from one or the other variance estimate.     

Methods for calculating stationary distribution in linear models of time series

The article deals with methods for computing the stationary marginal distribution in linear models of time series. Two approaches are described. First, an algorithm based on approximation of solution of the corresponding integral equation is briefly reviewed. Then, we study the limit behaviour of the partial sums c ₁ η₁+c ₂ η₂+···+c _n η _n where η _i are i.i.d. random variables and c _i real constants. We generalize procedure of Haiman (1998) [Haiman, G., 1998, Upper and lower bounds for the tail of the invariant distribution of some AR(1) processes. Asymptotic Methods in Probability and Statistics, 45, 723–730.] to an arbitrary causal linear process and relax the assumptions of his result significantly. This is achieved by investigating the properties of convolution of densities.     

A multivariate version of Gini's rank association coefficient

In this paper, we introduce a multivariate generalization of the population version of Gini's rank association coefficient, giving a response to this open question posed in [4]. We also study some properties of this version, present the corresponding results for the sample statistic, and provide several examples.     

Design selection criteria for discrimination/estimation for nested models and a binomial response

The aim of an experiment is often to enable discrimination between competing forms for a response model. We investigate the selection of a continuous design for a non-sequential strategy when there are two competing generalized linear models for a binomial response, with a common link function and the linear predictor of one model nested within that of the other. A new criterion, _TE$T_E$-optimality, is defined, based on the difference in the deviances from the two models, and comparisons are made with T$T$-, _Ds$D_s$- and D$D$-optimality. Issues are raised through the study of two examples in which designs are assessed using simulation studies of the power to reject the null hypothesis of the smaller model being correct, when the data are generated from the larger model. Parameter estimation for discrimination designs is also discussed and a simple method is investigated of combining designs to form a hybrid design in order to achieve both model discrimination and estimation. This method has a computational advantage over the use of a compound criterion and the similar performance of the designs obtained from the two approaches is illustrated in an example.     

Approximate minimax estimation in linear regression: theoretical results

We consider to ordinary linear regression model where the parameter vector ß is constrained to a given ellipsoid. It will be shown that within the class of linear statistics for ß where exists a (sub-)sequence of approximate minimax estimators converging to an exact minimax estimator. This result is valid for an arbitrary quadratic loss function.     

Optimal designs in random coefficient cubic regression models

In this article we investigate the problem of ascertaining A- and D-optimal designs in a cubic regression model with random coefficients. Our interest lies in estimation of all the parameters or in only those except the intercept term. Assuming the variance ratios to be known, we tabulate D-optimal designs for various combinations of the variance ratios. A-optimality does not pose any new problem in the random coefficients situation.     

Robust prediction and extrapolation designs for misspecified generalized linear regression models

We study minimax robust designs for response prediction and extrapolation in biased linear regression models. We extend previous work of others by considering a nonlinear fitted regression response, by taking a rather general extrapolation space and, most significantly, by dropping all restrictions on the structure of the regressors. Several examples are discussed.     

Numerical estimation of a probability measure

An iterative solution to the problem of maximizing a concave functional ø defined on the set of all probability measures on a topological space is considered. Convergence of this procedure and a rapidly converging algorithm are studied. Computational aspects of this algorithm along with the ones developed earlier by Wynn, Fedorov, Atwood, Wu and others are provided. Examples discussed are taken from the area of mixture likehoods and optimal experimental design.     

A Comparison of Survival Function Estimators in the Koziol–Green Model

In this paper, three competing survival function estimators are compared under the assumptions of the so-called Koziol– Green model, which is a simple model of informative random censoring. It is shown that the model specific estimators of Ebrahimi and Abdushukurov, Cheng, and Lin are asymptotically equivalent. Further, exact expressions for the (noncentral) moments of these estimators are given, and their biases are analytically compared with the bias of the familiar Kaplan–Meier estimator. Finally, MSE comparisons of the three estimators are given for some selected rates of censoring.     

Estimability and linearity in normal regression

In the normal regresion model, a relation between the notion of estimability of a distribution and the existence of a linear function of the observations with some desired property is studied. Several definitions of estimability are shown to be equivalent.     

Distribution-free tests for parallelism and concurrence in two-sample regression problem

This paper suggests some distribution-free methods for testing hypothesis of parallelism and concurrence of two linear regressions. We assume that the independent variable x is equally spaced. The proposed procedures are compared with nonparametric competitors and the normal theory t-test.     

Gaussian approximation of signed rank statistics process

We consider the signed linear rank statistics of the form

$\text{S}{}_{\mathrm{\Delta N}}\text{=}\text{∑}\text{i=1}\text{N}\text{c}{}_{\mathrm{Ni}}\text{ø(}\text{R}{}^{\mathrm{\Delta }}{}_{\mathrm{Ni}}\text{(N+1)}\text{)}\text{sgn}\text{Y}{}^{\mathrm{\Delta }}{}_{\mathrm{Ni}}$

where the c_Ni's are known real numbers, Δ∈[0,1] is an unknown real parameter,R^Δ_Ni is the rank of |Y^Δ_Ni| among |Y^Δ_Nj|, 1≤j≤N, ø is a score generating function, sgn y=1 or -1 according as y≥0 or <0, and Y^Δ_Nj, 1≤j ≤N, are independent random variables with continuous cumulative distribution functions F(y?Δd_Nj), 1≤ j≤N, respectively where the d_fNi's are known real numbers. Under suitable assumptions on the c's, d's, φ and F, it is proved that the random process {S_ΔN?S_0N?ES_ΔN, 0≤Δ≤1}, properly normalized, converges weakly to a Gaussian process, and this result is also true if ES_ΔN is replaced by Δb_N, where

$\text{b}{}_{\mathrm{N}}\text{=4}\text{∑}\text{i=1}\text{N}\text{c}{}_{\mathrm{Ni}}\text{d}{}_{\mathrm{Ni}}\text{∫}\text{0}\text{∞}\text{ø′(2F(x)?1)?}{}^2\text{(x)}\text{d}\text{x}\text{and}\text{?=F′}$

. As an application, we derive the asymptotic distribution of the properly normalized length of a confidence interval for Δ.     

Quadratic estimation in mixed linear models with two variance components

Explicit expressions for Bayes invariant quadratic estimates, biased and unbiased, are presented and proved to cover the entire class of admissible estimates in the considered classes. An unbalanced genetic model is studied for demonstration.