Applying neural network Poisson regression to predict cognitive score changes

In this study, we combined a Poisson regression model with neural networks (neural network Poisson regression) to relax the traditional Poisson regression assumption of linearity of the Poisson mean as a function of covariates, while including it as a special case. In four simulated examples, we found that the neural network Poisson regression improved the performance of simple Poisson regression if the Poisson mean was nonlinearly related to covariates. We also illustrated the performance of the model in predicting five-year changes in cognitive scores, in association with age and education level; we found that the proposed approach had superior accuracy to conventional linear Poisson regression. As the interpretability of the neural networks is often difficult, its combination with conventional and more readily interpretable approaches under the generalized linear model can benefit applications in biomedicine.     

On Semiparametric Mode Regression Estimation

It has been found that, for a variety of probability distributions, there is a surprising linear relation between mode, mean, and median. In this article, the relation between mode, mean, and median regression functions is assumed to follow a simple parametric model. We propose a semiparametric conditional mode (mode regression) estimation for an unknown (unimodal) conditional distribution function in the context of regression model, so that any m-step-ahead mean and median forecasts can then be substituted into the resultant model to deliver m-step-ahead mode prediction. In the semiparametric model, Least Squared Estimator (LSEs) for the model parameters and the simultaneous estimation of the unknown mean and median regression functions by the local linear kernel method are combined to infer about the parametric and nonparametric components of the proposed model. The asymptotic normality of these estimators is derived, and the asymptotic distribution of the parameter estimates is also given and is shown to follow usual parametric rates in spite of the presence of the nonparametric component in the model. These results are applied to obtain a data-based test for the dependence of mode regression over mean and median regression under a regression model.     

A ray method of confidence band construction for multiple linear regression models

This paper addresses the problem of confidence band construction for a standard multiple linear regression model. A “ray” method of construction is developed which generalizes the method of Graybill and Bowden [1967. Linear segment confidence bands for simple linear regression models. J. Amer. Statist. Assoc. 62, 403–408] for a simple linear regression model to a multiple linear regression model. By choosing suitable directions for the rays this method requires only critical points from t-distributions so that the confidence bands are easy to construct. Both one-sided and two-sided confidence bands can be constructed using this method. An illustration of the new method is provided.     

Testing for a change point in linear regression models

In this paper, the Schwarz Information Criterion (SIC) is proposed to locate a change point in the simple linear regression model, as well as in the multiple linear regression model. The method is then applied to a financial data set, and a change point is successfully detected.     

Best linear unbiased estimators of parameters of a simple linear regression model based on ordered ranked set samples

As an alternative to an estimation based on a simple random sample (BLUE-SRS) for the simple linear regression model, Moussa-Hamouda and Leone [E. Moussa-Hamouda and F.C. Leone, The o-blue estimators for complete and censored samples in linear regression, Technometrics, 16 (3) (1974), pp. 441–446.] discussed the best linear unbiased estimators based on order statistics (BLUE-OS), and showed that BLUE-OS is more efficient than BLUE-SRS for normal data. Using the ranked set sampling, Barreto and Barnett [M.C.M. Barreto and V. Barnett, Best linear unbiased estimators for the simple linear regression model using ranked set sampling. Environ. Ecoll. Stat. 6 (1999), pp. 119–133.] derived the best linear unbiased estimators (BLUE-RSS) for simple linear regression model and showed that BLUE-RSS is more efficient for the estimation of the regression parameters (intercept and slope) than BLUE-SRS for normal data, but not so for the estimation of the residual standard deviation in the case of small sample size. As an alternative to RSS, this paper considers the best linear unbiased estimators based on order statistics from a ranked set sample (BLUE-ORSS) and shows that BLUE-ORSS is uniformly more efficient than BLUE-RSS and BLUE-OS for normal data.     

Simultaneous prediction intervals for regression models with an intercept

Consider the usual linear regression model y = x’β+?, relating a response y to a vector of predictors x. Suppose that n observations on y together with the corresponding values of x are available , and it is desired to construct simultaneous prediction intervals for k future values of y at values of x which can not be ascertained beforehand. In most applications the regression model contains an intercept. This paper presents two sets of prediction intervals appropriate to this case. The proposed intervals are compared with those of Carlstein (1986), and the improvements are illustrated in the case of simple linear regression.     

Sample size calculation for method validation using linear regression

In this article, we present a method for sample size calculation for studies involving both the intercept and slope parameters of a simple linear regression model. Some methods have been proposed in the literature to determine the adequate sample size. However, they are usually based on the line slope only. We propose a method based on the F statistic that involves both the intercept and the slope parameters of the model. The validation process is conducted by fitting a simple linear regression model and by testing a zero intercept and unity slope hypothesis. Compared to a traditional method and using Monte Carlo simulations, encouraging results attest for the clear superiority of the proposed method. The article ends with a real-life example showing the value of the new method in practice.     

THE GROUPING PROBLEM IN DISTRIBUTION-FREE PLANAR REGRESSION

In the planar regression model having two slope parameters and identically distributed errors, exact distribution-free inference about one parameter may be carried out by grouping the observations, eliminating the nuisance parameter and reducing the model to simple linear regression, allowing exact distribution-free methods for slope to be employed. This model reduction involves a loss of efficiency: the choice of an optimal grouping to minimize efficiency loss is discussed.     

A note on the behaviour of augmented principal-component plots in regression

A simple formula for the augmented principal components of a linear regression model is derived. The formula allows one to explore certain aspects of the behaviour of principal-component plots. A practical example is discussed     

On f-tests and linear hypothesis in a general linear model

A simple method of setting linear hypotheses testable by F-tests in a general linear model when the covariance matrix has a general form and is completely unknown, is provided. With some additional conditions imposed on the covariance matrix, there exist the UMP invariant tests of certain linear hypotheses. We derive them to compare the powers with those of F-tests obtained under no restrictions on the covariance matrix. The results are illustrated in a multiple regression model with some examples.     

A GRAPHICAL DIAGNOSTIC FOR VARIANCE FUNCTIONS

This paper proposes diagnostic plots for regression variance functions. It shows how to extend graphical methodology that uses Bayesian sampling for checking the regression mean function to also check the variance function. Plots can be constructed quickly and easily for any model of interest. These plots help to identify model weaknesses and can suggest ways to make improvements. The proposed methodology is illustrated with two examples: a simple linear regression model to fix ideas, and a more complex study involving count data to demonstrate the potential for wide application.     

A note on variable selection in functional regression via random subspace method

Variable selection problem is one of the most important tasks in regression analysis, especially in a high-dimensional setting. In this paper, we study this problem in the context of scalar response functional regression model, which is a linear model with scalar response and functional regressors. The functional model can be represented by certain multiple linear regression model via basis expansions of functional variables. Based on this model and random subspace method of Mielniczuk and Teisseyre (Comput Stat Data Anal 71:725–742, 2014), two simple variable selection procedures for scalar response functional regression model are proposed. The final functional model is selected by using generalized information criteria. Monte Carlo simulation studies conducted and a real data example show very satisfactory performance of new variable selection methods under finite samples. Moreover, they suggest that considered procedures outperform solutions found in the literature in terms of correctly selected model, false discovery rate control and prediction error.     

Bayesian spectral analysis models for quantile regression with Dirichlet process mixtures

This paper presents a Bayesian analysis of partially linear additive models for quantile regression. We develop a semiparametric Bayesian approach to quantile regression models using a spectral representation of the nonparametric regression functions and the Dirichlet process (DP) mixture for error distribution. We also consider Bayesian variable selection procedures for both parametric and nonparametric components in a partially linear additive model structure based on the Bayesian shrinkage priors via a stochastic search algorithm. Based on the proposed Bayesian semiparametric additive quantile regression model referred to as BSAQ, the Bayesian inference is considered for estimation and model selection. For the posterior computation, we design a simple and efficient Gibbs sampler based on a location-scale mixture of exponential and normal distributions for an asymmetric Laplace distribution, which facilitates the commonly used collapsed Gibbs sampling algorithms for the DP mixture models. Additionally, we discuss the asymptotic property of the sempiparametric quantile regression model in terms of consistency of posterior distribution. Simulation studies and real data application examples illustrate the proposed method and compare it with Bayesian quantile regression methods in the literature.     

Linear regression through the origin with constant coefficient of variation for the inverse gaussian distribution

A simple linear regression model with no intercept term for the situation where the response variable obeys an inverse Gaussian distribution and the coefficient of variation is an unknown constant is discussed. Maximum likelihood estimators and the confidence limits of the regression parameter are obtained. Finally uniformly minimum variance unbiased estimators of parameters are given.     

Wild Bootstrapping in Finite Populations with Auxiliary Information

Consider a finite population u , which can be viewed as a realization of a super-population model. A simple ratio model (linear regression, without intercept) with heteroscedastic errors is supposed to have generated u . A random sample is drawn without replacement from u . In this set-up a two-stage wild bootstrap resampling scheme as well as several other useful forms of bootstrapping in finite populations will be considered. Some asymptotic results for various bootstrap approximations for normalized and Studentized versions of the well-known ratio and regression estimator are given. Bootstrap based confidence interval s for the population total and for the regression parameter of the underlying ratio model are also discussed     

Robust estimation of variance components

New robust estimates for variance components are introduced. Two simple models are considered: the balanced one-way classification model with a random factor and the balanced mixed model with one random factor and one fixed factor. However, the method of estimation proposed can be extended to more complex models. The new method of estimation we propose is based on the relationship between the variance components and the coefficients of the least-mean-squared-error predictor between two observations of the same group. This relationship enables us to transform the problem of estimating the variance components into the problem of estimating the coefficients of a simple linear regression model. The variance-component estimators derived from the least-squares regression estimates are shown to coincide with the maximum-likelihood estimates. Robust estimates of the variance components can be obtained by replacing the least-squares estimates by robust regression estimates. In particular, a Monte Carlo study shows that for outlier-contaminated normal samples, the estimates of variance components derived from GM regression estimates and the derived test outperform other robust procedures.     

A synthesis of stein-rule and mixed regression procedures inlinear regression models under non-normality

Stein-rule philosophy and mixed regression technique are combined to develop two families of improved estimators of regression coefficients in the linear regression model under incomplete prior information. The properties of these estimators are studied when disturbances are small and non-normal. Conditions for their dominance over mixed regression estimator are derived taking risk as the criterion for performance.     

Inferences on regression coefficients in a regression model under heteroscedasticity and robustness with respect to departure from normality

In this paper we consider a simple linear regression model under heteroscedasticity and nonnormality. A statistical test for testing the regression coefficient is then derived by assuming normality for the random disturbances and by applying Welch's method. Some Monte Carlo studies are generated for assessing robustness of this test. By combining Tiku's robust procedure with the new test, a robust but more powerful test is developed.     

The distribution of a linear predictor after model selection: conditional finite-sample distributions and asymptotic approximations

This paper studies the distribution of a linear predictor that is constructed after a data-driven model selection step in a linear regression model. The finite-sample cumulative distribution function (cdf) of the linear predictor is derived and a detailed analysis of the effects of the model selection step is given. Moreover, a simple approximation to the (complicated) finite-sample cdf is proposed. This approximation facilitates the study of the large-sample limit behavior of the linear predictor and its cdf, in the fixed-parameter case and under local alternatives. The focus of this paper is on the conditional distribution of a linear predictor, conditional on the event that a fixed (possibly incorrect) model has been selected. The unconditional distribution of a linear predictor is studied in the companion paper Leeb (The distribution of a linear predictor after model selection: unconditional finite-sample distributions and asymptotic approximations, Technical Report, Department of Statistics, University of Vienna, 2002).     

A study of regression calibration in a partially observed stratified Cox model

Regression calibration is a simple method for estimating regression models when covariate data are missing for some study subjects. It consists in replacing an unobserved covariate by an estimator of its conditional expectation given available covariates. Regression calibration has recently been investigated in various regression models such as the linear, generalized linear, and proportional hazards models. The aim of this paper is to investigate the appropriateness of this method for estimating the stratified Cox regression model with missing values of the covariate defining the strata. Despite its practical relevance, this problem has not yet been discussed in the literature. Asymptotic distribution theory is developed for the regression calibration estimator in this setting. A simulation study is also conducted to investigate the properties of this estimator.