Defining the linear portion of a sigmoid‐shaped curve: bend points

Formulae are provided that define the ‘bend points’, the beginning and end of the essentially linear dose–response region, for the four‐parameter logistic model. The formulae are expressed in both response and dose units. The derivation of the formulae is shown in order to illustrate the general nature of the methodology. Examples are given that describe how the formulae may be used while planning and conducting bioassays. Copyright © 2003 John Wiley & Sons, Ltd.     

RECURSIVE ESTIMATION OF THE GENERAL LINEAR MODEL WITH DEPENDENT ERRORS AND MULTIPLE ADDITIONAL OBSERVATIONS1

The techniques for recursive estimation of the general linear model with dependent errors and known second order properties, is generalised to allow for simultaneous addition of an arbitrary number of additional observations. Computational formulae for recursive updating of parameter estimates are derived, together with a sequence of univariate recursive residuals for testing the constancy of the regression relation over time.     

An Alternative Estimation Approach for the Heterogeneity Linear Mixed Model

In this article, an alternative estimation approach is proposed to fit linear mixed effects models where the random effects follow a finite mixture of normal distributions. This heterogeneity linear mixed model is an interesting tool since it relaxes the classical normality assumption and is also perfectly suitable for classification purposes, based on longitudinal profiles. Instead of fitting directly the heterogeneity linear mixed model, we propose to fit an equivalent mixture of linear mixed models under some restrictions which is computationally simpler. Unlike the former model, the latter can be maximized analytically using an EM-algorithm and the obtained parameter estimates can be easily used to compute the parameter estimates of interest.     

On Necessary and Sufficient Conditions for Ordinary Least Squares Estimators to Be Best Linear Unbiased Estimators

Two often-quoted necessary and sufficient conditions for ordinary least squares estimators to be best linear unbiased estimators are described. Another necessary and sufficient condition is described, providing an additional tool for checking to see whether the covariance matrix of a given linear model is such that the ordinary least squares estimator is also the best linear unbiased estimator. The new condition is used to show that one of the two published conditions is only a sufficient condition.     

Sample size determination for the parallel model in a survey with sensitive questions

Recently, a new non-randomized parallel design is proposed by Tian (2013) for surveys with sensitive topics. However, the sample size formulae associated with testing hypotheses for the parallel model are not yet available. As a crucial component in surveys, the sample size formulae with the parallel design are developed in this paper by using the power analysis method for both the one- and two-sample problems. We consider both the one- and two-sample problems. The asymptotic power functions and the corresponding sample size formulae for both the one- and two-sided tests based on the large-sample normal approximation are derived. The performance is assessed through comparing the asymptotic power with the exact power and reporting the ratio of the sample sizes with the parallel model and the design of direct questioning. We numerically compare the sample sizes needed for the parallel design with those required for the crosswise and triangular models. Two theoretical justifications are also provided. An example from a survey on ‘sexual practices’ in San Francisco, Las Vegas and Portland is used to illustrate the proposed methods.     

Detection of outliers in mixed regressive-spatial autoregressive models

ABSTRACT

This article studies the outlier detection problem in mixed regressive-spatial autoregressive model. The formulae for testing outliers and their approximate distributions are derived under the mean-shift model and the variance-weight model, respectively. The simulation studies are conducted for examining the power and size of the test, as well as for the detection of outliers when a simulated data contains several outliers. A real data is analyzed to illustrate the proposed method, and modified models based on mean-shift and variance-weight models in which detected outliers are taken into account are suggested to deal with the outliers and confirm theconclusions.     

Additional variables and adjusted estimates with arbitrary known variance-covariance structure

When additional variables are fitted in a linear model under arbitrary known variance-covariance struture, the extra sum of squares due to fitting the new variables and adjusted parameter estimates can be computed in an efficient manner without actually explicity fitting the entire augmented model. When the additional variables are specific dummy variables, downdating formulae are readily obtained, thus generatina methods which are well known for the linear model with variance-covariance structure σ²I. Two different methods to downdate a linear model are presented.     

The bivariate linear model: a geometris approach

The geometric approach to the general linear model is in accessible to the majorityof statistics students be cause the computations require matrix algebra.This article presents the geometric approach for the special case of the bivariate linear model,for which the only tool require dis the in ner product.The geometric approach is introduced by showing the dual2-dimensional and5-dimensional representations of several bivariate samples x of size5.The assumptions of the bivariate model are stated geometrically,and the distributions of the regression coefficient sare derived.Theanalysis of variance(ANOVA)right triangle is pictured and the sides of the triang leare associated with their corresponding entries in the ANOVA table.     

CONDITIONAL EXPECTATION FORMULAE FOR COPULAS

Not only are copula functions joint distribution functions in their own right, they also provide a link between multivariate distributions and their lower‐dimensional marginal distributions. Copulas have a structure that allows us to characterize all possible multivariate distributions, and therefore they have the potential to be a very useful statistical tool. Although copulas can be traced back to 1959, there is still much scope for new results, as most of the early work was theoretical rather than practical. We focus on simple practical tools based on conditional expectation, because such tools are not widely available. When dealing with data sets in which the dependence throughout the sample is variable, we suggest that copula‐based regression curves may be more accurate predictors of specific outcomes than linear models. We derive simple conditional expectation formulae in terms of copulas and apply them to a combination of simulated and real data.     

Bias correction and improved residuals for non-exponential family nonlinear models

In this paper we derive general formulae for the biases to order n ^?1 of the parameter estimates in a general class of nonlinear regression models, where n is the sample size. The formulae are related to those of Cordeiro and McCullagh (1991) and Paula (1992) and may be viewed as extensions of their results, Correction factors are derived for the score and deviance component residuals in these models. The practical use of such corrections is illustrated for the log-gamma model.     

Sample size estimation for non-inferiority trials of time-to-event data

We consider the problem of sample size calculation for non-inferiority based on the hazard ratio in time-to-event trials where overall study duration is fixed and subject enrollment is staggered with variable follow-up. An adaptation of previously developed formulae for the superiority framework is presented that specifically allows for effect reversal under the non-inferiority setting, and its consequent effect on variance. Empirical performance is assessed through a small simulation study, and an example based on an ongoing trial is presented. The formulae are straightforward to program and may prove a useful tool in planning trials of this type.     

A mixture-based approach to robust analysis of generalised linear models

A method for robustness in linear models is to assume that there is a mixture of standard and outlier observations with a different error variance for each class. For generalised linear models (GLMs) the mixture model approach is more difficult as the error variance for many distributions has a fixed relationship to the mean. This model is extended to GLMs by changing the classes to one where the standard class is a standard GLM and the outlier class which is an overdispersed GLM achieved by including a random effect term in the linear predictor. The advantages of this method are it can be extended to any model with a linear predictor, and outlier observations can be easily identified. Using simulation the model is compared to an M-estimator, and found to have improved bias and coverage. The method is demonstrated on three examples.     

Short notes on maximum likelihood inference for control‐based pattern‐mixture models

A likelihood‐based analytical approach has been proposed for the control‐based pattern‐mixture model and its extension. In this note, we derive equivalent but simpler analytical expressions for the treatment effect and its variance for these control‐based pattern mixture models. Our formulae are easier to use and interpret. An application of our formulae to an antidepressant trial is provided, in which the likelihood‐based analysis is compared with the multiple imputation approach. Copyright © 2015 John Wiley & Sons, Ltd.     

ESTIMATION PROCEDURES FOR CATEGORICAL SURVEY DATA WITH NONIGNORABLE NONRESPONSE

We consider surveys with one or more callbacks and use a series of logistic regressions to model the probabilities of nonresponse at first contact and subsequent callbacks. These probabilities are allowed to depend on covariates as well as the categorical variable of interest and so the nonresponse mechanism is nonignorable. Explicit formulae for the score functions and information matrices are given for some important special cases to facilitate implementation of the method of scoring for obtaining maximum likelihood estimates of the model parameters. For estimating finite population quantities, we suggest the imputation and prediction approaches as alternatives to weighting adjustment. Simulation results suggest that the proposed methods work well in reducing the bias due to nonresponse. In our study, the imputation and prediction approaches perform better than weighting adjustment and they continue to perform quite well in simulations involving misspecified response models.     

THE AUTOREGRESSIVE MOVING AVERAGE MODEL FOR SPATIAL ANALYSIS

A two dimensional autoregressive moving average spatial model is used to analyse spatial interaction. Maximum likelihood estimates of the unknown parameters are derived as the solution of a system of nonlinear equations, and are shown to be best asymptotic normal. One important computational procedure is discussed. The argument is extended to the general regression model with autoregressive moving average residuals. Explicit computational formulae are given.     

Two-sample Non Randomized Response Techniques for Sensitive Questions

The problem facing most researchers is how to encourage participants to respond, and then to provide truthful response in surveys with sensitive questions. In this article, we consider a non randomized triangular model for testing the equality of the proportions of people with a sensitive characteristic between two independent populations. We derive the Wald, score, and likelihood ratio tests. Their respective sample size formulae are developed as well. Simulation studies are conducted to evaluate the performance of the three proposed test procedures, which show that the score test outperforms the other two.     

Analytical closed-form solution for binary logit regression by categorical predictors

In contrast to the common belief that the logit model has no analytical presentation, it is possible to find such a solution in the case of categorical predictors. This paper shows that a binary logistic regression by categorical explanatory variables can be constructed in a closed-form solution. No special software and no iterative procedures of nonlinear estimation are needed to obtain a model with all its parameters and characteristics, including coefficients of regression, their standard errors and t-statistics, as well as the residual and null deviances. The derivation is performed for logistic models with one binary or categorical predictor, and several binary or categorical predictors. The analytical formulae can be used for arithmetical calculation of all the parameters of the logit regression. The explicit expressions for the characteristics of logit regression are convenient for the analysis and interpretation of the results of logistic modeling.     

Some Second-Order Asymptotics for Extreme Value Linear Regression Models

ABSTRACT

In this article we derive finite-sample corrections in matrix notation for likelihood ratio and score statistics in extreme-value linear regression models. We consider three corrected score tests that perform better than the usual score test. We also derive general formulae for second-order biases of maximum likelihood estimates of the linear parameters. Some simulations are performed to compare the likelihood ratio and score statistics with their modified versions and to illustrate the bias correction.     

Adjusted Pearson residuals in exponential family nonlinear models

In this paper, we give matrix formulae of order 𝒪(n ^?1), where n is the sample size, for the first two moments of Pearson residuals in exponential family nonlinear regression models [G.M. Cordeiro and G.A. Paula, Improved likelihood ratio statistic for exponential family nonlinear models, Biometrika 76 (1989), pp. 93–100.]. The formulae are applicable to many regression models in common use and generalize the results by Cordeiro [G.M. Cordeiro, On Pearson's residuals in generalized linear models, Statist. Prob. Lett. 66 (2004), pp. 213–219.] and Cook and Tsai [R.D. Cook and C.L. Tsai, Residuals in nonlinear regression, Biometrika 72(1985), pp. 23–29.]. We suggest adjusted Pearson residuals for these models having, to this order, the expected value zero and variance one. We show that the adjusted Pearson residuals can be easily computed by weighted linear regressions. Some numerical results from simulations indicate that the adjusted Pearson residuals are better approximated by the standard normal distribution than the Pearson residuals.     

Influence diagnostics and outlier tests for semiparametric mixed models

Summary. Semiparametric mixed models are useful in biometric and econometric applications, especially for longitudinal data. Maximum penalized likelihood estimators (MPLEs) have been shown to work well by Zhang and co-workers for both linear coefficients and nonparametric functions. This paper considers the role of influence diagnostics in the MPLE by extending the case deletion and subject deletion analysis of linear models to accommodate the inclusion of a nonparametric component. We focus on influence measures for the fixed effects and provide formulae that are analogous to those for simpler models and readily computable with the MPLE algorithm. We also establish an equivalence between the case or subject deletion model and a mean shift outlier model from which we derive tests for outliers. The influence diagnostics proposed are illustrated through a longitudinal hormone study on progesterone and a simulated example.