Converting observed likelihood to levels of significance for transformation models

Inference for a scalar parameter in the pressence of nuisance parameters requires high dimensional integrations of the joint density of the pivotal quantities. Recent development in asymptotic methods provides accurate approximations for significance levels and thus confidence intervals for a scalar component parameter. In this paper, a simple, efficient and accurate numerical procedure is first developed for the location model and is then extended to the location-scale model and the linear regression model. This numerical procedure only requires a fine tabulation of the parameter and the observed log likelihood function, which can be either the full, marginal or conditional observed log likelihood function, as input and output is the corresponding significance function. Numerical results showed that this approximation is not only simple but also very accurate. It outperformed the usual approximations such as the signed likelihood ratio statistic, the maximum likelihood estimate and the score statistic.     

Inference for a Simple Step-Stress Model with Type-I Censoring and Lognormally Distributed Lifetimes

Accelerated life-testing (ALT) is a very useful technique for examining the reliability of highly reliable products. It allows the experimenter to obtain failure data more quickly at increased stress levels than under normal operating conditions. A step-stress model is one special class of ALT, and in this article we consider a simple step-stress model under the cumulative exposure model with lognormally distributed lifetimes in the presence of Type-I censoring. We then discuss inferential methods for the unknown parameters of the model by the maximum likelihood estimation method. Some numerical methods, such as the Newton–Raphson and quasi-Newton methods, are discussed for solving the corresponding non-linear likelihood equations. Next, we discuss the construction of confidence intervals for the unknown parameters based on (i) the asymptotic normality of the maximum likelihood estimators (MLEs), and (ii) parametric bootstrap resampling technique. A Monte Carlo simulation study is carried out to examine the performance of these methods of inference. Finally, a numerical example is presented in order to illustrate all the methods of inference developed here.     

A mixture of the manova and gmanova models

A mixture of the MANOVA and GMANOVA models is presented. The expected value of the response matrix in this model is the sum of two matrix components. The first component represents the GMANOVA portion and the second component represents the MANOVA portion. Maximum likelihood estimators are derived for the parameters in this model, and goodness-of-fit tests are constructed for fuller models via the likelihood ration criterion. Finally, likelihood ration tests for general liinear hypotheses are developed and a numerical example is presented.     

Regression for censored survival data with lag effects

We consider regression modeling of survival data subject to right censoring when the full effect of some covariates (e.g. treatment) may be delayed. Several models are proposed, and methods for computing the maximum likelihood estimates of the parameters are described. Consistency and asymptotic normality properties of the estimators are derived. Some numerical examples are used to illustrate the implementation of the modeling and estimation procedures. Finally we apply the theory to interim data from a large scale randomized clinical trial for the prevention of skin cancer.     

Modified likelihood ratio statistics for inflated beta regressions

The class of inflated beta regression models generalizes that of beta regressions [S.L.P. Ferrari and F. Cribari-Neto, Beta regression for modelling rates and proportions, J. Appl. Stat. 31 (2004), pp. 799–815] by incorporating a discrete component that allows practitioners to model data on rates and proportions with observations that equal an interval limit. For instance, one can model responses that assume values in (0, 1]. The likelihood ratio test tends to be quite oversized (liberal, anticonservative) in inflated beta regressions estimated with a small number of observations. Indeed, our numerical results show that its null rejection rate can be almost twice the nominal level. It is thus important to develop alternative testing strategies. This paper develops small-sample adjustments to the likelihood ratio and signed likelihood ratio test statistics in inflated beta regression models. The adjustments do not require orthogonality between the parameters of interest and the nuisance parameters and are fairly simple since they only require first- and second-order log-likelihood cumulants. Simulation results show that the modified likelihood ratio tests deliver much accurate inference in small samples. An empirical application is presented and discussed.     

Relative Risk Regression for Binary Outcomes: Methods and Recommendations

Relative risks are often considered preferable to odds ratios for quantifying the association between a predictor and a binary outcome. Relative risk regression is an alternative to logistic regression where the parameters are relative risks rather than odds ratios. It uses a log link binomial generalised linear model, or log‐binomial model, which requires parameter constraints to prevent probabilities from exceeding 1. This leads to numerical problems with standard approaches for finding the maximum likelihood estimate (MLE), such as Fisher scoring, and has motivated various non‐MLE approaches. In this paper we discuss the roles of the MLE and its main competitors for relative risk regression. It is argued that reliable alternatives to Fisher scoring mean that numerical issues are no longer a motivation for non‐MLE methods. Nonetheless, non‐MLE methods may be worthwhile for other reasons and we evaluate this possibility for alternatives within a class of quasi‐likelihood methods. The MLE obtained using a reliable computational method is recommended, but this approach requires bootstrapping when estimates are on the parameter space boundary. If convenience is paramount, then quasi‐likelihood estimation can be a good alternative, although parameter constraints may be violated. Sensitivity to model misspecification and outliers is also discussed along with recommendations and priorities for future research.     

Generalized empirical likelihood inference in partial linear regression model for longitudinal data

In this paper, empirical likelihood inference for longitudinal data within the framework of partial linear regression models are investigated. The proposed procedures take into consideration the correlation within groups without involving direct estimation of nuisance parameters in the correlation matrix. The empirical likelihood method is used to estimate the regression coefficients and the baseline function, and to construct confidence intervals. A nonparametric version of Wilk's theorem for the limiting distribution of the empirical likelihood ratio is derived. Compared with methods based on normal approximations, the empirical likelihood does not require consistent estimators for the asymptotic variance and bias. The finite sample behaviour of the proposed method is evaluated with simulation and illustrated with an AIDS clinical trial data set.     

Approximate Inference for the Factor Loading of a Simple Factor Analysis Model

We study a factor analysis model with two normally distributed observations and one factor. Two approximate conditional inference procedures for the factor loading are developed. The first proposal is a very simple procedure but it is not very accurate. The second proposal gives extremely accurate results even for very small sample size. Moreover, the calculations require only the signed log-likelihood ratio statistic and a measure of the standardized maximum likelihood departure. Simulations are used to study the accuracy of the proposed procedures.     

Empirical likelihood for nonlinear regression models with nonignorable missing responses

This article develops three empirical likelihood (EL) approaches to estimate parameters in nonlinear regression models in the presence of nonignorable missing responses. These are based on the inverse probability weighted (IPW) method, the augmented IPW (AIPW) method and the imputation technique. A logistic regression model is adopted to specify the propensity score. Maximum likelihood estimation is used to estimate parameters in the propensity score by combining the idea of importance sampling and imputing estimating equations. Under some regularity conditions, we obtain the asymptotic properties of the maximum EL estimators of these unknown parameters. Simulation studies are conducted to investigate the finite sample performance of our proposed estimation procedures. Empirical results provide evidence that the AIPW procedure exhibits better performance than the other two procedures. Data from a survey conducted in 2002 are used to illustrate the proposed estimation procedure. The Canadian Journal of Statistics 48: 386–416; 2020 © 2020 Statistical Society of Canada     

A doubly restricted exponential dispersion model

In this paper, we propose and develop a doubly restricted exponential dispersion model, i.e. a varying dispersion generalized linear model with two sets of restrictions, a set of linear restrictions for the mean response, and at the same time, for another set of linear restrictions for the dispersion of the distribution. This model would be useful to consider several situations where it is necessary to control/analyze drug-doses, active effects in factorial experiments, mean-variance relationships, among other situations. A penalized likelihood function is proposed and developed in order to achieve the restricted parameters and to develop the inferential results. Several special cases from the literature are commented on. A simply restricted varying dispersion beta regression model is exemplified by means of real and simulated data. Satisfactory and promising results are found.     

Variable order ante-dependence models

Ante-dependence models can be used to model the covariance structure in problems involving repeated measures through time. They are conditional regression models which generalize Gabriel’s constant-order ante-dependence model. Likelihood-based procedures are presented, together with simple expressions for likelihood ratio test statistics in terms of sum of squares from appropriate analysis of covariance. The estimation of the orders is approached as a model selection problem, and penalized likelihood criteria are suggested. Extensions of all procedures discussed here to situations with a monotone pattern of missing data are presented.     

Bartlett-corrected tests for normal linear models when the error covariance matrix is nonscaiar

This paper provides Bartlett corrections to improve likelihood ratio tests for heteroskedastic normal linear models when the error covariance matrix is nonscaiar and depends on a set of unknown parameters. The Bartlett corrections are simple enough to be used algebraically to obtain several closed-form expressions in special cases. The corrections have also advantages for numerical purposes because they involve only simple operations on matrices and vectors.     

Joint estimation of the mean and dispersion parameters in the analysis of proportions: A comparison of efficiency and bias

This paper deals with joint estimation of the mean and dispersion parameters in the analysis of proportions. We consider a parametric model, namely the extended beta-binomial model, and several semiparametric procedures. We study large-sample efficiency and small-sample bias and efficiency properties of the estimates of the mean and intraclass correlation parameters. Estimation and efficiency calculations are présentés for the regression model. However, for simplicity, numerical large-sample efficiency and small-sample bias and efficiency calculations are performed for the two-parameter model only. Numerical efficiency results are présentés in terms of graphs. Estimated asymptotic efficiencies of various estimates are also compared for two data sets. Our findings suggest that for the estimation of the mean (regression) parameters the quasilikelihood procedure performs best. However, for the joint estimation, the Gaussian likelihood estimates perform best.     

Estimation and diagnostics for heteroscedastic nonlinear regression models based on scale mixtures of skew-normal distributions

An extension of some standard likelihood based procedures to heteroscedastic nonlinear regression models under scale mixtures of skew-normal (SMSN) distributions is developed. This novel class of models provides a useful generalization of the heteroscedastic symmetrical nonlinear regression models (Cysneiros et al., 2010), since the random term distributions cover both symmetric as well as asymmetric and heavy-tailed distributions such as skew-t, skew-slash, skew-contaminated normal, among others. A simple EM-type algorithm for iteratively computing maximum likelihood estimates of the parameters is presented and the observed information matrix is derived analytically. In order to examine the performance of the proposed methods, some simulation studies are presented to show the robust aspect of this flexible class against outlying and influential observations and that the maximum likelihood estimates based on the EM-type algorithm do provide good asymptotic properties. Furthermore, local influence measures and the one-step approximations of the estimates in the case-deletion model are obtained. Finally, an illustration of the methodology is given considering a data set previously analyzed under the homoscedastic skew-t nonlinear regression model.     

Estimation of the multi-criteria worths of the alternatives in a hierarchical structure of comparisons

The aggregated worths of the alternatives, when compared with respect to several criteria, are estimated in a hierarchical comparisons model introduced by Saaty (1980). A multiplicative model is used for the paired comparisons data which are collected in a ratio scale in this set-up in any level of this hierarchy. An iterative scheme is found for the maximum likelihood estimation of the worth parameters in this multiplicative model. The iterative values are shown to be convergent monotonically to the estimates. We also obtain the asymptotic dispersion matrix of the maximum likelihood estimates of the relative worths of the alternatives according to a single criterion as well as those according to the over-all suitability when compared under several criteria. A numerical example is presented to illustrate the method developed in this paper. Simulation techniques are employed to find the average number of iterations required for the convergence of the above iterative scheme.     

Statistical Inference for a New Class of Multivariate Pareto Distributions

Various solutions to the parameter estimation problem of a recently introduced multivariate Pareto distribution are developed and exemplified numerically. Namely, a density of the aforementioned multivariate Pareto distribution with respect to a dominating measure, rather than the corresponding Lebesgue measure, is specified and then employed to investigate the maximum likelihood estimation (MLE) approach. Also, in an attempt to fully enjoy the common shock origins of the multivariate model of interest, an adapted variant of the expectation-maximization (EM) algorithm is formulated and studied. The method of moments is discussed as a convenient way to obtain starting values for the numerical optimization procedures associated with the MLE and EM methods.     

Linear regression through the origin with constant coefficient of variation for the inverse gaussian distribution

A simple linear regression model with no intercept term for the situation where the response variable obeys an inverse Gaussian distribution and the coefficient of variation is an unknown constant is discussed. Maximum likelihood estimators and the confidence limits of the regression parameter are obtained. Finally uniformly minimum variance unbiased estimators of parameters are given.     

Inferences in dynamic logit models in semi-parametric setup for repeated binary data

Binary dynamic fixed and mixed logit models are extensively studied in the literature. These models are developed to examine the effects of certain fixed covariates through a parametric regression function as a part of the models. However, there are situations where one may like to consider more covariates in the model but their direct effect is not of interest. In this paper we propose a generalization of the existing binary dynamic logit (BDL) models to the semi-parametric longitudinal setup to address this issue of additional covariates. The regression function involved in such a semi-parametric BDL model contains (i) a parametric linear regression function in some primary covariates, and (ii) a non-parametric function in certain secondary covariates. We use a simple semi-parametric conditional quasi-likelihood approach for consistent estimation of the non-parametric function, and a semi-parametric likelihood approach for the joint estimation of the main regression and dynamic dependence parameters of the model. The finite sample performance of the estimation approaches is examined through a simulation study. The asymptotic properties of the estimators are also discussed. The proposed model and the estimation approaches are illustrated by reanalysing a longitudinal infectious disease data.     

Local Linear Estimation for Time-Dependent Coefficients in Cox's Regression Models

This article develops a local partial likelihood technique to estimate the time-dependent coefficients in Cox's regression model. The basic idea is a simple extension of the local linear fitting technique used in the scatterplot smoothing. The coefficients are estimated locally based on the partial likelihood in a window around each time point. Multiple time-dependent covariates are incorporated in the local partial likelihood procedure. The procedure is useful as a diagnostic tool and can be used in uncovering time-dependencies or departure from the proportional hazards model. The programming involved in the local partial likelihood estimation is relatively simple and it can be modified with few efforts from the existing programs for the proportional hazards model. The asymptotic properties of the resulting estimator are established and compared with those from the local constant fitting. A consistent estimator of the asymptotic variance is also proposed. The approach is illustrated by a real data set from the study of gastric cancer patients and a simulation study is also presented.