Estimation of odds ratios under order restrictions

A new method for estimating a set of odds ratios under an order restriction based on estimating equations is proposed. The method is applied to those of the conditional maximum likelihood estimators and the Mantel-Haenszel estimators. The estimators derived from the conditional likelihood estimating equations are shown to maximize the conditional likelihoods. It is also seen that the restricted estimators converge almost surely to the respective odds ratios when the respective sample sizes become large regularly. The restricted estimators are compared with the unrestricted maximum likelihood estimators by a Monte Carlo simulation. The simulation studies show that the restricted estimates improve the mean squared errors remarkably, while the Mantel-Haenszel type estimates are competitive with the conditional maximum likelihood estimates, being slightly worse.     

Odds ratio inference from stratified samples

One of the common problems encountered in applied statistics is that of comparing two proportions from stratified samples. One approach to this problem is via inference on the corresponding odds ratio. In this paper, the various point and interval estimators of and hypothesis testing procedures for a common odds ratio from multiple 2 ×2 tables are reviewed. Based On research to date, the conditional maximum likelihood and Mantel-Haenszel estimators are recommended as the point estimators of choice. Neither confidence intervals nor hypothesis testing metthods have been studied as well as the point estimators, but there is a confidence interval method associated with the Mantel-Haenszel estimator that is a good choice.     

Maximum Likelihood Estimation of the Log-Binomial Model

Maximum likelihood estimation of prevalence ratios using the log-binomial model is problematic when the estimates are on the boundary of the parameter space. When the model is correct, maximum likelihood is often the method of choice. The authors provide a theorem, formulas, and methodology for obtaining maximum likelihood estimators of the log-binomial model and their estimated standard errors when the solution is on the boundary of the parameter space. Examples are given to illustrate the method.     

Adjustment of provisional mortality series: the dynamic linear model with structured measurement errors

The authors "consider the problem of adjusting provisional time series using a bivariate structural model with correlated measurement errors. Maximum likelihood estimators and a minimum mean squared error adjustment procedure are derived for a provisional and final series containing common trend and seasonal components. The model also includes measurement errors common to both series and errors that are specific to the provisional series. [The authors] illustrate the technique by using provisional data to forecast ischemic heart disease mortality."     

Box‐Cox transformations in linear models: Large sample theory and tests of normality

The authors provide a rigorous large sample theory for linear models whose response variable has been subjected to the Box‐Cox transformation. They provide a continuous asymptotic approximation to the distribution of estimators of natural parameters of the model. They show, in particular, that the maximum likelihood estimator of the ratio of slope to residual standard deviation is consistent and relatively stable. The authors further show the importance for inference of normality of the errors and give tests for normality based on the estimated residuals. For non‐normal errors, they give adjustments to the log‐likelihood and to asymptotic standard errors.     

A note on the prospective analysis of outcome-dependent samples

Summary. Two likelihood representations corresponding to the prospective and retrospective analyses of the case–control design are derived for general outcome-dependent samples with arbitrary discrete or continuous outcomes and possibly non-multiplicative models. Parameter identification in the general outcome-dependent design is reduced to the simple problem of parameter identification in the general odds ratio function. Both likelihoods are shown to generate the same profile likelihood for the common parameter of interest. Maximum like- lihood estimators based on either likelihood are semiparametric efficient for the identifiable parameters.     

A Bivariate Geometric Distribution with Applications to Reliability

This article studies a bivariate geometric distribution (BGD) as a plausible reliability model. Maximum likelihood and Bayes estimators of parameters and various reliability characteristics are obtained. Approximations to the mean, variance, and Bayes risk of these estimators have been derived using Taylor's expansion. A Monte-Carlo simulation study has been performed to compare these estimators. At the end, the theory is illustrated with a real data set example of accidents.     

Estimation of Measures in M/M/1 Queue

Maximum likelihood and uniform minimum variance unbiased estimators of steady-state probability distribution of system size, probability of at least ? customers in the system in steady state, and certain steady-state measures of effectiveness in the M/M/1 queue are obtained/derived based on observations on X, the number of customer arrivals during a service time. The estimators are compared using Asympotic Expected Deficiency (AED) criterion leading to recommendation of uniform minimum variance unbiased estimators over maximum likelihood estimators for some measures.     

Near universal consistency of the maximum pseudolikelihood estimator for discrete models

Maximum pseudolikelihood (MPL) estimators are useful alternatives to maximum likelihood (ML) estimators when likelihood functions are more difficult to manipulate than their marginal and conditional components. Furthermore, MPL estimators subsume a large number of estimation techniques including ML estimators, maximum composite marginal likelihood estimators, and maximum pairwise likelihood estimators. When considering only the estimation of discrete models (on a possibly countably infinite support), we show that a simple finiteness assumption on an entropy-based measure is sufficient for assessing the consistency of the MPL estimator. As a consequence, we demonstrate that the MPL estimator of any discrete model on a bounded support will be consistent. Our result is valid in parametric, semiparametric, and nonparametric settings.     

Modified profile likelihood estimation for the Weibull regression models in survival analysis

In this study, adjustment of profile likelihood function of parameter of interest in presence of many nuisance parameters is investigated for survival regression models. Our objective is to extend the Barndorff–Nielsen’s technique to Weibull regression models for estimation of shape parameter in presence of many nuisance and regression parameters. We conducted Monte-Carlo simulation studies and a real data analysis, all of which demonstrate and suggest that the modified profile likelihood estimators outperform the profile likelihood estimators in terms of three comparison criterion: mean squared errors, bias and standard errors.     

The Multivariate Split Normal Distribution and Asymmetric Principal Components Analysis

The multivariate split normal distribution extends the usual multivariate normal distribution by a set of parameters which allows for skewness in the form of contraction/dilation along a subset of the principal axes. This article derives some properties for this distribution, including its moment generating function, multivariate skewness, and kurtosis, and discusses its role as a population model for asymmetric principal components analysis. Maximum likelihood estimators and a complete Bayesian analysis, including inference on the number of skewed dimensions and their directions, are presented.     

Standard errors for the parameters of graphical Gaussian models

The comparison of an estimated parameter to its standard error, the Wald test, is a well known procedure of classical statistics. Here we discuss its application to graphical Gaussian model selection. First we derive the Fisher information matrix and its inverse about the parameters of any graphical Gaussian model. Both the covariance matrix and its inverse are considered and a comparative analysis of the asymptotic behaviour of their maximum likelihood estimators (m.l.e.s) is carried out. Then we give an example of model selection based on the standard errors. The method is shown to produce almost identical inference to likelihood ratio methods in the example considered.     

Bayesian Estimation for Poisson-exponential Model under Progressive Type-II Censoring Data with Binomial Removal and Its Application to Ovarian Cancer Data

In this article, we propose Maximum likelihood estimators (MLEs) and Bayes estimators of parameters of Poisson-exponential distribution (PED) under General entropy loss function (GELF) and Squared error loss function (SELF) for Progressive type-II censored data with binomial removals (PT-II CBRs). The MLEs and corresponding Bayes estimators are compared in terms of their risks based on simulated samples from PED. The proposed methodology is illustrated on a real dataset of ovarian cancer.     

Estimation in the singly truncated weibull distribution with an unknown truncation point

When truncation points are unknown, they must be treated as additional parameters to be estimated from the sample data. In this article, estimators are derived for the truncation parameter in addition to basic parameters of both 1eft and riqht sing1y truncated Weibull distributions, Maximum likelihood estimators and estimators involving expected values of appropriate order statistics are derived, Asymptotic sampling errors of estimates are also given, Ill ustrative examples are inc1uded.     

On mantel-haenszel type estimators in simple nested case-control studies

We are concerned with nested case-control studies in this article. For proportional hazards model, a class of over-all estimators of hazard ratios is presented when simple samples are drawn from risk sets. These estimators have the form of the Mantel-Haenszel estimator of odds ratio, and are consistent not only for large strata, but also for sparse data. Consistent estimators of the variances of the proposed hazard ratio estimators are also developed. An example is given to illustrate the proposed estimators.     

Robustness of three power transformation estimation procedures

Maximum likelihood, goodness-of-fit, and symmetric percentile estimators of the power transformation parameterp, are considered. The comparative robustness of each estimation procedure is evaluated when the transformed data can be made symmetric, but may not necessarily be normal. Seven types of symmetric distributions are considered as well as four contaminated normal distributions over a range of six p values for samples of size 25, 50, and 100. The results indicate that the maximum likelihood estimator was slightly better than the goodness-of-fit estimator, but both were greatly superior to the percentile estimator. In general, the procedures were robust to distributional symmetric departures from normality, but increasing kurtosis caused appreciable increases in variation for estimated p values. The variability of p was found to decrease more than exponentially with decreases in the underlying normal distribution coefficient of variation. The standard likelihood ratio confidence interval procedure was found not to be generally useful.     

Estimation of a linear transformation and an associated distributional problem

A multivariate “errors in variables” regression model is proposed which generalizes a model previously considered by Gleser and Watson (1973). Maximum likelihood estimators [MLE's] for the parameters of this model are obtained, and the consistency properties of these estimators are investigated. Distribution of the MLE of the “error” variance is obtained in a simple case while the mean and the variance of the estimator are obtained in this case without appealing to the exact distribution.     

Variance components estimation for the balanced random effects model under mixed prior distributions

For the balanced random effects models, when the variance components are correlated either naturally or through common prior structures, by assuming a mixed prior distribution for the variance components, we propose some new Bayesian estimators. To contrast and compare the new estimators with the minimum variance unbiased (MVUE) and restricted maximum likelihood estimators (RMLE), some simulation studies are also carried out. It turns out that the proposed estimators have smaller mean squared errors than the MVUE and RMLE.     

Imputation of missing variance data using non-linear mixed effects modelling to enable an inverse variance weighted meta-analysis of summary-level longitudinal data: a case study

Missing variances, on the basis of the summary-level data, can be a problem when an inverse variance weighted meta-analysis is undertaken. A wide range of approaches in dealing with this issue exist, such as excluding data without a variance measure, using a function of sample size as a weight and imputing the missing standard errors/deviations. A non-linear mixed effects modelling approach was taken to describe the time-course of standard deviations across 14 studies. The model was then used to make predictions of the missing standard deviations, thus, enabling a precision weighted model-based meta-analysis of a mean pain endpoint over time. Maximum likelihood and Bayesian approaches were implemented with example code to illustrate how this imputation can be carried out and to compare the output from each method. The resultant imputations were nearly identical for the two approaches. This modelling approach acknowledges the fact that standard deviations are not necessarily constant over time and can differ between treatments and across studies in a predictable way.     

A comparison of some robust,adaptive, and partially adaptive estimators of regression models

Numerous estimation techniques for regression models have been proposed. These procedures differ in how sample information is used in the estimation procedure. The efficiency of least squares (OLS) estimators implicity assumes normally distributed residuals and is very sensitive to departures from normality, particularly to "outliers" and thick-tailed distributions. Lead absolute deviation (LAD) estimators are less sensitive to outliers and are optimal for laplace random disturbances, but not for normal errors. This paper reports monte carlo comparisons of OLS,LAD, two robust estimators discussed by huber, three partially adaptiveestimators, newey's generalized method of moments estimator, and an adaptive maximum likelihood estimator based on a normal kernal studied by manski. This paper is the first to compare the relative performance of some adaptive robust estimators (partially adaptive and adaptive procedures) with some common nonadaptive robust estimators. The partially adaptive estimators are based on three flxible parametric distributions for the errors. These include the power exponential (Box-Tiao) and generalized t distributions, as well as a distribution for the errors, which is not necessarily symmetric. The adaptive procedures are "fully iterative" rather than one step estimators. The adaptive estimators have desirable large sample properties, but these properties do not necessarily carry over to the small sample case.

The monte carlo comparisons of the alternative estimators are based on four different specifications for the error distribution: a normal, a mixture of normals (or variance-contaminated normal), a bimodal mixture of normals, and a lognormal. Five hundred samples of 50 are used. The adaptive and partially adaptive estimators perform very well relative to the other estimation procedures considered, and preliminary results suggest that in some important cases they can perform much better than OLS with 50 to 80% reductions in standard errors.