Bayesian estimation for first-order autoregressive model with explanatory variables

In this article, we develop a Bayesian analysis in autoregressive model with explanatory variables. When σ² is known, we consider a normal prior and give the Bayesian estimator for the regression coefficients of the model. For the case σ² is unknown, another Bayesian estimator is given for all unknown parameters under a conjugate prior. Bayesian model selection problem is also being considered under the double-exponential priors. By the convergence of ρ-mixing sequence, the consistency and asymptotic normality of the Bayesian estimators of the regression coefficients are proved. Simulation results indicate that our Bayesian estimators are not strongly dependent on the priors, and are robust.     

Unbiased tests for some one-sided testing problems

Unbiased tests are found for various testing problems. In the first model considered we test homogeneity of k + 1 independent one-parameter exponential family populations vs. the tree-top ordering alternative. The tree-top alternative is appropriate for one-sided comparisons for treatments with a control. In the next set of models normality is assumed. In one such model k independent populations have different unknown means but have an unknown common variance. An independent estimate of the variance exists. We test homogeneity of means against the alternative of no homogeneity. We also consider the alternative of an ordering of the means as well as the tree-top ordering. The final model considered is when we take a random sample from a multivariate normal population with unknown mean vector and an unknown covariance matrix of the intraclass type. We test the hypothesis that the mean vector is the zero vector against the one-sided alternative that each mean is nonnegative (with at least one positive).     

A Comparison of Bayesian Models of Heteroscedasticity in Nested Normal Data

We consider the fitting of a Bayesian model to grouped data in which observations are assumed normally distributed around group means that are themselves normally distributed, and consider several alternatives for accommodating the possibility of heteroscedasticity within the data. We consider the case where the underlying distribution of the variances is unknown, and investigate several candidate prior distributions for those variances. In each case, the parameters of the candidate priors (the hyperparameters) are themselves given uninformative priors (hyperpriors). The most mathematically convenient model for the group variances is to assign them inverse gamma distributed priors, the inverse gamma distribution being the conjugate prior distribution for the unknown variance of a normal population. We demonstrate that for a wide class of underlying distributions of the group variances, a model that assigns the variances an inverse gamma-distributed prior displays favorable goodness-of-fit properties relative to other candidate priors, and hence may be used as standard for modeling such data. This allows us to take advantage of the elegant mathematical property of prior conjugacy in a wide variety of contexts without compromising model fitness. We test our findings on nine real world publicly available datasets from different domains, and on a wide range of artificially generated datasets.     

Confidence regions based on inefficient estimators

We consider an unbiased estimator of a function of mean value parameters, which is not efficient. This inefficient estimator is correlated with a residual vector. Thus, if a unit dispersion is unknown, it is impossible to determine the correct confidence region for a function of mean value parameters via a standard estimator of an unknown dispersion with the exception of the case when the ordinary least squares (OLS) estimator is considered in a model with a special covariance structure such that the OLS and the generalized least squares (GLS) estimator are the same, that is the OLS estimator is efficient. Two different estimators of a unit dispersion independent of an inefficient estimator are derived in a singular linear statistical model. Their quality was verified by simulations for several types of experimental designs. Two new estimators of the unit dispersion were compared with the standard estimators based on the GLS and the OLS estimators of the function of the mean value parameters. The OLS estimator was considered in the incorrect model with a different covariance matrix such that the originally inefficient estimator became efficient. The numerical examples led to a slightly surprising result which seems to be due to data behaviour. An example from geodetic practice is presented in the paper.     

Predictive control of posterior robustness for sample size choice in a Bernoulli model

In this article we consider the sample size determination problem in the context of robust Bayesian parameter estimation of the Bernoulli model. Following a robust approach, we consider classes of conjugate Beta prior distributions for the unknown parameter. We assume that inference is robust if posterior quantities of interest (such as point estimates and limits of credible intervals) do not change too much as the prior varies in the selected classes of priors. For the sample size problem, we consider criteria based on predictive distributions of lower bound, upper bound and range of the posterior quantity of interest. The sample size is selected so that, before observing the data, one is confident to observe a small value for the posterior range and, depending on design goals, a large (small) value of the lower (upper) bound of the quantity of interest. We also discuss relationships with and comparison to non robust and non informative Bayesian methods.     

Semiparametric estimation of the single-index varying-coefficient model

In this paper, we consider the choice of pilot estimators for the single-index varying-coefficient model, which may result in radically different estimators, and develop the method for estimating the unknown parameter in this model. To estimate the unknown parameters efficiently, we use the outer product of gradient method to find the consistent initial estimators for interest parameters, and then adopt the refined estimation method to improve the efficiency, which is similar to the refined minimum average variance estimation method. An algorithm is proposed to estimate the model directly. Asymptotic properties for the proposed estimation procedure have been established. The bandwidth selection problem is also considered. Simulation studies are carried out to assess the finite sample performance of the proposed estimators, and efficiency comparisons between the estimation methods are made.     

Some extensions of anova techniques to location-scale models

In the usual analysis of variance (ANOVA) framework, the different distributions being compared are assumed to differ only in location so that the various measures of comparison are based on these location parameters only. The shift functions, introduced by Doksum (1974, provide a natural basis for extending some of the ANOVA techniques to nonlinear model so We consider a location-scale model and discuss several measures for comparing the various populations. These measures have intuitive interpretations in "control-treatments" situations. We develop various estimation procedures and discuss their large sample properties. Asymptotically efficient multiple comparison procedures are also considered.     

Consistent Estimation of the Regression Coefficient Through Weighted Arithmetic Mean of the Inconsistent Estimators in Replicated Ultrastructural Model

The problem of consistent estimation of the slope parameter in an ultrastructural model with replicated observations is considered in this article. A consistent estimator based on a weighted arithmetic mean of two inconsistent least squares estimators is proposed which is independent of any unknown quantity. The efficiency properties of this estimator are studied.     

Semiparametric Bayesian classification with longitudinal markers

Summary.  We analyse data from a study involving 173 pregnant women. The data are observed values of the β human chorionic gonadotropin hormone measured during the first 80 days of gestational age, including from one up to six longitudinal responses for each woman. The main objective in this study is to predict normal versus abnormal pregnancy outcomes from data that are available at the early stages of pregnancy. We achieve the desired classification with a semiparametric hierarchical model. Specifically, we consider a Dirichlet process mixture prior for the distribution of the random effects in each group. The unknown random-effects distributions are allowed to vary across groups but are made dependent by using a design vector to select different features of a single underlying random probability measure. The resulting model is an extension of the dependent Dirichlet process model, with an additional probability model for group classification. The model is shown to perform better than an alternative model which is based on independent Dirichlet processes for the groups. Relevant posterior distributions are summarized by using Markov chain Monte Carlo methods.     

Analysis of Linear Models with One Factor Having Both Fixed and Random Levels

ABSTRACT

A general theory for a case where a factor has both fixed and random effect levels is developed under one-way treatment structure model. Estimation procedures for the fixed effects and variance components are consider for the model. The testing of fixed effects is considered when the variance–covariance matrix is known and unknown. Confidence intervals for estimable functions and prediction intervals for predictable functions are constructed. The computational procedures are illustrated using data from an on-farm trial.     

Estimation of the number of vertices of different degrees in a graph

An unknown graph is partially observed by selecting a vertex sample and observing the edges in the subgraph induced by the sample. The sample is selected by either simple random sampling or Bernoulli sampling. We consider the problem of estimating the numbers of vertices of different degrees in the unknown graph by using the sample information. Unbiased estimators are given and their variance-covariance matrix is shown to depend on a set of intrinsic graph parameters which can hardly be satisfactorily estimated from the sample information without further assumptions. In particular, the problem of estimating the number of isolates (vertices of degree zero) is considered in some detail.     

ON ASYMPTOTIC PROPERTIES OF A TWO DIMENSIONAL FREQUENCY ESTIMATOR

Estimating parameters of a two dimensional frequency model is an important problem in statistical signal processing. In this paper, we consider the two-dimensional frequency model in presence of an additive stationary noise. We consider two different estimators and obtain their asymptotic properties. The asymptotic properties can be used to construct confidence intervals of the unknown parameters and for testing purposes also. The small sample performances of these estimators are observed using numerical simulations.     

Inference on constant stress accelerated life tests for log-location-scale lifetime distributions with type-I hybrid censoring

In this paper, we consider a constant stress accelerated life test terminated by a hybrid Type-I censoring at the first stress level. The model is based on a general log-location-scale lifetime distribution with mean life being a linear function of stress and with constant scale. We obtain the maximum likelihood estimators (MLE) and the approximate maximum likelihood estimators (AMLE) of the model parameters. Approximate confidence intervals, likelihood ratio tests and two bootstrap methods are used to construct confidence intervals for the unknown parameters of the Weibull and lognormal distributions using the MLEs. Finally, a simulation study and two illustrative examples are provided to demonstrate the performance of the developed inferential methods.     

Efficient estimation of regression parameters from multistage studies with validation of outcome and covariates

Often the variables in a regression model are difficult or expensive to obtain so auxiliary variables are collected in a preliminary step of a study and the model variables are measured at later stages on only a subsample of the study participants called the validation sample. We consider a study in which at the first stage some variables, throughout called auxiliaries, are collected; at the second stage the true outcome is measured on a subsample of the first-stage sample, and at the third stage the true covariates are collected on a subset of the second-stage sample. In order to increase efficiency, the probabilities of selection into the second and third-stage samples are allowed to depend on the data observed at the previous stages. In this paper we describe a class of inverse-probability-of-selection-weighted semiparametric estimators for the parameters of the model for the conditional mean of the outcomes given the covariates. We assume that a subject's probability of being sampled at subsequent stages is bounded away from zero and depends only on the subject's data collected at the previous sampling stages. We show that the asymptotic variance of the optimal estimator in our class is equal to the semiparametric variance bound for the model. Since the optimal estimator depends on unknown population parameters it is not available for data analysis. We therefore propose an adaptive estimation procedure for locally efficient inferences. A simulation study is carried out to study the finite sample properties of the proposed estimators.     

Large-sample comparisons of calibration procedures when both measurements are subject to error: the unreplicated case

A predictive functional relationship model is presented for the calibration problem in which the standard as well as the nonstandard measurements are subject to error. For the estimation of the relationship between the two measurements, the ordinary least squares and maximum likelihood estimation methods are considered, while for the prediction of unknown standard measurements we consider direct and inverse approaches. Relative performances of those calibration procedures are compared in terms of the asymptotic mean square error of prediction.     

Inference with three-level prior distributions in quantile regression problems

In this paper, we propose a three level hierarchical Bayesian model for variable selection and estimation in quantile regression problems. Specifically, at the first level we consider a zero mean normal priors for the coefficients with unknown variance parameters. At the second level, we specify two different priors for the unknown variance parameters which introduce two different models producing different levels of sparsity. Then, at the third level we suggest joint improper priors for the unknown hyperparameters assuming they are independent. Simulations and Boston Housing data are utilized to compare the performance of our models with six existing models. The results indicate that our models perform good in the simulations and Boston Housing data.     

Inference for a simple step-stress model with progressively censored competing risks data from Weibull distribution

In reliability analysis, it is common to consider several causes, either mechanical or electrical, those are competing to fail a unit. These causes are called “competing risks.” In this paper, we consider the simple step-stress model with competing risks for failure from Weibull distribution under progressive Type-II censoring. Based on the proportional hazard model, we obtain the maximum likelihood estimates (MLEs) of the unknown parameters. The confidence intervals are derived by using the asymptotic distributions of the MLEs and bootstrap method. For comparison, we obtain the Bayesian estimates and the highest posterior density (HPD) credible intervals based on different prior distributions. Finally, their performance is discussed through simulations.     

Some matrix results related to a partitioned singular linear model

Consider the linear model (y, Xβ V), where the model matrix X may not have a full column rank and V might be singular. In this paper we introduce a formula for the difference between the BLUES of Xβ under the full model and the model where one observation has been deleted. We also consider the partitioned linear regression model where the model matrix is (X₁: X₂) the corresponding vector of unknown parameters being (β′₁ : β′₂)′. We show that the BLUE of X₁ β₁ under a specific reduced model equals the corresponding BLUE under the original full model and consider some interesting consequences of this result.     

Maximum likelihood estimation of the parameters of a multiple step-stress model from the Birnbaum-Saunders distribution under time-constraint: A comparative study

The cumulative exposure model (CEM) is a commonly used statistical model utilized to analyze data from a step-stress accelerated life testing which is a special class of accelerated life testing (ALT). In practice, researchers conduct ALT to: (1) determine the effects of extreme levels of stress factors (e.g., temperature) on the life distribution, and (2) to gain information on the parameters of the life distribution more rapidly than under normal operating (or environmental) conditions. In literature, researchers assume that the CEM is from well-known distributions, such as the Weibull family. This study, on the other hand, considers a p-step-stress model with q stress factors from the two-parameter Birnbaum-Saunders distribution when there is a time constraint on the duration of the experiment. In this comparison paper, we consider different frameworks to numerically compute the point estimation for the unknown parameters of the CEM using the maximum likelihood theory. Each framework implements at least one optimization method; therefore, numerical examples and extensive Monte Carlo simulations are considered to compare and numerically examine the performance of the considered estimation frameworks.