Non-iterative Estimation and Variable Selection in the Single-index Quantile Regression Model

A new estimation procedure is proposed for the single-index quantile regression model. Compared to existing work, this approach is non-iterative and hence, computationally efficient. The proposed method not only estimates the index parameter and the link function but also selects variables simultaneously. The performance of the variable selection is enhanced by a fully adaptive penalty function motivated by the sliced inverse regression technique. Finite sample performance is studied through a simulation study that compares the proposed method with existing work under several criteria. A data analysis is given that highlights the usefulness of the proposed methodology.     

Robust estimation of a dynamic spatio-temporal model with structural change

We postulate a dynamic spatio-temporal model with constant covariate effect but with varying spatial effect over time and varying temporal effect across locations. To mitigate the effect of temporary structural change, the model can be estimated using the backfitting algorithm embedded with forward search algorithm and bootstrap. A simulation study is designed to evaluate structural optimality of the model with the estimation procedure. The fitted model exhibit superior predictive ability relative to the linear model. The proposed algorithm also consistently produced lower relative bias and standard errors for the spatial parameter estimates. While additional neighbourhoods do not necessarily improve predictive ability of the model, it trims down relative bias on the parameter estimates, specially for spatial parameter. Location of the temporary structural change along with the degree of structural change contributes to lower relative bias of parameter estimates and in better predictive ability of the model. The estimation procedure is able to produce parameter estimates that are robust to the occurrence of temporary structural change.     

Two steps generalized maximum entropy estimation procedure for fitting linear regression when both covariates are subject to error

This paper presents a procedure utilizing the generalized maximum entropy (GME) estimation method in two steps to quantify the uncertainty of the simple linear structural measurement error model parameters exactly. The first step estimates the unknowns from the horizontal line, and then the estimates were used in a second step to estimate the unknowns from the vertical line. The proposed estimation procedure has the ability to minimize the number of unknown parameters in formulating the GME system within each step, and hence reduce variability of the estimates. Analytical and illustrative Monte Carlo simulation comparison experiments with the maximum likelihood estimators and a one-step GME estimation procedure were presented. Simulation experiments demonstrated that the two steps estimation procedure produced parameter estimates that are more accurate and more efficient than the classical estimation methods. An application of the proposed method is illustrated using a data set gathered from the Centre for Integrated Government Services in Delma Island – UAE to predict the association between perceived quality and the customer satisfaction.     

Fast,closed-form,and efficient estimators for hierarchical models with AR(1) covariance and unequal cluster sizes

This article is concerned with statistically and computationally efficient estimation in a hierarchical data setting with unequal cluster sizes and an AR(1) covariance structure. Maximum likelihood estimation for AR(1) requires numerical iteration when cluster sizes are unequal. A near optimal non-iterative procedure is proposed. Pseudo-likelihood and split-sample methods are used, resulting in computing weights to combine cluster size specific parameter estimates. Results show that the method is statistically nearly as efficient as maximum likelihood, but shows great savings in computation time.     

A model-averaging approach for smoothing spline regression

ABSTRACT

This article considers nonparametric regression problems and develops a model-averaging procedure for smoothing spline regression problems. Unlike most smoothing parameter selection studies determining an optimum smoothing parameter, our focus here is on the prediction accuracy for the true conditional mean of Y given a predictor X. Our method consists of two steps. The first step is to construct a class of smoothing spline regression models based on nonparametric bootstrap samples, each with an appropriate smoothing parameter. The second step is to average bootstrap smoothing spline estimates of different smoothness to form a final improved estimate. To minimize the prediction error, we estimate the model weights using a delete-one-out cross-validation procedure. A simulation study has been performed by using a program written in R. The simulation study provides a comparison of the most well known cross-validation (CV), generalized cross-validation (GCV), and the proposed method. This new method is straightforward to implement, and gives reliable performances in simulations.     

A NEW APPROACH TO MAXIMUM LIKELIHOOD ESTIMATION OF THE THREE-PARAMETER GAMMA AND WEIBULL DISTRIBUTIONS

A new approach, is proposed for maximum likelihood (ML) estimation in continuous univariate distributions. The procedure is used primarily to complement the ML method which can fail in situations such as the gamma and Weibull distributions when the shape parameter is, at most, unity. The new approach provides consistent and efficient estimates for all possible values of the shape parameter. Its performance is examined via simulations. Two other, improved, general methods of ML are reported for comparative purposes. The methods are used to estimate the gamma and Weibull distributions using air pollution data from Melbourne. The new ML method is accurate when the shape parameter is less than unity and is also superior to the maximum product of spacings estimation method for the Weibull distribution.     

Finding Bounds Applied to Serial Dilution Experiments

A method of finding bounds for a parameter in a sum of similar functions is introduced. Such bounds can help an iteration procedure to estimate the parameter. This method applies to the equations for finding maximum likelihood estimates of concentration for a serial dilution experiment. For serial dilution experiments these bounds are calculated as an example of the method.     

Errors-in-Variables Regression Using Stein Estimates

A method is proposed for estimating regression parameters from data containing covariate measurement errors by using Stein estimates of the unobserved true covariates. The method produces consistent estimates for the slope parameter in the classical linear errors-in-variables model and applies to a broad range of nonlinear regression problems, provided the measurement error is Gaussian with known variance. Simulations are used to examine the performance of the estimates in a nonlinear regression problem and to compare them with the usual naive ones obtained by ignoring error and with other estimates proposed recently in the literature.     

Dimensionally reduced mixtures of regression models

A mixture of regression models for multivariate observed variables which contextually involves a dimension reduction step through a linear factor model is proposed. The model estimation is performed via the EM-algorithm and a procedure to compute asymptotic standard errors for the parameter estimates is developed. The proposed approach is applied to the study of students satisfaction towards different aspects of their school as a function of various covariates.     

Parametric Inference in Stationary Time Series Models with Dependent Errors

This article is concerned with inference for the parameter vector in stationary time series models based on the frequency domain maximum likelihood estimator. The traditional method consistently estimates the asymptotic covariance matrix of the parameter estimator and usually assumes the independence of the innovation process. For dependent innovations, the asymptotic covariance matrix of the estimator depends on the fourth‐order cumulants of the unobserved innovation process, a consistent estimation of which is a difficult task. In this article, we propose a novel self‐normalization‐based approach to constructing a confidence region for the parameter vector in such models. The proposed procedure involves no smoothing parameter, and is widely applicable to a large class of long/short memory time series models with weakly dependent innovations. In simulation studies, we demonstrate favourable finite sample performance of our method in comparison with the traditional method and a residual block bootstrap approach.     

Bayesian inference of the inverse Weibull mixture distribution using type-I censoring

A large number of models have been derived from the two-parameter Weibull distribution including the inverse Weibull (IW) model which is found suitable for modeling the complex failure data set. In this paper, we present the Bayesian inference for the mixture of two IW models. For this purpose, the Bayes estimates of the parameters of the mixture model along with their posterior risks using informative as well as the non-informative prior are obtained. These estimates have been attained considering two cases: (a) when the shape parameter is known and (b) when all parameters are unknown. For the former case, Bayes estimates are obtained under three loss functions while for the latter case only the squared error loss function is used. Simulation study is carried out in order to explore numerical aspects of the proposed Bayes estimators. A real-life data set is also presented for both cases, and parameters obtained under case when shape parameter is known are tested through testing of hypothesis procedure.     

Repeated measurement analysis for nonnormal data in small samples

The small sample performance of Zeger and Liang's extended generalized linear models for the analysis of longitudinal data (Biometrics, 42,121-130,1986) is investigated for correlated gamma data. Results show that the confidence intervals do not provide desirable coverage of the true parameter due to considerably biased point estimates. Improved estimates are proposed using the jackknife procedure. Simulations performed to evaluate the proposed estimates indicate superior properties to the previous estimates.     

E-Bayesian estimation of the exponentiated distribution family parameter under LINEX loss function

This paper is concerned with using the E-Bayesian method for computing estimates of the exponentiated distribution family parameter. Based on the LINEX loss function, formulas of E-Bayesian estimation for unknown parameter are given, these estimates are derived based on a conjugate prior. Moreover, property of E-Bayesian estimation—the relationship between of E-Bayesian estimations under different prior distributions of the hyper parameters are also provided. A comparison between the new method and the corresponding maximum likelihood techniques is conducted using the Monte Carlo simulation. Finally, combined with the golfers income data practical problem are calculated, the results show that the proposed method is feasible and convenient for application.     

An iterative procedure for robust circle fitting

The problem of fitting circles and circular arcs to observed points arises in many areas of science. However, the fitting results by using most geometric and algebraic methods are not usually acceptable in the presence of outliers. An iterative procedure for robust circle fitting is proposed. During the iteration, Taubin's method is employed to obtain the center and radius. And then the geometric distances from the data points to the circle are computed, with which outliers are identified and removed. Numerical examples demonstrate that the proposed iterative procedure can alleviate the corrupted effect of outliers on the circle parameter estimates.     

Scalable statistical inference for averaged implicit stochastic gradient descent

Stochastic gradient descent (SGD) provides a scalable way to compute parameter estimates in applications involving large‐scale data or streaming data. As an alternative version, averaged implicit SGD (AI‐SGD) has been shown to be more stable and more efficient. Although the asymptotic properties of AI‐SGD have been well established, statistical inferences based on it such as interval estimation remain unexplored. The bootstrap method is not computationally feasible because it requires to repeatedly resample from the entire data set. In addition, the plug‐in method is not applicable when there is no explicit covariance matrix formula. In this paper, we propose a scalable statistical inference procedure, which can be used for conducting inferences based on the AI‐SGD estimator. The proposed procedure updates the AI‐SGD estimate as well as many randomly perturbed AI‐SGD estimates, upon the arrival of each observation. We derive some large‐sample theoretical properties of the proposed procedure and examine its performance via simulation studies.     

Ridge estimation in generalized linear models and proportional hazards regressions

Conventionally, a ridge parameter is estimated as a function of regression parameters based on ordinary least squares. In this article, we proposed an iterative procedure instead of the one-step or conventional ridge method. Additionally, we construct an indicator that measures the potential degree of improvement in mean squared error when ridge estimates are employed. Simulations show that our methods are appropriate for a wide class of non linear models including generalized linear models and proportional hazards (PHs) regressions. The method is applied to a PH regression with highly collinear covariates in a cancer recurrence study.     

On power and sample size calculations for Wald tests in generalized linear models

A Wald test-based approach for power and sample size calculations has been presented recently for logistic and Poisson regression models using the asymptotic normal distribution of the maximum likelihood estimator, which is applicable to tests of a single parameter. Unlike the previous procedures involving the use of score and likelihood ratio statistics, there is no simple and direct extension of this approach for tests of more than a single parameter. In this article, we present a method for computing sample size and statistical power employing the discrepancy between the noncentral and central chi-square approximations to the distribution of the Wald statistic with unrestricted and restricted parameter estimates, respectively. The distinguishing features of the proposed approach are the accommodation of tests about multiple parameters, the flexibility of covariate configurations and the generality of overall response levels within the framework of generalized linear models. The general procedure is illustrated with some special situations that have motivated this research. Monte Carlo simulation studies are conducted to assess and compare its accuracy with existing approaches under several model specifications and covariate distributions.     

Bayesian averaging of classical estimates in asymmetric vector autoregressive models

The estimated vector autoregressive (VAR) model is sensitive to model misspecifications, resulting to biased and inconsistent parameter estimates. This article extends the Bayesian averaging of classical estimates, a robustness procedure in cross-section data, to a vector time-series that is estimated using a large number of asymmetric VAR models. The proposed procedure was applied to simulated data from various forms of model misspecifications. The results of the simulation suggest that, under misspecification problems, particularly if an important variable and moving average (MA) terms were omitted, the proposed procedure gives robust results and better forecasts than the automatically selected equal lag-length VAR model.     

ROBUST ANALYSIS OF THE BIFURCATING AUTOREGRESSIVE MODEL IN CELL LINEAGE STUDIES

A robust estimation procedure for the bifurcating autoregressive model in cell lineage studies is proposed. The method is illustrated by application to a real data set and is compared with least squares estimates in a small simulation study.     

ON OPTIMIZING MULTI-LEVEL DESIGNS: POWER UNDER BUDGET CONSTRAINTS

This paper derives a procedure for efficiently allocating the number of units in multi‐level designs given prespecified power levels. The derivation of the procedure is based on a constrained optimization problem that maximizes a general form of a ratio of expected mean squares subject to a budget constraint. The procedure makes use of variance component estimates to optimize designs during the budget formulating stages. The method provides more general closed form solutions than other currently available formulae. As such, the proposed procedure allows for the determination of the optimal numbers of units for studies that involve more complex designs. A method is also described for optimizing designs when variance component estimates are not available. Case studies are provided to demonstrate the method.