A note on the likelihood-ratio statistic under model misspecification

Following Viraswami and Reid (1996), higher-order results under model misspecification are obtained for the likelihood-ratio statistic and the adjusted likelihood-ratio statistic, for the case of a scalar parameter. An improved version of the adjusted likelihood-ratio statistic is suggested.     

On measuring sensitivity to parametric model misspecification

In settings where parametric inference is inconsistent under model misspecification, the discrepancy between correct and misspecified inferences is compared with the discrepancy between correct and misspecified models. To make the comparison tractable, large sample and small misspecification approximations are employed. The ratio of the approximate discrepancy between inferences to the approximate discrepancy between models is regarded as a relative measure of sensitivity to model misspecification. The maximum ratio over a family of correct distributions is determined as a measure of worst case sensitivity. As well, the distribution producing this maximum can be examined, to see how a particular combination of a parametric family and estimand is susceptible to model misspecifications.     

Assessing large sample bias in misspecified model scenarios with reference to exposure model misspecification in errors-in-variable regression: A new computational approach

In this paper, we develop a numerical method for evaluating the large sample bias in estimated regression coefficients arising due to exposure model misspecification while adjusting for measurement errors in errors-in-variable regression. The application of the proposed method has been demonstrated in the case of a logistic errors-in-variable regression model. The method is based on the combination of Monte-Carlo, numerical and, in some special cases, analytic integration techniques. The proposed method facilitates the investigation of the limiting bias in the estimated regression parameters based on a single data set rather than on repeated data sets as required by the conventional repeated sample method. Simulation studies demonstrate that the proposed method provides very similar estimates of bias in the estimated regression parameters under exposure model misspecification in logistic errors-in-variable regression with a higher degree of precision as compared to the conventional repeated sample method.     

The univariate distribution function for a particular bilinear model

The aim of the paper is to find the univariate stationary distribution of a particular bilinear process. In this context, we propose a novel approach to derive the distribution function. It is based on a recursive formula and allows to relax the conditions on the moments of the process. We also show that the derived approximation converges to the true distribution function. The accuracy of the recursive formula is evaluated for finite sample dimensions by a small simulation study.Received: February 2003, Revised: May 2004,     

Evaluating model misspecification in independent component analysis

Independent component analysis (ICA) is a popular blind source separation technique used in many scientific disciplines. Current ICA approaches have focused on developing efficient algorithms under specific ICA models, such as instantaneous or convolutive mixing conditions, intrinsically assuming temporal independence or autocorrelation of the sources. In practice, the true model is not known and different ICA algorithms can produce very different results. Although it is critical to choose an ICA model, there has not been enough research done on evaluating mixing models and assumptions, and how the associated algorithms may perform under different scenarios. In this paper, we investigate the performance of multiple ICA algorithms under various mixing conditions. We also propose a convolutive ICA algorithm for echoic mixing cases. Our simulation studies show that the performance of ICA algorithms is highly dependent on mixing conditions and temporal independence of the sources. Most instantaneous ICA algorithms fail to separate autocorrelated sources, while convolutive ICA algorithms depend highly on the model specification and approximation accuracy of unmixing filters.     

Identification of average marginal effects under misspecification when covariates are normal

A previously known result in the econometrics literature is that when covariates of an underlying data generating process are jointly normally distributed, estimates from a nonlinear model that is misspecified as linear can be interpreted as average marginal effects. This has been shown for models with exogenous covariates and separability between covariates and errors. In this paper, we extend this identification result to a variety of more general cases, in particular for combinations of separable and nonseparable models under both exogeneity and endogeneity. So long as the underlying model belongs to one of these large classes of data generating processes, our results show that nothing else must be known about the true DGP—beyond normality of observable data, a testable assumption—in order for linear estimators to be interpretable as average marginal effects. We use simulation to explore the performance of these estimators using a misspecified linear model and show they perform well when the data are normal but can perform poorly when this is not the case.     

On robustness of usual confidence region under transformation misspecification

Robustness of confidence region for linear model parameters following a misspecified transformation of dependent variable is studied. It is shown that when error standard deviation is moderate to large the usual confidence region is robust against transformation misspecification. When error standard deviation is small the usual confidence region could be very conservative for structured models and slightly liberal for unstructured models. However, the conservativeness in structured case can be controlled if the transformation is selected with the help of data rather than prior information since this is the case when data is able to provide a very accurate estimate of transformation.     

Statistical inference for the extended generalized inverse Gaussian model

This paper deals with the extended generalized inverse Gaussian (EGIG) distribution which has more than one turning point of the failure rate for certain values of the parameters. The EGIG model is a versatile model for analysing lifetime data and has one additional parameter, δ, than the GIG model's three parameters [B. Jorgensen, Statistical Properties of the Generalized Inverse Gaussian Distribution, Springer-Verlag, New York, 1982]. For the EGIG model, the maximum-likelihood estimation of the four parameters is discussed and a score test is developed for testing the importance of the additional parameter, δ. A non-central chi-square approximation to the power of the score test is provided. Simulation studies are carried out to examine the performance of the score test and the Wald confidence intervals. Finally, an example discussed by Jorgensen [5] is provided to illustrate that the EGIG model fits the data better than the GIG of Jorgensen [5]. Three other examples are presented and the power comparisons are displayed for each.     

Robust inference for Birnbaum–Saunders regressions

We propose a robust likelihood approach for the Birnbaum–Saunders regression model under model misspecification, which provides full likelihood inferences about regression parameters without knowing the true random mechanisms underlying the data. Monte Carlo simulation experiments and analysis of real data sets are carried out to illustrate the efficacy of the proposed robust methodology.     

Inference in a two-parameter generalized order statistics model

As a submodel of generalized order statistics with two unknown model parameters, m-generalized order statistics may serve as a simple model for ordered quantities in a given application. It is shown that the joint distribution of m-generalized order statistics has a representation as a regular exponential family in the model parameters, as it is the case for the comprising model. Utilizing this finding, a minimal sufficient and complete statistic is obtained along with distributional properties. Joint maximum likelihood estimation of the parameters is considered, and strong consistency and asymptotic efficiency of the estimator are established. A test is provided to decide whether a restriction to the submodel is reasonable.     

Quantification of model risk that is caused by model misspecification

In this paper, we suggest a technique to quantify model risk, particularly model misspecification for binary response regression problems found in financial risk management, such as in credit risk modelling. We choose the probability of default model as one instance of many other credit risk models that may be misspecified in a financial institution. By way of illustrating the model misspecification for probability of default, we carry out quantification of two specific statistical predictive response techniques, namely the binary logistic regression and complementary log–log. The maximum likelihood estimation technique is employed for parameter estimation. The statistical inference, precisely the goodness of fit and model performance measurements, are assessed. Using the simulation dataset and Taiwan credit card default dataset, our finding reveals that with the same sample size and very small simulation iterations, the two techniques produce similar goodness-of-fit results but completely different performance measures. However, when the iterations increase, the binary logistic regression technique for balanced dataset reveals prominent goodness of fit and performance measures as opposed to the complementary log–log technique for both simulated and real datasets.     

Between stability and higher-order asymptotics

We discuss the effects of model misspecifications on higher-order asymptotic approximations of the distribution of estimators and test statistics. In particular we show that small deviations from the model can wipe out the nominal improvements of the accuracy obtained at the model by second-order approximations of the distribution of classical statistics. Although there is no guarantee that the first-order robustness properties of robust estimators and tests will carry over to second-order in a neighbourhood of the model, the behaviour of robust procedures in terms of second-order accuracy is generally more stable and reliable than that of their classical counterparts. Finally, we discuss some related work on robust adjustments of the profile likelihood and outline the role of computer algebra in this type of research.     

Wald检验不一致性的微分几何解释及改进

Wald检验对于等价的零假设中不同形式的表达式在有限样本的情况下缺乏一致性,而从微分几何的角度来解释这一现象,并发现由于Wald统计量是一个混杂的不恰当的几何量,从而对不同的含参数的等价表达式不具有一致性。同时还展示了芬斯拉（Finsler）测地统计量如何能较为简便的计算出来、它在线性回归模型中的非线性约束条件下如何应用以及两者在什么情况下保持一致,并提出了一种解决Wald检验不一致性的思路。     

Bayesian predictive analysis of the linear regression model with an edgeworth series prior distribution

In this paper we obtain the Bayes forecasts for the future observations on the dependent variable in the linear regression model when the regression coefficients have an Edgeworth series prior distribution. Furthermore, we consider the effect of departure from normality of the prior distribution of regression coefficients on the Bayes forecasts.     

Some Theoretical and Simulation Results on the Frequency Domain Causality Test

Breitung and Candelon (2006 Breitung , J. , Candelon , B. ( 2006 ). Testing for short- and long-run causality: A frequency-domain approach . Journal of Econometrics 132 : 363 – 378 .[Crossref], [Web of Science ®] , [Google Scholar]) in Journal of Econometrics proposed a simple statistical testing procedure for the noncausality hypothesis at a given frequency. In their paper, however, they reported some theoretical results indicating that their test severely suffers from quite low power when the noncausality hypothesis is tested at a frequency close to 0 or pi. This paper examines whether or not these results indicate their procedure is useless at such frequencies.     

Optimal testing in a three way anova model

We consider likelihood ratio, score and Wald tests for a three-way random effects ANOVA model. Competitor tests are compared using criteria such as small sample power, asymptotic relative efficiency, and convenient null distribution. The final choice is between a new test and two tests long used in practice.     

A semiparametric nonlinear mixed model approach to phase I profile monitoring

When process data follow a particular curve in quality control, profile monitoring is suitable and appropriate for assessing process stability. Previous research in profile monitoring focusing on nonlinear parametric (P) modeling, involving both fixed and random-effects, was made under the assumption of an accurate nonlinear model specification. Lately, nonparametric (NP) methods have been used in the profile monitoring context in the absence of an obvious linear P model. This study introduces a novel technique in profile monitoring for any nonlinear and auto-correlated data. Referred to as the nonlinear mixed robust profile monitoring (NMRPM) method, it proposes a semiparametric (SP) approach that combines nonlinear P and NP profile fits for scenarios in which a nonlinear P model is adequate over part of the data but inadequate of the rest. These three methods (P, NP, and NMRPM) account for the auto-correlation within profiles and treats the collection of profiles as a random sample with a common population. During Phase I analysis, a version of Hotelling’s T² statistic is proposed for each approach to identify abnormal profiles based on the estimated random effects and obtain the corresponding control limits. The performance of the NMRPM method is then evaluated using a real data set. Results reveal that the NMRPM method is robust to model misspecification and performs adequately against a correctly specified nonlinear P model. Control charts with the NMRPM method have excellent capability of detecting changes in Phase I data with control limits that are easily computable.     

Hypotheses testing for a multidimensional parameter of inhomogeneous Poisson processes

We observe a realization of an inhomogeneous Poisson process whose intensity function depends on an unknown multidimensional parameter. We consider the asymptotic behaviour of the Rao score test for a simple null hypothesis against the multilateral alternative. By using the Edgeworth type expansion (under the null hypothesis) for a vector of stochastic integrals with respect to the Poisson process, we refine the (classic) threshold of the test (obtained by the central limit theorem), which improves the first type probability of error. The expansion allows us to describe the power of the test under the local alternative, i.e. a sequence of alternatives, which converge to the null hypothesis with a certain rate. The rates can be different for components of the parameter.     

Robustness of Approaches to ROC Curve Modeling under Misspecification of the Underlying Probability Model

A variety of statistical regression models have been proposed for the comparison of ROC curves for different markers across covariate groups. Pepe developed parametric models for the ROC curve that induce a semiparametric model for the market distributions to relax the strong assumptions in fully parametric models. We investigate the analysis of the power ROC curve using these ROC-GLM models compared to the parametric exponential model and the estimating equations derived from the usual partial likelihood methods in time-to-event analyses. In exploring the robustness to violations of distributional assumptions, we find that the ROC-GLM provides an extra measure of robustness.