Nonlinear regression models with general distortion measurement errors

This paper considers nonlinear regression models when neither the response variable nor the covariates can be directly observed, but are measured with both multiplicative and additive distortion measurement errors. We propose conditional variance and conditional mean calibration estimation methods for the unobserved variables, then a nonlinear least squares estimator is proposed. For the hypothesis testing of parameter, a restricted estimator under the null hypothesis and a test statistic are proposed. The asymptotic properties for the estimator and test statistic are established. Lastly, a residual-based empirical process test statistic marked by proper functions of the regressors is proposed for the model checking problem. We further suggest a bootstrap procedure to calculate critical values. Simulation studies demonstrate the performance of the proposed procedure and a real example is analysed to illustrate its practical usage.     

Estimation and inference for varying coefficient partially nonlinear models

In this paper, we extend the varying coefficient partially linear model to the varying coefficient partially nonlinear model in which the linear part of the varying coefficient partially linear model is replaced by a nonlinear function of the covariates. A profile nonlinear least squares estimation procedure for the parameter vector and the coefficient function vector of the varying coefficient partially nonlinear model is proposed and the asymptotic properties of the resulting estimators are established. We further propose a generalized likelihood ratio (GLR) test to check whether or not the varying coefficients in the model are constant. The asymptotic null distribution of the GLR statistic is derived and a residual-based bootstrap procedure is also suggested to derive the p-value of the GLR test. Some simulations are conducted to assess the performance of the proposed estimating and testing procedures and the results show that both the procedures perform well in finite samples. Furthermore, a real data example is given to demonstrate the application of the proposed model and its estimating and testing procedures.     

Empirical Likelihood Ratio Test for a Change-Point in Linear Regression Model

A nonparametric method based on the empirical likelihood is proposed to detect the change-point in the coefficient of linear regression models. The empirical likelihood ratio test statistic is proved to have the same asymptotic null distribution as that with classical parametric likelihood. Under some mild conditions, the maximum empirical likelihood change-point estimator is also shown to be consistent. The simulation results show the sensitivity and robustness of the proposed approach. The method is applied to some real datasets to illustrate the effectiveness.     

ASYMPTOTIC PROPERTIES OF RESTRICTED MAXIMUM LIKELIHOOD (REML) ESTIMATES FOR HIERARCHICAL MIXED LINEAR MODELS

This paper explores the asymptotic distribution of the restricted maximum likelihood estimator of the variance components in a general mixed model. Restricting attention to hierarchical models, central limit theorems are obtained using elementary arguments with only mild conditions on the covariates in the fixed part of the model and without having to assume that the data are either normally or spherically symmetrically distributed. Further, the REML and maximum likelihood estimators are shown to be asymptotically equivalent in this general framework, and the asymptotic distribution of the weighted least squares estimator (based on the REML estimator) of the fixed effect parameters is derived.     

An approximation for analyzing a broad class of implicitly and explicitly defined estimators

An approximation is presented that can be used to gain insight into the characteristics – such as outlier sensitivity, bias, and variability – of a wide class of estimators, including maximum likelihood and least squares. The approximation relies on a convenient form for an arbitrary order Taylor expansion in a multivariate setting. The implicit function theorem can be used to construct the expansion when the estimator is not defined in closed form. We present several finite-sample and asymptotic properties of such Taylor expansions, which are useful in characterizing the difference between the estimator and the expansion.     

Two tests for sequential detection of a change-point in a nonlinear model

In this paper, two tests, based on weighted CUSUM of the least squares residuals, are studied to detect in real time a change-point in a nonlinear model. A first test statistic is proposed by extension of a method already used in the literature but for the linear models. It is tested under the null hypothesis, at each sequential observation, that there is no change in the model against a change presence. The asymptotic distribution of the test statistic under the null hypothesis is given and its convergence in probability to infinity is proved when a change occurs. These results will allow to build an asymptotic critical region. Next, in order to decrease the type I error probability, a bootstrapped critical value is proposed and a modified test is studied in a similar way. A generalization of the Hájek–Rényi inequality is established.     

The Multiple Outlier Problem in Time Series Analysis

In this paper we consider the multiple outlier problem in time series analysis. The underlying undisturbed time series is assumed to be an autoregressive process. The location of the suspicious values is supposed to be known. We introduce conditional least squares estimators for the parameters. The estimates are shown to be strongly consistent. Using similar arguments as in the theory of linear models, we get a test statistic for the general linear hypothesis. Its asymptotic distribution is derived.     

A resampling‐based test for two crossing survival curves

The area between two survival curves is an intuitive test statistic for the classical two‐sample testing problem. We propose a bootstrap version of it for assessing the overall homogeneity of these curves. Our approach allows ties in the data as well as independent right censoring, which may differ between the groups. The asymptotic distribution of the test statistic as well as of its bootstrap counterpart are derived under the null hypothesis, and their consistency is proven for general alternatives. We demonstrate the finite sample superiority of the proposed test over some existing methods in a simulation study and illustrate its application by a real‐data example.     

Parameter estimation in semi-linear models using a maximal invariant likelihood function

In this paper, we consider the problem of estimation of semi-linear regression models. Using invariance arguments, Bhowmik and King [2007. Maximal invariant likelihood based testing of semi-linear models. Statist. Papers 48, 357–383] derived the probability density function of the maximal invariant statistic for the non-linear component of these models. Using this density function as a likelihood function allows us to estimate these models in a two-step process. First the non-linear component parameters are estimated by maximising the maximal invariant likelihood function. Then the non-linear component, with the parameter values replaced by estimates, is treated as a regressor and ordinary least squares is used to estimate the remaining parameters. We report the results of a simulation study conducted to compare the accuracy of this approach with full maximum likelihood and maximum profile-marginal likelihood estimation. We find maximising the maximal invariant likelihood function typically results in less biased and lower variance estimates than those from full maximum likelihood.     

A Test of Non Null Hypothesis for Linear Trends in Proportions

Usual tests for trends stand under null hypothesis. This article presents a test of non null hypothesis for linear trends in proportions. A weighted least squares method is used to estimate the regression coefficient of proportions. A non null hypothesis is defined as its expectation equal to a prescribed regression coefficient margin. Its variance is used to construct an equation of basic relationship for linear trends in proportions along the asymptotic normal method. Then follow derivations for the sample size formula, the power function, and the test statistic. The expected power is obtained from the power function and the observed power is exhibited by Monte Carlo method. It reduces to the classical test for linear trends in proportions on setting the margin equal to zero. The agreement between the expected and the observed power is excellent. It is the non null hypothesis test matched with the classical test and can be applied to assess the clinical significance of trends among several proportions. By contrast, the classical test is restricted in testing the statistical significance. A set of data from a website is used to illustrate the methodology.     

The Empirical Likelihood for First-Order Random Coefficient Integer-Valued Autoregressive Processes

This article studies the empirical likelihood method for the first-order random coefficient integer-valued autoregressive process. The limiting distribution of the log empirical likelihood ratio statistic is established. Confidence region for the parameter of interest and its coverage probabilities are given, and hypothesis testing is considered. The maximum empirical likelihood estimator for the parameter is derived and its asymptotic properties are established. The performances of the estimator are compared with the conditional least squares estimator via simulation.     

First-order random coefficients integer-valued threshold autoregressive processes

In this paper, we introduce a first-order random coefficient integer-valued threshold autoregressive process, which is based on binomial thinning. Basic probabilistic and statistical properties of this model are discussed. Conditional least squares and conditional maximum likelihood estimators are derived for both the cases that the threshold variable is known or not. The asymptotic properties of the estimators are established. Moreover, forecasting problem is addressed. Finally, some numerical results of the estimates and a real data example are presented.     

Optimal Binary Prediction for Group Decision Making

We address the problem of optimally forecasting a binary variable for a heterogeneous group of decision makers facing various (binary) decision problems that are tied together only by the unknown outcome. A typical example is a weather forecaster who needs to estimate the probability of rain tomorrow and then report it to the public. Given a conditional probability model for the outcome of interest (e.g., logit or probit), we introduce the idea of maximum welfare estimation and derive conditions under which traditional estimators, such as maximum likelihood or (nonlinear) least squares, are asymptotically socially optimal even when the underlying model is misspecified.     

Empirical phi-divergence test statistics for the difference of means of two populations

Empirical phi-divergence test statistics have demostrated to be a useful technique for the simple null hypothesis to improve the finite sample behavior of the classical likelihood ratio test statistic, as well as for model misspecification problems, in both cases for the one population problem. This paper introduces this methodology for two-sample problems. A simulation study illustrates situations in which the new test statistics become a competitive tool with respect to the classical z test and the likelihood ratio test statistic.     

An improved test of equality of mean directions for the Langevin‐von Mises‐Fisher distribution

A multi‐sample test for equality of mean directions is developed for populations having Langevin‐von Mises‐Fisher distributions with a common unknown concentration. The proposed test statistic is a monotone transformation of the likelihood ratio. The high‐concentration asymptotic null distribution of the test statistic is derived. In contrast to previously suggested high‐concentration tests, the high‐concentration asymptotic approximation to the null distribution of the proposed test statistic is also valid for large sample sizes with any fixed nonzero concentration parameter. Simulations of size and power show that the proposed test outperforms competing tests. An example with three‐dimensional data from an anthropological study illustrates the practical application of the testing procedure.     

Bootstrapping a time series model: some empirical results

The bootstrap is a methodology for estimating standard errors. The idea is to use a Monte Carlo simulation experiment based on a nonparametric estimate of the error distribution. The main objective of this article is to demonstrate the use of the bootstrap to attach standard errors to coefficient estimates in a second-order autoregressive model fitted by least squares and maximum likelihood estimation. Additionally, a comparison of the bootstrap and the conventional methodology is made. As it turns out, the conventional asymptotic formulae (both the least squares and maximum likelihood estimates) for estimating standard errors appear to overestimate the true standard errors. But there are two problems:i. The first two observations y₁ and y₂ have been fixed, and ii. The residuals have not been inflated. After these two factors are considered in the trial and bootstrap experiment, both the conventional maximum likelihood and bootstrap estimates of the standard errors appear to be performing quite well.     

Estimating and testing group effects from type i censored normal samples in experimental design

The maximum likelihood (ML) equations calculated from censored normal samples do not admit explicit solutions. A principle of modification is given and modified maximum likelihood (MML) equations, which admit explicit solutions, are defined. This approach makes it possible to tackle the hitherto unresolved problem of estimating and testing hypotheses about group-effects in one-way classification experimental designs based on Type I censored normal samples. The MML estimators of group-effects are obtained as explicit functions of sample observations and shown to be asymptotically identical with the ML estimators and hence BAN (best asymptotic normal) estimators. A statistic t is defined to test a linear contrast of group-effects and shown to be asymptotically normally distributed. A numerical example is presented which illustrates the procedure.     

A weighted cramer-von mises statistic derived from a decomposition of the anderson-darling statistic

Two goodness of fit statistics with asymmetric weight function are derived from a decomposition of the Anderson-Darling statistic, For each one, the asymptotic null distribution is found for a simple null hypothesis and some upper percentties are calculated. The asymptotic power of the tests are obtained for some contiguous alternatives around a normal null hypothesis. The tests allow the user to choose to which tail to give more weight and it is intended to be used for that purpose. Therefore it should be not considered as a competitor of the classical goodness of fit tests.     

A test for the linearity of the nonparametric part of a semiparametric logistic regression model

A semiparametric logistic regression model is proposed in which its nonparametric component is approximated with fixed-knot cubic B-splines. To assess the linearity of the nonparametric component, we construct a penalized likelihood ratio test statistic. When the number of knots is fixed, the null distribution of the test statistic is shown to be asymptotically the distribution of a linear combination of independent chi-squared random variables, each with one degree of freedom. We set the asymptotic null expectation of this test statistic equal to a value to determine the smoothing parameter value. Monte Carlo experiments are conducted to investigate the performance of the proposed test. Its practical use is illustrated with a real-life example.     

Testing for a finite mixture model with two components

Summary.  We consider a finite mixture model with k components and a kernel distribution from a general one-parameter family. The problem of testing the hypothesis k =2 versus k 3 is studied. There has been no general statistical testing procedure for this problem. We propose a modified likelihood ratio statistic where under the null and the alternative hypotheses the estimates of the parameters are obtained from a modified likelihood function. It is shown that estimators of the support points are consistent. The asymptotic null distribution of the modified likelihood ratio test proposed is derived and found to be relatively simple and easily applied. Simulation studies for the asymptotic modified likelihood ratio test based on finite mixture models with normal, binomial and Poisson kernels suggest that the test proposed performs well. Simulation studies are also conducted for a bootstrap method with normal kernels. An example involving foetal movement data from a medical study illustrates the testing procedure.