Consistency of least-squares estimator and its jackknife variance estimator in nonlinear models

The purpose of this paper is twofold: (1) We establish the consistency of the least-squares estimator in a nonlinear modely_i = f(x_i,θ) +σ_ie_i where the range of the parameter θ is noncompact, the regression function is unbounded, and the σ_i,'s are not necessarily equal. This extends the results in Jennrich (1969) and Wu (1981). (2) Under the same model, the jackknife estimator of the asymptotic covariance matrix of the least-squares estimator is shown to be consistent, which provides a theoretical justification of the empirical results in Duncan (1978) and the use of the jackknife method in large-sample inferences.     

The distribution of the Liu-type estimator of the biasing parameter in elliptically contoured models

We derive the density function of the stochastic shrinkage parameters of the Liu-type estimator in elliptical models. The correctness of derivation is checked by simulations. A real data application is also provided.     

Analytical expression for the integrated squared density partial derivative of a multivariate normal mixture distribution

This paper describes the derivation of the analytical expression for the integrated squared density partial derivative (ISDPD) in a multivariate normal mixture model. The analytical expression of the ISDPD is derived for arbitrary dimensions with partial derivative orders up to four. Although the value of the ISDPD can be obtained by using the common numerical integration via mathematical software (such as Maple, Mathematica, Matlab, etc), it suffers from the limitation of computation time when the dimension or the number of mixture components of the considered multivariate normal mixture model are large. Moreover, numerical comparison indicates the benefits of speed offered by our proposed analytical expression are far superior to the numerical integration performed by Maple. With this analytical expression, the ISDPD can apace be calculated with no assistance of numerical integration.     

Tests for the order of integration against higher order integration

Locally best invariant tests for the null hypothesis of I(p) against the alternative hypothesis of I(q), < q, are developed for models with independent normal errors. The tests are semiparametrically extended for models with autocorrelated errors. The method is illustrated by two real data sets in terms of double unit roots. The proposed tests can be used for determining integration orders of nonstationary time series.     

The probability contours and a goodness-of-fit test for the singly truncated bivariate normal distribution

The necessary statistic for constructing (1-α)% contour semiellipses of the distribution surface corresponding to the singly truncated bivariate normal is derived and 1t5 percentages tabulated, An approximate goodness-of-fit test which uses the derived statistic is indicated and an example given.     

The limiting distribution of the F-statistic from nonnormal universes

We consider a linear regression model with an unbalanced 1-fold nested error structure, where group effect and error are from nonnormal universes. The limiting distribution of the F-statistic in this model is derived, as the sample size is large and group sizes take values from a finite set of distinct integers. The result is used to approximate the F-distribution quantile and to test the significance of the random effect variance component. Results are also applicable to the F-statistic in the one-way random-effects model. The effects of departure from normality on the F-statistic distribution are given.     

Asymptotic properties of the maximum-likelihood estimator for a class of birth-and-death processes admitting a unique stationary distribution

The asymptotic properties of the maximum-likelihood estimator of the parameter vector for a class of birth-and-death processes admitting a unique stationary distribution are studied. Also, it is shown that identifiability of the parameter vector with respect to the likelihood implies that the Fisher information matrix is of full rank. Two special cases of biological interest are presented. One of these, the exponential birth-and-death process, is proposed as a more appropriate model of density dependence than the logistic process.     

The power of the tests of robinson (1994) in the context of fractionall[y integrated moving average models

We examine in this article the power of the tests of Robinson (1994) for testing I(d) statistical models in the presence of moving average (MA) disturbances. The results show that the tests behave relatively well if we correctly assume that the disturbances are MA. However, assuming white noise or autoregressive disturbances, the power of the tests against one-sided alternatives is very low.     

The distribution of a moment estimator for a parameter of the generalized poisson distribution

The ratio of the sample variance to the sample mean estimates a simple function of the parameter which measures the departure of the Poisson-Poisson from the Poisson distribution. Moment series to order n?²⁴ are given for related estimators. In one case, exact integral formulations are given for the first two moments, enabling a comparison to be made between their asymptotic developments and a computer-oriented extended Taylor series (COETS) algorithm. The integral approach using generating functions is sketched out for the third and fourth moments. Levin's summation algorithm is used on the divergent series and comparative simulation assessments are given.     

Berry-Esseen-type bounds for the kernel estimator of conditional distribution and conditional quantiles

Berry-Esseen bounds of order O(n^−1/2) have been obtained for several classes of statistics. In this paper, the rates of convergence in central limit theorem for conditional empirical functions and conditional sample quantiles based on kernel estimators are studied for both conditional and unconditional distributions.     

Simulated maximum likelihood estimation in joint models for multiple longitudinal markers and recurrent events of multiple types,in the presence of a terminal event

In medical studies we are often confronted with complex longitudinal data. During the follow-up period, which can be ended prematurely by a terminal event (e.g. death), a subject can experience recurrent events of multiple types. In addition, we collect repeated measurements from multiple markers. An adverse health status, represented by ‘bad’ marker values and an abnormal number of recurrent events, is often associated with the risk of experiencing the terminal event. In this situation, the missingness of the data is not at random and, to avoid bias, it is necessary to model all data simultaneously using a joint model. The correlations between the repeated observations of a marker or an event type within an individual are captured by normally distributed random effects. Because the joint likelihood contains an analytically intractable integral, Bayesian approaches or quadrature approximation techniques are necessary to evaluate the likelihood. However, when the number of recurrent event types and markers is large, the dimensionality of the integral is high and these methods are too computationally expensive. As an alternative, we propose a simulated maximum-likelihood approach based on quasi-Monte Carlo integration to evaluate the likelihood of joint models with multiple recurrent event types and markers.     

Uniqueness of the least-distances estimator in regression models with multivariate response

In a regression model with univariate response, the quantities derived from the least-absolute-deviations method need not be unique. In this note, we show that, contrary to the univariate case, in a regression model with multivariate response, the least-distances method typically yields quantities that exhibit uniqueness properties that are similar to those obtained by the least-squares method.     

Principal components regression estimator of the parameters in partially linear models

ABSTRACT

As a compromise between parametric regression and non-parametric regression models, partially linear models are frequently used in statistical modelling. This paper is concerned with the estimation of partially linear regression model in the presence of multicollinearity. Based on the profile least-squares approach, we propose a novel principal components regression (PCR) estimator for the parametric component. When some additional linear restrictions on the parametric component are available, we construct a corresponding restricted PCR estimator. Some simulations are conducted to examine the performance of our proposed estimators and the results are satisfactory. Finally, a real data example is analysed.     

On the uniqueness of the maximum likelihood estimator in truncated regression models

In this short note it is demonstrated that although the log-likelihood function for the truncated normal regression model may not be globally concave, it will possess a unique maximum if one exists. This is because the hessian matrix is negative semi-definite when evaluated at any possible solution to the likelihood equations. Since this rules out any saddle points or local minima, more than two local maxima occuring is impossible.     

The exact distribution and density functions of the stein-type estimator for normal variance

In this paper, we derive the exact distribution and density functions of the Stein-type estimator for the normal variance. It is shown by numerical evaluation that the density function of the Stein-type estimator is unimodal and concentrates around the mode more than that of the usual estimator.     

The implementation of the bayesian paradigm

Routine implementation of the Bayesian paradigm requires an efficient approach to the calculation and display of posterior or predictive distributions for given likelihood and prior specifi- cations. In this paper we shall review some of the analytic and numerical approaches currently available, describing in detail a numerical integration strategy based on Gaussian quadrature, and an associated strategy for the reconstruction and display of distributions based on spline techniques.     

Bias correction for parameter estimates of spatial point process models

When a spatial point process model is fitted to spatial point pattern data using standard software, the parameter estimates are typically biased. Contrary to folklore, the bias does not reflect weaknesses of the underlying mathematical methods, but is mainly due to the effects of discretization of the spatial domain. We investigate two approaches to correcting the bias: a Newton–Raphson-type correction and Richardson extrapolation. In simulation experiments, Richardson extrapolation performs best.