Maximum Likelihood Estimation for Stochastic Differential Equations with Random Effects

Abstract. We consider N independent stochastic processes (X _i (t), t ∈ [0,T _i ]), i=1,…, N, defined by a stochastic differential equation with drift term depending on a random variable φ _i . The distribution of the random effect φ _i depends on unknown parameters which are to be estimated from the continuous observation of the processes X_i. We give the expression of the exact likelihood. When the drift term depends linearly on the random effect φ _i and φ _i has Gaussian distribution, an explicit formula for the likelihood is obtained. We prove that the maximum likelihood estimator is consistent and asymptotically Gaussian, when T _i =T for all i and N tends to infinity. We discuss the case of discrete observations. Estimators are computed on simulated data for several models and show good performances even when the length time interval of observations is not very large.     

Bayes sequential estimation for a Poisson process under a LINEX loss function

In this paper, within the framework of a Bayesian model, we consider the problem of sequentially estimating the intensity parameter of a homogeneous Poisson process with a linear exponential (LINEX) loss function and a fixed cost per unit time. An asymptotically pointwise optimal (APO) rule is proposed. It is shown to be asymptotically optimal for the arbitrary priors and asymptotically non-deficient for the conjugate priors in a similar sense of Bickel and Yahav [Asymptotically pointwise optimal procedures in sequential analysis, in Proceedings of the Fifth Berkeley Symposium on Mathematical Statistics and Probability, Vol. 1, University of California Press, Berkeley, CA, 1967, pp. 401–413; Asymptotically optimal Bayes and minimax procedures in sequential estimation, Ann. Math. Statist. 39 (1968), pp. 442–456] and Woodroofe [A.P.O. rules are asymptotically non-deficient for estimation with squared error loss, Z. Wahrsch. verw. Gebiete 58 (1981), pp. 331–341], respectively. The proposed APO rule is illustrated using a real data set.     

Non-ergodic martingale estimating functions and related asymptotics

Well-known estimation methods such as conditional least squares, quasilikelihood and maximum likelihood (ML) can be unified via a single framework of martingale estimating functions (MEFs). Asymptotic distributions of estimates for ergodic processes use constant norm (e.g. square root of the sample size) for asymptotic normality. For certain non-ergodic-type applications, however, such as explosive autoregression and super-critical branching processes, one needs a random norm in order to get normal limit distributions. In this paper, we are concerned with non-ergodic processes and investigate limit distributions for a broad class of MEFs. Asymptotic optimality (within a certain class of non-ergodic MEFs) of the ML estimate is deduced via establishing a convolution theorem using a random norm. Applications to non-ergodic autoregressive processes, generalized autoregressive conditional heteroscedastic-type processes, and super-critical branching processes are discussed. Asymptotic optimality in terms of the maximum random limiting power regarding large sample tests is briefly discussed.     

Higher-order and non-stationary properties of lampard's stochastic reversible counter system

Summary. In this paper we discuss higher-order and non-stationary properties of LAM-PAED'S (1968) stochastic reversible counter model whose output is a stochastic point process with MABKOV dependent time intervals. Statistical properties of the primed counter system, are also considered. A characterization of the probability density function of the interval lengths and the probability distribution of the counts by means of a mixed POXSSOH process is then derived. The distribution of counts of the primed counter system is shown to be mathematically equivalent to the birth-and-death process with immigration. A generalization of the problem when initial counts and incremental counts have independent distributions is also discussed     

Comparison of conditional and unconditional confidence intervals for the double exponential distribution

Conditional confidence intervals for the location parameter of the double exponential distribution based on maximum likelihood estimators conditioned on a set of ancillary statistics and the corresponding unconditional confidence intervals based on the maximum likelihood estimators alone are compared in two ways. Monte Carlo techniques are used and the conditional approach appears to give slightly better results although agreement as n becomes larger is noted     

Amemiya‘s generalized least squares and tests of overidentification in simultaneous equation models with qualitative or limited dependent variables

Amemiya's generalized least squares method for the estimation of simultaneous equation modeis with qualitative or limited dependent variables is known to be efficient relative to many popular two stage estimators. This note points out that test statistics for overidentification restrictions can be obtained as by-products of Amerniya's generalized least squares procedure. Amemiya's procedure is shown to be a minimum chisquare method. The Amemiya procedure is valuable both for efficient estimation and for model evaluation of such models.     

Point estimation after early stopping in a repeated measures trial

When the individual measurements are statistically independent, the maximum likelihood estimator calculated at the end of a sequential procedure overestimates the underlying effect. There are many clinical trials in which we are interested in comparing changes in responses between two treatment groups sequentially. Lee and DeMets (1991, JASA 86, 757–762) proposed a group sequential method for comparing rates of change when a response variable is measured for eaeh patient at successive follow-up visits. They assumed that the response follows the linear mixed effects model and derived the asymptotic joint distribution of the sequentially computed statistics. In this article, we consider the maximum likelihood estimator (MLE), the median unbiased estimator (MUE) and the midpoint of a 100(1-α)% confidence interval as point estimators for the rate of change in the linear mixed effects model, and investigate their properties by Monte Carlo simulation.     

A New Control Scheme Always Better Than X-Bar Chart

A new control scheme is proposed by borrowing the idea of the Benjamini–Hochberg procedure for controlling the false discovery rate in multiple testing. It is shown theoretically that the proposed 2-span control scheme outperforms the Shewhart X-bar chart in terms of the average run length under any size of mean shifts. Some simulations are carried out to demonstrate that the proposed scheme having various span sizes always outperforms the X-bar chart in terms of the average run lengths.     

Test for Parameter Change in Linear Processes Based on Whittle's Estimator

In this article, we develop a cusum test for testing for parameter changes in linear processes based on Whittle's estimator. It is shown that under regularity conditions, the test statistic converges to the sup of a Brownian bridge. The result is particularly useful in handling the change point test in stationary ARMA processes. A simulation result is provided for illustration.