Least squares estimation of nonhomogeneous poisson processes

We formulate and evaluate weighted least squares (WLS) and ordinary least squares (OLS) procedures for estimating the parametric mean-value function of a nonhomogeneous Poisson process. We focus the development on processes having an exponential rate function, where the exponent may include a polynomial component or some trigonometric components. Unanticipated problems with the WLS procedure are explained by an analysis of the associated residuals. The OLS procedure is based on a square root transformation of the "detrended" event (arrival) times - that is, the fitted mean-value function evaluated at the observed event times; and under appropriate conditions, the corresponding residuals are proved to converge weakly to a normal distribution with mean 0 and variance 0.25. The results of a Monte Carlo study indicate the advantages of the OLS procedure with respect to estimation accuracy and computational efficiency.     

Quantile regression in functional linear semiparametric model

This paper proposes nonparametric estimation methods for functional linear semiparametric quantile regression, where the conditional quantile of the scalar responses is modelled by both scalar and functional covariates and an additional unknown nonparametric function term. The slope function is estimated using the functional principal component basis and the nonparametric function is approximated by a piecewise polynomial function. The asymptotic distribution of the estimators of slope parameters is derived and the global convergence rate of the quantile estimator of unknown slope function is established under suitable norm. The asymptotic distribution of the estimator of the unknown nonparametric function is also established. Simulation studies are conducted to investigate the finite-sample performance of the proposed estimators. The proposed methodology is demonstrated by analysing a real data from ADHD-200 sample.     

The Empirical Likelihood Inference of a Regression Parameter in Censored Partial Linear Models Based on a Piecewise Polynomial

This article aims at making an empirical likelihood inference of regression parameter in partial linear model when the response variable is right censored randomly. The present studies are mainly designed to use empirical likelihood (EL) method based on synthetic dependent data, and the result cannot be applied directly due to the unknown weights in it. In this paper, we introduce a censored empirical log-likelihood ratio and demonstrate that its limiting distribution is a standard chi-square distribution. The estimating procedure of β is developed based on piecewise polynomial method. As a result, the p-value of test and the confidence interval can be obtained without estimating other quantities. Some simulation studies are conducted to highlight the performance of the proposed EL method, and the results show a good performance. Finally, we apply our method into the real example of multiple myeloma data and show the proof of theorem.     

Analysis op failure time data by burr distribution

Sometimes it is appropriate to model the survival and failure time data by a non-monotonic failure rate distribution. This may be desirable when the course of disease is such that mortality reaches a peak after some finite period and then slowly declines.In this paper we study Burr, type XII model whose failure rate exhibits the above behavior. The location of the critical points (at which the monotonicity changes) for both the failure rate and the mean residual life function (MRLF) are studied. A procedure is described for estimating these critical points. Necessary and sufficient conditions for the existence and uniqueness of the maximum likelihood estimates are provided and it is shown that the conditions provided by Wingo (1993) are not sufficient. A data set pertaining to fibre failure strengths is analyzed and the maximum likelihood estimates of the critical points are obtained.     

On the calculations of the maximum likelihood estimates for the polynomial spline regression model with unknown knots and AR(1) errors

Asymptotic distributions of the maximum likelihood estimators of the regression coefficients and knot points for the polynomial spline regression models with unknown knots and AR(1) errors have been derived by Chan (1989). Chan showed that under some mild conditions the maximum likelihood estimators, after suitable standardization, asymptotically follow normal distributions as n diverges to infinity. For the calculations of the maximum likelihood estimators, iterative methods must be applied. But this is not easy to implement for the model considered. In this paper, we suggested an alternative method to compute the estimates of the regression parameters and knots. It is shown that the estimates obtained by this method are asymptotically equivalent to the maximum likelihood estimates considered by Chan.     

A dynamic system for Gompertz model

Two-parameter Gompertz distribution has been introduced as a lifetime model for reliability inference recently. In this paper, the Gompertz distribution is proposed for the baseline lifetimes of components in a composite system. In this composite system, failure of a component induces increased load on the surviving components and thus increases component hazard rate via a power-trend process. Point estimates of the composite system parameters are obtained by the method of maximum likelihood. Interval estimates of the baseline survival function are obtained by using the maximum-likelihood estimator via a bootstrap percentile method. Two parametric bootstrap procedures are proposed to test whether the hazard rate function changes with the number of failed components. Intensive simulations are carried out to evaluate the performance of the proposed estimation procedure.     

Generalized EM estimation for semi-parametric mixture distributions with discretized non-parametric component

We consider independent sampling from a two-component mixture distribution, where one component (called the parametric component) is from a known distributional family and the other component (called the non-parametric component) is unknown. This is a semi-parametric mixture distribution. We discretize the non-parametric component and estimate the parameters of this mixture model, namely the mixing proportion, the unknown parameters of the parametric component and the discretized non-parametric component. We define the maximum penalized likelihood (MPL) estimates of the mixture model parameters and then develop a generalized EM (GEM) iterative scheme to compute the MPL estimates. A simulation study and an example from biology are presented.     

On the integrated maximum likelihood estimators for a closed population capture–recapture model with unequal capture probabilities

Nuisance parameter elimination is a central problem in capture–recapture modelling. In this paper, we consider a closed population capture–recapture model which assumes the capture probabilities varies only with the sampling occasions. In this model, the capture probabilities are regarded as nuisance parameters and the unknown number of individuals is the parameter of interest. In order to eliminate the nuisance parameters, the likelihood function is integrated with respect to a weight function (uniform and Jeffrey's) of the nuisance parameters resulting in an integrated likelihood function depending only on the population size. For these integrated likelihood functions, analytical expressions for the maximum likelihood estimates are obtained and it is proved that they are always finite and unique. Variance estimates of the proposed estimators are obtained via a parametric bootstrap resampling procedure. The proposed methods are illustrated on a real data set and their frequentist properties are assessed by means of a simulation study.     

Nonlinear orthogonal series estimates for random design regression

Let (X,Y) be a pair of random variables with supp(X)⊆[0,1] and EY²<∞. Let m be the corresponding regression function. Estimation of m from i.i.d. data is considered. The L₂ error with integration with respect to the design measure μ (i.e., the distribution of X) is used as an error criterion.Estimates are constructed by estimating the coefficients of an orthonormal expansion of the regression function. This orthonormal expansion is done with respect to a family of piecewise polynomials, which are orthonormal in L₂(μ_n), where μ_n denotes the empirical design measure.It is shown that the estimates are weakly and strongly consistent for every distribution of (X,Y). Furthermore, the estimates behave nearly as well as an ideal (but not applicable) estimate constructed by fitting a piecewise polynomial to the data, where the partition of the piecewise polynomial is chosen optimally for the underlying distribution. This implies e.g., that the estimates achieve up to a logarithmic factor the rate n^−2p/(2p+1), if the underlying regression function is piecewise p-smooth, although their definition depends neither on the smoothness nor on the location of the discontinuities of the regression function.     

Penalized contrast estimation in functional linear models with circular data

Our aim is to estimate the unknown slope function in the functional linear model when the response Y is real and the random function X is a second-order stationary and periodic process. We obtain our estimator by minimizing a standard (and very simple) mean-square contrast on linear finite dimensional spaces spanned by trigonometric bases. Our approach provides a penalization procedure which allows to automatically select the adequate dimension, in a non-asymptotic point of view. In fact, we can show that our penalized estimator reaches the optimal (minimax) rate of convergence in the sense of the prediction error. We complete the theoretical results by a simulation study and a real example that illustrates how the procedure works in practice.     

Semiparametric statistical inferences for longitudinal data with nonparametric covariance modelling

In this paper, semiparametric modelling for longitudinal data with an unstructured error process is considered. We propose a partially linear additive regression model for longitudinal data in which within-subject variances and covariances of the error process are described by unknown univariate and bivariate functions, respectively. We provide an estimating approach in which polynomial splines are used to approximate the additive nonparametric components and the within-subject variance and covariance functions are estimated nonparametrically. Both the asymptotic normality of the resulting parametric component estimators and optimal convergence rate of the resulting nonparametric component estimators are established. In addition, we develop a variable selection procedure to identify significant parametric and nonparametric components simultaneously. We show that the proposed SCAD penalty-based estimators of non-zero components have an oracle property. Some simulation studies are conducted to examine the finite-sample performance of the proposed estimation and variable selection procedures. A real data set is also analysed to demonstrate the usefulness of the proposed method.     

Parameter estimation in semi-linear models using a maximal invariant likelihood function

In this paper, we consider the problem of estimation of semi-linear regression models. Using invariance arguments, Bhowmik and King [2007. Maximal invariant likelihood based testing of semi-linear models. Statist. Papers 48, 357–383] derived the probability density function of the maximal invariant statistic for the non-linear component of these models. Using this density function as a likelihood function allows us to estimate these models in a two-step process. First the non-linear component parameters are estimated by maximising the maximal invariant likelihood function. Then the non-linear component, with the parameter values replaced by estimates, is treated as a regressor and ordinary least squares is used to estimate the remaining parameters. We report the results of a simulation study conducted to compare the accuracy of this approach with full maximum likelihood and maximum profile-marginal likelihood estimation. We find maximising the maximal invariant likelihood function typically results in less biased and lower variance estimates than those from full maximum likelihood.     

Kernel Likelihood Inference for Time Series

Abstract.  This paper develops non-parametric techniques for dynamic models whose data have unknown probability distributions. Point estimators are obtained from the maximization of a semiparametric likelihood function built on the kernel density of the disturbances. This approach can also provide Kullback–Leibler cross-validation estimates of the bandwidth of the kernel densities. Confidence regions are derived from the dual-empirical likelihood method based on non-parametric estimates of the scores. Limit theorems for martingale difference sequences support the statistical theory; moreover, simulation experiments and a real case study show the validity of the methods.     

Piecewise Cox models with right-censored data

We study a general class of piecewise Cox models. We discuss the computation of the semi-parametric maximum likelihood estimates (SMLE) of the parameters, with right-censored data, and a simplified algorithm for the maximum partial likelihood estimates (MPLE). Our simulation study suggests that the relative efficiency of the PMLE of the parameter to the SMLE ranges from 96% to 99.9%, but the relative efficiency of the existing estimators of the baseline survival function to the SMLE ranges from 3% to 24%. Thus, the SMLE is much better than the existing estimators.     

A Seemingly Unrelated Nonparametric Additive Model with Autoregressive Errors

This article considers a nonparametric additive seemingly unrelated regression model with autoregressive errors, and develops estimation and inference procedures for this model. Our proposed method first estimates the unknown functions by combining polynomial spline series approximations with least squares, and then uses the fitted residuals together with the smoothly clipped absolute deviation (SCAD) penalty to identify the error structure and estimate the unknown autoregressive coefficients. Based on the polynomial spline series estimator and the fitted error structure, a two-stage local polynomial improved estimator for the unknown functions of the mean is further developed. Our procedure applies a prewhitening transformation of the dependent variable, and also takes into account the contemporaneous correlations across equations. We show that the resulting estimator possesses an oracle property, and is asymptotically more efficient than estimators that neglect the autocorrelation and/or contemporaneous correlations of errors. We investigate the small sample properties of the proposed procedure in a simulation study.     

Analytic computation of nonparametric Marsan–Lengliné estimates for Hawkes point processes

In 2008, Marsan and Lengliné presented a nonparametric way to estimate the triggering function of a Hawkes process. Their method requires an iterative and computationally intensive procedure which ultimately produces only approximate maximum likelihood estimates (MLEs) whose asymptotic properties are poorly understood. Here, we note a mathematical curiosity that allows one to compute, directly and extremely rapidly, exact MLEs of the nonparametric triggering function. The method here requires that the number q of intervals on which the nonparametric estimate is sought equals the number n of observed points. The resulting estimates have very high variance but may be smoothed to form more stable estimates. The performance and computational efficiency of the proposed method is verified in two disparate, highly challenging simulation scenarios: first to estimate the triggering functions, with simulation-based 95% confidence bands, for earthquakes and their aftershocks in Loma Prieta, California, and second, to characterise triggering in confirmed cases of plague in the United States over the last century. In both cases, the proposed estimator can be used to describe the rate of contagion of the processes in detail, and the computational efficiency of the estimator facilitates the construction of simulation-based confidence intervals.     

E-Bayesian estimation for the proportional hazard rate model based on record values

In this article, a new parameter estimation method, named E-Bayesian method, is considered to obtain the estimates of the unknown parameter and reliability function based on record values. The maximum likelihood, Bayesian, E-Bayesian, and hierarchical Bayesian estimates of the unknown parameter and reliability function are obtained when the underlying distribution belongs to the proportional hazard rate model. The Bayesian estimates are obtained based on squared error and linear-exponential loss functions. The previously obtained some relations for the E-Bayesian estimates are improved. The relationship between E-Bayesian and hierarchical Bayesian estimations are obtained under the same loss functions. The comparison of the derived estimates are carried out by using Monte Carlo simulations. Real data are analyzed for an illustration of the findings.     

A method for estimating age-specific reference intervals ('normal ranges') based on fractional polynomials and exponential transformation

The age-specific reference interval is an important screening tool in medicine. Put crudely, an individual whose value of a variable of interest lies outside certain extreme centiles may be suspected of abnormality. We propose a parametric method for constructing such intervals. It provides smooth centile curves and explicit formulae for the centile estimates and for standard deviation (SD) scores (age-standardized values). Each parameter of an exponential–normal or modulus–exponential–normal density is modelled as a fractional polynomial function of age. Estimation is by maximum likelihood. These three- and four-parameter models involve transformations of the data towards normality which remove non-normal skewness and/or kurtosis. Fractional polynomials provide more flexible curve shapes than do conventional polynomials. The method easily accommodates binary covariates facilitating, for example, parsimonious modelling of age- and sex-specific centile curves. A method of calculating precision profiles for centile estimates is proposed. Goodness of fit is assessed by using Q–Q -plots and Shapiro–Wilk W -tests of the SD scores, and likelihood ratio tests of the parameters of an enlarged model. Four substantial real data sets are used to illustrate the method. Comparisons are made with the semiparametric LMS method of Cole and Green.     

Modelling association between two irregularly observed spatiotemporal processes by using maximum covariance analysis

Summary.  Climatic phenomena such as the El-Niño–southern oscillation and the north Atlantic oscillation are results of complex interactions between atmospheric and oceanic processes. Understanding the interactions has enabled scientists to give early warning of the forthcoming phenomena, thereby reducing damage caused by them. Statistical methods have played an important role in revealing effects of these phenomena on different regions of the world. One such method is maximum covariance analysis (MCA). Two apparent weaknesses are associated with MCA. Firstly, it tends to produce estimates with a low signal-to-noise ratio, especially when the sample size is small. Secondly, there has been no objective way of incorporating incomplete records, which are frequently encountered in climatology and oceanographic data-bases. We introduce an MCA which incorporates a smoothing procedure on the estimates. The introduction of the smoothing procedure is shown to improve the signal-to-noise ratio on the estimates. The estimation of smoothing parameters is carried out by using a penalized likelihood approach, which makes the inclusion of incomplete records quite straightforward. The methodology is applied to investigate the association between Irish winter precipitation and sea surface temperature anomalies around the world. The results show relationships between Irish precipitation anomalies and the El-Niño–southern oscillation and the north Atlantic oscillation phenomena.     

An adaptive piecewise polynomial curve fitting procedure for data analysis

A wholly adaptive piecewise polynomial curve fitting procedure is presented. Using an information-theoretic criterion, the num= ber of knots is estimated necessary to give a ‘good’ approximation to the underlying function of the data. The optimal positioning of these knots is achieved by a suitable transformation of the constrained non-linear program