ON ASYMPTOTIC PROPERTIES OF A TWO DIMENSIONAL FREQUENCY ESTIMATOR

Estimating parameters of a two dimensional frequency model is an important problem in statistical signal processing. In this paper, we consider the two-dimensional frequency model in presence of an additive stationary noise. We consider two different estimators and obtain their asymptotic properties. The asymptotic properties can be used to construct confidence intervals of the unknown parameters and for testing purposes also. The small sample performances of these estimators are observed using numerical simulations.     

Estimation of the characteristics of a Lévy process

We consider a Lévy process that is e.g. used in finance to model stock price developments. We want to estimate the characteristics of that process, based on historical data where we assume that we have discrete, high frequency observations. We introduce a threshold estimation method and show consistency and in the case of finite activity asymptotic normality of these estimators.     

Amplitude modulated model for analyzing non-stationary speech signals

Recently amplitude modulated (AM) model in presence of additive white noise was used to analyze certain non-stationary speech data. It is observed that the assumption of white noise may not be proper in many cases. In this article, we consider the AM signal model in presence of stationary noise. We consider the least squares estimators and the estimators obtained by maximizing the Periodogram function. The two estimators are asymptotically equivalent. We study the theoretical properties of both estimators and observe their performances through numerical simulations. One speech data is analyzed and it is observed that the performance of the proposed estimators is quite satisfactory.     

Estimating the fundamental frequency of a periodic function

In this paper we consider the problem of estimation of the fundamental frequency of a periodic function, which has several applications in Speech Signal Processing. The problem was originally proposed by Hannan (1974) and later on Quinn and Thomson (1991) provided an estimation procedure of the unknown parameters. It is observed that the estimation procedure of Quinn and Thomson (1991) is quite involved numerically. In this paper we propose to use two simple estimators and it is observed that their performance are quite satisfactory. Asymptotic properties of the proposed estimators are obtained. The large sample properties of the estimators are compared theoretically. We present some simulation results to compare their small sample performance. One speech data is analyzed using this particular model.     

Application of shrinkage estimation in linear regression models with autoregressive errors

In this paper, we consider the shrinkage and penalty estimation procedures in the linear regression model with autoregressive errors of order p when it is conjectured that some of the regression parameters are inactive. We develop the statistical properties of the shrinkage estimation method including asymptotic distributional biases and risks. We show that the shrinkage estimators have a significantly higher relative efficiency than the classical estimator. Furthermore, we consider the two penalty estimators: least absolute shrinkage and selection operator (LASSO) and adaptive LASSO estimators, and numerically compare their relative performance with that of the shrinkage estimators. A Monte Carlo simulation experiment is conducted for different combinations of inactive predictors and the performance of each estimator is evaluated in terms of the simulated mean-squared error. This study shows that the shrinkage estimators are comparable to the penalty estimators when the number of inactive predictors in the model is relatively large. The shrinkage and penalty methods are applied to a real data set to illustrate the usefulness of the procedures in practice.     

Model averaging for multivariate multiple regression models

The theories and applications of model averaging have been developed comprehensively in the past two decades. In this paper, we consider model averaging for multivariate multiple regression models. In order to make use of the correlation information of the dependent variables sufficiently, we propose a model averaging method based on Mahalanobis distance which is related to the correlation of the dependent variables. We prove the asymptotic optimality of the resulting Mahalanobis Mallows model averaging (MMMA) estimators under certain assumptions. In the simulation study, we show that the proposed MMMA estimators compare favourably with model averaging estimators based on AIC and BIC weights and the Mallows model averaging estimators from the single dependent variable regression models. We further apply our method to the real data on urbanization rate and the proportion of non-agricultural population in ethnic minority areas of China.     

Estimation of time-varying coefficient dynamic panel data models

In this paper, we consider dynamic panel data models where the autoregressive parameter changes over time. We propose the GMM and ML estimators for this model. We conduct Monte Carlo simulation to compare the performance of these two estimators. The simulation results show that the ML estimator outperforms the GMM estimator.     

LASSO and shrinkage estimation in Weibull censored regression models

In this paper we address the problem of estimating a vector of regression parameters in the Weibull censored regression model. Our main objective is to provide natural adaptive estimators that significantly improve upon the classical procedures in the situation where some of the predictors may or may not be associated with the response. In the context of two competing Weibull censored regression models (full model and candidate submodel), we consider an adaptive shrinkage estimation strategy that shrinks the full model maximum likelihood estimate in the direction of the submodel maximum likelihood estimate. We develop the properties of these estimators using the notion of asymptotic distributional risk. The shrinkage estimators are shown to have higher efficiency than the classical estimators for a wide class of models. Further, we consider a LASSO type estimation strategy and compare the relative performance with the shrinkage estimators. Monte Carlo simulations reveal that when the true model is close to the candidate submodel, the shrinkage strategy performs better than the LASSO strategy when, and only when, there are many inactive predictors in the model. Shrinkage and LASSO strategies are applied to a real data set from Veteran's administration (VA) lung cancer study to illustrate the usefulness of the procedures in practice.     

Estimating the parameters of the linear compartment model

In this paper we consider the linear compartment model and consider the estimation procedures of the different parameters. We discuss a method to obtain the initial estimators, which can be used for any iterative procedures to obtain the least-squares estimators. Four different types of confidence intervals have been discussed and they have been compared by computer simulations. We propose different methods to estimate the number of components of the linear compartment model. One data set has been used to see how the different methods work in practice.     

Nonparametric estimation of transition probabilities in a non-Markov illness–death model

In this paper we consider nonparametric estimation of transition probabilities for multi-state models. Specifically, we focus on the illness-death or disability model. The main novelty of the proposed estimators is that they do not rely on the Markov assumption, typically assumed to hold in a multi-state model. We investigate the asymptotic properties of the introduced estimators, such as their consistency and their convergence to a normal law. Simulations demonstrate that the new estimators may outperform Aalen–Johansen estimators (the classical nonparametric tool for estimating the transition probabilities) in non-Markov situation. An illustration through real data analysis is included.     

Shrinkage and Penalty Estimators of a Poisson Regression Model

In this paper we propose Stein‐type shrinkage estimators for the parameter vector of a Poisson regression model when it is suspected that some of the parameters may be restricted to a subspace. We develop the properties of these estimators using the notion of asymptotic distributional risk. The shrinkage estimators are shown to have higher efficiency than the classical estimators for a wide class of models. Furthermore, we consider three different penalty estimators: the LASSO, adaptive LASSO, and SCAD estimators and compare their relative performance with that of the shrinkage estimators. Monte Carlo simulation studies reveal that the shrinkage strategy compares favorably to the use of penalty estimators, in terms of relative mean squared error, when the number of inactive predictors in the model is moderate to large. The shrinkage and penalty strategies are applied to two real data sets to illustrate the usefulness of the procedures in practice.     

Change-Point Estimation in Long Memory Nonparametric Models with Applications

We consider the estimation of a change point or discontinuity in a regression function for random design model with long memory errors. We provide several change-point estimators and investigate the consistency of the estimators. Using the fractional ARIMA process as an example of long memory process, we report a small Monte Carlo experiment to compare the performance of the estimators in finite samples. We finish by applying the method to a climatological data example.     

Estimation of parameters of two-dimensional sinusoidal signal in heavy-tailed errors

In this paper, we consider a two-dimensional sinusoidal model observed in an additive random field. The proposed model has wide applications in statistical signal processing. The additive noise has mean zero but the variance may not be finite. We propose the least squares estimators to estimate the unknown parameters. It is observed that the least squares estimators are strongly consistent. We obtain the asymptotic distribution of the least squares estimators under the assumption that the additive errors are from a symmetric stable distribution. Some numerical experiments are performed to see how the results work for finite samples.     

Optimal designs for minimising covariances among parameter estimators in a linear model

We construct approximate optimal designs for minimising absolute covariances between least‐squares estimators of the parameters (or linear functions of the parameters) of a linear model, thereby rendering relevant parameter estimators approximately uncorrelated with each other. In particular, we consider first the case of the covariance between two linear combinations. We also consider the case of two such covariances. For this we first set up a compound optimisation problem which we transform to one of maximising two functions of the design weights simultaneously. The approaches are formulated for a general regression model and are explored through some examples including one practical problem arising in chemistry.     

Analyzing non-stationary signals using generalized multiple fundamental frequency model

In this paper, we propose a new generalized multiple frequency model to analyze non-stationary signals. The model under the assumption of additive stationary errors can be used quite effectively to analyze different signals. We propose the usual least-squares estimators to estimate the unknown parameters and it is shown that the estimators are strongly consistent. We obtain the asymptotic distributions also. The performance of the proposed model is compared with the multiple frequency model using Monte Carlo simulations. Finally, several real data are analyzed using both the proposed model and the multiple frequency model.     

Extreme shape analysis

Summary.  We consider the analysis of extreme shapes rather than the more usual mean- and variance-based shape analysis. In particular, we consider extreme shape analysis in two applications: human muscle fibre images, where we compare healthy and diseased muscles, and temporal sequences of DNA shapes from molecular dynamics simulations. One feature of the shape space is that it is bounded, so we consider estimators which use prior knowledge of the upper bound when present. Peaks-over-threshold methods and maximum-likelihood-based inference are used. We introduce fixed end point and constrained maximum likelihood estimators, and we discuss their asymptotic properties for large samples. It is shown that in some cases the constrained estimators have half the mean-square error of the unconstrained maximum likelihood estimators. The new estimators are applied to the muscle and DNA data, and practical conclusions are given.     

Stochastic analysis of covariance when the error distribution is long-tailed symmetric

In this study, we consider stochastic one-way analysis of covariance model when the distribution of the error terms is long-tailed symmetric. Estimators of the unknown model parameters are obtained by using the maximum likelihood (ML) methodology. Iteratively reweighting algorithm is used to compute the ML estimates of the parameters. We also propose new test statistic based on ML estimators for testing the linear contrasts of the treatment effects. In the simulation study, we compare the efficiencies of the traditional least-squares (LS) estimators of the model parameters with the corresponding ML estimators. We also compare the power of the test statistics based on LS and ML estimators, respectively. A real-life example is given at the end of the study.     

Correcting for non-compliance in randomized trials using rank preserving structural failure time models

We propose correcting for non-compliance in randomized trials by estimating the parameters of a class of semi-parametric failure time models, the rank preserving structural failure time models, using a class of rank estimators. These models are the structural or strong version of the “accelerated failure time model with time-dependent covariates” of Cox and Oakes (1984). In this paper we develop a large sample theory for these estimators, derive the optimal estimator within this class, and briefly consider the construction of “partially adaptive” estimators whose efficiency may approach that of the optimal estimator. We show that in the absence of censoring the optimal estimator attains the semiparametric efficiency bound for the model.     

Reducing component estimation for varying coefficient models

The estimation problem for varying coefficient models has been studied by many authors. We consider the problem in the case that the unknown functions admit different degrees of smoothness. In this paper we propose a reducing component local polynomial method to estimate the unknown functions. It is shown that all of our estimators achieve the optimal convergence rates. The asymptotic distributions of our estimators are also derived. The established asymptotic results and the simulation results show that our estimators outperform the the existing two-step estimators when the coefficient functions admit different degrees of smoothness. We also develop methods to speed up the estimation of the model and the selection of the bandwidths.     

ON ESTIMATION OF LONG-MEMORY TIME SERIES MODELS

This paper discusses estimation associated with the long-memory time series models proposed by Granger & Joyeux (1980) and Hosking (1981). We consider the maximum likelihood estimator and the least squares estimator. Certain regularity conditions introduced by several authors to develop the asymptotic theory of these estimators do not hold in this model. However we can show that these estimators are strongly consistent, and we derive the limiting distribution and the rate of convergence.