Estimation of smooth regression functions in monotone response models

We consider the estimation of smooth regression functions in a class of conditionally parametric co-variate-response models. Independent and identically distributed observations are available from the distribution of (Z,X)$(Z,X)$, where Z is a real-valued co-variate with some unknown distribution, and the response X conditional on Z   is distributed according to the density p(·,ψ(Z))$p(·,\psi (Z))$, where p(·,θ)$p(·,\theta )$ is a one-parameter exponential family. The function ψ$\psi$ is a smooth monotone function. Under this formulation, the regression function E(X|Z)$E(X|Z)$ is monotone in the co-variate Z   (and can be expressed as a one–one function of ψ$\psi$); hence the term “monotone response model”. Using a penalized least squares approach that incorporates both monotonicity and smoothness, we develop a scheme for producing smooth monotone estimates of the regression function and also the function ψ$\psi$ across this entire class of models. Point-wise asymptotic normality of this estimator is established, with the rate of convergence depending on the smoothing parameter. This enables construction of Wald-type (point-wise) as well as pivotal confidence sets for ψ$\psi$ and also the regression function. The methodology is extended to the general heteroscedastic model, and its asymptotic properties are discussed.     

Goodness-of-fit tests for parametric regression with selection biased data

Consider the nonparametric location-scale regression model Y=m(X)+σ(X)ε$Y=m(X)+\sigma (X)\epsilon$, where the error ε$\epsilon$ is independent of the covariate X$X$, and m$m$ and σ$\sigma$ are smooth but unknown functions. The pair (X,Y)$(X,Y)$ is allowed to be subject to selection bias. We construct tests for the hypothesis that m(·)$m(·)$ belongs to some parametric family of regression functions. The proposed tests compare the nonparametric maximum likelihood estimator (NPMLE) based on the residuals obtained under the assumed parametric model, with the NPMLE based on the residuals obtained without using the parametric model assumption. The asymptotic distribution of the test statistics is obtained. A bootstrap procedure is proposed to approximate the critical values of the tests. Finally, the finite sample performance of the proposed tests is studied in a simulation study, and the developed tests are applied on environmental data.     

A marked point process perspective in fitting spatial point process models

This paper discusses a new perspective in fitting spatial point process models. Specifically the spatial point process of interest is treated as a marked point process where at each observed event x$\mathbf{x}$ a stochastic process M(x;t)$M(\mathbf{x};t)$, 0<t<r$0<t<r$, is defined. Each mark process M(x;t)$M(\mathbf{x};t)$ is compared with its expected value, say F(t;θ)$F(t;\theta )$, to produce a discrepancy measure at x$\mathbf{x}$, where θ$\theta$ is a set of unknown parameters. All individual discrepancy measures are combined to define an overall measure which will then be minimized to estimate the unknown parameters. The proposed approach can be easily applied to data with sample size commonly encountered in practice. Simulations and an application to a real data example demonstrate the efficacy of the proposed approach.     

Tools for constructing optimal two-level factorial designs for a linear model containing main effects and one two-factor interaction

In Hedayat and Pesotan [1992, Two-level factorial designs for main effects and selected two-factor interactions. Statist. Sinica 2, 453–464.] the concepts of a g(n,e)$g(n,e)$-design and a g(n,e)$g(n,e)$-matrix are introduced to study designs of n$n$ factor two-level experiments which can unbiasedly estimate the mean, the n$n$ main effects and e$e$ specified two-factor interactions appearing in an orthogonal polynomial model and it is observed that the construction of a g-design is equivalent to the construction of a g  -matrix. This paper deals with the construction of D-optimal g(n,1)$g(n,1)$-matrices. A standard form for a g(n,1)$g(n,1)$-matrix is introduced and some lower and upper bounds on the absolute determinant value of a D-optimal g(n,1)$g(n,1)$-matrix in the class of all g(n,1)$g(n,1)$-matrices are obtained and an approach to construct D-optimal g(n,1)$g(n,1)$-matrices is given for 2?n?8$2?n?8$. For two specific subclasses, namely a certain class of g(n,1)$g(n,1)$-matrices within the class of g(n,1)$g(n,1)$-matrices of index one and the class C(H)$C(H)$ of g(8t+2,1)$g(8t+2,1)$-matrices constructed from a normalized Hadamard matrix H   of order 8t+4(t?1)$8t+4(t?1)$ two techniques for the construction of the restricted D-optimal matrices are given.     

Elicitation of multivariate prior distributions: A nonparametric Bayesian approach

In the context of Bayesian statistical analysis, elicitation is the process of formulating a prior density f(·)$f(·)$ about one or more uncertain quantities to represent a person's knowledge and beliefs. Several different methods of eliciting prior distributions for one unknown parameter have been proposed. However, there are relatively few methods for specifying a multivariate prior distribution and most are just applicable to specific classes of problems and/or based on restrictive conditions, such as independence of variables. Besides, many of these procedures require the elicitation of variances and correlations, and sometimes elicitation of hyperparameters which are difficult for experts to specify in practice. Garthwaite et al. (2005) discuss the different methods proposed in the literature and the difficulties of eliciting multivariate prior distributions. We describe a flexible method of eliciting multivariate prior distributions applicable to a wide class of practical problems. Our approach does not assume a parametric form for the unknown prior density f(·)$f(·)$, instead we use nonparametric Bayesian inference, modelling f(·)$f(·)$ by a Gaussian process prior distribution. The expert is then asked to specify certain summaries of his/her distribution, such as the mean, mode, marginal quantiles and a small number of joint probabilities. The analyst receives that information, treating it as a data set D   with which to update his/her prior beliefs to obtain the posterior distribution for f(·)$f(·)$. Theoretical properties of joint and marginal priors are derived and numerical illustrations to demonstrate our approach are given.     

On the joint distribution of placement statistics under progressive censoring and applications to precedence test

In reliability and survival analysis, comparison of two or more populations is an important problem. For example, while comparing a treatment group with a control group, one may be interested in determining whether the observations in the treatment group have a longer lifetime than those from the control group, that is, whether the treatment is effective or not. In such a study, it would be extremely valuable to make a decision based on early failures. In this paper, we consider independent progressively Type-II censored random samples from two populations with cumulative distribution function's (cdf) F(·)$F(·)$ and G(·)$G(·)$ respectively, and discuss a precedence test for testing the equality of the two distributions based on placements. For this purpose, we derive the joint distribution of the first l   placement statistics from the progressively censored sample from F(·)$F(·)$. We then derive the exact null distribution of the precedence test statistic which is simply the sum of the placements. We provide the rejection regions for fixed levels of significance and various sample sizes and different progressive censoring schemes.     

Representing a function of two variables as a superposition over angles of ridge functions with a given shape via linear programming

A ridge function with shape function g   in the horizontal direction is a function of the form g(x)h(y,0)$g(x)h(y,0)$. Along each horizontal line it has the shape g(x)$g(x)$, multiplied by a function h(y,0)$h(y,0)$ which depends on the y-value of the horizontal line. Similarly a ridge function with shape function g   in the vertical direction has the form g(y)h(x,π/2)$g(y)h(x,\pi /2)$. For a given shape function g it may or may not be possible to represent an arbitrary   function f(x,y)$f(x,y)$ as a superposition over all angles of a ridge function with shape g   in each direction, where h=_hf=_hf,g$h=h_f=h_{f,g}$ depends on the functions f and g   and also on the direction, θ:h=_hf,g(·,θ)$\theta :h=h_{f,g}(·,\theta )$. We show that if g   is Gaussian centered at zero then this is always possible and we give the function _hf,g$h_{f,g}$ for a given f(x,y)$f(x,y)$. For highpass or for odd shapes g  , we show it is impossible to represent an arbitrary f(x,y)$f(x,y)$, i.e. in general there is no _hf,g$h_{f,g}$. Note that our problem is similar to tomography, where the problem is to invert the Radon transform, except that the use of the word inversion is here somewhat “inverted”: in tomography f(x,y)$f(x,y)$ is unknown and we find it by inverting the projections of f  ; here, f(x,y)$f(x,y)$ is known, g(z)$g(z)$ is known, and _hf(·,θ)=_hf,g(·,θ)$h_f(·,\theta )=h_{f,g}(·,\theta )$ is the unknown.     

Classification of orthogonal arrays by integer programming

The problem of classifying all isomorphism classes of OA(N,k,s,t)$\mathrm{OA}(N,k,s,t)$'s is shown to be equivalent to finding all isomorphism classes of non-negative integer solutions to a system of linear equations under the symmetry group of the system of equations. A branch-and-cut algorithm developed by Margot [2002. Pruning by isomorphism in branch-and-cut. Math. Programming Ser. A 94, 71–90; 2003a. Exploiting orbits in symmetric ILP. Math. Programming Ser. B 98, 3–21; 2003b. Small covering designs by branch-and-cut. Math. Programming Ser. B 94, 207–220; 2007. Symmetric ILP: coloring and small integers. Discrete Optim., 4, 40–62] for solving integer programming problems with large symmetry groups is used to find all non-isomorphic OA(24,7,2,2)$\mathrm{OA}(24,7,2,2)$'s, OA(24,k,2,3)$\mathrm{OA}(24,k,2,3)$'s for 6?k?11$6?k?11$, OA(32,k,2,3)$\mathrm{OA}(32,k,2,3)$'s for 6?k?11$6?k?11$, OA(40,k,2,3)$\mathrm{OA}(40,k,2,3)$'s for 6?k?10$6?k?10$, OA(48,k,2,3)$\mathrm{OA}(48,k,2,3)$'s for 6?k?8$6?k?8$, OA(56,k,2,3)$\mathrm{OA}(56,k,2,3)$'s, OA(80,k,2,4)$\mathrm{OA}(80,k,2,4)$'s, OA(112,k,2,4)$\mathrm{OA}(112,k,2,4)$'s, for k=6,7$k=6,7$, OA(64,k,2,4)$\mathrm{OA}(64,k,2,4)$'s, OA(96,k,2,4)$\mathrm{OA}(96,k,2,4)$'s for k=7,8$k=7,8$, and OA(144,k,2,4)$\mathrm{OA}(144,k,2,4)$'s for k=8,9$k=8,9$. Further applications to classifying covering arrays with the minimum number of runs and packing arrays with the maximum number of runs are presented.     

On asymptotic properties of the parameter estimator for a type of SPDE

In this paper, we study a random field _U?(t,x)$U_{?}(t,x)$ governed by some type of stochastic partial differential equations with an unknown parameter θ$\theta$ and a small noise ?$?$. We construct an estimator of θ$\theta$ based on the continuous observation of N   Fourier coefficients of _U?(t,x)$U_{?}(t,x)$, and prove the strong convergence and asymptotic normality of the estimator when the noise ?$?$ tends to zero.     

The use of an identity in Anderson for multivariate multiple testing

Consider the model where there are I$I$ independent multivariate normal treatment populations with p×1$p\times 1$ mean vectors _μi${\mathit{\mu }}_i$, i=1,…,I$i=1,\dots ,I$, and covariance matrix Σ$\Sigma$. Independently the (I+1)$(I+1)$st population corresponds to a control and it too is multivariate normal with mean vector _μI+1${\mathit{\mu }}_{I+1}$ and covariance matrix Σ$\Sigma$. Now consider the following two multiple testing problems.     

Analysis of one-way layout of count data in the presence of over or under dispersion

This article develops test statistics for the homogeneity of the means of several treatment groups of count data in the presence of over-dispersion or under-dispersion when there is no likelihood available. The C(α)$C(\alpha )$ or score type tests based on the models that are specified by only the first two moments of the counts are obtained using quasi-likelihood, extended quasi-likelihood, and double extended quasi-likelihood. Monte Carlo simulations are then used to study the comparative behavior of these C(α)$C(\alpha )$ statistics compared to the C(α)$C(\alpha )$ statistic based on a parametric model, namely, the negative binomial model, in terms of the following: size; power; robustness for departures from the data distribution as well as dispersion homogeneity. These simulations demonstrate that the C(α)$C(\alpha )$ statistic based on the double extended quasi-likelihood holds the nominal size at the 5% level well in all data situations, and it shows some edge in power over the other statistics, and, in particular, it performs much better than the commonly used statistic based on the quasi-likelihood. This C(α)$C(\alpha )$ statistic also shows robustness for moderate heterogeneity due to dispersion. Finally, applications to ecological, toxicological and biological data are given.     

Optimal block designs for three treatments when observations are correlated

E$E$-optimal designs for comparing three treatments in blocks of size three are identified, where intrablock observations are correlated according to a first order autoregressive error process with parameter ρ∈(0,1)$\rho \in (0,1)$. For number of blocks b   of the form b=3n+1$b=3n+1$, there are two distinct optimal designs depending on the value of ρ$\rho$, with the best design being unequally replicated for large ρ$\rho$. For other values of b$b$, binary, equireplicate designs with specified within-block assignment patterns are best. In many cases, the stronger majorization optimality is established.     

Truncated linear estimation of a bounded multivariate normal mean

We consider the problem of estimating the mean θ$\theta$ of an _Np(θ,_Ip)${\mathrm{N}}_{\mathrm{p}}(\theta ,I_p)$ distribution with squared error loss ∥δ−θ∥²$\parallel \delta -\theta {\parallel }^2$ and under the constraint ∥θ∥≤m$\parallel \theta \parallel \le m$, for some constant m>0$m>0$. Using Stein's identity to obtain unbiased estimates of risk, Karlin's sign change arguments, and conditional risk analysis, we compare the risk performance of truncated linear estimators with that of the maximum likelihood estimator _δmle${\delta }_{\mathrm{mle}}$. We obtain for fixed (m,p)$(m,p)$ sufficient conditions for dominance. An asymptotic framework is developed, where we demonstrate that the truncated linear minimax estimator dominates _δmle${\delta }_{\mathrm{mle}}$, and where we obtain simple and accurate measures of relative improvement in risk. Numerical evaluations illustrate the effectiveness of the asymptotic framework for approximating the risks for moderate or large values of p.     

Skew Dyck paths

In this paper we study the class S$\mathbb{S}$ of skew Dyck paths, i.e. of those lattice paths that are in the first quadrant, begin at the origin, end on the x-axis, consist of up steps  U=(1,1)$U=(1,1)$, down steps  D=(1,-1)$D=(1,-1)$, and left steps  L=(−1,-1)$L=(-1,-1)$, and such that up steps never overlap with left steps. In particular, we show that these paths are equinumerous with several other combinatorial objects, we describe some involutions on this class, and finally we consider several statistics on S$\mathbb{S}$.     

Super-simple cyclic designs with small values

Super-simple cyclic designs are useful on constructing codes and designs such as superimposed codes, perfect hash families and optical orthogonal codes with index two. In this paper, we show that there exists a super-simple cyclic (v,4,λ)$(v,4,\lambda )$ for 7?v?41$7?v?41$ and all admissible λ$\lambda$ with two definite exceptions of (v,λ)=(9,3),(13,5)$(v,\lambda )=(9,3),(13,5)$ and one possible exception of (v,λ)=(39,18)$(v,\lambda )=(39,18)$. Some useful algorithms are explained for computer search and new designs are displayed.     

Reduced-rank estimation of the difference between two covariance matrices

We consider m×m$m\times m$ covariance matrices, _Σ1${\Sigma }_1$ and _Σ2${\Sigma }_2$, which satisfy _Σ2-_Σ1=Δ${\Sigma }_2-{\Sigma }_1=\Delta$, where Δ$\Delta$ has a specified rank. Maximum likelihood estimators of _Σ1${\Sigma }_1$ and _Σ2${\Sigma }_2$ are obtained when sample covariance matrices having Wishart distributions are available and rank(Δ)$\text{rank}(\Delta )$ is known. The likelihood ratio statistic for a test about the value of rank(Δ)$\text{rank}(\Delta )$ is also given and some properties of its null distribution are obtained. The methods developed in this paper are illustrated through an example.     

Lattice and Schröder paths with periodic boundaries

We consider paths in the plane with (1,0$1,0$), (0,1$0,1$), and (a,b$a,b$)-steps that start at the origin, end at height n$n$, and stay strictly to the left of a given non-decreasing right boundary. We show that if the boundary is periodic and has slope at most b/a$b/a$, then the ordinary generating function for the number of such paths ending at height n   is algebraic. Our argument is in two parts. We use a simple combinatorial decomposition to obtain an Appell relation or “umbral” generating function, in which the power zⁿ$z^n$ is replaced by a power series of the form zⁿ_φn(z),$z^n{\phi }_n(z),$ where _φn(0)=1.${\phi }_n(0)=1.$ Then we convert (in an explicit way) the umbral generating function to an ordinary generating function by solving a system of linear equations and a polynomial equation. This conversion implies that the ordinary generating function is algebraic. We give several concrete examples, including an alternative way to solve the tennis ball problem.     

Distribution of concomitants of order statistics and their order statistics

For a random sample of size n$n$ from an absolutely continuous random vector (X,Y)$(X,Y)$, let _Yi:n$Y_{i:n}$ be i$i$th Y$Y$-order statistic and _Y[j:n]$Y_{[j:n]}$ be the Y$Y$-concomitant of _Xj:n$X_{j:n}$. We determine the joint pdf of _Yi:n$Y_{i:n}$ and _Y[j:n]$Y_{[j:n]}$ for all i,j=1$i,j=1$ to n$n$, and establish some symmetry properties of the joint distribution for symmetric populations. We discuss the uses of the joint distribution in the computation of moments and probabilities of various ranks for _Y[j:n]$Y_{[j:n]}$. We also show how our results can be used to determine the expected cost of mismatch in broken bivariate samples and approximate the first two moments of the ratios of linear functions of _Yi:n$Y_{i:n}$ and _Y[j:n]$Y_{[j:n]}$. For the bivariate normal case, we compute the expectations of the product of _Yi:n$Y_{i:n}$ and _Y[i:n]$Y_{[i:n]}$ for n=2$n=2$ to 8 for selected values of the correlation coefficient and illustrate their uses.