Using Lasso RCCA for cross-language information retrieval

ABSTRACT

Restricted canonical correlation analysis and the lasso shrinkage method were paired together for canonical correlation analysis with non-negativity restrictions on datasets, where a sample size is much smaller than the number of variables. The method was implemented in an alternating least-squares algorithm and applied to cross-language information retrieval on a dataset with aligned documents in eight languages. A set of experiments was ran to evaluate the method and compare it to other methods in the field.     

On the asymptotic properties of parameter estimates in a regression model with non-normally distributed errors

As pointed out in a recent paper by Amirkhalkhali and Rao (1986) (henceforth referred to as A&R), the usual assumption of normality for the error terms of a regression model isoften untenable. However, when this assumption is dropped, it may be difficult to characterize parameter estimates for the model. For example, A&R (p. 189) state that “if the regression errors are non-normal, we are not even sure of their [e.g., the generalized least squares parameter estimates1] asymptotic properties.” A partial answer, however, is given by Spall and Wall (1984), which presents an asymptotic distribution theory for Kalman filter estimates for cases where the random terms of the state space model are not necessarily Gaussian. Certain of these asymptotic distribution results are also discussed in Spall (1985) in the context of model validation (diagnostic checking)     

Geometry in Canonical Correlations

In this article, a useful proposition relating the canonical correlations in multi-way layout to the singular values of a specific matrix is proved and also a geometrical explanation of canonical correlations as an angle between subspaces is given.     

On the Similarity Structure of Order Statistics

In this article, we address the similarity structure between pairs of order statistics of an identically distributed independent random variables X₁,…, X_n. The overlapping coefficient (Δ) of Weitzman (1970 Weitzman , M. S. ( 1970 ). Measures of overlap of income distributions of white and Negro families in the United States . Technical Paper No. 22 , Washington , D.C. , U.S.A : Department of Commerce, Bureau of Census . [Google Scholar]), is used to assess the degree of similarity or closeness between pairs of order statistics. It appears that the degree of the similarity between any of such pairs is independent of the parent distribution. Using this notion, it is shown that for i < j, the degree of similarity between distributions of the ith and the jth order statistics decreases as i and j sunder. Some possible biometric applicability of the value of Δ are explored. In particular, the use of this measure in estimation of the number of possible strata, subgroups or natural subdivisions in a population are suggested.     

The Sample Coefficient of Determination in Simple Linear Regression

The behavior of the sample coefficient of determination is examined for some arrangements of independent variable values in a simple linear regression with normally distributed error terms. Numerical values of means and standard deviations are presented that provide some insight into the influence of range and arrangement of independent variable values and sample size on the size of the sample coefficient of determination. Some asymptotic results are given.     

The Ranges of Limiting Values of Some Partial Correlations under Conditional Independence

Pearson's partial correlation, Kendall's partial tau, and a partial correlation based on Spearman's rho need not be consistent estimators of zero under conditional independence. The ranges of possible limiting values of these correlations are computed under multivariate normality and lognormality. Students should exercise caution when interpreting these partial correlations as a measure of conditional independence.     

An Interesting Property of the Sample Mean under a First-Order Autoregressive Model

The unweighted sample mean is examined as an estimator of the population mean in a first-order autoregressive model. It is demonstrated that the precision of this estimator deteriorates as the number of equally spaced observations taken within a fixed time interval increases.     

Reducing component estimation for varying coefficient models

The estimation problem for varying coefficient models has been studied by many authors. We consider the problem in the case that the unknown functions admit different degrees of smoothness. In this paper we propose a reducing component local polynomial method to estimate the unknown functions. It is shown that all of our estimators achieve the optimal convergence rates. The asymptotic distributions of our estimators are also derived. The established asymptotic results and the simulation results show that our estimators outperform the the existing two-step estimators when the coefficient functions admit different degrees of smoothness. We also develop methods to speed up the estimation of the model and the selection of the bandwidths.     

Second-order asymptotic comparison of estimators under φ-divergence loss

Our main concern is on the second-order asymptotic optimality problem of estimators. The φ-divergence loss is used as a criterion for evaluating the performance of estimators. In the comparison problem of any two estimators, the condition that one estimator dominates another estimator under the φ-divergence risk is given by evaluating the second-order term in the difference between the risks. As a result, it is proved that the condition is characterized by a peculiar value of the φ-divergence loss, which is called the divergence-loss coefficient. Furthermore, it is shown that the comparison based on the φ-divergence loss does not correspond with that based on any standard loss functions including the mean squared error, the absolute loss and the 0-1 loss. In addition, a necessary and sufficient condition for an estimator to be second-order admissible is derived.     

Asymptotic Expansion and Conditional Robustness for the Sample Multiple Correlation Coefficient Under Nonnormality

ABSTRACT

Asymptotic distributions of the standardized estimators of the squared and non squared multiple correlation coefficients under nonnormality were obtained using Edgeworth expansion up to O(1/n). Conditions for the normal-theory asymptotic biases and variances to hold under nonnormality were derived with respect to the parameter values and the weighted sum of the cumulants of associated variables. The condition for the cumulants indicates a compensatory effect to yield the robust normal-theory lower-order cumulants. Simulations were performed to see the usefulness of the formulas of the asymptotic expansions using the model with the asymptotic robustness under nonnormality, which showed that the approximations by Edgeworth expansions were satisfactory.