Using Lasso RCCA for cross-language information retrieval

ABSTRACT

Restricted canonical correlation analysis and the lasso shrinkage method were paired together for canonical correlation analysis with non-negativity restrictions on datasets, where a sample size is much smaller than the number of variables. The method was implemented in an alternating least-squares algorithm and applied to cross-language information retrieval on a dataset with aligned documents in eight languages. A set of experiments was ran to evaluate the method and compare it to other methods in the field.     

Nonparametric Regression with Sample Design Following a Random Process

Nonparametric regression is considered where the sample point placement is not fixed and equispaced, but generated by a random process with rate n. Conditions are found for the random processes that result in optimal rates of convergence for nonparametric regression when using a block thresholded wavelet estimator. Previous results on nonparametric regression via wavelets on both fixed and random sample point placement are shown to be special cases of the general result given here. The estimator is adaptive over a large range of Hölder function spaces and the convergence rate exhibited is an improvement over term-by-term wavelet estimators. Threshold selection is implemented in a data-adaptive fashion, rather than using a fixed threshold as is usually done in block thresholding. This estimator, BlockSure, is compared against fixed-threshold block estimators and the more traditional term-by-term threshold wavelet estimators on several random design schemes via simulations.     

Trimmed and Outer Means and Their Variances

Some properties of trimmed and outer means for the normal situation are considered; in particular, the mean of the outer half of the sample has the same variance as the mean of the inner half. An inequality involving variances of unbiased estimators of location and their complements is derived and some of its consequences are examined.     

Tail-Adaptive Location Rank Test for the Generalized Secant Hyperbolic Distribution

The generalized secant hyperbolic distribution (GSHD) was recently introduced as a modeling tool in data analysis. The GSHD is a unimodal distribution that is completely specified by location, scale, and shape parameters. It has also been shown elsewhere that the rank procedures of location are regular, robust, and asymptotically fully efficient. In this article, we study certain tail weight measures for the GSHD and introduce a tail-adaptive rank procedure of location based on those tail weight measures. We investigate the properties of the new adaptive rank procedure and compare it to some conventional estimators.     

Variable selection and estimation for high-dimensional spatial autoregressive models

Spatial regression models are important tools for many scientific disciplines including economics, business, and social science. In this article, we investigate postmodel selection estimators that apply least squares estimation to the model selected by penalized estimation in high-dimensional regression models with spatial autoregressive errors. We show that by separating the model selection and estimation process, the postmodel selection estimator performs at least as well as the simultaneous variable selection and estimation method in terms of the rate of convergence. Moreover, under perfect model selection, the ℓ₂ rate of convergence is the oracle rate of $\sqrt{s/n}$, compared with the convergence rate of $\text{◂√▸}\sqrt{s\log p/n}$ in the general case. Here, n is the sample size and p, s are the model dimension and number of significant covariates, respectively. We further provide the convergence rate of the estimation error in the form of $\sup$ norm, and ideally the rate can reach as fast as $\text{◂√▸}\sqrt{\log s/n}$.     

Learning to Manage the Multirisk World

Risk assessment, perception, and management tend to focus on one risk at a time. But we live in a multirisk world. This essay in honor of the 40th anniversary of the Society for Risk Analysis (SRA) and the journal Risk Analysis suggests that we can—and have already begun to—strengthen risk analysis and policy outcomes by moving from a focus on the single to the multiple—multiple stressors, multiple impacts, and multiple decisions. This evolution can improve our abilities to assess actual risks, to confront and weigh risk-risk trade-offs and innovate risk-superior moves, and to build learning into adaptive regulation that adjusts over time. Recognizing the multirisk reality can help us understand complex systems, foresee unintended consequences, design better policy solutions, and learn to improve.     

Toward General Principles for Resilience Engineering

Maintaining the performance of infrastructure-dependent systems in the face of surprises and unknowable risks is a grand challenge. Addressing this issue requires a better understanding of enabling conditions or principles that promote system resilience in a universal way. In this study, a set of such principles is interpreted as a group of interrelated conditions or organizational qualities that, taken together, engender system resilience. The field of resilience engineering identifies basic system or organizational qualities (e.g., abilities for learning) that are associated with enhanced general resilience and has packaged them into a set of principles that should be fostered. However, supporting conditions that give rise to such first-order system qualities remain elusive in the field. An integrative understanding of how such conditions co-occur and fit together to bring about resilience, therefore, has been less clear. This article contributes to addressing this gap by identifying a potentially more comprehensive set of principles for building general resilience in infrastructure-dependent systems. In approaching this aim, we organize scattered notions from across the literature. To reflect the partly self-organizing nature of infrastructure-dependent systems, we compare and synthesize two lines of research on resilience: resilience engineering and social-ecological system resilience. Although some of the principles discussed within the two fields overlap, there are some nuanced differences. By comparing and synthesizing the knowledge developed in them, we recommend an updated set of resilience-enhancing principles for infrastructure-dependent systems. In addition to proposing an expanded list of principles, we illustrate how these principles can co-occur and their interdependencies.     

A Starting Point for Navigating the World of Daily Fantasy Basketball

Fantasy sports, particularly the daily variety in which new lineups are selected each day, are a rapidly growing industry. The two largest companies in the daily fantasy business, DraftKings and Fanduel, have been valued as high as $2 billion. This research focuses on the development of a complete system for daily fantasy basketball, including both the prediction of player performance and the construction of a team. First, a Bayesian random effects model is used to predict an aggregate measure of daily NBA player performance. The predictions are then used to construct teams under the constraints of the game, typically related to a fictional salary cap and player positions. Permutation based and K-nearest neighbors approaches are compared in terms of the identification of “successful” teams—those who would be competitive more often than not based on historical data. We demonstrate the efficacy of our system by comparing our predictions to those from a well-known analytics website, and by simulating daily competitions over the course of the 2015–2016 season. Our results show an expected profit of approximately $9,000 on an initial $500 investment using the K-nearest neighbors approach, a 36% increase relative to using the permutation-based approach alone. Supplementary materials for this article are available online.     

Detection of multiple undocumented change-points using adaptive Lasso

The problem of detecting multiple undocumented change-points in a historical temperature sequence with simple linear trend is formulated by a linear model. We apply adaptive least absolute shrinkage and selection operator (Lasso) to estimate the number and locations of change-points. Model selection criteria are used to choose the Lasso smoothing parameter. As adaptive Lasso may overestimate the number of change-points, we perform post-selection on change-points detected by adaptive Lasso using multivariate t simultaneous confidence intervals. Our method is demonstrated on the annual temperature data (year: 1902–2000) from Tuscaloosa, Alabama.     

Estimation of the extended Weibull parameters and acceleration factors in the step-stress accelerated life tests under an adaptive progressively hybrid censoring data

ABSTRACT

Based on the tampered failure rate model under the adaptive Type-II progressively hybrid censoring data, we discuss the maximum likelihood estimators of the unknown parameters and acceleration factors in the general step-stress accelerated life tests in this paper. We also construct the exact and unique confidence interval for the extended Weibull shape parameter. In the numerical analysis, we describe the simulation procedures to obtain the adaptive Type-II progressively hybrid censoring data in the step-stress accelerated life tests and present an experimental data to illustrate the performance of the estimators.