A Study of the Properties of the Item Count Technique

The item count technique is an indirect questioning techniquethat is used to estimate the proportion of people who have engagedin stigmatizing behavior. This technique is expected to yielda more appropriate estimate than the ordinary direct questioningtechnique because it requests respondents to indicate, basedon a list of several items, simply the number of items thatare applicable to them, including the target key item. An experimentalweb survey was conducted in an attempt to compare the directquestioning technique and the item count technique. Comparedwith the direct questioning technique, the item count techniqueyielded higher estimates of the proportion of shoplifters bynearly 10 percentage points, whereas the difference betweenthe estimates using these two techniques was mostly insignificantwith respect to innocuous blood donation. The survey resultssuggest that in the item count technique respondents tend toreport fewer total behaviors compared to the direct questioncase. This tendency is more pronounced in the case of longeritem lists. Three domain estimators for the item count techniquewere compared, and the cross-based method appeared to be themost appropriate method. Large differences in domain estimatesfor shoplifting between the item count and direct questioningtechniques were found among female respondents, middle-agedrespondents, respondents living in urban areas, and highly-educatedrespondents.     

A PARTIAL INDEPENDENCE ITEM RESPONSE MODEL FOR SURVEYS WITH FILTER QUESTIONS

In many surveys, responses to earlier questions determine whether later questions are asked. The probability of an affirmative response to a given item is therefore nonzero only if the participant responded affirmatively to some set of logically prior items, known as "filter items." In such surveys, the usual conditional independence assumption of standard item response models fails. A weaker "partial independence" assumption may hold, however, if an individual's responses to different items are independent conditional on the item parameters, the individual's latent trait, and the participant's affirmative responses to each of a set of filter items. In this paper, we propose an item response model for such "partially independent" item response data. We model such item response patterns as a function of a person-specific latent trait and a set of item parameters. Our model can be seen as a generalized hybrid of a discrete-time hazard model and a Rasch model. The proposed procedure yields estimates of (1) person-specific, interval-scale measures of a latent trait (or traits), along with person-specific standard errors of measurement; (2) conditional and marginal item severities for each item in a protocol; (3) person-specific conditional and marginal probabilities of an affirmative response to each item in a protocol; and (4) item information and total survey information. In addition, we show here how to investigate and test alternative conceptions of the dimensionality of the latent trait(s) being measured. Finally, we compare our procedure with a simpler alternative approach to summarizing data of this type.     

MEASURING HAPPINESS IN SURVEYS: A TEST OF THE SUBTRACTION HYPOTHESIS

Responses to an item on general happiness can change when thatitem follows one on marital happiness. Asking about maritalhappiness first sometimes reduces reported levels of overallhappiness. This reduction may result from a change in the interpretationof the general happiness item. According to this hypothesis,when the general item follows the item on marital happiness,respondents take the item to ask about aspects of their livesother than their marriages-in effect, the respondents subtracttheir (mostly happy) marriages in answering the general item.The study reported here tests this subtraction hypothesis byasking versions of the general happiness item that correspondto the different interpretations. A version of the general itemthat asked about general happiness "aside from your marriage"yielded responses that were quite similar to those given tothe standard item when it followed the item on marital happiness.Another version that asked about general happiness "includingyour marriage" elicited responses quite similar to those elicitedby the standard item when it preceded the marital happinessitem. However, reanalysis of the studies that originally demonstratedthe impact of the order of the two happiness items casts doubton the subtraction hypothesis and related models as explanationsof the earlier findings.     

Meaning and Measurement in Cross-National Research on Satisfaction with Democracy

The stability of a democratic nation has long been thought torest on its level of legitimacy among the mass public. Yet,measurement of such support has been characterized by considerableconfusion. One key element in that confusion is the heavy relianceover the past 20 years on data from a survey item that measuresrespondents' levels of satisfaction with democracy. Data fromthis item have been analyzed in numerous studies of politicalsupport. This research has proceeded despite the existence ofsubstantial disagreement regarding what dimension or dimensionsof support the item measures. In an effort to resolve this ambiguity,we examine the conceptual and empirical properties of the itemin question. The analysis draws on original surveys conductedin 1999 in Romania and El Salvador and on data from the 1997Latinbarometer. Results reveal that the satisfaction with democracyitem taps multiple dimensions of political support and thatthe substantive content represented by the item varies acrossboth individuals and nations. We argue that these empiricalcharacteristics limit the capacity of analysts to derive meaningfulinferences from study of this item and that, until clarificationof the measurement issue is obtained, progress in identifyingpredictors of democratic stability will be slowed.     

Validation of the Chinese version of the Oswestry Disability Index

This study aimed to collect evidence on the structural and substantive validity, and test-retest reliability of the Chinese version of the Oswestry Disability Index (CODI). Seventy-nine patients suffering from chronic low back pain were assessed with the CODI. The results of explorative factor analysis primarily suggested a single-factor structure with nine out of 10 items (factor loading = 0.66-0.79). The sex life item was found to load on a different factor. The Cronbach's alpha of all 10 items was 0.81 (p<0.05). When the sex life item was removed from the analysis, the alpha value was increased to 0.89 (p<0.05). The test-retest reliability was estimated based on 56 participants who completed two administrations of CODI in 48 hours. The intraclass correlation coefficient (ICC) computed for the total CODI scores was 0.86 (95% C.I. = 0.81-0.91). The reliability estimated for the item scores using Kappa statistics ranged from a high of k=0.80 for the sitting item to a low of k=0.49 for the traveling item. Kappa statistics were not available for three items. The Chinese version of the Oswestry Disability Index demonstrated satisfactory validity and test-retest reliability, and so could be considered as an appropriate instrument for assessing chronic back pain-related disability in Chinese patients in Hong Kong. Further research should address the cross-cultural and measurement issues in regard to sex life in order to further improve the test content of the instrument.     

Examining the Psychometric Properties of the Identify as a Professional Social Worker Subscale

ABSTRACT

The purpose of this study was to examine the psychometric properties of the Identify as a Professional Social Worker Subscale, which assessed the Council on Social Work Education–prescribed competency identify as a professional social worker and conduct oneself accordingly. The results of confirmatory factory analysis indicated that the items on the measure assessed the underlying latent construct of identification as a professional social worker. The item response theory analysis indicated that the measure could be shortened to a four-item measure, and the item “demonstrate professional demeanor in behavior, appearance, and communication” was the highest discriminating item, whereas “advocate for client access to the services of social work” was the lowest discriminating item. Implications for research, measurement development, and the 2015 Educational Policy and Accreditation Standards are discussed.     

Development and Spanish translation of the Weinberg Center Risk and Abuse Prevention Screen (WC-RAPS)

Barriers for enhanced detection, identification, and reporting of elder abuse include the paucity of appropriate, valid, easily administered screening tools. This article describes the qualitative methods used in the development of the Weinberg Center Risk and Abuse Prevention Screen (WC-RAPS), and of its Spanish version. Focus groups and cognitive interviews were instrumental in identifying problematic items, underscoring potential response errors, and informing about putative causes for divergent interpretations of item-intent. Seven of the 11 original items were modified, a double-barreled item was segregated into two, one item deleted, and three additional items included to create the final 13 WC-RAPS items. The multi-step approach implemented for the Spanish conversion evidenced deviation from the original intended meaning for one item. The readability for English and Spanish versions was also assessed. Screening for elder abuse, if implemented systematically can be instrumental in identifying unrecognized abuse and preventing reoccurrence.     

Observational Measure of Elder Self-Neglect

The purpose of this study was to improve measurement of elder self-neglect by testing the psychometric properties of the Elder Self-Neglect Assessment (ESNA). Social workers, case managers, and adult protective services providers from 13 Illinois agencies completed a 77-item assessment for 215 clients suffering from self neglect. Analyses used Rasch item response theory and traditional validation approaches to test for dimensionality, model fit, and additional construct validation, resulting in a 62-item assessment. The ESNA met Rasch fit criteria with good internal consistency, item reliability, and construct validity. A 25-item short form also met Rasch criteria. A hierarchy of items associated with severity of abuse was produced by frequency of occurrence. ESNA indicators of self-neglect align into two broad categories: behavioral characteristics and environmental factors, which must be accounted for in a comprehensive evaluation. Theoretical refinements developed using the empirically generated item hierarchy may help to improve assessment and intervention.     

Rates of missing responses in personal digital assistant (PDA) versus paper assessments

This article describes rates of missing item responses in personal digital assistant (PDA) assessments as compared to paper assessments. Data come from the evaluation of a classroom-based leisure, life skills, and sexuality education program delivered to high school students in Cape Town, South Africa. Analyses show that the paper assessments had much higher rates of missing-ness than PDA assessments. This association is moderated by item order. Certain analyses also suggest that paper assessments have higher rates of missingness for items pertaining to participants' sexual behavior. Implications of these results for evaluation research will be discussed.     

Latin America and the Postwar Era

Trying out a “Beyond the Bubble” assessment in a social studies methods classroom revealed that the assessment worked much better than any multiple choice item while retaining great ease in marking. However, as discussion of the item showed, the rubrics for the item apply the “sourcing” heuristic so literally that it loses some power. Specifically, any answer from the 19th century is automatically wrong since students are asked to think about a 20th century poster and play. Yet the authors of the play about John Brown, writing in 1930, were indeed thinking about John Brown. Answers that methods students gave that combined an item from the 19th and 20th century demonstrated considerable historical thinking.     

The Effects of Multiple-Tact and Receptive-Discrimination Training on the Acquisition of Intraverbal Behavior

The purpose of this study was to determine whether multiple-tact training and receptive-discrimination training could be used to teach thematically related vocal intraverbals to typically developing preschool children. Multiple-tact training involved teaching a child to name both the item and the category to which the item belonged. Receptive-discrimination training consisted of teaching a child to select a picture card in the presence of a question from the experimenter regarding the item or its category. When neither of these strategies resulted in substantial increases in intraverbal responses, a typical intraverbal training protocol using tact prompts was implemented. Six typically developing children participated in the study. A multiple-baseline design across word categories was used to evaluate the effects of the three training procedures. Results indicated that both multiple-tact and receptive-discrimination training had minimal effects on the strength of the intraverbal repertoire, whereas direct intraverbal training had a more substantial effect. The results provide some evidence of the functional independence of verbal operants, as well as the independence of listener and speaker repertoires. Receptive-discrimination and multiple-tact training may have facilitated acquisition of intraverbals; however, further research is needed to assess how these repertoires might interact with each other.     

CONTEXT EFFECTS FOR CENSUS MEASURES OF RACE AND HISPANIC ORIGIN

This paper reports on the results of a split-ballot experimentconducted in 1987 to test alternative versions of the decennialcensus long form. Two forms were randomly assigned and self-administeredin group sessions involving a total of 515 respondents. Theorder of race and Hispanic origin items was experimentally manipulated.The standard long form asks race, then Hispanic origin. Theexperimental form reversed the order of the items in order toreduce perceived redundancy, and to create a more restrictedframe of reference for the race item. The objectives of thecontext manipulation were (1) to reduce item nonresponse forthe Hispanic origin item, and (2) to reduce reporting of "Otherrace" by Hispanics in the race item. Objective (1) was met.Objective (2) was met for Hispanics born in a U.S. state, butnot for immigrants. The results are interpreted as reflectinga process of acculturation that affects how Hispanic respondentsapply U.S. racial categories "white" and "black" in the census.     

An item response theory investigation of the Family Assessment Form

Drawing from a sample obtained from a large scale, community-based child maltreatment prevention initiative, factor analysis and item response theory (IRT) were used to examine item discrimination and to identify items on the Family Assessment Form (FAF) that statistically do not add value for predictive modeling. Results suggest a consolidated, six-factor structure in general accordance with the current configuration of the instrument. In addition, 13 of the 59 items are identified as low information, indicating that they do not contribute unique measurement information regarding the underlying dimensions of the FAF. Findings suggest that from a statistical measurement perspective, the FAF can be shortened and retain its internal validity, although from a functional assessment perspective, certain items may need to be retained for comprehensive family assessment and case planning.     

CAN CHANGES IN CONTEXT REDUCE VOTE OVERPORTING IN SURVEYS?

This paper reports the results of two split-sample experimentsdesinged to examine whether question context can reduce voteoverreporting in surveys. The first experiment tests the effectsof preceding the turnout item with a question about the locationof the polling place. If respondents who overreport do notknow where their polling place is, they should be less apt toreport incorrectly about turnout after being asked the locationof the poll. The second experiment tests the effects of precedingthe vote item with a question about lifetime electoral behaviour.If inaccurancy is dueto respondent's wanting to present themselvesin a favourable light, the oppurtunity to report past or usualgood citizenship should reduce the pressure to claim participationin the last election.     

Which Diagnostic Criteria are Most Useful in Discriminating Between Social Gamblers and Individuals with Gambling Problems? An Examination of DSM-IV and DSM-5 Criteria

The current study sought to identify which diagnostic criteria for gambling disorder have the greatest ability to differentiate between social and problem gamblers. This study was conducted on a sample of male and female college student athletes across the U.S. (n = 8674). Classification and regression tree analysis represents an appropriate technique when addressing the question of an item’s diagnostic value, as it sequentially selects variables to isolate sets of observations with similar outcomes. The current results suggest that the item related to preoccupation (“Have there been periods in the past year where you spent a lot of time thinking about gambling?”) was the DSM-5 item best able to differentiate between male and female social and problem gamblers in this sample. When considering only the nine criteria retained in the DSM-5, three criteria were identified as key for distinguishing between social and disordered gamblers among men, and one criterion was identified for distinguishing between groups of women. In addition, these results do not support the notion that the illegal acts criterion has a particularly low base rate and found that it can be an important indicator of disordered gambling in a college-aged sample.     

Is Sexual Well-Being Part of Subjective Well-Being? An Empirical Analysis of Belgian (Flemish) Survey Data Using an Extended Well-Being Scale

Most conventionally used subjective well-being scales do not include any measurement of sexual well-being, despite the fact that most available research and theories indicate that sexuality is to be considered an important and integral part of human well-being. This article proposes a five-item subjective well-being scale that includes sexual well-being. A representative pilot survey in Belgium (n = 2,080) indicated that item non-response on the sexual item was limited. The new scale is strongly one-dimensional and internally coherent. A multivariate analysis demonstrated that including sexual well-being allows for a better understanding of subjective well-being, highlighting the importance of age and having a partner, and the interaction between both variables. This article concludes that the positive impact of having a partner on subjective well-being significantly increases with age. It is argued that sexual well-being should be included in subjective well-being measurements that are routinely being used in population surveys.     

Visual short‐term memory for overtly attended objects during infancy

We investigated limitations in young infants’ visual short‐term memory (VSTM). We used a one‐shot change detection task to ask whether 4‐ and 8.5‐month‐old infants (N = 59) automatically encode fixated items in VSTM. Our task included trials that consisted of the following sequence: first a brief (500 ms) presentation with a sample array of two items, next a brief (300 ms) delay period with a blank screen, and finally a test array (2,000 ms) identical to the sample array except that the color of one of the two items is changed. In Experiment 1, we induced infants to fixate one item by rotating it during the sample (the other item remained stationary). In Experiment 2, none of the items rotated. In both experiments, 4‐month‐old infants looked equally at the fixated item when it did and did not change color, providing no evidence that they encoded in VSTM the fixated item. In contrast, 8.5‐month‐old infants in Experiment 1 preferred the fixated item when it changed color from sample to test. Thus, 4‐month‐old infants do not appear to automatically encode fixated items in VSTM.     

Using anchoring vignettes to assess group differences in general self-rated health

This article addresses a potentially serious problem with the widely used self-rated health (SRH) survey item: that different groups have systematically different ways of using the item's response categories. Analyses based on unadjusted SRH may thus yield misleading results. The authors evaluate anchoring vignettes as a possible solution to this problem. Using vignettes specifically designed to calibrate the SRH item and data from the Wisconsin Longitudinal Study (WLS; N = 2,625), the authors show how demographic and health-related factors, including sex and education, predict differences in rating styles. Such differences, when not adjusted for statistically, may be sufficiently large to lead to mistakes in rank orderings of groups. In the present sample, unadjusted models show that women have better SRH than men, but this difference disappears in models adjusting for women's greater health-optimism. Anchoring vignettes appear a promising tool for improving intergroup comparability of SRH.     

The Effect of Including a Monetary Motive Item on the Gambling Motives Questionnaire in a Sample of Moderate Gamblers

This study explored the factor structure of the Gambling Motives Questionnaire (GMQ) with a large stratified sample of 839 moderate gamblers (49% female; median age category = 45–54 years) and examined the effect of including a monetary motive item on GMQ factor structure. Participants responded to a telephone survey in which they were asked how often they gamble for each of 16 reasons, including the 15 GMQ motives and an additional motive: “to win money”. Exploratory principal components analysis of the 15 GMQ items revealed three factors, together accounting for 49.04% of the total variance in GMQ scores. The factors tapped enhancement, coping and social motives, although only the coping subscale displayed strong internal consistency. A second exploratory principal components analysis of the 15 GMQ items and the monetary motive item continued to reveal three factors tapping enhancement, coping and social motives. The addition of the monetary motive item strengthened the independence of the components and dramatically improved the internal consistency of the enhancement factor. The results suggest that the psychometric properties of the GMQ, when used with a population of moderate gamblers, may be considerably strengthened with only minor modifications.     

A TEST OF THE CURVILINEAR HYPOTHESIS WITH FACES II AND III

Previous research has not supported the validity of Olson's "curvilinear hypothesis." Convergent validity studies of the FACES I and II have indicated that the "cohesion" and "adaptability" dimensions have a linear relation with healthy family functioning. It is not clear, however, whether these findings are due to the measurement of the FACES' constructs or to the curvilinear theory. This study tested the "curvilinear hypothesis" in terms of these theoretical and measurement issues. The results indicate that FACES II and III do not adequately operation-alize the "curvilinear hyothesis." However, an item consistent with the "curvilinear hypothesis" utilizing a bipolar item response format did adequately opera-tionalize the theory. The use of a bipolar item response format is suggested in the measurement of "cohesion" and "adaptability."