Reliability and reactivity of three new functional assessment measures

This study of the reliability of three new tests of work performance considered the effect of test reactivity on measured performance. The tests are components of an employment screening battery designed for placement of applicants in automotive assembly jobs. Statistical measures of reliability were compared with a simple measure of test reactivity in a sample of 51 healthy adults. The effect of test reactivity on employment selection decisions using various cut scores was studied. Test reactivity is found to be a significant threat to reliability that must be considered when skill-based performance tests are used on a serial basis. When intended for use on a serial basis, such tests should be studied for both reliability and reactivity. In addition to reporting traditional statistical indices of reliability, an index of the reactivity should be reported.     

Research Notes the Relationship Between Admissions Criteria and Academic Performance in an MSW Program

The authors report on an investigation of the correlation between admissions criteria and academic performance at one state university. The admissions data used in this study were collected from 654 MSW students who attended the school from 1985 to 1992. Test scores on a comprehensive exam taken by these MSW students prior to graduation were used as the measure of academic performance. The authors found that two admissions criteria, undergraduate GPA and GRE score, and two applicant characteristics, gender and race, were significantly correlated with academic performance.     

The Use of Students in Admissions Interviewing

This paper examines the role of second-year MSW students in group preadmission interviews as cointerviewers with faculty members. The initial findings of these experiences indicated that the ratings of applicants for entry into the MSW program by both students and faculty were very similar and that most applicants, student cointerviewers and faculty saw such a process as valuable in selecting candidates for the program.     

Gendered Constructions of Leadership in Danish Job Advertisements

The purpose of this article is to consider the gender imbalance at top management level from a discourse analytical perspective. More specifically, it investigates the language of 39 Danish top executive job advertisements and considers which leadership identities are projected as desirable or necessary. This is done by carrying out two interlinked studies: a semantic field analysis of the sections in the job advertisements describing the leadership traits of the ideal candidate (Study 1) and a study of MBA students' responses to extracts from the advertisements as far as gender is concerned (Study 2). Semantic field analysis reveals that all the job advertisements are gender‐biased and that most traits described in the advertisements are associated with traditional or stereotypical masculine attributes. Study 2 confirms this finding, as respondents (MBA students) assign a masculine identity to the vast majority of the extracts from the job advertisements.     

Fetishes and motorcars: Negrophilia in French modernism

Based on an ethnographic study of evaluators' micro-practices during the admission test at a prominent Danish design school, this paper looks into the decisions made by evaluators when selecting future students.Two rounds make up the test in question: A first round where evaluators review portfolios made by anonymous candidates and a second round where a number of candidates are invited to interviews based on positive reviews of their portfolios. Following the two-tier course of the test, the analysis discusses the co-constitutive relationship between portfolios and candidates. Whereas the first round of the admission test clearly builds on the principle that talent can be identified in applicants' work, the second round introduces the premise that the person in question may be more important than the work. Hence, while objects constitute active participants during the review round, they tend to become neglected when applicants step in. To consider the selection processes during the test, the paper draws inspiration from the anthropologist of art Alfred Gell's art nexus that consists of artist, recipients, art objects and prototypes. With these four cardinal points, it becomes possible to identify relations made between evaluators and candidates along with portfolios and conventions which they refer to. That is, rather than seeing the test as a social game played solely by evaluators and applicants, the art nexus calls attention also to the roles played by portfolios and aesthetic conventions. However, based on the structure of the test, evaluators rank the subjectivity of candidates as paramount, while portfolios become in Gell's words ‘secondary agents’. By introducing a specific form of personhood as the final selection parameter, the admission test continues a long tradition of auteurism, which may have problematic effects, as previous studies of cultural education have demonstrated within fashion design and the congruent domains of film and fine art.     

A Factor Analytic Study of Four Listening Tests

This paper describes the nature and assessment of an interactive videodisc instructional program on listening. The program is available to other educational institutions seeking to expand cost-effective listening instruction to students. Formative evaluations indicate that students enjoyed the Level III interactive multimedia instruction (IMI). Results of a dummy variable regression analysis indicate that students receiving IMI in listening achieved significantly higher immediate cognitive test scores and listening gain scores than did students in the control group. Regression analysis indicated no significant effect of reported GPA, year in school, previous listening instruction, or time-on-task on listening test gain scores of the IMI treatment group. However, significant effects on cognitive test scores were found for reported GPA, previous listening instruction, time-on-task, and senior versus non-senior standing.     

WHY DOES CULTURAL CAPITAL MATTER FOR HIGH SCHOOL ACADEMIC PERFORMANCE? An Empirical Assessment of Teacher‐Selection and Self‐Selection Mechanisms as Explanations of the Cultural Capital Effect

Many scholars have argued that students' cultural capital has a positive effect on academic performance because students with cultural capital have better relationships with their teachers (the "teacher-selection" effect). However, theory also points to the importance of a "self-selection" effect, whereby students' cultural capital has a positive effect on academic performance by enhancing students' expectations for future educational attainment. Using National Education Longitudinal Study data, I estimate structural equation models to empirically assess the extent to which teachers' perceptions of students and educational expectations act as mechanisms of the cultural capital effect on grades and standardized test scores. The results show that, contrary to theoretical expectations, teachers' perceptions do not mediate the effect of cultural capital on academic performance. However, educational expectations account for portions of the cultural capital effect on grades and test scores.     

WHITE ENROLLMENT IN NONPUBLIC SCHOOLS, PUBLIC SCHOOL RACIAL COMPOSITION, AND STUDENT PERFORMANCE

This research note presents preliminary research into the relationship between the racial composition of public schools in school districts and the percentages of white students in nonpublic schools in those districts. Specifically, we ask two questions: Is the enrollment of whites in non‐public schools associated with minority predominance in public schools? Is there an association between the enrollment of whites outside of the public school system and the academic performance of students in the public school system? Using two‐ and three‐level hierarchical linear models, we find that school districts that have more whites in nonpublic schools tend to contain public schools with larger percentages of minority students. Further, at both the school and individual levels, achievement test scores tend to be lower in districts in which white students tend to be enrolled outside of the public school system. In addition, the achievement gap between white and minority students tends to be greater in districts with relatively more students in nonpublic schools. These findings are consistent with the argument that the withdrawal of white students from the public school system is negatively related to academic achievement because it tends to concentrate minority students in public schools.     

Listening Assessment: The Watson-Barker Listening Test

This article discusses the need for valid and reliable measures of listening behavior and how the Watson-Barker Listening Test was developed to measure the listening abilities of adults and mature college students. Sections of the article describe the nature and forms of the test, various validation procedures and research studies using the test. The claims of validity are partially supported by the data, and the Watson-Barker Listening Test has gained wide acceptance.     

A cross-cultural test of the situational bias hypothesis : The israeli scene

The major aim of this study was to test the commonly held assumption, within the Israeli educational context, that the relatively poor mean performance of disadvantaged students on conventional ability tests is due, in part, to extraneous situational factors, systematically disadvantageous to their test performance. To that end, two controlled field experiments were conducted on independent samples of N = 288 and N = 48 elementary school pupils, respectively. The first experiment centered on the interaction between sociocultural group characteristics and each of two situational factors, namely, test atmosphere and examiner status, in affecting ability test performance. The second experiment explored the effects of test atmosphere per se on the nonverbal ability test scores of disadvantaged pupils. On the whole, this research provides evidence inconsistent with the situational bias hypothesis and does not support the assumption that disadvantaged children's ability test scores can be substantially improved by manipulating test atmosphere conditions. In view of the evidence showing that situational variables do not significantly bias testing results in favor of one group over another, it follows that current educational evaluation policies in Israel, relying heavily on the standardized ability tests results of disadvantaged groups, need not be changed.     

COHORT AND GENDER DIFFERENCES IN EXTRACURRICULAR PARTICIPATION: THE RELATIONSHIP BETWEEN ACTIVITIES,MATH ACHIEVEMENT,AND COLLEGE EXPECTATIONS

Using data from the National Education Longitudinal Study of 1988 and the Educational Longitudinal Study of 2002, I analyze the association that students' extracurricular activities have with two academic outcomes: mathematics achievement test scores and college expectations. I consider changes between cohorts and gender differences within each cohort. While prior achievement and expectations have the strongest associations with the dependent variables, relationships do appear between extracurricular participation and the dependent variables. There is only one cohort difference in the association between activities and math achievement test scores; computer use was positively associated with students' scores in the 1990s, but had no association with students' scores in the 2000s. School-sponsored activities were associated with higher scores for all students, while television-watching and hanging out with friends were negatively associated with them. School activities were positively associated with the college expectations of students in both cohorts, while spending time hanging out with friends was negatively associated with expectations, especially for students in the later cohort. There were a few gender differences in the association between activities and math scores, but no gender differences in the association between activities and college expectations. The findings indicate that many of the same activities are relevant for math achievement and college expectations in the two time periods.     

The Effects of Merit-Based Scholarships on Educational Outcomes

This paper analyzes the effect of a statewide merit-based scholarship program on educational outcomes in Arizona. It tests whether Arizona’s Instrument to Measure Standards (AIMS) scholarship has an effect on a comprehensive set of educational outcomes such as the number of applicants, student admissions, first-year first-time enrollment, ACT scores of entering freshman, retention rates, as well as on the level of tuition and fees at the three schools targeted by the program; Arizona State University, University of Arizona and Northern Arizona University. Both difference-in-differences estimation as well as synthetic control methods shows that AIMS has an economically and statistically significant effect enrollment. Enrollment effects are greatest among African American and Hispanic students and are significant for both men and women. While point estimates suggest that AIMS also lead to increases in tuition and fees, these results are not robust to placebo tests.     

Cosmopolitan pathways from the Global South: How non-middle-class students become desirable Fulbright applicants

International student mobility (ISM) is largely interpreted as a global middle-class capital accumulation strategy. Cosmopolitanism, which is the named outcome and effect of these mobile forms of social and cultural capital, is therefore disproportionately available to already privileged students. This study moves beyond this prevailing interpretation by examining how students from working- or lower-middle-class families with limited resources in Global South countries combine bottom-up cosmopolitanism with educational mobility to get selected into highly competitive spaces, such as the Fulbright Foreign Student Program, the most prestigious educational and cultural program in the United States. Based on 20 in-depth interviews with successful Fulbright applicants and participant observation, my findings suggest that working- and lower-middle-class applicants are largely successful because of their cosmopolitan dispositions which they cultivate in creative and agentive ways. This article adds texture and complexity to existing discussions on middle-class hegemony in ISM and cosmopolitan subject-making.     

Revealing stereotype threat effects and women’s maths performance: the moderating role of mathematical anxiety / Análisis de los efectos de la amenaza del estereotipo y el rendimiento matemático de las mujeres: el rol moderador de la ansiedad matemática

Stereotype threat is a phenomenon by which members of a stereotyped group have their performance impaired when their group identity is made salient. Previous research has found that telling women about stereotype threat prevents impaired performance in mathematical tasks. Moreover, the effect of stereotype threat seems to be moderated by mathematical anxiety. The present work seeks (1) to test the effect of stereotype threat on women’s maths performance taking into account a previous maths score, (2) to replicate in a Spanish sample the protective effect of teaching intervention and (3) to test the moderator role of maths anxiety in the relationship between stereotype threat and impaired performance. Participants (110 undergraduate students) were randomly assigned to either stereotype threat or teaching intervention condition and the decrement in their performance was used as a dependent variable. Stereotype threat only impairs the performance of women with higher maths anxiety scores, and teaching intervention is effective to ameliorate this decrement in performance. We recommend the development of programmes that teach girls about stereotype threat and reduce mathematical anxiety.     

Relationship among grip strength,functional outcomes,and work performance following hand trauma

This study examined the relationship among the recovery grip strength, functional outcomes, and work performance following occupational therapy intervention for hand trauma. This study had a sample size of 15 participants whose recovery grip strength was measured using a Jamar dynamometer, whose satisfaction with outcomes was measured by the Michigan Hand Outcomes Questionnaire (MHQ), and whose compliance with the home therapy program was measured by a visual analog scale (VAS). A Pearson r correlation demonstrated a significant relationship between recovery grip strength and two MHQ subset scores: overall hand function (r = 0.59, p = 0.019) and activities of daily living (ADL) performance (r = 0.61, p = 0.016). The participants' self-rating of compliance did not predict or influence either recovery grip strength or MHQ scores. A moderate positive correlation approaching significance (r = 0.51, p = 0.052) was found between grip strength and overall MHQ scores. The researchers concluded that a recovery grip strength measure should be used along with functional measures to appropriately assess overall hand function following hand trauma.     

Validation of the Individual and Community Empowerment Inventory: A Measure of Rap Music Engagement among First-Year College Students

Amid robust debates about the impact of music on the lives of young people, empirically validated measures of music engagement are absent. The present study builds on the construction of the Individual and Community Empowerment (ICE) inventory, a measure to capture different types of empowerment and different types of risk potential from rap music engagement. The scientific intent of the scale development and the present validation study was to test the simultaneous presence of empowerment and risk associated with music engagement and its application to the individual and community. A unique sample existed for the present study in comparison to the original, with the bulk of respondents being first-year college students and White. Results of the present study suggest that the ICE inventory is an effective and comparative measure of risk and empowerment. Major findings about the instrument’s utility were replicated, but results were divergent from original research on certain demographic trends with respect to gender, age, and race/ethnicity. Empowering and risky music engagement scale means were higher among male and younger respondents. White respondents had significantly lower mean scores than all other groups on empowerment scales, and African Americans had lower scores on the individual risk scale than other groups. Each result suggests the need for additional research. The validation of the ICE inventory offers promise for helping to collect, organize, and interpret new data on associations between music engagement and desirable health and well-being outcomes.     

A New Test to Measure Emotion Recognition Ability: Matsumoto and Ekman's Japanese and Caucasian Brief Affect Recognition Test (JACBART)

In this article, we report the development of a new test designed to measure individual differences in emotion recognition ability (ERA), five studies examining the reliability and validity of the scores produced using this test, and the first evidence for a correlation between ERA measured by a standardized test and personality. Utilizing Matsumoto and Ekman's (1988) Japanese and Caucasian Facial Expressions of Emotion (JACFEE) and Neutral Faces (JACNeuF), we call this measure the Japanese and Caucasian Brief Affect Recognition Test (JACBART). The JACBART improves on previous measures of ERA by (1) using expressions that have substantial validity and reliability data associated with them, (2) including posers of two visibly different races (3) balanced across seven universal emotions (4) with equal distribution of poser race and sex across emotions (5) in a format that eliminates afterimages associated with fast exposures. Scores derived using the JACBART are reliable, and three studies demonstrated a correlation between ERA and the personality constructs of Openness and Conscientiousness, while one study reports a correlation with Extraversion and Neuroticism.     

Clicking Toward Better Grades: The Use of Student Response Systems in Social Work Education

Faculty members at universities are increasingly shifting their pedagogical focus from traditional lectures to active learning by integrating academic technology such as clickers (i.e., student response systems) into classrooms. However, few studies have examined the effect of clickers on learning outcomes such as test grades, and even fewer studies have evaluated this technology in social work education. This study examined the effect of clickers on learning outcomes in an undergraduate social work course. Findings indicated that frequency of clicker use significantly contributed to increased test scores after controlling for important covariates, suggesting that clickers may be an effective tool in actively engaging social work students and promoting learning. Instructors guidelines for integrating technology into future social work courses are discussed.     

Zentrum und Peripherie im globalen Wissenschaftssystem

We use an experimental design to analyse the effect of symbolic capital of a nation’s higher education system and of single universities on students’ opportunities for international mobility. Fake applications of international doctoral students were sent to German sociology professors, who were asked to serve as supervisors during a research visit in Germany. Our fake applicants come from four different universities: Yale, Pennsylvania State University, National University Singapore, and Vietnam National University Hanoi. The results show that applicants from both US institutions get more positive, more informative and more personal feedback than applicants from Singapore and Vietnam. Moreover, the symbolic capital of a university seems more important than the quality of a specific department, which is problematic in normative terms.     

Just a paper exercise?

This paper will consider the impact and implications of changing the method of selection for social work students on one BA/Diploma in social work course for mature students with family commitments. The change was instituted following research which suggested that interviewers' preferences were a poor predictor of successful outcome of course completion for students, and further, that other predictors such as quality of written application material and student motivation were factors which had a strong correlation with successful outcome. Consequently, in 1999, selecting students by interview was replaced by paper selection. While it is the long-term aim of academic staff to evaluate the merits of paper selection in terms of students' outcomes, this initial paper considers the organisational and administrative implications of changing to paper selection and the students' and selectors' perceptions of paper selection. In particular, this paper will consider whether it is possible to be objective in selecting applicants, or whether subjectivity will always be part of the process. Finally, the article considers the relative cost of paper selection as opposed to interview. The findings of this study suggest that interviewing is twice as costly on academic and agency staff time - a factor which in the present financial climate has considerable implications for the future of interviewing on social work courses.