Lessons learned using a values-engaged approach to attend to culture,diversity, and equity in a STEM program evaluation

Evaluation must attend meaningfully and respectfully to issues of culture, race, diversity, power, and equity. This attention is especially critical within the evaluation of science, technology, engineering, and mathematics (STEM) educational programming, which has an explicit agenda of broadening participation. The purpose of this article is to report lessons learned from the implementation of a values-engaged, educative (Greene et al., 2006) evaluation within a multi-year STEM education program setting. This meta-evaluation employed a case study design using data from evaluator weekly systematic reflections, review of evaluation and program artifacts, stakeholder interviews, and peer review and assessment. The main findings from this study are (a) explicit attention to culture, diversity, and equity was initially challenged by organizational culture and under-developed evaluator–stakeholder professional relationship and (b) evidence of successful engagement of culture, diversity, and equity emerged in formal evaluation criteria and documents, and informal dialogue and discussion with stakeholders. The paper concludes with lessons learned and implications for practice.     

Factors Influencing STEM Career Aspirations of Underrepresented High School Students

A shortage of female and minority students pursuing science, technology, engineering, and mathematics (STEM) careers has prompted researchers and policy makers to examine the current STEM supply pipeline. This study examined factors influencing STEM career aspirations of a nationally representative sample of 9th‐grade students (N = 21,444). Characteristics of students who aspired to STEM careers and non‐STEM careers were examined. Guided by the career aspirations model (Mau & Bikos, 2000 ), the authors conducted logistic regression analyses to investigate variables predicting STEM career aspirations. Results indicated that race, gender, socioeconomic status, math interest, and science self‐efficacy were the most important predictors of STEM career aspirations. Counselors in school and related career services contexts are encouraged to consider these important factors in identifying high school students who are interested in STEM career choices, as well as in planning career interventions to facilitate their career paths. Future researchers could test the applicability of this model with middle school students or adults.     

HIGH SCHOOL CHOICES AND THE GENDER GAP IN STEM

Women are less likely than men to graduate with a degree in science, technology, engineering, or math (STEM). We use detailed administrative data for a recent cohort of Ontario high school students, combined with data from the province's university admission system, to analyze the sources of this gap. We show that entry to STEM programs is mediated through an index of STEM readiness that depends on end‐of‐high school courses in math and science. Most of the gender gap in STEM entry can be traced to differences in the share of college entrants who are STEM‐ready; only a small share is attributable to differences in the choice of major conditional on readiness. We then use high school course data to decompose the gender gap in STEM readiness into two channels: one reflecting the gap in the fraction of high school students with the necessary prerequisites to enter STEM, the other arising from differences in the overall fractions of females and males who enter university. The gender gap in the fraction of males and females with STEM prerequisites is small. The primary driver of the gap in STEM readiness is the low rate of university entry by nonscience‐oriented males. (JEL I21, 28, I20)     

Understanding African American Students' Experiences in STEM Education: An Ecological Systems Approach

Promoting racial and ethnic minority students' interest in science, technology, engineering, and mathematics (STEM) careers remains a primary workforce goal. To advance this goal, this study examined, through an ecological lens, 18 African American high school seniors' perceptions of their experiences related to their aspirations for STEM careers. All students were enrolled in STEM programs. Using a phenomenological approach to analyze the outcomes of focus group interviews, the authors identified themes at the ontogenic, microsystem, and macrosystem levels. Environmental factors, such as counseling, family expectations, and available resources, played a substantial role in influencing the students' interests, experiences, and perceptions in their pursuits of STEM careers. Implications highlight the importance of counselors in encouraging students of diverse backgrounds to pursue STEM courses and for policy makers to provide resources that support students' STEM goals. Future research is needed to examine the longitudinal effects of high school STEM programs on diverse populations.     

School counseling practices related to postsecondary STEM participation

This qualitative exploratory cross-case analysis analyzed the beliefs and practices of high school counselors related to science, technology, engineering, and mathematics (STEM) academic advisement, postsecondary planning, and career participation. Interviews were conducted with high school counselors (N = 13) who were purposively sampled to represent a diversity of schools in terms of demographic variables. Findings indicated that high school counselors perceived that (a) sociocultural factors influenced student preparation for STEM, career planning, and decision making; (b) students’ STEM-related career goals and academic behaviors were sometimes misaligned, and academic advisement often mediated this tension; and (c) their professional STEM knowledge, beliefs, and practices were influenced by professional preparation, workplace characteristics, and their academic experiences. Implications include the need for early, sustained high school STEM counseling and academic advisement; accessible professional development in STEM preparation and careers to promote multiple pathways and reduce school counselor bias; and encouraging family involvement in STEM career decision making.     

Innovating Practices to Prepare Students for Graduate School: Lessons From a Social Work MOOC

This article describes the implementation of a massive open online course (MOOC) developed by a school of social work and piloted in the incoming 2016 MSW class (N=397). Using implementation science as a framework, we describe the MOOC as an intervention for preparing students for graduate school and share findings from the pilot evaluation. We argue that MOOCs can represent an innovative approach for other schools of social work, but our lessons learned suggest that they also require resources, time investment, organizational support, and understanding of the implications for students and the school. Future questions for research include examining the long-term benefits of MOOCs to students, their broader application, and the cost-benefit analysis for schools interested in developing MOOCs.     

Applying utilization-focused evaluation to high school hazing prevention: A pilot intervention

Researchers argue that hazing can contribute to an abusive school climate and interfere with a positive learning environment for students. National efforts exist for establishing policies, protocols, evaluation, and education for students, administrators, and staff to prevent hazing at the college level, but this work has yet to be applied broadly in a high school context. In response to this gap, researchers implemented a pilot project at two high schools in Maine that consisted of hazing prevention training and assessment. This paper discusses the design, methods, and lessons learned through this collaborative, utilization-focused, and mixed-method training and evaluation with school personnel and high school student participants.     

Gender bias in the classroom: A network study on self and peer ability attribution

Stereotypes can contribute to the gender gap in STEM by shaping people’s expectations on their own and others’ performance. When gender is salient, expectations on task performance might reflect gender constructs even when information on individual abilities is available. We tested this hypothesis in a network study on students from ten high school classes in Milan, Italy. We asked the students to choose the four best candidates from their classmates for three hypothetical inter-class competitions in reading, math, and science. Results showed that females were more likely to be nominated for the reading competition but less likely for science. We did not find any statistically significant results for the math competition. We also found that female students were less likely to nominate themselves for any competition, regardless of the subject, even controlling for their own performance and self-concept.     

Friendship Groups,Personal Motivation,and Gender in Relation to High School Students' STEM Career Interest

Friendship group characteristics, motivation, and gender were investigated in relation to adolescents' science, technology, engineering, and math (STEM) career interest. The sample was comprised of 468 high school students (M = 16 years, range = 13–18) from diverse ethnic backgrounds. Participants rated their friendship group's support of STEM as well as their personal motivation in science. They separately rated the friendship group's support of English and personal motivation in English. Other predictors included friendship group characteristics (importance, gender composition) and background variables such as gender. Group support of STEM (but not English) and science motivation (but not English motivation) predicted STEM career interest. Group characteristics and participant gender moderated the effects. Findings suggest social identities and self‐concepts may shape youths' STEM career choices.     

Three high school after-school initiatives: lessons learned

Alarmed by the large numbers of high school-age youth who are disengaged at school and leaving high school without a diploma or the important skills for the workplace, policymakers and youth advocates are beginning to see high school after-school as the new frontier in after-school programming. Although older youth represent a sizable percentage of American students, they garner only a small fraction of the federal, state, and local investments for after-school programs. This chapter reviews the insights and lessons learned from three after-school initiatives that have shown success in attracting high school students to their programs and engaging them in meaningful activities to support their success in school and transition to early adulthood: the After School Safety and Education for Teens, After School Matters, and the After-School Corporation. Emerging from these pioneering efforts are some promising practices and program models that can guide the development of future after-school programs, but not without the help of policymakers and funders, both public and private.     

Young children's career aspirations: Gender differences,STEM ambitions,and expected skill use

This study examines young children's career aspirations, gender differences in those aspirations, and children's perceptions of the amount of math and science used in careers. We asked 1634 students in first to third grades what job they wanted in the future and how much they thought they would use math or science in it. Career aspirations were sorted into 27 career categories, of which 12 showed significant gender differences. Notably, boys were more likely to indicate military, manual labor, and math/computer science careers, and girls were more likely to indicate stay at home parent, education, and animal care careers. Students aspiring to science, technology, engineering, and mathematics (STEM) careers thought they would use science, but not math, more than non-STEM-aspiring students did. School counseling interventions focused on specific STEM subfields, and education highlighting links between school subjects and careers requirements may benefit students and reduce gender inequality in STEM fields.     

Evaluating minority retention programs: problems encountered and lessons learned from the Ohio science and engineering alliance

The retention rates for African-Americans, Hispanics, and Native-Americans in science, technology, engineering, and mathematics (STEM) are lower than those of White or Asian college students. In response, the National Science Foundation formed statewide partnerships of universities to develop programs to address this disparity. The deliberations and experiences in evaluating one such partnership are retrospectively reviewed. Problems and issues encountered during conceptualization and implementation are presented. Lessons learned from this endeavor should generalize to similar situations and provide guidance for others new to or interested in evaluating STEM retention programs as well as those evaluating collaborative endeavors.     

Work–Family Balance Self‐Efficacy's Relationship With STEM Commitment: Unexpected Gender Moderation

The number of students, particularly the number of women, completing science, technology, engineering, and mathematics (STEM) undergraduate degrees is insufficient to meet the U.S. demand. Thus, research investigating key predictors of STEM commitment is of high importance. Applying the Social Cognitive Model of Career Self‐Management (SCCT‐CSM; Lent & Brown, 2013 ) as a guiding framework, this study examined the relationship between work–family balance self‐efficacy (WFSE) and STEM commitment as moderated by gender. The sample included 246 STEM students (106 women, 140 men) from a southeastern university. A 3‐step hierarchical regression analysis demonstrated that WFSE accounted for incremental variance in STEM commitment beyond traditional social‐cognitive predictors, and gender moderated the relationship between WFSE and STEM commitment. Contrary to expectations, the relationship was stronger for men than for women. Findings suggest resiliency among women, showing that they are committed to STEM regardless of low WFSE. Practical implications for university and workplace contexts are discussed.     

Capturing change: Doing research in a society undergoing transformation

Systematic review and synthesis methods have gained wide acceptance within the social sciences and, as a result, many postgraduate students now consider using them for their thesis or dissertation research. However, students are rarely aware of all the concrete implications that their decision entails. This reflective narrative reports the experience of a political science student who began to conduct a systematic review as part of his Ph.D. dissertation but who did not complete it. The aim of this article is to identify challenges and lessons learned from this experience and to formulate recommendations for postgraduate students who wish to make an informed choice with respect to the use of these methods.     

Profiles of High School Students’ STEM Career Aspirations

Science, technology, engineering, and mathematics (STEM) fields have a need for recruiting and retaining a diverse workforce. Understanding students’ aspiration to STEM careers is important for supporting underrepresented populations. Data from a nationally representative sample (N = 20,010) of high school students who reported career aspirations were analyzed. Analyses revealed significant relations between students’ aspirations and demographic variables, and differences in aspirations based on students’ race and gender. Findings highlight a need for counselors to implement career interventions that address students’ cultural contexts.     

The emotional costs of computers: an expectancy-value theory analysis of predominantly low-socioeconomic status minority students’ STEM attitudes

There is a strong push to increase American students’ interest in Science, Technology, Engineering, and Mathematic (STEM) careers. However, minority and female students remain underrepresented in the STEM fields. Therefore, it is essential that we continue to examine the potential factors that both incite and dissuade STEM interest. We apply Expectancy-Value Theory (EVT) to examine STEM attitudes of predominantly low-socioeconomic status minority elementary school students over the course of a computing intervention. Furthermore, we integrate the digital inequality mental access conceptualization of ‘emotional costs’ into the EVT model in order to predict students’ negative STEM attitudes. Data are from a large-scale computing intervention that took place in a primarily minority, high poverty, urban elementary school district located in the southeastern USA. Results indicate that positive expectancies for success and subjective task values predict students’ positive STEM attitudes. Emotional costs toward technology primarily predict negative STEM attitudes. Students’ expectancies/values and emotional costs may have a ‘push-and-pull’ effect on the formation of STEM attitudes. This study successfully links digital disparities to STEM disparities by integrating the digital inequality concept of emotional costs. Practically, we conclude that future computing interventions should increase students’ academic-related expectancies and values while also minimizing their emotional costs in order to address both digital and STEM inequalities. Theoretically, we conclude that broad conceptualizations of emotional costs should be included in future studies to help explain negative attitudes/motivations toward STEM-related topics.     

Critical Literacy as a Lens for Students’ Evaluation of Sources in an AP World History Class

Abstract

Critical literacy is an appropriate learning outcome for social studies courses because it has the potential to teach students how to critically evaluate sources of information relevant to historical texts and current news media. The purpose of this qualitative case study is to examine the process through which students learned to apply critical literacy strategies while completing an end-of-unit research project in tenth grade AP world history. This study looks as student and teacher interviews to examine how students use critical literacy approaches and perspectives to analyze texts. As a result of this study it was determined that: (1) students at the elite private school had limited experience with source evaluation and critical literacy prior to this research project, (2) critical literacy served as an effective evaluation tool for reliability and bias for some students, (3) certain students experienced challenges in using critical literacy as an evaluation tool, and (4) students believed that critical literacy would benefit them personally and academically. Results include implications for instructors who wish to teach critical literacy and source evaluation in this information age.     

The Influence of Career Planning on Career Thoughts in STEM‐Interested Undergraduates

Undergraduate career planning courses have shown efficacy in decreasing students’ negative career thoughts; however, universities have minimally applied these courses to science, technology, engineering, and math (STEM) populations. This study compared the influence of a STEM‐focused career planning course for undecided STEM students with a seminar course for decided STEM majors. An analysis of covariance with covariate adjustment revealed that undecided career planning students had lower adjusted mean scores on a measure of negative career thinking than the decided STEM majors after the first semester of college. The results provide support for the efficacy of STEM‐focused career planning courses and measuring negative career thoughts with STEM undergraduates.     

Broadening the Array of Services: Integrating Legal and Social Work Services for Youth and Families

ABSTRACT

The Community Justice and Legal Assistance Clinic (CJLA) is a unique community-based legal clinic developed through a partnership between a law school and a child and family service agency embedded within a low-income community. This article describes the development of this clinic through a community assessment process; its unique multidisciplinary features; the services provided to clients in three of the agency's service areas; the benefits of the partnership for clients, the social service agency, the participating law students, and the law school; and lessons learned for replication of this type of clinic in other communities.     

SIGNALING IN HIGHER EDUCATION: THE EFFECT OF ACCESS TO ELITE COLLEGES ON CHOICE OF MAJOR

I propose a model of postsecondary education in which major field of study can be used by individuals to signal productivity to employers. Under this signaling model, I show that geographic areas with high access to elite universities result in fewer science, technology, engineering, and mathematics (STEM) majors among lower ability students at nonelite colleges. This is distinct from the prediction of a full information model in which access to elite schools should only affect high ability individuals directly. Using data from the National Center for Education Statistics' Baccalaureate & Beyond survey, I find evidence that is consistent with the signaling model prediction, specifically a 2.3–3.7 percentage point or 16%–25% decrease in the probability of choosing a STEM major among lower ability students in areas with greater access to elite colleges. (JEL I21, J24)