Images

Abstract

The targeting of elementary school students early in their education with exposure to the different Science, Technology, Engineering and Mathematics (STEM) fields will provide them future access to college offerings and career possibilities. Faculty and students from New York City College of Technology worked with young students at a local elementary school, creating and implementing programs that will help to strengthen the nation’s STEM workforce and to prepare students to be productive citizens with a strong sense of self.

Introduction

The New York City College of Technology (informally known as “City Tech”) partnership with P.S. 307 Daniel Hale Williams School began in 2014. The partnership aimed to promote A Better Educated City; an investment in STEM, and our nation’s future.  New York City College of Technology is part of the City University of New York (CUNY) system. Daniel Hale Williams is an elementary school serving students in Pre-K through Grade 5, which became a science and technology-themed magnet school for STEM Studies after being a recipient of a grant from the federal Magnet Schools Assistance Program. For the 2017-2018 academic year, 373 students are enrolled at Daniel Hale, where 57% are male students and 43% female students.  The race/ethnicity reported by the school includes a 56% Black and 27% Hispanic student population. With a similar male to female ratio of undergraduate students, City Tech reports 30% Black and 33% Hispanic (New York City College of Technology 2017).  The large underrepresented population at both schools made the partnership an ideal fit.  Initially, college students were hired as interns through the CUNY Service Corps program. The CUNY Service Corps organizes students and faculty across the institution to work on projects that benefit the residents and communities of New York City.  These projects aim to advance the “civic, economic and environmental sustainability” of the city (City University of New York [CUNY] 2018). At the core of the Service Corps, launched in 2013 as a response to Hurricane Sandy, is civic-engagement, which aligns with the values of SENCER. Students are paid as interns to work in civic-related jobs in community organizations (CUNY 2018). During the 2014–2015 academic year, two CUNY students worked to develop and implement an Educational Outreach Program that provided students in grades 1–5 with exposure to Science, Technology, Engineering, and Mathematics (STEM) in their elementary school classrooms. To sustain the program beyond the 2014–2015 academic year, the Black Male Initiative, Emerging Scholars, and Perkins Peer Advisement programs at City Tech continued to support the outreach project. Since the program’s inception, a number of City Tech undergraduate students have served as mentors to the elementary school students and have worked with faculty at City Tech and key staff at the local elementary school. The goal of this collaboration, which has spanned a number of years, was to engage college students, elementary school students, college faculty, elementary teachers, and the families of the elementary students in a STEM outreach initiative.

Why is it important to integrate STEM education into the elementary school curriculum?

Many recent studies indicate that the gap in the STEM workforce will continue to widen unless more students decide to enter the STEM fields (Brophy et al. 2008; Brown 2012; Johnson 2013). According to the U.S. Department of Commerce, STEM occupations are growing at 17%, while others are growing at 9.8% (Langdon et al. 2011). To succeed in society today, we should encourage students to solve problems, develop their capabilities in STEM, and become tomorrow’s scientists, inventors, and leaders (Science Pioneers 2017).  Exposure to STEM careers at the elementary school level enhances student learning, encourages creativity, and entices curiosity. The National Academy of Engineering and the National Research Council list some benefits of incorporating engineering in K–12 schools: improved achievement in mathematics and science, increased awareness of engineering, understanding and being able to do engineering design, and increased technological literacy (Katehi, Pearson, & Feder 2009). With these studies as a rationale, we developed a multitier approach to integrate STEM into a Pre-K–5 (elementary) school.

Methods 

The awareness of STEM-related careers was presented to the participating staff, students and families through in-class lesson plans, afterschool programs, and family workshops. Most of the projects centered on science and civil engineering to draw from the strength of the faculty involved.  The engineering design process was included in the activities.  Students were encouraged to (a) identify the problem, (b) brainstorm solutions, (c) try a design, (d) test, (e) identify strengths and weaknesses, and (f) try again.  In order to promote skills associated with a well-rounded scientist and engineer, the activities integrated concepts of cost, schedule, and communication. The majority of the activities (in-class lessons, afterschool program and family workshops) were held at the local elementary school.  College students and faculty met and communicated regularly with the staff at the elementary school to plan all activities.  We present below the project design of this multitier approach to the community.

In-class Lessons

The in-class lessons centered on the NYC Scope and Sequence for Science and the Next Generation Science Standards (NGSS).  The science focus included the following two topics: The Five Dancing Spheres (biosphere, lithosphere, geosphere, cryosphere, and hydrosphere) and Weathering and Erosion. In each unit, students in grades 3 and 4 explored these science fields and created models to represent and display their learning.  The civil engineering focus included the following in-class lesson topics: What is Engineering, Types of Engineering, Structures and Functions, Teams behind Construction, Construction Drawings, and Sustainability.  The goal of the in-class lessons was to enhance the existing science curriculum with real-world applications and hands-on projects to help the students better understand the science curriculum. The commitment and participation of teachers from the elementary school were critical to the success of the program.  The teachers and undergraduate students met regularly to plan, reflect, and ensure a smooth link between the NGSS curriculum and the in-class lesson topics.  The teachers provided insight on teaching techniques for elementary school-age children and diverse learning styles.  The undergraduate students worked closely with the teachers and tailored their lessons and activities to the children in the classroom.

The lesson plans for The Five Dancing Spheres curriculum (Figures 1 and 2) at the elementary school is only one example of the approach that we implemented.  Each lesson included a visual aspect (examples), vocabulary activity, homework, and a hands-on activity.

Afterschool Programs

The afterschool programs reflected the model used in two local design competitions: West Point Bridge Design and Future City. These competitions are aimed at middle school students to promote interest in civil engineering careers.  These projects required students to model the Engineering Design Process. Students used software programs to design their projects, create physical models, and prepare oral presentations.  Even though students did not participate in the competitions, they were encouraged to be problem solvers and engineers.  Students were encouraged to design, test, and revise their ideas. This provided a great opportunity for students to use their math, science, and technology skills while working with the engineering design process to come up with various solutions.

Engineering concepts such as force and equilibrium were incorporated through the Bridge Design project.  Students used the Bridge Design software to design their bridges and simulate the testing of the bridge. Bridge Designer is a zero-cost educational software intended to provide middle school and high school students with a real-world overview of engineering through the design of a steel highway bridge (Ressler 2013).

These elementary students were introduced to concepts of tensile and compressive force.  Students created a virtual bridge and a
replica model of their virtual bridge using  balsa wood (Figure 3). Each material had a cost assigned to it, and students worked to make the strongest and most affordable bridge.

Similarly, concepts such as city planning and sustainable design were taught through the city design project. Future City is a project-based learning program where students in 6th, 7th, and 8th grade imagine, research, design, and build cities of the future (National Engineers Week Future City Competition 2017). Our afterschool partnership brought this project to the elementary students at P.S. 307, and they successfully created their own virtual city using the Sim City software.  Students made blueprints of their cities and created a replica model showing a block of their cities using all recyclable materials. In preparing a blueprint, students visualize and sketch their design. Transferring the design from paper to three dimensions helped the students make a connection from 2-D to 3-D, promoting spatial thinking.  Spatial thinking has been identified as an important trait for STEM careers (Wai, Lubinski, & Benbow 2009).  “Fostering spatial thinking and mathematics learning in elementary school could contribute to a downstream ripple effect, improving students’ interest and success in STEM subjects throughout their education and into their careers” (Burte et al. 2017).

The process of calculating total cost introduced the idea of budgets and the importance of adhering to a budget.   Students also had to adhere to a schedule, as they were limited in the amount of time they could work on each portion of the project. Students presented their projects at the end of each program.

Family STEM Workshops

Recognizing the importance of family involvement in a child’s success, the program included interactive STEM workshops and field trips for families that increased their awareness of STEM-related careers. Survey and program assessment data informed planning for the next project year.  Topics in the family STEM workshops included, but were not limited to Civil Engineering, Chemistry, Mechanical Engineering, Architectural Engineering, and Computer Systems Technology.  One local field trip included the SONY Wonder Technology Lab in New York City.

Some of the activities that were introduced at the workshops were (a) Spooky Materials Testing experiment which included a Mechanical Engineering focus; (b) building a home for turkeys with a Civil Engineering focus; (c) dissolving M&Ms and making slime with Chemistry; (d) learning coding with puzzles with a Computer Engineering focus; and (e) the design and creation of an architectural building model with Architectural Engineering as the focus.

The Spooky Materials Testing experiment (Schooling a Monkey 2018) introduced stress concepts to the elementary students by applying the different types of stresses (tensile, compressive, shear) to different types of candy and comparing the results of the tests on each candy. Students then made connections as to which type of candy, based on the stress concept, would be best for building.

Building a home for a turkey (Preschool STEAM n.d.) introduced the structural concepts and material cost to the students. The goal was to contain the holiday turkeys in a structurally sound and cost-efficient space. There were time limits and cost constraints that the students had to comply with. Students were also given a range of materials, each with a certain cost assigned.

Dissolving M&Ms (American Chemical Society 2018) and making slime (STEAM Powered Family 2018) introduced the concept of chemical experimentation and observation. In both activities, students were able to combine substances and observe the outcomes, which were colorful, fun, and thought provoking. With the help of parents, the students poured rubbing alcohol, water, and oil onto a plate of M&Ms and saw the dissolving effects the different solutions had on the M&Ms.  The slime-making activity reinforced the concept of how observations are important in chemical processes.

Learning coding with puzzles introduced the algorithmic concept of coding patterns to the students (Institute of Electrical and Electronics Engineers 2018). This was accomplished through a brief introduction of how to follow steps using “coding language” and a visual puzzle activity that involved critical thinking. The students were then encouraged to “walk out” their coded steps on a large grid that closely followed the worksheet they worked on. As a next step, students and their families applied the skills they had learned to the online software in code.org.

By designing and creating an architectural building model, students were able to see the problem-solving and aesthetic skills it takes to become an architect. Students were given a laser-cut bendable paper set to create 3D models of their structure. Each student received the same pieces, but each individual was able to create entirely different structures by arranging the structure to their liking.

Results and Discussion

The faculty at New York City College of Technology recruited undergraduate students enrolled in the departments of Biological Sciences, Chemistry, and Civil Engineering Technology to serve as mentors, which included a pool of about 750 students. Throughout the years, several programs have provided support to the college students involved in this endeavor.  These included the CUNY Service Corps, Emerging Scholars, Perkins Peer Advisement, and the Black Male Initiative programs, all of which have recognized the value of the STEM Outreach program. The success of the partnership and the collaboration of college faculty and students at City Tech has opened the eyes, minds, and future career potential of the elementary students at P.S. 307 Daniel Hale Williams School. It reinforced the need for STEM education in underrepresented learners. The partnership has increased exposure at the elementary school to STEM topics and courses taught at the college level.  The outcomes as shown have been favorable and shared with the community at large via showcase presentations, school displays, and conference presentations, and at the college’s annual poster session.

Success(es)

Our success included presenting activities seen as academically challenging (geared only to junior high, high school, or college students) to the elementary school students at P.S. 307, in a way that led to both success and enjoyment for the students. Furthermore, these students were able to figure out what STEM topics they enjoyed by trying many different discipline-oriented workshops. By including the parents in our workshops, we were able to inform them about various fields of engineering, next step school options for their elementary child, and career opportunities.  Elementary school students were able to successfully implement the information they were learning through interactive hands-on STEM activities.

Impact on Undergraduate Students

There is a large body of evidence of the positive impact of undergraduate research on college students (Lopatto 2010; Russell, Hancock, & McCullough 2007).  George Kuh (2008) also points to high-impact practices such as engagement beyond classroom (internships) and community-based learning that promote student engagement.  The STEM outreach that we have described demonstrates that working with community partners such as the elementary school represents a valuable community-based project.  The CUNY Service Corps indicate that undergraduates gain “workplace skills and abilities; personal development; civic engagement and social issues awareness” (CUNY 2017).  The undergraduate students developed the curriculum under the guidance of the faculty and elementary school teachers.  Additionally, the students gained valuable experience for the real world, including organization and communication and presentation skills.

Conclusion

This work brings to the forefront a collaboration that engaged faculty, undergraduates and elementary school students and teachers in a STEM outreach project.  The project, which aimed to promote A Better Educated City, has increased awareness of STEM careers among families at the elementary school. Students were engaged in hands-on activities while learning elementary concepts related to STEM. Exposing elementary school students to science and engineering concepts can motivate them to solve various problems more effectively. “Quality STEM education is vital for the future success of students. Integrated STEM education is one way to make learning more connected and relevant for students” (Stohlmann, Moore, & Roehrig 2012, 28). Engineering is traditionally not a subject that is taught in elementary schools. However, it is a powerful method of teaching and motivating students in STEM-related fields. “Research indicates that using an interdisciplinary or integrated curriculum provides opportunities for more relevant, less fragmented, and more stimulating experiences for learners” (Furner & Kumar 2007, 186).  Adding science, and more importantly, engineering as a part of the elementary school curriculum can be an effective way for students to strengthen their science, mathematics, and technological skills.

Acknowledgements

Professors Samaroo and Villatoro thank the following programs for supporting the various undergraduate students involved in this project over the years: Perkins Peer Advisement, Black Male Initiative and Emerging Scholars programs at New York City College of Technology, and the CUNY Service Corps.  The authors thank the principals and teachers at Daniel Hale Williams School for opening their classrooms to this project throughout the years. We also acknowledge the faculty from the City Tech who participated in the Family STEM Workshops and the following undergraduates who have contributed to this project: Ramon Romero, Ngima Sherpa, Joyce Tam, Abigail Doris, Dante Francis and Jesam Usani.

About the Authors

Areeba Iqbal earned her Associate in Applied Science in Civil Engineering from New York City College of Technology.  She is currently pursuing a Bachelor of Science in Civil Engineering from
Manhattan College.

Kayla Natal is currently a student at New York City College of Technology, pursuing a Bachelor’s degree in Mechanical Engineering.  She also works as a Coordinator for the Peer Advisement Program. Kayla hopes to further her education and pursue a career in Industrial Design.

Servena Narine is a licensed and certified NYC Board of Education teacher. She currently works at Daniel Hale Williams Public School 307 Magnet School for STEM Studies. She has been an educator at P.S. 307 for 22 years. Over the course of her career, she has served as a classroom teacher (Grades Pre-K, 1, 2 and 3), mathematics coach, technology teacher, magnet resource specialist, and mentor. No matter the position, role or duties, she enjoys each, in addition to working with staff, students, parents, and partnerships. She brings to her work a focused and organized structure which has benefited her and the school over the years.

Melanie Villatoro is an assistant professor in the Department of Construction Management and Civil Engineering Technology.  She teaches a variety of courses in the civil engineering major including statics, strength of materials, concrete, steel, soil mechanics, and foundations.  Prof. Villatoro’s approach to teaching builds on developing rapport with her students.  She is highly effective in the classroom and as an advisor and mentor.  She is passionate about student retention and performance, as well as STEM Outreach from the elementary to the high school level.

Diana Samaroo is an associate professor and chair of Chemistry Department at New York City College of Technology in Brooklyn, New York.   Her pedagogical research is in the area of peer-led team learning in Chemistry and integrating research into the curriculum.  With a background in biochemistry, her research interests are in the area of drug discovery, therapeutics, and nanomaterials. She has successfully mentored students through the Louis Stokes Alliance for Minority Participation and the Black Male Initiative and serves on the college’s Undergraduate Research Committee.

References

American Chemical Society. (2018). Dissolving M&Ms. Retrieved February 5, 2018 from https://www.acs.org/content/acs/en/education/whatischemistry/adventures-in-chemistry/experiments/dissolving-m-ms.html.

Brophy, S., Klein, S., Portsmore, M., & Rogers, C. (2008). Advancing engineering education in P-12 classrooms. Journal of Engineering Education, 97(3), 369–387.

Brown, J. (2012). The current status of STEM education research. Journal of STEM Education: Innovations & Research, 13(5), 7–11. Available from Academic Search Complete, Ipswich, MA. Accessed October 9, 2017.

Burte, H., Gardony, ,Hutton, , & Taylor, . (2017). Think3d!: Improving mathematics learning through embodied spatial training. Cognitive Research: Principles and Implications, 2(13), 1–18.

City University of New York. (2018). CUNY Service Corps. Retrieved February 5, 2018 from  http://www1.cuny.edu/sites/servicecorps/.

Furner, M. J., & Kumar, . (2007). The mathematics and science integration argument: A stand for teacher education. Eurasia Journal of Mathematics, Science & Technology Education, 3(3), 185–189.

Institute of Electrical and Electronics Engineers. (2018) Try Engineering. Retrieved February 7, 2018 from http://tryengineering.org.

Johnson, C. C. 2013. Conceptualizing integrated STEM education. School Science and Mathematics, 113(8), 367–368.

Katehi, L., Pearson, G., & Feder, M. (2009). The status and nature of K-12 engineering education in the United States.  The Bridge on K-12 Engineering Education, 39(3). Retrieved February 5, 2018 from https://www.nae.edu/19582/Bridge/16145/16161.aspx.

Kuh, G. D. (2008). High-impact educational practices: What they are, who has access to them, and why they matter. Washington, DC: Association of American Colleges and Universities.

Langdon, D., McKittrick, G., Beede, D., Khan, B, & Doms, M.  (2011). STEM: Good jobs now and for the future.  U.S. Department of Commerce, Economics and Statistics Administration. Retrieved February 7, 2018 from http://www.esa.doc.gov/sites/default/files/stemfinalyjuly14_1.pdf.

Lopatto, D. (2010). Undergraduate research as a high-impact student experience. Peer Review 12(2). Retrieved February 7, 2018 from https://www.aacu.org/peerreview/2010/spring.

National Engineers Week Future City Competition. (2017). Future City Competition. Retrieved February 5, 2018 from https://futurecity.org.

New York City College of Technology, City University of New York. (2017). Fact Sheet 2017–2018. Retrieved February 5, 2018 from http://www.citytech.cuny.edu/about-us/docs/facts.pdf.

Preschool STEAM. (n.d.). Easy turkey preschool STEM activities. Retrieved February 7, 2018 from https://preschoolsteam.com/thanksgiving-preschool-stem-activities/.

Ressler, Stephen. (2013). The Bridge Designer Software. Retrieved February 7, 2018 from http://stephenjressler.com/wpbd/.

Russell S. H., Hancock , & McCullough, J. (2007). The pipeline. Benefits of undergraduate research experiences. Science, 316(5824), 548–549.

Schooling a Monkey. (2018). Hands-on teaching ideas. Retrieved February 7, 2018 from http://www.schoolingamonkey.com/engineering-activities-for-kids/.

Stohlmann, M., Moore, T. J., & Roehrig, G. H. (2012). Considerations for teaching integrated stem education. Journal of Pre-College Engineering Education Research (J-PEER), 2(1), 28–34.

STEAM Powered Family. (2018). Slime STEM Activities – Learning with slime, STEM and fun! Retrieved February 7, 2018 from https://www.steampoweredfamily.com/activities/slime-stem-activities-learning-with-slime-stem-and-fun/.

Science Pioneers. (2017). Why STEM education is important for everyone. http://www.sciencepioneers.org/parents/why-stem-is-important-to-everyone.

Ressler, Stephen. (2013). The Bridge Designer Software. Retrieved February 7, 2018 from http://stephenjressler.com/wpbd/.

Wai, J., Lubinski, D. & Benbow, C. P. (2009). Spatial ability for STEM domains: Aligning over 50 years of cumulative psychological knowledge solidifies its importance. Journal of Educational Psychology, 101(4), 817–835.

Download (PDF, 4.97MB)

Abstract

Retention efforts in STEM have become a priority of colleges and universities. Two-year college STEM students are particularly affected by factors that contribute to low retention and persistence. To address STEM retention problems, a student support program was developed through National Science Foundation funding to support STEM student success. The program sought to enhance STEM identity, thereby increasing persistence. Participants were required to engage in STEM civic engagement, using their STEM knowledge and skills for community betterment. This study sought to examine the effects of these activities on students’ STEM identity and ultimate persistence. Data were collected over years from participant surveys and interviews. We found that students had cultivated a sense of STEM identity, and that graduation and transfer rates increased as a result of their increased civic engagement. Students who engage in their community develop cultural competency, communication skills, and critical thinking ability and have opportunities to apply their knowledge.

Introduction

The Role of Two- year Colleges in STEM Education

Two-year colleges are an often overlooked but essential component in the pathway to Science, Technology, Engineering, and Mathematics (STEM) higher education (National Academies of Sciences, Engineering, and Medicine [NASEM] 2016; National Research Council [NRC] 2012).  They play a unique role in STEM education, enrolling nearly half of the nation’s undergraduate students (American Association of Community Colleges [AACC] 2014). Community colleges in the United States enroll more than eight million students annually, including 43% of U.S. undergraduates (AACC 2011; Mullin 2012). Approximately 50% of all college students who eventually earn bachelor’s degrees in STEM begin their undergraduate education at two-year colleges (Tsapogas 2004; Starobin & Laanan 2010), and 20% of students who were awarded science and engineering doctoral degrees earned credits at a two-year college at some point in their academic careers (Chen 2013).

Community colleges provide a diverse student body (people of color, women, older students, veterans, international students, first-generation college students, low-income students, and working parents) with access to higher education. According to the American Association of Community Colleges, 52% percent of Hispanic students, 44% of African American students, 55% of Native American students, and 45% of Asian-Pacific Islander students attend two-year colleges (AACC 2011). Additional reports (Provasnik & Planty 2008) show the median age of two-year college students is 24, with 35% of the student population 30 or older. Further data show that 20% of two-year college students are married with children, and an additional 15% are single parents (Provasnik & Planty 2008; Li 2007). Almost half of college-going students attend community colleges at some point in their academic careers; low-income, first generation, and under-represented minority students are more likely to enroll in two-year institutions (NASEM 2016).

Two-year colleges attract many students by providing affordable tuition, flexible scheduling, small class sizes, and access to faculty. These institutional attributes accommodate those two-year college students who take a nonlinear path to degree completion due to family and work obligations (Pérez & Ceja 2009). On account of the rich diversity of their student population, two-year colleges have the potential to increase participation of non-traditional and underrepresented students in STEM.

Retention and Persistence for Community College STEM Students

Retention and persistence of all STEM students continue to be of significant concern as data reveal that more than half of freshman who initially declare STEM majors leave these fields before graduation (President’s Council of Advisors for Science and Technology [PCAST] 2012; Chen 2009; Chen 2013). Among all students who declared their intentions to pursue STEM majors, only 43% were still in a STEM major at the time of their last enrollment, with the others all transitioning to other majors. Even more problematic, only 7.3% of STEM students who began at a two-year college received a STEM bachelor’s degree after six years, compared with 45% of students who started in a four-year program (Chen 2013).

Factors influencing retention and persistence in STEM majors are diverse and often interconnected. Leading reasons for low STEM retention and persistence at both the two-year and four-year colleges are uninspiring introductory courses, lack of math preparation, and an academic culture not welcoming of women, minorities, and non-traditional students (PCAST 2012; Seymour and Hewett 2000; Griffith 2010; Huang, Taddese, & Walter 2000). Additionally, STEM students at the two-year college are affected by external circumstances such as work and family obligations and have fewer economic and social resources and fewer STEM role models than their four-year traditional student counterparts.  For the two-year college STEM student, these external circumstances coupled with an unwelcoming STEM culture undermine their sense of identity, belonging, and self-efficacy, which are critical to their STEM retention and persistence.

The Culture of STEM

The explicit and implicit customs, behaviors, and values that are normative within STEM education make up the culture of STEM (NRC 2009). An examination of the culture of STEM education is important because the social, psychological, and structural dimensions of STEM education in two-year and four-year colleges influence student identity, belonging, self-efficacy, and encouragement. The experiences students gather during their interactions with the “STEM culture” of the department or institution drive student awareness and understanding of program standards, academic expectations, STEM identity, and their sense of belonging in the program. More importantly, student experiences within the STEM culture and the encouragement or lack thereof can have a profound impact on the student’s self-efficacy and desire to persist (Cabrera et al. 1999; Eccles, Wigfield, & Schiefele 1998; Reid & Radhakrishnan 2003; Pérez, Cromley, & Kaplan 2014).

Identity/Belongingness, Encouragement, and Self-efficacy

Self-perceptions regarding academic competence are framed by personal and collective identities. Each student has many such identities—racial, ethnic, socioeconomic, professional, sexual/gender, and family. These identities are framed by upbringing, experiences, and society at large and can shift across time either unconsciously or through deliberate effort (Good 2012). Students’ positive identification with their discipline can enhance academic engagement and belongingness and prove to be a great source of encouragement. However, more commonly the obverse is true, especially for non-traditional and underrepresented STEM students. These students often experience challenges such as isolation, invisibility, discrimination, and a sense of not belonging and disconnectedness from external social and cultural networks (Ong 2001; NRC 2012).

Belonging to valued social groups is a fundamental human need; a sense of inclusion is particularly important for underrepresented groups in STEM when stereotypes imply that they might be unsuited to certain settings, such as rigorous academic classes (Baumeister & Leary 1995; Dovidio, Major, & Crocker 2000; Walton & Cohen 2007; Cohen & Steele 2002). Feeling a sense of belonging and acceptance by others in STEM (faculty and peers) is crucial to retention and persistence for these STEM students (Johnson 2012; Palmer, Maramba, & Dancy 2011).

Stereotypical ideas about what constitute appropriate fields of study for two-year college students or comments regarding academic preparedness/achievement in math and science can serve as critical barriers to retention and persistence. According to Starobin & Laanan (2008), even when these students possess a strong math or science background, they often receive little encouragement or support from faculty. Creating a sense of encouragement and a support system for two-year college STEM students is paramount to increasing retention and persistence. Studies show non-traditional and underrepresented minorities need proactive personal encouragement and positive media messages to counteract the status quo “culture of STEM” (Hanover Research, 2014). Programs and activities that facilitate healthy positive relationships and offer encouragement among peers and from faculty promote student engagement and feelings of belonging.

Academic self-efficacy is commonly defined as the belief in one’s capabilities to achieve a goal or an outcome using one’s skills under certain circumstances, and that performance and motivation are determined by how effective people believe they can be. (Snyder & Lopez 2007; Bandura 1982). More specifically, for many two-year STEM students, academic self-efficacy is entangled with STEM identity as it refers to the belief or conviction that they can successfully obtain a STEM degree (Marra et al. 2009).

A major source of academic self-efficacy is simply having the raw knowledge, skills, and experience required to successfully reach a goal or to complete a task; this source of efficacy is commonly referred to as mastery experience (Bandura 1997). In the context of two-year STEM students, this means having a positive experience in completing a STEM task, specific course, and/or obtaining an associate’s degree.

STEM Civic Engagement through Peer Tutoring

STEM civic engagement covers a wide array of activities and learning outcomes in which students participate in the formal and informal STEM processes that address community needs and seek to improve the quality of life for individuals, groups, and entire communities. In this context, STEM civic engagement contributes to student growth by connecting authentic and meaningful service to communities with content and skills acquired in the classroom. Civic engagement activities, such as tutoring others in STEM content, present students with opportunities to reflect upon their own academic goals (also known as metacognition) (NRC, 2000), transform their communities, and identify and address social challenges that are specific to our society, i.e. the lack of STEM subject understanding, the lack of STEM role models, etc.

It is well documented that tutoring has beneficial effects on both the tutor and the tutee.  In particular, many studies have shown that tutoring increases the content knowledge as well as the self-concept of the tutor (Britz, Dixon, & McLaughlin1989; Cohen, Kulik, & Kulik 1982; Early 1998).  Students who tutor feel more positive towards themselves as students, and they display an improved academic self-concept. Through this enhanced self-concept, students identify themselves more strongly as students of their discipline (Early 1998).  Furthermore, students in STEM disciplines who serve as leaders among their peers experience increased self-efficacy and retention, and studies have shown that this trend applies to both majority and underrepresented students.  Thus, peer leadership may provide a path for improving retention of underrepresented groups in the field (Hug, Thiry, & Tedford 2011). Additional outcomes for STEM leaders (mentors or tutors) include increased participation in internships and higher GPAs (Monte, Sleeman, & Hein 2007). Other studies indicate that the opportunity to tutor or mentor others allows STEM students to develop a sense of belonging and social relationships that aid in student retention; to some extent, this can be attributed to improved experience with and understanding of STEM culture at the students’ institutions (Kiyama 2014; Kiyama et al. 2014).

Existing research provides a limited understanding of the relationship between identity/belonging, encouragement, self-efficacy, civic engagement, and retention rates for two-year college STEM students. Our study explored the effects of civic engagement volunteer activities on student identity/belonging, encouragement, and self-efficacy.  The results show a relationship between these activities and STEM persistence and retention for two-year college STEM students.

Institution and Program

Perimeter College is part of Georgia State University, a diverse, multi-campus urban research university in metropolitan Atlanta. The college is the major provider of associate’s degrees and student transfer opportunities in Georgia and a gateway to higher education, easing students’ entry into college-level study.  More than 21,000 students, representing all ages and backgrounds, are enrolled in Perimeter College. Through the college, Georgia State serves the largest number of dual enrollment, international, online, transfer, and first-time freshman students in the University System of Georgia.

Beginning in Spring 2012, through National Science Foundation funding, a Science, Technology, Engineering, and Mathematics Talent Expansion Program (STEP) was developed for two-year, full-time students, with a minimum 2.8 grade point average. To participate, students must have U.S. citizenship or status as permanent resident alien or refugee alien and be majoring in a STEM field of study, declared at any point but usually after the first year of coursework. The objectives of the program are two-fold: (a) to increase the number of students who persist in all STEM fields at the institution (chemistry, biology, math, geology, physics, computer science, and engineering) and (b) to increase the number of students who graduate and/or transfer to four-year colleges/universities to complete their STEM baccalaureate degrees.  The demographic breakdown of the STEP participants throughout the lifetime of the program mirrored that of the STEM majors in the institution; the majority of STEP students are underrepresented minorities.

Students participate in the program for an average of three semesters (including a summer semester). Stipends are given to those participants who meet the following criteria each semester: (a) are enrolled as a full-time student (12 credit hours during the fall and spring semester); (b) maintain a cumulative minimum GPA of 2.8 and a minimum semester GPA of 2.5; (c) participate in a minimum of 10 hours of STEM civic engagement activities per semester; (d) participate in a minimum of six STEM–related activities (STEP-sponsored and others). Stipend amounts vary depending on the academic classification of the participant. Additional stipends are given for participation in the Summer Bridge I undergraduate research experience (three weeks), Summer Bridge II undergraduate research experience (eight weeks), and participation in the NSF’s Research Experiences for Undergraduates program. STEP sponsors multiple STEM activities each semester, including STEM industry visits and college visits.

STEM Civic Engagement Activities

Program participants are engaged in the STEM community in a number of ways, some of which are required elements and others that are optional.  All program participants are required to attend a number of career workshops and to visit industry sites and four-year institutions.  Additionally, throughout their tenure in the program, participants are required to complete a minimum of 10 hours of civic engagement per semester.  Many of the students fulfill this requirement by serving as tutors in on-campus student support facilities or off campus in their communities.   Additional civic engagement opportunities are available to the students through outreach activities (such as science festivals), environmental clean-ups, and other STEM-related events. Many students (73%) completed more than the required 10 hours per semester of service; the average contribution per semester is 12 hours of service.

Methods

In order to determine student outcomes, we tracked students through their program experience and after graduation and transfer to four-year institutions. During their tenure in the program, participants were asked to complete a number of surveys and focus group interviews to determine their reactions to and the perceived outcomes of the various student support activities.  Surveys were retrospective in design: students were asked to think back to how they felt at the beginning of the program and compare that to how they felt at the time of taking the survey (usually after one year in the program). This approach maximizes ability to match responses and also eliminates pretest sensitivity and response shift bias, wherein students tend to underestimate or overestimate their attitudes towards the unknown prior to the start of an intervention (Howard 1980; Pratt, McGuigan, & Katzev 2000). In addition to surveys given during students’ tenure in the program, we also administered an alumni survey to those who had completed the program.

In particular, our 23-item student survey drew upon existing instruments designed to assess changes in STEM engagement (Fredricks et al. 2005), STEM identity and belonging, encouragement (Leonowich-Graham & Condley 2010), math and science anxiety (Bai et al. 2009; Glynn and Koballa 2006), commitment to research, and intent to persist (Tocker 2010). Further definition of these psychosocial constructs is presented in Table 1, along with example survey items. Students were asked to respond to survey items using a 5-point Likert scale of agreement (1=Strongly Disagree to 5=Strongly Agree).

To collect qualitative data, students were assembled in groups of 812 to participate in annual focus group interviews.  During these interviews, students were asked probing questions regarding their experiences in the program and how they affected their identity, engagement, and intent to persist in STEM. The focus group interview protocol included questions such as the following:

• Describe civic engagement activities that you participated in.
• Did these activities change the way you think about yourself? About your intended career?
• Are you making different decisions because of participating in this program? Explain.

To further explore the link between persistence and gains made by students as a result of the program and civic engagement activities, a multiple regression analysis was conducted whereby the outcome variable was Intention To Persist and the predictor variables were STEM Engagement, STEM Identity and Belongingness, Math and Science Anxiety, Research, and Encouragement. To compute the outcome and predictor values for this analysis, items from the student survey were averaged for each corresponding construct.

Results

Qualitative data gleaned from participants’ open-ended responses to surveys and during focus group interviews suggested that the STEP program positively impacted their motivation to pursue STEM education and careers by enhancing their sense of STEM identity and belonging and by providing social support and encouragement.

[STEP] helped me to be confident and to trust myself that I can do better things if I have the will. It also helped me make the decision that I belong to a STEM family.

STEP enhanced my vision of being a scientist.

I was about to give up on my school.…[A]fter meeting and getting help from different people, I was able to rethink my major and continue my studies.

Additionally, annual surveys completed by program participants demonstrated that they made significant gains in terms of STEM engagement, STEM identity and belongingness, comfort with math and science, encouragement, and intent to persist.  Table 2 shows statistically significant gains in attitude measured by these surveys over the course of the program.

Figure 1 summarizes the results of the regression analysis, conducted using data from the alumni surveys administered in 2013 and 2015 (n=39). Students taking the alumni survey had all completed their program and/or transferred to a four-year institution. Alumni survey data were chosen for this regression analysis in order to limit the findings to that of a longer-term student perspective; these students had the benefit of looking back over their entire program experience, and these data represent a more complete picture. The regression model with all five predictors explained 95% of the variance in the outcome variable (R2=.948, F(5,33)= 119.18, p<.001).  Controlling for other variables in the model, the results indicate that two variables statistically significantly predict intent to persist:

• STEM Identity and Belongingness (ß=.55, p<.001)
• Encouragement (ß=.56, p<.001)

This suggests that students’ motivations to pursue additional STEM education and/or careers is contingent on the degree to which the program was able to (a) improve their sense of belonging in STEM and (b) provide encouragement for attaining a STEM degree. This finding corroborates previous research which indicates that STEM persistence increases as students experience a greater sense of belonging and general social support from mentors and colleagues (London et al. 2011).

Quantitative data analysis was limited in that the response rate for the student surveys was not 100%. (Response rate was roughly 85% across all items and multiple administrations of the survey.)  Thus, responses might demonstrate a bias towards the positive, as students who felt less compelled to respond to the program survey were often those who had left the program (and usually the institution). Additionally, due to the low sample size, we must use caution when interpreting the results of the regression analysis. Correlations among constructs suggest that multicollinearity may have impacted the results of the regression. To mitigate the effects of multicollinearity, each predictor variable in the regression model was standardized (e.g., converted to a z-score). Furthermore, the results provided in the current report are preliminary and should be replicated using a larger sample size. It is also important to note that disaggregation of data by gender or race/ethnicity did not reveal significant differences among the participating groups of students.

Qualitative Findings

During annual interviews, students were asked about their experiences in program activities, and how they thought these experiences affected them. In particular, we explored which facets of the program led to increased STEM identity and encouragement.  Students explained that the volunteer work they did to meet their civic engagement requirements helped them in many ways.  Specifically, they were able to solidify their STEM content knowledge and improve their communication and leadership skills:

Being part of [tutoring]… helps you refresh your mind. When you are helping them it helps you refresh your mind. You refresh communication skills.

It improves your leadership skills. One thing that I’ve learned is that you’re more involved in the community and you’re more exposed to the problems of the community. I think that it really improves your communication skills, your leadership, and it helps you learn more about your community.

Participants also felt that civic engagement motivated them to work harder in STEM and gave them a broader perspective on their futures.

It opens your mind up to all that’s out here. It’s opened my mind to what’s out there and made me think that I want to help people. It’s an unselfish thing.

Even being around the other members, outside of class, you get to know them—being around people that are really smart, makes me want to be really smart.

You become more motivated. You want to learn as much as you can. You want to help as much as you can. You want to put things out there so that people can learn from you.

It’s not about improving myself, but improving other people’s lives. I started thinking about non-profits. I started thinking about things that I didn’t think about before.

In short, students explained that participation in civic engagement improved their STEM and soft skills and motivated them to consider a broader range of career options. Their sense of identity as part of a STEM community was solidified through exchanges with their peers as well as with those they were helping.

In order to examine the effect of programmatic activities on actual persistence, we tracked transfer and graduation rates of the scholars, and compared those to non-participant STEM students. Table 3 indicates that program participants were more than twice as likely to complete their program of study and /or transfer to a four-year institution to pursue a STEM degree. Furthermore, STEP students who completed at least 10 hours per semester of civic engagement activities were even more likely to graduate and/or transfer (Table 3).

Discussion

The culture that students encounter when studying STEM has an effect on their interest, self-concept, sense of connectedness, and persistence in STEM. Students who persist often have to draw upon personal, cultural, and co-curricular resources to counter messages about the nature of ability and stereotypes that they encounter in interactions with faculty and that are embedded in organizational norms and practices.

Interventions aimed at improving participant identity and belonging have been shown to enhance achievement and persistence (Cohen & Garcia 2008). Not surprisingly, students in highly evaluative environments (such as STEM courses) are sensitive to stereotype threat when facing difficult coursework and feedback, suggesting that it is particularly important to focus on improving STEM identity in an effort to increase student success (Cohen & Steele 2002).

Despite limitations of the study discussed in the results section, we found that an increase in STEM identity and belongingness and encouragement predicted an increase in intent to persist, and that actual persistence was improved with civic engagement. We posit that opportunities to guide others through tutoring and other civic engagement activities enhanced STEM identity, as scholars explained to us during interviews.  In concurrence with STEM achievement, improved identity and belongingness in STEM led to a substantially higher likelihood of graduation and or transfer, as evidenced by participant graduation and transfer rates in comparison to those of non-participant STEM students at the institution. Participating students still face a number of challenges, as do their non-participating counterparts; though the overall graduation and transfer rate for participants is still alarmingly low, the trend towards success is encouraging and suggests that interventions aimed at increasing STEM identity through civic engagement will increase overall STEM diversity in academe and the workforce

About the Authors

Dr. Pamela M. Leggett-Robinson is the Science Department associate chair and an associate professor of chemistry on the Decatur campus of Georgia State University-Perimeter College. Dr. Leggett-Robinson has served as a program director for several NSF and NIH initiatives and is currently the principal investigator of Georgia State University-Perimeter College’s NSF STEP grant. Her research and scientific presentations focus on natural product chemistry, surface chemistry, and student support programs in STEM education. She holds a BS in Chemistry from Georgia State University, an MS in Bio-Inorganic Chemistry from Tennessee Technological University, and a PhD in Physical Organic Chemistry from Georgia State University. As corresponding author, Dr. Leggett-Robinson can be reached at pleggett1@gsu.edu.

Mrs. Naranja Davis is the NSF GSU-PC STEP coordinator. She has worked as a coordinator on several other NSF STEM initiatives over the past 10 years and is experienced in student data systems. Ms. Davis has a BS in Communication with a minor in Public Relations.

Dr. Brandi Villa did her graduate research in areas of applied and environmental microbiology as well as program evaluation of a science education outreach organization. She has been a science educator at middle school, high school, and undergraduate levels for more than a decade and thus brings an educator and researcher’s perspective to the design and implementation of education research and program evaluation. In addition to her passion for all aspects of STEM education, Dr. Villa particularly enjoys challenges related to evaluation design, reporting, and data visualization.

References

American Association of Community Colleges (AACC). (2011). Fast facts, 2011. Washington, DC: American Association of Community Colleges.

American Association of Community Colleges (AACC). (2014). Fact Sheet. Washington, DC: American Association of Community Colleges.

Bai, H., Wang, L., Pan, W., & Frey, M. (2009). Measuring mathematics anxiety:  Psychometric analysis of a bi-dimensional affective scale. Journal of Instructional Psychology, 36(3), 185–193.

Bandura, A. (1997). Self-efficacy: The exercise of control. New York: W.H. Freeman and Company.

Baumeister, R. F., & Leary, M. (1995). The need to belong: Desire for interpersonal attachments as a fundamental human motivation. Psychological Bulletin, 117(3), 497–529.

Britz, M. W., Dixon, J., & McLaughlin, T. F.  (1989). The effects of peer tutoring on mathematics performance: A recent review. B.C.J. Special Education, 13,17–33.

Cabrera, A. F., Nora, A., Terenzini, P. T., Pascarella, E. T., & Hagedorn, L. S. (1999). Campus racial climate and the adjustment of students to college: A comparison between white students and African-American students. Journal of Higher Education, 70, 134–160.

Chen, X. (2009). Students who study science, technology, engineering, and mathematics (STEM) in postsecondary education. Washington DC: U.S. Department of Education, National Center for Education Statistics, Institute of Education Sciences. Retrieved January 31, 2018 from https://nces.ed.gov/pubs2009/2009161.pdf.

Chen, X. (2013). STEM attrition: college students’ paths into and out of STEM fields (NCES 2014-001). Washington DC: U.S. Department of Education, National Center for Education Statistics, Institute of Education Sciences. Retrieved January 31, 2018 from https://nces.ed.gov/pubs2014/2014001rev.pdf.

Cohen, G. L., & Garcia, J. (2008). Identity, belonging and achievement: a model, interventions, implications. Current Directions in Psychological Science, 17, 365–369.

Cohen, G. L., & Steele, C. M. (2002). A barrier of mistrust: How negative stereotypes affect cross-race mentoring. In J. Aronson (Ed.), Improving academic achievement: Impact of psychological factors on education. San Diego, CA: Academic Press.

Cohen, P. A., Kulik, J. A., & Kulik, C. C. (1982). Educational outcomes of tutoring: A meta-analysis of findings. American Educational Research Journal, 19, 237–248.

Dovidio, J. F., Major, B., & Crocker, J. (2000). Stigma: Introduction and overview.  In T. F. Heatherton (Ed.), The Social Psychology of Stigma (pp. 1–28). New York: Guilford Press.

Early, J. W. (1998). The impact of peer tutoring on self-esteem and Texas Assessment of Academic Skills mathematics performance of tenth grade students. Unpublished doctoral dissertation, Texas A&M University, College Station, TX.

Eccles, J., Wigfield, A., & Schiefele, U. (1998). Motivation to succeed. In W. Damon (Series Ed.) and N. Eisenberg (Volume Ed.), Handbook of Child Psychology. Vol. 3: Social, Emotional, and Personality Development (5th ed., pp. 1017–1095). New York: Wiley.

Fredricks, J. A., Blumenfeld, P. C., Friedel, J., & Paris, A. (2005). School engagement. In K. A. Moore and L. Lippman (Eds.), Conceptualizing and measuring indicators of positive development: what do children need to flourish? New York: Kluwer Academic/Plenum Press.

Glynn, S. M., & Koballa, T. R., Jr. (2006). Motivation to learn college science. In J. J. Mintzes & W. H. Leonard (Eds.), Handbook of college science teaching. Arlington, VA: National Science Teachers Association Press.

Good, C. (2012). Why do women opt out? Sense of belonging and women’s representation in mathematics. Journal of Personality and Social Psychology, 102(4), 700–717.

Griffith, A. L. (2010). Persistence of women and minorities in STEM field majors: Is it the school that matters? Retrieved January 31, 2018 from http://digitalcommons.ilr.cornell.edu/workingpapers/122/

Hanover Research (2014). Encouraging Students to Embrace STEM programs. Retrieved January 31, 2018 from http://mygaen.org/research/Encouraging%20Students%20to%20Embrace%20STEM%20Programs.pdf.

Howard, G. S. (1980). Response-shift bias: A problem in evaluating interventions with

pre/post self-reports. Evaluation Review, 4(1), 93–106.

Huang,G., Taddese, N., & Walter, E. (2000). Entry and persistence of women and minorities in college science and engineering education (NCES 2000–601). Washington, DC: U.S. Department of Education, National Center for Education Statistics.

Hug, S., Thiry, H., & Tedford, P. (2011, March). Learning to love computer science: Peer leaders gain teaching skill, communicative ability, and content knowledge in the CS classroom. SIGCSE: Proceedings of the 42nd ACM Technical Symposium on Computer Science Education, Dallas, TX (pp. 201–206).

Johnson, D. R. (2012). Campus racial climate perceptions and overall sense of belonging among racially diverse women in STEM majors. Journal of College Student Development, 53(2), 336–346.

Kiyama, J. M. (2014). Structured opportunities: Exploring the social and academic benefits for peer mentors in retention programs. Journal of College Student Retention: Research, Theory, & Practice, 15, 489–514.

Kiyama, J. M., Luca, S. G., Raucci, M., & Crump-Owens, S. (2014). A cycle of retention: Peer mentors’ accounts of active engagement and agency. College Student Affairs Journal. 32, 81–95.

Leonowich-Graham, P., & Condly, S. (2010). Encouragement may be the missing link in the pursuit of CS / IT Majors. Fall 2010 Mid-Atlantic ASEE Conference,  Villanova University. Retrieved January 31, 2018 from https://www.asee.org/documents/sections/middle-atlantic/fall-2010/01-Encouragement-May-Be-the-Missing-Link-in-the-Pursuit-of-CS-I.pdf.

Li, X. (2007). Characteristics of minority-serving institutions and minority undergraduates enrolled in these institutions (NCES 2008-156). Washington, DC: U.S. Department of Education, National Center for Education Statistics.

London, B., Rosenthal, L., Levy, S., & Lobel, M. (2011). The influences of perceived identity compatibility and social support on women in nontraditional fields during the college transition. Basic and Applied Social Psychology, 33, 304–321.

Marra, R. M.,  Rodgers, K. A., Shen, D., & Bogue, B. (2009) Women engineering students and self-efficacy: A multi-year, multi-institution study of women engineering student self- efficacy. Journal of Engineering Education ,98(1), 27–38.

Monte, A. E., Sleeman, K. A., & Hein, G. L. (2007, October). Does peer mentoring increase retention of the mentor? 37th ASEE/IEEE Frontiers in Education Conference. Milwaukee, WI.

Mullin, C. M. (2012, February). Why access matters: The community college student body (Policy Brief 2012-01PBL). Washington, DC: American Association of Community Colleges

National Academies of Sciences, Engineering, and Medicine (NASEM). (2016). Barriers and opportunities for 2-year and 4-year STEM degrees: Systemic change to support students’ diverse pathways. Washington, DC: National Academies Press.

National Research Council (NRC). (2000). How people learn: Brain, mind, experience, and school.. Expanded Edition. Washington, DC: National Academies Press.

National Research Council (NRC). (2009). Learning Science in Informal Environments: People, Places, and Pursuits.  Washington, DC: The National Academies Press.

National Research Council (NRC). (2012). Community colleges in the evolving stem education landscape: Summary of a summit. Washington, DC: National Academies Press.

Ong, M. (2001). Playing with in/visibility: How minority women gain power from the margins of science culture. Women in Higher Education, 10/11, 4–44.

Palmer, R. T., Maramba, D. C., & Dancy, T. E. (2011). A qualitative investigation of actors promoting the retention and persistence of students of color in STEM. Journal of Negro Education, 80(4), 491–504.

Pérez, P., & Ceja, M. (2009). Best practices and outcomes in transfer to universities. Journal of Hispanic Higher Education. 9(1), 6–21.

Pérez, T., Cromley, J. G., and Kaplan, A. (2014). The role of identity development, values, and costs in college STEM retention. Journal of Educational Psychology, 106(1), 315–329.

Pratt, C., McGuigan, W., & Katzev, A. (2000). Measuring program outcomes: Using retrospective pretest methodology. American Journal of Evaluation, 21(3), 34–349.

President’s Council of Advisors for Science and Technology (PCAST). (2012). Report to the President: Engage to excel: Producing one million additional college graduates with degrees in science, technology, engineering, and mathematics. Washington, DC: Executive Office of the President.

Provasnik, S., & Planty, M. (2008). Community colleges: Special supplement to the Condition of Education 2008 (NCES 2008-033). Washington, DC: U.S. Department of Education, National Center for Education Statistics.

Reid, L. D., & Radhakrishnan, P. (2003). How race still matters: The relation between race and general campus climate. Cultural Diversity and Ethnic Minority Psychology, 9, 263–275.

Snyder, C. R., & Lopez, S. J. (Eds.) (2002). Handbook of positive psychology. Oxford: Oxford University Press.

Starobin, S. & Laanan, F. S. (2008). Broadening female participation in science, technology, engineering, and mathematics: Experiences at community colleges. New Directions for Community Colleges, 142, 37–46.

Tocker, Y. (2010).  Non-ability correlates of the science/math trait complex: Searching for personality characteristics and revising vocational interests. Doctoral dissertation: Georgia Institute of Technology, Atlanta, GA.

Tsapogas, J. (2004). The role of community colleges in the education of recent science and engineering graduates (InfoBrief 04-315.) Arlington, VA: Division of Science Resources Statistics, National Science Foundation.

Walton, G. M., & Cohen, G. L. (2007). A question of belonging: Race, social fit, and achievement. Journal of Personality and Social Psychology, 92(1), 82–96.

Download (PDF, 6.12MB)