Mixed Methods

Incorporating Professional Science Writing into High School STEM Research Projects

The goal of this project is to expand high school student participation in the peer-review process and in publishing in JEI, a science journal dedicated to mentoring pre-college students through peer-reviewed publication. By publishing pre-college research in an open access website, the project will build understanding of how engaging in these activities can change high school students' perceptions and practices of scientific inquiry.

Lead Organization(s): 
Award Number: 
2010333
Funding Period: 
Wed, 07/15/2020 to Fri, 06/30/2023
Project Evaluator: 
Maya Patel
Full Description: 

This exploratory project addresses important challenge of incorporating disciplinary literacy practices in scientific inquiry projects of high school students. The project will incorporate the peer-review process and publication in the Journal of Emerging Investigators (JEI). The Next Generation Science Standards emphasize constructs from disciplinary literacy such as engaging in argument from evidence, and evaluating and communicating information. However, there are few resources available to students and teachers that integrate these constructs in authentic forms that reflect the practices of professional scientists. High school student learners engage in scientific inquiry, but rarely participate in authentic forms of communication, forms that are reflective of how scientists communicate and participate in the primary literature of their fields. The project has three aims: 1) Generate knowledge of the impact of peer-review and publication on perceptions and skills of scientific inquiry and STEM identity, 2) Generate knowledge of how participation in peer-review and publication are impacted by contextual factors (differences in mentors and research contexts), and 3) Develop JEI field-guides across a range of contexts in which students conduct their research.

The goal of the project is to expand high school student participation in the peer-review process and in publishing in JEI, a science journal dedicated to mentoring pre-college students through peer-reviewed publication. By publishing pre-college research in an open access website, the project will build understanding of how engaging in these activities can change high school students' perceptions and practices of scientific inquiry. The project will investigate how participation in peer-reviewed publications will have an impact on student learning by administering a set of pre- and post-surveys to students who submit a paper to JEI. The project will expand student participation in JEI via outreach to teachers in under-resourced and remote areas by delivering virtual and in-person workshops which will serve to demystify peer review and publication, and explore ways to integrate these processes into existing inquiry projects. Other efforts will focus on understanding how student contextual experiences can impact their learning of scientific inquiry. These student experiences include the location of the project (school, home, university lab), the type of mentor they have, and how they became motivated to pursue publication of their research. The project will recruit students from under-resourced schools in New York through a collaboration with MathForAmerica and from rural areas through outreach with STEM coordinators in the Midwest. The resources created will be disseminated directly on the JEI website.

Assessing College-Ready Computational Thinking (Collaborative Research: Wilson)

The goal of this project is to develop learning progressions and assessment items targeting computational thinking. The items will be used for a test of college-ready critical reasoning skills and will be integrated into an existing online assessment system, the Berkeley Assessment System Software.

Award Number: 
2010314
Funding Period: 
Tue, 09/01/2020 to Sat, 08/31/2024
Full Description: 

Because of the growing need for students to be college and career ready, high-quality assessments of college readiness skills are in high demand. To realize the goal of preparing students for college and careers, assessments must measure important competencies and provide rapid feedback to teachers. It is necessary to go beyond the limits of multiple-choice testing and foster the skills and thinking that lie at the core of college and career ready skills, such as computational thinking. Computational thinking is a set of valuable skills that can be used to solve problems, design systems, and understand human behavior, and is thus essential to developing a more STEM-literate public. Computational thinking is increasingly seen as a fundamental analytical skill that everyone, not just computer scientists, can use. The goal of this project is to develop learning progressions and assessment items targeting computational thinking. The items will be used for a test of college-ready critical reasoning skills and will be integrated into an existing online assessment system, the Berkeley Assessment System Software.

The project will address a set of research questions focused on 1) clarifying computational thinking constructs, 2) usability, reliability of validity of assessment items and the information they provide, 3) teachers' use of assessments, and 4) relationships to student performance. The study sample of 2,700 used for the pilot and field tests will include all levels of students in 10th through 12th grade and first year college students (both community college and university level). The target population is students in schools which are implementing the College Readiness Program (CRP) of the National Mathematics and Science Institute. In the 2020-21 academic year 54 high schools across 11 states (CA, GA, FL, ID, LA, NC, NM, OH, TX, VA, and WA) will participate. This will include high school students in Advanced Placement classes as well as non-Advanced Placement classes.  The team will use the BEAR Assessment System to develop and refine assessment materials. This system is an integrated approach to developing assessments that seeks to provide meaningful interpretations of student work relative to cognitive and developmental goals. The researchers will gather empirical evidence to develop and improve the assessment materials, and then gather reliability and validity evidence to support their use. In total, item response data will be collected from several thousand students. Student response data will be analyzed using multidimensional item response theory models.

Storytelling for Mathematics Learning and Engagement

This project will collect and curate digital stories of diverse mathematicians sharing stories of their learning within and beyond schools. These short videos will become part of a more extensive digital database of mathematics stories that will be aligned with K-8 mathematics topics and then materials will be developed for teachers to use. The project team will explore the use of mathematics storytelling on K-8 teacher and student mathematics learning and engagement.

Award Number: 
2010276
Funding Period: 
Wed, 07/01/2020 to Fri, 06/30/2023
Full Description: 

Mathematics education in the United States has long been challenged by three key issues this project seeks to address: (a) narrow conceptions of mathematics as a discipline (b) the lack of racially/ethnically diverse role models for mathematics in terms of representation in the public imagination, media, and schools; and (c) a paucity of resources for instruction to harness students' early interest and engagement in mathematics across racial and gender groups. One promising way to expose teachers and students to a variety of images and diversity of models of mathematics is to include images of diverse people telling their stories about their doing and knowing of mathematics. Although storytelling is a natural part of human activity and is used extensively in other elementary school subjects like social studies and language arts, it is not usually found in elementary mathematics. As part of this three-year project, the project team will collect and curate digital stories of diverse mathematicians sharing stories of their learning within and beyond schools. These short videos will become part of a more extensive digital database of mathematics stories that will be aligned with K-8 mathematics topics and then materials will be developed for teachers to use. Throughout this work, the project team will explore the use of mathematics storytelling on K-8 teacher and student mathematics learning and engagement.

This project responds to calls for improved equity and access to rich, rigorous math: to contribute to understanding a more equitable K-12 pedagogy; to disrupt racial inequities in math (and STEM, more broadly) through culturally responsive and inclusive instructional practice; and to enhance teachers' instructional practice. The first phase of the work will involve collecting and curating a set of digital stories told by mathematicians. Then, through two cycles of design and piloting, the project team will work with participating teachers and students to finalize the design of the videos and associated instructional materials. A sample of pilot teachers will be purposefully selected to account for diversity in region, school population, and experience level of teachers. The research team will also design grade-level appropriate research instruments, collect surveys, and conduct interviews to investigate both teachers' and students' conceptions of mathematics, their conceptions of who "belongs" in mathematics, and teachers' instructional practice with the storytelling materials themselves. Their analysis will draw on quantitative and qualitative research methods. For example, they will use narrative inquiry to examine teachers' and students' experiences with the videos. Using the research findings, the project will make available samples of teachers' pedagogical repertoires related to these videos and demonstrate how storytelling can be used as an effective mechanism for mathematics teaching and learning. Products from this project will include a digital database and supporting instructional materials for teachers, school leaders, and professional developers to use. The dissemination of this research will contribute to building models for mathematics education that serve to deepen understanding of mathematics of teachers and students, as well as simultaneously empowering students of all backgrounds, but especially underserved students, to activate and pursue their interests in mathematics.

Geological Construction of Rock Arrangements from Tectonics: Systems Modeling Across Scales

This project will create two curriculum units that use sophisticated simulations designed for students in secondary schools that integrate the study of the tectonic system and the rock genesis system. The project seeks to overcome the more typical approaches taken in earth science classrooms where such geologic processes are treated as discrete and highly predictable, rather than intertwined and dynamic.

Lead Organization(s): 
Award Number: 
2006144
Funding Period: 
Thu, 10/01/2020 to Mon, 09/30/2024
Full Description: 

Plate tectonics is the fundamental theory of geology that underlies almost all geological processes, including land and rock formation. However, the geologic processes and immense timeframes involved are often misunderstood. This study will create two curriculum units that use sophisticated simulations designed for students in secondary schools. The simulations will integrate the study of the tectonic system and the rock genesis system. Data from the simulations would be students' sources of evidence. For instance, the Tectonic Rock Explorer would use a sophisticated modeling engine that uses the physics involved in geodynamic data to represent compressional and tensional forces and calculate pressure and temperature in rock forming environments. This project seeks to overcome the more typical approaches taken in earth science classrooms where such geologic processes are treated as discrete and highly predictable, rather than intertwined and dynamic. In addition, this study would include work on students with disabilities in earth science classrooms and explore the practices that seem to be particularly useful in helping understand these systems. By working with simulations, the researchers intend to engage students in scientific practices that are more authentic to the ways that geologists work. The researchers will study if and how these simulations and the computer-based tools allow students to observe and manipulate processes that would be may otherwise be inaccessible.

This work follows on from prior work done by the Concord Consortium on simulations of earth systems. The design and development progression in Years 1 and 2 would create two units. The first module focuses on the relationship between tectonic movement and rock formation. The second would investigate geochronology and dating of rock formations. The researchers would work with 3 teachers (and classes), and then 15 teachers (and classes) using automated data logs, class observations, and video of students working in groups in Years 1 and 2. Professional development for teachers would be followed by the creation of educative materials. Researchers will also develop the framework for an assessment tool that includes understanding of geologic terms and embedded assessments. The researchers will used a mixed methods approach to analyze student data, including analyses cycles of analysis of students pre- and post-test scores on targeted concepts, reports of student performances on tasks embedded in the simulations, and the coding of videos to analyze discourse between partners and the supports provided by teachers. Teacher data will be analyzed using interviews, surveys and journals, with some special focus on how they are seeing students with identified disabilities respond to the materials and simulations. The research team intends to make materials widely available to thousands of students through their networks and webpages, and pursue outreach and dissemination in scholarly and practitioner conferences and publications.

Reaching Across the Hallway: An Interdisciplinary Approach to Teaching Computer Science in Rural Schools

This project will develop, test, and refine a "train-the-trainer" professional development model for rural teacher-leaders. The project goal is to design and develop a professional development model that supports teachers integrating culturally relevant computer science skills and practices into their middle school social studies classrooms, thereby broadening rural students' participation in computer science.

Lead Organization(s): 
Award Number: 
2010256
Funding Period: 
Wed, 07/01/2020 to Sun, 06/30/2024
Full Description: 

Strengthening computer science (CS) and computational thinking (CT) education is a national priority with particular attention to increasing the number of teachers prepared to deliver computer science courses. For rural schools, that collectively serve more than 10 million students, it is especially challenging. Rural schools find it difficult to recruit and retain STEM teachers that are prepared to teach computer science and computational thinking. This project will develop, test, and refine a "train-the-trainer" professional development model for rural teacher-leaders. The project will build teachers' self-efficacy to deliver computer science concepts and practices into middle school social studies classrooms. The project is led by CodeVA (a statewide non-profit in Virginia), in partnership with TERC (a STEM-focused national research institution) and the University of South Florida College of Education, and in collaboration with six rural school districts in Virginia. The project goal is to design and develop a professional development model that supports teachers integrating culturally relevant computer science skills and practices into their middle school social studies classrooms, thereby broadening rural students' participation in computer science. The professional development model will be designed and developed around meeting rural teachers, where they are, geographically, economically, and culturally. The model will also be sustainable and will work within the resource constraints of the rural school district. The model will also be built on strategies that will broadly spread CS education while building rural capacity.

The project will use a mixed-methods research approach to understand the model's potential to build capacity for teaching CS in rural schools. The research design is broken down into four distinct phases; planning/development prototyping, piloting and initial dissemination, an efficacy study, and analysis, and dissemination. The project will recruit 45 teacher-leaders and one district-level instructional coach, 6th and 7th-grade teachers, and serve over 1900 6th and 7th-grade students. Participants will be recruited from the rural Virginia school districts of Buchanan, Russell, Charlotte, Halifax, and Northampton. The research question for phase 1 is what is each district's existing practice around computer science education (if any) and social studies education? Phases 2, 3 and 4 research will examine the effectiveness of professional development on teacher leadership and the CS curricular integration. Phase 4 research will examine teacher efficacy to implement the professional development independently, enabling district teachers to integrate CS into their social studies classes. Teacher data sources for each phase include interviews with administrators and teachers, teacher readiness surveys, observations, an examination of artifacts, and CS/CT content interviews. Student data will consist of classroom observation and student attitude surveys. Quantitative and qualitative data will be triangulated to address each set of research questions and provide a reliability check on findings. Qualitative data, such as observations/video, and interview data will be analyzed through codes that represent expected themes and patterns related to teachers' and coaches' experiences. Project results will be communicated through presentations at conferences such as Special Interest Group on Computer Science Education, the Computer Science Teachers Association (CSTA), the National Council for Social Studies (NCSS), and the American Educational Research Association. Lesson plans will be made available on the project website, and links will be provided through publications and newsletters such as the NCSS Middle-Level Learner, NCSS Social Education, CSTA the Voice, the NSF-funded CADREK12 website and the NSF-funded STEM Video Showcase.

Supporting Students' Language, Knowledge, and Culture through Science

This project will test and refine a teaching model that brings together current research about the role of language in science learning, the role of cultural connections in students' science engagement, and how students' science knowledge builds over time. The outcome of this project will be to provide an integrated framework that can guide current and future science teachers in preparing all students with the conceptual and linguistic practices they will need to succeed in school and in the workplace.

Lead Organization(s): 
Award Number: 
2010633
Funding Period: 
Tue, 09/01/2020 to Sat, 08/31/2024
Full Description: 

The Language, Culture, and Knowledge-building through Science project seeks to explore and positively influence the work of science teachers at the intersection of three significant and ongoing challenges affecting U.S. STEM education. First, U.S. student demographics are rapidly changing, with an increasing number of students learning STEM subjects in their second language. This change means that all teachers need new skills for meeting students where they currently are, linguistically, culturally, and in terms of prior science knowledge. Second, the needs and opportunities of the national STEM workforce are changing rapidly within a shifting employment landscape. This shift means that teachers need to better understand future job opportunities and the knowledge and skills that will be necessary in those careers. Third, academic expectations in schools have changed, driven by changes in education standards. These new expectations mean that teachers need new skills to support all students to master a range of practices that are both conceptual and linguistic. To address these challenges, teachers require new models that bring together current research about the role of language in science learning, the role of cultural connections in students' science engagement, and how students' science knowledge builds over time. This project begins with such an initial model, developed collaboratively with science teachers in a prior project. The model will be rigorously tested and refined in a new geographic and demographic context. The outcome will be to provide an integrated framework that can guide current and future science teachers in preparing all students with the conceptual and linguistic practices they will need to succeed in school and in the workplace.

This project model starts with three theoretical constructs that have been integrated into an innovative framework of nine practices. These practices guide teachers in how to simultaneously support students' language development, cultural sustenance, and knowledge building through science with a focus on supporting and challenging multilingual learners. The project uses a functional view of language development, which highlights the need to support students in understanding both how and why to make shifts in language use. For example, students' attention will be drawn to differences in language use when they shift from language that is suited to peer negotiation in a lab group to written explanations suitable for a lab report. Moving beyond a funds of knowledge approach to culture, the team view of integrating students' cultural knowledge includes strengthening the role of home knowledge in school, but also guiding students to apply school knowledge to their out-of-school interests and passions. Finally, the project team's view of cumulative knowledge building, informed by work in the sociology of knowledge, highlights the need for teachers and students to understand the norms for meaning making within a given discipline. In the case of science, the three-dimensional learning model in the Next Generation Science Standards makes these disciplinary norms visible and serves as a launching point for the project's work. Teachers will be supported to structure learning opportunities that highlight what is unique about meaning making through science. Using a range of data collection and analysis methods, the project team will study changes in teachers' practices and beliefs related to language, culture and knowledge building, as teachers work with all students, and particularly with multilingual learners. The project work will take place in both classrooms and out of class science learning settings. By working closely over several years with a group of fifty science teachers spread across the state of Oregon, the project team will develop a typology of teachers (design personas) to increase the field's understanding of how to support different teachers, given their own backgrounds, in preparing all students for the broad range of academic and occupational pathways they will encounter.

Responsive Instruction for Emergent Bilingual Learners in Biology Classrooms

This project seeks to support emergent bilingual students in high school biology classrooms. The project team will study how teachers make sense of and use an instructional model that builds on students' cultural and linguistic strengths to teach biology in ways that are responsive. The team will also study how such a model impacts emergent bilingual students' learning of biology and scientific language practices, as well as how it supports students' identities as knowers/doers of science.

Lead Organization(s): 
Award Number: 
2010153
Funding Period: 
Wed, 07/01/2020 to Fri, 06/30/2023
Full Description: 

The population of students who are emergent bilinguals in the US is not only growing in number but also, historically, has been underrepresented in STEM fields. Emergent bilingual students have not had access to the same high-quality science education as their peers, despite bringing rich academic, linguistic and cultural strengths to their learning. Building on smaller pilot studies and ideas that have shown to be successful in supporting emergent bilingual students' learning of elementary science, this project seeks to support emergent bilingual students in high school biology classrooms. The project team will study how teachers make sense of and use an instructional model that builds on students' cultural and linguistic strengths to teach biology in ways that are responsive. The team will also study how such a model impacts emergent bilingual students' learning of biology and scientific language practices, as well as how it supports students' identities as knowers/doers of science. The collaboration will include two partner districts that will allow the project work to impact about 11,000 high school students and 30 biology teachers in Florida. Over time, the project team plans to enact and study three cohorts of teachers and students; use the information learned to improve the instructional model; and develop lessons, a website, and other materials that can be applied to other contexts to support emergent bilingual students' learning of biology. This project will increase emergent bilingual students' participation in biology classes, improve their achievement and engagement in science and engineering practices, extend current research-based practices, and document how to build on emergent bilingual students' strengths and prior experiences.

In two previous pilot studies through the collaboration of an interdisciplinary team, the project team developed an instructional model that they found supported emergent bilingual students to have high-quality opportunities for science learning. The model builds on research related to culturally responsive instruction; funds of knowledge (including work on identity affirmation and collaboration); and linguistically responsive instruction (including using students' home languages and multiple modalities, and explicit attention to academic language). Using design-based research, the project team will gather data from two primary settings: their professional development program and biology teachers' classrooms. They will use these data both to improve the instructional model and professional development for biology teachers. Additionally, the project team will study how teachers use the model to support emergent bilingual students' biology engagement and achievement, as well as study how biology teachers enact the instructional model in two school districts. The project will work toward three main outcomes: a) to develop new knowledge related to how diverse learners develop language and content knowledge in biology through engaging in science and engineering practices; b) to generate new knowledge about how biology teachers can adapt responsive instruction to local contexts and student populations; and c) to articulate an instructional model for biology teachers of emergent bilingual students that is rigorous, yet practical. The dissemination and sustainability include publishing and presenting findings at a range of conferences and journals; making available the refined instructional framework and professional development materials on a website; communication with district leaders and policymakers; and white papers that can be more widely distributed.

Exploring Early Childhood Teachers' Abilities to Identify Computational Thinking Precursors to Strengthen Computer Science in Classrooms

This project will explore PK-2 teachers' content knowledge by investigating their understanding of the design and implementation of culturally relevant computer science learning activities for young children. The project team will design a replicable model of PK-2 teacher professional development to address the lack of research in early computer science education.

Lead Organization(s): 
Award Number: 
2006595
Funding Period: 
Tue, 09/01/2020 to Thu, 08/31/2023
Full Description: 

Strengthening computer science education is a national priority with special attention to increasing the number of teachers who can deliver computer science education in schools. Yet computer science education lacks the evidence to determine how teachers come to think about computational thinking (a problem-solving process) and how it could be integrated within their day-to-day classroom activities. For teachers of pre-kindergarten to 2nd (PK-2) grades, very little research has specifically addressed teacher learning. This oversight challenges the achievement of an equitable, culturally diverse, computationally empowered society. The project team will design a replicable model of PK-2 teacher professional development in San Marcos, Texas, to address the lack of research in early computer science education. The model will emphasize three aspects of teacher learning: a) exploration of and reflection on computer science and computational thinking skills and practices, b) noticing and naming computer science precursor skills and practices in early childhood learning, and c) collaborative design, implementation and assessment of learning activities aligned with standards across content areas. The project will explore PK-2 teachers' content knowledge by investigating their understanding of the design and implementation of culturally relevant computer science learning activities for young children. The project includes a two-week computational making and inquiry institute focused on algorithms and data in the context of citizen science and historical storytelling. The project also includes monthly classroom coaching sessions, and teacher meetups.

The research will include two cohorts of 15 PK-2 teachers recruited from the San Marcos Consolidated Independent School District (SMCISD) in years one and two of the project. The project incorporates a 3-phase professional development program to be run in two cycles for each cohort of teachers. Phase one (summer) includes a 2-week Computational Making and Inquiry Institute, phase two (school year) includes classroom observations and teacher meetups and phase three (late spring) includes an advanced computational thinking institute and a community education conference. Research and data collection on impacts will follow a mixed-methods approach based on a grounded theory design to document teachers learning. The mixed-methods approach will enable researchers to triangulate participants' acquisition of new knowledge and skills with their developing abilities to implement learning activities in practice. Data analysis will be ongoing, interweaving qualitative and quantitative methods. Qualitative data, including field notes, observations, interviews, and artifact assessments, will be analyzed by identifying analytical categories and their relationships. Quantitative data includes pre to post surveys administered at three-time points for each cohort. Inter-item correlations and scale reliabilities will be examined, and a repeated measures ANOVA will be used to assess mean change across time for each of five measures. Project results will be communicated via peer-reviewed journals, education newsletters, annual conferences, family and teacher meetups, and community art and culture events, as well as on social media, blogs, and education databases.

Place-Based Learning for Elementary Science at Scale (PeBLES2)

To support equitable access to place-based science learning opportunities, Maine Mathematics and Science Alliance in collaboration with BSCS Science Learning, will develop and test a model to support 3rd-5th grade teachers in incorporating locally or culturally relevant place-based phenomena into rigorously tested curricular units that meet the expectations of the NGSS. The project team will develop two units that could be used in any region across the country with built-in opportunities and embedded supports for teachers to purposefully adapt curriculum to include local phenomena.

Award Number: 
2009613
Funding Period: 
Fri, 05/15/2020 to Tue, 04/30/2024
Full Description: 

This project investigates how to design instructional resources and supporting professional learning that value rigor and standardization while at the same time creating experiences that help students understand their worlds by connecting to local phenomena, communities, and cultures. Currently, many instructional materials designed for widespread use do not connect to local phenomena, while units that do incorporate local phenomena are often developed from the ground up by community members, requiring extensive time and resources.  To support equitable access to place-based science learning opportunities, the Maine Mathematics and Science Alliance in collaboration with BSCS Science Learning, will develop and test a model to support 3rd-5th grade teachers in incorporating locally or culturally relevant place-based phenomena into rigorously tested units that meet the expectations of the Next Generation Science Standards (NGSS). The project team will develop two units and associated professional learning that could be used in any region across the country with built-in opportunities for teachers to purposefully adapt curriculum to include local phenomena.

A design based research approach will be used to: 1) iteratively design, test, and revise, two locally adaptable instructional resource packages for Grades 3-5 science; 2) examine how teachers apply unit resources and professional learning experiences to incorporate local phenomena into the curriculum and their teaching; and 3) examine how the process of curriculum adaptation can support teacher understanding of the science ideas and phenomena within the units, teacher agency and self-efficacy beliefs in science teaching, and student perceptions of relevance and interest in science learning. Participating teachers will range from rural and urban settings in California, Colorado, and Maine. Data sources will include instructional logs, teacher surveys, and student electronic exit tickets from 50 classrooms per unit as well as teacher interviews, classroom observations, and student focus groups from six exemplar case study teachers per unit. Evaluation of the project will focus on monitoring the (1) quality of the research and development components, (2) quality of program implementation to inform program improvement and future implementation, and (3) potential of scaling up the program to other sites and organizations. The design and research from this project will advance the field’s knowledge about how to design instructional materials and professional learning experiences that meet the expectations of the NGSS while also empowering teachers to adapt materials in productive ways, drawing on locally or culturally relevant phenomena.

Developing a Suite of Standards-based Instructionally Supportive Tools for Middle School Computer Science

This project will develop a set of educative resources, assessment tools and teacher professional development (PD) activities to support teachers in developing knowledge of CS standards and improving their instructional pedagogy. Teachers will learn to use formative assessments related to these standards to determine student understanding. Improved CS instruction that is responsive to the needs and challenges of the student population is particularly critical in school districts with a large population of students who are typically underserved and under-represented in computer science.

Lead Organization(s): 
Award Number: 
2010591
Funding Period: 
Fri, 05/15/2020 to Sun, 04/30/2023
Full Description: 

As computing has become an integral part of the world and the workforce, demand for computer science (CS) education in K-12 classrooms is growing. States and school districts in the U.S. are increasing CS course offerings, increasing the need for teachers with CS content and teaching knowledge. However, many CS teachers are not originally certified to teach computer science and often lack the necessary tools, resources, and training. This project will develop a set of educative resources, assessment tools and teacher professional development (PD) activities to support teachers in developing knowledge of CS standards and improving their instructional pedagogy. Teachers will learn to use formative assessments related to these standards to determine student understanding. Improved CS instruction that is responsive to the needs and challenges of the student population is particularly critical in school districts with a large population of students who are typically underserved and under-represented in computer science. The project, a partnership between SRI International and the Milwaukee Public School District, will provide professional development experiences tied to standards instead of a specific curriculum in order to support diverse teachers teaching a variety of computer science curricula using different programming languages. Teachers will receive training via a combination of virtual webinars and face-to-face instruction. Teachers will have opportunities to evaluate their own teaching and measure their students' progress towards the standards.

The research will examine how these teacher professional development activities can help improve CS content and pedagogical knowledge for teachers. The team will use a mixed-methods design to answer three research questions: 1) How can CS standards-aligned educative instructional supports be designed to be informative and useful to middle school CS teachers using different CS curricula and what professional development (PD) do teachers need to be able to use and benefit from these educative instructional supports? 2) What are the different ways in which teachers adapt and use the standards-aligned educative resources and instructionally supportive CS assessment tools in their CS classes? 3) How can standards-aligned instructional supports and teacher PD improve middle school teachers' CS pedagogical content knowledge and improve their implementation of standards-aligned CS instruction? To answer research question one, the team will use an Evidence-Centered Design approach to systematically unpack each standard and develop aligned instructionally supportive assessments and scoring guides. Data analysis for research question one includes qualitative analysis of student cognitive interviews to determine students' proficiencies and challenges, analysis of teacher PD surveys, inter-rater reliability analysis of teacher and researcher scores on assessments, psychometric analysis of student responses for reliability and validity evidence, analysis of classroom observations of teachers responding to data from assessments, and analysis of teacher interviews providing feedback on the usefulness of the PD provided and the assessment tasks and scoring guides that have been developed. For research questions two and three, the project will collect and analyze data from multiple sources, including teacher interviews, classroom observations, teacher PCK (pedagogical content knowledge) surveys, and teacher logs to determine the impacts of the project. Data analysis for questions two and three will include analysis of shifts in teacher PCK between the start of year two and the end of year three, qualitative analysis of observations of teachers' instructional practices, and analysis of teacher interviews reflecting on individual formative assessment practices and decisions. The project will recruit 16 teachers of varying experience levels. Additionally, upto 450 middle school students will be recruited with a significant number of female, African-American, and Hispanic students represented in the sample. Project evaluation will examine the overall achievement of program goals and objectives. Project results will be disseminated widely at national conferences and through submissions to refereed journals. The project resources and instructionally supportive tools including PD Webinars will be made available online to school districts and teachers.

The Discovery Research preK-12 program (DRK-12) seeks to significantly enhance the learning and teaching of science, technology, engineering and mathematics (STEM) by preK-12 students and teachers, through research and development of innovative resources, models and tools. Projects in the DRK-12 program build on fundamental research in STEM education and prior research and development efforts that provide theoretical and empirical justification for proposed projects.

This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

Pages

Subscribe to Mixed Methods