Mixed Methods

Design and Development of a K-12 STEM Observation Protocol (Collaborative Research: Roehrig)

This project will design and develop a new K-12 classroom observation protocol for integrated STEM instruction (STEM-OP). The STEM-OP will inform the instruction of integrated STEM in many contexts with the goal of improving integrated STEM education.

Award Number: 
1813342
Funding Period: 
Sat, 09/01/2018 to Wed, 08/31/2022
Full Description: 

This project will design and develop a new K-12 classroom observation protocol for integrated STEM instruction (STEM-OP). The STEM-OP will be developed for use in K-12 STEM settings. While the importance of integrated STEM education is established, there remains disagreement on models and effective approaches for integrated STEM instruction. This issue is confounded by the lack of observation protocols sensitive to integrated STEM teaching and learning to inform research to the effectiveness of new models and strategies. Existing instruments were not developed for use in integrated STEM learning environments. The STEM-OP will be designed to be used effectively by multiple stakeholders in a variety of contexts. Researchers will benefit from having the STEM-OP available for them to carry out research and continue to improve STEM education in a variety of ways. Existing instruments were not developed for use in integrated STEM learning environments.  The STEM-OP and associated training materials will be available for use by other education stakeholders, such as K-12 teachers and district administrators, through a publicly available online platform. In brief, the STEM-OP will inform the instruction of integrated STEM in many contexts with the goal of improving integrated STEM education.

The primary product of this project is the new observation protocol called STEM-OP for K-12 classrooms implementing integrated STEM lessons. The project will use over 500 integrated STEM classroom videos to design the STEM-OP. Using exploratory and confirmatory factor analysis, the STEM-OP will be a valid and reliable instrument for use in a variety of educational contexts. The research will explore the different ways that elementary, middle, and high school science teachers enact integrated STEM instruction. This study will shed light on the nature of STEM instruction in each of these grade bands and provide information building towards an understanding of learning progressions for engineering practices across grade bands. Research exploring how the nature of STEM integration changes from day to day over the course of a unit will provide critical information about the different sequencing and trajectories of STEM units. Examining how integrated STEM instruction unfolds over a full unit of instruction will inform the understanding of integrated STEM practices at both micro- and macro- levels of analysis. The STEM-OP and associated training materials will be available for use by other education stakeholders, such as K-12 teachers and district administrators, through a publicly available, which will be distributed via a publicly available, online platform that includes a training manual and classroom video for practice scoring.

Design and Development of a K-12 STEM Observation Protocol (Collaborative Research: Dare)

This project will design and develop a new K-12 classroom observation protocol for integrated STEM instruction (STEM-OP). The STEM-OP will inform the instruction of integrated STEM in many contexts with the goal of improving integrated STEM education.

Lead Organization(s): 
Award Number: 
1854801
Funding Period: 
Sat, 09/01/2018 to Wed, 08/31/2022
Full Description: 

This project will design and develop a new K-12 classroom observation protocol for integrated STEM instruction (STEM-OP). The STEM-OP will be developed for use in K-12 STEM settings. While the importance of integrated STEM education is established, there remains disagreement on models and effective approaches for integrated STEM instruction. This issue is confounded by the lack of observation protocols sensitive to integrated STEM teaching and learning to inform research to the effectiveness of new models and strategies. Existing instruments were not developed for use in integrated STEM learning environments. The STEM-OP will be designed to be used effectively by multiple stakeholders in a variety of contexts. Researchers will benefit from having the STEM-OP available for them to carry out research and continue to improve STEM education in a variety of ways. Existing instruments were not developed for use in integrated STEM learning environments.  The STEM-OP and associated training materials will be available for use by other education stakeholders, such as K-12 teachers and district administrators, through a publicly available online platform. In brief, the STEM-OP will inform the instruction of integrated STEM in many contexts with the goal of improving integrated STEM education.

The primary product of this project is the new observation protocol called STEM-OP for K-12 classrooms implementing integrated STEM lessons. The project will use over 500 integrated STEM classroom videos to design the STEM-OP. Using exploratory and confirmatory factor analysis, the STEM-OP will be a valid and reliable instrument for use in a variety of educational contexts. The research will explore the different ways that elementary, middle, and high school science teachers enact integrated STEM instruction. This study will shed light on the nature of STEM instruction in each of these grade bands and provide information building towards an understanding of learning progressions for engineering practices across grade bands. Research exploring how the nature of STEM integration changes from day to day over the course of a unit will provide critical information about the different sequencing and trajectories of STEM units. Examining how integrated STEM instruction unfolds over a full unit of instruction will inform the understanding of integrated STEM practices at both micro- and macro- levels of analysis. The STEM-OP and associated training materials will be available for use by other education stakeholders, such as K-12 teachers and district administrators, through a publicly available, which will be distributed via a publicly available, online platform that includes a training manual and classroom video for practice scoring.

Design and Development of a K-12 STEM Observation Protocol (Collaborative Research: Ring-Whalen)

This project will design and develop a new K-12 classroom observation protocol for integrated STEM instruction (STEM-OP). The STEM-OP will inform the instruction of integrated STEM in many contexts with the goal of improving integrated STEM education.

Lead Organization(s): 
Award Number: 
1812794
Funding Period: 
Sat, 09/01/2018 to Wed, 08/31/2022
Full Description: 

This project will design and develop a new K-12 classroom observation protocol for integrated STEM instruction (STEM-OP). The STEM-OP will be developed for use in K-12 STEM settings. While the importance of integrated STEM education is established, there remains disagreement on models and effective approaches for integrated STEM instruction. This issue is confounded by the lack of observation protocols sensitive to integrated STEM teaching and learning to inform research to the effectiveness of new models and strategies. Existing instruments were not developed for use in integrated STEM learning environments. The STEM-OP will be designed to be used effectively by multiple stakeholders in a variety of contexts. Researchers will benefit from having the STEM-OP available for them to carry out research and continue to improve STEM education in a variety of ways. Existing instruments were not developed for use in integrated STEM learning environments.  The STEM-OP and associated training materials will be available for use by other education stakeholders, such as K-12 teachers and district administrators, through a publicly available online platform. In brief, the STEM-OP will inform the instruction of integrated STEM in many contexts with the goal of improving integrated STEM education.

The primary product of this project is the new observation protocol called STEM-OP for K-12 classrooms implementing integrated STEM lessons. The project will use over 500 integrated STEM classroom videos to design the STEM-OP. Using exploratory and confirmatory factor analysis, the STEM-OP will be a valid and reliable instrument for use in a variety of educational contexts. The research will explore the different ways that elementary, middle, and high school science teachers enact integrated STEM instruction. This study will shed light on the nature of STEM instruction in each of these grade bands and provide information building towards an understanding of learning progressions for engineering practices across grade bands. Research exploring how the nature of STEM integration changes from day to day over the course of a unit will provide critical information about the different sequencing and trajectories of STEM units. Examining how integrated STEM instruction unfolds over a full unit of instruction will inform the understanding of integrated STEM practices at both micro- and macro- levels of analysis. The STEM-OP and associated training materials will be available for use by other education stakeholders, such as K-12 teachers and district administrators, through a publicly available, which will be distributed via a publicly available, online platform that includes a training manual and classroom video for practice scoring.

Design and Development of Transmedia Narrative-based Curricula to Engage Children in Scientific Thinking and Engineering Design (Collaborative Research: Ellis)

This project will address the need for engineering resources by applying an innovative pedagogy called Imaginative Education (IE) to create middle school engineering curricula. In IE, developmentally appropriate narratives are used to design learning environments that help learners engage with content and organize their knowledge productively. This project will combine IE with transmedia storytelling.

Lead Organization(s): 
Award Number: 
1814033
Funding Period: 
Sun, 07/15/2018 to Thu, 06/30/2022
Full Description: 

Engineering is an important component of the Next Generation Science Standards (NGSS). However, resources for supporting teachers in implementing these standards are scarce. This project will address the need for resources by applying an innovative pedagogy called Imaginative Education (IE) to create middle school engineering curricula. In IE, developmentally appropriate narratives are used to design learning environments that help learners engage with content and organize their knowledge productively. To fully exploit the potential of this pedagogy, this project will combine IE with transmedia storytelling. In transmedia storytelling, different elements of a narrative are spread across a variety of formats (such as books, websites, new articles, videos and other media) in a way that creates a coordinated experience for the user. Once created, the curricula will be implemented in classrooms to research its impact on (1) increasing learners' capacities to engage in both innovative and direct application of engineering concepts, and (2) improving learners' science, technology, engineering, and mathematics (STEM) identity. 

This research will be led by Smith College and Springfield Technical Community College in collaboration with Springfield (MA) Public Schools (SPS). Additional expertise in evaluating the findings will be provided by the Collaborative for Educational Services and an external advisory board of leaders in STEM education and transmedia storytelling. The project will result in the development of a transmedia learning environment that includes two NGSS-aligned, interdisciplinary engineering units and seven lessons that integrate science and engineering. The research study will be implemented in four phases in eight SPS middle schools. Approximately 900 students will participate each year. In Phase 1, the project team will collaborate with SPS teachers to create engineering units, lessons, and standards-based achievement measures. In Phase 2, teachers in the treatment group will participate in professional development (PD) workshops covering IE, transmedia learning environments, structure of the curriculum, and connections to NGSS. In Phase 3 the curricula will be implemented in treatment classrooms and both treatment and control group students will be assessed. In Phase 4, testing and assessment will continue in SPS schools and will be expanded to rural and suburban classrooms. Teachers in these classrooms will use online multimedia PD that will ensure scalability and mirrors the structure and content of in-person PD. Data analysis will provide evidence of whether this imaginative and transmedia educational approach improves students' capacities for using engineering concepts and enhances their STEM identity.


Project Videos

2020 STEM for All Video Showcase

Title: Transforming Engineering Education for Middle Schools (TEEMS)

Presenter(s): Isabel Huff, Kaia Cormier, Glenn Ellis, Sonia Ellis, Crystal Ford, Kate Lytton, Becky Mazur, Beth McGinnis-Cavanaugh, Jeremy Pina, & Al Rudnitsky

2019 STEM for All Video Showcase

Title: Transforming Engineering Education for Middle School (TEEMS)

Presenter(s): Beth McGinnis-Cavanaugh, Sonia Ellis, & Crystal Ford


Design and Development of Transmedia Narrative-based Curricula to Engage Children in Scientific Thinking and Engineering Design (Collaborative Research: McGinnis-Cavanaugh)

This project will address the need for engineering resources by applying an innovative pedagogy called Imaginative Education (IE) to create middle school engineering curricula. In IE, developmentally appropriate narratives are used to design learning environments that help learners engage with content and organize their knowledge productively. This project will combine IE with transmedia storytelling.

Partner Organization(s): 
Award Number: 
1813572
Funding Period: 
Sun, 07/15/2018 to Thu, 06/30/2022
Project Evaluator: 
Collaborative for Educational Services (CES)
Full Description: 

Engineering is an important component of the Next Generation Science Standards (NGSS). However, resources for supporting teachers in implementing these standards are scarce. This project will address the need for resources by applying an innovative pedagogy called Imaginative Education (IE) to create middle school engineering curricula. In IE, developmentally appropriate narratives are used to design learning environments that help learners engage with content and organize their knowledge productively. To fully exploit the potential of this pedagogy, this project will combine IE with transmedia storytelling. In transmedia storytelling, different elements of a narrative are spread across a variety of formats (such as books, websites, new articles, videos and other media) in a way that creates a coordinated experience for the user. Once created, the curricula will be implemented in classrooms to research its impact on (1) increasing learners' capacities to engage in both innovative and direct application of engineering concepts, and (2) improving learners' science, technology, engineering, and mathematics (STEM) identity. 

This research will be led by Smith College and Springfield Technical Community College in collaboration with Springfield (MA) Public Schools (SPS). Additional expertise in evaluating the findings will be provided by the Collaborative for Educational Services and an external advisory board of leaders in STEM education and transmedia storytelling. The project will result in the development of a transmedia learning environment that includes two NGSS-aligned, interdisciplinary engineering units and seven lessons that integrate science and engineering. The research study will be implemented in four phases in eight SPS middle schools. Approximately 900 students will participate each year. In Phase 1, the project team will collaborate with SPS teachers to create engineering units, lessons, and standards-based achievement measures. In Phase 2, teachers in the treatment group will participate in professional development (PD) workshops covering IE, transmedia learning environments, structure of the curriculum, and connections to NGSS. In Phase 3 the curricula will be implemented in treatment classrooms and both treatment and control group students will be assessed. In Phase 4, testing and assessment will continue in SPS schools and will be expanded to rural and suburban classrooms. Teachers in these classrooms will use online multimedia PD that will ensure scalability and mirrors the structure and content of in-person PD. Data analysis will provide evidence of whether this imaginative and transmedia educational approach improves students' capacities for using engineering concepts and enhances their STEM identity.


Project Videos

2020 STEM for All Video Showcase

Title: Transforming Engineering Education for Middle Schools (TEEMS)

Presenter(s): Isabel Huff, Kaia Cormier, Glenn Ellis, Sonia Ellis, Crystal Ford, Kate Lytton, Becky Mazur, Beth McGinnis-Cavanaugh, Jeremy Pina, & Al Rudnitsky

2019 STEM for All Video Showcase

Title: Transforming Engineering Education for Middle School (TEEMS)

Presenter(s): Beth McGinnis-Cavanaugh, Sonia Ellis, & Crystal Ford


Extending and Investigating the Impact of the High School Model-based Educational Resource (Collaborative Research: Passmore)

This project builds on a line of work that has developed and studied the Model Based Educational Resource (MBER), a year-long curriculum for high school biology. The project will generate rigorous causal evidence on how this approach to biology teaching and learning can support student learning, and foundational information on how to support high school teachers in improving their teaching. It will also provide resources to expand and update MBER to reflect the changing high school science landscape by integrating Earth Science standards into the year long sequence.

Partner Organization(s): 
Award Number: 
1814263
Funding Period: 
Wed, 08/01/2018 to Sun, 07/31/2022
Full Description: 

This project builds on a line of work that has developed and studied the Model Based Educational Resource (MBER), a year-long curriculum for high school biology. In classrooms using MBER, modeling serves as an anchoring practice that keeps the inquiry tied to the goal of making sense of the world, helping teachers to engage their students in a range of cognitive and social activities that lead to deep understanding of scientific ideas. This project will generate rigorous causal evidence on how this approach to biology teaching and learning can support student learning, and foundational information on how to support high school teachers in improving their teaching. This funding will also provide resources to expand and update MBER to reflect the changing high school science landscape by integrating Earth Science standards into the year long sequence. The study will address the general research question: What is the impact of the Model Based Educational Resource (MBER) on high school students' science achievement, and what factors influence that impact? In addition to generating important research findings, the materials revised and studied in this project will be open-source and freely available to teachers and schools.

This study addresses a significant gap in the research on next generation curriculum materials. While there is emerging agreement about the importance of instructional materials in supporting teachers in effectively engaging students in the practices of science, there is very little empirical evidence to support such claims. The goal of this project is to study the impact of the MBER program through a cluster randomized trial and expand the promise of efficacy and feasibility established in previous work. This study will be able to make causal claims by using an experimental design in which 32 high school teachers serve as their own controls, and by using multi-level modeling in the analysis. This study will advance the field's knowledge about the impact of innovative materials on student learning, measured by both project-level assessments and the state science test. Exploratory research questions will examine a) how using the MBER program develops teachers' vision of the Next Generation Science Standards, b) how student learning is mediated by the fidelity of implementation of the materials, c) how teachers interact with materials designed to be modified for their classroom context, and d) to what extent the MBER materials provide equitable opportunities to learn and close achievement gaps.

Strengthening Data Literacy across the Curriculum (SDLC)

This project is developing and studying high school curriculum modules that integrate social justice topics with statistical data investigations to promote skills and interest in data science among underrepresented groups in STEM.

Award Number: 
1813956
Funding Period: 
Sun, 07/01/2018 to Wed, 06/30/2021
Full Description: 

The Strengthening Data Literacy across the Curriculum (SDLC) project is an exploratory/early stage design and development effort that aims to promote understanding of core statistical concepts and interest in quantitative data analysis among high school students from underrepresented groups in STEM. Led by a collaboration of researchers and developers at Education Development Center (EDC), statistics educators at California Polytechnic State University (Cal Poly), and technology developers at The Concord Consortium, the project is creating and studying a set of curriculum modules targeted to high school students who are taking mathematics or statistics classes that are not at advanced-placement (AP) levels. Iteratively developed and tested in collaboration with high school statistics and social studies teachers, the modules consist of applied data investigations structured around a four-step data investigation cycle that engage students in explorations of authentic social science issues using large-scale data sets from the U.S. Census Bureau. The project hypothesizes that students who engage in guided investigations using data visualization tools to explore and visualize statistical concepts may develop deeper understandings of these concepts as well as the data investigation process. Similarly, high school students – particularly those from historically marginalized groups who are underrepresented in STEM fields – may develop greater interest in statistics when they can use data to examine patterns of social and economic inequality and questions related to social justice.

One module, Investigating Income Inequality in the U.S., focuses on describing, comparing, and making sense of quantitative variables. Students deepen their understanding of this content by investigating questions such as: How have incomes for higher- and lower-income individuals in the U.S. changed over time? How much income inequality exists between males and females in the U.S.? Does education explain the wage gap between males and females? Another module, Investigating Immigration to the U.S., focuses on describing, comparing, and making sense of categorical variables. Students investigate questions such as: Are there more immigrants in the U.S. today than in previous years? Where have immigrants to the U.S. come from, now and in the past? Are immigrants as likely as the U.S. born to be participating in the labor force, after adjusting for education? Students conduct these analyses using the Common Online Data Analysis Platform (CODAP), an open-source set of tools that supports data visualization and conceptual understanding of statistical ideas over calculations. Lessons encourage collaborative inquiry and provide students with experiences in multivariable analysis—an important domain that is underemphasized in current high school mathematics and statistics curricula but critical for analyzing data in a big-data world.

The project is using a mixed methods approach to study three primary research questions: 1) What is the feasibility of implementing SDLC modules, and what supports may teachers and students need to use the modules? 2) In what ways may different features and components of the SDLC modules help to promote positive student learning and interest outcomes? 3) To what extent do students show greater interest in statistics and data analysis, as well as improved understandings of target statistical concepts, after module use? To investigate these questions, the project has worked with 12 mathematics and six social studies teachers in diverse public high schools in Massachusetts and California to conduct iterative research with over 600 students. Through this work, the project aims to build knowledge of curriculum-based approaches that prepare and attract more diverse populations to data science fields.

A Practice-based Online Learning Environment for Scientific Inquiry with Digitized Museum Collections in Middle School Classrooms

This project will develop and study a prototype online learning environment that supports student learning via Engaging Practices for Inquiry with Collections in Bioscience (EPIC Bioscience), which uses authentic research investigations with digitized collections from natural history museums. 

Lead Organization(s): 
Award Number: 
1812844
Funding Period: 
Fri, 06/15/2018 to Mon, 05/31/2021
Full Description: 

There are an estimated 2-4 billion specimens in the world's natural history collections that contain the data necessary to address complex global issues, including biodiversity and climate. Digitized natural history collections present an untapped opportunity to engage learners in crucial questions of science with far-reaching potential consequences via object-based research investigations. This project will develop and study a prototype online learning environment that supports student learning via Engaging Practices for Inquiry with Collections in Bioscience (EPIC Bioscience). EPIC Bioscience uses authentic research investigations with digitized collections from natural history museums. The project team will create a curriculum aligned with the Next Generation of Science Standards (NGSS) for middle school students, emphasizing a major disciplinary core idea in grades 6-8 life science, Ecosystems: Interactions, Energy, and Dynamics. The project has three major goals: 1) Develop an online learning environment that guides students through research investigations using digitized natural history collections to teach NGSS life science standards. 2) Investigate how interactive features and conversational scaffolds in the EPIC Bioscience learning environment can promote deeper processing of science content and effective knowledge building. 3) Demonstrate effective approaches to using digitized collections objects for contextualized, research-based science learning that aligns to NGSS standards for middle school classrooms.

The project will examine how and when interactive features of a digital learning environment can be combined with deep questions and effective online scaffolds to promote student engagement, meaningful collaborative discourse, and robust learning outcomes during research with digitized museum collections. Research activities will address: How can interactive features of EPIC Bioscience help students learn disciplinary core ideas and cross cutting concepts via science practices through collections-based research? How can effective patterns of collaborative scientific discourse be supported and enhanced during online, collections-based research? How does the use of digitized scientific collections influence students' levels of engagement and depth of processing during classroom investigations? A significant impact of the proposed work is expanded opportunities for research with authentic museum objects for populations who are traditionally underserved in STEM and are underrepresented in museum visitor demographics (Title I schools, racial/ethnic minorities, and rural school populations). Research activities will engage over 1,500 Title I and rural students (50 classes across three years) in meaningful research investigations with collections objects that address pressing global issues.

Developing and Validating Assessments to Measure and Build Elementary Teachers' Content Knowledge for Teaching about Matter and Its Interactions within Teacher Education Settings (Collaborative Research: Hanuscin)

The fundamental purpose of this project is to examine and gather initial validity evidence for assessments designed to measure and build kindergarten-fifth grade science teachers' content knowledge for teaching (CKT) about matter and its interactions in teacher education settings.

Partner Organization(s): 
Award Number: 
1814275
Funding Period: 
Sun, 07/01/2018 to Thu, 06/30/2022
Full Description: 

This is an Early-Stage Design and Development collaborative effort submitted to the assessment strand of the Discovery Research PreK-12 (DRK-12) Program. Its fundamental purpose is to examine and gather initial validity evidence for assessments designed to measure and build kindergarten-fifth grade science teachers' content knowledge for teaching (CKT) about matter and its interactions in teacher education settings. The selection of this topic will facilitate the development of a proof-of-concept to determine if and how CKT assessments can be developed and used to measure and build elementary teachers' CKT. Also, it will facilitate rapid and targeted refinement of an evidence-centered design process that could be applied to other science topics. Plans are to integrate CKT assessments and related resources into teacher education courses to support the ability of teachers to apply their content knowledge to the work of teaching and learning science. The project will combine efforts from prior projects and engage in foundational research to examine the nature of teachers' CKT and to build theories and hypotheses about the productive use and design of CKT assessment materials to support formative and summative uses. Likewise, the project will create a set of descriptive cases highlighting the use of these tools. Understanding how CKT science assessments can be leveraged as summative tools to evaluate current efforts, and as formative tools to build elementary teachers' specialized, practice-based knowledge will be the central foci of this effort.

The main research questions will be: (1) What is the nature of elementary science teachers' CKT about matter and its interactions?; and (2) How can the development of prospective elementary teachers' CKT be supported within teacher education? To address the research questions, the study will employ a mixed-methods, design-based research approach to gather various sources of validity evidence to support the formative and summative use of the CKT instrument, instructional tasks, and supporting materials. The project will be organized around two main research and development strands. Strand One will build an empirically grounded understanding of the nature of elementary teachers' CKT. Strand Two will focus on developing and studying how CKT instructional tasks can be used formatively within teacher education settings to build elementary teachers' CKT. In addition, the project will refine a conceptual framework that identifies the science-specific teaching practices that comprise the work of teaching science. This will be used as well to assess the CKT that teachers leverage when recognizing, understanding, and responding to the content-intensive practices that they engage in as they teach science. To that end, the study will build on two existing frameworks from prior NSF-funded work. The first was originally developed to create CKT assessments for elementary and middle school teachers in English Language Arts and mathematics. The second focuses on the content challenges that novice elementary science teachers face. It is organized by the instructional tools and practices that elementary science teachers use, such as scientific models and explanations. These instructional practices cut across those addressed in the Next Generation Science Standards' (NGSS; Lead States, 2013) disciplinary strands. The main project's outcomes will be knowledge that builds and refines theories about the nature of elementary teachers' CKT, and how CKT elementary science assessment materials can be designed productively for formative and summative purposes. The project will also result in the development of a suite of valid and reliable assessments that afford interpretations on CKT matter proficiency and can be used to monitor elementary teachers learning. An external advisory board will provide formative and summative feedback on the project's activities and progress.


Project Videos

2020 STEM for All Video Showcase

Title: Building Content Knowledge for Teaching about Matter

Presenter(s): Jamie Mikeska, Emily Borda, Katherine Castellano, Dante Cisterna, Dan Hanley, Debi Hanuscin, & Josie Melton


Developing and Validating Assessments to Measure and Build Elementary Teachers' Content Knowledge for Teaching about Matter and Its Interactions within Teacher Education Settings (Collaborative Research: Mikeska)

The fundamental purpose of this project is to examine and gather initial validity evidence for assessments designed to measure and build kindergarten-fifth grade science teachers' content knowledge for teaching (CKT) about matter and its interactions in teacher education settings.

Lead Organization(s): 
Partner Organization(s): 
Award Number: 
1813254
Funding Period: 
Sun, 07/01/2018 to Thu, 06/30/2022
Full Description: 

This is an Early-Stage Design and Development collaborative effort submitted to the assessment strand of the Discovery Research PreK-12 (DRK-12) Program. Its fundamental purpose is to examine and gather initial validity evidence for assessments designed to measure and build kindergarten-fifth grade science teachers' content knowledge for teaching (CKT) about matter and its interactions in teacher education settings. The selection of this topic will facilitate the development of a proof-of-concept to determine if and how CKT assessments can be developed and used to measure and build elementary teachers' CKT. Also, it will facilitate rapid and targeted refinement of an evidence-centered design process that could be applied to other science topics. Plans are to integrate CKT assessments and related resources into teacher education courses to support the ability of teachers to apply their content knowledge to the work of teaching and learning science. The project will combine efforts from prior projects and engage in foundational research to examine the nature of teachers' CKT and to build theories and hypotheses about the productive use and design of CKT assessment materials to support formative and summative uses. Likewise, the project will create a set of descriptive cases highlighting the use of these tools. Understanding how CKT science assessments can be leveraged as summative tools to evaluate current efforts, and as formative tools to build elementary teachers' specialized, practice-based knowledge will be the central foci of this effort.

The main research questions will be: (1) What is the nature of elementary science teachers' CKT about matter and its interactions?; and (2) How can the development of prospective elementary teachers' CKT be supported within teacher education? To address the research questions, the study will employ a mixed-methods, design-based research approach to gather various sources of validity evidence to support the formative and summative use of the CKT instrument, instructional tasks, and supporting materials. The project will be organized around two main research and development strands. Strand One will build an empirically grounded understanding of the nature of elementary teachers' CKT. Strand Two will focus on developing and studying how CKT instructional tasks can be used formatively within teacher education settings to build elementary teachers' CKT. In addition, the project will refine a conceptual framework that identifies the science-specific teaching practices that comprise the work of teaching science. This will be used as well to assess the CKT that teachers leverage when recognizing, understanding, and responding to the content-intensive practices that they engage in as they teach science. To that end, the study will build on two existing frameworks from prior NSF-funded work. The first was originally developed to create CKT assessments for elementary and middle school teachers in English Language Arts and mathematics. The second focuses on the content challenges that novice elementary science teachers face. It is organized by the instructional tools and practices that elementary science teachers use, such as scientific models and explanations. These instructional practices cut across those addressed in the Next Generation Science Standards' (NGSS; Lead States, 2013) disciplinary strands. The main project's outcomes will be knowledge that builds and refines theories about the nature of elementary teachers' CKT, and how CKT elementary science assessment materials can be designed productively for formative and summative purposes. The project will also result in the development of a suite of valid and reliable assessments that afford interpretations on CKT matter proficiency and can be used to monitor elementary teachers learning. An external advisory board will provide formative and summative feedback on the project's activities and progress.


Project Videos

2020 STEM for All Video Showcase

Title: Building Content Knowledge for Teaching about Matter

Presenter(s): Jamie Mikeska, Emily Borda, Katherine Castellano, Dante Cisterna, Dan Hanley, Debi Hanuscin, & Josie Melton


Pages

Subscribe to Mixed Methods