Assessment

STEM Curriculum Development and Implementation

Review of the recent literature on integrated STEM curriculum development and implementation. Included are frameworks for integrated STEM curriculum development and research assessments to evaluate curriculum quality. Details and examples from a large integrated STEM research project in the United States are included. The paper concludes with a call for future research related to STEM curriculum implementation, including the need for new observation protocols.

Author/Presenter

Gillian H. Roehrig

Emily A. Dare

Jenna R. Wieselmann

Elizabeth A. Ring-Whalen

Year
2023
Short Description

Review of the recent literature on integrated STEM curriculum development and implementation. Included are frameworks for integrated STEM curriculum development and research assessments to evaluate curriculum quality. Details and examples from a large integrated STEM research project in the United States are included. The paper concludes with a call for future research related to STEM curriculum implementation, including the need for new observation protocols.

Investigating the Presence of Mathematics and the Levels of Cognitively Demanding Mathematical Tasks in Integrated STEM Units

Effective K-12 integrated STEM education should reflect an intentional effort to adequately represent and facilitate each of its component disciplines in a meaningful way. However, most research in this space has been conducted within the context of science classrooms, ignoring mathematics. Also missing from the literature is research that examines the level of cognitive demand required from mathematical tasks present within integrated STEM lessons.

Author/Presenter

Elizabeth N. Forde

Latanya Robinson

Joshua A. Ellis

Emily A. Dare

Year
2023
Short Description

Effective K-12 integrated STEM education should reflect an intentional effort to adequately represent and facilitate each of its component disciplines in a meaningful way. However, most research in this space has been conducted within the context of science classrooms, ignoring mathematics. Also missing from the literature is research that examines the level of cognitive demand required from mathematical tasks present within integrated STEM lessons. In order to seek insight pertaining to this gap in the literature, we sought to better understand how science teachers use mathematics within K-12 integrated STEM instruction.

Investigating the Presence of Mathematics and the Levels of Cognitively Demanding Mathematical Tasks in Integrated STEM Units

Effective K-12 integrated STEM education should reflect an intentional effort to adequately represent and facilitate each of its component disciplines in a meaningful way. However, most research in this space has been conducted within the context of science classrooms, ignoring mathematics. Also missing from the literature is research that examines the level of cognitive demand required from mathematical tasks present within integrated STEM lessons.

Author/Presenter

Elizabeth N. Forde

Latanya Robinson

Joshua A. Ellis

Emily A. Dare

Year
2023
Short Description

Effective K-12 integrated STEM education should reflect an intentional effort to adequately represent and facilitate each of its component disciplines in a meaningful way. However, most research in this space has been conducted within the context of science classrooms, ignoring mathematics. Also missing from the literature is research that examines the level of cognitive demand required from mathematical tasks present within integrated STEM lessons. In order to seek insight pertaining to this gap in the literature, we sought to better understand how science teachers use mathematics within K-12 integrated STEM instruction.

Investigating the Presence of Mathematics and the Levels of Cognitively Demanding Mathematical Tasks in Integrated STEM Units

Effective K-12 integrated STEM education should reflect an intentional effort to adequately represent and facilitate each of its component disciplines in a meaningful way. However, most research in this space has been conducted within the context of science classrooms, ignoring mathematics. Also missing from the literature is research that examines the level of cognitive demand required from mathematical tasks present within integrated STEM lessons.

Author/Presenter

Elizabeth N. Forde

Latanya Robinson

Joshua A. Ellis

Emily A. Dare

Year
2023
Short Description

Effective K-12 integrated STEM education should reflect an intentional effort to adequately represent and facilitate each of its component disciplines in a meaningful way. However, most research in this space has been conducted within the context of science classrooms, ignoring mathematics. Also missing from the literature is research that examines the level of cognitive demand required from mathematical tasks present within integrated STEM lessons. In order to seek insight pertaining to this gap in the literature, we sought to better understand how science teachers use mathematics within K-12 integrated STEM instruction.

Design Considerations for a Middle School Computer Science Pedagogical Content Knowledge Instrument

K- 12 Computer Science (CS) education is developing rapidly but still lacks a comprehensive measure for CS teachers’ pedagogical content knowledge (PCK) . We respond to this need by describing the design of a CS-PCK instrument for ‘Algorithms and Programming’ that measures three broad constructs: (a) teachers’ understanding of standards and standards-alignment, (b) teachers’ formative assessment practices, and (c) teachers’ self-efficacy for teaching and assessing CS.

Author/Presenter

Satabdi Basu

Daisy Rutstein

Carol Tate

Arif Rachmatullah

Hui Yang

Lead Organization(s)
Year
2022
Short Description

K- 12 Computer Science (CS) education is developing rapidly but still lacks a comprehensive measure for CS teachers’ pedagogical content knowledge (PCK). We respond to this need by describing the design of a CS-PCK instrument for ‘Algorithms and Programming’ that measures three broad constructs: (a) teachers’ understanding of standards and standards-alignment, (b) teachers’ formative assessment practices, and (c) teachers’ self-efficacy for teaching and assessing CS.

Standards-Aligned Instructional Supports to Promote Computer Science Teachers' Pedagogical Content Knowledge

The rapid expansion of K-12 CS education has made it critical to support CS teachers, many of whom are new to teaching CS, with the necessary resources and training to strengthen their understanding of CS concepts and how to effectively teach CS. CS teachers are often tasked with teaching different curricula using different programming languages in different grades or during different school years, and tend to receive different professional development (PD) for each curriculum they are required to teach.

Author/Presenter
Satabdi Basu

Daisy Rutstein

Carol Tate

Arif Rachmatullah

Hui Yang

Lead Organization(s)
Year
2022
Short Description

This position paper advocates supporting CS teacher professional learning by supplementing existing curriculum-specific teacher PD with standards-aligned PD that focuses on teachers' conceptual understanding of CS standards and ability to adapt instruction based on student understanding of concepts underlying the CS standards.

Unpacking Response Process Issues Encountered When Developing a Mathematics Teachers’ Pedagogical Content Knowledge (PCK) Assessment

It is essential for items in assessments of mathematics’ teacher knowledge to evoke the desired response processes – to be interpreted and responded to by teachers as intended by item developers. In this study, we sought to unpack evidence that middle school mathematics teachers were not consistently interacting as intended with constructed response (i.e. open-ended) items designed to assess their pedagogical content knowledge (PCK).

Author/Presenter

Martha L. Epstein

Hamza Malik

Kun Wang

Chandra H. Orrill

Year
2023
Short Description

It is essential for items in assessments of mathematics’ teacher knowledge to evoke the desired response processes – to be interpreted and responded to by teachers as intended by item developers. In this study, we sought to unpack evidence that middle school mathematics teachers were not consistently interacting as intended with constructed response (i.e. open-ended) items designed to assess their pedagogical content knowledge (PCK).

Finding the Right Grain-Size for Measurement in the Classroom

This article introduces a new framework for articulating how educational assessments can be related to teacher uses in the classroom. It articulates three levels of assessment: macro (use of standardized tests), meso (externally developed items), and micro (on-the-fly in the classroom). The first level is the usual context for educational measurement, but one of the contributions of this article is that it mainly focuses on the latter two levels.

Author/Presenter

Mark Wilson

Year
2023
Short Description

This article introduces a new framework for articulating how educational assessments can be related to teacher uses in the classroom. It articulates three levels of assessment: macro (use of standardized tests), meso (externally developed items), and micro (on-the-fly in the classroom).

Examining How Using Dichotomous and Partial Credit Scoring Models Influence Sixth-Grade Mathematical Problem-Solving Assessment Outcomes

Determining the most appropriate method of scoring an assessment is based on multiple factors, including the intended use of results, the assessment's purpose, and time constraints. Both the dichotomous and partial credit models have their advantages, yet direct comparisons of assessment outcomes from each method are not typical with constructed response items. The present study compared the impact of both scoring methods on the internal structure and consequential validity of a middle-grades problem-solving assessment called the problem solving measure for grade six (PSM6).

Author/Presenter

Toni A. May

Kristin L. K. Koskey

Jonathan D. Bostic

Gregory E. Stone

Lance M. Kruse

Gabriel Matney

Year
2023
Short Description

Determining the most appropriate method of scoring an assessment is based on multiple factors, including the intended use of results, the assessment's purpose, and time constraints. Both the dichotomous and partial credit models have their advantages, yet direct comparisons of assessment outcomes from each method are not typical with constructed response items. The present study compared the impact of both scoring methods on the internal structure and consequential validity of a middle-grades problem-solving assessment called the problem solving measure for grade six (PSM6).

Examining How Using Dichotomous and Partial Credit Scoring Models Influence Sixth-Grade Mathematical Problem-Solving Assessment Outcomes

Determining the most appropriate method of scoring an assessment is based on multiple factors, including the intended use of results, the assessment's purpose, and time constraints. Both the dichotomous and partial credit models have their advantages, yet direct comparisons of assessment outcomes from each method are not typical with constructed response items. The present study compared the impact of both scoring methods on the internal structure and consequential validity of a middle-grades problem-solving assessment called the problem solving measure for grade six (PSM6).

Author/Presenter

Toni A. May

Kristin L. K. Koskey

Jonathan D. Bostic

Gregory E. Stone

Lance M. Kruse

Gabriel Matney

Year
2023
Short Description

Determining the most appropriate method of scoring an assessment is based on multiple factors, including the intended use of results, the assessment's purpose, and time constraints. Both the dichotomous and partial credit models have their advantages, yet direct comparisons of assessment outcomes from each method are not typical with constructed response items. The present study compared the impact of both scoring methods on the internal structure and consequential validity of a middle-grades problem-solving assessment called the problem solving measure for grade six (PSM6).