Assessment

Iterative Cognitive Interview Design to Uncover Children’s Spatial Reasoning

Cognitive interviews play an important role in articulating the intended construct of educational assessments. This paper describes the iterative development of protocols for cognitive interviews with kindergarten through second-grade children to understand how their spatial reasoning skill development aligns with intended constructs. We describe the procedures used to gather evidence of construct relevance and improved alignment to task-based interview items through multiple pilot rounds before conducting cognitive interviews.

Author/Presenter

Elizabeth R. Thomas

Robyn K. Pinilla

Leanne R. Ketterlin-Geller

Cassandra Hatfield

Year
2023
Short Description

Cognitive interviews play an important role in articulating the intended construct of educational assessments. This paper describes the iterative development of protocols for cognitive interviews with kindergarten through second-grade children to understand how their spatial reasoning skill development aligns with intended constructs.

Connecting Classroom Assessment with Learning Goals and Instruction Through Theories of Learning

In this report section, we discuss the importance of aligning classroom assessments with learning goals and instructional practices to both shape and evaluate students’ learning opportunities. We describe a plausible solution for improving alignment by integrating theories of learning in the design of classroom assessments. We discuss ways in which the specification of theories of learning as learning progressions can improve alignment between classroom assessments and instruction by focusing on the content, task design, and data generated from classroom assessments.

Author/Presenter

Leanne R. Ketterlin-Geller

Christopher J. Harris

Year
2023
Short Description

In this report section, we discuss the importance of aligning classroom assessments with learning goals and instructional practices to both shape and evaluate students’ learning opportunities.

Developing and Using a Scalable Assessment to Measure Preservice Elementary Teachers' Ccontent Knowledge for Teaching About Matter

There is strong agreement in science teacher education of the importance of teachers' content knowledge for teaching (CKT), which includes their subject matter knowledge and their pedagogical content knowledge. However, there are limited instruments that can be easily administered and scored on a large scale to assess and study elementary science teachers' CKT.

Author/Presenter

Katherine E. Castellano

Jamie N. Mikeska

Lead Organization(s)
Year
2023
Short Description

There is strong agreement in science teacher education of the importance of teachers' content knowledge for teaching (CKT), which includes their subject matter knowledge and their pedagogical content knowledge. However, there are limited instruments that can be easily administered and scored on a large scale to assess and study elementary science teachers' CKT. Such measures would support strategic monitoring of large groups of science teachers' CKT and the investigation of comparative questions about science teachers' CKT longitudinally across the professional continuum or across teacher education or professional development sites. To address this gap, this study focused on designing an automatically scorable summative assessment that can be used to measure preservice elementary teachers' (PSETs') CKT in one high-leverage science content area: matter and its interactions.

Engaging Hearts and Minds in Assessment and Validation Research

Bostic, J. (2023). Engaging hearts and minds in assessment research. School Science and Mathematics Journal, 123(6), 217-219. https://doi.org/10.1111/ssm.12621

Author/Presenter

Jonathan D. Bostic

Lead Organization(s)
Year
2023
Short Description

A School Science and Mathematics Journal editorial.

Engaging Hearts and Minds in Assessment and Validation Research

Bostic, J. (2023). Engaging hearts and minds in assessment research. School Science and Mathematics Journal, 123(6), 217-219. https://doi.org/10.1111/ssm.12621

Author/Presenter

Jonathan D. Bostic

Lead Organization(s)
Year
2023
Short Description

A School Science and Mathematics Journal editorial.

Engaging Hearts and Minds in Assessment and Validation Research

Bostic, J. (2023). Engaging hearts and minds in assessment research. School Science and Mathematics Journal, 123(6), 217-219. https://doi.org/10.1111/ssm.12621

Author/Presenter

Jonathan D. Bostic

Lead Organization(s)
Year
2023
Short Description

A School Science and Mathematics Journal editorial.

Engaging Hearts and Minds in Assessment and Validation Research

Bostic, J. (2023). Engaging hearts and minds in assessment research. School Science and Mathematics Journal, 123(6), 217-219. https://doi.org/10.1111/ssm.12621

Author/Presenter

Jonathan D. Bostic

Lead Organization(s)
Year
2023
Short Description

A School Science and Mathematics Journal editorial.

Applying Rasch Measurement to Assess Knowledge-in-Use in Science Education

This study applied the many-facet Rasch measurement (MFRM) to assess students’ knowledge-in-use in middle school physical science. 240 students completed three knowledge-in-use classroom assessment tasks on an online platform. We developed transformable scoring rubrics to score students’ responses, including a task-generic polytomous rubric (applicable to the three tasks), a task-specific polytomous rubric (for each task), and a task-specific dichotomous rubric (for each task). Three qualified raters scored 240 students’ responses to the three tasks.

Author/Presenter

Peng He

Xiaoming Zhai

Namsoo Shin

Joseph Krajcik

Lead Organization(s)
Year
2023
Short Description

This study applied the many-facet Rasch measurement (MFRM) to assess students’ knowledge-in-use in middle school physical science.

Reasoning About Data in Elementary School: Student Strategies and Strengths when Reasoning with Multiple Variables

The need for data literacy is an increasingly pressing priority in society, but most of the work in data-centred education has focused on developing skills at the middle school, secondary, and post-secondary levels, with little attention on the potential for engaging elementary-aged students in reasoning with and about data. This paper reports findings from a foundational study to explore the natural strengths, skills, and strategies that upper elementary students bring to reasoning about data-centred problems.

Author/Presenter

Jessica Sickler

Michelle Lentzner

Lynn T. Goldsmith

Lauren Brase

Randall Kochevar

Year
2024
Short Description

The need for data literacy is an increasingly pressing priority in society, but most of the work in data-centred education has focused on developing skills at the middle school, secondary, and post-secondary levels, with little attention on the potential for engaging elementary-aged students in reasoning with and about data. This paper reports findings from a foundational study to explore the natural strengths, skills, and strategies that upper elementary students bring to reasoning about data-centred problems.

Reasoning About Data in Elementary School: Student Strategies and Strengths when Reasoning with Multiple Variables

The need for data literacy is an increasingly pressing priority in society, but most of the work in data-centred education has focused on developing skills at the middle school, secondary, and post-secondary levels, with little attention on the potential for engaging elementary-aged students in reasoning with and about data. This paper reports findings from a foundational study to explore the natural strengths, skills, and strategies that upper elementary students bring to reasoning about data-centred problems.

Author/Presenter

Jessica Sickler

Michelle Lentzner

Lynn T. Goldsmith

Lauren Brase

Randall Kochevar

Year
2024
Short Description

The need for data literacy is an increasingly pressing priority in society, but most of the work in data-centred education has focused on developing skills at the middle school, secondary, and post-secondary levels, with little attention on the potential for engaging elementary-aged students in reasoning with and about data. This paper reports findings from a foundational study to explore the natural strengths, skills, and strategies that upper elementary students bring to reasoning about data-centred problems.