Assessment

Developing and Using a Scalable Assessment to Measure Preservice Elementary Teachers' Ccontent Knowledge for Teaching About Matter

There is strong agreement in science teacher education of the importance of teachers' content knowledge for teaching (CKT), which includes their subject matter knowledge and their pedagogical content knowledge. However, there are limited instruments that can be easily administered and scored on a large scale to assess and study elementary science teachers' CKT.

Author/Presenter

Katherine E. Castellano

Jamie N. Mikeska

Lead Organization(s)
Year
2023
Short Description

There is strong agreement in science teacher education of the importance of teachers' content knowledge for teaching (CKT), which includes their subject matter knowledge and their pedagogical content knowledge. However, there are limited instruments that can be easily administered and scored on a large scale to assess and study elementary science teachers' CKT. Such measures would support strategic monitoring of large groups of science teachers' CKT and the investigation of comparative questions about science teachers' CKT longitudinally across the professional continuum or across teacher education or professional development sites. To address this gap, this study focused on designing an automatically scorable summative assessment that can be used to measure preservice elementary teachers' (PSETs') CKT in one high-leverage science content area: matter and its interactions.

Engaging Hearts and Minds in Assessment and Validation Research

Bostic, J. (2023). Engaging hearts and minds in assessment research. School Science and Mathematics Journal, 123(6), 217-219. https://doi.org/10.1111/ssm.12621

Author/Presenter

Jonathan D. Bostic

Lead Organization(s)
Year
2023
Short Description

A School Science and Mathematics Journal editorial.

Engaging Hearts and Minds in Assessment and Validation Research

Bostic, J. (2023). Engaging hearts and minds in assessment research. School Science and Mathematics Journal, 123(6), 217-219. https://doi.org/10.1111/ssm.12621

Author/Presenter

Jonathan D. Bostic

Lead Organization(s)
Year
2023
Short Description

A School Science and Mathematics Journal editorial.

Engaging Hearts and Minds in Assessment and Validation Research

Bostic, J. (2023). Engaging hearts and minds in assessment research. School Science and Mathematics Journal, 123(6), 217-219. https://doi.org/10.1111/ssm.12621

Author/Presenter

Jonathan D. Bostic

Lead Organization(s)
Year
2023
Short Description

A School Science and Mathematics Journal editorial.

Engaging Hearts and Minds in Assessment and Validation Research

Bostic, J. (2023). Engaging hearts and minds in assessment research. School Science and Mathematics Journal, 123(6), 217-219. https://doi.org/10.1111/ssm.12621

Author/Presenter

Jonathan D. Bostic

Lead Organization(s)
Year
2023
Short Description

A School Science and Mathematics Journal editorial.

Applying Rasch Measurement to Assess Knowledge-in-Use in Science Education

This study applied the many-facet Rasch measurement (MFRM) to assess students’ knowledge-in-use in middle school physical science. 240 students completed three knowledge-in-use classroom assessment tasks on an online platform. We developed transformable scoring rubrics to score students’ responses, including a task-generic polytomous rubric (applicable to the three tasks), a task-specific polytomous rubric (for each task), and a task-specific dichotomous rubric (for each task). Three qualified raters scored 240 students’ responses to the three tasks.

Author/Presenter

Peng He

Xiaoming Zhai

Namsoo Shin

Joseph Krajcik

Lead Organization(s)
Year
2023
Short Description

This study applied the many-facet Rasch measurement (MFRM) to assess students’ knowledge-in-use in middle school physical science.

Reasoning About Data in Elementary School: Student Strategies and Strengths when Reasoning with Multiple Variables

The need for data literacy is an increasingly pressing priority in society, but most of the work in data-centred education has focused on developing skills at the middle school, secondary, and post-secondary levels, with little attention on the potential for engaging elementary-aged students in reasoning with and about data. This paper reports findings from a foundational study to explore the natural strengths, skills, and strategies that upper elementary students bring to reasoning about data-centred problems.

Author/Presenter

Jessica Sickler

Michelle Lentzner

Lynn T. Goldsmith

Lauren Brase

Randall Kochevar

Year
2024
Short Description

The need for data literacy is an increasingly pressing priority in society, but most of the work in data-centred education has focused on developing skills at the middle school, secondary, and post-secondary levels, with little attention on the potential for engaging elementary-aged students in reasoning with and about data. This paper reports findings from a foundational study to explore the natural strengths, skills, and strategies that upper elementary students bring to reasoning about data-centred problems.

Reasoning About Data in Elementary School: Student Strategies and Strengths when Reasoning with Multiple Variables

The need for data literacy is an increasingly pressing priority in society, but most of the work in data-centred education has focused on developing skills at the middle school, secondary, and post-secondary levels, with little attention on the potential for engaging elementary-aged students in reasoning with and about data. This paper reports findings from a foundational study to explore the natural strengths, skills, and strategies that upper elementary students bring to reasoning about data-centred problems.

Author/Presenter

Jessica Sickler

Michelle Lentzner

Lynn T. Goldsmith

Lauren Brase

Randall Kochevar

Year
2024
Short Description

The need for data literacy is an increasingly pressing priority in society, but most of the work in data-centred education has focused on developing skills at the middle school, secondary, and post-secondary levels, with little attention on the potential for engaging elementary-aged students in reasoning with and about data. This paper reports findings from a foundational study to explore the natural strengths, skills, and strategies that upper elementary students bring to reasoning about data-centred problems.

Multidimensional Science Assessment: Design Challenges and Technology Affordances

Contemporary views on what students should learn increasingly emphasize that students need to acquire more than a base of knowledge; they need to acquire the skills and abilities to use such knowledge in dynamic and flexible ways. To be most effective, learning environments need assessments that are aligned to these perspectives. Using a principled design framework can help guide assessment development toward such targets. Even when using a framework, however, thorny design challenges may arise.

Author/Presenter

Brian D. Gane

Diksha Gaur

Samuel Arnold

Daniel Damelin

Lead Organization(s)
Year
2024
Short Description

In this paper, we describe three challenges (conflict between multiple dimensions of science proficiency, authentic data, and grade-appropriate graphing tools) that we faced when designing for a specific Next Generation Science Standard, and the theoretical and design principles that guided us as we ideated design solutions. Through these designs we maintained alignment to our multidimensional assessment targets, a critical component of our larger assessment validity argument.

Multidimensional Science Assessment: Design Challenges and Technology Affordances

Contemporary views on what students should learn increasingly emphasize that students need to acquire more than a base of knowledge; they need to acquire the skills and abilities to use such knowledge in dynamic and flexible ways. To be most effective, learning environments need assessments that are aligned to these perspectives. Using a principled design framework can help guide assessment development toward such targets. Even when using a framework, however, thorny design challenges may arise.

Author/Presenter

Brian D. Gane

Diksha Gaur

Samuel Arnold

Daniel Damelin

Lead Organization(s)
Year
2024
Short Description

In this paper, we describe three challenges (conflict between multiple dimensions of science proficiency, authentic data, and grade-appropriate graphing tools) that we faced when designing for a specific Next Generation Science Standard, and the theoretical and design principles that guided us as we ideated design solutions. Through these designs we maintained alignment to our multidimensional assessment targets, a critical component of our larger assessment validity argument.