Elementary

Examining Elementary Science Teachers' Responses to Assessments Tasks Designed to Measure Their Content Knowledge for Teaching About Matter and its Interactions

Despite the importance of developing elementary science teachers' content knowledge for teaching (CKT), there are limited assessments that have been designed to measure the full breadth of their CKT at scale. Our overall research project addressed this gap by developing an online assessment to measure elementary preservice teachers' CKT about matter and its interactions. This study, which was part of our larger project, reports on findings from one component of the item development process examining the construct validity of 118 different CKT about matter assessment items.

Author/Presenter

Jamie N. Mikeska

Dante Cisterna

Heena Lakhani

Allison K. Bookbinder

David L. Myers

Luronne Vaval

Lead Organization(s)
Year
2022
Short Description

Despite the importance of developing elementary science teachers' content knowledge for teaching (CKT), there are limited assessments that have been designed to measure the full breadth of their CKT at scale. Our overall research project addressed this gap by developing an online assessment to measure elementary preservice teachers' CKT about matter and its interactions. This study, which was part of our larger project, reports on findings from one component of the item development process examining the construct validity of 118 different CKT about matter assessment items.

Undergraduate Engineering and Education Students Reflect on Their Interdisciplinary Teamwork Experiences Following Transition to Virtual Instruction Caused by COVID-19

This study explores undergraduate engineering and education students’ perspectives on their interdisciplinary teams throughout the rapid transition to online learning and instruction from a face-to-face to a virtual format. In this qualitative study, students’ reflections and focus groups from three interdisciplinary collaborations were analyzed using the lens of Social Cognitive Theory.

Author/Presenter

Jennifer J. Kidd

Min Jung Lee

Pilar Pazos

Krishnanand Kaipa

Stacie I. Ringleb

Orlando Ayala

Lead Organization(s)
Year
2022
Short Description

This study explores undergraduate engineering and education students’ perspectives on their interdisciplinary teams throughout the rapid transition to online learning and instruction from a face-to-face to a virtual format.

COVID-19 as a Magnifying Glass: Exploring the Importance of Relationships as Education Students Learn and Teach Robotics via Zoom

Ed+gineering, an NSF-funded program, adapted hands-on robotics instruction for online delivery in response to the COVID-19 pandemic. This qualitative multiple case study shares the experiences of participating education students in spring 2021 as they collaborated virtually with engineering students and fifth graders to engineer bioinspired robots in an afterschool technology club adapted to be virtual.

Author/Presenter

Jennifer Kidd

Krishnanand Kaipa

Kristie Gutierrez

Min Jung Lee

Pilar Pazos

Stacie I. Ringleb

Lead Organization(s)
Year
2022
Short Description

Ed+gineering, an NSF-funded program, adapted hands-on robotics instruction for online delivery in response to the COVID-19 pandemic. This qualitative multiple case study shares the experiences of participating education students in spring 2021 as they collaborated virtually with engineering students and fifth graders to engineer bioinspired robots in an afterschool technology club adapted to be virtual.

Leading for Justice, Leading for Learning: Conceptualizing Urban School Leadership for Antiracist Mathematics Teaching and Learning

Urban school leaders can support mathematics instruction that acknowledges and sustains students’ racialized and cultured ways of knowing and being. Yet, leadership for racial justice is often discussed separately from instructional improvement. In this conceptual inquiry, we investigate how leadership can integrate antiracist practices into teaching and learning.

Author/Presenter

Jessica G. Rigby

Stephanie Forman

Lead Organization(s)
Year
2023
Short Description

Urban school leaders can support mathematics instruction that acknowledges and sustains students’ racialized and cultured ways of knowing and being. Yet, leadership for racial justice is often discussed separately from instructional improvement. In this conceptual inquiry, we investigate how leadership can integrate antiracist practices into teaching and learning.

Flip It: An Exploratory (Versus Explanatory) Sequential Mixed Methods Design Using Delphi and Differential Item Functioning to Evaluate Item Bias

The Delphi method has been adapted to inform item refinements in educational and psychological assessment development. An explanatory sequential mixed methods design using Delphi is a common approach to gain experts' insight into why items might have exhibited differential item functioning (DIF) for a sub-group, indicating potential item bias. Use of Delphi before quantitative field testing to screen for potential sources leading to item bias is lacking in the literature.

Author/Presenter
Kristin L.K. Koskey
Toni A. May
Yiyun “Kate” Fan
Dara Bright
Gregory Stone
Gabriel Matney
Jonathan D. Bostic
Year
2023
Short Description

The Delphi method has been adapted to inform item refinements in educational and psychological assessment development. An explanatory sequential mixed methods design using Delphi is a common approach to gain experts' insight into why items might have exhibited differential item functioning (DIF) for a sub-group, indicating potential item bias. Use of Delphi before quantitative field testing to screen for potential sources leading to item bias is lacking in the literature. An exploratory sequential design is illustrated as an additional approach using a Delphi technique in Phase I and Rasch DIF analyses in Phase II. We introduce the 2 × 2 Concordance Integration Typology as a systematic way to examine agreement and disagreement across the qualitative and quantitative findings using a concordance joint display table.

Flip It: An Exploratory (Versus Explanatory) Sequential Mixed Methods Design Using Delphi and Differential Item Functioning to Evaluate Item Bias

The Delphi method has been adapted to inform item refinements in educational and psychological assessment development. An explanatory sequential mixed methods design using Delphi is a common approach to gain experts' insight into why items might have exhibited differential item functioning (DIF) for a sub-group, indicating potential item bias. Use of Delphi before quantitative field testing to screen for potential sources leading to item bias is lacking in the literature.

Author/Presenter
Kristin L.K. Koskey
Toni A. May
Yiyun “Kate” Fan
Dara Bright
Gregory Stone
Gabriel Matney
Jonathan D. Bostic
Year
2023
Short Description

The Delphi method has been adapted to inform item refinements in educational and psychological assessment development. An explanatory sequential mixed methods design using Delphi is a common approach to gain experts' insight into why items might have exhibited differential item functioning (DIF) for a sub-group, indicating potential item bias. Use of Delphi before quantitative field testing to screen for potential sources leading to item bias is lacking in the literature. An exploratory sequential design is illustrated as an additional approach using a Delphi technique in Phase I and Rasch DIF analyses in Phase II. We introduce the 2 × 2 Concordance Integration Typology as a systematic way to examine agreement and disagreement across the qualitative and quantitative findings using a concordance joint display table.

Examining the Influence of COVID-19 on Elementary Mathematics Standardized Test Scores in a Rural Ohio School District

In the United States, national and state standardized assessments have become a metric for measuring student learning and high-quality learning environments. As the COVID-19 pandemic offered a multitude of learning modalities (e.g., hybrid, socially distanced face-to-face instruction, virtual environment), it becomes critical to examine how this learning disruption influenced elementary mathematic performance.

Author/Presenter

Dara Bright

Yiyun “Kate” Fan

Chris Fornaro

Kristin L. K. Koskey

Toni A. May

Jonathan D. Bostic

Dolores Swineford

Year
2022
Short Description

In the United States, national and state standardized assessments have become a metric for measuring student learning and high-quality learning environments. As the COVID-19 pandemic offered a multitude of learning modalities (e.g., hybrid, socially distanced face-to-face instruction, virtual environment), it becomes critical to examine how this learning disruption influenced elementary mathematic performance. This study tested for

differences in mathematics performance on fourth grade standardized tests before and during COVID-19 in a case study of a rural Ohio school district using the Measure of Academic Progress (MAP) mathematics test.

Examining the Influence of COVID-19 on Elementary Mathematics Standardized Test Scores in a Rural Ohio School District

In the United States, national and state standardized assessments have become a metric for measuring student learning and high-quality learning environments. As the COVID-19 pandemic offered a multitude of learning modalities (e.g., hybrid, socially distanced face-to-face instruction, virtual environment), it becomes critical to examine how this learning disruption influenced elementary mathematic performance.

Author/Presenter

Dara Bright

Yiyun “Kate” Fan

Chris Fornaro

Kristin L. K. Koskey

Toni A. May

Jonathan D. Bostic

Dolores Swineford

Year
2022
Short Description

In the United States, national and state standardized assessments have become a metric for measuring student learning and high-quality learning environments. As the COVID-19 pandemic offered a multitude of learning modalities (e.g., hybrid, socially distanced face-to-face instruction, virtual environment), it becomes critical to examine how this learning disruption influenced elementary mathematic performance. This study tested for

differences in mathematics performance on fourth grade standardized tests before and during COVID-19 in a case study of a rural Ohio school district using the Measure of Academic Progress (MAP) mathematics test.

“Should We Build This?”: Student Reasoning in Intentionally Facilitated Socio-technical Design Talks

In pre-college engineering education contexts, detailed explorations of student discourse and teacher moves have begun to emerge. For example, recent studies have shown how particular teacher questions prompt student reasoning during particular phases of the engineering design process (Capobianco, deLisi, & Radloff, 2018) and how a teacher’s valuing of heterogeneous ideas sets the stage for students to take epistemic agency in engineering (Carlone, Mercier, & Metzger, 2021).

Author/Presenter

Kristen B. Wendell

Jessica Watkins

Natalie Annabelle De Lucca

Tyrine Jamella Pangan

Rae Woodcock

Chelsea Andrews

Year
2022
Short Description

We are developing case studies of specific types of teacher-supported conversation in which students are asked to consider design decision-making not just as a technical task, but as a complex socio-technical activity with ethical, economic, and political dimensions. Our work foregrounds a perspective of care in students’ engineering discourse and builds on emerging frameworks exploring compassionate design, macroethics and ideology, and critical socio-technical literacy. In this paper and its related poster, we summarize our first year of design talk enactments and analysis.

“Should We Build This?”: Student Reasoning in Intentionally Facilitated Socio-technical Design Talks

In pre-college engineering education contexts, detailed explorations of student discourse and teacher moves have begun to emerge. For example, recent studies have shown how particular teacher questions prompt student reasoning during particular phases of the engineering design process (Capobianco, deLisi, & Radloff, 2018) and how a teacher’s valuing of heterogeneous ideas sets the stage for students to take epistemic agency in engineering (Carlone, Mercier, & Metzger, 2021).

Author/Presenter

Kristen B. Wendell

Jessica Watkins

Natalie Annabelle De Lucca

Tyrine Jamella Pangan

Rae Woodcock

Chelsea Andrews

Year
2022
Short Description

We are developing case studies of specific types of teacher-supported conversation in which students are asked to consider design decision-making not just as a technical task, but as a complex socio-technical activity with ethical, economic, and political dimensions. Our work foregrounds a perspective of care in students’ engineering discourse and builds on emerging frameworks exploring compassionate design, macroethics and ideology, and critical socio-technical literacy. In this paper and its related poster, we summarize our first year of design talk enactments and analysis.