Standards

Development of a Questionnaire on Teachers' Beliefs, Preparedness, and Instructional Practices for Teaching NGSS Science with Multilingual Learners

The limited availability of research instruments that reflect the vision of the Next Generation Science Standards (NGSS) restricts the field's understanding of whether and how teachers are making instructional shifts called for by the standards. The need for such instruments is particularly urgent with teachers of multilingual learners (MLs), who are called on to make shifts in how they think about and enact instruction related to both science and language.

Author/Presenter

Scott E. Grapin

Courtney Plumley

Eric Banilower

Alycia J. Sterenberg Mahon

Laura Craven

Kristen Malzahn

Joan Pasley

Abigail Schwenger

Alison Haas

Okhee Lee

Lead Organization(s)
Year
2024
Short Description

The limited availability of research instruments that reflect the vision of the Next Generation Science Standards (NGSS) restricts the field's understanding of whether and how teachers are making instructional shifts called for by the standards. The need for such instruments is particularly urgent with teachers of multilingual learners (MLs), who are called on to make shifts in how they think about and enact instruction related to both science and language. The purpose of this study was to develop and gather validity evidence for a questionnaire that measures elementary teachers' beliefs, preparedness, and instructional practices for teaching NGSS science with MLs.

Uncovering Middle School CS Students’ Understanding of Variables and Control Structures: A Cognitive Think-Aloud Approach

This poster presents findings on middle school students’ understanding of core computer science (CS) concepts, such as variables and control structures, using cognitive think-aloud interviews with eight students. Each student worked on 16-22 formative assessment tasks designed to assess understanding on the ‘Algorithms and Programming’ middle school CS standards. Our study describes students’ interpretations of the CS concepts and discusses potential factors influencing student interpretations. Significance and next steps are described.

Author/Presenter

Hui Yang

Satabdi Basu

Daisy Rutstein

Arif Rachmatullah

Carol Tate

Christopher Ortiz

Eliese Rulifson

Lead Organization(s)
Year
2023
Short Description

This poster presents findings on middle school students’ understanding of core computer science (CS) concepts, such as variables and control structures, using cognitive think-aloud interviews with eight students.

Exploring Middle School Students’ Understanding of Algorithms Using Standards-aligned Formative Assessments: Teacher and Researcher Perspectives

‘Algorithms’ is a core CS concept included in the K-12 CS standards, yet student challenges with understanding different aspects of algorithms are still not well documented, especially for younger students. This paper describes an approach to decompose the broad middle-school ‘algorithms’ standard into finer grained learning targets, develop formative assessment tasks aligned with the learning targets, and use the tasks to explore student understanding of, and challenges with, the various aspects of the standard.

Author/Presenter

Satabdi Basu

Daisy Rutstein

Carol Tate

Arif Rachmatullah

Hui Yang

Christopher Ortiz

Lead Organization(s)
Year
2023
Short Description

‘Algorithms’ is a core CS concept included in the K-12 CS standards, yet student challenges with understanding different aspects of algorithms are still not well documented, especially for younger students. This paper describes an approach to decompose the broad middle-school ‘algorithms’ standard into finer grained learning targets, develop formative assessment tasks aligned with the learning targets, and use the tasks to explore student understanding of, and challenges with, the various aspects of the standard.

Designing Standards-aligned Formative Assessments to Explore Middle School Students’ Understanding of Algorithms

'Algorithms’ is a core CS concept included in the K-12 CS learning standards, yet student challenges with understanding and using algorithms are still not well documented. This paper describes an approach to decompose the broad middle-school ‘algorithms’ standard into finer grained learning targets, develop formative assessment tasks aligned with the fine-grained learning targets, and use the tasks to explore student understanding of and challenges with the various concepts underlying the standard.

Author/Presenter

Satabdi Basu

Daisy Wise Rutstein

Arif Rachmatullah

Carol Tate

Hui Yang

Christopher Ortiz

Lead Organization(s)
Year
2023
Short Description

'Algorithms’ is a core CS concept included in the K-12 CS learning standards, yet student challenges with understanding and using algorithms are still not well documented. This paper describes an approach to decompose the broad middle-school ‘algorithms’ standard into finer grained learning targets, develop formative assessment tasks aligned with the fine-grained learning targets, and use the tasks to explore student understanding of and challenges with the various concepts underlying the standard.

Multidimensional Science Assessment: Design Challenges and Technology Affordances

Contemporary views on what students should learn increasingly emphasize that students need to acquire more than a base of knowledge; they need to acquire the skills and abilities to use such knowledge in dynamic and flexible ways. To be most effective, learning environments need assessments that are aligned to these perspectives. Using a principled design framework can help guide assessment development toward such targets. Even when using a framework, however, thorny design challenges may arise.

Author/Presenter

Brian D. Gane

Diksha Gaur

Samuel Arnold

Daniel Damelin

Lead Organization(s)
Year
2024
Short Description

In this paper, we describe three challenges (conflict between multiple dimensions of science proficiency, authentic data, and grade-appropriate graphing tools) that we faced when designing for a specific Next Generation Science Standard, and the theoretical and design principles that guided us as we ideated design solutions. Through these designs we maintained alignment to our multidimensional assessment targets, a critical component of our larger assessment validity argument.

Multidimensional Science Assessment: Design Challenges and Technology Affordances

Contemporary views on what students should learn increasingly emphasize that students need to acquire more than a base of knowledge; they need to acquire the skills and abilities to use such knowledge in dynamic and flexible ways. To be most effective, learning environments need assessments that are aligned to these perspectives. Using a principled design framework can help guide assessment development toward such targets. Even when using a framework, however, thorny design challenges may arise.

Author/Presenter

Brian D. Gane

Diksha Gaur

Samuel Arnold

Daniel Damelin

Lead Organization(s)
Year
2024
Short Description

In this paper, we describe three challenges (conflict between multiple dimensions of science proficiency, authentic data, and grade-appropriate graphing tools) that we faced when designing for a specific Next Generation Science Standard, and the theoretical and design principles that guided us as we ideated design solutions. Through these designs we maintained alignment to our multidimensional assessment targets, a critical component of our larger assessment validity argument.

Evaluating the Effectiveness of an Online Professional Development for Rural Middle-School Science Teachers

In rural, geographically dispersed school districts, access to high-quality face-to-face professional development (PD) is challenging. Our study developed and compared the effectiveness of an online PD for middle-school science teachers working in remote, rural areas of Kansas with an evidence-based traditional face-to-face PD with the goal of supporting change in teachers’ conceptual understanding and self-efficacy in utilizing Next Generation Science Standards (NGSS), change in instructional practices, and overall student content learning.

Author/Presenter

Brooke A. Moore

Earl F. Legleiter

Kylia Owens

Brynne Packard

Jessica Wright

Lead Organization(s)
Year
2023
Short Description

In rural, geographically dispersed school districts, access to high-quality face-to-face professional development (PD) is challenging. Our study developed and compared the effectiveness of an online PD for middle-school science teachers working in remote, rural areas of Kansas with an evidence-based traditional face-to-face PD with the goal of supporting change in teachers’ conceptual understanding and self-efficacy in utilizing Next Generation Science Standards (NGSS), change in instructional practices, and overall student content learning.

Refinement of an Instrument Measuring Science Teachers’ Knowledge of Language Through Mixed Method

Teachers must know how to use language to support students in knowledge generation environments that align to the Next Generation Science Standards. To measure this knowledge, this study refines a survey on teachers’ knowledge of language as an epistemic tool. Rasch modelling was used to examine 15 items’ fit statistics and the functioning of a previously-designed questionnaire’s response categories. Cronbach’s alpha reliability was also examined. Additionally, interviews were used to investigate teachers’ interpretations of each item to identify ambiguous items.

Author/Presenter

Chenchen Ding

Catherine Lammert

Gavin W. Fulmer

Brian Hand

Jee K. Suh

Lead Organization(s)
Year
2023
Short Description

Teachers must know how to use language to support students in knowledge generation environments that align to the Next Generation Science Standards. To measure this knowledge, this study refines a survey on teachers’ knowledge of language as an epistemic tool.

Design Considerations for a Middle School Computer Science Pedagogical Content Knowledge Instrument

K- 12 Computer Science (CS) education is developing rapidly but still lacks a comprehensive measure for CS teachers’ pedagogical content knowledge (PCK) . We respond to this need by describing the design of a CS-PCK instrument for ‘Algorithms and Programming’ that measures three broad constructs: (a) teachers’ understanding of standards and standards-alignment, (b) teachers’ formative assessment practices, and (c) teachers’ self-efficacy for teaching and assessing CS.

Author/Presenter

Satabdi Basu

Daisy Rutstein

Carol Tate

Arif Rachmatullah

Hui Yang

Lead Organization(s)
Year
2022
Short Description

K- 12 Computer Science (CS) education is developing rapidly but still lacks a comprehensive measure for CS teachers’ pedagogical content knowledge (PCK). We respond to this need by describing the design of a CS-PCK instrument for ‘Algorithms and Programming’ that measures three broad constructs: (a) teachers’ understanding of standards and standards-alignment, (b) teachers’ formative assessment practices, and (c) teachers’ self-efficacy for teaching and assessing CS.

Standards-Aligned Instructional Supports to Promote Computer Science Teachers' Pedagogical Content Knowledge

The rapid expansion of K-12 CS education has made it critical to support CS teachers, many of whom are new to teaching CS, with the necessary resources and training to strengthen their understanding of CS concepts and how to effectively teach CS. CS teachers are often tasked with teaching different curricula using different programming languages in different grades or during different school years, and tend to receive different professional development (PD) for each curriculum they are required to teach.

Author/Presenter
Satabdi Basu

Daisy Rutstein

Carol Tate

Arif Rachmatullah

Hui Yang

Lead Organization(s)
Year
2022
Short Description

This position paper advocates supporting CS teacher professional learning by supplementing existing curriculum-specific teacher PD with standards-aligned PD that focuses on teachers' conceptual understanding of CS standards and ability to adapt instruction based on student understanding of concepts underlying the CS standards.