Search
Resource
Teachers face challenges when building the concept of substance with students because tensions of meanings emerge from students’ daily life and canonical ideas developed in classrooms. A powerful tool to address learning,…
A Design-Based Process in Characterizing Experienced Teachers’ Formative Assessment Enactment in Science Classrooms
Resource
Formative assessment can facilitate teachers’ abilities to elicit and notice the disciplinary substance of students’ thinking and to respond based on this. Following a design-based process, we developed principled…
Resource
One challenge facing the fields of mathematics education and special education is how to design instruction on fraction concepts that can meet the needs of diverse learners. An innovation that shows promise is to base…
Validating the Use of Student-Level Instruments to Examine Preservice Teachers' Mathematical Problem Solving
Resource
Problem solving is a central focus of mathematics teaching and learning. If teachers are expected to support students' problem-solving development, then it reasons that teachers should also be able to solve problems…
Examining How Using Dichotomous and Partial Credit Scoring Models Influence Sixth-Grade Mathematical Problem-Solving Assessment Outcomes
Resource
Determining the most appropriate method of scoring an assessment is based on multiple factors, including the intended use of results, the assessment's purpose, and time constraints. Both the dichotomous and partial credit…
Resource
This article introduces a new framework for articulating how educational assessments can be related to teacher uses in the classroom. It articulates three levels of assessment: macro (use of standardized tests), meso (…
Unpacking Response Process Issues Encountered When Developing a Mathematics Teachers’ Pedagogical Content Knowledge (PCK) Assessment
Resource
It is essential for items in assessments of mathematics’ teacher knowledge to evoke the desired response processes – to be interpreted and responded to by teachers as intended by item developers. In this study, we sought…
Standards-Aligned Instructional Supports to Promote Computer Science Teachers' Pedagogical Content Knowledge
Resource
This position paper advocates supporting CS teacher professional learning by supplementing existing curriculum-specific teacher PD with standards-aligned PD that focuses on teachers' conceptual understanding of CS…
Resource
K- 12 Computer Science (CS) education is developing rapidly but still lacks a comprehensive measure for CS teachers’ pedagogical content knowledge (PCK). We respond to this need by describing the design of a CS-PCK…
Investigating the Presence of Mathematics and the Levels of Cognitively Demanding Mathematical Tasks in Integrated STEM Units
Resource
Effective K-12 integrated STEM education should reflect an intentional effort to adequately represent and facilitate each of its component disciplines in a meaningful way. However, most research in this space has been…
Resource
Review of the recent literature on integrated STEM curriculum development and implementation. Included are frameworks for integrated STEM curriculum development and research assessments to evaluate curriculum quality.…
Beyond the Design of Assessment Tasks: Expanding the Assessment Toolkit to Support Teachers’ Formative Assessment Practices in Elementary Science Classrooms
Resource
Teachers experience challenges in effectively using formative assessment practices in their classrooms. In the US, only 28% of elementary teachers report using formative assessment. This study highlights the need to design…
Resource
Involving students in scientific modeling practice is one of the most effective approaches to achieving the next generation science education learning goals. Given the complexity and multirepresentational features of…
Resource
To best support students in developing competence, assessments that allow students to use knowledge to solve challenging problems and make sense of phenomena are needed. These assessments need to be designed and tested to…
Examining the Influence of COVID-19 on Elementary Mathematics Standardized Test Scores in a Rural Ohio School District
Resource
In the United States, national and state standardized assessments have become a metric for measuring student learning and high-quality learning environments. As the COVID-19 pandemic offered a multitude of learning…
Flip It: An Exploratory (Versus Explanatory) Sequential Mixed Methods Design Using Delphi and Differential Item Functioning to Evaluate Item Bias
Resource
The Delphi method has been adapted to inform item refinements in educational and psychological assessment development. An explanatory sequential mixed methods design using Delphi is a common approach to gain experts'…
Examining Elementary Science Teachers' Responses to Assessments Tasks Designed to Measure Their Content Knowledge for Teaching About Matter and its Interactions
Resource
Despite the importance of developing elementary science teachers' content knowledge for teaching (CKT), there are limited assessments that have been designed to measure the full breadth of their CKT at scale. Our overall…
Investigating Teachers’ Understanding Through Topic Modeling: A Promising Approach to Studying Teachers’ Knowledge
Resource
Examining teachers’ knowledge on a large scale involves addressing substantial measurement and logistical issues; thus, existing teacher knowledge assessments have mainly consisted of selected-response items because of…
Resource
This article pilots ChatGPT in tackling the most challenging part of science learning and found it successful in automation of assessment development, grading, learning guidance, and recommendation of learning materials…
Resource
Artificial Intelligence (AI) is prevalent in nearly every aspect of our lives. However, recent studies have found a significant amount of confusion and misunderstanding surrounding AI. To develop effective educational…
Resource
This report takes stock of what we currently know as well as what we need to know to make classroom assessment maximally beneficial for the teaching and learning of STEM subject matter in K–12 classrooms…
Can Generative AI and ChatGPT Outperform Humans on Cognitive-Demanding Problem-Solving Tasks in Science?
Resource
This study aimed to examine an assumption regarding whether generative artificial intelligence (GAI) tools can overcome the cognitive intensity that humans suffer when solving problems. We examine the performance of…
Resource
In this paper, we describe three challenges (conflict between multiple dimensions of science proficiency, authentic data, and grade-appropriate graphing tools) that we faced when designing for a specific Next Generation…
Reasoning About Data in Elementary School: Student Strategies and Strengths when Reasoning with Multiple Variables
Resource
The need for data literacy is an increasingly pressing priority in society, but most of the work in data-centred education has focused on developing skills at the middle school, secondary, and post-secondary levels, with…
Resource
This study applied the many-facet Rasch measurement (MFRM) to assess students’ knowledge-in-use in middle school physical science.
This study applied the many-facet Rasch measurement (MFRM) to assess…
Resource
A School Science and Mathematics Journal editorial.
Bostic, J. (2023). Engaging hearts and minds in assessment research. School Science and Mathematics Journal, 123(6), 217-219. https://doi.org/10.1111/…
Developing and Using a Scalable Assessment to Measure Preservice Elementary Teachers' Ccontent Knowledge for Teaching About Matter
Resource
There is strong agreement in science teacher education of the importance of teachers' content knowledge for teaching (CKT), which includes their subject matter knowledge and their pedagogical content knowledge. However,…
Resource
In this report section, we discuss the importance of aligning classroom assessments with learning goals and instructional practices to both shape and evaluate students’ learning opportunities.
In this…
Resource
Cognitive interviews play an important role in articulating the intended construct of educational assessments. This paper describes the iterative development of protocols for cognitive interviews with kindergarten through…
Resource
This section presents an overview of critical developments in technology-driven, classroom-based innovative assessment practices. It uses a framework organized around cognitive constructs, assessment functionality, and…
Designing Standards-aligned Formative Assessments to Explore Middle School Students’ Understanding of Algorithms
Resource
'Algorithms’ is a core CS concept included in the K-12 CS learning standards, yet student challenges with understanding and using algorithms are still not well documented. This paper describes an approach to decompose the…
Exploring Middle School Students’ Understanding of Algorithms Using Standards-aligned Formative Assessments: Teacher and Researcher Perspectives
Resource
‘Algorithms’ is a core CS concept included in the K-12 CS standards, yet student challenges with understanding different aspects of algorithms are still not well documented, especially for younger students. This paper…
Uncovering Middle School CS Students’ Understanding of Variables and Control Structures: A Cognitive Think-Aloud Approach
Resource
This poster presents findings on middle school students’ understanding of core computer science (CS) concepts, such as variables and control structures, using cognitive think-aloud interviews with eight students…
The Dimensionality of the Epistemic Orientation Survey and Longitudinal Measurement Invariance for the Short Form of EOS (EOS-SF)
Resource
The dimensionality of the epistemic orientation survey (EOS) was examined across four occasions with item factor analysis (IFA). Because of an emphasis on the knowledge generation of epistemic orientation (EO), four…
Resource
Our 5D assessment development process is eight phases, each with a clear goal and tools to support task development. The tools and processes are combined in the 5D Assessment Development Tool for easy access from a single…
Resource
The author describes an innovative approach to assessment that aims to blend the productive characteristics of both summative and formative assessment. The resulting assessment system is accountable to students and…
Toward a Better Understanding of the Nature of Pedagogical Content Knowledge for Fractions: The Role of Experience
Resource
Mathematical knowledge for teaching (MKT) is a professional knowledge crucial for effective mathematics instruction, encompassing both content knowledge (CK) and pedagogical content knowledge (PCK). The purpose of this…
Evaluation of the Cognitive, Psychometric, and Instructional Affordances of Curriculum-embedded Assessments: A Comprehensive Validity-based Approach
Poster
Elementary School
Middle School
Assessment
Cognitive Science
Curriculum
Mathematics…
SimScientists Human Body Systems: Using Simulations to Foster Integrated Understanding of Complex, Dynamic, Interactive Systems
Poster
Middle School
High School
Assessment
Educational Technology
Science
Barbara Buckley…
Visualizing to Integrate Science Understanding for All Learners (VISUAL), Cumulative Learning using Embedded Assessment Results (Clear)
Poster
Middle School
High School
Assessment
Curriculum
Educational Technology
Science
Technology…
Poster
Middle School
Assessment
Educational Technology
Science
Technology
Janice Gobert…
Poster
Middle School
High School
Assessment
Educational Technology
Mathematics
Science
William…
Resource
Liu, O. L., Lee, H.S. & Linn, M.C. (2011a). An investigation of explanation multiple-choice items in science assessment. Educational Assessment, 16, 164-184.
ABSTRACT:
Both multiple-choice and constructed-response…
Resource
Liu, O.L., Lee, H.S., & Linn, M.C. (2011b). Measuring knowledge integration: Validation of four-year assessments. Journal of Research in Science Teaching, 48(9), 1079-1107.
ABSTRACT:
Science education needs valid,…
Resource
The significance of inquiry skills is widely acknowledged in science practice across many areas. Carrying out experimental investigations is an indispensable element of scientific inquiry and, therefore, an important…
A Design Pattern for Observational Investigation Assessment Tasks (Large Scale Assessment Technical Report 2)
Resource
The significance of inquiry skills is widely acknowledged in science practice across many areas. Unlike experimentation, another form of inquiry skill, observational investigation has been much ignored in science…
Resource
Join the panelists from the plenary presentation to continue conversations about common standards in each of the STEM disciplines.
Assessment
Curriculum
Equity…
Resource
In this interactive talk, Wilson will ask each project to make explicit its assumptions about how teachers learn, the forces that matter the most, and how the logic and components of programs reflect those underlying…