Search
Resource
This brief gives an overview—and by no means a comprehensive one—of several NGSS-aligned projects in the areas of curriculum, instruction, assessment, and professional development.
This brief gives an…
Constructing Assessment Tasks that Blend Disciplinary Core Ideas, Crosscutting Concepts, and Science Practices for Classroom Formative Applications
Resource
How do we measure knowledge in use? In this paper we describe how we use principles of evidence-centered design to develop classroom-based science assessments that integrate three dimensions of science proficiency—…
Resource
This book examines the extent to which study quality, assessment type, and scaffolding characteristics (strategy, intended outcome, fading schedule, scaffolding intervention, and paired intervention) influence cognitive…
Resource
Three middle school science curricular units on the topics of genetics, ocean biodiversity & discourse, and solar ovens & design critiques.
Three middle school science curricular units on the…
Resource
To understand the mathematics writing of students, we conducted a synthesis to evaluate empirical research about mathematics writing. We identified 29 studies that included a mathematics-writing assessment, intervention,…
Initial Understandings of Fraction Concepts Evidenced by Students With Mathematics Learning Disabilities and Difficulties
Resource
This study extends current literature by presenting key understandings of fractions, documented through problem-solving activity, language, representations, and operations, evidenced by students with LD and mathematics…
Resource
Understand students’ fraction concepts through interview tasks. Includes tasks and guide to record student thinking.
Understand students’ fraction concepts through interview tasks. Includes tasks…
Resource
The study’s purpose is to describe content validity evidence related to new problem-solving measures currently under development.
Bostic, J., Matney, G., Sondergeld, T., & Stone, G. (2018, November…
Resource
The goal for this proceeding is to foster the conversation about validation using examples and to communicate information about validation in ways that are broadly accessible.
Validity-related issues…
Opportunities to Participate (OtP) in Science: Examining Differences Longitudinally and Across Socioeconomically Diverse Schools
Resource
The purpose of this study was to develop and validate a survey of opportunities to participate (OtP) in science that will allow educators and researchers to closely approximate the types of learning opportunities students…
Resource
Use these ideas to diagnose and address common conceptual obstacles that inhibit students’ success.
Cirillo, M. & Hummer, J. (2019). Addressing misconceptions in secondary geometry proof.…
Automated text scoring and real‐time adjustable feedback: Supporting revision of scientific arguments involving uncertainty
Resource
This paper describes HASbot, an automated text scoring and real‐time feedback system designed to support student revision of scientific arguments.
This paper describes HASbot, an automated text scoring…
Resource
This article describes the process of developing and validating a Science Instructional Practices survey instrument that is appropriate for NGSS and other related science standards.
Ambitious efforts…
Resource
This article describes how research-based learning progressions can be used to enhance the analysis and response to student work.
Dig deeper into classroom artifacts using research-based learning…
Resource
Test scoring procedures should align with the intended uses and interpretations of test results. In this paper, we examine three test scoring procedures for an operational assessment of early numeracy, the Early Grade…
Resource
This paper illustrates how the combination of teacher and computer guidance can strengthen collaborative revision and identifies opportunities for teacher guidance in a computer-supported collaborative learning environment…
Understanding Science and Language Connections: New Approaches to Assessment with Bilingual Learners
Resource
Authors report on the use of bilingual constructed response science assessments in the context of a research and development partnership with secondary school science teachers.
We report on the use of…
Resource
This article reports on how three prospective teachers had differing opportunities to demonstrate their skills in the context of the field assessment, but similar opportunities in the context of the simulation assessment…
The Effect of Automated Feedback on Revision Behavior and Learning Gains in Formative Assessment of Scientific Argument Writing
Resource
This study investigates a formative feedback system integrated into an online science curriculum module teaching climate change.
Application of new automated scoring technologies, such as natural…
Resource
In this article, authors examined classroom videos of nine experienced teachers of elementary, middle, and high school science, aiming to create a model of FA enactment that is useful to teachers.…
Chemistry Critical Friendships: Investigating Chemistry-Specific Discourse within a Domain-General Discussion of Best Practices for Inquiry Assessments
Resource
Presented in this paper are the results from analyzing a discussion between five high school chemistry teachers as they generated a set of best practices for inquiry assessments.
High school chemistry…
Resource
In this article, authors use meta-analysis to analyze 42 design and comparison studies involving data from 7699 students spanning over 35 years.
Graph technologies are now widely available in K-12…
Resource
Authors investigate ways to support students in integrating their understanding of density concepts through a graph that is linked to a simulation depicting the relationship between mass, volume, and density…
Pathways for Analyzing and Responding to Student Work for Formative Assessment: The Role of Teachers’ Goals for Student Learning
Resource
This study explored how teachers interpreted and responded to their own student work during the process of formative assessment.
This study explored how teachers interpreted and responded to their own…
Resource
In this report, authors describe the results of a rigorous two-year study of the impacts of a mathematics initiative called Ongoing Assessment Project (OGAP) on teacher and student learning in grades 3-5 in two…
Revisiting Purpose and Conceptualisation in the Design of Assessments of Mathematics Teachers’ Knowledge
Resource
In this paper, authors focus on the design of assessments of mathematics teachers’ knowledge by emphasising the importance of identifying the purpose for the assessment, defining the specific construct to be measured, and…
Investigating Classroom-related Factors that Influence Student Perceptions of LEGO Robots as Educational Tools in Middle Schools
Resource
This paper investigates classroom-related factors such as pedagogical strategies and management of robotics-based educational content that contribute to the formation of student perceptions in robotics-enhanced classes…
Resource
This paper will describe the process and result of developing a LEGO robotics, NGSS, and 5E aligned middle school curriculum during a three-week summer PD program for teachers who teach urban students-of-color…
Resource
This paper describes a program to engage teachers to learn about mechatronics, robotics, and Next Generation Science Standards (NGSS) through hands-on activities and collaborative research.
Rapid…
Analyzing Successful Teaching Practices in Middle School Science and Math Classrooms when using Robotics
Resource
This paper analyzes teaching practices that successfully integrate robotics in middle school science and math classrooms.
A robotics-based curriculum offers numerous opportunities to enrich science,…
Resource
This paper describes how the design canvas of Kline et al. was adopted and implemented in our workshop and investigates its benefits.
Advances in science and technology are shaping every aspect of our…
Designing Robotics-based Science Lessons Aligned with the Three Dimensions of NGSS-plus-5E Model: A Content Analysis
Resource
In this study, analyzing lesson plans using the rubrics provided opportunities for suggestions and feedback for improvement to developers and it informs the development of new lessons by the project team…
Resource
A poster to be presented at the Association of Science Teacher Educators International Conference.
Hapgood, S., Heuring, J. & Wilson, G., Czerniak, C. (Accepted for January 2020). Early Childhood…
Resource
Paper presented at the European Science Education Research Association.
Czerniak, C. M., Kaderavek, J., Paprzycki, P., Hapgood, S., Mentzer, G., Molitor, S., & Mendenhall, R. (2019). Longitudinal…
Longitudinal Impact of Early Childhood Science Instruction on Middle Grades Literacy and Mathematics
Resource
Paper presented at the Global Conference on Education and Research.
Czerniak, C. M., Paprzycki, P., Hapgood, S., & Kaderavek, J. (2019). Longitudinal Impact of Early Childhood Science Instruction on…
Scientific Inquiry for Young Children: Linking Teacher Professional Development and Family Engagement to Improve Student Achievement
Resource
Paper presented at the Society for Research on Child Development Conference.
Hapgood, S., Paprzycki, P., Czerniak, C.M. (2019). Scientific Inquiry for Young Children: Linking Teacher Professional…
Thinking Beyond the Score: Multidimensional Analysis of Student Performance to Inform the Next Generation of Science Assessments
Resource
Informed by Systemic Functional Linguistics and Latent Dirichlet Allocation analyses, this study utilizes an innovative bilingual (Spanish–English) constructed response assessment of science and language practices for…
Resource
Free, standards-aligned, and research-based inquiry curricula that address NGSS 3D proficiency. Includes Interactive scientific models plus hands-on activities, personalized guidance, and rich embedded…
Knowledge in Use: Examining Elementary Teachers’ Content Knowledge for Teaching (CKT) about Matter using Scenario-Based Assessment
Resource
This study explores how teachers across the United States answer and reason on “teacher assessment tasks” designed to elicit content knowledge for teaching (CKT) about matter and its interactions. It leverages a think…
Elementary Pre-service Teachers' Perceptions of Assessment Tasks to Measure Content Knowledge for Teaching about Matter
Resource
This study explores how 79 elementary pre-service teachers evaluate the importance and pertinence of assessment tasks, designed to elicit information about content knowledge for teaching (CKT) about matter—a foundational…
Designing Educative Curriculum Materials for Teacher Educators: Supporting Elementary Teachers' Content Knowledge for Teaching about Matter
Resource
Building on the work of Ball and Cohen and that of Davis and Krajcik, as well as more recent research related to K12 teacher learning from and about curriculum materials, we seek to answer the question, How can educative…
Resource
A cluster randomized trial design was used to examine the effectiveness of a Grades 3 to 5 early algebra intervention with a diverse student population.
A cluster randomized trial design was used to…
Resource
The purpose of this presentation is to convey validity evidence for a new measure titled Problem-Solving Measure for grade four (PSM4), an assessment within the previously published PSM series designed for elementary and…
Resource
The purpose of this study was to develop and validate a self‐assessment using critical components of successful inclusive STEM high schools for school personnel and educational researchers who wish to better understand…
The Role of Instructional Materials in the Relationship Between the Official Curriculum and the Enacted Curriculum
Resource
The authors studied how the distal policy mechanisms of curricular aims and objectives articulated in official curriculum documents influenced classroom instruction, and the factors that were associated with the enactment…
On the Alignment of Teachers’ Mathematical Content Knowledge Assessments with the Common Core State Standards
Resource
This article provides content maps for two widely used teacher assessment instruments in the USA relative to the widely adopted Common Core State Standards. This common reference enables comparisons of content alignment…
Resource
This is a description of a new methodological tool to gather response process validity evidence. The context is scholarship within mathematics education contexts.
Response process validity evidence…
Resource
Introduction to special issue focusing on think alouds and response process evidence. This work cuts across STEM education scholarship and introduces readers to robust means to engage in think alouds.…
Investigating High School Chemistry Teachers’ Assessment Item Generation Processes for a Solubility Lab
Resource
Designing high school chemistry assessments is a complex and difficult task. Although prior studies about assessment have offered teachers guidelines and standards as support to generate quality assessment items, little is…
Investigating How Assessment Design Guides High School Chemistry Teachers’ Interpretation of Student Responses to a Planned, Formative Assessment
Resource
This study seeks to better understand what teachers notice when interpreting assessment results and how the design of the assessment may influence teachers’ patterns of noticing. The study described herein investigates…
Visualizing Chemistry Teachers’ Enacted Assessment Design Practices to Better Understand Barriers to “Best Practices”
Resource
In this paper, the relationship between high school chemistry teachers’ self-generated “best practices” for developing formative assessments and the assessments they implement in their courses are examined…
Integrating a Statistical Topic Model and a Diagnostic Classification Model for Analyzing Items in a Mixed Format Assessment
Resource
Selected response items and constructed response (CR) items are often found in the same test. Conventional psychometric models for these two types of items typically focus on using the scores for correctness of the…
Developing Transmedia Engineering Curricula Using Cognitive Tools to Impact Learning and the Development of STEM Identity
Resource
This paper examines the use of Imaginative Education (IE) to create an NGSS-aligned middle school engineering curriculum that supports transfer and the development of STEM identity.
This paper examines…
How Science Teachers DiALoG Classrooms: Towards a Practical and Responsive Formative Assessment of Oral Argumentation
Resource
This article presents lessons learned from an ongoing attempt to conceptualize, develop, and refine a way for teachers to gather formative assessment evidence about classroom argumentation as it happens…
Resource
This study explores design strategies used by experienced designers in Energy3D, a computer-aided design (CAD) simulation environment designed for learning settings, to provide insight into supporting students' use of CAD…
Poster
Middle School
High School
Mathematics
Science
Technology
Assessment
Curriculum…
Poster
High School
Post-secondary
Computer Science
Technology
Assessment
Educational Technology
This…
CAREER: Fraction Activities and Assessments for Conceptual Teaching (FAACT) for Students with Learning Disabilities
Poster
Elementary School
Middle School
Mathematics
Assessment
Broadening Participation
Curriculum
Special…
Developing and Evaluating Assessments of Problem Solving (Collaborative Research: Bostic and Sondergeld)
Poster
Elementary School
Middle School
Mathematics
Assessment
Through DEAP, we have created three Problem-Solving Measures (PSMs)…
Developing and Validating a Scalable, Classroom-focused Measure of Usable Knowledge for Teaching Mathematics: The Classroom Video Analysis Instrument
Poster
Elementary School
Middle School
Mathematics
Assessment
Disciplinary Content Knowledge
This project focuses on…
Misconceptions Oriented Standards-Based Assessment Resource for Teachers of High School Physical Sciences (MOSART HSPS)
Poster
High School
Science
Assessment
MOSART HS PS developed assessment tools based on both NRC Standards and NGSS for high school chemistry and…
Online Practice Suite: Practice Spaces, Simulations and Virtual Reality Environments for Preservice Teachers to Learn to Facilitate Argumentation Discussions in Math and Science
Poster
Post-secondary
Mathematics
Science
Technology
Assessment
Curriculum
Educational Technology…
Poster
Middle School
High School
Mathematics
Assessment
Classroom Practice
Curriculum
Disciplinary Content…
Design and Development of Transmedia Narrative-based Curricula to Engage Children in Scientific Thinking and Engineering Design (Collaborative Research: Ellis and McGinnis-Cavanaugh)
Poster
Middle School
Engineering
Science
Assessment
Broadening Participation
Cognitive Science
Curriculum…
Developing and Validating Assessments to Measure and Build Elementary Teachers' Content Knowledge for Teaching about Matter and Its Interactions within Teacher Education Settings (Collaborative Research: Hanuscin)
Poster
Post-secondary
Science
Assessment
Disciplinary Content Knowledge
Professional Development
This is an NSF-…
Poster
High School
Chemistry
Earth Science
Assessment
Curriculum
Disciplinary Content Knowledge
Professional…
Transforming Scientific Practices to Promote Students Interest and Motivation in the Life Sciences: A Teacher Leadership Development Intervention
Poster
Teachers
Engineering
Mathematics
Science
Technology
Assessment
Broadening Participation…
Poster
Middle School
Science
Assessment
Curriculum
This Early-Stage Design and Development project is developing NGSS-friendly…
Design and Development of a K-12 STEM Observation Protocol (Collaborative Research: Dare, Ring-Whalen, and Roehrig)
Poster
Elementary School
Middle School
High School
Engineering
Mathematics
Science
Technology…
Developing a Suite of Standards-based Instructionally Supportive Tools for Middle School Computer Science
Poster
Middle School
Computer Science
Assessment
Classroom Practice
Disciplinary Content Knowledge
Professional Development…
Developing and Validating Assessments to Measure and Build Elementary Teachers' Content Knowledge for Teaching about Matter and Its Interactions within Teacher Education Settings (Collaborative Research: Mikeska)
Poster
Post-secondary
Science
Assessment
Curriculum
Disciplinary Content Knowledge
This project aims to develop and…
Poster
Teachers
Science
Technology
Assessment
Curriculum
Disciplinary Content Knowledge
Pedagogical Content…
Three-Dimensional Teaching and Learning: Rebuilding and Researching an Online Middle School Curriculum
Poster
Middle School
Science
Assessment
Curriculum
Disciplinary Content Knowledge
Professional Development…
Poster
High School
Mathematics
Assessment
Broadening Participation
Curriculum
We are studying the implementation and…
Improving Multi-dimensional Assessment and Instruction: Building and Sustaining Elementary Science Teachers' Capacity Through Learning Communities (Collaborative Research: Lehman and Pellegrino)
Poster
Elementary School
Science
Assessment
Professional Development
The NGSA project seeks to better understand how to build and…
Leveraging Simulations in Preservice Preparation to Improve Mathematics Teaching for Students with Disabilities (Collaborative Research: Cohen and Jones)
Poster
Elementary School
Mathematics
Assessment
Curriculum
Disciplinary Content Knowledge
Educational Technology…
Poster
Middle School
High School
Science
Assessment
The main goal of the 5DMASTERS (Making Aligned Science Tasks Equitable for…
Poster
High School
Mathematics
Technology
Assessment
Broadening Participation
Classroom Practice
Curriculum…
Supporting Teachers in Responsive Instruction for Developing Expertise in Science (Collaborative Research: Linn)
Poster
Middle School
Science
Technology
Assessment
Broadening Participation
Curriculum
Educational Technology…
Poster
High School
Science
Assessment
Curriculum
Our team works with high school chemistry teachers to co-develop a suite of…
Developing Preservice Elementary Teachers' Ability to Facilitate Goal-Oriented Discussions in Science and Mathematics via the Use of Simulated Classroom Interactions
Poster
Post-secondary
Mathematics
Science
Technology
Assessment
Curriculum
Educational Technology…
Measuring Early Mathematical Reasoning Skills: Developing Tests of Numeric Relational Reasoning and Spatial Reasoning
Poster
Elementary School
Mathematics
Assessment
Broadening Participation
The MMaRS project is designing classroom assessment…
Building a Teacher Knowledge Base for the Implementation of High-Quality Instructional Resources through the Collaborative Investigation of Video Cases (Collaborative Research: Murray and Wilson)
Poster
Middle School
High School
Mathematics
Assessment
Curriculum
Disciplinary Content Knowledge
Professional…
Supporting Teachers in Responsive Instruction for Developing Expertise in Science (Collaborative Research: Riordan)
Poster
Middle School
Science
Technology
Assessment
Educational Technology
With the increasing use of online…
Case Studies of a Suite of Next Generation Science Instructional, Assessment, and Professional Development Materials in Diverse Middle School Settings
Poster
Elementary School
Assessment
Our learning approach, eco-solutioning, emphasizes learning 3D environmental content through the construction of solutions…
Resource
This web-based portal offers free, technology-enhanced science assessment tasks for Grades 3-5. Designed for use by educators, researchers, and the public, the tasks are aligned to the NGSS performance expectations and…
Resource
DiALoG stands for Diagnosing the Argumentation Levels of Groups. It is designed for teachers to formatively assess the quality of evidence-based arguments and to guide the selection of instructional responses designed to…
Resource
Assessment tasks intended to support teaching and learning in classrooms that are enacting NGSS-aligned instruction, and to gain insights into grades 3-8 students’ progress in building proficiency with NGSS performance…
Resource
Estimating and monitoring the construct-irrelevant variance (CIV) is of significant importance to validity, especially for constructed response assessments with rich contextualized information. To examine CIV in…
Developing and Piloting a Tool to Assess Culturally Responsive Principles in Schools Serving Indigenous Students
Resource
This article presents a tool and discusses the rationale for the authors’ development of a tool designed to assess the alignment of culturally responsive schooling principles within schools serving predominantly…
Articulating a Transformative Approach for Designing Tasks that Measure Young Learners’ Developing Proficiencies in Integrated Science and Literacy
Resource
This paper introduces an approach for designing NGSS-aligned assessments that measure young learners’ science progress while also attending to the scientific language and literacy practices that are integral parts of the…
Elementary Preservice Teachers’ Perceptions of Assessment Tasks that Measure Content Knowledge for Teaching about Matter
Resource
This study explores how 79 elementary preservice teachers perceive the relevance and importance of assessment task scenarios designed to elicit information about content knowledge for teaching (CKT) about matter and its…
Resource
The purpose of this study was to investigate fourth-grade students’ sensemaking of a word problem. Sensemaking occurs when students connect their understanding of situations with existing knowledge. We investigated…
Examining the Responding Component of Teacher Noticing: A Case of One Teacher’s Pedagogical Responses to Students’ Thinking in Classroom Artifacts
Resource
In this study, we investigated how an experienced fourth-grade teacher responded to her students’ thinking as part of her teacher noticing practice in a formative assessment context. Our primary purpose in doing this work…
Training a New Generation of Problem Solvers: How Can Education Programs Develop the Problem-Solving Skills of Today's Schoolchildren and Tomorrow's STEM Workforce?
Resource
This article addresses the need and potential for students to develop problem-solving skills as part of STEM learning.
Songer, N.B. (2022 April) Training a new generation of problem solvers: How can…
When Should I Use a Measure to Support InstructionalImprovement at Scale? The Importance of Considering BothIntended and Actual Use in Validity Arguments
Resource
Despite the ease of accessing a wide range of measures, little attention is given to validity arguments when considering whether to use the measure for a new purpose or in a different context. Making a validity argument…
Resource
The process of using Learning Analytics (LA) to improve teaching works from the assumption that data should be readily shared between stakeholders in an educational organization. However, the design of LA tools often does…
Resource
Formative assessment is an important component of teaching as it enables teachers to foster student learning by uncovering, interpreting, and advancing student thinking. In this work, we sought to characterize how…
Analyzing Chemistry Teachers’ Formative Assessment Practices Using Formative Assessment Portfolio Chapters
Resource
The effective use of formative assessment (FA) has been demonstrated to confer positive impacts on student learning. To understand why and how FA works, it is necessary to characterize teachers’ FA practices, but because…
Resource
Teaching chemistry as a practice rather than as a mere collection of facts demands that teachers modify their practices, particularly their approach to formative assessment (FA). In this study, we investigated how teachers…
Resource
Teachers face challenges when building the concept of substance with students because tensions of meanings emerge from students’ daily life and canonical ideas developed in classrooms. A powerful tool to address learning,…
A Design-Based Process in Characterizing Experienced Teachers’ Formative Assessment Enactment in Science Classrooms
Resource
Formative assessment can facilitate teachers’ abilities to elicit and notice the disciplinary substance of students’ thinking and to respond based on this. Following a design-based process, we developed principled…
Resource
One challenge facing the fields of mathematics education and special education is how to design instruction on fraction concepts that can meet the needs of diverse learners. An innovation that shows promise is to base…
Validating the Use of Student-Level Instruments to Examine Preservice Teachers' Mathematical Problem Solving
Resource
Problem solving is a central focus of mathematics teaching and learning. If teachers are expected to support students' problem-solving development, then it reasons that teachers should also be able to solve problems…
Examining How Using Dichotomous and Partial Credit Scoring Models Influence Sixth-Grade Mathematical Problem-Solving Assessment Outcomes
Resource
Determining the most appropriate method of scoring an assessment is based on multiple factors, including the intended use of results, the assessment's purpose, and time constraints. Both the dichotomous and partial credit…
Resource
This article introduces a new framework for articulating how educational assessments can be related to teacher uses in the classroom. It articulates three levels of assessment: macro (use of standardized tests), meso (…
Unpacking Response Process Issues Encountered When Developing a Mathematics Teachers’ Pedagogical Content Knowledge (PCK) Assessment
Resource
It is essential for items in assessments of mathematics’ teacher knowledge to evoke the desired response processes – to be interpreted and responded to by teachers as intended by item developers. In this study, we sought…
Standards-Aligned Instructional Supports to Promote Computer Science Teachers' Pedagogical Content Knowledge
Resource
This position paper advocates supporting CS teacher professional learning by supplementing existing curriculum-specific teacher PD with standards-aligned PD that focuses on teachers' conceptual understanding of CS…
Resource
K- 12 Computer Science (CS) education is developing rapidly but still lacks a comprehensive measure for CS teachers’ pedagogical content knowledge (PCK). We respond to this need by describing the design of a CS-PCK…
Investigating the Presence of Mathematics and the Levels of Cognitively Demanding Mathematical Tasks in Integrated STEM Units
Resource
Effective K-12 integrated STEM education should reflect an intentional effort to adequately represent and facilitate each of its component disciplines in a meaningful way. However, most research in this space has been…
Resource
Review of the recent literature on integrated STEM curriculum development and implementation. Included are frameworks for integrated STEM curriculum development and research assessments to evaluate curriculum quality.…
Beyond the Design of Assessment Tasks: Expanding the Assessment Toolkit to Support Teachers’ Formative Assessment Practices in Elementary Science Classrooms
Resource
Teachers experience challenges in effectively using formative assessment practices in their classrooms. In the US, only 28% of elementary teachers report using formative assessment. This study highlights the need to design…
Resource
Involving students in scientific modeling practice is one of the most effective approaches to achieving the next generation science education learning goals. Given the complexity and multirepresentational features of…
Resource
To best support students in developing competence, assessments that allow students to use knowledge to solve challenging problems and make sense of phenomena are needed. These assessments need to be designed and tested to…
Examining the Influence of COVID-19 on Elementary Mathematics Standardized Test Scores in a Rural Ohio School District
Resource
In the United States, national and state standardized assessments have become a metric for measuring student learning and high-quality learning environments. As the COVID-19 pandemic offered a multitude of learning…
Flip It: An Exploratory (Versus Explanatory) Sequential Mixed Methods Design Using Delphi and Differential Item Functioning to Evaluate Item Bias
Resource
The Delphi method has been adapted to inform item refinements in educational and psychological assessment development. An explanatory sequential mixed methods design using Delphi is a common approach to gain experts'…
Examining Elementary Science Teachers' Responses to Assessments Tasks Designed to Measure Their Content Knowledge for Teaching About Matter and its Interactions
Resource
Despite the importance of developing elementary science teachers' content knowledge for teaching (CKT), there are limited assessments that have been designed to measure the full breadth of their CKT at scale. Our overall…
Investigating Teachers’ Understanding Through Topic Modeling: A Promising Approach to Studying Teachers’ Knowledge
Resource
Examining teachers’ knowledge on a large scale involves addressing substantial measurement and logistical issues; thus, existing teacher knowledge assessments have mainly consisted of selected-response items because of…
Resource
This article pilots ChatGPT in tackling the most challenging part of science learning and found it successful in automation of assessment development, grading, learning guidance, and recommendation of learning materials…
Resource
Artificial Intelligence (AI) is prevalent in nearly every aspect of our lives. However, recent studies have found a significant amount of confusion and misunderstanding surrounding AI. To develop effective educational…
Resource
This report takes stock of what we currently know as well as what we need to know to make classroom assessment maximally beneficial for the teaching and learning of STEM subject matter in K–12 classrooms…
Can Generative AI and ChatGPT Outperform Humans on Cognitive-Demanding Problem-Solving Tasks in Science?
Resource
This study aimed to examine an assumption regarding whether generative artificial intelligence (GAI) tools can overcome the cognitive intensity that humans suffer when solving problems. We examine the performance of…
Resource
In this paper, we describe three challenges (conflict between multiple dimensions of science proficiency, authentic data, and grade-appropriate graphing tools) that we faced when designing for a specific Next Generation…
Reasoning About Data in Elementary School: Student Strategies and Strengths when Reasoning with Multiple Variables
Resource
The need for data literacy is an increasingly pressing priority in society, but most of the work in data-centred education has focused on developing skills at the middle school, secondary, and post-secondary levels, with…
Resource
This study applied the many-facet Rasch measurement (MFRM) to assess students’ knowledge-in-use in middle school physical science.
This study applied the many-facet Rasch measurement (MFRM) to assess…
Resource
A School Science and Mathematics Journal editorial.
Bostic, J. (2023). Engaging hearts and minds in assessment research. School Science and Mathematics Journal, 123(6), 217-219. https://doi.org/10.1111/…
Developing and Using a Scalable Assessment to Measure Preservice Elementary Teachers' Content Knowledge for Teaching About Matter
Resource
There is strong agreement in science teacher education of the importance of teachers' content knowledge for teaching (CKT), which includes their subject matter knowledge and their pedagogical content knowledge. However,…
Resource
In this report section, we discuss the importance of aligning classroom assessments with learning goals and instructional practices to both shape and evaluate students’ learning opportunities.
In this…
Resource
Cognitive interviews play an important role in articulating the intended construct of educational assessments. This paper describes the iterative development of protocols for cognitive interviews with kindergarten through…
Resource
This section presents an overview of critical developments in technology-driven, classroom-based innovative assessment practices. It uses a framework organized around cognitive constructs, assessment functionality, and…
Designing Standards-aligned Formative Assessments to Explore Middle School Students’ Understanding of Algorithms
Resource
'Algorithms’ is a core CS concept included in the K-12 CS learning standards, yet student challenges with understanding and using algorithms are still not well documented. This paper describes an approach to decompose the…
Exploring Middle School Students’ Understanding of Algorithms Using Standards-aligned Formative Assessments: Teacher and Researcher Perspectives
Resource
‘Algorithms’ is a core CS concept included in the K-12 CS standards, yet student challenges with understanding different aspects of algorithms are still not well documented, especially for younger students. This paper…
Uncovering Middle School CS Students’ Understanding of Variables and Control Structures: A Cognitive Think-Aloud Approach
Resource
This poster presents findings on middle school students’ understanding of core computer science (CS) concepts, such as variables and control structures, using cognitive think-aloud interviews with eight students…
The Dimensionality of the Epistemic Orientation Survey and Longitudinal Measurement Invariance for the Short Form of EOS (EOS-SF)
Resource
The dimensionality of the epistemic orientation survey (EOS) was examined across four occasions with item factor analysis (IFA). Because of an emphasis on the knowledge generation of epistemic orientation (EO), four…
Resource
Our 5D assessment development process is eight phases, each with a clear goal and tools to support task development. The tools and processes are combined in the 5D Assessment Development Tool for easy access from a single…
Resource
The author describes an innovative approach to assessment that aims to blend the productive characteristics of both summative and formative assessment. The resulting assessment system is accountable to students and…
Toward a Better Understanding of the Nature of Pedagogical Content Knowledge for Fractions: The Role of Experience
Resource
Mathematical knowledge for teaching (MKT) is a professional knowledge crucial for effective mathematics instruction, encompassing both content knowledge (CK) and pedagogical content knowledge (PCK). The purpose of this…
Resource
This portal contains classroom-ready assessments for elementary and middle school teachers to use formatively to gain insights into their students’ progress on achieving NGSS performance expectations.…
Resource
The ASET Toolkit is a Next Generation Science Standards (NGSS) planning toolkit designed to help science educators plan lessons and units that integrate the 3 dimensions outlined in the Framework (NRC, 2012). The toolkit…
Understanding Variation in Integrated STEM Practice as Measured by the STEM Observation Protocol (STEM-OP)
Resource
To better understand integrated STEM education, this work explored scores on the STEM Observation Protocol (STEM-OP), a newly developed observation protocol for use in K-12 science and engineering classrooms. The goals of…
Resource
The purpose of this study was to explore the problem-solving behaviors of middle-school students with learning disabilities (SLD). Think-aloud interviews were performed with 20 seventh- and eighth-grade students who had…
Resource
We present a detailed empirical investigation of feature-based, recurrent neural network, and pre-trained transformer models on scoring content in real-world formative assessment data. We demonstrate that recent neural…
Resource
We use natural language processing (NLP) to identify student ideas in science explanations. The identified ideas, along with Knowledge Integration (KI) pedagogy, informed the design of a question bank to support students…
Teacher Educators’ Use of Formative Feedback During Preservice Teachers’ Simulated Teaching Experiences in Mathematics and Science
Resource
The purpose of this research study was to identify how teacher educators (TEs) attend to and use formative feedback as they work to support preservice teachers’ (PSTs’) learning. The formative feedback was provided to the…
Unpacking the Nuances: An Exploratory Multilevel Analysis on the Operationalization of Integrated STEM Education and Student Attitudinal Change
Resource
Integrated STEM education (iSTEM) is recognized for its potential to improve students’ scientific and mathematical knowledge, as well as to nurture positive attitudes toward STEM, which are essential for motivating…
Combining Natural Language Processing with Epistemic Network Analysis to Investigate Student Knowledge Integration within an AI Dialog
Resource
In this study, we used Epistemic Network Analysis (ENA) to represent data generated by Natural Language Processing (NLP) analytics during an activity based on the Knowledge Integration (KI) framework. The activity features…
Employing Automatic Analysis Tools Aligned to Learning Progressions to Assess Knowledge Application and Support Learning in STEM
Resource
We discuss transforming STEM education using three aspects: learning progressions (LPs), constructed response performance assessments, and artificial intelligence (AI). Using LPs to inform instruction, curriculum, and…
Expanding Uses of the STEM Observation Protocol (STEM-OP): Secondary Science Teachers’ Reflections on Integrated STEM Practice
Resource
There are few guidelines related to how to implement integrated STEM education in the K-12 science classroom. It is important that teachers have opportunities to reflect on integrated STEM instruction when implemented so…
A Usability Analysis and Consequences of Testing Exploration of the Problem-Solving Measures–Computer-Adaptive Test
Resource
Testing is a part of education around the world; however, there are concerns that consequences of testing is underexplored within current educational scholarship. Moreover, usability studies are rare within education. One…
NLP-Enabled Automated Assessment of Scientific Explanations: Towards Eliminating Linguistic Discrimination
Resource
As use of artificial intelligence (AI) has increased, concerns about AI bias and discrimination have been growing. This paper discusses an application called PyrEval in which natural language processing (NLP) was used to…
Resource
We present findings from an analysis of tests of teacher mathematical knowledge identified over a 20-year period of mathematics education literature, and report on how these tests are discussed in the literature, with a…
Unveiling Scoring Processes: Dissecting the Differences Between LLMs and Human Graders in Automatic Scoring
Resource
Large language models (LLMs) have demonstrated strong potential in performing automatic scoring for constructed response assessments. While constructed responses graded by humans are usually based on given grading rubrics…
Culturally and Linguistically Sustaining Formative Assessment in Science and Engineering: Highlighting Multilingual Girls’ Linguistic, Epistemic, and Spatial Brilliances
Resource
This study advances understandings of formative assessment by introducing the Culturally and Linguistically Sustaining Formative Assessment (CLSA) framework, grounded in relational and embodied perspectives and culturally…
Resource
For the promotion of youth voice to be successful, out-of-school-time (OST) program facilitators and classroom teachers need a common understanding of what quality looks and sounds like and support for implementing higher-…
Resource
The significance of children’s mathematical competence during the early years is well established; however, the methods for developing such competencies remain less understood. Specifically, there is a need to identify…
Evaluation of the Cognitive, Psychometric, and Instructional Affordances of Curriculum-embedded Assessments: A Comprehensive Validity-based Approach
Poster
Elementary School
Middle School
Assessment
Cognitive Science
Curriculum
Mathematics…
SimScientists Human Body Systems: Using Simulations to Foster Integrated Understanding of Complex, Dynamic, Interactive Systems
Poster
Middle School
High School
Assessment
Educational Technology
Science
Barbara Buckley…
Visualizing to Integrate Science Understanding for All Learners (VISUAL), Cumulative Learning using Embedded Assessment Results (Clear)
Poster
Middle School
High School
Assessment
Curriculum
Educational Technology
Science
Technology…
Poster
Middle School
Assessment
Educational Technology
Science
Technology
Janice Gobert…
Poster
Middle School
High School
Assessment
Educational Technology
Mathematics
Science
William…
Resource
Liu, O. L., Lee, H.S. & Linn, M.C. (2011a). An investigation of explanation multiple-choice items in science assessment. Educational Assessment, 16, 164-184.
ABSTRACT:
Both multiple-choice and constructed-response…
Resource
Liu, O.L., Lee, H.S., & Linn, M.C. (2011b). Measuring knowledge integration: Validation of four-year assessments. Journal of Research in Science Teaching, 48(9), 1079-1107.
ABSTRACT:
Science education needs valid,…
Resource
The significance of inquiry skills is widely acknowledged in science practice across many areas. Carrying out experimental investigations is an indispensable element of scientific inquiry and, therefore, an important…
A Design Pattern for Observational Investigation Assessment Tasks (Large Scale Assessment Technical Report 2)
Resource
The significance of inquiry skills is widely acknowledged in science practice across many areas. Unlike experimentation, another form of inquiry skill, observational investigation has been much ignored in science…
Resource
Join the panelists from the plenary presentation to continue conversations about common standards in each of the STEM disciplines.
Assessment
Curriculum
Equity…
Resource
In this interactive talk, Wilson will ask each project to make explicit its assumptions about how teachers learn, the forces that matter the most, and how the logic and components of programs reflect those underlying…
Resource
In this session, the presenters discuss findings and experiences regarding technology-embedded assessment and how to support teachers in using it effectively.
Assessment…
Conceptual Framework for Analyzing and Designing Illustrations in Science Assessment: Development and Use in the Testing of Linguistically and Culturally Diverse Populations
Resource
We present a conceptual framework for designing and analyzing illustrations used in science assessment. This conceptual framework is intended to help test developers to systematically create and examine illustrations used…
Resource
Understanding, exploring, and interacting with the world through models characterizes science in all its branches and at all levels of education. Model-based reasoning is central to science education and thus science…
Resource
Assessment
Presentation
Middle
Britte Haugan Cheng
2010
Resource
In this session, the presenters discuss findings and experiences regarding technology-embedded assessment and how to support teachers in using it effectively.
Assessment…
Mathematics Teachers Teaching English Language Learners: What Knowledge Do They Need? (Driscoll, Heck, Chval)
Resource
Mathematics teachers of English language learners (ELLs) are increasingly expected to help ELLs learn academic language. This session focuses on the question, What knowledge do teachers of mathematics need in order to…
Resource
This paper represents measurement methods of projects developing and testing intelligent learning environments.
This paper represents measurement methods of projects developing and testing intelligent…
Resource
Join the panelists from the plenary presentation to continue conversations about common standards in each of the STEM disciplines.
Assessment
Science
Standards…
Resource
This is the final poster that was presented at the PI conference in Washington, DC. it was part of the DRK 12 Sims & Games session proposal of 12 posters.
Assessment
Gaming/…
SURGE: Connecting students' intuitive understandings about kinematics and Newtonian mechanics into explicit formalized frameworks (Clark)
Resource
In this session, the presenters discuss findings and experiences regarding technology-embedded assessment and how to support teachers in using it effectively.
Assessment…
Using Teaching Routines with Classroom Network Technology to Support Improved Classroom Assessment (Penuel, Schank)
Resource
This interactive workshop introduces participants to teaching routines for use with a classroom network technology called Group Scribbles, which supports teachers’ invention of classroom assessment activities in Earth…
Resource
In this short text, the power of formative assessment as a teaching tool is detailed, and examples of opportunities for formative assessment within Foundation Science Biology proposed, for Learning Experiences (LE) 2, 3…
Resource
Create an immersive virtual environment to engage students in problem solving.
Assessment
Science
Publication…
Resource
Current science assessments typically present a series of isolated fact-based questions, poorly representing the complexity of how real-world science is constructed. The National Research Council asserts that this needs to…
Resource
Though many national and international science organizations stress the importance of integrating scientific inquiry into classroom instruction, this is often difficult for teachers. Moreover, assessing and scaffolding…
Resource
The goal of this study was to develop a high school physics course (Energizing Physics, developed by two Boston physics teachers) with an assessment system that has the potential to enable all students to learn how to…
Resource
This webinar, led by Edith Gummer (formerly of NSF), discusses the guidelines outlined in the report co-authored by the Institute of Education Sciences, U.S. Department of Education and the National Science Foundation…
CAREER: Community-Based Engineering as a Learning and Teaching Strategy for Pre-service Urban Elementary Teachers
Poster
Elementary School
Teachers
Urban
Engineering
Assessment
Professional Development…
Resource
Growing attention to preK mathematics and increased focus on standards in the US may be leading policy makers, administrators, and practitioners down the wrong path when it comes to assessing young children. The temptation…
Resource
This paper presents WriteEval, a hybrid text analytics method for analyzing student-constructed responses.
Real-time formative assessment of student learning has become the subject of increasing…
Towards Domain-Independent Assessment of Elementary Students’ Science Competency using Soft Cardinality
Resource
This paper presents a novel application of the soft cardinality text analytics method to support assessment of text.
Automated assessment of student learning has become the subject of increasing…
Resource
A paper on the prototype evolution of the ScratchJr programming environment.
Computer programming for young children has grown in popularity among both education researchers and product developers, but…