Search
Resource
This section presents an overview of critical developments in technology-driven, classroom-based innovative assessment practices. It uses a framework organized around cognitive constructs, assessment functionality, and…
The Dimensionality of the Epistemic Orientation Survey and Longitudinal Measurement Invariance for the Short Form of EOS (EOS-SF)
Resource
The dimensionality of the epistemic orientation survey (EOS) was examined across four occasions with item factor analysis (IFA). Because of an emphasis on the knowledge generation of epistemic orientation (EO), four…
Resource
Our 5D assessment development process is eight phases, each with a clear goal and tools to support task development. The tools and processes are combined in the 5D Assessment Development Tool for easy access from a single…
Resource
This portal contains classroom-ready assessments for elementary and middle school teachers to use formatively to gain insights into their students’ progress on achieving NGSS performance expectations.…
Resource
The ASET Toolkit is a Next Generation Science Standards (NGSS) planning toolkit designed to help science educators plan lessons and units that integrate the 3 dimensions outlined in the Framework (NRC, 2012). The toolkit…
Understanding Variation in Integrated STEM Practice as Measured by the STEM Observation Protocol (STEM-OP)
Resource
To better understand integrated STEM education, this work explored scores on the STEM Observation Protocol (STEM-OP), a newly developed observation protocol for use in K-12 science and engineering classrooms. The goals of…
Resource
We present a detailed empirical investigation of feature-based, recurrent neural network, and pre-trained transformer models on scoring content in real-world formative assessment data. We demonstrate that recent neural…
Resource
We use natural language processing (NLP) to identify student ideas in science explanations. The identified ideas, along with Knowledge Integration (KI) pedagogy, informed the design of a question bank to support students…
Teacher Educators’ Use of Formative Feedback During Preservice Teachers’ Simulated Teaching Experiences in Mathematics and Science
Resource
The purpose of this research study was to identify how teacher educators (TEs) attend to and use formative feedback as they work to support preservice teachers’ (PSTs’) learning. The formative feedback was provided to the…
Unpacking the Nuances: An Exploratory Multilevel Analysis on the Operationalization of Integrated STEM Education and Student Attitudinal Change
Resource
Integrated STEM education (iSTEM) is recognized for its potential to improve students’ scientific and mathematical knowledge, as well as to nurture positive attitudes toward STEM, which are essential for motivating…
Combining Natural Language Processing with Epistemic Network Analysis to Investigate Student Knowledge Integration within an AI Dialog
Resource
In this study, we used Epistemic Network Analysis (ENA) to represent data generated by Natural Language Processing (NLP) analytics during an activity based on the Knowledge Integration (KI) framework. The activity features…
Employing Automatic Analysis Tools Aligned to Learning Progressions to Assess Knowledge Application and Support Learning in STEM
Resource
We discuss transforming STEM education using three aspects: learning progressions (LPs), constructed response performance assessments, and artificial intelligence (AI). Using LPs to inform instruction, curriculum, and…
Expanding Uses of the STEM Observation Protocol (STEM-OP): Secondary Science Teachers’ Reflections on Integrated STEM Practice
Resource
There are few guidelines related to how to implement integrated STEM education in the K-12 science classroom. It is important that teachers have opportunities to reflect on integrated STEM instruction when implemented so…
NLP-Enabled Automated Assessment of Scientific Explanations: Towards Eliminating Linguistic Discrimination
Resource
As use of artificial intelligence (AI) has increased, concerns about AI bias and discrimination have been growing. This paper discusses an application called PyrEval in which natural language processing (NLP) was used to…
Resource
Liu, O. L., Lee, H.S. & Linn, M.C. (2011a). An investigation of explanation multiple-choice items in science assessment. Educational Assessment, 16, 164-184.
ABSTRACT:
Both multiple-choice and constructed-response…
Resource
Liu, O.L., Lee, H.S., & Linn, M.C. (2011b). Measuring knowledge integration: Validation of four-year assessments. Journal of Research in Science Teaching, 48(9), 1079-1107.
ABSTRACT:
Science education needs valid,…
Resource
The significance of inquiry skills is widely acknowledged in science practice across many areas. Carrying out experimental investigations is an indispensable element of scientific inquiry and, therefore, an important…
A Design Pattern for Observational Investigation Assessment Tasks (Large Scale Assessment Technical Report 2)
Resource
The significance of inquiry skills is widely acknowledged in science practice across many areas. Unlike experimentation, another form of inquiry skill, observational investigation has been much ignored in science…
Conceptual Framework for Analyzing and Designing Illustrations in Science Assessment: Development and Use in the Testing of Linguistically and Culturally Diverse Populations
Resource
We present a conceptual framework for designing and analyzing illustrations used in science assessment. This conceptual framework is intended to help test developers to systematically create and examine illustrations used…
Resource
Understanding, exploring, and interacting with the world through models characterizes science in all its branches and at all levels of education. Model-based reasoning is central to science education and thus science…
Resource
In this session, the presenters discuss findings and experiences regarding technology-embedded assessment and how to support teachers in using it effectively.
Assessment…
Resource
Join the panelists from the plenary presentation to continue conversations about common standards in each of the STEM disciplines.
Assessment
Science
Standards…
Resource
This is the final poster that was presented at the PI conference in Washington, DC. it was part of the DRK 12 Sims & Games session proposal of 12 posters.
Assessment
Gaming/…
Resource
In this short text, the power of formative assessment as a teaching tool is detailed, and examples of opportunities for formative assessment within Foundation Science Biology proposed, for Learning Experiences (LE) 2, 3…
Resource
Create an immersive virtual environment to engage students in problem solving.
Assessment
Science
Publication…
Resource
Current science assessments typically present a series of isolated fact-based questions, poorly representing the complexity of how real-world science is constructed. The National Research Council asserts that this needs to…
Resource
Though many national and international science organizations stress the importance of integrating scientific inquiry into classroom instruction, this is often difficult for teachers. Moreover, assessing and scaffolding…
Resource
This paper presents WriteEval, a hybrid text analytics method for analyzing student-constructed responses.
Real-time formative assessment of student learning has become the subject of increasing…
Towards Domain-Independent Assessment of Elementary Students’ Science Competency using Soft Cardinality
Resource
This paper presents a novel application of the soft cardinality text analytics method to support assessment of text.
Automated assessment of student learning has become the subject of increasing…