Research

Integrating a Statistical Topic Model and a Diagnostic Classification Model for Analyzing Items in a Mixed Format Assessment

Selected response items and constructed response (CR) items are often found in the same test. Conventional psychometric models for these two types of items typically focus on using the scores for correctness of the responses. Recent research suggests, however, that more information may be available from the CR items than just scores for correctness. In this study, we describe an approach in which a statistical topic model along with a diagnostic classification model (DCM) was applied to a mixed item format formative test of English and Language Arts.

Author/Presenter: 
H.-J. Choi
Seohyun Kim
Allan S. Cohen
Jonathan Templin
Yasemin Copur-Gencturk
Year: 
2021
Short Description: 

Selected response items and constructed response (CR) items are often found in the same test. Conventional psychometric models for these two types of items typically focus on using the scores for correctness of the responses. Recent research suggests, however, that more information may be available from the CR items than just scores for correctness. In this study, we describe an approach in which a statistical topic model along with a diagnostic classification model (DCM) was applied to a mixed item format formative test of English and Language Arts.

Think Alouds: Informing Scholarship and Broadening Partnerships through Assessment

Think alouds are valuable tools for academicians, test developers, and practitioners as they provide a unique window into a respondent’s thinking during an assessment. The purpose of this special issue is to highlight novel ways to use think alouds as a means to gather evidence about respondents’ thinking. An intended outcome from this special issue is that readers may better understand think alouds and feel better equipped to use them in practical and research settings.

Author/Presenter: 
Jonathan David Bostic
Lead Organization(s): 
Year: 
2021
Short Description: 

Introduction to special issue focusing on think alouds and response process evidence. This work cuts across STEM education scholarship and introduces readers to robust means to engage in think alouds.

Gathering Response Process Data for a Problem-Solving Measure through Whole-Class Think Alouds

Response process validity evidence provides a window into a respondent’s cognitive processing. The purpose of this study is to describe a new data collection tool called a whole-class think aloud (WCTA). This work is performed as part of test development for a series of problem-solving measures to be used in elementary and middle grades. Data from third-grade students were collected in a 1–1 think-aloud setting and compared to data from similar students as part of WCTAs. Findings indicated that students performed similarly on the items when the two think-aloud settings were compared.

Author/Presenter: 
Jonathan David Bostic
Toni A. Sondergeld
Gabriel Matney
Gregory Stone
Tiara Hicks
Lead Organization(s): 
Year: 
2021
Short Description: 

This is a description of a new methodological tool to gather response process validity evidence. The context is scholarship within mathematics education contexts.

“Teaching Them How to Fish”: Learning to Learn and Teach Responsively

The Responsive Math Teaching (RMT) project’s 3-year model for professional development introduces teachers to a new instructional model through a full year of monthly Math Circles, where they experience problem solving and productive struggle from the student perspective while working through challenging open-ended tasks, engaging in mathematical discussions, and reflecting on the process. This paper examines teachers’ views of what they learned from this experience and how it affected both their instructional practices and their visions of mathematics teaching and learning.
Author/Presenter: 
Caroline B. Ebby
Brittany Hess
Lizzy Pecora
Jennifer Valerio
Lead Organization(s): 
Year: 
2021
Short Description: 

The Responsive Math Teaching (RMT) project’s 3-year model for professional development introduces teachers to a new instructional model through a full year of monthly Math Circles, where they experience problem solving and productive struggle from the student perspective while working through challenging open-ended tasks, engaging in mathematical discussions, and reflecting on the process. This paper examines teachers’ views of what they learned from this experience and how it affected both their instructional practices and their visions of mathematics teaching and learning.

Computational Participation and the Learner‐Technology Pairing in K‐12 STEM Education

The role of technology in STEM education remains unclear and needs stronger operational definition. In this paper, we explore the theoretical connection between STEM and emergent technologies, with a focus on learner behaviors and the potential of technology-mediated experiences with computational participation (CP) in shaping STEM learning. In particular, by de-emphasizing what technology is used and bringing renewed focus to how the technology is used, we make a case for CP as an epistemological and pedagogical approach that promotes collaborative STEM practices.

Author/Presenter: 
Ramya Sivaraj
Joshua A. Ellis
Jeanna R. Wieselmann
Gillian H. Roehrig
Year: 
2020
Short Description: 

This paper explores the theoretical connection between STEM and emergent technologies, with a focus on learner behaviors and the potential of technology-mediated experiences with computational participation (CP) in shaping STEM learning.

The Leaders Handbook for the Practicum Academy to Improve Science Education (PRACTISE)

This handbook provides detailed information on how to conduct a series of research-based professional learning sessions focused on helping elementary classroom teachers to facilitate science argumentation with their students. Each session is 2-3 hours long and focuses on topics such as:

Author/Presenter: 
Emily Weiss
Craig Strang
Year: 
2017
Short Description: 

The Practicum Academy to Improve Science Education (PRACTISE) is a professional learning program to support scientific argumentation in grades 3-5. This handbook provides detailed information on how to conduct a series of research-based professional learning sessions focused on helping elementary classroom teachers to facilitate science argumentation with their students.

Instructional Scaffolding in STEM Education

This book uses meta-analysis to synthesize research on scaffolding and scaffolding-related interventions in STEM (science, technology, engineering, and mathematics) education. Specifically, the volume examines the extent to which study quality, assessment type, and scaffolding characteristics (strategy, intended outcome, fading schedule, scaffolding intervention, and paired intervention) influence cognitive student outcomes.

Author/Presenter: 
Brian Belland
Lead Organization(s): 
Year: 
2017
Short Description: 

This book examines the extent to which study quality, assessment type, and scaffolding characteristics (strategy, intended outcome, fading schedule, scaffolding intervention, and paired intervention) influence cognitive student outcomes.

Game-Based Learning Assessments: Using Data from Digital Games to Understand Learning

STEM Categorization: 
Day: 
Thu

Discover how digital games can inform classroom teaching using data from innovative formative assessments from three different game-based projects.

Date/Time: 
9:30 am to 11:00 am
Session Materials: 

This session aims to open up a conversation about of how games can be used for formative assessment and how data from digital games can inform classroom teaching.

Session Types: 

Elementary Mathematical Writing Task Force Recommendations: Implications for Research and Classroom Implementation

STEM Categorization: 
Day: 
Thu

Learn about types of and purposes for elementary mathematical writing, and discuss implications for research and classroom implementation.

Date/Time: 
9:30 am to 11:00 am
Session Materials: 

Although the mathematics education community long has emphasized the importance of discourse in teaching and learning mathematics, mathematical writing has not been clearly defined. Questions remain about how writing can leverage elementary students’ learning of mathematics. In October 2015, the Elementary Mathematical Writing Task Force came together and recommended four types of writing (exploratory, informative/explanatory, argumentative, and mathematically creative) and their respective purposes.

Session Types: 

Pages

Subscribe to Research