Assessment

Impact of Graph Technologies in K-12 Science and Mathematics Education

Graph technologies are now widely available in K-12 science and mathematics classrooms. These technologies have the potential to impact the learning of science and mathematics, especially by supporting student investigations. We use meta-analysis to analyze 42 design and comparison studies involving data from 7699 students spanning over 35 years. In these studies, graphing technologies include computer software such as simulations; online tools such as graph utilities; and sensors such as temperature probes. We characterize the assessments used to measure graphing.

Author/Presenter

Dermot FrancisDonnelly-HermosilloaLibby F.GerardbMarcia C.Linn

Year
2020
Short Description

In this article, authors use meta-analysis to analyze 42 design and comparison studies involving data from 7699 students spanning over 35 years.

Chemistry Critical Friendships: Investigating Chemistry-Specific Discourse within a Domain-General Discussion of Best Practices for Inquiry Assessments

High school chemistry teachers struggle to use assessment results to inform instruction. In the absence of expert assistance, teachers often look to their peers for guidance and support; however, little is known about the assessment beliefs and practices of high school chemistry teachers or the discourse mechanisms used as teachers support one another. Presented in this paper are the results from analyzing a discussion between five high school chemistry teachers as they generated a set of best practices for inquiry assessments.

Author/Presenter

Adam G. L. Schafer

Ellen J. Yezierski

Lead Organization(s)
Year
2020
Short Description

Presented in this paper are the results from analyzing a discussion between five high school chemistry teachers as they generated a set of best practices for inquiry assessments.

Characterizing the Formative Assessment Enactment of Experienced Science Teachers

Teachers' use of formative assessment (FA) has been shown to improve student outcomes; however, teachers enact FA in many ways. We examined classroom videos of nine experienced teachers of elementary, middle, and high school science, aiming to create a model of FA enactment that is useful to teachers.

Author/Presenter

Vesal Dini

Hannah Sevian

Klaudja Caushi

Raúl Orduña Picón

Year
2020
Short Description

In this article, authors examined classroom videos of nine experienced teachers of elementary, middle, and high school science, aiming to create a model of FA enactment that is useful to teachers.

The Effect of Automated Feedback on Revision Behavior and Learning Gains in Formative Assessment of Scientific Argument Writing

Application of new automated scoring technologies, such as natural language processing and machine learning, makes it possible to provide automated feedback on students' short written responses. Even though many studies investigated the automated feedback in the computer-mediated learning environments, most of them focused on the multiple-choice items instead of the constructed response items. This study focuses on the latter and investigates a formative feedback system integrated into an online science curriculum module teaching climate change.

Author/Presenter

Mengxiao Zhu

Ou Lydia Liu

Hee-Sun Lee

Lead Organization(s)
Year
2019
Short Description

This study investigates a formative feedback system integrated into an online science curriculum module teaching climate change.

Complementary Assessments of Prospective Teachers’ Skill with Eliciting Student Thinking

As teacher education shifts to focus on teaching beginners to do the work of teaching, assessments need to shift to focus on assessing practice. We focus on one teaching practice, eliciting student thinking, in the context of elementary mathematics. We describe assessments in two contexts (field and simulation). For each assessment, we describe the eliciting of three prospective teachers what could be seen about the skills of group of prospective teachers (N = 44).

Author/Presenter

Meghan Shaughnessy

Timothy A. Boerst

Susanna Owens Farmer

Lead Organization(s)
Year
2019
Short Description

This article reports on how three prospective teachers had differing opportunities to demonstrate their skills in the context of the field assessment, but similar opportunities in the context of the simulation assessment.

Complementary Assessments of Prospective Teachers’ Skill with Eliciting Student Thinking

As teacher education shifts to focus on teaching beginners to do the work of teaching, assessments need to shift to focus on assessing practice. We focus on one teaching practice, eliciting student thinking, in the context of elementary mathematics. We describe assessments in two contexts (field and simulation). For each assessment, we describe the eliciting of three prospective teachers what could be seen about the skills of group of prospective teachers (N = 44).

Author/Presenter

Meghan Shaughnessy

Timothy A. Boerst

Susanna Owens Farmer

Lead Organization(s)
Year
2019
Short Description

This article reports on how three prospective teachers had differing opportunities to demonstrate their skills in the context of the field assessment, but similar opportunities in the context of the simulation assessment.

Understanding Science and Language Connections: New Approaches to Assessment with Bilingual Learners

We report on the use of bilingual constructed response science assessments in the context of a research and development partnership with secondary school science teachers. Given the power that assessments have in today’s education systems, our project provided a series of workshops for teachers where they explored students’ emergent reform-oriented science meaning-making in our project-designed assessments.

Author/Presenter

Cory Buxton

Ruth Harman

Lourdes Cardozo-Gaibisso

Lei Jiang

Khanh Bui

Martha Allexsaht-Snider

Lead Organization(s)
Year
2019
Short Description

Authors report on the use of bilingual constructed response science assessments in the context of a research and development partnership with secondary school science teachers.

Guiding Collaborative Revision of Science Explanations

This paper illustrates how the combination of teacher and computer guidance can strengthen collaborative revision and identifies opportunities for teacher guidance in a computer-supported collaborative learning environment. We took advantage of natural language processing tools embedded in an online, collaborative environment to automatically score student responses using human-designed knowledge integration rubrics. We used the automated explanation scores to assign adaptive guidance to the students and to provide real-time information to the teacher on students’ learning.

Author/Presenter

Libby Gerard

Ady Kidron

Marcia C. Linn

Year
2019
Short Description

This paper illustrates how the combination of teacher and computer guidance can strengthen collaborative revision and identifies opportunities for teacher guidance in a computer-supported collaborative learning environment.

Guiding Collaborative Revision of Science Explanations

This paper illustrates how the combination of teacher and computer guidance can strengthen collaborative revision and identifies opportunities for teacher guidance in a computer-supported collaborative learning environment. We took advantage of natural language processing tools embedded in an online, collaborative environment to automatically score student responses using human-designed knowledge integration rubrics. We used the automated explanation scores to assign adaptive guidance to the students and to provide real-time information to the teacher on students’ learning.

Author/Presenter

Libby Gerard

Ady Kidron

Marcia C. Linn

Year
2019
Short Description

This paper illustrates how the combination of teacher and computer guidance can strengthen collaborative revision and identifies opportunities for teacher guidance in a computer-supported collaborative learning environment.

Aligning Test Scoring Procedures with Test Uses: A Balancing Act

Test scoring procedures should align with the intended uses and interpretations of test results. In this paper, we examine three test scoring procedures for an operational assessment of early numeracy, the Early Grade Mathematics Assessment (EGMA). Current test specifications call for subscores to be reported for each of the eight subtests on the EGMA. This test scoring procedures has been criticized as being difficult for stakeholders to use and interpret, thereby impacting the overall usefulness of the EGMA for informing decisions.

Author/Presenter

Leanne Ketterlin Geller

Lindsey Perry

Linda Platas

Yasmin Sitabkhana

Year
2018
Short Description

Test scoring procedures should align with the intended uses and interpretations of test results. In this paper, we examine three test scoring procedures for an operational assessment of early numeracy, the Early Grade Mathematics Assessment (EGMA). Current test specifications call for subscores to be reported for each of the eight subtests on the EGMA. This test scoring procedures has been criticized as being difficult for stakeholders to use and interpret, thereby impacting the overall usefulness of the EGMA for informing decisions. We examine the psychometric properties including the reliability and distinctiveness of the results and usefulness of reporting test scores as (1) total scores, (2) subscores, and (3) composite scores. These test scoring procedures are compared using data from an actual administration of the EGMA. Conclusions and recommendations for test scoring procedures are made. Generalizations to other testing programs are proposed.