Climate Change

This study investigates a formative feedback system integrated into an online science curriculum module teaching climate change.

Modeling and argumentation are two important scientific practices students need to develop throughout school years. In this paper, we investigated how middle and high school students (N=512) construct a scientific argument based on evidence from computational models with which they simulated climate change. We designed scientific argumentation tasks with three increasingly complex dynamic climate models. Each scientific argumentation task consisted of four parts: multiple-choice claim, open ended explanation, five-point Likert scale uncertainty rating, and open-ended uncertainty rationale.
We coded 1,294 scientific arguments in terms of a claim’s consistency with current scientific consensus, whether explanations were model based or knowledge based and categorized the sources of uncertainty (personal vs. scientific). We used chi-square and ANOVA tests to identify significant patterns. Results indicate that (1) a majority of students incorporated models as evidence to support their claims, (2) most students used model output results shown on graphs to confirm their claim rather than to explain simulated molecular processes, (3) students’ dependence on model results and their uncertainty rating diminished as the dynamic climate models became more and more complex, (4) some students’ misconceptions interfered with observing and interpreting model results or simulated processes, and (5) students’ uncertainty sources reflected more frequently on their assessment of personal knowledge or abilities related to the tasks than on their critical examination of scientific evidence resulting from models. These findings have implications for teaching and research related to the integration of scientific argumentation and modeling practices to address complex Earth systems.

Though addressing sources of uncertainty is an important part of doing science, it has largely been neglected in assessing students' scientific argumentation. In this study, we initially defined a scientific argumentation construct in four structural elements consisting of claim, justification, uncertainty qualifier, and uncertainty rationale. We consulted literature to characterize and score different levels of student performances on each of these four argumentation elements. We designed a test comprised of nine scientific argumentation tasks addressing climate change, the search for life in space, and fresh water availability and administered it to 473 students from 9 high schools in the United States. After testing the local dependence and unidimensionality assumptions, we found that the uncertainty qualifier element was not aligned with the other three. After removing items related to uncertainty qualifier, we applied a Rasch analysis based on a Partial Credit Model. Results indicate that (1) claim, justification, and uncertainty rationale items form a unidimensional scale, (2) justification and uncertainty rationale items contribute the most on the unidimensional scientific argumentation scale as they cover much wider ranges of the scale than claim items, (3) average item difficulties increase in the order of claim, justification, and uncertainty rationale, (4) students' elaboration of uncertainty exhibits dual characteristics: self-assessment of their own knowledge and ability versus scientific assessment of conceptual and empirical errors embedded in investigations, and (5) students who can make warrants between theory and evidence are more likely to think about uncertainty from scientific sources than those who cannot. We identified limitations of this study in terms of science topic coverage and sample selection and made suggestions on how these limitations might have affected results and interpretations.