Projects

Geometry Assessments for Secondary Teachers (GAST) represents a collaborative partnership among faculty and staff at the University of Louisville, the University of Kentucky, Florida State University, Alpine Testing Solutions, and Horizon Research, Inc. to develop a knowledge framework and assessments for secondary mathematics teachers' geometry knowledge for teaching. The framework for the assessments will be designed to collect validity evidence for predicting effective geometry teaching and improving student achievement.

This project is developing and evaluating a test form that diagnoses teachers' capacities in two closely connected cases of reasoning about multiplicative relations among quantities: fractions and proportions. Teachers' responses to test items will be informative about their capacities to reason about content in ways that support student’s thinking. The project is developing instruments using a new class of psychometric models called Diagnostic Classifcation Models (DCMs) that are based on categorical latent variables.

The goal of this project is to accelerate the progress of early-career and pre-service science teachers from novice to expert-like pedagogical reasoning and practice by developing and studying a system of discourse tools. The tools are aimed at developing teachers' capabilities in shaping instruction around the most fundamental science ideas; scaffolding student thinking; and adapting instruction to diverse student populations by collecting and analyzing student data on their thinking levels.

A principled framework is created for the development of learning progressions in science that can demonstrate how their use can transform the way researchers, educators and curriculum developers conceptualize important scientific constructs. Using the construct of transformation of matter, which requires understanding of both discrete learning goals and also the connections between them, a hypothetical learning progression is constructed for grades 5-12.

Several small-scale experimental classroom studies Star and Rittle-Johnson demonstrate the value of comparison in mathematics learning: Students who learned by comparing and contrasting alternative solution methods made greater gains in conceptual knowledge, procedural knowledge, and flexibility than those who studied the same solution methods one at a time. This study will extend that prior work by developing, piloting, and then evaluating the impact of comparison on students' learning of mathematics in a full-year algebra course.

This project focuses on the challenge of using assessment of relevant STEM content to improve K-12 teaching and learning. CLEAR takes advantage of new technologies and research findings to investigate ways that science assessments can both capture and contribute to cumulative, integrated learning of standards-based concepts in middle school courses. The project will research new forms of assessment that document students' accumulation of knowledge and also serve as learning events.

We are analyzing the intended algebra curriculum as represented in a variety of high-school mathematics textbooks – Core Plus Mathematics Project (CPMP), Discovering Mathematics (Key Curriculum Press), EDC's Center for Mathematics Education, Glencoe, Interactive Mathematics Program (IMP), and University of Chicago School Mathematics Project (UCSMP). The textbook analysis is based on two dimensions frequently used for curriculum analysis: a content dimension and a cognitive dimension.

This project is developing a science teacher education model focused on the establishment of a diagnostic learning environment through formative assessment as a powerful instructional practice for promoting learning of all students (grades 5–12) on the topic of energy with the goal of increasing the understanding of the processes through which teachers develop the requisite knowledge, skills, and dispositions for effective deployment of a formative assessment instructional cycle.

This project uses computer-based models of interacting organisms and their environments to support a learning progression leading to an appreciation of the theory of evolution and evidence that supports it. The project has created a research-based curriculum centered on progressively complex models that exhibit emergent behavior. The project will help improve the teaching of complex scientific topics and provide a reliable means of directly assessing students' conceptual understanding and inquiry skills.

SRI International developed a formative assessment intervention that integrates classroom network technologies and contingent curriculum activities to help middle school teachers adjust instruction to improve student learning of Earth science concepts. The intervention was tested as part of a quasi-experimental study within an urban school district in Colorado that includes ethnically and economically diverse student populations. Findings indicate significant student learning gains for students in implementation classes as compared to students in comparison classes.

This project investigates how vignette illustrations minimize the impact of limited English proficiency on student performance in science tests. Different analyses will determine whether and how ELL and non-ELL students differ significantly on the ways they use vignettes to make sense of items; whether the use of vignettes reduces test-score differences due to language factors between ELL and non-ELL students; and whether the level of distance of the items moderates the effectiveness of vignette-illustrated items.

This project is developing and conducting research on the Cohort Model for addressing the mathematics education of students that perform in the bottom quartile on state and district tests. The predicted outcome is that most students will remain in the cohort for all four years and that almost all of those who do will perform well enough on college entrance exams to be admitted and will test out of remedial mathematics courses.

The SAVE Science project is creating an innovative system using immersive virtual environments for evaluating learning in science, consistent with research- and policy-based recommendations for science learning focused around the big ideas of science content and inquiry for middle school years. Motivation for this comes not only from best practices as outlined in the National Science Education Standards and AAAS' Project 2061, but also from the declining interest and confidence of today's student in science.

This project is writing and researching a book supporting grade 5-8 students in scientific explanations and arguments. The book provides written and video examples from a variety of contexts in terms of content and diversity of students. The book and accompanying facilitator materials also provide different teacher instructional strategies for supporting students. The research focuses on how the book and accompanying professional development impact teachers' beliefs, pedagogical content knowledge and classroom practice.

This project investigates the potential of online role-playing games for scientific literacy through the iterative design and research of Saving Lake Wingra, an online role-playing game around a controversial development project in an urban area. Saving Lake Wingra positions players as ecologists, department of natural resources officials, or journalists investigating a rash of health problems at a local lake, and then creating and debating solutions.

This project is developing an 8th-grade assessment for proportional reasoning from a cognitive diagnosis model (CDM) framework. CDMs are psychometric models developed specifically for diagnosing the presence or absence of fine-grained skills or processes required in solving problems on a test. Assessments based on CDMs can provide information deemed more diagnostic and descriptive, and therefore, more relevant in applied instructional settings.

The purposes of this conference include bringing together 150 participants from all aspects of STEM education to exchange ideas about research, curriculum, and assessment; to help teachers integrate research-based instructional strategies in their teaching; and to build sustainable collaborations between participants. It includes three days of parallel presentations and discussion followed by a two-day summer academy. A focus on research-based strategies that advance the successful participation of underrepresented groups is embedded in all activities.

This conference uses Student Evaluation Standards, published by the Joint Committee on Standards for Educational Evaluation, to engage a broad array of educational organizations in improving student achievement in STEM education through better evaluation practices that assess for learning. Participants learn more about the Student Evaluation Standards and use them together with a benchmarking process - distributed to them in the form of a toolkit - to enhance student evaluation processes.

This project’s overarching goal is to evaluate the assessment components embedded within two NSF-supported mathematics curricula: Everyday Mathematics and Math Trailblazers. The investigators will apply a comprehensive validity perspective that integrates a variety of empirical evidence regarding the cognitive, psychometric, and instructional affordances of multiple assessments embedded in these curricula as part of their overall instructional design.

This project is conducting an empirical analysis of NAEP assessment items in science to determine whether evidence supports the hypothesis that standardized tests capture only a limited amount of student knowledge because of their cultural background. The investigator will create a model of test design more likely to extract student knowledge from students of varied cultures by expanding items’ content. The study will examine the experience of American Indian groups, Alaska Natives, and Pacific Islanders.

This project has pioneered simulation-based assessments of model-based science learning and inquiry practices for middle school physical and life science systems. The assessment suites include curriculum-embedded, formative assessments that provide  immediate, individualized feedback and graduated coaching with supporting reflection activities as well as summative end-of-unit benchmark assessments. The project has documented the instructional benefits, feasibility, utility, and technical quality of the assessments with over 7,000 students and 80 teachers in four states.

This project implemented a facets-of-thinking perspective to design tools and practices to improve high school chemistry teachers' formative assessment practices. Goals are to identify and develop clusters of facets related to key chemistry concepts; develop assessment items; enhance the assessment system for administering items, reporting results, and providing teacher resource materials; develop teacher professional development and resource materials; and examine whether student learning in chemistry improves in classes that incorporate a facet-based assessment system.

A collaboration among educators, engineers, and mathematicians in three universities, this project is creating, implementing, and evaluating a one-year curriculum for teaching a non-calculus, fourth-year high school mathematics course and accompanied assessment instruments. The curriculum will draw on decision-making tools that include but go well beyond linear programming, to enhance student mathematical competence (particularly solving multi-step problems), improve students' attitudes toward mathematics, and promote states' adoption of the curriculum (initially NC and MI).

This project is implementing a program of professional development for teachers and web interface that links scientists with urban classrooms. Scientist mentors work with students and teachers through the web to carry out an original "authentic" inquiry project in plant science. The classroom intervention involves high school biology students working in assigned teams to generate their own research questions in plant science centered on core biology concepts from the National Science Education Standards.

This project aims to (1) determine ways in which Evidence-Centered Design enhances the quality of large-scale, technology-based science assessments for middle school grades and high school equivalency; (2) implement resulting procedures in operational test development; (3) evaluate the efficiency, effectiveness and generalizability of these procedures, and (4) disseminate findings to the assessment community.