Instrument

Diagnostic E-learning Trajectories Approach (DELTA) Applied to Rational Number Reasoning for Grades 3-8

This project aims to develop a software diagnostic tool for integrating diagnostic interviews, group administered assessments, and student data in real-time so that teachers can enter and view student status information. This project would concentrate on rational number learning in grades 3-8. The design is based on a model of learning trajectories developed from existing research studies.

Project Email: 
Award Number: 
0733272
Funding Period: 
Sat, 09/01/2007 to Tue, 08/31/2010
Project Evaluator: 
William Penuel (SRI)
Full Description: 

This project aims to develop a software diagnostic tool for integrating diagnostic interviews, group administered assessments, and student data in real-time so that teachers can enter and view student status information. This project would concentrate on rational number learning in grades 3-8. The design is based on a model of learning trajectories developed from existing research studies.

The diagnostic system to be developed for teachers would be used in assessing their students' knowledge and would identify difficulties in understanding five key clusters of concepts and skills in rational number reasoning. It would also investigate the diagnostic system's effects on student and teacher learning in relation to state standards, assessments, and curricular programs. The five areas include understanding: (1) multiplicative and division space; (2) fractions, ratio, proportion and rates; (3) rectangular area and volume; (4) decimals and percents; and (5) similarity and scaling.

The diagnostic measures will include diagnostic interviews collecting data using a handheld computer, two types of group-administered assessments of student progress, one set along learning trajectories for each of the five sub-constructs and one composite measurement per grade. The diagnostic system will produce computer-based progress maps, summarizing individual student and class performance and linking to state assessments.

Teachers' Use of Standards-based Instructional Materials

This study explores the ways middle school mathematics teachers implement standards-based curriculum materials in urban schools. It takes the view that instructional materials are cultural tools and examines how teachers use these tools to plan and implement the curriculum in their classrooms. The study is using a mixed methods approach that combines surveys of teachers in 30 schools in the Newark Public Schools district and closer observations of teachers in selected case schools.

Lead Organization(s): 
Award Number: 
0732184
Funding Period: 
Sat, 09/01/2007 to Fri, 08/31/2012
Project Evaluator: 
Ashaki Coleman

Mathematics Instruction Using Decision Science and Engineering Tools

A collaboration among educators, engineers, and mathematicians in three universities, this project is creating, implementing, and evaluating a one-year curriculum for teaching a non-calculus, fourth-year high school mathematics course and accompanied assessment instruments. The curriculum will draw on decision-making tools that include but go well beyond linear programming, to enhance student mathematical competence (particularly solving multi-step problems), improve students' attitudes toward mathematics, and promote states' adoption of the curriculum (initially NC and MI).

Project Email: 
Award Number: 
0733137
Funding Period: 
Sat, 09/15/2007 to Tue, 08/31/2010
Project Evaluator: 
Dr. Shlomo S. Sawilowsky
Full Description: 

Mathematics INstruction using Decision Science and Engineering Tools (MINDSET) is a collaboration among educators, engineers, and mathematicians at three universities to create, implement, and evaluate a new curriculum and textbook to teach standard mathematics concepts using math-based decision-making tools for a non-calculus fourth-year mathematics curriculum that several states now require and others may require in the near future. MINDSET has three goals: (1) enhancement of students’ mathematical ability, especially their ability to formulate and solve multi-step problems and interpret results; (2) improvement in students’ attitude toward mathematics, especially those from underrepresented groups, thereby motivating them to study mathematics; and (3) adoption of the curriculum initially in North Carolina and Michigan, then in other states.

Using decision-making tools from Operations Research and Industrial Engineering, we will develop a fourthyear high school curriculum in mathematics and support materials to teach standard content. Through a multi-state, multi-school district assessment, we will determine if a statistically significant improvement in students’ mathematical ability—particularly in multi-step problem solving and interpretation of results—and in motivation and attitude toward mathematics has occurred. Participating teachers will receive professional training, help to create a knowledge-based online community for support, and in-person and online technical assistance. Through extensive data collection and analysis, we will determine if this infrastructure is sustainable and sufficiently flexible to be reproduced and used by others.

Quality Cyber-enabled, Engineering Education Professional Development to Support Teacher Change and Student Achievement (E2PD)

In this project, a video and audio network links elementary school teachers with researchers and educators at Purdue to form a community of practice dedicated to implementing engineering education at the elementary grades. The research plan includes identifying the attributes of face-to-face and cyber-enabled teacher professional development and community building that can transform teachers into master users and designers of engineering education for elementary learners.

Lead Organization(s): 
Award Number: 
0822261
Funding Period: 
Mon, 09/15/2008 to Tue, 08/31/2010
Project Evaluator: 
Rose Marra, University of Missouri-Columbia

CAREER: A Comprehensive Modeling Approach to Cognitively Diagnostic Assessment: Methodological Developments and Practical Implementations

This project is developing an 8th-grade assessment for proportional reasoning from a cognitive diagnosis model (CDM) framework. CDMs are psychometric models developed specifically for diagnosing the presence or absence of fine-grained skills or processes required in solving problems on a test. Assessments based on CDMs can provide information deemed more diagnostic and descriptive, and therefore, more relevant in applied instructional settings.

Lead Organization(s): 
Partner Organization(s): 
Award Number: 
0744486
Funding Period: 
Fri, 08/01/2008 to Sat, 07/31/2010

PUM (PhysicsUnionMathematics) Exploration

The PuM project develops and conducts research on a learning continuum for seamless instruction in middle school physical science and high school physics. The ultimate goal is to use physics as the context to develop mathematics literacy, particularly with students from underrepresented populations and special needs students. The research component analyzes the effects of the curriculum on students' learning while simultaneously investigating teachers' pedagogical content knowledge in a variety of forms.

Lead Organization(s): 
Partner Organization(s): 
Award Number: 
0733140
Funding Period: 
Sat, 09/01/2007 to Tue, 08/31/2010

Diagnosing Teachers' Multiplicative Reasoning

This project is developing and evaluating a test form that diagnoses teachers' capacities in two closely connected cases of reasoning about multiplicative relations among quantities: fractions and proportions. Teachers' responses to test items will be informative about their capacities to reason about content in ways that support student’s thinking. The project is developing instruments using a new class of psychometric models called Diagnostic Classifcation Models (DCMs) that are based on categorical latent variables.

Lead Organization(s): 
Award Number: 
1125621
Funding Period: 
Wed, 09/17/2008 to Thu, 09/30/2010
Project Evaluator: 
Daniel Bolt

Chemistry Facets: Formative Assessment to Improve Student Understanding in Chemistry

This project implemented a facets-of-thinking perspective to design tools and practices to improve high school chemistry teachers' formative assessment practices. Goals are to identify and develop clusters of facets related to key chemistry concepts; develop assessment items; enhance the assessment system for administering items, reporting results, and providing teacher resource materials; develop teacher professional development and resource materials; and examine whether student learning in chemistry improves in classes that incorporate a facet-based assessment system.

Partner Organization(s): 
Award Number: 
0733169
Funding Period: 
Sat, 09/15/2007 to Wed, 08/31/2011
Project Evaluator: 
Heller Research Associates
Full Description: 

Supported by research on students' preconceptions, particularly in chemistry, and the need to build on the knowledge and skills that students bring to the classroom, this project implements a facets-of-thinking perspective for the improvement of formative assessment, learning, and instruction in high school chemistry. Its goals are: to identify and develop clusters of facets (students' ideas and understandings) related to key high school chemistry concepts; to develop assessment items that diagnose facets within each cluster; to enhance the existing web-based Diagnoser assessment system for administering items, reporting results, and providing teacher resource materials for interpreting and using the assessment data; to develop teacher professional development and resource materials to support their use of facet-based approaches in chemistry; and to examine whether student learning in chemistry improves in classes that incorporate a facet-based assessment system.

The proposed work builds on two previously NSF-funded projects focused on designing Diagnoser (ESI-0435727) in the area of physics and on assessment development to support the transition to complex science learning (REC-0129406). The work plan is organized in three strands: (1) Assessment Development, consisting of the development and validation of facet clusters related to the Atomic Structure of Matter and Changes in Matter and the development and validation of question sets related to each facet cluster, including their administration to chemistry classes; (2) Professional Development, through which materials will be produced for a teacher workshop focused on the assessment-for-learning cycle; and (3) Technology Development, to upgrade the Diagnoser authoring system and to include chemistry facets and assessments.

Anticipated products include: (1) 8-10 validated facet clusters related to the Atomic Structure of Matter and Changes in Matter; (2) 12-20 items per facet cluster that provide diagnostic information about student understanding in relation to the facet clusters; (3) additional instructional materials related to each facet cluster, including 1-3 questions to elicit inital student ideas, a developmental lesson to encourage students' exploration of new concepts, and 3-5 prescriptive lessons to address persistent problematic ideas; and (4) a publically-available web-based Diagnoser for chemistry (www.Diagnoser.com), including student assessments and instructional materials.

Honing Diagnostic Practice: Toward a New Model of Teacher Professional Preparation and Development

This project is developing a science teacher education model focused on the establishment of a diagnostic learning environment through formative assessment as a powerful instructional practice for promoting learning of all students (grades 5–12) on the topic of energy with the goal of increasing the understanding of the processes through which teachers develop the requisite knowledge, skills, and dispositions for effective deployment of a formative assessment instructional cycle.

Project Email: 
Lead Organization(s): 
Award Number: 
0822342
Funding Period: 
Mon, 09/01/2008 to Sat, 08/31/2013
Project Evaluator: 
Horizon Research Inc.

Developing Contingent Pedagogies: Integrating Technology-enhanced Feedback into a Middle School Science Curriculum to Improve Conceptual Teaching and Learning

SRI International developed a formative assessment intervention that integrates classroom network technologies and contingent curriculum activities to help middle school teachers adjust instruction to improve student learning of Earth science concepts. The intervention was tested as part of a quasi-experimental study within an urban school district in Colorado that includes ethnically and economically diverse student populations. Findings indicate significant student learning gains for students in implementation classes as compared to students in comparison classes.

Lead Organization(s): 
Award Number: 
0822314
Funding Period: 
Mon, 09/01/2008 to Tue, 08/31/2010
Project Evaluator: 
Christy Kim Boscardin
Full Description: 

SRI is developing a formative assessment intervention that integrates existing classroom network technologies (GroupScribbles and Classroom Performance Systems), interactive formative assessments, and contingent curriculum activities to help teachers adjust instruction to improve middle school student learning of selected Earth science concepts (the rock cycle, forces that shape Earth's surface, and plate tectonics). To test the hypothesis that integrating response system technology, assessment, and curriculum can improve K-12 science teaching and learning, the project is developing and testing (1) pedagogical routines for teachers to follow when using classroom network technologies, (2) diagnostic questions for teachers to elicit student preconceptions, (3) decision rules for teachers to use alternative learning activities that supplement an existing geoscience curriculum, (4) training materials that prepare teachers to enact the intervention, and (5) research- and classroom-based instruments that measure changes in teacher instructional practice, student thinking, and student achievement. The intervention is being tested in two urban school districts located in two western states (Colorado and California) that have ethnically and economically diverse student populations.

Pages

Subscribe to Instrument