Design & Development

Development of a Cognition-Guided, Formative-Assessment-Intensive, Individualized Computer-Based Dynamic Geometry Learning System for Grades 3-8

This project is focused on creating, testing, refining, and studying a computer-based, individualized, interactive learning system for intermediate/middle school students or by teachers in classrooms. This learning system is called Individualized Dynamic Geometry Instruction and will contain four instructional modules in geometry and measurement that reflect the recommendations of the Common Core State Standards.

Lead Organization(s): 
Partner Organization(s): 
Award Number: 
1119034
Funding Period: 
Thu, 09/01/2011 to Mon, 08/31/2015
Project Evaluator: 
Jeff Shih
Full Description: 

Developers and researchers at Ohio State University and KCP Technologies are creating, testing, refining, and studying a computer-based, individualized, interactive learning system for intermediate/middle school students that can be used by them independently (online or offline) or by teachers in classrooms. This learning system is called Individualized Dynamic Geometry Instruction (iDGi) and will contain four instructional modules in geometry and measurement that reflect the recommendations of the Common Core State Standards (CCSS). iDGi courseware fully integrates research-based Learning Progressions (LPs) for guiding students' reasoning; formative-assessment linked to LPs; instructional sequencing that interactively adapts to students' locations in LPs; built-in student monitoring, feedback, and guidance; and research-based principles of educational media into the modules. The software platform for iDGi development is an extended version of the dynamic geometry computer environment, The Geometer's Sketchpad.

The development process follows recommendations in Douglas Clements' Curriculum Research Framework and includes sequences of development, trials with students, data collection, and revision. The research and evaluation are based on random assignment of approximately 350 students to treatment and control groups. Achievement data are collected using developer-constructed instruments with items that reflect the mathematics topics in the CCSS. Researchers explore the variability at the student, teacher, and school levels using the appropriate level of hierarchical linear models.

Commercial publishers have expressed strong interest in publishing online and offline computer versions of iDGi, an iPad version of iDGi, an online management system for iDGi, and support materials for users and teachers.

Supporting Scientific Practices in Elementary and Middle School Classrooms

This project will develop a learning progression that characterizes how learners integrate and interrelate scientific argumentation, explanation and scientific modeling, building ever more sophisticated versions of practice over time using the three common elements of sense-making, persuading peers and developing consensus.

Lead Organization(s): 
Partner Organization(s): 
Award Number: 
1020316
Funding Period: 
Wed, 09/01/2010 to Fri, 08/31/2012
Full Description: 

Research on student learning has developed separate progressions for scientific argumentation, explanation and scientific modeling. Engaging Learners in Scientific Practices develops a learning progression that characterizes how learners integrate and interrelate scientific argumentation, explanation and scientific modeling, building ever more sophisticated versions of practice over time using the three common elements of sense-making, persuading peers and developing consensus. The learning progression is constructed through improvements in students' performance and understanding of scientific practice as measured by their attention to generality of explanation, attention to clarity of communication and audience understanding, attention to evidentiary support, and attention to mechanistic versus descriptive accounts. The project is led by researchers at Northwestern University, the University of Texas, Wright State University, Michigan State University, and the BEAR assessment group. Two cohorts of 180 students each are followed for two years from 4th to 5th grade in Illinois and two cohorts of 180 students each are followed for two years from 5th to 6th grade in Michigan The elementary school students will work with FOSS curriculum units modified to embed supports for scientific practices. Two cohorts of 500 middle school students are followed for three years from 6th to 8th grade as they work with coordinated IQWST units over three years. The outcome measures include analyses of classroom discourse, pre- and pos-test assessments of student learning, and reflective interviews grounded in students' own experiences with practices in the classroom to assess their growth across the dimensions. The BEAR team is responsible for validation and calibration of the frameworks and instruments, and design of the scheme for analysis of the data. Horizon Research performs the formative and summative evaluation. The project will produce an empirically-tested learning progression for scientific practices for grades 4-8 along with tested curriculum materials and validated assessment items that support and measure students' ability in the scientific practices of explanation, argumentation and modeling. In the process of development, an understanding is gained about how to design and test this learning progression. The framework is articulated on a website for use by other researchers and developers. The project also builds capacity by educating several graduate students.


Project Videos

2019 STEM for All Video Showcase

Title: Science Storylines

Presenter(s): Brian Reiser, Kelsey Edwards, Barbara Hug, Tara McGill, Jamie Noll, Michael Novak, Bill Penuel, Trey Smith, & Aliza Zivic


Teachers Empowered to Advance Change in Mathematics (TEACH MATH): Preparing Pre K-8 Teachers to Connect Children's Mathematical Thinking and Community-Based Funds of Knowledge

This project will modify the teacher preparation program for preK-8 teachers. The program is designed to help pre-service teachers learn mathematics well, learn to access students' cultural funds of knowledge, and learn to encourage students' mathematical thinking. The developers are designing (a) modules that can be used in teacher preparation courses, (b) a mentoring program for new teachers, and (c) on-line networks to facilitate collaboration among participating teachers and institutions.

Lead Organization(s): 
Award Number: 
1228034
Funding Period: 
Thu, 09/01/2011 to Thu, 08/31/2017
Project Evaluator: 
Research Institute for Studies in Education
Full Description: 

This research and development project will modify the teacher preparation program for preK-8 teachers at six universities located in different regions of the U.S. The new program is designed to help pre-service teachers learn mathematics well, learn to access students' cultural funds of knowledge in ways that will help them teach mathematics, and learn to encourage students' mathematical thinking. By integrating these important bodies of knowledge, pre-service teachers should be better prepared to teach mathematics to the variety of students in their classes. The developers are designing (a) modules that can be used in teacher preparation courses, (b) a mentoring program for new teachers, and (c) on-line networks to facilitate collaboration among participating teachers and institutions.

The project includes a study of how pre-service teachers learn to apply the knowledge they have gained in the program. The research team has planned a longitudinal collection of data that will track the pre-service teachers into their careers. Their goal is to document teachers' understandings of children's mathematical thinking and children's cultural funds of knowledge and to understand the relationship between teachers' understandings and the learning and disposition of preK-8 students. The study will be implemented at all six universities with staggered start dates allowing for analysis and revisions between cohorts.

These research and development efforts have the potential to impact preK-8 teacher preparation through (1) the development of modules that integrate several relevant proficiencies in mathematics teaching, and (2) the research that studies the impact of such a program on the mathematical learning and disposition of preK-8 students.

Professional Development for Culturally Relevant Teaching and Learning in Pre-K Mathematics

This project is creating and studying a professional development model to support preK teachers in developing culturally and developmentally appropriate practices in counting and early number. The proposed model is targeted at teachers of children in four-year-old kindergarten, and focuses on culturally relevant teaching and learning. The model stresses counting and basic number operations with the intention of exploring the domain as it connects to children's experiences in their homes and communities.

Award Number: 
1019431
Funding Period: 
Wed, 09/01/2010 to Fri, 08/31/2018
Project Evaluator: 
Victoria Jacobs
Full Description: 

Developers and researchers at the University of Wisconsin are creating and studying a professional development model that connects research in counting and early number (CGI), early childhood, and funds of knowledge. The proposed model is targeted at teachers of children in four-year-old kindergarten, and focuses on culturally relevant teaching and learning. The model stresses a specific, circumscribed content domain - counting and basic number operations - with the intention of exploring the domain in depth particularly as it connects to children's experiences in their homes and communities and how it is learned and taught through play.

The project designs, develops, and tests innovative resources and models for teachers to support ongoing professional learning communities. These learning communities are designed to identify and build on the rich mathematical understandings of all pre-K children. The project's specific goals are to instantiate a reciprocal "funds of knowledge" framework for (a) accessing children's out-of-school experiences in order to provide instruction that is equitable and culturally relevant and (b) developing culturally effective ways to support families in understanding how to mathematize their children's out-of-school activities. Teachers are observed weekly during the development and evaluation process and student assessments are used to measure students' progress toward meeting project benchmarks and the program's effectiveness in reducing or eliminating the achievement gap.

The outcome is a complete professional development model that includes written and digital materials. The product includes case studies, classroom video, examples of student work, and strategies for responding to students' understandings.

Measurement Approach to Rational Number (MARN)

This project is designing, developing, and testing an innovative approach to elementary students' learning in the critical areas of multiplicative reasoning, fractions, and proportional reasoning. The project is building on the successful El'Konin-Davydov (E-D) elementary mathematics curriculum that originated in Russia to develop a curriculum framework that can be implemented in U. S. schools. The ultimate product of the research will be a rational number learning progression consisting of carefully articulated and sequenced learning goals.

Lead Organization(s): 
Partner Organization(s): 
Award Number: 
1020154
Funding Period: 
Thu, 07/15/2010 to Tue, 06/30/2015
Full Description: 

The Measurement Approach to Rational Number (MARN) project is a collaborative effort by faculty at New York University, Iowa State University, and the Illinois Institute of Technology that is designing, developing, and testing an innovative approach to elementary students' learning in the critical areas of multiplicative reasoning, fractions, and proportional reasoning. The project team is building on the successful El'Konin-Davydov (E-D) elementary mathematics curriculum that originated in Russia to develop a curriculum framework that can be implemented in U. S. schools.

The MARN project addresses five core research questions about how rational number learning can be developed from a measurement perspective and how sociocultural theory and constructivism can contribute to design of effective learning trajectories based on that perspective. The project begins with careful analysis of the E-D curriculum embodied in Russian mathematics materials, of classroom data from a Hawaii implementation of the E-D curriculum, and of relevant prior curriculum development projects in other U. S. contexts. Work is proceeding from development of an initial curriculum framework through intensive teaching experiments to implementation and modification of the framework in the course of classroom design experiments.

The ultimate product of the research and development effort will be a rational number learning progression consisting of carefully articulated and sequenced learning goals. The curriculum framework will also include mathematical tasks to foster learning of each concept, description of predicted student learning in the context of the tasks, a set of assessment items related to each concept, and guidelines for relevant teacher interventions. Thus, the framework will provide a foundation for development of curriculum units.

Integrating Engineering and Literacy

This project is developing and testing curriculum materials and a professional development model designed to explore the potential for introducing engineering concepts in grades 3 - 5 through design challenges based on stories in popular children's literature. The research team hypothesizes that professional development for elementary teachers using an interdisciplinary method for combining literature with engineering design challenges will increase the implementation of engineering in 3-5 classrooms and have positive impacts on students.

Lead Organization(s): 
Award Number: 
1020243
Funding Period: 
Wed, 09/01/2010 to Wed, 05/31/2017
Full Description: 

The Integrating Engineering and Literacy (IEL) project is developing and testing curriculum materials and a professional development model designed to explore the potential for introducing engineering concepts in grades 3 - 5 through design challenges based on stories in popular children's literature. The project research and development team at Tufts University is working with pre-service teachers to design and test the curriculum modules for students and the teacher professional development model. Then the program is tested and refined in work with 100 in-service teachers and their students in a diverse set of Massachusetts schools. The research team hypothesizes that professional development for elementary teachers using an interdisciplinary method for combining literature with engineering design challenges will increase the implementation of engineering in 3-5 classrooms and have positive impacts on students. The driving questions behind this proposed research are: (1) How do teachers' engineering (and STEM) content knowledge, pedagogical content knowledge, and perceptions or attitudes toward engineering influence their classroom teaching of engineering through literacy? (2) Do teachers create their own personal conceptions of the engineering design process, and what do these conceptions look like? (3) What engineering/reading thinking skills are students developing by participating in engineering activities integrated into their reading and writing work? The curriculum materials and teacher professional development model are being produced by a design research strategy that uses cycles of develop/test/refine work. The effects of the program are being evaluated by a variety of measures of student and teacher learning and practice. The project will contribute materials and research findings to the ultimate goal of understanding how to provide elementary school students with meaningful opportunities to learn engineering and develop valuable problem solving and thinking skills.

INK-12: Teaching and Learning Using Interactive Ink Inscriptions in K-12 (Collaborative Research: Koile)

This is a continuing research project that supports (1) creation of what are termed "ink inscriptions"--handwritten sketches, graphs, maps, notes, etc. made on a computer using a pen-based interface, and (2) in-class communication of ink inscriptions via a set of connected wireless tablet computers. The primary products are substantiated research findings on the use of tablet computers and inscriptions in 4th and 5th grade math and science, as well as models for teacher education and use.
Award Number: 
1020152
Funding Period: 
Wed, 09/01/2010 to Sun, 08/31/2014
Project Evaluator: 
David Reider, Education Design Inc.
Full Description: 

The research project continues a collaboration between MIT's Center for Educational Computing Initiatives and TERC focusing on the enhancement of K-12 STEM math and science education by means of technology that supports (1) creation of what are termed "ink inscriptions"--handwritten sketches, graphs, maps, notes, etc. made on a computer using a pen-based interface, and (2) in-class communication of ink inscriptions via a set of connected wireless tablet computers. The project builds on the PIs' prior work, which demonstrated that both teachers and students benefit from such technology because they can easily draw and write on a tablet screens, thus using representations not possible with only a typical keyboard and mouse; and they can easily send such ink inscriptions to one another via wireless connectivity. This communication provides teachers the opportunity to view all the students' work and make decisions about which to share anonymously on a public classroom screen or on every student's screen in order to support discussion in a "conversation-based" classroom. Artificial intelligence methods are used to analyze ink inscriptions in order to facilitate selection and discussion of student work.

The project is a series of design experiments beginning with the software that emerged from earlier exploratory work. The PIs conduct two cycles of experiments to examine how tablets affect students learning in 4th and 5th grade mathematics and science. The project research questions and methods focus on systematic monitoring of teachers' and students' responses to the innovation in order to inform the development process. The PIs collect data on teachers' and students' use of the technology and on student learning outcomes and use those data as empirical evidence about the promise of the technology for improving STEM education in K-12 schools. An external evaluator uses parallel data collection, conducting many of the same research activities as the core team and independently providing analysis to be correlated with other data. His involvement is continuous and provides formative evaluation reports to the project through conferences, site visits, and conference calls.

The primary products are substantiated research findings on the use of tablet computers, inscriptions, and networks in 4th and 5 grade classrooms. In addition the PIs develop models for teacher education and use, and demonstrate the utility of artificial intelligence techniques in facilitating use of the technology. With the addition of Malden Public Schools to the list of participating districts, which includes Cambridge Public Schools and Waltham Public Schools from earlier work, the project expands the field test sites to up 20 schools' classrooms.

CAREER: Supporting Middle School Students' Construction of Evidence-Based Arguments

Doing science requires that students learn to create evidence-based arguments (EBAs), defined as claims connected to supporting evidence via premises. In this CAREER project, I investigate how argumentation ability can be enhanced among middle school students. The project entails theoretical work, instructional design, and empirical work, and involves 3 middle schools in northern Utah and southern Idaho.

Lead Organization(s): 
Partner Organization(s): 
Award Number: 
0953046
Funding Period: 
Sun, 08/15/2010 to Fri, 07/31/2015
Project Evaluator: 
David Williams
Full Description: 

Doing science requires that students learn to create evidence-based arguments (EBAs), defined as claims connected to supporting evidence via premises. The question chosen for study by a new researcher at Utah State University is: How can argumentation ability be enhanced among middle school students? This study involves 325 middle school students in 12 class sections from 3 school districts in Utah and Idaho. First, students in middle school science classrooms will be introduced to problem-based learning (PBL) units that allow them to investigate ill-structured science problems. These activities provide students with something about which to argue: something that they have explored personally and with which they have grappled. Next, they will construct arguments using a powerful computer technology, the Connection Log, developed by the PI. The Connection Log provides a scaffold for building arguments, allowing each student to write about his/her reasoning and compare it to arguments built by peers. The study investigates how the Connection Log improves the quality of students' arguments. It also explores whether students are able to transfer what they have learned to new situations that call for argumentation.

This study is set in 6th and 7th grade science classrooms with students of diverse SES, ethnicity, and achievement levels. The Connection Log software supports middle school students with written prompts on a computer screen that take students through the construction of an argument. The system allows students to share their arguments with other members of their PBL group. The first generation version of the Connection Log asks students to:

1. define the problem, or state the problem in their own words

2. determine needed information, or decide on evidence they need to find to solve the problem

3. find and organize needed information

4. develop a claim, or make an assertion stating a possible problem solution

5. link evidence to claim, linking specific, relevant data to assertions

The model will be optimized through a process of design-based research. The study uses a mixed methods research design employing argument evaluation tests, video, interviews, database information, debate ratings, and a mental models measure, to evaluate student progress.

This study is important because research has shown that students do not automatically come to school prepared to create evidence-based arguments. Middle school students face three major challenges in argumentation: adequately representing the central problem of the unit; determining and obtaining the most relevant evidence; and synthesizing gathered information to construct a sound argument. Argumentation ability is crucial to STEM performance and to access to STEM careers. Without the ability to formulate arguments based upon evidence, middle school students are likely to be left out of the STEM pipeline, avoid STEM careers, and have less ability to critically evaluate and understand scientific findings as citizens. By testing and refining the Connection Log, the project has the potential for scaling up for use in science classrooms (and beyond) throughout the United States.

Integrating Computing Across the Curriculum (ICAC): Incorporating Technology into STEM Education Using XO Laptops

This project builds and tests applications tied to the school curriculum that integrate the sciences with mathematics, computational thinking, reading and writing in elementary schools. The investigative core of the project is to determine how to best integrate computing across the curriculum in such a way as to support STEM learning and lead more urban children to STEM career paths.

Project Email: 
Award Number: 
1404467
Funding Period: 
Sat, 08/01/2009 to Sun, 07/31/2011
Project Evaluator: 
Leslie Cooksy - Univ. of Delaware
Full Description: 

Computer access has opened an exciting new dimension for STEM education; however, if computers in the classroom are to realize their full potential as a tool for advancing STEM education, methods must be developed to allow them to serve as a bridge across the STEM disciplines. The goal of this 60-month multi-method, multi-disciplinary ICAC project is to develop and test a program to increase the number of students in the STEM pipeline by providing teachers and students with curricular training and skills to enhance STEM education in elementary schools. ICAC will be implemented in an urban and predominantly African American school system, since these schools traditionally lag behind in filling the STEM pipeline. Specifically, ICAC will increase computer proficiency (e.g., general usage and programming), science, and mathematics skills of teachers and 4th and 5th grade students, and inform parents about the opportunities available in STEM-centered careers for their children.

The Specific Aims of ICAC are to:

SA1. Conduct a formative assessment with teachers to determine the optimal intervention to ensure productive school, principal, teacher, and student participation.

SA2. Implement a structured intervention aimed at (1) teachers, (2) students, and (3) families that will enhance the students’ understanding of STEM fundamentals by incorporating laptops into an inquiry-based educational process.

SA3. Assess the effects of ICAC on:

a. Student STEM  engagement and performance.

b. Teacher and student computing specific confidence and utilization.

c. Student interest in technology and STEM careers.

d. Parents’ attitudes toward STEM careers and use of computers.

To enable us to complete the specific aims noted above, we have conducted a variety of project activities in Years 1-3. These include:

  1. Classroom observations at the two Year 1 pilot schools
  2. Project scaling to 6 schools in Year 2 and 10 schools in Year 3
  3. Semi-structured school administrator interviews in schools
  4. Professional development sessions for teachers
  5. Drafting of curriculum modules to be used in summer teacher institutes and for dissemination
  6. In-class demonstration of curriculum modules
  7. Scratch festivals each May
  8. Summer teacher institutes
  9. Student summer camps
  10. Surveying of teachers in summer institutes
  11. Surveying of teachers and students at the beginning and end of the school year
  12. Showcase event at end of student workshops

The specific ICAC activities for Years 2-5 include:

  • Professional development sessions (twice monthly for teachers), to integrate the ‘best practices’ from the program.
  • Working groups led by a grade-specific lead teacher. The lead teacher for each grade in each school will identify areas where assistance is needed and will gather the grade-specific cohort of teachers at their school once every two weeks for a meeting to discuss the progress made in addition to challenges to or successes in curricula development.  
  • ICAC staff and prior trained teachers will visit each class monthly during the year to assist the teachers and to evaluate specific challenges and opportunities for the use of XOs in that classroom.  
  • In class sessions at least once per month (most likely more often given feedback from Teacher Summer Institutes) to demonstrate lesson plans and assist teachers as they implement lesson plans.
  • ICAC staff will also hold a joint meeting of administrators of all target schools each year to assess program progress and challenges. 
  • Teacher Summer Institutes – scaled-up to teachers from the new schools each summer to provide training in how to incorporate computing into their curriculum.
  • Administrator sessions during the Teacher Summer Institutes; designed to provide insight into how the laptops can facilitate the education and comprehension of their students in all areas of the curriculum, discuss flexible models for physical classroom organization to facilitate student learning, and discussions related to how to optimize the use of computing to enhance STEM curricula in their schools.  Student Summer Computing Camps – designed to teach students computing concepts, make computing fun, and enhance their interest in STEM careers.  
  • ICAC will sponsor a yearly showcase event in Years 2-5 that provides opportunities for parents to learn more about technology skills their children are learning (e.g., career options in STEM areas, overview of ICAC, and summary of student projects). At this event, a yearly citywide competition among students also will be held that is an expanded version of the weeklong showcase event during the student summer camps.
  • Surveying of students twice a year in intervention schools.
  • Surveying of teachers at Summer Institutes and then at the end of the academic year.
  • Coding and entry of survey data; coding of interview and observational data.
  • Data analysis to examine the specific aims (SA) noted above:
    • The impact of ICAC on teacher computing confidence and utilization (SA 3.b).
    • Assess the effects of (1) teacher XO training on student computing confidence and utilization (SA 3.b), (2) training on changes in interest in STEM careers (SA 3.c), and (3) XO training on student engagement (SA 3.a).
    • A quasi-experimental comparison of intervention and non-intervention schools to assess intervention effects on student achievement (SA 3.a).
    • Survey of parents attending the yearly ICAC showcase to assess effects on parental attitudes toward STEM careers and computing (SA 3.d).

The proposed research has the potential for broad impact by leveraging technology in BCS to influence over 8,000 students in the Birmingham area. By targeting 4th and 5th grade students, we expect to impact STEM engagement and preparedness of students before they move into a critical educational and career decision-making process. Further, by bolstering student computer and STEM knowledge, ICAC will impart highly marketable skills that prepare them for the 81% of new jobs that are projected to be in computing and engineering in coming years (as predicted by the US Bureau of Labor Statistics).3 Through its formative and summative assessment, ICAC will offer intellectual merit by providing teachers throughout the US with insights into how computers can be used to integrate the elementary STEM curriculum. ICAC will develop a model for using computers to enhance STEM education across the curriculum while instilling a culture among BCS schools where computing is viewed as a tool for learning.

(Previously listed under Award # 0918216)

Math Pathways and Pitfalls: Capturing What Works for Anytime Anyplace Professional Development

Math Pathways & Pitfalls lessons for students boost mathematics achievement for diverse students, including English Learners, English Proficient students, and Latino students. This project develops modules that increase teachers’ capacity to employ the effective and equitable principles of practice embodied by Math Pathways & Pitfalls and apply these practices to any mathematics lesson. This four-year project develops, field tests, and evaluates 10 online professional development modules.

Lead Organization(s): 
Award Number: 
0918834
Funding Period: 
Tue, 09/15/2009 to Fri, 08/31/2012
Full Description: 

Researchers and developers at WestEd are developing, field-testing, and evaluating ten online professional development modules anchored in research-based teaching principles and achievement-boosting mathematics materials. The modules provide interactive learning opportunities featuring real classroom video demonstrations, simulations, and scaffolded implementation. The professional development module development builds on the Math Pathways and Pitfalls instructional modules for elementary and middle school students developed with NSF support. The professional development provided through the use of these modules is web-based (rather than face-to-face), is provided in chunks during the school year and immediately applied in the classroom (rather than summer professional development and school year application), and explicitly models ways to apply key teaching principles to regular mathematics lessons (rather than expecting teachers to extract and apply principles spontaneously).

The project studies the impact of the modules on teaching practice with an experimental design that involves 20 treatment teachers and 20 control teachers. Data are gathered from teacher questionnaires, classroom observations, and post-observation interviews.

Pages

Subscribe to Design & Development