Digital Media

Taking Foundation Science to Scale—Digitally: Transforming a Print Curriculum into an Innovative Learning Tool for Commercial Distribution

This project provides a model of how existing, tested digital enhancements can increase student learning. Increasing the quality of science education requires careful coupling of effective, research-based curricula with innovative digital features that deepen and enhance science learning and teaching. This RAPID is to ensure that the content and pedagogical expertise is present during the development of the digital version of Foundation science.

Award Number: 
1119736
Funding Period: 
Fri, 04/01/2011 to Sun, 03/31/2013
Full Description: 

The print version of Foundation Science, a comprehensive high school science curriculum, has been extensively field tested and shown to be effective in increasing student learning and changing teacher practice. Carolina Biological Supply is scheduled to publish a digital version of Biology and Chemistry portions of Foundation Science that goes well beyond the conversion of print text to digital delivery by September 2012. Many digital enhancements have been developed and tested in the biology unit of Foundation Science, which was used as a model to develop a system to incorporate Universal Design for learning features in materials development and in on-line professional development for cross-over teachers. Some of the digital resources include a digital book reader; a notebook in which notes can take various forms such as text, drawing, voice recording; separate unscored assessments; an interactive glossary; graphing capabilities and an online research tool.

Thus this project provides a model of how existing, tested digital enhancements can increase student learning. Increasing the quality of science education requires careful coupling of effective, research-based curricula with innovative digital features that deepen and enhance science learning and teaching. This RAPID is to ensure that the content and pedagogical expertise is present during the development of the digital version of Foundation science.

Continuous Learning and Automated Scoring in Science (CLASS)

This five-year project investigates how to provide continuous assessment and feedback to guide students' understanding during science inquiry-learning experiences, as well as detailed guidance to teachers and administrators through a technology-enhanced system. The assessment system integrates validated automated scorings for students' written responses to open-ended assessment items into the "Web-based Inquiry Science Environment" (WISE) program.

Award Number: 
1119670
Funding Period: 
Thu, 09/01/2011 to Mon, 08/31/2015
Full Description: 

This five-year project investigates how to provide continuous assessment and feedback to guide students' understanding during science inquiry-learning experiences, as well as detailed guidance to teachers and administrators through a technology-enhanced system. The assessment system integrates validated automated scorings for students' written responses to open-ended assessment items (i.e., short essays, science narratives, concept mapping, graphing problems, and virtual experiments) into the "Web-based Inquiry Science Environment" (WISE) program. WISE is an online science-inquiry curricula that supports deep understanding through visualization of processes not directly observable, virtual experiments, graphing results, collaboration, and response to prompts for explanations. In partnership with Educational Testing Services (ETS), project goals are: (1) to develop five automated inquiry assessment activities that capture students' abilities to integrate their ideas and form coherent scientific arguments; (2) to customize WISE by incorporating automated scores; (3) to investigate how students' systematic feedback based on these scores improve their learning outcomes; and (4) to design professional development resources to help teachers use scores to improve classroom instruction, and administrators to make better informed decisions about teacher professional development and inquiry instruction. The project targets general science (life, physical, and earth) in three northern California school districts, five middle schools serving over 4,000 6th-8th grade students with diverse cultural and linguistic backgrounds, and 29 science teachers. It contributes to increase opportunities for students to improve their science achievement, and for teachers and administrators to make efficient, evidence-based decisions about high-quality teaching and learning.

A key research question guides this effort: How automated scoring of inquiry assessments can increase success for diverse students, improve teachers' instructional practices, and inform administrators' decisions about professional development, inquiry instruction, and assessment? To develop science inquiry assessment activities, scoring written responses include semantic, syntax, and structure of meaning analyses, as well as calibration of human-scored items with a computer-scoring system through the c-rater--an ETS-developed cyber learning technology. Validity studies are conducted to compare automated scores with human-scored items, teacher, district, and state scores, including sensitivity to the diverse student population. To customize the WISE curriculum, the project modifies 12 existing units and develops nine new modules. To design adaptive feedback to students, comparative studies explore options for adaptive guidance and test alternatives based on automated scores employing linear models to compare student performance across randomly assigned guidance conditions; controlling for covariates, such as prior science scores, gender, and language; and grouping comparison studies. To design teacher professional development, synthesis reports on auto-scored data are created to enable them to use evidence to guide curricular decisions, and comments' analysis to improve feedback quality. Workshops, classroom observations, and interviews are conducted to measure longitudinal teachers' change over time. To empower administrators' decision making, special data reports, using-evidence activities, individual interviews, and observation of administrators' meetings are conducted. An advisory board charged with project evaluation addresses both formative and summative aspects.

A research-informed model to improve science teaching and learning at the middle school level through cyber-enabled assessment is the main outcome of this effort. A total of 21 new, one- to three-week duration standards-based science units, each with four or more automatically scored items, serve as prototypes to improve students' performance, teachers' instructional approaches, and administrators' school policies and practices.

Development of a Cognition-Guided, Formative-Assessment-Intensive, Individualized Computer-Based Dynamic Geometry Learning System for Grades 3-8

This project is focused on creating, testing, refining, and studying a computer-based, individualized, interactive learning system for intermediate/middle school students or by teachers in classrooms. This learning system is called Individualized Dynamic Geometry Instruction and will contain four instructional modules in geometry and measurement that reflect the recommendations of the Common Core State Standards.

Lead Organization(s): 
Partner Organization(s): 
Award Number: 
1119034
Funding Period: 
Thu, 09/01/2011 to Mon, 08/31/2015
Project Evaluator: 
Jeff Shih
Full Description: 

Developers and researchers at Ohio State University and KCP Technologies are creating, testing, refining, and studying a computer-based, individualized, interactive learning system for intermediate/middle school students that can be used by them independently (online or offline) or by teachers in classrooms. This learning system is called Individualized Dynamic Geometry Instruction (iDGi) and will contain four instructional modules in geometry and measurement that reflect the recommendations of the Common Core State Standards (CCSS). iDGi courseware fully integrates research-based Learning Progressions (LPs) for guiding students' reasoning; formative-assessment linked to LPs; instructional sequencing that interactively adapts to students' locations in LPs; built-in student monitoring, feedback, and guidance; and research-based principles of educational media into the modules. The software platform for iDGi development is an extended version of the dynamic geometry computer environment, The Geometer's Sketchpad.

The development process follows recommendations in Douglas Clements' Curriculum Research Framework and includes sequences of development, trials with students, data collection, and revision. The research and evaluation are based on random assignment of approximately 350 students to treatment and control groups. Achievement data are collected using developer-constructed instruments with items that reflect the mathematics topics in the CCSS. Researchers explore the variability at the student, teacher, and school levels using the appropriate level of hierarchical linear models.

Commercial publishers have expressed strong interest in publishing online and offline computer versions of iDGi, an iPad version of iDGi, an online management system for iDGi, and support materials for users and teachers.

Developing and Testing a Model to Support Student Understanding of the Sub-microscopic Interactions That Govern Biological and Chemical Processes

This project designs, develops, and tests coherent interdisciplinary instructional materials to support high school students' integrated understanding of the forces and energetics involved in interactions that occur between atoms and molecules, and explores how students' learning progresses across time. The project will be implemented in three Michigan school districts with students who traditionally do not succeed in science. 

Award Number: 
1232388
Funding Period: 
Thu, 09/01/2011 to Wed, 08/31/2016
Project Evaluator: 
Steven McGee, The Learning Partnership
Full Description: 

This project designs, develops, and tests coherent interdisciplinary instructional materials to support high school students' integrated understanding of the forces and energetics involved in interactions that occur between atoms and molecules, and explores how students' learning progresses across time. Instructional materials focus on physical science core ideas identified in "A Framework for K-12 Science Education" (NRC, 2011), and "College Board Standards for College Success" (College Board, 2009). The two research questions are: (1) How does learning progress over time when students experience a set of interdisciplinary instructional materials designed to help them advance toward important learning goals related to interactions at very small scales?; and (2) How do the various learning activities support the development of integrated understanding? The project is implemented in three Michigan school districts with students who traditionally do not succeed in science. Two of the school districts serve urban communities with ethnically diverse student populations; the third serves a rural, primarily Caucasian community. 

To develop and test instructional materials and associated assessments, the project joins efforts with the Concord Consortium and employs the Construct-Centered Design process (a principled process based on evidence-centered assessment and learning goal-driven designs); uses physical and computer-based models and simulations; and draws on previous and ongoing work on a learning progression of the hypothetical students' path in their understanding of the structure, properties, interactions, and transformations of matter. Four instructional units are produced: (1) Introduction to Electrical Forces, (2) Water, (3) Larger Molecules, and (4) Bio-Molecules, with a duration of two to six weeks each. After testing for usability, the units go through two additional phases. Phase I comprises pilot testing with at least one teacher at two sites, two classrooms each, yielding information from 100-120 students per unit. Phase II consists of field testing the units with a larger sample. Using a power analysis to determine sample size, the project tests two different sequences of the units: (a) four teachers, eight classrooms, and 200 students use the units as a single semester course before taking biology or chemistry; and (b) four teachers, eight classrooms, and 200 students use the units in appropriate points within a chemistry or biology course. Eight teachers from the same school districts, 16 classrooms, and 400 students who do not use the units, serve as the comparison group. A mixed-methods approach is used to collect and analyze data. Data collection strategies include: (a) pre- and post- tests, (b) unit-embedded assessments, (c) students' interest and attitudes, (d) assessments to place students in the learning progression, (e) classroom observations, (f) analysis of student classroom work, and (g) interviews with students and teachers. Data interpretation strategies include: (a) coding of students' and teachers' responses from interviews, (b) identification of patterns, and (c) using item-response theory (IRT) procedures to place students' responses in the learning progression. A range of methods are used to assess validity and reliability of instruments used, including: (a) construct validity, (b) content validity, and (c) IRT procedures. Project external evaluation addresses both formative and summative aspects.

Key project outcomes include: (a) a research-informed and field-tested semester-long course comprising four integrated units with specific objectives, learning tasks, phenomena to illustrate and support understanding at key points, reading materials, and embedded assessments; (b) computer simulations aligned with the units; (c) educative materials for teachers; (d) valid and reliable instruments to measure students' understanding and attitudes; and (e) a set of research manuscripts focused on how the new materials work and promote student learning of key challenging ideas.

A Framework for Assessing Environmental Literacy

This workshop developed a new, comprehensive, research-based framework for assessing environmental literacy. By bringing together, for the first time, experts in research, assessment, and evaluation from the fields of science education, environmental education, and related social science fields, this project accessed and built its work on the literature and the insights of many disciplines.

Award Number: 
1033934
Funding Period: 
Mon, 11/15/2010 to Wed, 10/31/2012
Project Evaluator: 
Joe Heimlich, OSU
Full Description: 
This workshop developed a new, comprehensive, research-based framework for assessing environmental literacy. By bringing together, for the first time, experts in research, assessment, and evaluation from the fields of science education, environmental education, and related social science fields, this project accessed and built its work on the literature and the insights of many disciplines. The North American Association for Environmental Education (NAAEE) worked with the leaders of the only two large-scale assessments of environmental literacy used in the U.S. to date (Programme for International Student Assessment [PISA] and the National Environmental Literacy Assessment [NELA]) to conduct the workshop. The project leaders analyzed PISA and NELA and used a multi-disciplinary search and review of the literature to prepare a draft framework. At the workshop and thereafter, a diverse array of invited experts critiqued that draft and provided suggestions for revision. Then, the leaders/organizers produced a final Environmental Literacy Framework and disseminated it both electronically and at a nationally advertised event to a wide audience of assessment specialists, funding and policy-making agencies, and organizations working to develop assessments and achieve environmental literacy. Many institutions and agencies have noted the need to create an environmentally literate population, and government and private entities are investing hundreds of millions of dollars in projects aimed at enhancing environmental literacy. Given the scope and scale of these investments and the interest in this arena on the part of federal agencies, professional organizations, and corporations, assessments for gauging our progress in transforming our preK-12 education system to achieve that end are needed. The new Framework for assessing environmental literacy provides a foundation for measuring the extent to which we are enabling all learners to acquire the knowledge, skills, dispositions, and behaviors vital for competently making decisions about local, regional, national and global issues.
Alternative video text
Alternative video text: 
A video of the National Press Club dissemination event is posted at www.NAAEE.net/Framework

Multimedia Design Process: How to Make the Bad Stuff Good

Day: 
Thu

Participants will learn how designers work through early versions of games to arrive at final products. As part of the workshop, participants will review and critique early prototypes of work in progress to the final version.

Date/Time: 
2:00 pm to 4:00 pm
Session Type: 
Product Feedback Session

As educators, you may be skilled at identifying a really good educational product. You can review an educational game and, based on observation and testing (or your own developed intuition), you can know if it is effective and engaging. The more difficult task includes learning how to develop a multimedia product—reviewing early prototypes of a game or animation, and changing it many times so that it meets the learning goals while also engaging potential students. This process often involves dumping many unsuccessful attempts as well as starting over.

New Web-based Tools to Help Students (and Teachers) Who Find STEM Content Challenging

Day: 
Thu

Participants will be asked to view and discuss free tools that Dynabook and SmartGraphs are developing. These Web-based tools link multiple visual representations and allow immediate feedback to teachers and students.

Date/Time: 
8:30 am to 9:45 am
Session Type: 
Product Feedback Session
Session Materials: 

The capabilities of interactive, Web-based media offer approaches that can be especially valuable to students and teachers who find STEM content challenging to learn. Through the lenses of both general education and special education, the presenters are designing new products to be effective for all teachers and students. Web-based tools link multiple visual representations and allow immediate feedback to teachers and students. See and discuss free tools that Dynabook and SmartGraphs are developing.

Supporting Scientific Practices in Elementary and Middle School Classrooms

This project will develop a learning progression that characterizes how learners integrate and interrelate scientific argumentation, explanation and scientific modeling, building ever more sophisticated versions of practice over time using the three common elements of sense-making, persuading peers and developing consensus.

Lead Organization(s): 
Partner Organization(s): 
Award Number: 
1020316
Funding Period: 
Wed, 09/01/2010 to Fri, 08/31/2012
Full Description: 

Research on student learning has developed separate progressions for scientific argumentation, explanation and scientific modeling. Engaging Learners in Scientific Practices develops a learning progression that characterizes how learners integrate and interrelate scientific argumentation, explanation and scientific modeling, building ever more sophisticated versions of practice over time using the three common elements of sense-making, persuading peers and developing consensus. The learning progression is constructed through improvements in students' performance and understanding of scientific practice as measured by their attention to generality of explanation, attention to clarity of communication and audience understanding, attention to evidentiary support, and attention to mechanistic versus descriptive accounts. The project is led by researchers at Northwestern University, the University of Texas, Wright State University, Michigan State University, and the BEAR assessment group. Two cohorts of 180 students each are followed for two years from 4th to 5th grade in Illinois and two cohorts of 180 students each are followed for two years from 5th to 6th grade in Michigan The elementary school students will work with FOSS curriculum units modified to embed supports for scientific practices. Two cohorts of 500 middle school students are followed for three years from 6th to 8th grade as they work with coordinated IQWST units over three years. The outcome measures include analyses of classroom discourse, pre- and pos-test assessments of student learning, and reflective interviews grounded in students' own experiences with practices in the classroom to assess their growth across the dimensions. The BEAR team is responsible for validation and calibration of the frameworks and instruments, and design of the scheme for analysis of the data. Horizon Research performs the formative and summative evaluation. The project will produce an empirically-tested learning progression for scientific practices for grades 4-8 along with tested curriculum materials and validated assessment items that support and measure students' ability in the scientific practices of explanation, argumentation and modeling. In the process of development, an understanding is gained about how to design and test this learning progression. The framework is articulated on a website for use by other researchers and developers. The project also builds capacity by educating several graduate students.


Project Videos

2019 STEM for All Video Showcase

Title: Science Storylines

Presenter(s): Brian Reiser, Kelsey Edwards, Barbara Hug, Tara McGill, Jamie Noll, Michael Novak, Bill Penuel, Trey Smith, & Aliza Zivic


Cyber-Enabled Learning: Digital Natives in Integrated Scientific Inquiry Classrooms (Collaborative Research: Wang)

This project investigated the professional development needed to make teachers comfortable teaching with multi-user simulations and communications that students use every day. The enactment with OpenSim (an open source, modular, expandable platform used to create simulated 3D spaces with customizable terrain, weather and physics) also provides an opportunity to demonstrate the level of planning and preparation that go into fashioning modules with all selected cyber-enabled cognitive tools framed by constructivism, such as GoogleEarth and Biologica.

Award Number: 
1020091
Funding Period: 
Wed, 09/01/2010 to Wed, 08/31/2011
Project Evaluator: 
HRI
Full Description: 

There is an increasing gap between the assumptions governing the use of cyber-enabled resources in schools and the realities of their use by students in out of school settings. The potential of information and communications technologies (ICT) as cognitive tools for engaging students in scientific inquiry and enhancing teacher learning is explored. A comprehensive professional development program of over 240 hours, along with follow-up is used to determine how teachers can be supported to use ICT tools effectively in classroom instruction to create meaningful learning experiences for students, reducing the gap between formal and informal learning and improve student learning outcomes. In the first year, six teachers from school districts - two in Utah and one in New York - are educated to become teacher leaders and advisors. Then three cohorts of 30 teachers matched by characteristics are provided professional development and field test units over two years in a delayed-treatment design. Biologists from Utah State University and New York College of Technology develop four modules that meet the science standards for both states - the first being changes in the environment. Teachers are guided to develop additional modules. The key technological resource to be used in the project is the Opensimulator 3D application Server (OpenSim), an open source, modular, expandable platform used to create simulated 3D spaces with customizable terrain, weather and physics. 

The research methodology includes the use of the classroom observations using RTOP and Technology Use in Science Instruction (TUSI), selected interviews of teachers and students and validated assessments of student learning. Evaluation, by an external evaluator, assesses the quality of the professional development and the quality of the cyber-enabled learning resources, as well as reviews the research design and implementation. An Advisory Board will monitor the project. 

The project is to determine the professional development needed to make teachers comfortable teaching with multi-user simulations and communications that students use everyday. The enactment with OpenSim also provides an opportunity to demonstrate the level of planning and preparation that go into fashioning modules with all selected cyber-enabled cognitive tools framed by constructivism, such as GoogleEarth and Biologica.

Pages

Subscribe to Digital Media