Science

Development and Validation of a Mobile, Web-based Coaching Tool to Improve PreK Classroom Practices to Enhance Learning

This project will promote pre-K teachers' use of specific teaching strategies that have been shown to enhance young children's learning and social skills. To enhance teachers' use of these practices, the project will develop a new practitioner-friendly version of the Classroom Quality Real-time Empirically-based Feedback (CQ-REF) tool for instructional coaches who work with pre-K teachers.

Lead Organization(s): 
Award Number: 
1813008
Funding Period: 
Wed, 08/01/2018 to Sun, 07/31/2022
Full Description: 

Children from low-income families often enter kindergarten academically behind their more economically affluent peers. Advancing pre-kindergarten (pre-K) teachers' ability to provide all students with high-quality early math learning experiences has potential to minimize this gap in school readiness. This project will promote pre-K teachers' use of specific teaching strategies, such as spending more time on math content and listening to children during instructional activities, that have been shown to enhance young children's learning and social skills. To enhance teachers' use of these practices, the project takes a novel approach--a mobile website that helps instructional coaches who work with pre-K teachers. The Classroom Quality Real-time Empirically-based Feedback tool (CQ-REF) will guide coaches' ability to observe specific teacher practices in their classrooms and then provide feedback to help teachers evaluate their practices and set goals for improvement.  Practically, the CQ-REF addresses the need for accessible, real-time feedback on high quality pre-K classroom teaching.

This project focuses on developing a new practitioner-friendly version of the CQ-REF, originally designed as a research tool for evaluating the quality of classroom teaching, for use by coaches and teachers. At the beginning of the four-year project, the team will collect examples of high-quality classroom teaching and coaching strategies. These will be used to create a library of video and other materials that teachers and coaches can use to establish a shared definition of what effective pre-K teaching looks like. In year three of the project, the team will pilot the CQ-REF with a diverse range of pre-K teachers and their coaches to determine the tool's usability and relevance. In this validation study coaches will be randomly assigned to either use the CQ-REF tool or coach in their usual manner. After one year, the CQ-REF's impact on teacher practices and student outcomes will be assessed. Outcomes of interest include teacher and student classroom behavior and children's executive function and ability in mathematics, literacy and science. Concurrently, an external evaluation team will examine how the coaching is being conducted and used, and participants' impressions of the coaching process. In the fourth and final year, the team will focus on refining the tool based on results from prior work and on disseminating the findings to research and practitioner audiences.

Design and Development of Transmedia Narrative-based Curricula to Engage Children in Scientific Thinking and Engineering Design (Collaborative Research: Ellis)

This project will address the need for engineering resources by applying an innovative pedagogy called Imaginative Education (IE) to create middle school engineering curricula. In IE, developmentally appropriate narratives are used to design learning environments that help learners engage with content and organize their knowledge productively. This project will combine IE with transmedia storytelling.

Lead Organization(s): 
Award Number: 
1814033
Funding Period: 
Sun, 07/15/2018 to Thu, 06/30/2022
Full Description: 

Engineering is an important component of the Next Generation Science Standards (NGSS). However, resources for supporting teachers in implementing these standards are scarce. This project will address the need for resources by applying an innovative pedagogy called Imaginative Education (IE) to create middle school engineering curricula. In IE, developmentally appropriate narratives are used to design learning environments that help learners engage with content and organize their knowledge productively. To fully exploit the potential of this pedagogy, this project will combine IE with transmedia storytelling. In transmedia storytelling, different elements of a narrative are spread across a variety of formats (such as books, websites, new articles, videos and other media) in a way that creates a coordinated experience for the user. Once created, the curricula will be implemented in classrooms to research its impact on (1) increasing learners' capacities to engage in both innovative and direct application of engineering concepts, and (2) improving learners' science, technology, engineering, and mathematics (STEM) identity. 

This research will be led by Smith College and Springfield Technical Community College in collaboration with Springfield (MA) Public Schools (SPS). Additional expertise in evaluating the findings will be provided by the Collaborative for Educational Services and an external advisory board of leaders in STEM education and transmedia storytelling. The project will result in the development of a transmedia learning environment that includes two NGSS-aligned, interdisciplinary engineering units and seven lessons that integrate science and engineering. The research study will be implemented in four phases in eight SPS middle schools. Approximately 900 students will participate each year. In Phase 1, the project team will collaborate with SPS teachers to create engineering units, lessons, and standards-based achievement measures. In Phase 2, teachers in the treatment group will participate in professional development (PD) workshops covering IE, transmedia learning environments, structure of the curriculum, and connections to NGSS. In Phase 3 the curricula will be implemented in treatment classrooms and both treatment and control group students will be assessed. In Phase 4, testing and assessment will continue in SPS schools and will be expanded to rural and suburban classrooms. Teachers in these classrooms will use online multimedia PD that will ensure scalability and mirrors the structure and content of in-person PD. Data analysis will provide evidence of whether this imaginative and transmedia educational approach improves students' capacities for using engineering concepts and enhances their STEM identity.


Project Videos

2019 STEM for All Video Showcase

Title: Transforming Engineering Education for Middle School (TEEMS)

Presenter(s): Beth McGinnis-Cavanaugh, Sonia Ellis, & Crystal Ford


Design and Development of Transmedia Narrative-based Curricula to Engage Children in Scientific Thinking and Engineering Design (Collaborative Research: McGinnis-Cavanaugh)

This project will address the need for engineering resources by applying an innovative pedagogy called Imaginative Education (IE) to create middle school engineering curricula. In IE, developmentally appropriate narratives are used to design learning environments that help learners engage with content and organize their knowledge productively. This project will combine IE with transmedia storytelling.

Partner Organization(s): 
Award Number: 
1813572
Funding Period: 
Sun, 07/15/2018 to Thu, 06/30/2022
Project Evaluator: 
Collaborative for Educational Services (CES)
Full Description: 

Engineering is an important component of the Next Generation Science Standards (NGSS). However, resources for supporting teachers in implementing these standards are scarce. This project will address the need for resources by applying an innovative pedagogy called Imaginative Education (IE) to create middle school engineering curricula. In IE, developmentally appropriate narratives are used to design learning environments that help learners engage with content and organize their knowledge productively. To fully exploit the potential of this pedagogy, this project will combine IE with transmedia storytelling. In transmedia storytelling, different elements of a narrative are spread across a variety of formats (such as books, websites, new articles, videos and other media) in a way that creates a coordinated experience for the user. Once created, the curricula will be implemented in classrooms to research its impact on (1) increasing learners' capacities to engage in both innovative and direct application of engineering concepts, and (2) improving learners' science, technology, engineering, and mathematics (STEM) identity. 

This research will be led by Smith College and Springfield Technical Community College in collaboration with Springfield (MA) Public Schools (SPS). Additional expertise in evaluating the findings will be provided by the Collaborative for Educational Services and an external advisory board of leaders in STEM education and transmedia storytelling. The project will result in the development of a transmedia learning environment that includes two NGSS-aligned, interdisciplinary engineering units and seven lessons that integrate science and engineering. The research study will be implemented in four phases in eight SPS middle schools. Approximately 900 students will participate each year. In Phase 1, the project team will collaborate with SPS teachers to create engineering units, lessons, and standards-based achievement measures. In Phase 2, teachers in the treatment group will participate in professional development (PD) workshops covering IE, transmedia learning environments, structure of the curriculum, and connections to NGSS. In Phase 3 the curricula will be implemented in treatment classrooms and both treatment and control group students will be assessed. In Phase 4, testing and assessment will continue in SPS schools and will be expanded to rural and suburban classrooms. Teachers in these classrooms will use online multimedia PD that will ensure scalability and mirrors the structure and content of in-person PD. Data analysis will provide evidence of whether this imaginative and transmedia educational approach improves students' capacities for using engineering concepts and enhances their STEM identity.


Project Videos

2019 STEM for All Video Showcase

Title: Transforming Engineering Education for Middle School (TEEMS)

Presenter(s): Beth McGinnis-Cavanaugh, Sonia Ellis, & Crystal Ford


Developing a Generalized Storyline that Organizes the Supports for Evidence-based Modeling of Long-Term Impacts of Disturbances in Complex Systems

This project will support students to develop evidence-based explanations for the impact of disturbances on complex systems.

Lead Organization(s): 
Award Number: 
1813802
Funding Period: 
Sun, 07/15/2018 to Thu, 06/30/2022
Full Description: 

This project will support students to develop evidence-based explanations for the impact of disturbances on complex systems. The project will focus on middle school environmental science disciplinary core ideas in life, Earth, and physical sciences. There are a wide variety of complex systems principles at work in disturbance ecology. This project serves as a starting point on supporting students to coordinate different sources of information to parse out the direct and indirect effects of disturbances on components of a system and to examine the interconnections between components to predict whether a system will return to equilibrium (resilience) or the system will change into a new state (hysteresis). These same complex systems principles can be applied to other scientific phenomena, such as homeostasis and the spread of infectious disease. This project will bring the excitement of Luquillo Long Term Ecological Research (LTER) to classrooms outside of Puerto Rico, and has a special emphasis on low performing, low income, high minority schools in Chicago. Over 6000 students will directly benefit from participation in the research program. The units will be incorporated into the Journey to El Yunque web site for dissemination throughout Chicago Public Schools (CPS) and the LTER network. The units will be submitted for review at the Achieve network, thus extending the reach to teachers around the country. The project will impact science teachers and curriculum designers through an online course on storyline development. This project aims to improve students' ability to engage in argument from evidence and address what the literature has identified as a significant challenge, namely the ability to evaluate evidence. Researchers will also demonstrate how it is possible to make progress on implementing Next Generation Science Standards in low performing schools. Through the web-based platform, these results can be replicated across many other school districts.

Researchers will to use the scientific context of the LTER program to develop a generalized storyline template for using evidence-based modeling to teach basic principles of disturbance ecology. Though a co-design process with middle school teachers in CPS, researchers will test the application of learning principles to a generalized storyline template by developing and evaluating three units on disturbance ecology - one life science, one Earth system science, and one physical science. Through a task analysis, researchers have identified three key areas of support for students to be successful at explaining how a system will respond to a disturbance. First, students need to be able to record evidence in a manner that will guide them to developing their explanation. Causal model diagrams have been used successfully in the past to organize evidence, but little is known about how students can use their causal diagrams for developing explanations. Second, there have been a wide variety of scaffolds developed to support the evaluation of scientific arguments, but less is known about how to support students in organizing their evidence to produce scientific arguments. Third, evidence-based modeling and scientific argumentation are not tasks that can be successfully accomplished by following a recipe. Students need to develop a task model to understand the reason why they are engaged in a particular task and how that task will contribute to the primary goal of explanation.

Integrating Science with Mathematics and Engineering: Linking Home and School Learning for All Young Learners

This study will investigate the integration of science with mathematics and engineering and develop resources that provide preschool children with integrated STEM learning experiences. The study will also investigate the connection between home and school learning and will develop resources that strengthen children's experiences at school and home.

Lead Organization(s): 
Award Number: 
1813280
Funding Period: 
Sat, 09/01/2018 to Mon, 02/28/2022
Full Description: 

Children in preschool programs have few opportunities to engage meaningfully in science, technology, engineering, and mathematics (STEM) disciplines. This is especially true in programs serving children from low-income communities, where resources are scarce. This study will investigate the integration of science with mathematics and engineering and develop resources that provide preschool children with integrated STEM learning experiences. The study will also investigate the connection between home and school learning and will develop resources that strengthen children's experiences at school and home. This will include investigating the needs of and designing for dual language learners who represent a large (and growing) proportion of the population served in public preschool programs.

Using design based research (DBR), the researchers will: (1) Develop learning blueprints to guide the design of classroom and family learning resources. (2) Co-design resources with teachers and parents from low-income as well as culturally and linguistically diverse communities. (3) Conduct a series of formative pilot studies with partner teachers and parents. (4) Conduct a quasi-experimental field study in preschool classrooms and homes to examine both implementation and learning outcomes. Data sources will include observations in classrooms and homes, surveys and interviews with teachers and parents, and child learning assessments. Analysis will include qualitative approaches to examine patterns of interaction and engagement with resources in classrooms and homes, as well as quantitative approaches to examine children's learning accounting for the multilevel structure of the data. The project involves a collaboration between Digital Promise Global, Education Development Center, WGBH and multiple early childhood programs in California and New York. A total of 28 preschool centers, 56 classroom teachers, 208 families and 560 children are expected to participate. Results from this project are intended to inform understanding of how young children learn STEM, how adults at school and home can support children's early STEM learning, and what supports are useful to diverse learners specifically. Results could also highlight design principles that can inform future early STEM education research and development efforts integrating media and technology.

Science Communities of Practice Partnership

This project will study implementation of an effective professional learning model for elementary science teachers that includes teacher leaders, administrators and university educators in a system perspective for improving science instruction in ways that make it sustainable.

Award Number: 
1813012
Funding Period: 
Wed, 08/01/2018 to Sun, 07/31/2022
Full Description: 

This project will study implementation of an effective professional learning model for elementary science teachers that includes teacher leaders, administrators and university educators in a system perspective for improving science instruction in ways that make it sustainable. The working model involves reciprocal communities of practice, which are groups of teachers, leaders and administrators that focus on practical tasks and how to achieve them across these stakeholder perspectives. The project will provide evidence about the specific components of the professional development model that support sustainable improvement in science teaching, will test the ways that teacher ownership and organizational conditions mediate instructional change, and will develop four tools for facilitating the teacher learning and the accompanying capacity building. In this way, the project will produce practical knowledge and tools necessary for other school districts nationwide to create professional learning that is tailored to their contexts and therefore sustainable.

This study posits that communication among district teachers, teacher leaders, and administrators, and a sense of ownership for improved instruction among teachers can support sustainable change. As such, it tests a model that fosters communication and ownership through three reciprocal communities of practice--one about district leadership including one teacher per school, coaches and university faculty; another about lesson study including teachers, coaches and faculty; and a third about instructional innovation including teachers and administrators, facilitated by coaches. The research design seeks to inform what the communities of practice add to the effects in a quasi-experimental study involving 72 third to fifth grade teachers and 6500 students in four urban school districts. Mixed methodologies will be used to examine shifts in science teaching over three years, testing the professional development model and the mediating roles of reform ownership and organizational conditions.

Determining Teachers' Baseline Practice and Alignment Prior to a Systemic Curriculum Change

In this study, researchers will collaborate with Baltimore City Public Schools to collect and document teacher classroom practices prior to the implementation of an extended professional development model that targets pedagogical skills associated with the NGSS. The broad objective of the project is to characterize the benefits and limitations of utilizing controlled practice-teaching as a key component of teacher professional development for integrating NGSS aligned practices in middle school science classrooms.

Partner Organization(s): 
Award Number: 
1822029
Funding Period: 
Sun, 04/01/2018 to Sun, 03/31/2019
Full Description: 

The goal of this research is to document current teaching practices prior to the systemic integration of the Next Generation Science Standards (NGSS) in Baltimore City Public schools. In this study, UMBC will collaborate with Baltimore City Public Schools (City Schools) to collect and document teacher classroom practices prior to the implementation of an extended professional development model that targets pedagogical skills associated with the Next Generation Science Standards. The broad objective of the project is to characterize the benefits and limitations of utilizing controlled practice-teaching as a key component of teacher professional development for integrating NGSS aligned practices in middle school science classrooms. Success will be measured by changes in teacher attitudes, enhancement of teacher pedagogical skills and student learning gains. Sixty teachers, and over 4,500 students in Baltimore City will be directly impacted through the professional development and curriculum enactment efforts proposed. As a full partner in the project, the City Schools' leadership will also learn what works, for whom, and under what conditions in schools that are representative of their diverse district. Lessons learned have the potential to inform the implementation of other new reform initiatives within City Schools and beyond. Findings from the proposed research have the potential to advance our understanding of innovative professional development strategies and their impact on classroom practices and student learning.

This project focuses on a national need of models for high quality professional development that directly tie specific strategies to classroom-based instructional changes and student learning outcomes. One particular shift in classroom practice that is fundamental for the classroom implementation of NGSS is scientific discourse and argumentation. One particular strategy that has shown promise for supporting teachers' use of strategies supporting argumentation is the use of controlled practice teaching. The proposed study explicitly attempts to determine the impact of the controlled practice-teaching using a quasi-experimental design. The research plan involves middle science teachers being assigned to one of two experimental conditions (PD including or excluding a controlled practice-teaching component) and then to investigate potential differences among the two treatments and control conditions related to changes in attitudes toward NGSS, classroom practices and impact on student learning. The researcher hypothesizes that the inclusion of control-practice teaching that is imbedded in a sustained professional development program will promote the development of teacher pedagogical skills aligned with NGSS more effectively than sustained professional development that does not include a control-practice component.

Highly Adaptive Science Simulations for Accessible STEM Education

This project will research, design, and develop adaptive accessibility features for interactive science simulations. The proposed research will lay the foundation that advances the accessibility of complex interactives for learning and contribute to solutions to address the significant disparity in science achievement between students with and without disabilities.

Lead Organization(s): 
Award Number: 
1814220
Funding Period: 
Sun, 04/15/2018 to Wed, 03/31/2021
Full Description: 

This project will research, design, and develop adaptive accessibility features for interactive science simulations. The proposed research will lay the foundation that advances the accessibility of complex interactives for learning and contribute to solutions to address the significant disparity in science achievement between students with and without disabilities. The PhET Interactive Simulations project at the University of Colorado Boulder and collaborators at Georgia Tech, with expertise in accessible technology and design, will form the project team. The project team will conduct design-based implementation research, where adaptive accessibility features for interactive science simulations are developed through co-design with students with disabilities and their teachers. Students will include those with dyslexia, visual impairments or blindness, and students with intellectual and developmental disabilities, ranging from 5th grade through high school, and recent high school graduates. The adaptive accessibility features will be implemented within a set of PhET interactive science simulations, and allow students with disabilities to access the science simulations with alternative input devices (such as keyboards, switches, and sip-and-puff devices), alter the visual display of the simulations (changing color contrast, zoom and enlarge, and simplify), hear different auditory representations of the visual display (descriptions, sonification, and text-to-speech), and control the rate of simulated events. All features will be capable of being turned on or off and modified on-the-fly by teachers or students through a global control panel that includes curated feature sets, resulting in highly flexible, highly accessible, interactive learning resources.

PhET simulations are widely used in US classrooms, evidence-based, aligned with standards, and highly engaging and effective learning resources. With the proposed highly adaptive features and supporting resources, teachers will be able to quickly adapt the PhET simulations to meet the needs of many students with disabilities, simplifying the task of creating differentiated learning opportunities for students and supporting students with disabilities to engage in collaborative learning - a foundational component of a high-quality STEM education - alongside their non-disabled peers. To research, design, and develop the adaptive features and investigate their use by students, project team members will co-teach in classrooms with students with disabilities and conduct co-design activities with students, where students engage in design thinking to help design and refine the adaptive features to meet identified accessibility needs (their own and those of their peers). In addition, interviews with individual students with and without disabilities will also be conducted, to test early prototypes of individual features, to later refine the layering of the many different features, and to ensure the presence of adaptive features does not negatively impact traditional use of the simulations. The proposed work also includes surveys of teachers and students and analysis of teacher use, to refine global control features, develop curated feature sets, and develop supporting teacher resources. The project will address key questions at the heart of educational design for students with diverse needs, including how to make adaptive features that support student achievement of specific learning goals. The project will use design-based implementation research, with significant co-designing with students with disabilities (including visual impairments, cognitive disabilities, or dyslexia), interviews, case studies, and classroom implementation to design and evaluate the accessibility features. This will inform new models and theories of learning with technology. The project will investigate: 1) How students engage with, use, and learn from adaptive accessibility features, 2) how adaptive accessibility features can be designed to layer harmoniously together in a learning resource, and 3) how to effectively support access to rich, dynamic feature controls and curated feature sets for intuitive classroom use by students and teachers. The project will produce 8 PhET simulations with adaptive accessibility features and supporting teacher resources. The foundational research knowledge will result in effective design and implementation of adaptive accessibility features through the analysis of student engagement, usability, and learning from accessible simulations. Additionally, the project will provide technical infrastructure, exemplars, and software for use by other STEM education technology developers. The project team will work together to create a deep understanding of how to design adaptive science simulations with practical, usable, effective accessibility, so that learners with diverse needs can advance their science content knowledge and participate in science practices alongside their peers. The work has great potential to transform STEM learning for students with disabilities and to make simulations more effective for all learners. Results will provide insight into the effectiveness of accessible simulation-based activities and their corresponding teacher materials in engaging students in science practices and learning in the classroom.

The Spectrum Laboratory: Towards Authentic Inquiry for All

This project proposes to design, implement, and investigate the impact on students of an innovative curriculum supplement called the Spectrum Laboratory. The Spectrum Lab will be an online, interactive learning environment that enables students to make use of the database of publicly available spectra from research scientists, as well as from students.

Award Number: 
1814077
Funding Period: 
Tue, 05/01/2018 to Fri, 04/30/2021
Full Description: 

This project addresses physics, astronomy, and chemistry education at the high-school level. Spectroscopy is the single most important diagnostic tool in the sciences, and is required for inquiry at the frontiers of science across many disciplines, yet is unavailable to most classrooms. The Smithsonian Astrophysical Observatory proposes to design, implement, and investigate the impact on students of an innovative curriculum supplement called the Spectrum Laboratory. The Spectrum Lab will be an online, interactive learning environment that enables students to make use of the database of publicly available spectra from research scientists, as well as from students. The online learning resource and associated materials are purposefully being developed and tested with a demographically diverse set of schools. The project will determine how the design of a spectroscopy workspace can help students to use spectra while gaining fluency with a range of important science practices. The project's significance and importance is to greatly increase the opportunities for high school students to engage in authentic inquiry. Being able to evaluate and interpret real-world data is a hallmark of data literacy that is developed with Spectrum Lab. Project will potentially benefit the field through advances with respect to education and diversity, and benefit society by equipping high school students with the perceptual and cognitive factors that promote students' reasoning about spectra.

The Spectrum Lab's initial design applies research-based principles recommended for educational interfaces that engage students with graphical data advancing knowledge from prior research into understanding of how students make sense of spectroscopic data and its graphical representations. The project will be developed in collaboration with partner teachers in up to eight high school classrooms, representing a diverse population of learners, and then tested with a national group of 20 teachers with 600 to 800 students. A mix of quantitative and qualitative measures, including pre/post surveys and assessments, analysis of student project work, classroom video, and teacher surveys, will help address researcher's questions about students' experiences with the Spectrum Lab. The data to be gathered will be used to iteratively improve the design of the laboratory to aid students understand the source of these authentic data coming from spectroscopy to address real-world science questions of interest and importance to them. The Spectrum Lab will enable students to engage in a broad range of inquiry projects that were previously inaccessible, including projects near the frontiers of science. The students will become involved in their authentic inquiry projects, where each activity engages them in key science practices, including generating model spectrum plots to make predictions, assessing and interpreting data, and reasoning from evidence (and models) in support of a claim. The students will be using graphs of well-documented experiments and in physics, more challenging graphs of spectra of less familiar wavelength axis. The students in chemistry will learn how to relate the bright lines observed in an atom's spectrum to energy levels of the atom.  There will be studies that track students' eye movements show that students associate the peaks or valleys of a spectrum with individual atoms in a molecule, rather than with the overall properties of the molecule. The resources developed by the project will be freely available online for teachers and researchers. The Spectrum Lab is an advance in education technology that uses modern tools for enabling interactive data visualization. Its features enable students to integrate and apply the most important elements of science practice, such as the ability to draw evidence-based conclusions, as well as the ability to gather, evaluate and interpret data, intended to help students' science practice more closely resemble how research is done. The Spectrum Lab will modernize a critical part of high-school science classrooms, help teachers meet the expectations of the Next Generation Science Standards, and will better prepare students for college work.

Improving Multi-Dimensional Assessment and Instruction: Building and Sustaining Elementary Science Teachers' Capacity through Learning Communities (Collaborative Research: Lehman)

The main goal of this project is to better understand how to build and sustain the capacity of elementary science teachers in grades 3-5 to instruct and formatively assess students in ways that are aligned with contemporary science education frameworks and standards. To achieve this goal, the project will use classroom-based science assessment as a focus around which to build teacher capacity in science instruction and three-dimensional learning in science.

Lead Organization(s): 
Partner Organization(s): 
Award Number: 
1813938
Funding Period: 
Sun, 07/01/2018 to Thu, 06/30/2022
Full Description: 

This is an Early-Stage Design and Development collaborative effort submitted to the assessment strand of the Discovery Research PreK-12 (DRK-12) Program. Its main goal is to better understand how to build and sustain the capacity of elementary science teachers in grades 3-5 to instruct and formatively assess students in ways that are aligned with contemporary science education frameworks and standards. To achieve this goal, the project will use classroom-based science assessment as a focus around which to build teacher capacity in science instruction and three-dimensional learning in science. The three dimensions will include disciplinary core ideas, science and engineering practices, and crosscutting concepts. These dimensions are described in the Framework for K-12 Science Education (National Research Council; NRC, 2012), and the Next Generation Science Standards (NGSS; NGSS Lead States, 2013). The project will work closely with teachers to co-develop usable assessments and rubrics and help them to learn about three-dimensional assessment and instruction. Also, the project will work with teachers to test the developed assessments in diverse settings, and to create an active, online community of practice.

The two research questions will be: (1) How well do these assessments function with respect to aspects of validity for classroom use, particularly in terms of indicators of student proficiency, and tools to support teacher instructional practice?; and (2) In what ways do providing these assessment tasks and rubrics, and supporting teachers in their use, advance teachers' formative assessment practices to support multi-dimensional science instruction? The research and development components of this project will produce assessments and rubrics, which can directly impact students and teachers in the districts and states that have adopted the NGSS, as well as those that have embraced the vision of science teaching and learning embodied in the NRC Framework. The project will consist of five major tasks. First, the effort will iteratively develop assessments and rubrics for formative use, using an evidence-centered design approach. Second, it will collect data from evidence-based revision and redesign of the assessments from teachers piloting the assessments and rubrics, project cognitive laboratory studies with students, and an external review of the assessments design products. Third, it will study teachers' classroom use of assessments to understand and document how they blend assessment and instruction. The project will use pre/post questionnaires, video recordings, observation field notes, and pre/post interviews. Fourth, the study will build the capacity of participating teachers. Teacher Collaborators (n=9) will engage in participatory design of the assessment tasks and act as technical assistants to the overall implementation process. Teacher Implementers (n=15) will use the assessments formatively as part of their instructional practice. Finally, the work will develop a community of learners through the development of a technical assistance infrastructure, and leveraging teacher expertise to formatively assess students' work, using the assessments designed to be diagnostic and instructionally informative. External reviewers and an advisory board will provide formative feedback on the project's processes and summative evaluation of the project's results. The main outcomes of this endeavor will be prototypes of elementary science multi-dimensional assessments and new knowledge for the field on the underlying theory for developing teachers' capacity for engaging in multi-dimensional science instruction, learning, and assessment.

Pages

Subscribe to Science