Teacher Outcomes

Design and Development of Transmedia Narrative-based Curricula to Engage Children in Scientific Thinking and Engineering Design (Collaborative Research: McGinnis-Cavanaugh)

This project will address the need for engineering resources by applying an innovative pedagogy called Imaginative Education (IE) to create middle school engineering curricula. In IE, developmentally appropriate narratives are used to design learning environments that help learners engage with content and organize their knowledge productively. This project will combine IE with transmedia storytelling.

Partner Organization(s): 
Award Number: 
1813572
Funding Period: 
Sun, 07/15/2018 to Thu, 06/30/2022
Project Evaluator: 
Collaborative for Educational Services (CES)
Full Description: 

Engineering is an important component of the Next Generation Science Standards (NGSS). However, resources for supporting teachers in implementing these standards are scarce. This project will address the need for resources by applying an innovative pedagogy called Imaginative Education (IE) to create middle school engineering curricula. In IE, developmentally appropriate narratives are used to design learning environments that help learners engage with content and organize their knowledge productively. To fully exploit the potential of this pedagogy, this project will combine IE with transmedia storytelling. In transmedia storytelling, different elements of a narrative are spread across a variety of formats (such as books, websites, new articles, videos and other media) in a way that creates a coordinated experience for the user. Once created, the curricula will be implemented in classrooms to research its impact on (1) increasing learners' capacities to engage in both innovative and direct application of engineering concepts, and (2) improving learners' science, technology, engineering, and mathematics (STEM) identity. 

This research will be led by Smith College and Springfield Technical Community College in collaboration with Springfield (MA) Public Schools (SPS). Additional expertise in evaluating the findings will be provided by the Collaborative for Educational Services and an external advisory board of leaders in STEM education and transmedia storytelling. The project will result in the development of a transmedia learning environment that includes two NGSS-aligned, interdisciplinary engineering units and seven lessons that integrate science and engineering. The research study will be implemented in four phases in eight SPS middle schools. Approximately 900 students will participate each year. In Phase 1, the project team will collaborate with SPS teachers to create engineering units, lessons, and standards-based achievement measures. In Phase 2, teachers in the treatment group will participate in professional development (PD) workshops covering IE, transmedia learning environments, structure of the curriculum, and connections to NGSS. In Phase 3 the curricula will be implemented in treatment classrooms and both treatment and control group students will be assessed. In Phase 4, testing and assessment will continue in SPS schools and will be expanded to rural and suburban classrooms. Teachers in these classrooms will use online multimedia PD that will ensure scalability and mirrors the structure and content of in-person PD. Data analysis will provide evidence of whether this imaginative and transmedia educational approach improves students' capacities for using engineering concepts and enhances their STEM identity.


Project Videos

2019 STEM for All Video Showcase

Title: Transforming Engineering Education for Middle School (TEEMS)

Presenter(s): Beth McGinnis-Cavanaugh, Sonia Ellis, & Crystal Ford


Developing Preservice Teachers' Capacity to Teach Students with Learning Disabilities in Algebra I

Project researchers are training pre-service teachers to tutor students with learning disabilities in Algebra 1, combining principles from special education, mathematics education, and cognitive psychology. The trainings emphasize the use of gestures and strategic questioning to support students with learning disabilities and to build students’ understanding in Algebra 1.

Project Email: 
Lead Organization(s): 
Award Number: 
1813903
Funding Period: 
Wed, 08/01/2018 to Sat, 07/31/2021
Full Description: 

This project is implementing a program to train pre-service teachers to tutor students with learning disabilities in Algebra 1, combining principles from special education, mathematics education, and cognitive psychology. The project trains tutors to utilize gestures and strategic questioning to support students with LD to build connections between procedural knowledge and conceptual understanding in Algebra 1, while supporting students’ dispositions towards doing mathematics. The training will prepare tutors to address the challenges that students with LD often face—especially challenges of working memory and processing—and to build on their strengths as they engage with Algebra 1. The project will measure changes in tutors’ ability to use gestures and questioning to support the learning of students with LD during and after the completion of our training. It will also collect and analyze data on the knowledge and dispositions of students with LD in Algebra 1 for use in the ongoing refinement of the training and in documenting the impact of the training program.

 

Extending and Investigating the Impact of the High School Model-based Educational Resource (Collaborative Research: Wilson)

This project builds on a line of work that has developed and studied the Model Based Educational Resource (MBER), a year-long curriculum for high school biology. The project will generate rigorous causal evidence on how this approach to biology teaching and learning can support student learning, and foundational information on how to support high school teachers in improving their teaching. It will also provide resources to expand and update MBER to reflect the changing high school science landscape by integrating Earth Science standards into the year long sequence.

Lead Organization(s): 
Award Number: 
1813538
Funding Period: 
Wed, 08/01/2018 to Sun, 07/31/2022
Full Description: 

This project builds on a line of work that has developed and studied the Model Based Educational Resource (MBER), a year-long curriculum for high school biology. In classrooms using MBER, modeling serves as an anchoring practice that keeps the inquiry tied to the goal of making sense of the world, helping teachers to engage their students in a range of cognitive and social activities that lead to deep understanding of scientific ideas. This project will generate rigorous causal evidence on how this approach to biology teaching and learning can support student learning, and foundational information on how to support high school teachers in improving their teaching. This funding will also provide resources to expand and update MBER to reflect the changing high school science landscape by integrating Earth Science standards into the year long sequence. The study will address the general research question: What is the impact of the Model Based Educational Resource (MBER) on high school students' science achievement, and what factors influence that impact? In addition to generating important research findings, the materials revised and studied in this project will be open-source and freely available to teachers and schools.

This study addresses a significant gap in the research on next generation curriculum materials. While there is emerging agreement about the importance of instructional materials in supporting teachers in effectively engaging students in the practices of science, there is very little empirical evidence to support such claims. The goal of this project is to study the impact of the MBER program through a cluster randomized trial and expand the promise of efficacy and feasibility established in previous work. This study will be able to make causal claims by using an experimental design in which 32 high school teachers serve as their own controls, and by using multi-level modeling in the analysis. This study will advance the field's knowledge about the impact of innovative materials on student learning, measured by both project-level assessments and the state science test. Exploratory research questions will examine a) how using the MBER program develops teachers' vision of the Next Generation Science Standards, b) how student learning is mediated by the fidelity of implementation of the materials, c) how teachers interact with materials designed to be modified for their classroom context, and d) to what extent the MBER materials provide equitable opportunities to learn and close achievement gaps.

Science Communities of Practice Partnership

This project will study implementation of an effective professional learning model for elementary science teachers that includes teacher leaders, administrators and university educators in a system perspective for improving science instruction in ways that make it sustainable.

Award Number: 
1813012
Funding Period: 
Wed, 08/01/2018 to Sun, 07/31/2022
Full Description: 

This project will study implementation of an effective professional learning model for elementary science teachers that includes teacher leaders, administrators and university educators in a system perspective for improving science instruction in ways that make it sustainable. The working model involves reciprocal communities of practice, which are groups of teachers, leaders and administrators that focus on practical tasks and how to achieve them across these stakeholder perspectives. The project will provide evidence about the specific components of the professional development model that support sustainable improvement in science teaching, will test the ways that teacher ownership and organizational conditions mediate instructional change, and will develop four tools for facilitating the teacher learning and the accompanying capacity building. In this way, the project will produce practical knowledge and tools necessary for other school districts nationwide to create professional learning that is tailored to their contexts and therefore sustainable.

This study posits that communication among district teachers, teacher leaders, and administrators, and a sense of ownership for improved instruction among teachers can support sustainable change. As such, it tests a model that fosters communication and ownership through three reciprocal communities of practice--one about district leadership including one teacher per school, coaches and university faculty; another about lesson study including teachers, coaches and faculty; and a third about instructional innovation including teachers and administrators, facilitated by coaches. The research design seeks to inform what the communities of practice add to the effects in a quasi-experimental study involving 72 third to fifth grade teachers and 6500 students in four urban school districts. Mixed methodologies will be used to examine shifts in science teaching over three years, testing the professional development model and the mediating roles of reform ownership and organizational conditions.

Determining Teachers' Baseline Practice and Alignment Prior to a Systemic Curriculum Change

In this study, researchers will collaborate with Baltimore City Public Schools to collect and document teacher classroom practices prior to the implementation of an extended professional development model that targets pedagogical skills associated with the NGSS. The broad objective of the project is to characterize the benefits and limitations of utilizing controlled practice-teaching as a key component of teacher professional development for integrating NGSS aligned practices in middle school science classrooms.

Partner Organization(s): 
Award Number: 
1822029
Funding Period: 
Sun, 04/01/2018 to Sun, 03/31/2019
Full Description: 

The goal of this research is to document current teaching practices prior to the systemic integration of the Next Generation Science Standards (NGSS) in Baltimore City Public schools. In this study, UMBC will collaborate with Baltimore City Public Schools (City Schools) to collect and document teacher classroom practices prior to the implementation of an extended professional development model that targets pedagogical skills associated with the Next Generation Science Standards. The broad objective of the project is to characterize the benefits and limitations of utilizing controlled practice-teaching as a key component of teacher professional development for integrating NGSS aligned practices in middle school science classrooms. Success will be measured by changes in teacher attitudes, enhancement of teacher pedagogical skills and student learning gains. Sixty teachers, and over 4,500 students in Baltimore City will be directly impacted through the professional development and curriculum enactment efforts proposed. As a full partner in the project, the City Schools' leadership will also learn what works, for whom, and under what conditions in schools that are representative of their diverse district. Lessons learned have the potential to inform the implementation of other new reform initiatives within City Schools and beyond. Findings from the proposed research have the potential to advance our understanding of innovative professional development strategies and their impact on classroom practices and student learning.

This project focuses on a national need of models for high quality professional development that directly tie specific strategies to classroom-based instructional changes and student learning outcomes. One particular shift in classroom practice that is fundamental for the classroom implementation of NGSS is scientific discourse and argumentation. One particular strategy that has shown promise for supporting teachers' use of strategies supporting argumentation is the use of controlled practice teaching. The proposed study explicitly attempts to determine the impact of the controlled practice-teaching using a quasi-experimental design. The research plan involves middle science teachers being assigned to one of two experimental conditions (PD including or excluding a controlled practice-teaching component) and then to investigate potential differences among the two treatments and control conditions related to changes in attitudes toward NGSS, classroom practices and impact on student learning. The researcher hypothesizes that the inclusion of control-practice teaching that is imbedded in a sustained professional development program will promote the development of teacher pedagogical skills aligned with NGSS more effectively than sustained professional development that does not include a control-practice component.

Improving Multi-Dimensional Assessment and Instruction: Building and Sustaining Elementary Science Teachers' Capacity through Learning Communities (Collaborative Research: Lehman)

The main goal of this project is to better understand how to build and sustain the capacity of elementary science teachers in grades 3-5 to instruct and formatively assess students in ways that are aligned with contemporary science education frameworks and standards. To achieve this goal, the project will use classroom-based science assessment as a focus around which to build teacher capacity in science instruction and three-dimensional learning in science.

Lead Organization(s): 
Partner Organization(s): 
Award Number: 
1813938
Funding Period: 
Sun, 07/01/2018 to Thu, 06/30/2022
Full Description: 

This is an Early-Stage Design and Development collaborative effort submitted to the assessment strand of the Discovery Research PreK-12 (DRK-12) Program. Its main goal is to better understand how to build and sustain the capacity of elementary science teachers in grades 3-5 to instruct and formatively assess students in ways that are aligned with contemporary science education frameworks and standards. To achieve this goal, the project will use classroom-based science assessment as a focus around which to build teacher capacity in science instruction and three-dimensional learning in science. The three dimensions will include disciplinary core ideas, science and engineering practices, and crosscutting concepts. These dimensions are described in the Framework for K-12 Science Education (National Research Council; NRC, 2012), and the Next Generation Science Standards (NGSS; NGSS Lead States, 2013). The project will work closely with teachers to co-develop usable assessments and rubrics and help them to learn about three-dimensional assessment and instruction. Also, the project will work with teachers to test the developed assessments in diverse settings, and to create an active, online community of practice.

The two research questions will be: (1) How well do these assessments function with respect to aspects of validity for classroom use, particularly in terms of indicators of student proficiency, and tools to support teacher instructional practice?; and (2) In what ways do providing these assessment tasks and rubrics, and supporting teachers in their use, advance teachers' formative assessment practices to support multi-dimensional science instruction? The research and development components of this project will produce assessments and rubrics, which can directly impact students and teachers in the districts and states that have adopted the NGSS, as well as those that have embraced the vision of science teaching and learning embodied in the NRC Framework. The project will consist of five major tasks. First, the effort will iteratively develop assessments and rubrics for formative use, using an evidence-centered design approach. Second, it will collect data from evidence-based revision and redesign of the assessments from teachers piloting the assessments and rubrics, project cognitive laboratory studies with students, and an external review of the assessments design products. Third, it will study teachers' classroom use of assessments to understand and document how they blend assessment and instruction. The project will use pre/post questionnaires, video recordings, observation field notes, and pre/post interviews. Fourth, the study will build the capacity of participating teachers. Teacher Collaborators (n=9) will engage in participatory design of the assessment tasks and act as technical assistants to the overall implementation process. Teacher Implementers (n=15) will use the assessments formatively as part of their instructional practice. Finally, the work will develop a community of learners through the development of a technical assistance infrastructure, and leveraging teacher expertise to formatively assess students' work, using the assessments designed to be diagnostic and instructionally informative. External reviewers and an advisory board will provide formative feedback on the project's processes and summative evaluation of the project's results. The main outcomes of this endeavor will be prototypes of elementary science multi-dimensional assessments and new knowledge for the field on the underlying theory for developing teachers' capacity for engaging in multi-dimensional science instruction, learning, and assessment.

Professional Development for K-12 Science Teachers in Linguistically Diverse Classrooms

This project will engage science teachers in a sustained professional development (PD) program embedded in an afterschool science program designed for a linguistically diverse group of English learners (ELs).

Award Number: 
2001688
Funding Period: 
Tue, 05/01/2018 to Sat, 04/30/2022
Full Description: 

This project will engage science teachers in a sustained professional development (PD) program embedded in an afterschool science program designed for a linguistically diverse group of English learners (ELs). The project targets science teachers (chemistry, physics, biology, and earth science) who teach in a high school that includes refugees from Myanmar, Central America, and Africa. Roughly 20% of the students are classified as ELs, representing almost 20 different linguistic groups, including a variety of Asian, Spanish, and Arabic languages. The fundamental issue that the project seeks to address is the design of science learning environments to facilitate ELs' learning in linguistically diverse high school classrooms. Research on science education for ELs has recommended several effective teaching approaches, such as building on students' diverse and rich resources, engaging students in authentic science learning practices, and encouraging and valuing flexible use of multiple languages. However, previously most research has focused on teaching speakers of Spanish in elementary and middle school level science classrooms in which a majority of ELs speak the same language. Furthermore, while many PD programs supporting science education for ELs provide a short-term workshop and/or newly designed curriculum and curriculum guide, there is a lack of PD models that engage teachers in a sustained community of practice through collaboration between researchers and teachers.

The project's primary goal includes broadening participation with direct impact on 14 science teachers, who will impact over 2000 students, including over 450 ELs, during the project implementation period. The project provides a sustained model of the PD program which further impacts EL students of teachers who participated in the various phases of the project. The project has a potential to make an impact on ELs and high school science teachers of ELs in three different ways. First, by generating PD materials that include effective teaching materials and instructional practices for ELs, which can be used by other educators situated in similar educational contexts. Second, by giving presentations and publish papers that communicate findings of the project to academic communities. These outputs can impact other researchers who would like to design PD programs to foster ELs' science learning. Third, by implementing the developed and tested PD program in a larger scale. The implementation of the project will build capacity to conduct a larger PD project to impact more teachers and students. These anticipated outputs and outcomes will provide valuable resources for researcher and practitioners looking to support ELs' science learning and steps forward to equity. Finally, the project team and two cohorts of science teachers will co-design a school-wide science teacher PD to transform science teaching materials and practices of non-participating teachers.

This project was previously funded under award #1813937.

Investigating Impact of Different Types of Professional Development on What Aspects Mathematics Teachers Take Up and Use in Their Classroom

This project will study the design and development of PD that supports teacher development and student learning, and provide accumulation of evidence to inform teacher educators, administrators, teachers, and policymakers of factors associated with successful PD experiences and variation across teachers and types of PDs.

Lead Organization(s): 
Award Number: 
1813439
Funding Period: 
Sun, 07/01/2018 to Wed, 06/30/2021
Full Description: 

Professional development is a critical way in which teachers who are currently in classrooms learn about changes in mathematics teaching and learning and improve their practice. Little is known about what types of professional development (PD) support teachers' improved practice and student learning. However, federal, state, and local governments spend resources on helping teachers improve their teaching practice and students' learning. PD programs vary in their intent and can fall on a continuum from highly adaptive, with great latitude in the implementation, to highly specified, with little ability to adapt the program during implementation. The project will study the design and development of PD that supports teacher development and student learning, and provide accumulation of evidence to inform teacher educators, administrators, teachers, and policymakers of factors associated with successful PD experiences and variation across teachers and types of PDs. The impact study will expand on the evidence of promise from four 2015 National Science Foundation (NSF)-funded projects - two adaptive, two specified - to provide evidence of the impact of the projects on teachers' instructional practice over time. Although the four projects are different in terms of structure and design elements, they all share the goal to support challenging mathematics content, practice standards, and differentiation techniques to support culturally and linguistically diverse, underrepresented populations. Understanding the nature of the professional development including structure and design elements, and unpacking what teachers take up and use in their instructional practice potentially has widespread use to support student learning in diverse contexts, especially those serving disadvantaged and underrepresented student populations.

This study will examine teachers' uptake of mathematics content, pedagogy and materials from different types of professional development in order to understand and unpack the factors that are associated with what teachers take up and use two-three years beyond their original PD experience: Two specified 1) An Efficacy Study of the Learning and Teaching Geometry PD Materials: Examining Impact and Context-Based Adaptations (Jennifer Jacobs, Karen Koellner & Nanette Seago), 2) Visual Access to Mathematics: Professional Development for Teachers of English Learners (Mark Driscoll, Johanna Nikula, & Pamela Buffington), two adaptive: 3) Refining a Model with Tools to Develop Math PD Leaders: An Implementation Study (Hilda Borko & Janet Carlson), 4), TRUmath and Lesson Study: Supporting Fundamental and Sustainable Improvement in High School Mathematics Teaching (Suzanne Donovan, Phil Tucher, & Catherine Lewis). The project will utilize a multi-case method which centers on a common focus of what content, pedagogy and materials teachers take up from PD experiences. Using a specified sampling procedure, the project will select 8 teachers from each of the four PD projects to serve as case study teachers. Subsequently, the project will conduct a cross case analysis focusing on variation among and between teachers and different types of PD. The research questions that guide the project's impact study are: RQ1: What is the nature of what teachers take up and use after participating in professional development workshops? RQ2: What factors influence what teachers take up and use and in what ways? RQ3: How does a professional development's position on the specified-adaptive continuum affect what teachers take up and use?

Moving Beyond Pedagogy: Developing Elementary Teachers' Adaptive Expertise in Using the Epistemic Complexity of Science

The Next Generation Science Standards (NGSS) emphasize the integration of scientific knowledge and the practices of science, a recognition that science classrooms are complex learning environments. Meeting this expectation requires teachers to move beyond traditional routines of practice to become adaptive experts who can adjust their teaching to maximize learning in varied classroom situations.

Lead Organization(s): 
Award Number: 
1812576
Funding Period: 
Tue, 05/15/2018 to Sat, 04/30/2022
Full Description: 

The Next Generation Science Standards (NGSS) emphasize the integration of scientific knowledge and the practices of science, a recognition that science classrooms are complex learning environments. Meeting this expectation requires teachers to move beyond traditional routines of practice to become adaptive experts who can adjust their teaching to maximize learning in varied classroom situations. A teacher who has adaptive expertise is defined as someone who can self-assess and strategically adjust decision-making before, during and after teaching episodes. To become adaptive experts, teachers must understand the foundational ways that scientific knowledge is advanced and develop knowledge of, and practices related to, using argument, language, and dialogical environments--individually and collectively--as tools for learning science. To effectively use these tools requires teachers to shift from viewing science teaching as the transfer or replication of knowledge through routines of practices to one in which students are participants in a more cognitively based approach to learning. How teachers develop adaptive expertise for NGSS-aligned learning environments is still little understood. This project will examine the complex nature of the relationship between these learning tools and teacher orientation that enables teachers to develop adaptive expertise over the course of a multi-year professional development program.

The project will work with 150 Grade 3-5 teachers in Iowa and Alabama to implement a three-year professional development program to assist teachers develop adaptive expertise. Through implementation of an argument-based inquiry approach focused on development of adaptiveness, teachers will be supported as they shift their expertise from routine to adaptiveness. Project data will include teachers' implementation of the approach, their understanding of science argument, and their shifting epistemic orientation. The project will examine selected case studies of teachers to better understand the variations in development of adaptive expertise. The project outcome will be a model of adaptive expertise that can be used by in-service and pre-service educators to advance teacher practices towards adaptive expertise. The aim is to design ways to transfer adaptive expertise to students in STEM. The mixed-method project will integrate analyses with a focus on understanding complexity, using large-scale quantitative data.

Developing and Validating Assessments to Measure and Build Elementary Teachers' Content Knowledge for Teaching about Matter and Its Interactions within Teacher Education Settings (Collaborative Research: Hanuscin)

The fundamental purpose of this project is to examine and gather initial validity evidence for assessments designed to measure and build kindergarten-fifth grade science teachers' content knowledge for teaching (CKT) about matter and its interactions in teacher education settings.

Partner Organization(s): 
Award Number: 
1814275
Funding Period: 
Sun, 07/01/2018 to Thu, 06/30/2022
Full Description: 

This is an Early-Stage Design and Development collaborative effort submitted to the assessment strand of the Discovery Research PreK-12 (DRK-12) Program. Its fundamental purpose is to examine and gather initial validity evidence for assessments designed to measure and build kindergarten-fifth grade science teachers' content knowledge for teaching (CKT) about matter and its interactions in teacher education settings. The selection of this topic will facilitate the development of a proof-of-concept to determine if and how CKT assessments can be developed and used to measure and build elementary teachers' CKT. Also, it will facilitate rapid and targeted refinement of an evidence-centered design process that could be applied to other science topics. Plans are to integrate CKT assessments and related resources into teacher education courses to support the ability of teachers to apply their content knowledge to the work of teaching and learning science. The project will combine efforts from prior projects and engage in foundational research to examine the nature of teachers' CKT and to build theories and hypotheses about the productive use and design of CKT assessment materials to support formative and summative uses. Likewise, the project will create a set of descriptive cases highlighting the use of these tools. Understanding how CKT science assessments can be leveraged as summative tools to evaluate current efforts, and as formative tools to build elementary teachers' specialized, practice-based knowledge will be the central foci of this effort.

The main research questions will be: (1) What is the nature of elementary science teachers' CKT about matter and its interactions?; and (2) How can the development of prospective elementary teachers' CKT be supported within teacher education? To address the research questions, the study will employ a mixed-methods, design-based research approach to gather various sources of validity evidence to support the formative and summative use of the CKT instrument, instructional tasks, and supporting materials. The project will be organized around two main research and development strands. Strand One will build an empirically grounded understanding of the nature of elementary teachers' CKT. Strand Two will focus on developing and studying how CKT instructional tasks can be used formatively within teacher education settings to build elementary teachers' CKT. In addition, the project will refine a conceptual framework that identifies the science-specific teaching practices that comprise the work of teaching science. This will be used as well to assess the CKT that teachers leverage when recognizing, understanding, and responding to the content-intensive practices that they engage in as they teach science. To that end, the study will build on two existing frameworks from prior NSF-funded work. The first was originally developed to create CKT assessments for elementary and middle school teachers in English Language Arts and mathematics. The second focuses on the content challenges that novice elementary science teachers face. It is organized by the instructional tools and practices that elementary science teachers use, such as scientific models and explanations. These instructional practices cut across those addressed in the Next Generation Science Standards' (NGSS; Lead States, 2013) disciplinary strands. The main project's outcomes will be knowledge that builds and refines theories about the nature of elementary teachers' CKT, and how CKT elementary science assessment materials can be designed productively for formative and summative purposes. The project will also result in the development of a suite of valid and reliable assessments that afford interpretations on CKT matter proficiency and can be used to monitor elementary teachers learning. An external advisory board will provide formative and summative feedback on the project's activities and progress.

Pages

Subscribe to Teacher Outcomes