Impact

CAREER: Multilevel Mediation Models to Study the Impact of Teacher Development on Student Achievement in Mathematics

This project will develop a comprehensive framework to inform and guide the analytic design of teacher professional development studies in mathematics. An essential goal of the research is to advance a science of teaching and learning in ways that traverse both research and education.

Lead Organization(s): 
Award Number: 
1552535
Funding Period: 
Thu, 09/01/2016 to Tue, 08/31/2021
Full Description: 

This is a Faculty Early Career Development Program (CAREER) project. The CAREER program is a National Science Foundation-wide activity that offers the most prestigious awards in support of junior faculty who exemplify the role of teacher-scholars through outstanding research, excellent education and the integration of education and research. The intellectual merit and broader impacts of this study lie in two complementary contributions of the project. First, the development of the statistical framework for the design of multilevel mediation studies has significant potential for broad impact because it develops a core platform that is transferable to other STEM (science, technology, engineering, and mathematics) education areas and STEM disciplines. Second, the development of software and curricular materials to implement this framework further capitalize on the promise of this work because it distributes the results in an accessible manner to diverse sets of research and practitioner groups across STEM education areas and STEM disciplines. Together, the components of this project will substantially expand the scope and quality of evidence generated through mathematics professional development and, more generally, multilevel mediation studies throughout STEM areas by increasing researchers' capacity to design valid and comprehensive studies of the theories of action and change that underlie research programs.

This project will develop a comprehensive framework to inform and guide the analytic design of teacher professional development studies in mathematics. The proposed framework incorporates four integrated research and education components: (1) develop statistical formulas and tools to guide the optimal design of experimental and non-experimental multilevel mediation studies in the presence of measurement error, (2) develop empirical estimates of the parameters needed to implement these formulas to design teacher development studies in mathematics, (3) develop free and accessible software to execute this framework, and (4) develop training materials and conduct workshops on the framework to improve the capacity of the field to design effective and efficient studies of teacher development. An essential goal of the research is to advance a science of teaching and learning in ways that traverse both research and education.

Science, Technology, Engineering and Mathematics Scholars Teacher Academy Resident System

This project will investigate the effectiveness of a teacher academy resident model to recruit, license, induct, employ, and retain middle school and secondary teachers for high-need schools in the South. It will prepare new, highly-qualified science and mathematics teachers from historically Black universities in high-needs urban and rural schools with the goal of increasing teacher retention and diversity rates.

Lead Organization(s): 
Award Number: 
1621325
Funding Period: 
Fri, 07/15/2016 to Wed, 06/30/2021
Full Description: 

This project at Jackson State University will investigate the effectiveness of a teacher academy resident model to recruit, license, induct, employ, and retain middle school and secondary science and mathematics teachers for high-need schools in the South. It will prepare new, highly-qualified science and mathematics teachers from historically Black universities in high-needs urban and rural schools. The project involves a partnership among three historically Black universities (Jackson, State University, Xavier University of Louisiana, and the University of Arkansas at Pine Bluff), and diverse urban and rural school districts in Jackson, Mississippi; New Orleans, Louisiana; and Pine Bluff Arkansas region that serve more than 175,000 students.

Participants will include 150 middle and secondary school teacher residents who will gain clinical mentored experience and develop familiarity with local schools. The 150 teacher residents supported by the program to National Board certification will obtain: state licensure/certification in science teaching, a master's degree, and initiation. The goal is to increase teacher retention and diversity rates. The research question guiding this focus is: Will training STEM graduates have a significant effect on the quality of K-12 instruction, teacher efficacy and satisfaction, STEM teacher retention, and students? Science and mathematics achievement? A quasi-experimental design will be used to evaluate project's effectiveness.

Three-Dimensional Teaching and Learning: Rebuilding and Researching an Online Middle School Curriculum

This project will develop an online curriculum-based supported by a teacher professional development (PD) program by rebuilding an existing life science unit of Biological Sciences Curriculum Study (BSCS) Middle School Science. The project is designed to be an exemplar of fully digital Next Generation Science Standards (NGSS) aligned resources for teachers and students, creating an NGSS-aligned learning environment combining disciplinary core ideas with science and engineering practices and cross-cutting concepts.

Lead Organization(s): 
Award Number: 
1502571
Funding Period: 
Tue, 09/01/2015 to Sat, 08/31/2019
Full Description: 

This project was funded by the Discovery Research K-12 (DRK-12) program that seeks to significantly enhance the learning and teaching of science, technology, engineering, and mathematics (STEM) by preK-12 students and teachers, through research and development of innovative resources, models, and tools. Projects in the DRK-12 program build on fundamental research in STEM education and prior research and development efforts that provide theoretical and empirical justification for proposed projects. The project, in collaboration with Oregon Public Broadcasting, will develop an online curriculum-based supported by a teacher professional development (PD) program by rebuilding an existing life science unit of Biological Sciences Curriculum Study (BSCS) Middle School Science. The materials will include strategically integrated multimedia elements including animations, interactive learning experiences, and enhanced readings for students, as well as classroom videos for teachers that will help all users gain a deeper understanding of three-dimensional learning. The project is designed to be an exemplar of fully digital Next Generation Science Standards (NGSS) aligned resources for teachers and students, creating an NGSS-aligned learning environment combining disciplinary core ideas with science and engineering practices and cross-cutting concepts. Using the powerful affordances of a digital environment, the project will invigorate and inspire learners and support teachers as only a media-rich environment can do.

The project will develop and research the project innovation, the combination of digital instructional materials for students and online teacher PD using a proven lesson-analysis framework. Although prior research has demonstrated the efficacy of the lesson analysis PD and curriculum elements independently, there has been little investigation of their joint ability to transform teaching and learning. The project will merge research and development in this project by incorporating a complex array of multi-component assessment activities, including classroom-based assessments, in a quasi-experimental study. Assessment activities will be designed using an evidence-centered design process that will involve the careful selection and development of assessment tasks, scoring rubrics, and criteria for scoring based on the performance expectations (PEs) and the best ways to elicit evidence about student proficiency with those PEs. The research, carried out by SRI International, will use multi-component tasks that will support inferences about student learning and advance understanding of how to assess NGSS learning. Project research and resources, which will include a digital, middle school life sciences unit, teacher PD and online digital resources, and related assessment tools, which will be widely disseminated to policy makers, researchers, and practitioners.


Project Videos

2020 STEM for All Video Showcase

Title: A Medical Mystery: Middle School Body Systems for the NGSS

Presenter(s): Susan Kowalski, Lindsey Mohan, Betty Stennett, Catherine Stimac, & Heather Young


Retention of Early Algebraic Understanding

The project will use a quasi-experimental design to explore students' knowledge of core algebraic concepts in middle grades (grade 6), one year after their completion of 3-year, grades 3-5 early algebra intervention. The research questions are: (1) how well students who received a specific intervention retain their understanding of algebraic concepts in future years; and (2) whether and how the intervening year of regular classroom instruction in grade 6 influences the algebra understanding of both intervention and comparison students.

Lead Organization(s): 
Award Number: 
1550897
Funding Period: 
Tue, 09/01/2015 to Wed, 08/31/2016
Full Description: 

The Discovery Research K-12 program (DRK-12) seeks to significantly enhance the learning and teaching of science, technology, engineering and mathematics (STEM) by prek-12 students and teachers through research and development of innovative resources, models and tools. While national and state standards provide important benchmarks for algebra learning beginning in kindergarten, they do not provide rigorously tested models by which these algebra standards might be attained in elementary grades classrooms in ways that will ensure further mathematics achievement. This work will addresses this need by closely documenting the effectiveness of models and tools, developed in our previous work, for early algebra education

The proposed project will use a quasi-experimental design to explore students' knowledge of core algebraic concepts in middle grades (grade 6), one year after their completion of 3-year, grades 3-5 early algebra intervention. The project will also study the algebraic knowledge of a comparison group of students. The research questions are: (1) how well students who received a specific intervention retain their understanding of algebraic concepts in future years; and (2) whether and how the intervening year of regular classroom instruction in grade 6 influences the algebra understanding of both intervention and comparison students.

Quality Urban Ecology Science Teaching for Diverse Learners

This project will examine the relationship between teacher professional development associated with newly developed modules in urban ecology and the achievement and engagement of long-term English learners (LTEL).  Existing Urban Ecology learning modules will be enhanced to accommodate the needs of LTELs, and teachers will participate in professional development aimed at using the new materials to effectively integrate academic science discourse and literacy development for LTELs.

Lead Organization(s): 
Award Number: 
1503519
Funding Period: 
Sat, 08/01/2015 to Fri, 05/31/2019
Full Description: 

The Discovery Research K-12 program (DRK-12) seeks to significantly enhance the learning and teaching of science, technology, engineering and mathematics (STEM) by preK-12 students and teachers, through research and development of innovative resources, models and tools (RMTs). Projects in the DRK-12 program build on fundamental research in STEM education and prior research and development efforts that provide theoretical and empirical justification for proposed projects. This exploratory research project will examine the relationship between teacher professional development associated with newly developed modules in urban ecology and the achievement and engagement of long-term English learners (LTEL). Participants in the project will include students in grades 4-8 in a large urban school district, elementary school teachers, middle school science teachers, and middle school teachers of English language arts. Existing Urban Ecology learning modules will be enhanced to accommodate the needs of LTELs, and teachers will participate in professional development aimed at using the new materials to effectively integrate academic science discourse and literacy development for LTELs.

The project will develop two enhanced urban ecology modules (47 lessons) for English learners in grades 4-8; science language and literacy assessments for English language learners (ELLs); an ELL STEM career awareness inventory; an urban ecology for ELLs teacher knowledge scale, and an urban ecology for ELLs pedagogy observation protocol. The materials will be tested with a stratified random sample of students identified by achievement level (low, medium, and high) and linguistic background (mainstream, LTEL, and "at risk" of becoming LTEL). A mixed-methods research design will be used to test the hypothesis that the quantity and quality of LTEL science language and literacy achievement will increase as a result of teacher participation in implementing the newly developed transdisciplinary framework for Urban Ecology for English Learners.

Collaborative Math: Creating Sustainable Excellence in Mathematics for Head Start Programs

This project will adapt and study a promising and replicable teacher professional development (PD) intervention, called Collaborative Math (CM), for use in early childhood programs. Prepared as generalists, preschool teachers typically acquire less math knowledge in pre-service training than their colleagues in upper grades, which reduces their effectiveness in teaching math. To address teacher PD needs, the project will simultaneously develop teacher content knowledge, confidence, and classroom practice by using a whole teacher approach.

Lead Organization(s): 
Award Number: 
1503486
Funding Period: 
Tue, 09/01/2015 to Sat, 08/31/2019
Full Description: 

This project was submitted to the Discovery Research K-12 (DRK-12) program that seeks to significantly enhance the learning and teaching of science, technology, engineering, and mathematics (STEM) by preK-12 students and teachers, through research and development of innovative resources, models, and tools. Projects in the DRK-12 program build on fundamental research in STEM education and prior research and development efforts that provide theoretical and empirical justification for proposed projects. The project will adapt and study a promising and replicable teacher professional development (PD) intervention, called Collaborative Math (CM), for use in early childhood programs. CM content will focus on nine topics emphasized in preschool mathematics, including sets, number sense, counting, number operations, pattern, measurement, data analysis, spatial relationships, and shape. These concepts are organized around Big Ideas familiar in early math, are developmentally appropriate and foundational to a young child's understanding of mathematics. The project addresses the urgent need for improving early math instruction for low-income children. Prepared as generalists, preschool teachers typically acquire less math knowledge in pre-service training than their colleagues in upper grades, which reduces their effectiveness in teaching math. To address teacher PD needs, the project will simultaneously develop teacher content knowledge, confidence, and classroom practice by using a whole teacher approach. Likewise, the project will involve teachers, teacher aides, and administrators through a whole school approach in PD, which research has shown is more effective than involving only lead teachers. Through several phases of development and research, the project will investigate the contributions of project components on increases in teacher knowledge and classroom practices, student math knowledge, and overall implementation. The project will impact approximately 200 Head Start (HS) teaching staff, better preparing them to provide quality early math experiences to more than 3,000 HS children during the project period. Upon the completion of the project, a range of well-tested CM materials such as resource books and teaching videos will be widely available for early math PD use. Assessment tools that look at math knowledge, attitudes, and teacher practice will also be available. 

The project builds on Erikson Institute research and development work in fields of early math PD and curriculum. Over a 4-year span, project development and research will be implemented in 4 phases: (1) adapting the existing CM and research measures for HS context; (2) conducting a limited field study of revised CM in terms of fidelity and director, teacher/aide, and student outcomes, and study of business as usual (BAU) comparison groups; (3) a study of the promise of the intervention promise with the phase 3 BAU group (who offered baseline in phase 2) and (4) a test of the 2nd year sustainability intervention with phase 3 treatment group. The teacher and student measures are all published, frequently used measures in early childhood education and will be piloted and refined prior to full implementation. The project is a partnership between Erikson, SRI, and Chicago Head Start programs. Project research and resources will be widely disseminated to policy makers, researchers, and practitioners.

PBS NewsHour STEM Student Reporting Labs: Broad Expansion of Youth Journalism to Support Increased STEM Literacy Among Underserved Student Populations and Their Communities

The production of news stories and student-oriented instruction in the classroom are designed to increase student learning of STEM content through student-centered inquiry and reflections on metacognition. This project scales up the PBS NewsHour Student Reporting Labs (SRL), a model that trains teens to produce video reports on important STEM issues from a youth perspective.

Award Number: 
1503315
Funding Period: 
Sat, 08/01/2015 to Wed, 07/31/2019
Full Description: 

The Discovery Research K-12 program (DR-K12) seeks to significantly enhance the learning and teaching of science, technology, engineering and mathematics (STEM) by preK-12 students and teachers, through research and development of innovative resources, models and tools (RMTs). Projects in the DRK-12 program build on fundamental research in STEM education and prior research and development efforts that provide theoretical and empirical justification for proposed projects. This project scales up the PBS NewsHour Student Reporting Labs (SRL), a model that trains teens to produce video reports on important STEM issues from a youth perspective. Participating schools receive a SRL journalism and digital media literacy curriculum, a mentor for students from a local PBS affiliate, professional development for educators, and support from the PBS NewsHour team. The production of news stories and student-oriented instruction in the classroom are designed to increase student learning of STEM content through student-centered inquiry and reflections on metacognition. Students will develop a deep understanding of the material to choose the best strategy to teach or tell the STEM story to others through digital media. Over the 4 years of the project, the model will be expanded from the current 70 schools to 150 in 40 states targeting schools with high populations of underrepresented youth. New components will be added to the model including STEM professional mentors and a social media and media analytics component. Project partners include local PBS stations, Project Lead the Way, and Share My Lesson educators.

The research study conducted by New Knowledge, LLC will add new knowledge about the growing field of youth science journalism and digital media. Front-end evaluation will assess students' understanding of contemporary STEM issues by deploying a web-based survey to crowd-source youth reactions, interest, questions, and thoughts about current science issues. A subset of questions will explore students' tendencies to pass newly-acquired information to members of the larger social networks. Formative evaluation will include qualitative and quantitative studies of multiple stakeholders at the Student Reporting Labs to refine the implementation of the program. Summative evaluation will track learning outcomes/changes such as: How does student reporting on STEM news increase their STEM literacy competencies? How does it affect their interest in STEM careers? Which strategies are most effective with underrepresented students? How do youth communicate with each other about science content, informing news media best practices? The research team will use data from pre/post and post-delayed surveys taken by 1700 students in the STEM Student Reporting Labs and 1700 from control groups. In addition, interviews with teachers will assess the curriculum and impressions of student engagement.


Project Videos

2019 STEM for All Video Showcase

Title: How Video Storytelling Reengages Teenagers in STEM Learning

Presenter(s): Leah Clapman & William Swift

2018 STEM for All Video Showcase

Title: PBS NewsHour's STEM SRL Transforms Classrooms into Newsrooms

Presenter(s): Leah Clapman & William Swift

2017 STEM for All Video Showcase

Title: PBS is Building the Next Generation of STEM Communicators

Presenter(s): Leah Clapman, John Fraser, Su-Jen Roberts, & Bill Swift


An Efficacy Study of the Learning and Teaching Geometry PD Materials: Examining Impact and Context-Based Adaptations

This study will examine the impact of the Learning and Teaching Geometry (LTG) professional development for secondary mathematics teachers on the teachers' knowledge and classroom instruction, as well as on their students' learning. As the nation invests vast resources in the professional development of teachers to meet new curriculum and instruction challenges, exploring the efficacy of professional development is important to understand how best to direct those resources.

Lead Organization(s): 
Award Number: 
1503399
Funding Period: 
Wed, 07/01/2015 to Sun, 06/30/2019
Full Description: 

The Discovery Research K-12 program (DRK-12) seeks to significantly enhance the learning and teaching of science, technology, engineering and mathematics (STEM) by preK-12 students and teachers, through research and development of innovative resources, models and tools (RMTs). Projects in the DRK-12 program build on fundamental research in STEM education and prior research and development efforts that provide theoretical and empirical justification for proposed projects. There are few examples of research that demonstrates causal impacts of professional development on teachers' knowledge and practice and student learning. This study will examine the impact of the Learning and Teaching Geometry (LTG) professional development for secondary mathematics teachers on the teachers' knowledge and classroom instruction, as well as on their students' learning. As the nation invests vast resources in the professional development of teachers to meet new curriculum and instruction challenges, exploring the efficacy of professional development is important to understand how best to direct those resources.

Using a cluster randomized design, the project will sample from 132 teachers (66 per condition) from 28 middle and high schools to participate in a 2-year implementation of the LTG professional development, facilitated by highly trained facilitators to study the efficacy of the materials. The project will monitor the fiedity of implementation of the LTG using a professional development session logging tool and Facilitator Interview Protocol. Outcome measures include measures of teacher knowledge, teaching practice, and student learning of geometry. Analyses will include two- and three-level hierarchical linear models to estimate the effects of participation in the LTG professional development and growth over time.

Teaching Environmental Sustainability - Model My Watershed (Collaborative Research: Kerlin)

This project will develop curricula for environmental/geoscience disciplines for high-school classrooms. The Model My Watershed (MMW) v2 app will bring new environmental datasets and geospatial capabilities into the classroom, to provide a cloud-based learning and analysis platform accessible from a web browser on any computer or mobile device, thus overcoming the cost and technical obstacles to integrating Geographic Information System technology in secondary education.

Lead Organization(s): 
Award Number: 
1418133
Funding Period: 
Mon, 09/01/2014 to Fri, 08/31/2018
Project Evaluator: 
Education Design
Full Description: 

This project will develop curricula for environmental/geoscience disciplines for high-school classrooms. It will teach a systems approach to problem solving through hands-on activities based on local data and issues. This will provide an opportunity for students to act in their communities while engaging in solving problems they find interesting, and require synthesis of prior learning. The Model My Watershed (MMW) v2 app will bring new environmental datasets and geospatial capabilities into the classroom, to provide a cloud-based learning and analysis platform accessible from a web browser on any computer or mobile device, thus overcoming the cost and technical obstacles to integrating Geographic Information System technology in secondary education. It will also integrate new low-cost environmental sensors that allow students to collect and upload their own data and compare them to data visualized on the new MMW v2. This project will transform the ability of teachers throughout the nation to introduce hands-on geospatial analysis activities in the classroom, to explore a wide range of geographic, social, political and environmental concepts and problems beyond the project's specific curricular focus.

The Next Generation Science Standards state that authentic research experiences are necessary to enhance STEM learning. A combination of computational modeling and data collection and analysis will be integrated into this project to address this need. Placing STEM content within a place- and problem-based framework enhances STEM learning. Students, working in groups, will not only design solutions, they will be required to defend them within the application portal through the creation of multimedia products such as videos, articles and web 2.0 presentations. The research plan tests the overall hypothesis that students are much more likely to develop an interest in careers that require systems thinking and/or spatial thinking, such as environmental sciences, if they are provided with problem-based, place-based, hands-on learning experiences using real data, authentic geospatial analysis tools and models, and opportunities to collect their own supporting data. The MMW v2 web app will include a data visualization tool that streams data related to the modeling application. This database will be modified to integrate student data so teachers and students can easily compare their data to data collected by other students and the government and research data. All data will be easily downloadable so that students can increase the use of real data to support the educational exercises. As a complement to the model-based activities, the project partners will design, manufacture, and distribute a low-cost environmental monitoring device, called the Watershed Tracker. This device will allow students to collect real-world data to enhance their understanding of watershed dynamics. Featuring temperature, light, humidity, and soil moisture sensors, the Watershed Tracker will be designed to connect to tablets and smartphones through the audio jack common to all of these devices.

Science in the Learning Gardens (SciLG): Factors that Support Racial and Ethnic Minority Students’ Success in Low-Income Middle Schools

Science in the Learning Gardens (SciLG) designs and implements curriculum aligned with Next Generation Science Standards (NGSS) and uses school gardens as learning contexts in grade 6 (2014-2015), grade 7 (2015-2016) and grade 8 (2016-2017) in two low-income urban schools. The project investigates the extent to which SciLG activities predict students’ STEM identity, motivation, learning, and grades in science using a theoretical model of motivational development.

Lead Organization(s): 
Partner Organization(s): 
Award Number: 
1418270
Funding Period: 
Mon, 09/01/2014 to Thu, 08/31/2017
Full Description: 

Science in the Learning Gardens (SciLG) will use school gardens as the context for learning at two low-income middle schools with predominantly racial and ethnic minority students in Portland, Oregon. There are thousands of gardens flourishing across the country that are underutilized as contexts for active engagement in the middle grades. School gardens provide important cultural contexts while addressing environmental and food issues. SciLG will bring underrepresented youth into gardens at a critical time in their intellectual development to broaden the factors that support motivation to pursue STEM careers and educational pathways. The project will adapt, organize, and align two disparate sets of existing resources into the project curriculum: 6th grade science curriculum resources, and garden-based lessons and units. The curriculum will be directly aligned with the Next Generation Science Standards (NGSS). 

The project will use a design-based research approach to refine instruction and formative assessment, and to investigate factors for student success in science proficiency and their motivational engagement in relation to the garden curriculum. The curriculum will be pilot-tested during the first year of the project in five sixth-grade classes with 240 students in Portland Public Schools. Students will be followed longitudinally in grades 7 and 8 in years 2 and 3 respectively, as curricular integration continues. The research team will support participating teachers each year in using their schools' gardens, and study how this context can serve as an effective pedagogical strategy for NGSS-aligned science curriculum. Academic learning will be measured by assessments of student progress towards the end of middle-school goals defined by NGSS. Motivation will be measured by a validated motivational engagement instrument. SciLG results along with the motivational engagement instrument will be disseminated widely through a variety of professional networks to stimulate implementation nationwide.

Pages

Subscribe to Impact