Mixed Methods

Developing the Science Comprehensive Online Learning Platform for Rural School Science Teacher Development

This project will develop, evaluate, and compare the effectiveness of newly-designed online learning platform with traditional face-to-face PD in supporting rural high school science teachers' implementation of an existing biology curriculum aligned with the Next Generation Science Standards (NGSS).

Lead Organization(s): 
Award Number: 
1908937
Funding Period: 
Sun, 09/01/2019 to Wed, 08/31/2022
Full Description: 

Rural school districts in the US face unique challenges: isolation in small farm communities, significant distances between communities, minimal funding, and low teacher salaries. They also serve high numbers of diverse and low-income students, who deserve equitable access to high quality science learning opportunities. Effective online professional development (PD) is needed for teachers working in isolated rural communities where high quality face-to-face PD may be economically impractical for districts to offer. This project will develop, evaluate, and compare the effectiveness of newly-designed online learning platform with traditional face-to-face PD in supporting rural high school science teachers' implementation of an existing biology curriculum aligned with the Next Generation Science Standards (NGSS). The online learning platform will be modeled after successful face-to-face PD features: (1) job-embedded - learning occurs within the context of teachers' classroom instruction, (2) collaborative - teachers share experiences in implementing new practices, and (3) content-specific - teachers develop disciplinary content and instructional practices that support students' understanding of science. Once developed and refined, the online PD platform can be used broadly across other contexts and content areas.

Over a three year period, this project will develop, evaluate, and then compare an online PD platform for supporting rural science teachers in implementing the Towards High School Biology (THSB) curriculum with a traditional face-to-face PD. In year one, the research team will iteratively develop the online platform and adapt the already developed face-to-face PD for implementing THSB to an online format. Utilizing Curator, a social learning platform developed by HT2Labs, project researchers will embed teacher learning that is situated with their own classroom contexts, is asynchronously and synchronously collaborative, and is focused on the THSB curriculum content. In years two and three, forty eight rural middle-school science educators will be recruited from southwest Kansas and randomly assigned to online PD (treatment) or face-to-face PD (comparison). Using mixed methodology, the project will examine if differences exist between the conditions in regards to teacher content knowledge, teacher self-efficacy in using new practices, teacher classroom practices, and student learning outcomes. It is hypothesized that there should be no differences between conditions in fostering successful implementation of evidence-based science practices and student outcomes, demonstrating the success of an online modality to support deep conceptual change in teachers' instructional practices. Furthermore, lessons learned in developing and investigating a science comprehensive online learning platform can inform application to other disciplinary content (e.g., physics, chemistry, Earth and space sciences) and across other grade level and school contexts.

 

Learning Trajectories as a Complete Early Mathematics Intervention: Achieving Efficacies of Economies at Scale

The purpose of this project is to test the efficacy of the Learning and Teaching with Learning Trajectories (LT2) program with the goal of improving mathematics teaching and thereby increasing young students' math learning. LT2 is a professional development tool and a curriculum resource intended for teachers to be used to support early math instruction and includes the mathematical learning goal, the developmental progression, and relevant instructional activities.

Lead Organization(s): 
Award Number: 
1908889
Funding Period: 
Mon, 07/01/2019 to Sun, 06/30/2024
Full Description: 

U.S. proficiency in mathematics continues to be low and early math performance is a powerful predictor of long-term academic success and employability. However, relatively few early childhood degree programs have any curriculum requirements focused on key mathematics topics. Thus, teacher professional development programs offer a viable and promising method for supporting and improving teachers' instructional approaches to mathematics and thus, improving student math outcomes. The purpose of this project is to test the efficacy of the Learning and Teaching with Learning Trajectories (LT2) program with the goal of improving mathematics teaching and thereby increasing young students' math learning. LT2 is a professional development tool and a curriculum resource intended for teachers to be used to support early math instruction. The LT2 program modules uniquely include the mathematical learning goal, the developmental progression, and relevant instructional activities. All three aspects are critical for high-quality and coherent mathematics instruction in the early grades.

This project will address the following research questions: 1) What are the medium-range effects of LT2 on student achievement and the achievement gap? 2) What are the short- and long-term effects of LT2 on teacher instructional approach, beliefs, and quality? and 3) How cost effective is the LT2 intervention relative to the original Building Blocks intervention? To address the research questions, this project will conduct a multisite cluster randomized experimental design, with 90 schools randomly assigned within school districts to either experimental or control groups. Outcome measures for the approximately 250 kindergarten classrooms across these districts will include the Research-based Elementary Math Assessment, observations of instructional quality, a questionnaire focused on teacher beliefs and practices, in addition to school level administrative data. Data will be analyzed using multi-level regression models to determine the effect of the Learning Trajectories intervention on student learning.

Case Studies of a Suite of Next Generation Science Instructional, Assessment, and Professional Development Materials in Diverse Middle School Settings

This project addresses a gap between vision and implementation of state science standards by designing a coordinated suite of instructional, assessment and teacher professional learning materials that attempt to enact the vision behind the Next Generation Science Standards. The study focuses on using state-of-the-art technology to create an 8-week long, immersive, life science field experience organized around three investigations.

Lead Organization(s): 
Award Number: 
1907944
Funding Period: 
Mon, 07/01/2019 to Fri, 06/30/2023
Full Description: 

New state science standards are ambitious and require important changes to instructional practices, accompanied by a coordinated system of curriculum, assessment, and professional development materials. This project addresses a gap between vision and implementation of such standards by designing a coordinated suite of instructional, assessment and teacher professional learning materials that attempt to enact the vision behind the Next Generation Science Standards. The study focuses on the design of such materials using state-of-the-art technology to create an 8-week long, immersive, life science field experience organized around three investigations. Classes of urban students in two states will collect data on local insect species with the goal of understanding, sharing, and critiquing environmental management solutions. An integrated learning technology system, the Learning Navigator, draws on big data to organize student-gathered data, dialogue, lessons, an assessment information. The Learning Navigator will also amplify the teacher's role in guiding and fostering next generation science learning. This project advances the field through an in-depth exploration of the goals for the standards documents. The study begins to address questions about what works when, where, and for whom in the context of the Next Generation Science Standards.

The project uses a series of case studies to create, test, evaluate and refine the system of instructional, assessment and professional development materials as they are enacted in two distinct urban school settings. It is designed with 330 students and 22 teachers in culturally, racially and linguistically diverse, under-resourced schools in Pennsylvania and California. These schools are located in neighborhoods that are economically challenged and have students who demonstrate patterns of underperformance on state standardized tests. It will document the process of team co-construction of Next Generation Science-fostering instructional materials; develop assessment tasks for an instructional unit that are valid and reliable; and, track the patterns of use of the instructional and assessment materials by teachers. The study will also record if new misconceptions are revealed as students develop Next Generation Science knowledge,  comparing findings across two diverse school locations in two states. Data collection will include: (a) multiple types of data to establish validity and reliability of educational assessments, (b) the design, evaluation and use of a classroom observation protocol to gather information on both frequency and categorical degree of classroom practices that support the vision, and (c) consecutive years of ten individual classroom enactments through case studies analyzed through cross-case analyses. This should lead to stronger and better developed understandings about what constitutes strong Next Generation Science learning and the classroom conditions, instructional materials, assessments and teacher development that foster it.

Aligning the Science Teacher Education Pathway: A Networked Improvement Community

This project will study the activities of a Networked Improvement Community (NIC) as a vehicle to bridge gaps across four identified steps along the science teacher training and development pathways within local contexts of 8 participating universities. The overarching goal of the project is to strengthen the capacity of universities and school districts to reliably produce teachers of science who are knowledgeable about and can effectively enact the Next Generation Science Standards (NGSS), although prepared in varied organizational contexts.

Award Number: 
1908900
Funding Period: 
Mon, 07/01/2019 to Fri, 06/30/2023
Full Description: 

California State University will study the activities of a Networked Improvement Community (NIC) as a vehicle to bridge gaps across four identified steps along the science teacher training and development pathways within local contexts of 8 participating universities (NIC sites). Networked Improvement Community (NIC) will co-create a shared vision and co-defined research agenda between university researchers, science educators and school district practitioners working together to reform teacher education across a variety of local contexts. By studying outcomes of shared supports and teacher tools for use in multiple steps along the science teacher education pathway, researchers will map variation existing in the system and align efforts across the science teacher education pathway. This process will integrate an iterative nature of educational change in local contexts impacting enactment of the NGSS in both university teacher preparation programs and in school district professional training activities and classrooms.

The overarching goal of the project is to strengthen the capacity of universities and school districts to reliably produce teachers of science who are knowledgeable about and can effectively enact the Next Generation Science Standards (NGSS), although prepared in varied organizational contexts. The project will accomplish this goal 1) leveraging the use of an established Networked Improvement Community, composed of science education faculty from eight university campuses and by 2) improving and studying coherence in the steps along the science teacher education pathway within and across these universities and school districts. The project will use a mixed methods approach to data collection and analysis. Consistent with Improvement Science Theory, research questions will be co-defined by all stakeholders.

Getting Unstuck: Designing and Evaluating Teacher Resources to Support Conceptual and Creative Fluency with Programming

The project will create opportunities for teachers to develop programming content knowledge and new understandings of the creative possibilities in computer science education, thereby increasing opportunities for students to develop conceptual and creative fluency with programming.

Lead Organization(s): 
Award Number: 
1908110
Funding Period: 
Mon, 07/01/2019 to Wed, 06/30/2021
Full Description: 

The project will create opportunities for teachers to develop programming content knowledge and new understandings of the creative possibilities in computer science education, thereby increasing opportunities for students to develop conceptual and creative fluency with programming. K-12 introductory programming experiences are often highly scaffolded, and it can be challenging for students to transition from constrained exercises to open-ended programming activities encountered later in-and out of-school. Teachers can provide critical support to help students solve problems and develop the cognitive, social, and emotional capacities required for conceptually and creatively complex programming challenges. Teachers - particularly elementary and middle school teachers, especially in rural and Title I schools - often lack the programming content knowledge, skills, and practices needed to support deeper and more meaningful programming experiences for students. Professional development opportunities can cultivate teacher expertise, especially when supported by curricular materials that bridge teachers' professional learning and students' classroom learning. This research responds to these needs, addressing key national priorities for increasing access to high-quality K-12 computer science education for all students through teacher professional development.

The project will involve the design and evaluation of (1) an online learning experience for teachers to develop conceptual and creative fluency through short, daily programming prompts (featuring the Scratch programming environment), and (2) educative curricular materials for the classroom (based on the online experience). The online experience and curricular materials will be developed in collaboration with three 4th through 6th-grade rural or Title I teachers. The project will evaluate teacher learning in the online experience using mixed-methods analyses of pre/post-survey data of teachers' perceived expertise and quantitative analyses of teachers' programs and evolving conceptual knowledge. Three additional 4th through 6th-grade teachers will pilot the curricular materials in their classrooms. The six pilot teachers will maintain field journals about their experiences and will participate in interviews, evaluating use of the resources in practice. An ethnography of one teacher's classroom will be developed to further contribute to understandings of the classroom-level resources in action, including students' experiences and learning. Student learning will be evaluated through student interviews and analyses of student projects. Project outcomes will inform how computer science conceptual knowledge and creative fluency can be developed both for teachers and their students' knowledge and fluency that will be critical for students' future success in work and life.

Building Students' Data Literacy through the Co-design of Curriculum by Mathematics and Art Teachers (Collaborative Research: Matuk)

This project aims to enact and study the co-design of classroom activities by mathematics and visual arts teachers to promote middle school students' data literacy.

Lead Organization(s): 
Award Number: 
1908557
Funding Period: 
Mon, 07/01/2019 to Wed, 06/30/2021
Full Description: 

The aim of this project is to enact and study a process in which middle school teachers of mathematics and visual arts co-design and teach activities that combine math and art to teach data science. Many existing efforts to promote data literacy are grounded in mathematical concepts of central tendency and variation, and typically are narrowly focused in single subject domains. Taking an art-based perspective on data science has the potential to promote student relevance, accessibility, engagement, reasoning, and meaning-making with data science. Moreover, visualization technology has advanced to a degree that the relation between the information in data and visual aesthetic can be leveraged easily. To explore the opportunity this offers, research on this project will examine how to equip teachers to develop such interdisciplinary pedagogical approaches to cultivate their students' data literacy. This exploratory project will provide support for 12 teachers during summer workshops and during the school year as these teachers implement their co-designed units in their classrooms. The work addresses the following questions: (1) How do we support effective co-design of data literacy units among art teachers, mathematics teachers, and researchers? (2) How are teachers able to use the unit materials in their classrooms to engage students in data literacy? And (3) How does an art-based approach support students' data literacy? Answers to these questions will build an understanding of how to support interdisciplinary curriculum design collaborations among researchers and teachers. They will also show how art-integrated, maker-oriented activities can support middle school learners' data literacy development; and how to design technologies that are accessible and powerful to teachers and learners in these interdisciplinary environments.

Through summer workshops and year-round design collaborations, the project will iteratively design, test and refine four units for middle school classrooms, including activities, tools, and assessments, to promote students' data literacy. Data will be collected from co-design sessions as well as classroom-enactments, and will include observations, video/audio recordings, student- and teacher-generated artifacts, and pre and post assessments of students' knowledge and self-efficacy. Mixed methods analyses of these data, and syntheses of findings across participants, classroom enactments, and project years, will explore effective ways to support co-design among art teachers, mathematics teachers, and researchers; and the impact of art-integrated activities on students' data literacy. This project will reach 12 teachers and their students across 6 New York city schools. By building capacity and knowledge about how to initiate and sustain teachers' interdisciplinary curriculum collaborations, the project will have broader impact. Refined project materials, including pedagogical approaches, toolkits and adaptable classroom activities, will be disseminated to facilitate classroom adoption by other educators who wish to undertake similar art-integrated data literacy curriculum design collaborations, and will thus ultimately broaden participation in data science among diverse youth within and beyond New York City.

Building Students' Data Literacy through the Co-design of Curriculum by Mathematics and Art Teachers (Collaborative Research: Vacca)

The aim of this project is to enact and study a process in which middle school teachers of mathematics and visual arts co-design and teach activities that combine math and art to teach data science.

Lead Organization(s): 
Award Number: 
1908142
Funding Period: 
Mon, 07/01/2019 to Wed, 06/30/2021
Full Description: 

The aim of this project is to enact and study a process in which middle school teachers of mathematics and visual arts co-design and teach activities that combine math and art to teach data science. Many existing efforts to promote data literacy are grounded in mathematical concepts of central tendency and variation, and typically are narrowly focused in single subject domains. Taking an art-based perspective on data science has the potential to promote student relevance, accessibility, engagement, reasoning, and meaning-making with data science. Moreover, visualization technology has advanced to a degree that the relation between the information in data and visual aesthetic can be leveraged easily. To explore the opportunity this offers, research on this project will examine how to equip teachers to develop such interdisciplinary pedagogical approaches to cultivate their students' data literacy. This exploratory project will provide support for 12 teachers during summer workshops and during the school year as these teachers implement their co-designed units in their classrooms. The work addresses the following questions: (1) How do we support effective co-design of data literacy units among art teachers, mathematics teachers, and researchers? (2) How are teachers able to use the unit materials in their classrooms to engage students in data literacy? And (3) How does an art-based approach support students' data literacy? Answers to these questions will build an understanding of how to support interdisciplinary curriculum design collaborations among researchers and teachers. They will also show how art-integrated, maker-oriented activities can support middle school learners' data literacy development; and how to design technologies that are accessible and powerful to teachers and learners in these interdisciplinary environments.

Through summer workshops and year-round design collaborations, the project will iteratively design, test and refine four units for middle school classrooms, including activities, tools, and assessments, to promote students' data literacy. Data will be collected from co-design sessions as well as classroom-enactments, and will include observations, video/audio recordings, student- and teacher-generated artifacts, and pre and post assessments of students' knowledge and self-efficacy. Mixed methods analyses of these data, and syntheses of findings across participants, classroom enactments, and project years, will explore effective ways to support co-design among art teachers, mathematics teachers, and researchers; and the impact of art-integrated activities on students' data literacy. This project will reach 12 teachers and their students across 6 New York city schools. By building capacity and knowledge about how to initiate and sustain teachers' interdisciplinary curriculum collaborations, the project will have broader impact. Refined project materials, including pedagogical approaches, toolkits and adaptable classroom activities, will be disseminated to facilitate classroom adoption by other educators who wish to undertake similar art-integrated data literacy curriculum design collaborations, and will thus ultimately broaden participation in data science among diverse youth within and beyond New York City.

Building Students' Data Literacy through the Co-design of Curriculum by Mathematics and Art Teachers (Collaborative Research: Silander)

The aim of this project is to enact and study a process in which middle school teachers of mathematics and visual arts co-design and teach activities that combine math and art to teach data science.

Award Number: 
1908030
Funding Period: 
Mon, 07/01/2019 to Wed, 06/30/2021
Full Description: 

The aim of this project is to enact and study a process in which middle school teachers of mathematics and visual arts co-design and teach activities that combine math and art to teach data science. Many existing efforts to promote data literacy are grounded in mathematical concepts of central tendency and variation, and typically are narrowly focused in single subject domains. Taking an art-based perspective on data science has the potential to promote student relevance, accessibility, engagement, reasoning, and meaning-making with data science. Moreover, visualization technology has advanced to a degree that the relation between the information in data and visual aesthetic can be leveraged easily. To explore the opportunity this offers, research on this project will examine how to equip teachers to develop such interdisciplinary pedagogical approaches to cultivate their students' data literacy. This exploratory project will provide support for 12 teachers during summer workshops and during the school year as these teachers implement their co-designed units in their classrooms. The work addresses the following questions: (1) How do we support effective co-design of data literacy units among art teachers, mathematics teachers, and researchers? (2) How are teachers able to use the unit materials in their classrooms to engage students in data literacy? And (3) How does an art-based approach support students' data literacy? Answers to these questions will build an understanding of how to support interdisciplinary curriculum design collaborations among researchers and teachers. They will also show how art-integrated, maker-oriented activities can support middle school learners' data literacy development; and how to design technologies that are accessible and powerful to teachers and learners in these interdisciplinary environments.

Through summer workshops and year-round design collaborations, the project will iteratively design, test and refine four units for middle school classrooms, including activities, tools, and assessments, to promote students' data literacy. Data will be collected from co-design sessions as well as classroom-enactments, and will include observations, video/audio recordings, student- and teacher-generated artifacts, and pre and post assessments of students' knowledge and self-efficacy. Mixed methods analyses of these data, and syntheses of findings across participants, classroom enactments, and project years, will explore effective ways to support co-design among art teachers, mathematics teachers, and researchers; and the impact of art-integrated activities on students' data literacy. This project will reach 12 teachers and their students across 6 New York city schools. By building capacity and knowledge about how to initiate and sustain teachers' interdisciplinary curriculum collaborations, the project will have broader impact. Refined project materials, including pedagogical approaches, toolkits and adaptable classroom activities, will be disseminated to facilitate classroom adoption by other educators who wish to undertake similar art-integrated data literacy curriculum design collaborations, and will thus ultimately broaden participation in data science among diverse youth within and beyond New York City.

Young Mathematicians: Expanding an Innovative and Promising Model Across Learning Environments to Promote Preschoolers' Mathematics Knowledge

The goal of this design and development project is to address the critical need for innovative resources that transform the mathematics learning environments of preschool children from under-resourced communities by creating a cross-context school-home intervention.

Award Number: 
1907904
Funding Period: 
Mon, 07/01/2019 to Fri, 06/30/2023
Full Description: 

Far too many children in the U.S. start kindergarten lacking the foundational early numeracy skills needed for academic success. This project contributes to the goal of enhancing the learning and teaching of early mathematics in order to build a STEM-capable workforce and STEM-literate citizenry, which are both crucial to our nation's prosperity and competitiveness. Preparation for the STEM-workforce must start early, as young children's mathematics development undergirds cognitive development, building brain architecture, and supporting problem-solving, puzzling, and persevering, while strongly impacting and predicting future success in school. Preschool children from low socio-economic backgrounds are particularly at risk, as their mathematics knowledge may be up to a full year behind their middle-income peers. Despite agreements about the importance of mathematics-rich interactions for young children's learning and development, most early education teachers and families are not trained in evidence-based methods that can facilitate these experiences, making preschool learning environments (such as school and home) a critical target for intervention. The benefit of this project is that it will develop a robust model for a school-based intervention in early mathematics instruction. The model has the potential to broaden participation by providing instructional materials that support adult-child interaction and engagement in mathematics, explicitly promoting school-home connections in mathematics, and addressing educators' and families' attitudes toward mathematics while promoting children's mathematical knowledge and narrowing opportunity gaps.

The goal of this design and development project is to address the critical need for innovative resources that transform the mathematics learning environments of preschool children from under-resourced communities by creating a cross-context school-home intervention. To achieve this goal, qualitative and quantitative research methodologies will be employed, integrating data from multiple sources and stakeholders. Specifically, the project will: (1) engage in a materials design and development process that includes an iterative cycle of design, development, and implementation, collaborating with practitioners and families in real-world settings; (2) collect and analyze data from at least 40 Head Start classrooms, implementing the mathematics materials to ensure that the classroom and family mathematics materials and resources are engaging, usable, and comprehensible to preschoolers, teachers, and families; and (3) conduct an experimental study that will measure the impact of the intervention on preschool children's mathematics learning. The researchers will analyze collected data using hierarchical linear regression modeling to account for the clustering of children within classrooms. The researchers will also use a series of regression models and multi-level models to determine whether the intervention promotes student outcomes and whether it supports teachers' and families' positive attitudes toward mathematics.

Improving Grades 6-8 Students' Mathematics Achievement in Modeling and Problem Solving through Effective Sequencing of Instructional Practices

This project will provide structured and meaningful scaffolds for teachers in examining two research-based teaching strategies hypothesized to positively impact mathematics achievement in the areas of mathematical modeling and problem solving. The project investigates whether the order in which teachers apply these practices within the teaching of mathematics content has an impact on student learning.

Project Email: 
Lead Organization(s): 
Award Number: 
1907840
Funding Period: 
Mon, 07/01/2019 to Fri, 06/30/2023
Full Description: 

The Researching Order of Teaching project will provide structured and meaningful scaffolds for teachers in examining two research-based teaching strategies hypothesized to positively impact mathematics achievement in the areas of mathematical modeling and problem solving. The first strategy, Explicit Attention to Concepts (EAC), is a set of practices that draw students' attention specifically to mathematical concepts in ways that extend beyond memorization, procedures, or application of skills. This strategy may include teachers asking students to connect multiple mathematical representations, compare solution strategies, discuss mathematical reasoning underlying procedures, or to identify a main mathematical idea in a lesson and how it fits into the broader mathematical landscape. The second strategy, Student Opportunities to Struggle (SOS), entails providing students with time and space to make sense of graspable content, overcoming confusion points, stimulating personal sense-making, building perseverance, and promoting openness to challenge. This strategy may include teachers assigning problems with multiple solution strategies, asking students to look for patterns and make conjectures, encouraging and promoting discourse around confusing or challenging ideas, and asking students for extended mathematical responses. This project investigates whether the order in which teachers apply these practices within the teaching of mathematics content has an impact on student learning. This study builds on previous work that had identified an interaction between the EAC and SOS instructional strategies, and associated teacher reporting of stronger use of the practices with higher student mathematics achievement.

The project will have four key design features. First, the project will adopt and extend the research-based EAC/SOS conceptual framework, and explicitly responds to the call for further research on the interactions. Second, the project will focus on the mathematical areas of modeling and problem solving, two complex and critical competencies for all students in the middle grades. Third, the project will position teachers as collaborators in the research with needed expertise. Finally, the project will make use of research methods from crossover clinical trials to implementation in classrooms. The project aims to identify the affordances and constraints of the EAC/SOS framework in the design and development of instructional practices, to identify student- and teacher-level factors associated with changes in modeling and problem solving outcomes, to analyze teachers' implementations EAC and SOS in teaching modeling and problem solving and to associate those implementation factors with student achievement changes, and to determine whether the ordering of these two strategies correlates with differences in achievement. The project will collect classroom observation data and make use of existing tools to obtain reliable and valid ratings of the EAC and SOS strategies in action.The design of the study features a randomized 2 x 2 cluster crossover trial with a sample of teachers for 80% power. The project builds on existing state infrastructure and relationships with a wide array of school districts in the context of professional development, and aims to create a formal Teacher-Researcher Alliance for Investigating Learning as a part of the project work.

Pages

Subscribe to Mixed Methods