Mixed Methods

Readiness through Integrative Science and Engineering: Refining and Testing a Co-constructed Curriculum Approach with Head Start Partners

Building upon prior research on Head Start curriculum, this phase of Readiness through Integrative Science and Engineering (RISE) will be expanded to include classroom coaches and community experts to enable implementation and assessment of RISE in a larger sample of classrooms. The goal is to improve school readiness for culturally and linguistically diverse, urban-residing children from low-income families, and the focus on science, technology, and engineering will address a gap in early STEM education.

Lead Organization(s): 
Award Number: 
1621161
Funding Period: 
Sat, 10/01/2016 to Wed, 09/30/2020
Full Description: 

Readiness through Integrative Science and Engineering (RISE) is a late stage design and development project that will build upon the results of an earlier NSF-funded design and development study in which a co-construction process for curriculum development was designed by a team of education researchers with a small group of Head Start educators and parent leaders. In this phase, the design team will be expanded to include Classroom Coaches and Community Experts to enable implementation and assessment of the RISE model in a larger sample of Head Start classrooms. In this current phase, an iterative design process will further develop the science, technology, and engineering curricular materials as well continue to refine supports for teachers to access families' funds of knowledge related to science, technology, and engineering in order to build on children's prior knowledge as home-school connections. The ultimate goal of the project is to improve school readiness for culturally and linguistically diverse, urban-residing children from low-income families who tend to be underrepresented in curriculum development studies even though they are most at-risk for later school adjustment difficulties. The focus on science, technology, and engineering will address a gap in early STEM education.

The proposed group-randomized design, consisting of 90 teachers/classrooms (45 RISE/45 Control), will allow for assessment of the impact of a 2-year RISE intervention compared with a no-intervention control group. Year 1 will consist of recruitment, induction, and training of Classroom Coaches and Community Experts in the full RISE model, as well as preparation of integrative curricular materials and resources. In Year 2, participating teachers will implement the RISE curriculum approach supported by Classroom Coaches and Community Experts; data on teacher practice, classroom quality, and implementation fidelity will be collected, and these formative assessments will inform redesign and any refinements for Year 3. During Year 2, project-specific measures of learning for science, technology, and engineering concepts and skills will also be tested and refined. In Year 3, pre-post data on teachers (as in Year 2) as well as on 10 randomly selected children in each classroom (N = 900) will be collected. When child outcomes are assessed, multilevel modeling will be used to account for nesting of children in classrooms. In addition, several moderators will be examined in final summative analyses (e.g., teacher education, part or full-day classroom, parent demographics, implementation fidelity). At the end of this project, all materials will be finalized and the RISE co-construction approach will be ready for scale-up and replication studies in other communities.

Algebra Project Mathematics Content and Pedagogy Initiative

This project will scale up, implement, and assess the efficacy of interventions in K-12 mathematics education based on the well-established Algebra Project (AP) pedagogical framework, which seeks to improve performance and participation in mathematics of students in distressed school districts, particularly low-income students from underserved populations.

Award Number: 
1621416
Funding Period: 
Thu, 09/15/2016 to Mon, 08/31/2020
Full Description: 

Algebra continues to serve as a gatekeeper and potential barrier for high school students. The Algebra Project Mathematics Content and Pedagogy Initiative (APMCPI) will scale up, implement and assess the efficacy of interventions in K-12 mathematics education based on the well-established Algebra Project (AP) pedagogical framework. The APMCPI project team is comprised of four HBCUs (Virginia State University, Dillard University, Xavier University, Lincoln University), the Southern Initiative Algebra Project (SIAP), and four school districts that are closely aligned with partner universities. The purpose of the Algebra Project is to improve performance and participation in mathematics by members of students in distressed school districts, particularly those with a large population of low-income students from underserved populations including African American and Hispanics. The project will provide professional development and implement the Algebra Project in four districts and study the impact on student learning. The research results will inform the nation's learning how to improve mathematics achievement for all children, particularly those in distressed inner-city school districts.

The study builds on a prior pilot project with a 74% increase in students who passed the state exam. In the early stages of this project, teachers in four districts closely associated with the four universities will receive Algebra Project professional development in Summer Teacher Institutes with ongoing support during the academic year, including a community development plan. The professional development is designed to help teachers combine mathematical problem solving with context-rich lessons, which both strengthen and integrate teachers' understanding of key concepts in mathematics so that they better engage their students. The project also will focus on helping teachers establish a framework for mathematically substantive, conceptually-rich and experientially-grounded conversations with students. The first year of the study will begin a longitudinal quasi-experimental, explanatory, mixed-method design. Over the course of the project, researchers will follow cohorts who are in grade-levels 5 through 12 in Year 1 to allow analyses across crucial transition periods - grades 5 to 6; grades 8 to 9; and grades 12 to college/workforce. Student and teacher data will be collected in September of Project Year 1, and in May of each project year, providing five data points for each student and teacher participant. Student data will include student attitude, belief, anxiety, and relationship to mathematics and science, in addition to student learning outcome measures. Teacher data will include content knowledge, attitudes and beliefs, and practices. Qualitative data will provide information on the implementation in both the experimental and control conditions. Analysis will include hierarchical linear modeling and multivariate analysis of covariance.

Sonified Interactive Simulations for Accessible Middle School STEM

For this project, researchers will iteratively develop simulations to include sonifications, non-speech sounds that represent visual information, aimed at enhancing accessibility for all learners, but particularly for those with visual impairments to produce sonified simulations, professional development resources, design guidelines and exemplars, and publications.

Lead Organization(s): 
Award Number: 
1621363
Funding Period: 
Sat, 10/01/2016 to Mon, 09/30/2019
Full Description: 

Students with disabilities often have fewer opportunities for experiential learning, an important component of quality STEM education. Computer based simulations in science can provide valuable opportunities for these students to experience and manipulate natural phenomena related to critical STEM ideas. However, existing simulations remain largely inaccessible to students with visual impairments in particular. Recent advances in technology related to sonification use with simulations can make it possible for these students to have a more complete and authentic experience. Sonification is the use of non-speech sounds, such as musical tones, to represent visual information including data. Such sounds can be manipulated temporally and spatially and can also vary by amplitude and frequency to convey information that is more traditionally displayed visually. 

Researchers will iteratively develop five middle school physical science simulations to include sonifications aimed at enhancing accessibility for all learners, but particularly for those with visual impairments. Data collection activities will include focus groups and interviews with students and teachers focused on engagement. The end products of this project will include sonified simulations, professional development resources, design guidelines and exemplars, and publications.

Systemic Formative Assessment to Promote Mathematics Learning in Urban Elementary Schools

This project builds on the study of the Ongoing Assessment Project's (OGAP) math assessment intervention on elementary teachers and students and combines the intervention with research-based understandings of systemic reform. This project will produce concrete tools, routines, and practices that can be applied to strengthen programs' implementation by ensuring the strategic support of school and district leaders.

Lead Organization(s): 
Award Number: 
1621333
Funding Period: 
Thu, 09/15/2016 to Sat, 02/29/2020
Full Description: 

Districts have long struggled to implement instructional programming in ways that meaningfully and sustainably impact teaching and learning. Systemic education reform is based on the hypothesis that prevailing patterns of incoherence and misalignment in an educational system can send mixed messages to local implementers as they try to respond to various cues and incentives in the environment. Systemic reform seeks to bring alignment to education systems in multiple ways, including consistency across instructional philosophies, alignment across grade levels, and vertical coherence from district to schools to classrooms. This project builds on the Consortium for Policy Research in Education's (CPRE) ongoing, NSF-funded experimental study of the impacts of the Ongoing Assessment Project's (OGAP) math assessment intervention on elementary teachers and students in Philadelphia-area schools. The project will combine the OGAP math intervention with research-based understandings of systemic reform. OGAP is based upon established theory and research demonstrating the impact of teachers' use of ongoing short- and medium-cycle formative assessment on student learning. It combines these understandings with recent research on learning trajectories within mathematics content domains. By bringing to bear the strengths of all three of these areas of research - formative assessment, learning trajectories, and systemic reform - the project promises a significant contribution to the knowledge base about the application of math learning research to classroom instruction on a large scale. This project will produce concrete tools, routines, and practices that can be applied to strengthen programs' implementation by ensuring the strategic support of school and district leaders. This project is funded by the Discovery Research PreK-12 (DRK-12) and EHR Core Research (ECR) Programs. The DRK-12 program supports research and development on STEM education innovations and approaches to teaching, learning, and assessment. The ECR program emphasizes fundamental STEM education research that generates foundational knowledge in the field.

CPRE and the School District of Philadelphia (SDP) will establish a research-practice partnership focused on developing, implementing, refining, and testing a systemic support model to strengthen implementation of the OGAP math intervention in elementary schools. CPRE's current experimental study of OGAP's impacts reveals, preliminarily, statistically significant positive effects on teacher knowledge and student learning. As a result, SDP has decided to expand OGAP into an additional 60 schools in 2016-17. However, the current OGAP study has also revealed weak implementation stemming from a lack of consistent leadership support for the intervention. The project will address this implementation challenge by developing, refining, supporting, and documenting a systemic support component that will accompany OGAP's classroom-level implementation. The systemic supports will be developed by a research-practice partnership between CPRE; SDP; OGAP; the Graduate School of Education at the University of Pennsylvania (PennGSE); and the Philadelphia Education Research Consortium (PERC). The team will use principles of design-based implementation research to iteratively refine and improve the systemic support model. Along with the design and development of the systemic support model, the project will conduct a mixed-methods study of its impacts and roll-out. A three-armed quasi-experimental study will examine the differential impacts of OGAP, with and without systemic supports, and business-as-usual math programming on teacher and student outcomes. A mixed-methods study will examine teacher and administrator experiences in both treatment groups, and will provide feedback to inform the iterative development of the systemic support model.

Analysis of Effective Science Coaching: What, Why and How

This project will conduct an in-depth analysis of instructional coaching by analyzing archived video-recorded coaching sessions with middle and high school science teachers. The goal of the project is to analyzing the videos and previously collected quantitative outcome data to create descriptive profiles of instructional coaching and identify which key coaching elements lead to desired teacher and student outcomes.

Lead Organization(s): 
Award Number: 
1621308
Funding Period: 
Sat, 10/01/2016 to Mon, 09/30/2019
Full Description: 

This Exploratory project will conduct an in-depth analysis of instructional coaching by analyzing 520 hours of archived video-recorded coaching sessions with 75 middle and high school science teachers in grades 6-12 collected in a U.S. Department of Education IES-funded coaching research study. The goal of the project is to "unpack" the coaching intervention by analyzing the videos and previously collected quantitative outcome data to (a) create descriptive profiles of instructional coaching and (b) identify which key coaching elements ("active ingredients") lead to desired teacher and student outcomes.

Following a design-based research approach, relying on iterative feedback and using data saturation process to analyze data, the project will translate theorized, conceptual characteristics of coaching into empirical models to guide future coaching research and practical guidance through identification of critical elements needed for coaching to work.

InquirySpace 2: Broadening Access to Integrated Science Practices

This project will create technology-enhanced classroom activities and resources that increase student learning of science practices in high school biology, chemistry, and physics. InquirySpace will incorporate several innovative technological and pedagogical features that will enable students to undertake scientific experimentation that closely mirrors current science research and learn what it means to be a scientist.

Lead Organization(s): 
Partner Organization(s): 
Award Number: 
1621301
Funding Period: 
Thu, 09/15/2016 to Tue, 08/31/2021
Full Description: 

This project will create technology-enhanced classroom activities and resources that increase student learning of science practices in high school biology, chemistry, and physics courses. The project addresses the urgent national priority to improve science education as envisioned in the Next Generation Science Standards (NGSS) by focusing less on learning facts and equations and instead providing students with the time, skills, and resources to experience the conduct of science and what it means to be a scientist. This project builds on prior work that created a sequence of physics activities that significantly improved students' abilities to undertake data-based experiments and led to productive independent investigations. The goal of the InquirySpace project is to improve this physics sequence, extend the approach to biology and chemistry, and adapt the materials to the needs of diverse students by integrating tailored formative feedback in real time. The result will be student and teacher materials that any school can use to allow students to experience the excitement and essence of scientific investigations as an integral part of science instruction. The project plans to create and iteratively revise learning materials and technologies, and will be tested in 48 diverse classroom settings. The educational impact of the project's approach will be compared with that of business-as-usual approaches used by teachers to investigate to what extent it empowers students to undertake self-directed experiments. To facilitate the widest possible use of the project, a complete set of materials, software, teacher professional development resources, and curriculum design documents will be available online at the project website, an online teacher professional development course, and teacher community sites. The Discovery Research K-12 program (DRK-12) seeks to significantly enhance the learning and teaching of science, technology, engineering and mathematics (STEM) by preK-12 students and teachers, through research and development of innovative resources, models and tools (RMTs). Projects in the DRK-12 program build on fundamental research in STEM education and prior research and development efforts that provide theoretical and empirical justification for proposed projects.

InquirySpace will incorporate several innovative technological and pedagogical features that will enable students to undertake scientific experimentation that closely mirrors current science research. These features will include (1) educational games to teach data analysis and interpretation skills needed in the approach, (2) reduced dependence on reading and writing through the use of screencast instructions and reports, (3) increased reliance on graphical analysis that can make equations unnecessary, and (4) extensive use of formative feedback generated from student logs. The project uses an overarching framework called Parameter Space Reasoning (PSR) to scaffold students through a type of experimentation applicable to a very large class of experiments. PSR involves an integrated set of science practices related to a question that can be answered with a series of data collection runs for different values of independent variables. Data can be collected from sensors attached to the computer, analysis of videos, scientific databases, or computational models. A variety of visual analytic tools will be provided to reveal patterns in the graphs. Research will be conducted in three phases: design and development of technology-enhanced learning materials through design-based research, estimation of educational impact using a quasi-experimental design, and feasibility testing across diverse classroom settings. The project will use two analytical algorithms to diagnose students' learning of data analysis and interpretation practices so that teachers and students can modify their actions based on formative feedback in real time. These algorithms use computationally optimized calculations to model the growth of student thinking and investigation patterns and provide actionable information to teachers and students almost instantly. Because formative feedback can improve instruction in any field, this is a major development that has wide potential.

Sensing Science through Modeling: Developing Kindergarten Students' Understanding of Matter and Its Changes

This project will develop a technology-supported, physical science curriculum that will facilitate kindergarten students' conceptual understanding of matter and how matter changes. The results of this investigation will contribute important data on the evolving structure and content of children's physical science models as well as demonstrate children's understanding of matter and its changes.

Lead Organization(s): 
Award Number: 
1621299
Funding Period: 
Sat, 10/01/2016 to Wed, 09/30/2020
Full Description: 

Despite recent research demonstrating the capacity of young children to engage deeply with science concepts and practices, challenging science curriculum is often lacking in the early grades. This project addresses this gap by developing a technology-supported, physical science curriculum that will facilitate kindergarten students' conceptual understanding of matter and how matter changes. To accomplish these goals, the curriculum will include opportunities for students to participate in model-based inquiry in conjunction with the use of digital probeware and simulations that enable students to observe dynamic visualizations and make sense of the phenomena. To support the capacity of kindergarten teachers, a continuous model of teacher development will be implemented.

Throughout development, the project team will collaborate with kindergarten teachers and more than 300 demographically diverse students across eight classrooms in Massachusetts and Indiana. A design based research approach will be used to iteratively design and revise learning activities, technological tools, and assessments that meet the needs and abilities of kindergarten students and teachers. The project team will: 1) work with kindergarten teachers to modify an existing Grade 2 curricular unit for use with their students; 2) design a parallel curricular unit incorporating technology; 3) evaluate both units for feasibility and maturation effects; and 4) iteratively revise and pilot an integrated unit and assess kindergarten student conceptual understanding of matter and its changes. The results of this investigation will contribute important data on the evolving structure and content of children's physical science models as well as demonstrate children's understanding of matter and its changes.

Building a Next Generation Diagnostic Assessment and Reporting System within a Learning Trajectory-Based Mathematics Learning Map for Grades 6-8

This project will build on prior funding to design a next generation diagnostic assessment using learning progressions and other learning sciences research to support middle grades mathematics teaching and learning. The project will contribute to the nationally supported move to create, use, and apply research based open educational resources at scale.

Award Number: 
1621254
Funding Period: 
Thu, 09/15/2016 to Sat, 08/31/2019
Full Description: 

This project seeks to design a next generation diagnostic assessment using learning progressions and other research (in the learning sciences) to support middle grades mathematics teaching and learning. It will focus on nine large content ideas, and associated Common Core State Standards for Mathematics. The PIs will track students over time, and work within school districts to ensure feasibility and use of the assessment system.

The research will build on prior funding by multiple funding agencies and address four major goals. The partnership seeks to address these goals: 1) revising and strengthening the diagnostic assessments in mathematics by adding new item types and dynamic tools for data gathering 2) studying alternative ways to use measurement models to assess student mathematical progress over time using the concept of learning trajectories, 3) investigating how to assist students and teachers to effectively interpret reports on math progress, both at the individual and the class level, and 4) engineering and studying instructional strategies based on student results and interpretations, as they are implemented within competency-based and personalized learning classrooms. The learning map, assessment system, and analytics are open source and can be used by other research and implementation teams. The project will exhibit broad impact due to the number of states, school districts and varied kinds of schools seeking this kind of resource as a means to improve instruction. Finally, the research project contributes to the nationally supported move to create, use, and apply research based open educational resources at scale.

Learning Evolution through Human and Non-Human Case Studies

This project will develop and test two curriculum units on the topic of evolution for high school general biology courses, with one unit focusing primarily on human case studies to teach evolution and one unit focusing primarily on case studies of evolution in other species. The two units will be compared to examine how different approaches to teaching evolution affect students and teachers.

Lead Organization(s): 
Award Number: 
1621194
Funding Period: 
Thu, 09/15/2016 to Tue, 08/31/2021
Full Description: 

This project aligns with Alabama's College & Career-Ready Standards (CCRS) for biology in grades 9-12 relating to Unity and Diversity. These standards are based on the Next Generation Science Standards (NGSS) and go into effect during the 2016-2017 school year. Building on prior work (DRL-119468), this project will develop and test two curriculum units on the topic of evolution for high school general biology courses, with one unit focusing primarily on human case studies to teach evolution and one unit focusing primarily on case studies of evolution in other species. The two units will be compared to examine how different approaches to teaching evolution affect students and teachers. The project will also develop and field test a Cultural and Religious Sensitivity (CRS) Resource to provide teachers with strategies for creating supportive learning environments where understanding of the scientific account of evolution is aided while also acknowledging the cultural controversy associated with learning about evolution. The impacts on student and teacher outcomes of using the curriculum units and the CRS Resource will be tested in classrooms by comparing the outcomes of the human versus non-human units, and by using or not using classroom strategies from the CRS Resource.

The project will examine student and teacher outcomes of four treatment groups: 1) Curriculum Unit 1, 2) Curriculum Unit 1 with the CRS Resource, 3) Curriculum Unit 2, and 4) Curriculum Unit 2 with the CRS Resource. The research questions are: 1) In what ways does using examples of human versus non-human evolution to teach core evolutionary concepts affect understanding of, acceptance of, and motivation to learn about evolution among high school introductory biology students? 2) In what ways do using teaching strategies that focus on acknowledging the cultural controversy about evolution using a procedural neutrality approach affect high school introductory biology teachers' comfort and confidence with teaching evolution? 3) In what ways does using examples of human versus non-human evolution to teach fundamental evolutionary concepts in conjunction with teaching strategies that focus on acknowledging the cultural controversy about evolution using a procedural neutrality approach affect understanding of, acceptance of, and motivation to learn about evolution among high school introductory biology students? And 4) In what ways does using examples of human versus non-human evolution to teach fundamental evolutionary concepts in conjunction with teaching strategies that focus on acknowledging the cultural controversy about evolution using a procedural neutrality approach affect high school introductory biology teachers' comfort and confidence with teaching evolution? The project will use a 2 X 2 X 2 mixed factorial quasi-experimental research design to answer these questions, and will include a total of 32 teachers, 8 in each treatment group, along with approximately 800 students. Each assessment will be administered as a pretest two weeks prior to starting the curriculum unit and as a posttest immediately after completing the unit. Test scores will be the within-subjects factors, and Curriculum Unit and CRS Resource will be the between-subjects factors.

Geological Models for Explorations of Dynamic Earth (GEODE): Integrating the Power of Geodynamic Models in Middle School Earth Science Curriculum

This project will develop and research the transformational potential of geodynamic models embedded in learning progression-informed online curricula modules for middle school teaching and learning of Earth science. The primary goal of the project is to conduct design-based research to study the development of model-based curriculum modules, assessment instruments, and professional development materials for supporting student learning of (1) plate tectonics and related Earth processes, (2) modeling practices, and (3) uncertainty-infused argumentation practices.

Lead Organization(s): 
Award Number: 
1621176
Funding Period: 
Mon, 08/15/2016 to Fri, 07/31/2020
Full Description: 

This project will contribute to the Earth science education community's understanding of how engaging students with dynamic computer-based systems models supports their learning of complex Earth science concepts regarding Earth's surface phenomena and sub-surface processes. It will also extend the field's understandings of how students develop modeling practices and how models are used to support scientific endeavors. This research will shed light on the role uncertainty plays when students use models to develop scientific arguments with model-based evidence. The GEODE project will directly involve over 4,000 students and 22 teachers from diverse school systems serving students from families with a variety of socioeconomic, cultural, and racial backgrounds. These students will engage with important geoscience concepts that underlie some of the most critical socio-scientific challenges facing humanity at this time. The GEODE project research will also seek to understand how teachers' practices need to change in order to take advantage of these sophisticated geodynamic modeling tools. The materials generated through design and development will be made available for free to all future learners, teachers, and researchers beyond the participants outlined in the project.

The GEODE project will develop and research the transformational potential of geodynamic models embedded in learning progression-informed online curricula modules for middle school teaching and learning of Earth science. The primary goal of the project is to conduct design-based research to study the development of model-based curriculum modules, assessment instruments, and professional development materials for supporting student learning of (1) plate tectonics and related Earth processes, (2) modeling practices, and (3) uncertainty-infused argumentation practices. The GEODE software will permit students to "program" a series of geologic events into the model, gather evidence from the emergent phenomena that result from the model, revise the model, and use their models to explain the dynamic mechanisms related to plate motion and associated geologic phenomena such as sedimentation, volcanic eruptions, earthquakes, and deformation of strata. The project will also study the types of teacher practices necessary for supporting the use of dynamic computer models of complex phenomena and the use of curriculum that include an explicit focus on uncertainty-infused argumentation.

Pages

Subscribe to Mixed Methods