Quasi-experimental

CAREER: Multilevel Mediation Models to Study the Impact of Teacher Development on Student Achievement in Mathematics

This project will develop a comprehensive framework to inform and guide the analytic design of teacher professional development studies in mathematics. An essential goal of the research is to advance a science of teaching and learning in ways that traverse both research and education.

Lead Organization(s): 
Award Number: 
1552535
Funding Period: 
Thu, 09/01/2016 to Tue, 08/31/2021
Full Description: 

This is a Faculty Early Career Development Program (CAREER) project. The CAREER program is a National Science Foundation-wide activity that offers the most prestigious awards in support of junior faculty who exemplify the role of teacher-scholars through outstanding research, excellent education and the integration of education and research. The intellectual merit and broader impacts of this study lie in two complementary contributions of the project. First, the development of the statistical framework for the design of multilevel mediation studies has significant potential for broad impact because it develops a core platform that is transferable to other STEM (science, technology, engineering, and mathematics) education areas and STEM disciplines. Second, the development of software and curricular materials to implement this framework further capitalize on the promise of this work because it distributes the results in an accessible manner to diverse sets of research and practitioner groups across STEM education areas and STEM disciplines. Together, the components of this project will substantially expand the scope and quality of evidence generated through mathematics professional development and, more generally, multilevel mediation studies throughout STEM areas by increasing researchers' capacity to design valid and comprehensive studies of the theories of action and change that underlie research programs.

This project will develop a comprehensive framework to inform and guide the analytic design of teacher professional development studies in mathematics. The proposed framework incorporates four integrated research and education components: (1) develop statistical formulas and tools to guide the optimal design of experimental and non-experimental multilevel mediation studies in the presence of measurement error, (2) develop empirical estimates of the parameters needed to implement these formulas to design teacher development studies in mathematics, (3) develop free and accessible software to execute this framework, and (4) develop training materials and conduct workshops on the framework to improve the capacity of the field to design effective and efficient studies of teacher development. An essential goal of the research is to advance a science of teaching and learning in ways that traverse both research and education.

Science, Technology, Engineering and Mathematics Scholars Teacher Academy Resident System

This project will investigate the effectiveness of a teacher academy resident model to recruit, license, induct, employ, and retain middle school and secondary teachers for high-need schools in the South. It will prepare new, highly-qualified science and mathematics teachers from historically Black universities in high-needs urban and rural schools with the goal of increasing teacher retention and diversity rates.

Lead Organization(s): 
Award Number: 
1621325
Funding Period: 
Fri, 07/15/2016 to Wed, 06/30/2021
Full Description: 

This project at Jackson State University will investigate the effectiveness of a teacher academy resident model to recruit, license, induct, employ, and retain middle school and secondary science and mathematics teachers for high-need schools in the South. It will prepare new, highly-qualified science and mathematics teachers from historically Black universities in high-needs urban and rural schools. The project involves a partnership among three historically Black universities (Jackson, State University, Xavier University of Louisiana, and the University of Arkansas at Pine Bluff), and diverse urban and rural school districts in Jackson, Mississippi; New Orleans, Louisiana; and Pine Bluff Arkansas region that serve more than 175,000 students.

Participants will include 150 middle and secondary school teacher residents who will gain clinical mentored experience and develop familiarity with local schools. The 150 teacher residents supported by the program to National Board certification will obtain: state licensure/certification in science teaching, a master's degree, and initiation. The goal is to increase teacher retention and diversity rates. The research question guiding this focus is: Will training STEM graduates have a significant effect on the quality of K-12 instruction, teacher efficacy and satisfaction, STEM teacher retention, and students? Science and mathematics achievement? A quasi-experimental design will be used to evaluate project's effectiveness.

CAREER: Making Science Visible: Using Visualization Technology to Support Linguistically Diverse Middle School Students' Learning in Physical and Life Sciences

Award Number: 
1552114
Funding Period: 
Wed, 06/01/2016 to Tue, 05/31/2022
Full Description: 

The growing diversity in public schools requires science educators to address the specific needs of English language learners (ELLs), students who speak a language other than English at home. Although ELLs are the fastest-growing demographic group in classrooms, many are historically underserved in mainstream science classrooms, particularly those from underrepresented minority groups. The significant increase of ELLs at public schools poses a challenge to science teachers in linguistically diverse classrooms as they try to support and engage all students in learning science. The proposed project will respond to this urgent need by investigating the potential benefits of interactive, dynamic visualization technologies, including simulations, animations, and visual models, in supporting science learning for all middle school students, including ELLs. This project will also identify design principles for developing such technology, develop additional ways to support student learning, and provide new guidelines for effective science teachers' professional development that can assist them to better serve students from diverse language backgrounds. The project has the potential to transform traditional science instruction for all students, including underserved ELLs, and to broaden their participation in science.

In collaboration with eighth grade science teachers from two low-income middle schools in North Carolina, the project will focus on three objectives: (1) develop, test, and refine four open-source, web-based inquiry units featuring dynamic visualizations on energy and matter concepts in physical and life sciences, aligned with the Next Generation Science Standards (NGSS); (2) investigate how dynamic visualizations can engage eighth-grade ELLs and native-English-speaking students in science practices and improve their understanding of energy and matter concepts; and (3) investigate which scaffolding approaches can help maximize ELLs' learning with visualizations. Research questions include: (1) Which kinds of dynamic visualizations (simulations, animations, visual models) lead to the best learning outcomes for all students within the four instructional science units?; (2) Do ELLs benefit more from visualizations (or particular kinds of visualizations) than do native-English-speaking students?; and (3) What kinds of additional scaffolding activities (e.g., critiquing arguments vs. generating arguments) are needed by ELLs in order to achieve the greatest benefit? The project will use design-based research and mixed-methods approaches to accomplish its research objectives and address these questions. Furthermore, it will help science teachers develop effective strategies to support students' learning with visualizations. Products from this project, including four NGSS-aligned web-based inquiry units, the visualizations created for the project, professional development materials, and scaffolding approaches for teachers to use with ELLs, will be freely available through a project website and multiple professional development networks. The PI will collaborate with an advisory board of experts to develop the four instructional units, visualizations, and scaffolds, as well as with the participating teachers to refine these materials in an iterative fashion. Evaluation of the materials and workshops will be provided each year by the advisory board members, and their feedback will be used to improve design and implementation for the next year. The advisory board will also provide summative evaluation of student learning outcomes and will assess the success of the teachers' professional development workshops.

Three-Dimensional Teaching and Learning: Rebuilding and Researching an Online Middle School Curriculum

This project will develop an online curriculum-based supported by a teacher professional development (PD) program by rebuilding an existing life science unit of Biological Sciences Curriculum Study (BSCS) Middle School Science. The project is designed to be an exemplar of fully digital Next Generation Science Standards (NGSS) aligned resources for teachers and students, creating an NGSS-aligned learning environment combining disciplinary core ideas with science and engineering practices and cross-cutting concepts.

Lead Organization(s): 
Award Number: 
1502571
Funding Period: 
Tue, 09/01/2015 to Sat, 08/31/2019
Full Description: 

This project was funded by the Discovery Research K-12 (DRK-12) program that seeks to significantly enhance the learning and teaching of science, technology, engineering, and mathematics (STEM) by preK-12 students and teachers, through research and development of innovative resources, models, and tools. Projects in the DRK-12 program build on fundamental research in STEM education and prior research and development efforts that provide theoretical and empirical justification for proposed projects. The project, in collaboration with Oregon Public Broadcasting, will develop an online curriculum-based supported by a teacher professional development (PD) program by rebuilding an existing life science unit of Biological Sciences Curriculum Study (BSCS) Middle School Science. The materials will include strategically integrated multimedia elements including animations, interactive learning experiences, and enhanced readings for students, as well as classroom videos for teachers that will help all users gain a deeper understanding of three-dimensional learning. The project is designed to be an exemplar of fully digital Next Generation Science Standards (NGSS) aligned resources for teachers and students, creating an NGSS-aligned learning environment combining disciplinary core ideas with science and engineering practices and cross-cutting concepts. Using the powerful affordances of a digital environment, the project will invigorate and inspire learners and support teachers as only a media-rich environment can do.

The project will develop and research the project innovation, the combination of digital instructional materials for students and online teacher PD using a proven lesson-analysis framework. Although prior research has demonstrated the efficacy of the lesson analysis PD and curriculum elements independently, there has been little investigation of their joint ability to transform teaching and learning. The project will merge research and development in this project by incorporating a complex array of multi-component assessment activities, including classroom-based assessments, in a quasi-experimental study. Assessment activities will be designed using an evidence-centered design process that will involve the careful selection and development of assessment tasks, scoring rubrics, and criteria for scoring based on the performance expectations (PEs) and the best ways to elicit evidence about student proficiency with those PEs. The research, carried out by SRI International, will use multi-component tasks that will support inferences about student learning and advance understanding of how to assess NGSS learning. Project research and resources, which will include a digital, middle school life sciences unit, teacher PD and online digital resources, and related assessment tools, which will be widely disseminated to policy makers, researchers, and practitioners.


Project Videos

2020 STEM for All Video Showcase

Title: A Medical Mystery: Middle School Body Systems for the NGSS

Presenter(s): Susan Kowalski, Lindsey Mohan, Betty Stennett, Catherine Stimac, & Heather Young


Mathematical and Computational Methods for Planning a Sustainable Future II

The project will develop modules for grades 9-12 that integrate mathematics, computing and science in sustainability contexts. The project materials also include information about STEM careers in sustainability to increase the relevancy of the content for students and broaden their understanding of STEM workforce opportunities. It uses summer workshops to pilot test materials and online support and field testing in four states. 

Lead Organization(s): 
Award Number: 
1503414
Funding Period: 
Wed, 07/15/2015 to Sun, 06/30/2019
Full Description: 

The project will develop modules for grades 9-12 that integrate mathematics, computing and science in sustainability contexts. The project materials also include information about STEM careers in sustainability to increase the relevancy of the content for students and broaden their understanding of STEM workforce opportunities. It uses summer workshops to pilot test materials and online support and field testing in four states. Outcomes include the modules, tested and revised; strategies for transfer of learning embedded in the modules; and a compendium of green jobs, explicitly related to the modules. The Discovery Research K-12 program (DRK-12) seeks to significantly enhance the learning and teaching of science, technology, engineering and mathematics (STEM) by preK-12 students and teachers, through research and development of innovative resources, models and tools (RMTs). Projects in the DRK-12 program build on fundamental research in STEM education and prior research and development efforts that provide theoretical and empirical justification for proposed projects. The STEM+Computing Partnerships (STEM+C) Program is a joint effort between the Directorate for Education & Human Resources (EHR) and Directorate Computer & Information Science & Engineering (CISE). Reflecting the increasing role of computational approaches in learning across the STEM disciplines, STEM+C supports research and development efforts that integrate computing within one or more STEM disciplines and/or integrate STEM learning in computer science; 2) advance multidisciplinary, collaborative approaches for integrating computing in STEM in and out of school, and 3) build capacity in K-12 computing education through foundational research and focused teacher preparation

The project is a full design and development project in the learning strand of DRK-12. The goal is to enhance transfer of knowledge in mathematics and science via sustainability tasks with an emphasis on mathematical and scientific practices. The research questions focus on how conceptual representations and the modules support students' learning and especially transfer to novel problems. The project design integrates the research with the curriculum development. It includes a mixed methods data collection and analysis from teachers and students (e.g., interviews, content exams, focus groups, implementation logs). Assessment of student work includes both short, focused problems in the content area and longer project-based tasks providing a range of assessments of student learning. The investigators will develop a rubric for scoring student work on the tasks. The curriculum design process includes iterations of the modules over time with feedback from teachers and using data collected from the implementation.

Retention of Early Algebraic Understanding

The project will use a quasi-experimental design to explore students' knowledge of core algebraic concepts in middle grades (grade 6), one year after their completion of 3-year, grades 3-5 early algebra intervention. The research questions are: (1) how well students who received a specific intervention retain their understanding of algebraic concepts in future years; and (2) whether and how the intervening year of regular classroom instruction in grade 6 influences the algebra understanding of both intervention and comparison students.

Lead Organization(s): 
Award Number: 
1550897
Funding Period: 
Tue, 09/01/2015 to Wed, 08/31/2016
Full Description: 

The Discovery Research K-12 program (DRK-12) seeks to significantly enhance the learning and teaching of science, technology, engineering and mathematics (STEM) by prek-12 students and teachers through research and development of innovative resources, models and tools. While national and state standards provide important benchmarks for algebra learning beginning in kindergarten, they do not provide rigorously tested models by which these algebra standards might be attained in elementary grades classrooms in ways that will ensure further mathematics achievement. This work will addresses this need by closely documenting the effectiveness of models and tools, developed in our previous work, for early algebra education

The proposed project will use a quasi-experimental design to explore students' knowledge of core algebraic concepts in middle grades (grade 6), one year after their completion of 3-year, grades 3-5 early algebra intervention. The project will also study the algebraic knowledge of a comparison group of students. The research questions are: (1) how well students who received a specific intervention retain their understanding of algebraic concepts in future years; and (2) whether and how the intervening year of regular classroom instruction in grade 6 influences the algebra understanding of both intervention and comparison students.

Conceptual Model-based Problem Solving: A Response to Intervention Program for Students with Learning Difficulties in Mathematics

This project will develop a cross-platform mathematics tutoring program that addresses the problem-solving skill difficulties of second- and third-grade students with learning disabilities in mathematics (LDM). COMPS-A is a computer-generated instructional program focusing on additive word problem solving; it will provide tutoring specifically tailored to each individual student's learning profile in real time. 

Lead Organization(s): 
Award Number: 
1503451
Funding Period: 
Tue, 09/01/2015 to Fri, 08/31/2018
Full Description: 

The Discovery Research K-12 program (DRK-12) seeks to significantly enhance the learning and teaching of science, technology, engineering and mathematics (STEM) by preK-12 students and teachers, through research and development of innovative resources, models and tools. Projects in the DRK-12 program build on fundamental research in STEM education and prior research and development efforts that provide theoretical and empirical justification for proposed projects.

The 3-year exploratory project, Conceptual Model-based Problem Solving: A Response to Intervention Program for Students with Learning Difficulties in Mathematics, will develop a cross-platform mathematics tutoring program that addresses the problem-solving skill difficulties of second- and third-grade students with learning disabilities in mathematics (LDM). While mathematics problem-solving skills are critical in all areas of daily life, many students with LDM do not acquire key math concepts such as additive and multiplicative reasoning in a proficient manner during the early school years. In fact, about 5-10% of school-age children are identified as having mathematical disabilities which might cause them to experience considerable difficulties in the upper grades and experience persistent academic, life, and work challenges. Despite the proliferation of web-based mathematical games for early learners, there are very few programs or tools that target growth in the conceptual understanding of fundamental mathematical ideas, which is essential in enabling young students with LDM to perform proficiently in mathematical and everyday contexts. COMPS-A is a computer-generated instructional program focusing on additive word problem solving; it will provide tutoring specifically tailored to each individual student's learning profile in real time. COMPS-A will also make the reasoning and underlying mathematical model more explicit to them, and the tool's flexibility will facilitate group or one-on-one instruction in regular classroom settings, in other sessions during or after the school day, and at home. COMPS-A addresses a significant practical issue in today's classrooms by providing individualized and effective RtI intervention programs for students with LDM.

COMPS-A program represents a mathematical model-based problem-solving approach that emphasizes understanding and representation of mathematical relations in algebraic equations and, thus, will support growth in generalized problem-solving skills.COMPS-A will achieve the following objectives: 1) Create the curriculum content, screen design, and a teacher's manual for all four modules in the area of additive word problem solving; 2) Design and develop the cross-platform computer application that can be ported as a web-based, iPad, Android, or Windows app, and this flexibility will make the program accessible to all students; and 3) Conduct small-scale single subject design and randomized controlled trial studies to evaluate the potential of COMPS-A to enhance students' word problem-solving performance. The following research questions will be resolved: (1) What is the functional relationship between the COMPS-A program and students' performance in additive mathematics problem solving? (2) What is the teacher's role in identifying students' misconceptions, alternative reasoning, and knowledge gaps when students are not responsive to the intervention program? (3) What are the necessary instructional scaffolds that will address students' knowledge gaps and therefore facilitate the connection between students' conceptual schemes and the mathematical models necessary for problem solving in order to promote meaningful understanding and construction of additive reasoning? A functional prototype of the COMPS-A will be developed followed by a single-subject design study with a small group of students with LDM to field-test the initial program. Finally, a pretest-posttest, comparison group design with random assignment of participants to groups will then be used to examine the effects of the two intervention conditions: COMPS-A and business as usual. An extensive dissemination plan will enable the project team to share results to a wider community that is responsible for educating all students and, especially, students with LDM.

 

Science Teachers Learning from Lesson Analysis (STeLLA): High School Biology

This project will develop and test a biology teacher professional model that employs analysis of videotaped lessons to promote increased biology content knowledge and pedagogical content knowledge among practicing biology teachers. The content of the professional development activities will focus on the crosscutting concepts of stability and change that link core ideas in three areas of biology: cell biology, heredity, and evolution.

Lead Organization(s): 
Award Number: 
1503280
Funding Period: 
Sat, 08/01/2015 to Wed, 07/31/2019
Full Description: 

The Discovery Research K-12 program (DRK-12) seeks to significantly enhance the learning and teaching of science, technology, engineering and mathematics (STEM) by preK-12 students and teachers, through research and development of innovative resources, models and tools (RMTs). Projects in the DRK-12 program build on fundamental research in STEM education and prior research and development efforts that provide theoretical and empirical justification for proposed projects. This project will develop and test a biology teacher professional model that employs analysis of videotaped lessons to promote increased biology content knowledge and pedagogical content knowledge among practicing biology teachers. The content of the professional development activities will focus on the crosscutting concepts of stability and change that link core ideas in three areas of biology: cell biology, heredity, and evolution. These are content areas that have been shown to be difficult for students to learn, and difficult for teachers to teach. The professional development model will include: a) a summer institute where teachers gain new knowledge and skills in biology and learn to analyze videotaped lessons; b) opportunities to teach project-developed lessons during the academic year; and c) study group sessions during the academic year where participating teachers analyze videoclips of their own teaching.

The project will design, develop, and test a teacher professional development model that is based on a previously developed approach that has been shown to be effective among elementary school teachers. It is hypothesized that the newly developed program will have a positive impact on the science achievement of high school students, that it will improve teacher science content knowledge and classroom practice, and that the effects on student outcomes will be equitable across student demographic variables. To test thee hypotheses, the project will employ a quasi-experimental research approach in which teachers will serve as their own comparison groups in a cohort control design. Hierarchical linear modeling will be used to differentiate the effects of variances in teacher content knowledge and pedagogical content knowledge, student demographic variables, and school factors. It is anticipated that the project will find evidence that the proposed approach to biology teacher professional development has the potential to close the achievement gaps among student populations.

Playing with the Data: Developing Digital Supports for Middle School Science Teachers using Game-based Formative Assessment

This project will use cycles of design-based research to build new knowledge about how to facilitate teachers' interpretation and use of digital game-based formative assessment data. The research will also inform the revision and expansion of Playfully, an existing, online data-reporting dashboard that can be used with multiple digital games.

Award Number: 
1503255
Funding Period: 
Wed, 07/01/2015 to Sat, 06/30/2018
Full Description: 

The Discovery Research K-12 program (DRK-12) seeks to significantly enhance the learning and teaching of science, technology, engineering and mathematics (STEM) by preK-12 students and teachers, through research and development of innovative resources, models and tools (RMTs). Projects in the DRK-12 program build on fundamental research in STEM education and prior research and development efforts that provide theoretical and empirical justification for proposed projects.

This project will use cycles of design-based research to build new knowledge about how to facilitate teachers' interpretation and use of digital game-based formative assessment data. The research will also inform the revision and expansion of Playfully, an existing, online data-reporting dashboard that can be used with multiple digital games. The project is a collaboration between researchers at Education Development Center Inc.'s Center for Children and Technology (EDC|CCT) and the assessment and game development teams at GlassLab. The research and development teams will engage in a three-year partnership with 60 middle-grade science teachers working in diverse school settings in different parts of the country. The aim of the project is to refine an online formative assessment platform that utilizes data from a video game designed to teach argumentation at the middle school level. It provides rigorous research on the design features of data tools and associated materials available to teachers to inform their ongoing instruction (i.e., formative assessment tools) when using game-based platforms.

Dissemination of the results of this project will include practical, evidence-based suggestions for supporting middle school science teachers' use of digital games for assessment, and for the design and implementation of data dashboards. Key audiences include educational game designers, game-based assessment developers, formative assessment experts, and leaders in middle grade science teaching and learning.

Student-Adaptive Pedagogy for Elementary Teachers: Promoting Multiplicative and Fractional Reasoning to Improve Students' Preparedness for Middle School Mathematics

The project develops a teacher professional development intervention to support student-adaptive pedagogy for multiplicative and fractional reasoning. The idea is that classroom instruction should build on students' current conceptions and experiences. It focuses on students from urban, underserved and low-socioeconomic status populations who often fall behind in the elementary grades and are left underprepared for middle grades mathematics.

Lead Organization(s): 
Award Number: 
1503206
Funding Period: 
Wed, 07/15/2015 to Sun, 06/30/2019
Full Description: 

The project develops a teacher professional development intervention to support student-adaptive pedagogy for multiplicative and fractional reasoning. The idea is that classroom instruction should build on students' current conceptions and experiences. The context for the study is grades 3-5 teachers in Aurora Public Schools. It focuses on students from urban, underserved and low-socioeconomic status populations who often fall behind in the elementary grades and are left underprepared for middle grades mathematics. It includes a summer workshop and academic year follow-up including teacher collaboration. The project provides tools for capitalizing on successful, school-based research for promoting teachers' buy-in, adoption, and sustaining of student-adaptive pedagogy. The project also includes measurement of student understanding of the concepts. An extensive plan to share tools and resources for teachers and instructional coaches (scalable to district/state levels) and of research instruments and findings, will promote sharing project outcomes with a wide community of stakeholders (teachers, administrators, researchers, parents, policy makers) responsible for students' growth. This is a Full Design & Development project within the DRK-12 Program's Learning Strand. The Discovery Research K-12 program (DRK-12) seeks to significantly enhance the learning and teaching of science, technology, engineering and mathematics (STEM) by preK-12 students and teachers, through research and development of innovative resources, models and tools (RMTs). Projects in the DRK-12 program build on fundamental research in STEM education and prior research and development efforts that provide theoretical and empirical justification for proposed projects.

The project aims to implement and study a professional development intervention designed to shift upper-elementary teachers' mathematics teaching toward a constructivist approach, called student-adaptive pedagogy (AdPed), which adapts teaching goals and activities based on students' conceptions and experiences. The project focuses on multiplicative and fractional reasoning--critical for students' success in key areas of middle school mathematics (e.g., ratio, proportion, and function). The project seeks to design an instrument for measuring teachers' implementation of AdPed, a clinical interview rubric for students' multiplicative reasoning and then an analysis of teachers' content knowledge and the implementation of AdPed following the professional development. The research design is rooted in an innovative, cohesive framework that integrates four research-based components: (i) a model of mathematics learning and knowing, (ii) models of progressions in students' multiplicative and fractional reasoning, (iii) a model of teaching (AdPed) to promote such learning, and (iv) a mathematics teacher development continuum. Capitalizing on successful preliminary efforts in the Denver Metro area to refine a PD intervention and student-adaptive tools that challenge and transform current practices, the project will first validate and test instruments to measure (a) teacher growth toward adaptive pedagogy and (b) students' growth in multiplicative reasoning. Using these new instruments, along with available measures, the project will then promote school-wide teacher professional development (grades 3-5) in multiple schools in an urban district with large underserved student populations and study the professional development benefits for teacher practices and student outcomes. The mixed methods study includes classroom-based data (e.g., video analysis, lesson observations, teacher interviews) and measures of students' multiplicative reasoning specifically and mathematical understanding generally.

Pages

Subscribe to Quasi-experimental