Broadening Participation

Human Variance and Assessment for Learning Implications for Diverse Learners of STEM: A National Conference

The conference will attract thought leaders, policy makers, supervisors of practice and scholars of measurement science to be informed of emerging thought and developments and to discuss selected models for the implementation of new ways of generating and utilizing data from education tests.

Lead Organization(s): 
Award Number: 
1939192
Funding Period: 
Sun, 09/01/2019 to Mon, 08/31/2020
Full Description: 

The conference purpose is to stimulate a national conversation concerning the relationships between assessment, teaching and learning that include scholarly research and development of tests; members of city and state boards of education; officials from states and major school systems; policymakers; and representatives of teachers' associations and parents' associations. This conference aims to attract these important professionals has important co-sponsors like the Urban Institute. This national conference flows from the work of the Gordon Commission on the Future of Assessment for Education that addressed the advancement of achievement in STEM disciplines (PreK-12) for students who are underrepresented among high achieving students. This issue of advancement of underrepresented high achieving students has received little concentrated effort and a conference would help in providing greater understanding of this special concern, which includes a student in poverty in complexed family structures.

The conference will attract thought leaders, policy makers, supervisors of practice and scholars of measurement science to be informed of emerging thought and developments and to discuss selected models for the implementation of new ways of generating and utilizing data from education tests. The conference will stimulate national conversation and ultimately a market that demands educational assessments that inform and improve teaching and learning transactions. The conference will be organized around four conceptual and theoretical papers that focus on the knowledge base upon which six concurrent workshops will be based. The four papers are: (1) Human Diversity and Assessment; (2) The Limits of Test Bias and Its Corrections; (3) Towards an Assessment Science Capable of Informing and Improving Learning; and  (4) Assessment in the Service of Learning. The workshops will focus on models of pedagogical practice that show promise for informing and improving teaching and learning processes and their outcomes. These issues will be discussed by 11-15 expert presenters who understand student learning and the types of information gleaned from different types of assessments. The attention to URMs and their needs and contexts are prioritized in discussions surrounding measurement science and the integration of assessment. Several important issues that address understanding of student learning, and the relationship between the varieties of information concerning students that can be accessed through assessments are: (1) The importance of the broader and more productive use of educational testing to improve the learning of STEM subject matter and values; (2) Curriculum embedded assessment and the reduction in disparities in achievement by STEM learners from diverse social divisions; (3) Innovative procedures and programs for the use of data concerning learners and teaching and learning transactions in the teaching and learning of STEM with learners who are underrepresented among high achieving STEM learners.

Advancing Coherent and Equitable Systems of Science Education

This project will examine how partnerships among state science leaders, education researchers and education practitioners cultivate vertical coherence and equity in state science education.

Lead Organization(s): 
Award Number: 
1920249
Funding Period: 
Thu, 08/01/2019 to Mon, 07/31/2023
Full Description: 

This project will examine how partnerships among state science leaders, education researchers and education practitioners cultivate vertical coherence and equity in state science education. This is an important study because in most states, the student population is becoming more diverse, and states need help in finding ways to better serve schools and districts within their jurisdictions. Through this effort, state science leaders will participate in a networked improvement community model organized to develop and test state-level strategies. Specifically, the focus will be on the adaptation of instructional materials and formative assessment as linked policy strategies for aligning curriculum, instruction, and assessment and for relating instruction to the interests and histories of local communities. State science leaders and researchers will investigate how and under what conditions certain strategies support the emergence of coherent and equitable state systems of science education in which all students have opportunities to meet challenging new science standards. The project will build knowledge and theory about the conditions under which a network of state teams can promote coherent guidance for culturally-based instruction in local districts and schools. Together the partners will collaborate to diagnose current challenges to promoting coherence and equity and then develop knowledge and resources about conditions that promote coherence and equity by testing and studying strategies for cultivating it.

An iterative design-based research approach will be used to build foundational knowledge for the equitable implementation of the vision of science and engineering learning that integrates disciplinary core ideas, science and engineering practices, and crosscutting concepts working from a cultural perspective on learning. A multiple-case study will be used to collect data about the impact of the networked improvement community model on leadership development to effectively improve state efforts. Surveys and interviews will be used to gather information on co-designing efforts, use and adaptation of resources, and knowledge gained by state science leaders. Data will also be collected on political conditions and infrastructures of teamwork as potential facilitators and barriers to the development of strategic knowledge leadership. Analyses of data will identify patterns or configurations of conditions associated with growth in science leaders' strategic knowledge leadership related to equity. This technique will generate evidence-based claims for how and when supports and barriers matter for growth in strategic knowledge leadership for equity.

Ed+gineering: An Interdisciplinary Partnership Integrating Engineering into Elementary Teacher Preparation Programs

In this project, over 500 elementary education majors will team with engineering majors to teach engineering design to over 1,600 students from underrepresented groups. These standards-based lessons will emphasize student questioning, constructive student-to-student interactions, and engineering design processes, and they will be tailored to build from students' interests and strengths.

Lead Organization(s): 
Award Number: 
1908743
Funding Period: 
Sun, 09/01/2019 to Thu, 08/31/2023
Full Description: 

Engineering education, with its emphasis on developing creative solutions to relevant problems, is a promising approach to increasing elementary students' interest in scientific fields. Despite its potential, engineering education is often absent from elementary classes because many teachers feel underprepared to integrate it into their instruction. This project addresses this issue through an innovative approach to undergraduate elementary education programs. In this approach, called Ed+gineering, undergraduate elementary education majors team with undergraduate engineering majors to develop and teach engineering lessons to elementary students in out-of-school settings. In this project, over 500 elementary education majors will team with engineering majors to teach engineering design to over 1,600 students from underrepresented groups. These standards-based lessons will emphasize student questioning, constructive student-to-student interactions, and engineering design processes, and they will be tailored to build from students' interests and strengths. The research team will study whether Ed+gineering is correlated with positive outcomes for the elementary education majors. They will also study whether and how the elementary education majors subsequently provide engineering instruction during their first year of licensed teaching. This project will advance knowledge by resulting in a model for teacher education that has the potential to improve future elementary teachers' confidence and ability to teach engineering. In turn, more elementary students may have opportunities to experience engineering as they discover how innovative applications of science can be used to solve problems in the world around them.

Researchers at Old Dominion University will study whether a teacher preparation model is associated with positive outcomes for pre-service teachers while they are undergraduates and in their first year as professional teachers. Undergraduate elementary education majors and undergraduate engineering majors will work in interdisciplinary teams, comprised of four to six people, in up to three mandatory collegiate courses in their respective disciplinary programs. Each semester, these interdisciplinary teams will develop and teach a culturally responsive, engineering-based lesson with accompanying student materials during a field trip or after-school program attended by underrepresented students in fourth, fifth, or sixth grade. Using a quasi-experimental design with treatment and matched comparison groups, researchers will identify whether the teacher preparation model is associated with increased knowledge of engineering, beliefs about engineering integration, self-efficacy for engineering integration, and intention to integrate engineering, as determined by existing validated instruments as well as by new instruments that will be adapted and validated by the research team. Additionally, the researchers will follow program participants using surveys, interviews, and classroom observations to determine whether and how they provide engineering instruction during their first year as licensed teachers. Constant comparative analyses of these data will indicate barriers and enablers to engineering instruction among beginning teachers who participated in the Ed+gineering program. This project will result in an empirically-based model of teacher preparation, a predictive statistical model of engineering integration, field-tested engineering lesson plans, and validated instruments that will be disseminated widely to stakeholders.

Strengthening STEM Teaching in Native American Serving Schools through Long-Term, Culturally Responsive Professional Development

This project will explore how a nationally implemented professional development model is applied in two distinct Indigenous communities, the impact the model has on teacher practice in Native-serving classrooms, and the model's capacity to promote the integration of culturally responsive approaches to STEM teaching.

Project Email: 
Lead Organization(s): 
Award Number: 
1908464
Funding Period: 
Sun, 09/01/2019 to Thu, 08/31/2023
Full Description: 

Although there is a long-established body of knowledge about effective professional development for STEM teachers, very little of it has been applied and studied with teachers in Native American-serving school districts. This project will explore how a nationally implemented professional development model is applied in two distinct Indigenous communities, the impact the model has on teacher practice in Native-serving classrooms, and the model's capacity to promote the integration of culturally responsive approaches to STEM teaching. This project will substantially grow the data and knowledge available within this unique context, which is critical given the persistent gaps in educational achievement and STEM career participation among Indigenous people in the U.S. K-12 teachers will participate in an 8-month cohort designed to increase their STEM content knowledge and facilitate their efforts to develop academically rigorous, culturally responsive STEM instructional units for use in their classrooms. The project will add to our knowledge about the transferability of a nationally-implemented professional development model within two specific Indigenous contexts, and it will grow our knowledge about how STEM professional development impacts teacher practice. Finally, the project will provide concrete examples and knowledge about the ways culturally responsive approaches to STEM professional development, curriculum development, and teacher practice are taken up in two distinct Native-student-serving contexts.

This project includes the development and implementation of professional development that is long-term, teacher-driven, collaborative across grade levels and content areas, and facilitated by university faculty with STEM expertise. The research will follow a collective case study methodology in order to establish a robust and nuanced understanding of (1) how a national professional development model operates within two specific and distinct Indigenous contexts; (2) how a professional development model impacts teachers' STEM instructional practice in Native-serving schools; and (3) how teachers in Native-serving schools engage culturally responsive approaches to STEM curriculum development and STEM instructional practice. Data will include interviews and focus groups with participating teachers, university faculty, and other stakeholders, classroom observations and "Scoop Notebook" artifacts of teacher practice, and the teacher-developed STEM instructional units. Data will be iteratively coded with a combination of open and focused coding using a constant comparative method with a specific emphasis on identifying the culturally responsive elements present across the data sources. Individual and cross-case comparisons will be conducted to reveal broader themes that address the research questions. Results and products will be disseminated to researchers, practitioners, and community members through peer-reviewed publications, conference presentations, annual partnership meetings, and posting of the teacher developed instructional units to a web-based, freely accessible clearing house.

Validation of the Equity and Access Rubrics for Mathematics Instruction (VEAR-MI)

The main goal of this project is to validate a set of rubrics that attend to the existence and the quality of instructional practices that support equity and access in mathematics classes. The project team will clarify the relationships between the practices outlined in the rubrics and aspects of teachers' perspectives and knowledge as well as student learning outcomes.

Award Number: 
1908481
Funding Period: 
Mon, 07/15/2019 to Fri, 06/30/2023
Full Description: 

High-quality mathematics instruction remains uncommon and opportunities for students to develop the mathematical understanding are not distributed equally. This is particularly true for students of color and students for whom English is not their first language. While educational research has made progress in identifying practices that are considered high-quality, little attention has been given to specific instructional practices that support historically marginalized groups of students particularly as they participate in more rigorous mathematics. The main goal is to validate a set of rubrics that attend to the existence and the quality of instructional practices that support equity and access in mathematics classes. In addition, the project team will clarify the relationships between the practices outlined in the rubrics and aspects of teachers' perspectives and knowledge as well as student learning outcomes.

This project will make use of two existing large-scale datasets focusing on mathematics teachers to develop rubrics on mathematics instructional quality. The datasets include nearly 3,000 video-recorded mathematics lessons and student achievement records from students in Grades 3 through 8. The four phases of this research and development project include training material development, an observation and rubric generalizability study, a coder reliability study, and structural analysis. Data analysis plans involve case studies, exploratory and confirmatory factor analyses, and cognitive interviews. 

Science Learning through Embodied Performances in Elementary and Middle School

This project's approach uses two types of embodied performances: experiential performances that engage learners in using their bodies to physically experience scientific phenomena (e.g., the increase of heart rate during exercise), and dramatic performances where learners act out science ideas (e.g., the sources and impact of air pollution) with gestures, body movement, dances, role-plays, or theater productions.

Project Email: 
Award Number: 
1908272
Funding Period: 
Thu, 08/01/2019 to Sun, 07/31/2022
Project Evaluator: 
Full Description: 

There is a need to develop ways of making scientific ideas and practices more accessible to students, in particular students in elementary grades and from populations underrepresented in STEM disciplines. Learning science involves the construction of scientific knowledge and science identities, both of which can be supported by science instruction that integrates scientific practices with theater and literacy practices. This project's approach uses two types of embodied performances: experiential performances that engage learners in using their bodies to physically experience scientific phenomena (e.g., the increase of heart rate during exercise), and dramatic performances where learners act out science ideas (e.g., the sources and impact of air pollution) with gestures, body movement, dances, role-plays, or theater productions. Body movements, positions, and actions along with language and other modes of representation are employed as critical constituents of meaning making, which offer learners opportunities to understand science core ideas, crosscutting concepts, and scientific practices by dramatizing them for and with others. This project is adding to the limited science education literature on the use, value, and impact of embodied performances in science classrooms, and on the brilliance, ingenuity, and science knowledge that all youth, and particularly historically marginalized young people, have and can further develop in urban school classrooms.

This project's research focuses on understanding how embodied performances of science concepts and processes can shape classroom science learning, and how their impact is similar and/or different across science topics, elementary and middle school grade levels, and as the school year progresses. It explores the kinds of science ideas students learn, the multimodal literacy practices in which they engage, and the science identities they construct. The research attends to learning for all young people with a specific focus on children from historically marginalized groups in STEM. Using design-based research, the project team (students and teachers in Chicago Public Schools, teaching artists, and researchers) designs embodied performances that are implemented, studied, and revised throughout the project's duration. Ten teachers participate in professional development to learn relevant theater practices (including adaptation, workshopping, and inter- and intra-personal embodiment practices), to strengthen their science understandings, and to learn ways of intertwining both in their teaching. They are subsequently supported by teaching artists through the implementation of various activities in their classrooms, eventually implementing them without any scaffolding. Data sources include fieldnotes during classwork related to embodied performances; written materials, images, sound files, and other digital productions created to enhance, share, expand, and/or support performances; ongoing written student reflections on learning science and the role of embodied performances; regular assessments found in the science curriculum; reflective conversations with student teams about their embodied performances; one-on-one semi-structured interviews with 6 focal students per classroom about science identity development twice in a school year; video of classwork related to embodied performances; and video of science ideas performed by students to school and community audiences. Analyses include structured and focused coding of qualitative data, multimodal discourse analysis, and content analysis. The findings of this research are providing empirical evidence of the value and impact of integrating performing-arts practices into science teaching and learning and the potential of this approach to transform urban science classrooms into spaces where young people from marginalized groups find access to science to engage with it creatively and deeply.

Alternative video text
Alternative video text: 

Learning Trajectories as a Complete Early Mathematics Intervention: Achieving Efficacies of Economies at Scale

The purpose of this project is to test the efficacy of the Learning and Teaching with Learning Trajectories (LT2) program with the goal of improving mathematics teaching and thereby increasing young students' math learning. LT2 is a professional development tool and a curriculum resource intended for teachers to be used to support early math instruction and includes the mathematical learning goal, the developmental progression, and relevant instructional activities.

Lead Organization(s): 
Award Number: 
1908889
Funding Period: 
Mon, 07/01/2019 to Sun, 06/30/2024
Full Description: 

U.S. proficiency in mathematics continues to be low and early math performance is a powerful predictor of long-term academic success and employability. However, relatively few early childhood degree programs have any curriculum requirements focused on key mathematics topics. Thus, teacher professional development programs offer a viable and promising method for supporting and improving teachers' instructional approaches to mathematics and thus, improving student math outcomes. The purpose of this project is to test the efficacy of the Learning and Teaching with Learning Trajectories (LT2) program with the goal of improving mathematics teaching and thereby increasing young students' math learning. LT2 is a professional development tool and a curriculum resource intended for teachers to be used to support early math instruction. The LT2 program modules uniquely include the mathematical learning goal, the developmental progression, and relevant instructional activities. All three aspects are critical for high-quality and coherent mathematics instruction in the early grades.

This project will address the following research questions: 1) What are the medium-range effects of LT2 on student achievement and the achievement gap? 2) What are the short- and long-term effects of LT2 on teacher instructional approach, beliefs, and quality? and 3) How cost effective is the LT2 intervention relative to the original Building Blocks intervention? To address the research questions, this project will conduct a multisite cluster randomized experimental design, with 90 schools randomly assigned within school districts to either experimental or control groups. Outcome measures for the approximately 250 kindergarten classrooms across these districts will include the Research-based Elementary Math Assessment, observations of instructional quality, a questionnaire focused on teacher beliefs and practices, in addition to school level administrative data. Data will be analyzed using multi-level regression models to determine the effect of the Learning Trajectories intervention on student learning.

Case Studies of a Suite of Next Generation Science Instructional, Assessment, and Professional Development Materials in Diverse Middle School Settings

This project addresses a gap between vision and implementation of state science standards by designing a coordinated suite of instructional, assessment and teacher professional learning materials that attempt to enact the vision behind the Next Generation Science Standards. The study focuses on using state-of-the-art technology to create an 8-week long, immersive, life science field experience organized around three investigations.

Lead Organization(s): 
Award Number: 
1907944
Funding Period: 
Mon, 07/01/2019 to Fri, 06/30/2023
Full Description: 

New state science standards are ambitious and require important changes to instructional practices, accompanied by a coordinated system of curriculum, assessment, and professional development materials. This project addresses a gap between vision and implementation of such standards by designing a coordinated suite of instructional, assessment and teacher professional learning materials that attempt to enact the vision behind the Next Generation Science Standards. The study focuses on the design of such materials using state-of-the-art technology to create an 8-week long, immersive, life science field experience organized around three investigations. Classes of urban students in two states will collect data on local insect species with the goal of understanding, sharing, and critiquing environmental management solutions. An integrated learning technology system, the Learning Navigator, draws on big data to organize student-gathered data, dialogue, lessons, an assessment information. The Learning Navigator will also amplify the teacher's role in guiding and fostering next generation science learning. This project advances the field through an in-depth exploration of the goals for the standards documents. The study begins to address questions about what works when, where, and for whom in the context of the Next Generation Science Standards.

The project uses a series of case studies to create, test, evaluate and refine the system of instructional, assessment and professional development materials as they are enacted in two distinct urban school settings. It is designed with 330 students and 22 teachers in culturally, racially and linguistically diverse, under-resourced schools in Pennsylvania and California. These schools are located in neighborhoods that are economically challenged and have students who demonstrate patterns of underperformance on state standardized tests. It will document the process of team co-construction of Next Generation Science-fostering instructional materials; develop assessment tasks for an instructional unit that are valid and reliable; and, track the patterns of use of the instructional and assessment materials by teachers. The study will also record if new misconceptions are revealed as students develop Next Generation Science knowledge,  comparing findings across two diverse school locations in two states. Data collection will include: (a) multiple types of data to establish validity and reliability of educational assessments, (b) the design, evaluation and use of a classroom observation protocol to gather information on both frequency and categorical degree of classroom practices that support the vision, and (c) consecutive years of ten individual classroom enactments through case studies analyzed through cross-case analyses. This should lead to stronger and better developed understandings about what constitutes strong Next Generation Science learning and the classroom conditions, instructional materials, assessments and teacher development that foster it.

Aligning the Science Teacher Education Pathway: A Networked Improvement Community

This project will study the activities of a Networked Improvement Community (NIC) as a vehicle to bridge gaps across four identified steps along the science teacher training and development pathways within local contexts of 8 participating universities. The overarching goal of the project is to strengthen the capacity of universities and school districts to reliably produce teachers of science who are knowledgeable about and can effectively enact the Next Generation Science Standards (NGSS), although prepared in varied organizational contexts.

Award Number: 
1908900
Funding Period: 
Mon, 07/01/2019 to Fri, 06/30/2023
Full Description: 

California State University will study the activities of a Networked Improvement Community (NIC) as a vehicle to bridge gaps across four identified steps along the science teacher training and development pathways within local contexts of 8 participating universities (NIC sites). Networked Improvement Community (NIC) will co-create a shared vision and co-defined research agenda between university researchers, science educators and school district practitioners working together to reform teacher education across a variety of local contexts. By studying outcomes of shared supports and teacher tools for use in multiple steps along the science teacher education pathway, researchers will map variation existing in the system and align efforts across the science teacher education pathway. This process will integrate an iterative nature of educational change in local contexts impacting enactment of the NGSS in both university teacher preparation programs and in school district professional training activities and classrooms.

The overarching goal of the project is to strengthen the capacity of universities and school districts to reliably produce teachers of science who are knowledgeable about and can effectively enact the Next Generation Science Standards (NGSS), although prepared in varied organizational contexts. The project will accomplish this goal 1) leveraging the use of an established Networked Improvement Community, composed of science education faculty from eight university campuses and by 2) improving and studying coherence in the steps along the science teacher education pathway within and across these universities and school districts. The project will use a mixed methods approach to data collection and analysis. Consistent with Improvement Science Theory, research questions will be co-defined by all stakeholders.

Building a Teacher Knowledge Base for the Implementation of High-Quality Instructional Resources through the Collaborative Investigation of Video Cases (Collaborative Research: DiNapoli)

This project will address the pressing national need to generate shared, practice-based knowledge about how to implement freely available, high-quality instructional resources (mathematics formative assessment lessons) that have been shown to produce significant gains in student learning outcomes. It will expand a professional development model (Analyzing Instruction in Mathematics using the Teaching for Robust Understanding Framework (AIM-TRU)) that supports teacher learning about effective lesson implementation.

Lead Organization(s): 
Award Number: 
1908319
Funding Period: 
Mon, 07/01/2019 to Fri, 06/30/2023
Full Description: 

This project will address the pressing national need to generate shared, practice-based knowledge about how to implement freely available, high-quality instructional resources (mathematics formative assessment lessons) that have been shown to produce significant gains in student learning outcomes. It will expand a professional development model (Analyzing Instruction in Mathematics using the Teaching for Robust Understanding Framework (AIM-TRU)) that supports teacher learning about effective lesson implementation. The backbone of AIM-TRU is a growing, open repository of video cases available to teachers and teacher educators across the U.S. who use or are interested in using the lessons. The repository will include tools such as a facilitator's guide to support teachers and teacher educators to engage in the model and collaboratively investigate the video cases. Consequently, the work will have the potential to engage teachers and teacher educators in improving mathematics education at scale. Because the video cases will capture implementation and ideas for improving instruction in schools serving populations who are underrepresented in mathematics, AIM-TRU will serve to improve mathematics education equitably.

Research questions focus on what teachers learn about high-quality mathematics instruction and instructional materials within a community of practice, and how that learning influences their teaching. In AIM-TRU, teachers engage in the collaborative investigation of video cases utilizing a shared repertoire that includes questioning protocols adapted from the Teaching for Robust Understanding (TRU) framework. This framework articulates five dimensions of classroom instruction that are necessary and sufficient to support students in becoming powerful mathematical thinkers. This affords teachers opportunities to use the TRU dimensions as lenses to diagnose common problems of practice that arise in implementation, and propose innovations and theories for improving instruction that can be tested in real classrooms and documented in new video cases. Analytic tools will be used from frame analysis to produce empirical evidence of what teachers are learning about instruction and instructional materials along the five dimensions of TRU. These data will be mapped to a random sample of video recordings of participating teachers' instruction, scored using the TRU Math Rubric, in order to link learning outcomes from the professional development to changes in instruction. Addressing these research questions will provide a deeper understanding and empirical evidence of learning within teacher collectives, the pressing national need to develop mechanisms to produce collective professional knowledge for teaching, and further efforts to understand the types of knowledge required for effective teaching.

Pages

Subscribe to Broadening Participation