Equity

Building a Next Generation Diagnostic Assessment and Reporting System within a Learning Trajectory-Based Mathematics Learning Map for Grades 6-8

This project will build on prior funding to design a next generation diagnostic assessment using learning progressions and other learning sciences research to support middle grades mathematics teaching and learning. The project will contribute to the nationally supported move to create, use, and apply research based open educational resources at scale.

Award Number: 
1621254
Funding Period: 
Thu, 09/15/2016 to Sat, 08/31/2019
Full Description: 

This project seeks to design a next generation diagnostic assessment using learning progressions and other research (in the learning sciences) to support middle grades mathematics teaching and learning. It will focus on nine large content ideas, and associated Common Core State Standards for Mathematics. The PIs will track students over time, and work within school districts to ensure feasibility and use of the assessment system.

The research will build on prior funding by multiple funding agencies and address four major goals. The partnership seeks to address these goals: 1) revising and strengthening the diagnostic assessments in mathematics by adding new item types and dynamic tools for data gathering 2) studying alternative ways to use measurement models to assess student mathematical progress over time using the concept of learning trajectories, 3) investigating how to assist students and teachers to effectively interpret reports on math progress, both at the individual and the class level, and 4) engineering and studying instructional strategies based on student results and interpretations, as they are implemented within competency-based and personalized learning classrooms. The learning map, assessment system, and analytics are open source and can be used by other research and implementation teams. The project will exhibit broad impact due to the number of states, school districts and varied kinds of schools seeking this kind of resource as a means to improve instruction. Finally, the research project contributes to the nationally supported move to create, use, and apply research based open educational resources at scale.

Improving the Implementation of Rigorous Instructional Materials in Middle-Grades Mathematics: Developing a System of Practical Measures and Routines (Collaborative Research: Smith)

The goal of this project is to improve the implementation of rigorous instructional materials in middle-grades mathematics at scale through a system of practical measures and routines for collecting and using data that both assesses and supports implementation.

Award Number: 
1621238
Funding Period: 
Sat, 10/01/2016 to Thu, 09/30/2021
Full Description: 

The goal of this 5-year research project is to improve the implementation of rigorous instructional materials in middle-grades mathematics at scale. Many projects seek to improve mathematics instruction, but are not able to easily track their efforts at improvement. The primary product of this project will be a system of practical measures and routines for collecting and using data that both assesses and supports the implementation of rigorous instructional materials in middle-grades mathematics. In contrast to research and accountability measures, practical measures are assessments that require little time to administer and can thus be used frequently. The data can be analyzed rapidly so that teachers can receive prompt feedback on their progress, and instructional leaders can use the data to decide where to target resources to support improvement in the quality of instruction and student learning. The system of practical measures and routines will include 1) measures of high-leverage aspects of teachers' instructional practices that have been linked to student learning (e.g., rigor of tasks, quality of students' discourse) and attend to equitable student participation; and 2) measures of high-leverage aspects of key supports for improving the quality of teachers' practice (e.g., quality of professional development; coaching); and 3) a set of routines regarding how to use the resulting data to engage in rapid, improvement efforts. A key principle of the proposed project is that the system of measures and routines can be adapted to a wide range of school and district contexts. This project is supported by the Discovery Research preK-12 (DRK-12) program. The DRK-12 program supports research and development of STEM education innovations and approaches in assessment, learning, and teaching.

The project will establish three research-practice partnerships with five districts, in three different states, that are currently implementing rigorous instructional materials in middle-grades mathematics. Year 1 will focus on the development of a set of practical measures of classroom instruction. Year 2 will focus on testing the use of the classroom measures in the context of supports for teachers' learning, and the development of practical measures of key supports for teachers' learning. Years 3-4 will focus on how the project can "learn our way to scale" (Bryk et al., 2015), which requires strategically implementing measures and routines in increasingly diverse conditions. The project will engage in rapid improvement cycles in which researchers will work alongside district leaders and professional development (PD) facilitators to analyze the data from the measures of both classroom instruction and the quality of support for teacher learning to test the effectiveness of improvements in intended supports for teacher learning and to adjust the design of the support based on data. Across Years 1-4, the project will use recent developments in technology and information visualization to test and improve 1) the collection of practical measures in situ and 2) the design of data representations (or visualizations) that support teachers and leaders to make instructional improvement decisions. In Year 5, the project will conduct formal analyses of the relations between supports for teachers' learning; teachers' knowledge and classroom practices; and student learning.

Doing the Math with Paraeducators: A Research and Development Project

This project will design and pilot professional development that focuses on developing the confidence, mathematical knowledge, and teaching strategies of paraeducators using classroom activities that they are expected to implement. The planned professional development will enable them to make a greater difference in the classroom, but it will also increase their access to continuing education and workplace opportunities.

Lead Organization(s): 
Award Number: 
1621151
Funding Period: 
Thu, 09/15/2016 to Sat, 08/31/2019
Full Description: 

Over one million paraeducators (teaching assistants and volunteers) currently assist in classrooms, and another 100,000 are likely to be added in the next ten years. Paraeducators (paras) are often required to teach content, such as mathematics, but there are few efforts to provide them with the knowledge or supervision they need to be effective when working with a range of students, including those with disabilities and for whom English is a second language. The project will focus on developing the confidence, mathematical knowledge, and teaching strategies of paras using classroom activities that they are expected to implement. The planned professional development will enable them to make a greater difference in the classroom, but it will also increase their access to continuing education and workplace opportunities. The work will be conducted in the Boston Public Schools (BPS) and will focus on grades K-3, where the largest numbers of paras are employed. Given the importance of early math learning in predicting mathematical achievement, supporting paras who work in the early grades is particularly important.

The project will design and pilot professional development that supports paraeducator knowledge development and addresses instructional challenges in teaching mathematics. The project will address the following goals: research the current roles of paras in mathematics instruction, the preparation of their collaborating teachers, and the opportunities for collaboration and planning between supervising teachers and paras in BPS; pilot, develop, implement, and research a model for professional development program for paras that targets specific activities they can implement that are key to student learning in number and operation in K-3; document how paras assume new roles that increase student engagement and empower them as mathematical learners; pilot, develop, implement, and research a supervisory component to help teachers set expectations, and structures for debriefing and reflecting along with their paras; and identify next steps for an early stage development study based on our findings. A needs assessment survey will investigate the context in which paras work. The iterative process of design-based research will develop, test, and implement the targeted professional development with paras, measuring how prepared they feel to implement new ideas and how they translate their learning into new pedagogical practices. Crosscase analyses, descriptive statistics, tallies and coded behaviors from observations, and themes from paras, and teacher and administrator interviews will be collected, coded, and analyzed. Furthermore, an efficacy survey will be administered periodically to document longitudinal changes in paras, which will be integrated in the crosscase analyses.

Organizing to Learn Practice: Teacher Learning in Classroom-Focused Professional Development

This project addresses the fundamental challenge of how to support teachers to improve their practice. The approach uses a "live mathematics classroom" as a common text for working on practice, where participants are not only watching and discussing but are engaged in developing and learning practice. The project will generate new knowledge regarding ways in which elementary teachers of mathematics can be supported to learn effective teaching practice.

Project Email: 
Lead Organization(s): 
Award Number: 
1621104
Funding Period: 
Thu, 09/01/2016 to Mon, 08/31/2020
Full Description: 

Growing evidence about the powerful effects of skillful teaching on students' learning creates a need to for professional development that impacts teachers' actual practice. Just as other professions (e.g., nursing, social work, law) have centered practitioners' learning in "live" practice with structures that support learning in context, the project will investigate whether and how this can be accomplished in teaching. The approach uses a "live mathematics classroom" as a common text for working on practice, where participants are not only watching and discussing but are engaged in developing and learning practice. The project also explores the following variations in practice-based professional development: (1) on-site and remote participation of teachers; and (2) the addition of supplementary practice-focused professional development. The project will generate new knowledge regarding ways in which elementary teachers of mathematics can be supported to learn effective teaching practice.

This project addresses a fundamental challenge for professional development, that is, how to support teachers to improve their practice. Teachers profit from well-designed opportunities to develop new visions for practice, learn more about students' thinking, or work on specific mathematical topics or tasks. Still, such opportunities are often insufficient to support teachers with the complexity of classroom teaching. These kinds of professional opportunities focus on critical resources for instruction but not on the details of teaching practice itself. This practice-centered professional development is situated within a summer mathematics program for fifth graders. The proposed research will explore the impact on teachers' practice, as well as on their knowledge and dispositions, from participating in these structured ways. Three studies will resolve the following three sets of questions: (1) What do teachers learn from structured participation in the class? Does their participation impact their own teaching practice, and if so, in what ways? (2) Does the setting of the peripheral participation matter? Does this form of participation impact their own teaching practice, and if so, in what ways? (3) Does the addition of professional development focused on a particular teaching practice impact teachers' own practice, and if so, in what ways? How does the addition of professional development focused on a specific instructional practice compare across the in-person and online forms of participation in terms of impact on teachers' own practice? The project will collect and analyze several types of data pre- and post-intervention, including measures of mathematical knowledge for teaching, measures of language for talking about the work of teaching and students, and skill with leading a mathematics discussion, and the mathematical quality of instruction. The project will generate new knowledge related to to organizing professional learning around supports that teachers need to learn practice as well as ways to study their learning of teaching practice.

Supporting Teacher Practice to Facilitate and Assess Oral Scientific Argumentation: Embedding a Real-Time Assessment of Speaking and Listening into an Argumentation-Rich Curriculum (Collaborative Research: Greenwald)

The fundamental purpose of this project is to support teacher practice and professional learning around oral scientific argumentation in order to improve the quality of this practice in classrooms. The key outcome of this work will be a research-informed and field-tested prototype to improve the quality of teaching and learning argumentation in middle school science classrooms usable in different learning environments.

Partner Organization(s): 
Award Number: 
1621441
Funding Period: 
Thu, 09/01/2016 to Mon, 08/31/2020
Full Description: 

This is an early-stage design and development collaborative study submitted to the assessment strand of the Discovery Research PreK-12 (DRK-12) program, in response to Program Solicitation NSF 15-592. The fundamental purpose of this project is to support teacher practice and professional learning around oral scientific argumentation in order to improve the quality of this practice in classrooms. To achieve this purpose, the project will examine the validity of a new technology-based formative assessment tool for classroom argumentation--"Diagnosing the Argumentation Levels of Groups" (DiALoG)--for which psychometric validation work has been conducted in a laboratory setting. The DiALoG assessment tool allows teachers to document classroom talk and display scores across multiple dimensions--both intrapersonal and interpersonal--for formative assessment purposes. The project will work with 6th-8th grade science teachers to monitor and support argumentation through real-time formative assessment data generated by the DiALoG instrument. DiALoG will be used in conjunction with "Amplify Science", a Lawrence Hall of Science-developed curriculum that incorporates the science practice of engaging in argument from evidence, and a suite of newly developed Responsive Mini-Lessons (RMLs), which consist of 20-30 minute instructional strategies designed to assist teachers to provide feedback to students' thinking and follow-up to argumentation episodes that the DiALoG tool identifies in need of further support. The study will allow the refinement and expansion of DiALoG and evaluation of its impact on teacher pedagogical content knowledge and formative assessment practices in widespread classroom use.

The project will address two specific research questions: (1) How can DiALoG be refined to provide a formative assessment tool for oral argumentation that is reliable, practical, and useful in middle school classrooms?; and (2) How does the use of DiALoG affect teacher formative assessment practices around evidence-based argumentation, when implementing science units designed to support oral argumentation? In order to answer these questions, the project will conduct a randomized control trial with 100 teachers: 50 will teach argumentation-focused curriculum with DiALoG, 50 will teach the same curriculum without DiALoG. Both control and treatment teachers will receive all digital and physical materials needed to teach three Amplify Science curriculum units. Treatment teachers will be provided also with the most recent version of DiALoG, including the linked RMLs, as well as support materials for using DiALoG with the Amplify curriculum. A subgroup of focus teachers (5 from the treatment group, and 5 from the control group) will be the subject of additional data collection and analysis. Three focus lessons, in which students are engaging in small-group or whole-class oral argumentation, will be selected from each of the three Amplify Science curricular units. Teacher measures for the randomized control trial will include validated instruments, such as (a) a pre- and post-assessment of teacher pedagogical content knowledge; (b) post-lesson and post-unit surveys in which teachers will self-report on their formative assessment practices; and (c) video recordings of selected lessons in the focus classrooms. In order to observe potential differences in formative assessment practices between treatment and control, protocols will be used to analyze the video recordings of focus classrooms, including (a) Reformed Teaching Observation Protocol; (b) Assessment of Scientific Argumentation inside the Classroom; and (c) Formative Assessment for Teachers and Students. The key outcome of this work will be a research-informed and field-tested prototype to improve the quality of teaching and learning argumentation in middle school science classrooms usable in different learning environments.

CAREER: Making Science Visible: Using Visualization Technology to Support Linguistically Diverse Middle School Students' Learning in Physical and Life Sciences

Award Number: 
1552114
Funding Period: 
Wed, 06/01/2016 to Mon, 05/31/2021
Full Description: 

The growing diversity in public schools requires science educators to address the specific needs of English language learners (ELLs), students who speak a language other than English at home. Although ELLs are the fastest-growing demographic group in classrooms, many are historically underserved in mainstream science classrooms, particularly those from underrepresented minority groups. The significant increase of ELLs at public schools poses a challenge to science teachers in linguistically diverse classrooms as they try to support and engage all students in learning science. The proposed project will respond to this urgent need by investigating the potential benefits of interactive, dynamic visualization technologies, including simulations, animations, and visual models, in supporting science learning for all middle school students, including ELLs. This project will also identify design principles for developing such technology, develop additional ways to support student learning, and provide new guidelines for effective science teachers' professional development that can assist them to better serve students from diverse language backgrounds. The project has the potential to transform traditional science instruction for all students, including underserved ELLs, and to broaden their participation in science.

In collaboration with eighth grade science teachers from two low-income middle schools in North Carolina, the project will focus on three objectives: (1) develop, test, and refine four open-source, web-based inquiry units featuring dynamic visualizations on energy and matter concepts in physical and life sciences, aligned with the Next Generation Science Standards (NGSS); (2) investigate how dynamic visualizations can engage eighth-grade ELLs and native-English-speaking students in science practices and improve their understanding of energy and matter concepts; and (3) investigate which scaffolding approaches can help maximize ELLs' learning with visualizations. Research questions include: (1) Which kinds of dynamic visualizations (simulations, animations, visual models) lead to the best learning outcomes for all students within the four instructional science units?; (2) Do ELLs benefit more from visualizations (or particular kinds of visualizations) than do native-English-speaking students?; and (3) What kinds of additional scaffolding activities (e.g., critiquing arguments vs. generating arguments) are needed by ELLs in order to achieve the greatest benefit? The project will use design-based research and mixed-methods approaches to accomplish its research objectives and address these questions. Furthermore, it will help science teachers develop effective strategies to support students' learning with visualizations. Products from this project, including four NGSS-aligned web-based inquiry units, the visualizations created for the project, professional development materials, and scaffolding approaches for teachers to use with ELLs, will be freely available through a project website and multiple professional development networks. The PI will collaborate with an advisory board of experts to develop the four instructional units, visualizations, and scaffolds, as well as with the participating teachers to refine these materials in an iterative fashion. Evaluation of the materials and workshops will be provided each year by the advisory board members, and their feedback will be used to improve design and implementation for the next year. The advisory board will also provide summative evaluation of student learning outcomes and will assess the success of the teachers' professional development workshops.

CAREER: Designing Learning Environments to Foster Productive and Powerful Discussions Among Linguistically Diverse Students in Secondary Mathematics

Lead Organization(s): 
Award Number: 
1553708
Funding Period: 
Mon, 02/01/2016 to Sun, 01/31/2021
Full Description: 

The project will design and investigate learning environments in secondary mathematics classrooms focused on meeting the needs of English language learners. An ongoing challenge for mathematics teachers is promoting deep mathematics learning among linguistically diverse groups of students while taking into consideration how students' language background influences their classroom experiences and the mathematical understandings they develop. In response to this challenge, this project will design and develop specialized instructional materials and guidelines for teaching fundamental topics in secondary algebra in linguistically diverse classrooms. The materials will incorporate insights from current research on student learning in mathematics as well as insights from research on the role of language in students' mathematical thinking and learning. A significant contribution of the work will be connecting research on mathematics learning generally with research on the mathematics learning of English language learners. In addition to advancing theoretical understandings, the research will also contribute practical resources and guidance for mathematics teachers who teach English language learners. The Faculty Early Career Development (CAREER) program is a National Science Foundation (NSF)-wide activity that offers awards in support of junior faculty who exemplify the role of teacher-scholars through outstanding research, excellent education, and the integration of education and research within the context of the mission of their organizations.

The project is focused on the design of specialized hypothetical learning trajectories that incorporate considerations for linguistically diverse students. One goal for the specialized trajectories is to foster productive and powerful mathematics discussions about linear and exponential rates in linguistically diverse classrooms. The specialized learning trajectories will include both mathematical and language development learning goals. While this project focuses on concepts related to reasoning with linear and exponential functions, the resulting framework should inform the design of specialized hypothetical learning trajectories in other topic areas. Additionally, the project will add to the field's understanding of how linguistically diverse students develop mathematical understandings of a key conceptual domain. The project uses a design-based research framework gathering classroom-based data, assessment data, and interviews with teachers and students to design and refine the learning trajectories. Consistent with a design-based approach, the project results will include development of theory about linguistically diverse students' mathematics learning and development of guidance and resources for secondary mathematics teachers. This research involves sustained collaboration with secondary mathematics teachers and the impacts will include developing capacity of teachers locally, and propagating the results of this work in professional development activities.


Project Videos

2019 STEM for All Video Showcase

Title: Fostering Math Discussions among English Learners

Presenter(s): William Zahner


Exploring Ways to Transform Teaching Practices to Increase Native Hawaiian Students' Interest in STEM

This project will integrate Native Hawaiian cross-cultural practices to explore ways to help teachers know about and know how to connect resources of students' familiar worlds to their science teaching. This project will transform the ways teachers orient their teaching at the upper elementary and middle grades through professional development courses offered at the University of Hawaii at Manoa.

Lead Organization(s): 
Award Number: 
1551502
Funding Period: 
Tue, 09/01/2015 to Fri, 08/31/2018
Full Description: 

This project will integrate Native Hawaiian cross-cultural practices to explore ways to help teachers know about and know how to connect resources of students' familiar worlds to their science teaching. This research is needed since Native Hawaiians are often stereotyped as poor learners; the available STEM workforce falls short of meeting the demands of STEM employers in the state; and as the largest group of public school enrollees, data show a greater decline in percent of students meeting or exceeding proficiency in science at higher grade levels. This project will address these issues by transforming the ways teachers orient their teaching at the upper elementary and middle grades through professional development courses offered at the University of Hawaii at Manoa.

The professional development model for teachers will be situated in the larger national and global contexts of an increasingly technology oriented, urbanized society with associated marginalization of indigenous people whose traditional ecological knowledge and indigenous languages are often overlooked. Guided by the cultural mental model theory and a mixed methods approach, data will be collected through document analysis, surveys, individual and focus group interviews, and pre-post assessments. This approach will capture initials findings about the influence of the professional development model on teaching and learning in science. The end products from this project will be an improved professional development model that is more sensitive to contexts that promote learning by Native Hawaiian students. It will also produce a survey instrument to assess student interest and engagement in science learning whose teachers will have participated in the professional development model being explored. Both outcomes will potentially be instrumental in changing the way approximately 2000 Native Hawaiian students learn about and become more interested in STEM fields through their natural world.

Mathematical and Computational Methods for Planning a Sustainable Future II

The project will develop modules for grades 9-12 that integrate mathematics, computing and science in sustainability contexts. The project materials also include information about STEM careers in sustainability to increase the relevancy of the content for students and broaden their understanding of STEM workforce opportunities. It uses summer workshops to pilot test materials and online support and field testing in four states. 

Lead Organization(s): 
Award Number: 
1503414
Funding Period: 
Wed, 07/15/2015 to Sun, 06/30/2019
Full Description: 

The project will develop modules for grades 9-12 that integrate mathematics, computing and science in sustainability contexts. The project materials also include information about STEM careers in sustainability to increase the relevancy of the content for students and broaden their understanding of STEM workforce opportunities. It uses summer workshops to pilot test materials and online support and field testing in four states. Outcomes include the modules, tested and revised; strategies for transfer of learning embedded in the modules; and a compendium of green jobs, explicitly related to the modules. The Discovery Research K-12 program (DRK-12) seeks to significantly enhance the learning and teaching of science, technology, engineering and mathematics (STEM) by preK-12 students and teachers, through research and development of innovative resources, models and tools (RMTs). Projects in the DRK-12 program build on fundamental research in STEM education and prior research and development efforts that provide theoretical and empirical justification for proposed projects. The STEM+Computing Partnerships (STEM+C) Program is a joint effort between the Directorate for Education & Human Resources (EHR) and Directorate Computer & Information Science & Engineering (CISE). Reflecting the increasing role of computational approaches in learning across the STEM disciplines, STEM+C supports research and development efforts that integrate computing within one or more STEM disciplines and/or integrate STEM learning in computer science; 2) advance multidisciplinary, collaborative approaches for integrating computing in STEM in and out of school, and 3) build capacity in K-12 computing education through foundational research and focused teacher preparation

The project is a full design and development project in the learning strand of DRK-12. The goal is to enhance transfer of knowledge in mathematics and science via sustainability tasks with an emphasis on mathematical and scientific practices. The research questions focus on how conceptual representations and the modules support students' learning and especially transfer to novel problems. The project design integrates the research with the curriculum development. It includes a mixed methods data collection and analysis from teachers and students (e.g., interviews, content exams, focus groups, implementation logs). Assessment of student work includes both short, focused problems in the content area and longer project-based tasks providing a range of assessments of student learning. The investigators will develop a rubric for scoring student work on the tasks. The curriculum design process includes iterations of the modules over time with feedback from teachers and using data collected from the implementation.

Quality Urban Ecology Science Teaching for Diverse Learners

This project will examine the relationship between teacher professional development associated with newly developed modules in urban ecology and the achievement and engagement of long-term English learners (LTEL).  Existing Urban Ecology learning modules will be enhanced to accommodate the needs of LTELs, and teachers will participate in professional development aimed at using the new materials to effectively integrate academic science discourse and literacy development for LTELs.

Lead Organization(s): 
Award Number: 
1503519
Funding Period: 
Sat, 08/01/2015 to Fri, 05/31/2019
Full Description: 

The Discovery Research K-12 program (DRK-12) seeks to significantly enhance the learning and teaching of science, technology, engineering and mathematics (STEM) by preK-12 students and teachers, through research and development of innovative resources, models and tools (RMTs). Projects in the DRK-12 program build on fundamental research in STEM education and prior research and development efforts that provide theoretical and empirical justification for proposed projects. This exploratory research project will examine the relationship between teacher professional development associated with newly developed modules in urban ecology and the achievement and engagement of long-term English learners (LTEL). Participants in the project will include students in grades 4-8 in a large urban school district, elementary school teachers, middle school science teachers, and middle school teachers of English language arts. Existing Urban Ecology learning modules will be enhanced to accommodate the needs of LTELs, and teachers will participate in professional development aimed at using the new materials to effectively integrate academic science discourse and literacy development for LTELs.

The project will develop two enhanced urban ecology modules (47 lessons) for English learners in grades 4-8; science language and literacy assessments for English language learners (ELLs); an ELL STEM career awareness inventory; an urban ecology for ELLs teacher knowledge scale, and an urban ecology for ELLs pedagogy observation protocol. The materials will be tested with a stratified random sample of students identified by achievement level (low, medium, and high) and linguistic background (mainstream, LTEL, and "at risk" of becoming LTEL). A mixed-methods research design will be used to test the hypothesis that the quantity and quality of LTEL science language and literacy achievement will increase as a result of teacher participation in implementing the newly developed transdisciplinary framework for Urban Ecology for English Learners.

Pages

Subscribe to Equity