Mathematics

Using Technology to Capture Classroom Interactions: The Design, Validation, and Dissemination of a Formative Assessment of Instruction Tool for Diverse K-8 Mathematics Classrooms

This project will refine, expand, and validate a formative assessment tool called Math Habits Tool (MHT) for kindergarten through 8th grade classrooms. MHT is intended to capture and understand patterns of in-the-moment teacher-student and student-student classroom interactions in ways that can promote more equitable access to high quality math learning experiences for all students.

Lead Organization(s): 
Award Number: 
1814114
Funding Period: 
Sat, 09/15/2018 to Wed, 08/31/2022
Full Description: 

An important aspect of mathematics teaching and learning is the provision of timely and targeted feedback to students and teachers on the teaching and learning processes. However, many of the tools and resources focused on providing such feedback (e.g., formative assessment) are aimed at helping students. However, formative assessment of teaching can be equally transformative for teachers and school leaders and is a key component of improved teacher practice. This project will refine, expand and validate a formative assessment tool called Math Habits Tool (MHT) for kindergarten through 8th grade classrooms. MHT is intended to capture and understand patterns of in-the-moment teacher-student and student-student classroom interactions in ways that can promote more equitable access to high quality math learning experiences for all students. The tablet or computer-based tool is intended for use with teacher leaders, principals, coaches, and others interested in assessing teacher practice in a formative way.

This project will continue the development of the MHT through: (1) the integration of an access component; (2) analysis of videos collected during prior studies covering a diverse set of classrooms across the K-8 spectrum; (2) a validation study using validity-argument approach; and (3) the development, piloting, and refinement of professional development modules that will guide math educators, researchers, and practitioners in using the MHT effectively as a formative assessment of instruction. The revised MHT will be validated through analyses of video data from a range of K-8 classrooms with varying demographics and contexts such as socio-economic status, language backgrounds, gender, school settings (e.g., urban, rural, suburban), and race, with particular attention to increasing accessibility to mathematics learning by students who are traditionally underserved, including emergent bilingual students. The data analysis plan involves video coding with multiple checks on reliability, dimensionality analysis with optimal scaling, correlation analysis, and hierarchical linear modeling.

Building Sustainable Networked Instructional Leadership in Elementary Mathematics Through a University Partnership with a Large Urban District

This grant is also known as The Responsive Math Teaching Project: Developing Instructional Leadership in a Network of Elementary Schools.

The goal of this project is to build instructional leadership capacity in teachers and school-based leaders in a network of underperforming elementary schools with limited resources. Through design-based improvement research, the project is designed to enhance the knowledge, skills, and competencies of elementary teacher leaders and principals to develop a shared vision and provide ongoing support of high-quality math instruction.

Lead Organization(s): 
Award Number: 
1813048
Funding Period: 
Sat, 09/01/2018 to Wed, 08/31/2022
Full Description: 

Mathematics is an important discipline that provides access to students to the other STEM disciplines. Early competence with mathematics has proven to be an important predictor of later achievement in school across socioeconomic backgrounds (National Mathematics Advisory Panel, 2008). It is difficult for schools and districts to maintain a sustained focus on improving math instruction in the elementary years, particularly in low-income and underperforming contexts where these goals are often overshadowed by more pressing needs and issues. Instructional leadership development holds promise for increasing the ability of school-based leaders to understand and support evidence-base practices, improve the quality of instruction, and ultimately improve student achievement (Ingersoll, Sirinides, & Doherty, 2017). The goal of this project is to build instructional leadership capacity in teachers and school-based leaders in a network of underperforming elementary schools with limited resources. Through design-based improvement research, the project is designed to enhance the knowledge, skills, and competencies of elementary teacher leaders and principals to develop a shared vision and provide ongoing support of high-quality math instruction. During the first 3 years of this project, cohorts of 2-4 schools will be added each year for mentored mathematics lead teachers (MLTs) coaching development and strategic school-based leadership support. Each cohort will begin with a year of instructional leadership mentorship, where a university-based consultant with expertise in mathematics instruction works side-by-side with the MLT as they co-participate in coaching activities. The second year of participation will involve a launch phase where MLTs will have the opportunity for monthly check-ins with the mentor while working with more independence with a new set of focal teachers and continuing to participate in the network-wide professional development. By the third year of participation, schools will be expected to assume ownership of the instructional leadership and strategic planning efforts while continuing to participate in network-wide professional community. Concurrently, the project team will offer professional development to MLTs and school-based leaders across all 13 schools, building up an ongoing networked community with different levels of expertise. The multi-year design of the project allows for studying the development of a group of teachers as they transition from mentored novices to more experienced and independent instructional leaders over time.

Building on two years of prior work and relationship building, the project aims to build coherence from the district to school to classroom level, leveraging the resources of the university to help translate the district vision for instructional improvement into classroom practice. In particular, the project focuses on developing shared understanding of high quality math instruction at the network level, strategic planning for math instructional leadership at the school level, and mentorship for lead teachers to provide effective instructional coaching at the classroom level. Development goals include: building math leadership capacity within the network, developing and refining a set of tools and routines to support instructional improvement at the classroom, school, network, and district levels, and building a networked community of schools, teachers, and leaders. The overarching problem that this project seeks to address is: How can instructional leadership expertise be developed in newly appointed math lead teachers within a large urban school district? The project will collect data including coaching artifacts such as observation and debriefing forms; mentor logs; interviews with teachers, MLTs, principals, and university-based mentors; and video recordings of coaching cycles. The focus of the data analysis will be to determine coherence and evidence of growth at different levels of the system to continually improve the intervention through a variety of qualitative data analysis techniques.

Usable Measures of Teacher Understanding: Exploring Diagnostic Models and Topic Analysis as Tools for Assessing Proportional Reasoning for Teaching

This project seeks to measure the kinds of knowledge developed in professional development (PD) programs that have been shown to matter for teachers' classroom practices and their students' learning. The project aims to develop an assessment that identifies patterns in the teachers' learning in a way that helps drive subsequent PD.The overall goal of this project is to pursue a potentially transformative approach to the assessment of teacher proportional knowledge by developing a measure that is well aligned with the content and skills taught in various PD programs.

Award Number: 
1813760
Funding Period: 
Sat, 09/01/2018 to Wed, 08/31/2022
Full Description: 

One of the great challenges related to teachers and their knowledge is measuring their learning in ways that are both formative and meaningful in relation to their likely impact on students. This challenge persists despite efforts to define the knowledge teachers should have and despite previous innovative efforts to create good measures. This project tackles the challenge by specifically aiming to measure the kinds of knowledge developed in professional development (PD) programs that has been shown to matter for teachers' classroom practices and their students' learning. The project aims to develop an assessment that identifies patterns in the teachers' learning in a way that helps drive subsequent professional development.

The overall goal of this project is to pursue a potentially transformative approach to the assessment of teacher proportional knowledge by developing a measure that is well aligned with the content and skills taught in various PD programs. This instrument will be based on a new approach that builds on emerging psychometric models. Specifically, diagnostic classification models (DCMs) will be utilized to diagnose teachers' learning during a PD program as well as employed to identify the progression in teachers' learning.  Statistical topic models (STMs) will be used to look for patterns of understanding that emerge from open-ended responses and provide natural-language insight into teachers' reasoning. A final version of the assessment will be constructed for a national sample based on the results from the predictive validity stage, and this version will be tested with teachers who participate in various types of PD programs targeting proportional reasoning. This project has broad implications for the creation of assessments and for teacher education. It will provide insights about whether there is a clear learning progression for teachers. While much work has been done with students' learning progression, much less is known about how teachers learn. Another implication is that the STM approach allows machine scoring of natural language in a way that highlights strengths and weaknesses in reasoning rather than simply returning a score. For formative use, this is information that is more helpful as it highlights areas for further instruction. A third implication is that DCMs will allow to assess teacher knowledge at a finer-grained understanding than is typically available, thus allowing for careful refinement of PD as well as a tool for showing overall growth in PD. A fourth implication is that a more systematic approach will be followed to capture the kinds of knowledge teachers need. Assessments developed using DCMs and STMs have the potential to serve as models for developing further instruments in other STEM content areas. Such assessments have the potential to not only help identify successful PD programs, but also to provide PD providers with rich data from which they can make instructional decisions.

Professional Development Supports for Teaching Bioinformatics through Mobile Learning

This project will investigate the professional development supports needed for teaching bioinformatics at the high school level. The project team will work with biology and mathematics teachers to co-design instructional modules to engage students with core bioinformatics concepts and computational literacies, by focusing on local community health issues supported through mobile learning activities.

Lead Organization(s): 
Award Number: 
1812738
Funding Period: 
Sat, 09/01/2018 to Mon, 02/28/2022
Full Description: 

Bioinformatics is an emerging area of research that develops new knowledge through computational analysis of vast biological and biomedical data. This project will investigate the professional development supports needed for teaching bioinformatics at the high school level. Building from a robust literature in professional development design research, project team will work with biology and mathematics teachers to co-design instructional modules to engage students with core bioinformatics concepts and computational literacies, by focusing on local community health issues supported through mobile learning activities. The overarching goal of the project is to help create an engage population of informatics-informed students who are capable of critically analyzing information and able to solve local problems related to their health and well-being.

The project team will use a design-based implementation research approach to identify the curricular and instructional supports needed to achieve the teaching and learning goals through iterative project revisions, employing mixed methods to evaluate teacher and student learning processes and outcomes. Teachers from local high needs schools will participate in a three-week summer workshop, where they will learn about state-of-the-art bioinformatics content, project-based pedagogies that promote computational literacy, and strategies integrate mobile technologies into instruction.  They will implement the instructional units during the year, and the summer workshop will be revised and delivered to an expanded cohort of teachers the following summer. The data collection and analysis conducted on teachers' enactment of these modules will reveal the professional development and implementation areas needed to support particular populations, specifically underrepresented groups in STEM, to engage with bioinformatics learning and take authentic action on local community issues.

Understanding the Role of Simulations in K-12 Science and Mathematics Teacher Education

This project will develop and implement a working conference for scholars and practitioners to articulate current use cases and theories of action regarding the use of simulations in PreK-12 science and mathematics teacher education. The conference will be structured to provide opportunities for attendees to share their current research, theoretical models, conceptual views, and use cases focused on the design and use of digital and non-digital simulations for building and assessing K-12 science and mathematics teacher competencies.

Lead Organization(s): 
Award Number: 
1813476
Funding Period: 
Sat, 09/01/2018 to Sat, 08/31/2019
Full Description: 

The recent emergence of updated learning standards in science and mathematics, coupled with increasingly diverse school students across the nation, has highlighted the importance of updating professional learning opportunities for science and mathematics teachers. One promising approach that has emerged is the use of simulations to engage teachers in approximations of practice where the focus is on helping them learn how to engage in ambitious content teaching. In particular, recent technological advances have supported the emergence of new kinds of digital simulations and have brought increased attention to simulations as a tool to enhance teacher learning. This project will develop and implement a working conference for scholars and practitioners to articulate current use cases and theories of action regarding the use of simulations in PreK-12 science and mathematics teacher education. The conference will be structured to provide opportunities for attendees to share their current research, theoretical models, conceptual views, and use cases focused on the design and use of digital and non-digital simulations for building and assessing K-12 science and mathematics teacher competencies.

While the use of simulations in teacher education is neither new nor limited to digital simulation, emerging technological capabilities have enabled digital simulations to become practical in ways not formerly available. The current literature base, however, is dated and the field lacks clear theoretic models or articulated theories of action regarding what teachers could or should learn via simulations, and the essential components of effective learning trajectories. This working conference will be structured to provide opportunities for attending, teacher educators, researchers, professional development facilitators, policy makers, preservice and inservice teachers, and school district leaders to share their current research, theoretical models, conceptual views, and use cases regarding the role of simulations in K-12 science and mathematics teacher education. The conference will be organized around four major goals, including: (1) Define how simulations (digital and non-digital) are conceptualized, operationalized, and utilized in K-12 science and mathematics teacher education; (2) Document and determine the challenges and affordances of the varied contexts, audiences, and purposes for which simulations are used in K-12 science and mathematics teacher education and the variety of investigation methods and research questions employed to investigate the use of simulations in these settings; (3) Make explicit the theories of action and conceptual views undergirding the various simulation models being used in K-12 science and mathematics teacher education; and (4) Determine implications of the current research and development work in this space and establish an agenda for studying the use of simulations in K-12 science and mathematics teacher education. The project will produce a white paper that presents the research and development agenda developed by the working conference, describes a series of use cases describing current and emergent practice, and identifies promising directions for future research and development in this area. Conference outcomes are expected to advance understanding of the varied ways in which digital and non-digital simulations can be used to foster and assess K-12 science and mathematics teacher competencies and initiate a research and development agenda for examining the role of simulations in K-12 science and mathematics teacher education.


Project Videos

2019 STEM for All Video Showcase

Title: Understanding the Role of Simulations in Teacher Preparation

Presenter(s): Lisa Dieker, Angelica Fulchini Scruggs, Heather Howell, Michael Hynes, & Jamie Mikeska


Prospective Elementary Teachers Making for Mathematical Learning

This study takes an innovative approach to documenting how teacher knowledge can be enhanced by incorporating a design experience into pre-service mathematics education. Teachers will use digital and fabrication technologies (e.g., 3D printers and laser cutters) to design and use manipulatives for K-6 mathematics learning. The goals of the project include describing how this experience influences the prospective teachers' knowledge and identities while creating curriculum for teacher education.

Lead Organization(s): 
Award Number: 
1812887
Funding Period: 
Sat, 09/01/2018 to Mon, 08/31/2020
Full Description: 

What teachers know and believe is central to what they can do in classrooms. This study takes an innovative approach to documenting how teacher knowledge can be enhanced by incorporating a design experience into pre-service mathematics education. The study's participating prospective teachers will use digital and fabrication technologies (e.g., 3D printers and laser cutters) to design and use manipulatives for K-6 mathematics learning. The goals of the project include describing how this experience influences the prospective teachers' knowledge and identities while creating curriculum for teacher education. Also, because more schools and students have access to 3D fabrication capabilities, teacher education can utilize these capabilities to prepare teachers to take advantage of these resources. Prior research by the team demonstrated how the process of making a manipulative can support prospective teachers in learning about mathematics and how to teach elementary mathematics concepts. The project will generate resources for other elementary teacher education programs and research about how prospective elementary teachers learn mathematics for teaching.

The project includes three research questions. First, what forms of knowledge are brought to bear as prospective elementary teachers make new manipulatives and write corresponding tasks to support the teaching and learning of mathematics? Second, how does prospective elementary teachers' knowledge for teaching mathematics develop as they make new manipulatives and write tasks to support the teaching and learning of mathematics? Third, as prospective elementary teachers make new manipulatives and write tasks to support the teaching and learning of mathematics, how do they see themselves in relation to the making, the mathematics, and the mathematics teaching? The project will employ a design-based research methodology with cycles of design, enactment, analysis and redesign to create curriculum modules for teacher education focused on making mathematics manipulatives. Data collection will include video recording of class sessions, participant observation, field notes, artifacts from the participants' design of manipulatives, and assessments of mathematical knowledge for teaching. A qualitative analysis will use multiple frameworks from prior research on mathematics teacher knowledge and identity development.

Design and Development of a K-12 STEM Observation Protocol (Collaborative Research: Roehrig)

This project will design and develop a new K-12 classroom observation protocol for integrated STEM instruction (STEM-OP). The STEM-OP will inform the instruction of integrated STEM in many contexts with the goal of improving integrated STEM education.

Award Number: 
1813342
Funding Period: 
Sat, 09/01/2018 to Wed, 08/31/2022
Full Description: 

This project will design and develop a new K-12 classroom observation protocol for integrated STEM instruction (STEM-OP). The STEM-OP will be developed for use in K-12 STEM settings. While the importance of integrated STEM education is established, there remains disagreement on models and effective approaches for integrated STEM instruction. This issue is confounded by the lack of observation protocols sensitive to integrated STEM teaching and learning to inform research to the effectiveness of new models and strategies. Existing instruments were not developed for use in integrated STEM learning environments. The STEM-OP will be designed to be used effectively by multiple stakeholders in a variety of contexts. Researchers will benefit from having the STEM-OP available for them to carry out research and continue to improve STEM education in a variety of ways. Existing instruments were not developed for use in integrated STEM learning environments.  The STEM-OP and associated training materials will be available for use by other education stakeholders, such as K-12 teachers and district administrators, through a publicly available online platform. In brief, the STEM-OP will inform the instruction of integrated STEM in many contexts with the goal of improving integrated STEM education.

The primary product of this project is the new observation protocol called STEM-OP for K-12 classrooms implementing integrated STEM lessons. The project will use over 500 integrated STEM classroom videos to design the STEM-OP. Using exploratory and confirmatory factor analysis, the STEM-OP will be a valid and reliable instrument for use in a variety of educational contexts. The research will explore the different ways that elementary, middle, and high school science teachers enact integrated STEM instruction. This study will shed light on the nature of STEM instruction in each of these grade bands and provide information building towards an understanding of learning progressions for engineering practices across grade bands. Research exploring how the nature of STEM integration changes from day to day over the course of a unit will provide critical information about the different sequencing and trajectories of STEM units. Examining how integrated STEM instruction unfolds over a full unit of instruction will inform the understanding of integrated STEM practices at both micro- and macro- levels of analysis. The STEM-OP and associated training materials will be available for use by other education stakeholders, such as K-12 teachers and district administrators, through a publicly available, which will be distributed via a publicly available, online platform that includes a training manual and classroom video for practice scoring.

Design and Development of a K-12 STEM Observation Protocol (Collaborative Research: Dare)

This project will design and develop a new K-12 classroom observation protocol for integrated STEM instruction (STEM-OP). The STEM-OP will inform the instruction of integrated STEM in many contexts with the goal of improving integrated STEM education.

Lead Organization(s): 
Award Number: 
1854801
Funding Period: 
Sat, 09/01/2018 to Wed, 08/31/2022
Full Description: 

This project will design and develop a new K-12 classroom observation protocol for integrated STEM instruction (STEM-OP). The STEM-OP will be developed for use in K-12 STEM settings. While the importance of integrated STEM education is established, there remains disagreement on models and effective approaches for integrated STEM instruction. This issue is confounded by the lack of observation protocols sensitive to integrated STEM teaching and learning to inform research to the effectiveness of new models and strategies. Existing instruments were not developed for use in integrated STEM learning environments. The STEM-OP will be designed to be used effectively by multiple stakeholders in a variety of contexts. Researchers will benefit from having the STEM-OP available for them to carry out research and continue to improve STEM education in a variety of ways. Existing instruments were not developed for use in integrated STEM learning environments.  The STEM-OP and associated training materials will be available for use by other education stakeholders, such as K-12 teachers and district administrators, through a publicly available online platform. In brief, the STEM-OP will inform the instruction of integrated STEM in many contexts with the goal of improving integrated STEM education.

The primary product of this project is the new observation protocol called STEM-OP for K-12 classrooms implementing integrated STEM lessons. The project will use over 500 integrated STEM classroom videos to design the STEM-OP. Using exploratory and confirmatory factor analysis, the STEM-OP will be a valid and reliable instrument for use in a variety of educational contexts. The research will explore the different ways that elementary, middle, and high school science teachers enact integrated STEM instruction. This study will shed light on the nature of STEM instruction in each of these grade bands and provide information building towards an understanding of learning progressions for engineering practices across grade bands. Research exploring how the nature of STEM integration changes from day to day over the course of a unit will provide critical information about the different sequencing and trajectories of STEM units. Examining how integrated STEM instruction unfolds over a full unit of instruction will inform the understanding of integrated STEM practices at both micro- and macro- levels of analysis. The STEM-OP and associated training materials will be available for use by other education stakeholders, such as K-12 teachers and district administrators, through a publicly available, which will be distributed via a publicly available, online platform that includes a training manual and classroom video for practice scoring.

Design and Development of a K-12 STEM Observation Protocol (Collaborative Research: Ring-Whalen)

This project will design and develop a new K-12 classroom observation protocol for integrated STEM instruction (STEM-OP). The STEM-OP will inform the instruction of integrated STEM in many contexts with the goal of improving integrated STEM education.

Lead Organization(s): 
Award Number: 
1812794
Funding Period: 
Sat, 09/01/2018 to Wed, 08/31/2022
Full Description: 

This project will design and develop a new K-12 classroom observation protocol for integrated STEM instruction (STEM-OP). The STEM-OP will be developed for use in K-12 STEM settings. While the importance of integrated STEM education is established, there remains disagreement on models and effective approaches for integrated STEM instruction. This issue is confounded by the lack of observation protocols sensitive to integrated STEM teaching and learning to inform research to the effectiveness of new models and strategies. Existing instruments were not developed for use in integrated STEM learning environments. The STEM-OP will be designed to be used effectively by multiple stakeholders in a variety of contexts. Researchers will benefit from having the STEM-OP available for them to carry out research and continue to improve STEM education in a variety of ways. Existing instruments were not developed for use in integrated STEM learning environments.  The STEM-OP and associated training materials will be available for use by other education stakeholders, such as K-12 teachers and district administrators, through a publicly available online platform. In brief, the STEM-OP will inform the instruction of integrated STEM in many contexts with the goal of improving integrated STEM education.

The primary product of this project is the new observation protocol called STEM-OP for K-12 classrooms implementing integrated STEM lessons. The project will use over 500 integrated STEM classroom videos to design the STEM-OP. Using exploratory and confirmatory factor analysis, the STEM-OP will be a valid and reliable instrument for use in a variety of educational contexts. The research will explore the different ways that elementary, middle, and high school science teachers enact integrated STEM instruction. This study will shed light on the nature of STEM instruction in each of these grade bands and provide information building towards an understanding of learning progressions for engineering practices across grade bands. Research exploring how the nature of STEM integration changes from day to day over the course of a unit will provide critical information about the different sequencing and trajectories of STEM units. Examining how integrated STEM instruction unfolds over a full unit of instruction will inform the understanding of integrated STEM practices at both micro- and macro- levels of analysis. The STEM-OP and associated training materials will be available for use by other education stakeholders, such as K-12 teachers and district administrators, through a publicly available, which will be distributed via a publicly available, online platform that includes a training manual and classroom video for practice scoring.

Testing the Efficacy of the Strategic Observation and Reflection (SOAR) for Math Professional Learning Program

The purpose of this project is to develop, implement and test a professional development program, SOAR for Math, to build capacity for mentors and teachers to improve English learner's academic language development and mathematical content understanding.

Award Number: 
1814356
Funding Period: 
Sat, 09/01/2018 to Wed, 08/31/2022
Full Description: 
Professional development is an important way for teachers who are currently in classrooms to learn about new best practices in mathematics teaching and learning and improve their practice. Little is known about what types of professional development (PD) and teacher mentoring programs support teachers' improved practices and ultimately lead to gains in student learning. The purpose of this project is to develop, implement and test a professional development program, SOAR for Math, to build capacity for mentors and teachers to improve English learner's academic language development and mathematical content understanding.
 
This study will test the efficacy of the Strategic Observation and Reflection (SOAR) for Math professional development program. The mixed methods study is designed to answer several research questions: (1) What is the impact of teachers' participation in SOAR for Math on student achievement outcomes for current and recent grade 3-6 English learner students in treatment schools? (2) What is the impact of SOAR for Math on treatment school teachers' knowledge and practices related to their academic language and literacy development instruction for current and recent English learner students, specifically scores on the Knowledge/Use Scale? (3) What is the impact of SOAR for Math on treatment mentors' knowledge and practices related to their academic language and math instruction? A randomized controlled trial will be conducted in 80 elementary schools in one California school district. Schools serving third- through sixth-grade general education students will be eligible to participate. The research team will randomly assign 40 schools to provide SOAR for Math training to mentor teachers and 40 schools to comprise a control group receiving business-as-usual professional development. Two mentors per school will participate in the study. Measures will include state math scores and a variety of observations and questionnaires to assess fidelity of implementation. Data will be analyzed using hierarchical linear modeling to account for the nested data structure.

Pages

Subscribe to Mathematics