Urban

Measuring Early Mathematical Reasoning Skills: Developing Tests of Numeric Relational Reasoning and Spatial Reasoning

The primary aim of this study is to develop mathematics screening assessment tools for Grades K-2 over the course of four years that measure students' abilities in numeric relational reasoning and spatial reasoning. The team of researchers will develop Measures of Mathematical Reasoning Skills system, which will contain Tests of Numeric Relational Reasoning (T-NRR) and Tests of Spatial Reasoning (T-SR).

Award Number: 
1721100
Funding Period: 
Fri, 09/15/2017 to Tue, 08/31/2021
Full Description: 

Numeric relational reasoning and spatial reasoning are critical to success in later mathematics coursework, including Algebra 1, a gatekeeper to success at the post-secondary level, and success in additional STEM domains, such as chemistry, geology, biology, and engineering. Given the importance of these skills for later success, it is imperative that there are high-quality screening tools available to identify students at-risk for difficulty in these areas. The primary aim of this study is to develop mathematics screening assessment tools for Grades K-2 over the course of four years that measure students' abilities in numeric relational reasoning and spatial reasoning. The team of researchers will develop Measures of Mathematical Reasoning Skills system, which will contain Tests of Numeric Relational Reasoning (T-NRR) and Tests of Spatial Reasoning (T-SR). The measures will be intended for use by teachers and school systems to screen students to determine who is at-risk for difficulty in early mathematics, including students with disabilities. The measures will help provide important information about the intensity of support that may be needed for a given student. Three forms per grade level will be developed for both the T-NRR and T-SR with accompanying validity and reliability evidence collected. The Discovery Research K-12 program (DRK-12) seeks to significantly enhance the learning and teaching of science, technology, engineering and mathematics (STEM) by preK-12 students and teachers, through research and development of innovative resources, models and tools (RMTs). Projects in the DRK-12 program build on fundamental research in STEM education and prior research and development efforts that provide theoretical and empirical justification for proposed projects.

The development of the T-NRR and T-SR measures will follow an iterative process across five phases. The phases include (1) refining the construct; (2) developing test specifications and item models; (3) developing items; (4) field testing the items; and (5) conducting validity studies. The evidence collected and evaluated during each phase will contribute to the overall evaluation of the reliability of the measures and the validity of the interpretations made using the measures. Item models, test specifications, and item development will be continuously evaluated and refined based on data from cognitive interviews, field tests, and reviews by mathematics educators, teachers of struggling students, teachers of culturally and linguistically diverse populations, and a Technical Advisory Board. In the final phase of development of the T-NRR and T-SR, reliability of the results will be estimated and multiple sources of validity evidence will be collected to examine the concurrent and predictive relation with other criterion measures, classification accuracy, and sensitivity to growth. Approximately 4,500 students in Grades K-2 will be involved in all phases of the research including field tests and cognitive interviews. Data will be analyzed using a two-parameter IRT model to ensure item and test form comparability.

Networking Urban Resources with Teachers and University to Enrich Early Childhood Science (NURTURES) Phase II: Expansion and Evaluation

Building on successful prior work, this project simultaneously targets young children's teachers and families/caregivers in an effort to build both parties' capacity to promote student interest in science, technology, engineering and mathematics (STEM) learning.

Lead Organization(s): 
Award Number: 
1721059
Funding Period: 
Fri, 09/01/2017 to Tue, 08/31/2021
Full Description: 

Building on successful prior work, this University of Toledo project, Networking Urban Resources with Teachers and University to enRich Early Childhood Science (NURTURES): Researching the impact of teacher professional development and family engagement on PreK-3 achievement, simultaneously targets young children's teachers and families/caregivers in an effort to build both parties' capacity to promote student interest in science, technology, engineering and mathematics (STEM) learning. Teachers participate in a two-week summer professional development program and receive support across the school year in the form of individualized coaching and participation in professional learning communities. Families receive science inquiry packets (sent home from school) four times a year and attend community STEM events throughout the year. Inquiry packets and community events encourage science inquiry, discourse, and further exploration of key science ideas. Project participants will include 120 teachers, 2,400 PreK-3 children and over 7,200 family members in Ohio and Michigan.

Extending the initial NURTURES project, developed with NSF Math and Science Partnership funding, this follow-up project aims to: 1) Transform early childhood science teaching based upon Next Generation Science Standards (NGSS) to measurably increase student science, literacy, and math achievement, and 2) Engage families of PreK-3 students in science inquiry practices to measurably improve student science, literacy, and math achievement. A particularly important facet of this follow-up project is the research effort to parse and understand how each component (teacher professional development versus family engagement) impacts student learning. The project will use a randomized control group research design (RCT) to compare student achievement outcomes among three groups: Children whose teachers received professional development and family engagement activities, children whose teachers received only professional development, and a control group. The project will use standardized tests (the TerraNova Complete Battery) to measure impact on learning gains in science, mathematics, reading, and early literacy for children in grades K- 3. The Lens on Science assessment will measure science learning in preschool children. This project will result in an NGSS-based program for teachers and families that has been systematically tested and may ultimately be scaled up to an impact study and dissemination at a broad level.

A Partnership to Adapt, Implement and Study a Professional Learning Model and Build District Capacity to Improve Science Instruction and Student Understanding (Collaborative Research: Borko)

This project will work in partnership with the Santa Clara Unified School District (SCUSD) to adapt a previously designed Professional Learning (PL) model based on the District's objectives and constraints to build the capacity of teacher leaders and a program coordinator to implement the adapted PL program. The project is examining the sustainability and scalability of a PL model that supports the development of teachers' pedagogical content knowledge and instructional practices.

Lead Organization(s): 
Award Number: 
1720930
Funding Period: 
Sun, 10/01/2017 to Thu, 09/30/2021
Full Description: 

The Lawrence Hall of Science (the Hall) and Stanford University teams have previously developed and tested the efficacy of a program of Professional Learning (PL) which is focused on improving teachers' ability to support students' ability to engage in scientific argumentation. Key components of the PL model include a week-long summer institute and follow-up sessions during the academic year that incorporate additional pedagogical input, video reflection, and planning time. In this project, the Hall and Stanford are working in partnership with the Santa Clara Unified School District (SCUSD) to adapt the PL model based on the District's objectives and constraints, to build the capacity of teacher leaders and a program coordinator to implement the adapted PL program. This will enable the District to continue to adapt and implement the program independently at the conclusion of the project. Concurrently, the project is studying the adaptability of the PL model and the effectiveness of its implementation, and is developing guidelines and tools for other districts to use in adapting and implementing the PL model in their local contexts. Thus, this project is contributing knowledge about how to build capacity in districts to lead professional learning in science that addresses the new teaching and learning standards and is responsive to the needs of their local context.

The project is examining the sustainability and scalability of a PL model that supports the development of teachers' pedagogical content knowledge and instructional practices, with a particular focus on engaging students in argument from evidence. Results from the Hall and Stanford's previous research project indicate that the PL model is effective at significantly improving teachers' and students' classroom discourse practices. These findings suggest that a version of the model, adapted to the context and needs of a different school district, has the potential to improve the teaching of science to meet the demands of the current vision of science education. Using a Design-Based Implementation Research approach, this project is (i) working with SCUSD to adapt the PL model; (ii) preparing a district project coordinator and cadre of local teacher leaders (TLs) to implement and further adapt the model; and (iii) studying the adaptation and implementation of the model. The outcomes will be: a) a scalable PL model that can be continually adapted to the objectives and constraints of a district; b) a set of activities and resources for the district to prepare and support the science teacher leaders who will implement the adapted PL program internally with other teachers; and c) knowledge about the adaptations and resources needed for the PL model to be implemented independently by other school districts. The team also is researching the impact of the program on classroom practices and student learning.


Project Videos

2019 STEM for All Video Showcase

Title: Building District Leadership in Scientific Argumentation

Presenter(s): Coralie Delhaye, Emily Reigh, & Emily Weiss

2018 STEM for All Video Showcase


Project MAPLE: Makerspaces Promoting Learning and Engagement

The project plans to develop and study a series of metacognitive strategies that support learning and engagement for struggling middle school students during makerspace experiences. The study will focus narrowly on establishing a foundational understanding of how to ameliorate barriers to engaging in design learning through the use of metacognitive strategies.

Award Number: 
1721236
Funding Period: 
Fri, 09/01/2017 to Sat, 08/31/2019
Full Description: 

The project plans to develop and study a series of metacognitive strategies that support learning and engagement for struggling middle school students during makerspace experiences. The makerspace movement has gained recognition and momentum, which has resulted in many schools integrating makerspace technologies and related curricular practices into the classroom. The study will focus narrowly on establishing a foundational understanding of how to ameliorate barriers to engaging in design learning through the use of metacognitive strategies. The project plans to translate and apply research on the use of metacognitive strategies in supporting struggling learners to develop approaches that teachers can implement to increase opportunities for students who are the most difficult to reach academically. Project strategies, curricula, and other resources will be disseminated through existing outreach websites, research briefs, peer-reviewed publications for researchers and practitioners, and a webinar for those interested in middle-school makerspaces for diverse learners.

The research will address the paucity of studies to inform practitioners about what pedagogical supports help struggling learners engage in these makerspace experiences. The project will focus on two populations of struggling learners in middle schools, students with learning disabilities, and students at risk for academic failure. The rationale for focusing on metacognition within makerspace activities comes from the literature on students with learning disabilities and other struggling learners that suggests that they have difficulty with metacognitive thinking. Multiple instruments will be used to measure metacognitive processes found to be pertinent within the research process. The project will tentatively focus on persistence (attitudes about making), iteration (productive struggle) and intentionality (plan with incremental steps). The work will result in an evidence base around new instructional practices for middle school students who are struggling learners so that they can experience more success during maker learning experiences.

Integrating Chemistry and Earth Science

This project will design, develop, and test a new curriculum unit for high school chemistry courses that is organized around the question, "How does chemistry shape where I live?" The new unit will integrate relevant Earth science data, scientific practices, and key urban environmental research findings with the chemistry curriculum to gain insights into factors that support the approach to teaching and learning advocated by current science curriculum standards.

Award Number: 
1721163
Funding Period: 
Tue, 08/15/2017 to Wed, 07/31/2019
Full Description: 

This Integrating Chemistry and Earth science (ICE) project will design, develop, and test a new curriculum unit for high school chemistry courses that is organized around the question, "How does chemistry shape where I live?" The new unit will integrate relevant Earth science data, scientific practices, and key urban environmental research findings with the chemistry curriculum to gain insights into factors that support the approach to teaching and learning advocated by current science curriculum standards. The overarching goal of the project is to develop teacher capacity to teach and evaluate student abilities to use the practices of scientists and concepts from Earth science and chemistry to understand important phenomena in their immediate, familiar environments. The project has the potential to serve as a model for how to make cutting edge science directly accessible to all students. The project is a collaborative effort that engages scientists, science education researchers, curriculum developers, school curriculum and instruction leaders, and science teachers in the longer term challenge of infusing Earth science concepts and practices across the core high school science courses.

Current guidelines and standards for science education promote learning that engages students in three interrelated dimensions: disciplinary core ideas, scientific practices, and crosscutting ideas. This project is guided by the hypothesis that when provided sustained opportunities to engage in three-dimensional learning experiences, in an integrated Earth science and chemistry context, students will improve in their ability to demonstrate the coordination of disciplinary core ideas, scientific practices, and crosscutting concepts when solving problems and developing explanations related to scientific phenomena. This project will employ a design based research approach, and during the two development-enactment-analysis-and-redesign cycles, the project team will collect student assessment data, teacher interview data, observational data from lessons, teacher surveys, and reflective teacher logbooks. These collected data will provide information about how teachers implement the lessons, what students do during the lessons, and what students learn from them that will lead to better design and a better understanding of student learning. This information will be used to inform the modification of lessons from cycle to cycle, and to inform the professional development materials for teachers. The research agenda for the project is guided by the following questions: 1. What are the design features of ICE lessons that support teachers in enacting three-dimensional instruction within the context of their classroom? 2. What are the design features of embedded three-dimensional assessments that yield useful classroom data for teachers and researchers regarding their students' abilities to integrate core ideas, scientific practices, and crosscutting concepts? 3. What is the nature of student learning related to disciplinary core ideas, scientific practices, and crosscutting concepts that results from students' engagement in ICE lesson sets? 4. What differences emerge in student engagement and learning outcomes for ICE lessons that incorporate local phenomena or data sets as compared to lessons that do not? 5. What contextual factors (i.e., school context, administrative support, time constraints, etc.) influence teachers' implementation of three-dimensional instruction embedded within ICE lessons?


Project Videos

2019 STEM for All Video Showcase

Title: Integrating Chemistry and Earth Science (ICE)

Presenter(s): Alan Berkowitz, Vonceil Anderson, Bess Caplan, Kevin Garner, & Jonathon Grooms


Engaging Students in Scientific Practices: Evaluating Evidence and Explanation in Secondary Earth and Space Science

This project will develop, implement, test, and revise instructional approaches and materials for high school students that focus on the links between scientific evidence and alternative explanations of phenomena relating to Earth and space education. Students will learn to construct diagrams showing the links between explanatory models of natural phenomena and lines of evidence, and then evaluate the plausibility of various alternative explanations for events.

Lead Organization(s): 
Award Number: 
1721041
Funding Period: 
Fri, 09/01/2017 to Tue, 08/31/2021
Full Description: 

This project will develop, implement, test, and revise instructional approaches and materials for high school students that focus on the links between scientific evidence and alternative explanations of phenomena relating to Earth and space education. Students will examine alternative explanations for natural phenomena associated with extreme weather events, freshwater resource availability, and related topics in learning how to evaluate scientifically valid lines of evidence and explanation. Students will learn to construct diagrams showing the links between explanatory models of natural phenomena and lines of evidence, and then evaluate the plausibility of various alternative explanations for events. It is expected that engagement in these activities will help students gain proficiency in model-based reasoning, critical thinking, planning and analyzing scientifically valid investigations, constructing plausible explanations, engaging in collaborative argumentation, and critically evaluating scientific information.

This 4-year Design and Development project will examine use of Model-Evidence Link (MEL) diagrams that are intended to help students cognitively construct mental scaffolds that assist their engagement in the practices of critical evaluation, plausibility appraisal, and knowledge construction related to science topics that are considered by some as controversial. Prior research has demonstrated the potential educational outcomes of using MEL diagrams, but this project will extend the previous work by examining an approach where students construct their own MEL diagrams (build-a-MELs, or baMELs). The project will examine the use of both pre-constructed MELs and baMELs for effectiveness in promoting student engagement in scientific reasoning and practices. The project will employ design-based research methodologies in pursuing answers to three research questions: (1) Do baMEL activities tested in multiple high school classroom settings promote critical evaluation, plausibility reappraisal, and  scientifically accurate knowledge construction about controversial Earth and space science topics? (2) How do these additional baMELs differ from pre-constructed MELs in promoting critical evaluation, plausibility reappraisal, and knowledge construction? And (3) To what extent does repeated use of both pre-constructed MELs and baMELs result in student engagement of scientific practices (i.e., asking critical questions, using model-based reasoning, planning and analyzing scientifically valid investigations, constructing plausible explanations, engaging in collaborative argumentation, and critically evaluating scientific information)? The project will engage high school students taking Earth and space classes in selected schools of Georgia, New Jersey, and within Philadelphia. Teacher professional development opportunities associated with the project will include summer institutes, classroom supports, and mentoring sessions.

Mathematical Learning via Architectural Design and Modeling Using E-Rebuild

This project will explore the learning of mathematics through architectural tasks in an online simulation game, E-Rebuild. In the game-based architectural simulation, students will be able to complete tasks such as building and constructing structures while using mathematics and problem solving. The project will examine how to collect data about students' learning from data generated as they play the game, how students learn mathematics using the simulation, and how the simulation can be included in middle school mathematics learning.

Lead Organization(s): 
Award Number: 
1720533
Funding Period: 
Tue, 08/01/2017 to Sat, 07/31/2021
Full Description: 

This project will explore the learning of mathematics through architectural tasks in an online simulation game, E-Rebuild. There is a need to connect mathematics to real world contexts and problems. In the game-based architectural simulation, students will be able to complete tasks such as building and constructing structures while using mathematics and problem solving. The learning platform will be flexible so teachers can customize tasks for their students. The project will examine how to collect data about students' learning from data generated as they play the game. The project will explore how students learn mathematics using the simulation and how the simulation can be included in middle school mathematics learning.

The project includes two major research questions. First, how will the design of a scalable game-based, design-centered learning platform promote coordination and application of math representation for problem solving? Second, how and under what implementation circumstances will using a scalable architectural game-based learning platform improve students multi-stranded mathematical proficiency (i.e., understanding, problem solving and positive disposition)? A key feature of the project is stealth-assessment or data collected and logged as students use the architectural simulation activities that can be used to understand their mathematics learning. The project uses a design-based research approach to gather data from students and teachers that will inform the design of the learning environment. The qualitative and quantitative data will also be used to understand what students are learning as they play the game and how teachers are interacting with their students. The project will include a mixed methods study to compare classrooms using the architectural activities to classrooms that are using typical activities.

Building a Community of Science Teacher Educators to Prepare Novices for Ambitious Science Teaching

This conference will bring together a group of teacher educators to focus on preservice teacher education and a shared vision of instruction called ambitious science teaching. It is a critical first step toward building a community of teacher educators who can collectively share and refine strategies, tools, and practices for preparing preservice science teachers for ambitious science teaching.

Lead Organization(s): 
Award Number: 
1719950
Funding Period: 
Tue, 08/01/2017 to Tue, 07/31/2018
Full Description: 

There is a growing consensus among science teacher educators of a need for a shared, research-based vision of accomplished instructional practice, and for teacher education pedagogies that can effectively prepare preservice science teachers to support the science learning of students from all backgrounds. This conference will bring together a group of teacher educators to focus on preservice teacher education and a shared vision of instruction called ambitious science teaching. This conference is a critical first step toward building a community of teacher educators who can collectively share and refine strategies, tools, and practices for preparing preservice science teachers for ambitious science teaching. The conference has two goals. The first goal is to develop a shared vision and language about effective pedagogy of science teacher preparation, focusing on ambitious science teaching and practice-based approaches to science teacher preparation. The second goal is to initiate a professional community that can generate, test, revise, and disseminate a set of resources (curriculum materials, tools, videos, models of teacher educator pedagogies, etc.) to support teacher educators.

There are immediate and long-term broader impacts that will result from this conference. One immediate impact is that this conference will set forth an actionable research agenda for the participants and the field to take up around ambitious science teaching and practice-based teacher education. Such an agenda will help shape new work, involving institutional collaborations,teacher preparation programs, and national organizations. Such an outcome has the potential to immediately impact the work of the conference participants and their own teacher preparation programs. In the long-term, this conference provides an opportunity for the participants to consider how to use ambitious science teaching to address issues of equity and social justice in science education and schools. In addition, the broader impacts of this conference will be to spread a vision of science teaching and practice-based teacher preparation in which students' ideas and experiences are the raw material of teachers' work.

Fostering Collaborative Computer Science Learning with Intelligent Virtual Companions for Upper Elementary Students (Collaborative Research: Wiebe)

The project will provide the opportunity for upper elementary students to learn computer science and build strong collaboration practices.

Partner Organization(s): 
Award Number: 
1721000
Funding Period: 
Tue, 08/15/2017 to Sat, 07/31/2021
Full Description: 

There is growing recognition that children can, and should, learn computer science. One of the central tenets of computer science is that it is a collaborative discipline, yet children do not start out with an intrinsic ability to collaborate. The project will provide the opportunity for upper elementary students to learn computer science and build strong collaboration practices. Leveraging the promise of virtual learning companions, the project will address three thrusts. First, the project will collect datasets of collaborative learning for computer science in diverse upper elementary school classrooms. Second, the project will design, develop, and iteratively refine its intelligent virtual learning companions, which support dyads of students in a scaffolded computer science learning environment with an interactive online coding tool. Third, the project will generate research findings and evidence about how children collaborate in computer science learning, and how best to support their collaboration with intelligent virtual learning companions. There will be three families of deliverables: learning activities and professional development, an intelligent learning environment with virtual learning companions, and research evidence that furthers the state of scholarship and practice surrounding the collaborative learning of computer science. The project will situate itself in highly diverse elementary schools in two states, Durham County, North Carolina and Alachua County, Florida. This project is supported by the Discovery Research PreK-12 program, which funds research and development of STEM innovations and approaches.

The project addresses the research question, "How can we support upper elementary-school students in computer science learning and collaboration using intelligent virtual learning companions?" The initial dataset will provide a ground-truth measure of students' collaboration approaches to classroom computer science learning tasks through instrumenting computer labs in elementary schools for collecting dialogue and problem-solving activity. The project will collect triangulating qualitative data to better understand impactful classroom dynamics around dyadic learning of computer science. The technical innovation of the project is the way in which student dyads are supported: each pair of children within the elementary school classroom will interact with a dyad of state of-the-art intelligent virtual learning companions. These companions will enhance the classroom experience by adapting in real time to the students' patterns of collaboration and problem solving to provide tailored support specifically for that pair of students. The virtual learning companions will model crucial dimensions of healthy collaboration through their dialogue with one another, including self-explanation, question generation, attributing challenges to the task and not to deficits in each other, and establishing common ground through uptake of ideas. The project will compare outcomes of computer science learning as measured in two ways: individual pre-test to post-test, and quality of collaboratively produced solutions. The project team will measure collaborative practices through dialogue analysis for the target collaboration strategies, as well as interest and self-efficacy for computer science. The project will utilize a multilevel model design to study the effect of the virtual learning companions on student outcomes. Using speech, dialogue transcripts, code artifact analysis, and multimodal analysis of gesture and facial expression, the team will conduct sequential analyses that identify the virtual learning companion interactions that are particularly beneficial for students, and focus our development efforts on expanding and refining those interactions. They will also identify the affordances that students did not engage with and determine whether to eliminate or re-cast them. The analytics of collaborative process data will once again be augmented with qualitative classroom data from field notes, focus groups, and semi-structured interviews with students and teachers. The themes that emerge will guide subsequent refinement of the environment and learning activities.

BioGraph 2.0: Online Professional Development for High School Biology Teachers for Teaching and Learning About Complex Systems

This proposal will develop and test an open-access, online system of professional development for high school biology teachers in order to build pedagogical competencies for teaching about complex systems and to support the application of those competencies in high school biology classrooms.

Lead Organization(s): 
Award Number: 
1721003
Funding Period: 
Fri, 09/01/2017 to Sat, 08/31/2019
Full Description: 

This proposal will develop and test an open-access, online system of professional development for high school biology teachers in order to build pedagogical competencies for teaching about complex systems and to support the application of those competencies in high school biology classrooms. The online teacher professional development (PD) will be delivered through the edX open access platform.

This research project will include two cycles of design and development of the professional development experience. It will include mixed methods and a longitudinal examination of teacher and student learning fostered by professional development. The research for the first phase will be qualitative in nature and will result in a series of case studies that highlight different facets of the interactions that influence teachers' learning. Following this qualitative phase, through a field study that employs multivariate analysis of covariance and hierarchical linear models analytical techniques, the effectiveness of the design and development stages will be compared to an alternative professional development experience that is similar to the project's professional development but does not include collaborative design. The broad aim is to develop and test an open-access, online system of professional development (PD) that includes solutions for known challenges in teacher online PD. The project builds on a prior NSF-funded exploratory project. The project will employ a randomized control trial to assess the effectiveness of PD on improving teacher content knowledge and skills, changes in classroom practices and instruction, curriculum engagement by students and student achievement outcomes with an end goal to understand better what facilitates online PD and to create a low cost scalable and online version of the original NSF-funded BioGraph. This research will produce insights and guidelines that can immediately be incorporated into the emerging field of online professional development, and online education in general. The content goals are to build pedagogical competencies for teaching about complex systems and to support the application of those competencies in high school biology classrooms.

Pages

Subscribe to Urban