Urban

Enhancing Teacher and Student Understanding of Engineering in K-5 Bilingual Programs

This mixed-method exploratory study will examine how bilingual teachers working in elementary schools in Massachusetts and Puerto Rico understand the role and skills of engineers in society. In turn, it will examine how teachers adapt existing engineering lessons so that those activities and concepts are more culturally and linguistically accessible to their students.

Lead Organization(s): 
Award Number: 
1814258
Funding Period: 
Mon, 10/01/2018 to Thu, 09/30/2021
Full Description: 

Engineering is part of everyone's local community and daily activities yet opportunities to learn about engineering are often absent from elementary school classrooms. Further, little is known about how teachers' and students' conceptions of engineering relate to aspects of their local community such as language and culture. Knowing more about this is important because students' perceptions of mismatch between their personal culture and the engineering field contributes to the continued underrepresentation of minorities in the profession. This mixed-method exploratory study will examine how bilingual teachers working in elementary schools in Massachusetts and Puerto Rico understand the role and skills of engineers in society. In turn, it will examine how teachers adapt existing engineering lessons so that those activities and concepts are more culturally and linguistically accessible to their students.

Consistent with the aims of the DRK-12 program, this project will advance understanding of how engineering education materials can be adapted to the characteristics of teachers, students, and the communities that they reside in. Further, its focus on bilingual classrooms will bring new perspectives to characterizations of the engineering field and its role in different cultures and societies. Over a three-year period, the team will investigate these issues by collecting data from 24 teachers (12 from each location). Data will be collected via surveys, interviews, discussion of instructional examples, videos of teachers' classroom instruction and analysis of artifacts such as teachers' lesson plans. Teachers will collaborate and function as a professional co-learning community called instructional rounds by participating and providing feedback synchronously in face-to-face settings and via the use of digital apps. Project findings can lead to teaching guidelines, practices, and briefs that inform efforts to successfully integrate bilingual engineering curriculum at the elementary grades. This work also has the potential to create professional development models of success for K-5 teachers in bilingual programs and enhance engineering teaching strategies and methods at these early grade levels.

Engaging High School Students in Computer Science with Co-Creative Learning Companions (Collaborative Research: Magerko)

This research investigates how state-of-the-art creative and pedagogical agents can improve students' learning, attitudes, and engagement with computer science. The project will be conducted in high school classrooms using EarSketch, an online computer science learning environments that engages learners in making music with JavaScript or Python code.

Award Number: 
1814083
Funding Period: 
Sat, 09/15/2018 to Wed, 08/31/2022
Full Description: 
This research investigates how state-of-the-art creative and pedagogical agents can improve students' learning, attitudes, and engagement with computer science. The project will be conducted in high school classrooms using EarSketch, an online computer science learning environments that engages over 160,000 learners worldwide in making music with JavaScript or Python code. The researchers will build the first co-creative learning companion, Cai, that will scaffold students with pedagogical strategies that include making use of learner code to illustrate abstraction and modularity, suggesting new code to scaffold new concepts, providing help and hints, and explaining its decisions. This work will directly address the national need to develop computing literacy as a core STEM skill.
 
The proposed work brings together an experienced interdisciplinary team to investigate the hypothesis that adding a co-creative learning companion to an expressive computer science learning environment will improve students' computer science learning (as measured by code sophistication and concept knowledge), positive attitudes towards computing (self-efficacy and motivation), and engagement (focused attention and involvement during learning). The iterative design and development of the co-creative learning companion will be based on studies of human collaboration in EarSketch classrooms, the findings in the co-creative literature and virtual agents research, and the researchers' observations of EarSketch use in classrooms. This work will address the following research questions: 1) What are the foundational pedagogical moves that a co-creative learning companion for expressive programming should perform?; 2) What educational strategies for a co-creative learning companion most effectively scaffold learning, favorable attitudes toward computing, and engagement?; and 3) In what ways does a co-creative learning companion in EarSketch increase computer science learning, engagement, and positive attitudes toward computer science when deployed within the sociocultural context of a high school classroom? The proposed research has the potential to transform our understanding of how to support student learning in and broaden participation through expressive computing environments.

Understanding the Role of Simulations in K-12 Science and Mathematics Teacher Education

This project will develop and implement a working conference for scholars and practitioners to articulate current use cases and theories of action regarding the use of simulations in PreK-12 science and mathematics teacher education. The conference will be structured to provide opportunities for attendees to share their current research, theoretical models, conceptual views, and use cases focused on the design and use of digital and non-digital simulations for building and assessing K-12 science and mathematics teacher competencies.

Lead Organization(s): 
Award Number: 
1813476
Funding Period: 
Sat, 09/01/2018 to Sat, 08/31/2019
Full Description: 

The recent emergence of updated learning standards in science and mathematics, coupled with increasingly diverse school students across the nation, has highlighted the importance of updating professional learning opportunities for science and mathematics teachers. One promising approach that has emerged is the use of simulations to engage teachers in approximations of practice where the focus is on helping them learn how to engage in ambitious content teaching. In particular, recent technological advances have supported the emergence of new kinds of digital simulations and have brought increased attention to simulations as a tool to enhance teacher learning. This project will develop and implement a working conference for scholars and practitioners to articulate current use cases and theories of action regarding the use of simulations in PreK-12 science and mathematics teacher education. The conference will be structured to provide opportunities for attendees to share their current research, theoretical models, conceptual views, and use cases focused on the design and use of digital and non-digital simulations for building and assessing K-12 science and mathematics teacher competencies.

While the use of simulations in teacher education is neither new nor limited to digital simulation, emerging technological capabilities have enabled digital simulations to become practical in ways not formerly available. The current literature base, however, is dated and the field lacks clear theoretic models or articulated theories of action regarding what teachers could or should learn via simulations, and the essential components of effective learning trajectories. This working conference will be structured to provide opportunities for attending, teacher educators, researchers, professional development facilitators, policy makers, preservice and inservice teachers, and school district leaders to share their current research, theoretical models, conceptual views, and use cases regarding the role of simulations in K-12 science and mathematics teacher education. The conference will be organized around four major goals, including: (1) Define how simulations (digital and non-digital) are conceptualized, operationalized, and utilized in K-12 science and mathematics teacher education; (2) Document and determine the challenges and affordances of the varied contexts, audiences, and purposes for which simulations are used in K-12 science and mathematics teacher education and the variety of investigation methods and research questions employed to investigate the use of simulations in these settings; (3) Make explicit the theories of action and conceptual views undergirding the various simulation models being used in K-12 science and mathematics teacher education; and (4) Determine implications of the current research and development work in this space and establish an agenda for studying the use of simulations in K-12 science and mathematics teacher education. The project will produce a white paper that presents the research and development agenda developed by the working conference, describes a series of use cases describing current and emergent practice, and identifies promising directions for future research and development in this area. Conference outcomes are expected to advance understanding of the varied ways in which digital and non-digital simulations can be used to foster and assess K-12 science and mathematics teacher competencies and initiate a research and development agenda for examining the role of simulations in K-12 science and mathematics teacher education.


Project Videos

2019 STEM for All Video Showcase

Title: Understanding the Role of Simulations in Teacher Preparation

Presenter(s): Lisa Dieker, Angelica Fulchini Scruggs, Heather Howell, Michael Hynes, & Jamie Mikeska


Design and Development of a K-12 STEM Observation Protocol (Collaborative Research: Roehrig)

This project will design and develop a new K-12 classroom observation protocol for integrated STEM instruction (STEM-OP). The STEM-OP will inform the instruction of integrated STEM in many contexts with the goal of improving integrated STEM education.

Award Number: 
1813342
Funding Period: 
Sat, 09/01/2018 to Wed, 08/31/2022
Full Description: 

This project will design and develop a new K-12 classroom observation protocol for integrated STEM instruction (STEM-OP). The STEM-OP will be developed for use in K-12 STEM settings. While the importance of integrated STEM education is established, there remains disagreement on models and effective approaches for integrated STEM instruction. This issue is confounded by the lack of observation protocols sensitive to integrated STEM teaching and learning to inform research to the effectiveness of new models and strategies. Existing instruments were not developed for use in integrated STEM learning environments. The STEM-OP will be designed to be used effectively by multiple stakeholders in a variety of contexts. Researchers will benefit from having the STEM-OP available for them to carry out research and continue to improve STEM education in a variety of ways. Existing instruments were not developed for use in integrated STEM learning environments.  The STEM-OP and associated training materials will be available for use by other education stakeholders, such as K-12 teachers and district administrators, through a publicly available online platform. In brief, the STEM-OP will inform the instruction of integrated STEM in many contexts with the goal of improving integrated STEM education.

The primary product of this project is the new observation protocol called STEM-OP for K-12 classrooms implementing integrated STEM lessons. The project will use over 500 integrated STEM classroom videos to design the STEM-OP. Using exploratory and confirmatory factor analysis, the STEM-OP will be a valid and reliable instrument for use in a variety of educational contexts. The research will explore the different ways that elementary, middle, and high school science teachers enact integrated STEM instruction. This study will shed light on the nature of STEM instruction in each of these grade bands and provide information building towards an understanding of learning progressions for engineering practices across grade bands. Research exploring how the nature of STEM integration changes from day to day over the course of a unit will provide critical information about the different sequencing and trajectories of STEM units. Examining how integrated STEM instruction unfolds over a full unit of instruction will inform the understanding of integrated STEM practices at both micro- and macro- levels of analysis. The STEM-OP and associated training materials will be available for use by other education stakeholders, such as K-12 teachers and district administrators, through a publicly available, which will be distributed via a publicly available, online platform that includes a training manual and classroom video for practice scoring.

Design and Development of a K-12 STEM Observation Protocol (Collaborative Research: Dare)

This project will design and develop a new K-12 classroom observation protocol for integrated STEM instruction (STEM-OP). The STEM-OP will inform the instruction of integrated STEM in many contexts with the goal of improving integrated STEM education.

Lead Organization(s): 
Award Number: 
1854801
Funding Period: 
Sat, 09/01/2018 to Wed, 08/31/2022
Full Description: 

This project will design and develop a new K-12 classroom observation protocol for integrated STEM instruction (STEM-OP). The STEM-OP will be developed for use in K-12 STEM settings. While the importance of integrated STEM education is established, there remains disagreement on models and effective approaches for integrated STEM instruction. This issue is confounded by the lack of observation protocols sensitive to integrated STEM teaching and learning to inform research to the effectiveness of new models and strategies. Existing instruments were not developed for use in integrated STEM learning environments. The STEM-OP will be designed to be used effectively by multiple stakeholders in a variety of contexts. Researchers will benefit from having the STEM-OP available for them to carry out research and continue to improve STEM education in a variety of ways. Existing instruments were not developed for use in integrated STEM learning environments.  The STEM-OP and associated training materials will be available for use by other education stakeholders, such as K-12 teachers and district administrators, through a publicly available online platform. In brief, the STEM-OP will inform the instruction of integrated STEM in many contexts with the goal of improving integrated STEM education.

The primary product of this project is the new observation protocol called STEM-OP for K-12 classrooms implementing integrated STEM lessons. The project will use over 500 integrated STEM classroom videos to design the STEM-OP. Using exploratory and confirmatory factor analysis, the STEM-OP will be a valid and reliable instrument for use in a variety of educational contexts. The research will explore the different ways that elementary, middle, and high school science teachers enact integrated STEM instruction. This study will shed light on the nature of STEM instruction in each of these grade bands and provide information building towards an understanding of learning progressions for engineering practices across grade bands. Research exploring how the nature of STEM integration changes from day to day over the course of a unit will provide critical information about the different sequencing and trajectories of STEM units. Examining how integrated STEM instruction unfolds over a full unit of instruction will inform the understanding of integrated STEM practices at both micro- and macro- levels of analysis. The STEM-OP and associated training materials will be available for use by other education stakeholders, such as K-12 teachers and district administrators, through a publicly available, which will be distributed via a publicly available, online platform that includes a training manual and classroom video for practice scoring.

Design and Development of a K-12 STEM Observation Protocol (Collaborative Research: Ring-Whalen)

This project will design and develop a new K-12 classroom observation protocol for integrated STEM instruction (STEM-OP). The STEM-OP will inform the instruction of integrated STEM in many contexts with the goal of improving integrated STEM education.

Lead Organization(s): 
Award Number: 
1812794
Funding Period: 
Sat, 09/01/2018 to Wed, 08/31/2022
Full Description: 

This project will design and develop a new K-12 classroom observation protocol for integrated STEM instruction (STEM-OP). The STEM-OP will be developed for use in K-12 STEM settings. While the importance of integrated STEM education is established, there remains disagreement on models and effective approaches for integrated STEM instruction. This issue is confounded by the lack of observation protocols sensitive to integrated STEM teaching and learning to inform research to the effectiveness of new models and strategies. Existing instruments were not developed for use in integrated STEM learning environments. The STEM-OP will be designed to be used effectively by multiple stakeholders in a variety of contexts. Researchers will benefit from having the STEM-OP available for them to carry out research and continue to improve STEM education in a variety of ways. Existing instruments were not developed for use in integrated STEM learning environments.  The STEM-OP and associated training materials will be available for use by other education stakeholders, such as K-12 teachers and district administrators, through a publicly available online platform. In brief, the STEM-OP will inform the instruction of integrated STEM in many contexts with the goal of improving integrated STEM education.

The primary product of this project is the new observation protocol called STEM-OP for K-12 classrooms implementing integrated STEM lessons. The project will use over 500 integrated STEM classroom videos to design the STEM-OP. Using exploratory and confirmatory factor analysis, the STEM-OP will be a valid and reliable instrument for use in a variety of educational contexts. The research will explore the different ways that elementary, middle, and high school science teachers enact integrated STEM instruction. This study will shed light on the nature of STEM instruction in each of these grade bands and provide information building towards an understanding of learning progressions for engineering practices across grade bands. Research exploring how the nature of STEM integration changes from day to day over the course of a unit will provide critical information about the different sequencing and trajectories of STEM units. Examining how integrated STEM instruction unfolds over a full unit of instruction will inform the understanding of integrated STEM practices at both micro- and macro- levels of analysis. The STEM-OP and associated training materials will be available for use by other education stakeholders, such as K-12 teachers and district administrators, through a publicly available, which will be distributed via a publicly available, online platform that includes a training manual and classroom video for practice scoring.

Methods for Assessing Replication

The goal of this project is to formalize subjective ideas about the important concept of replication, provide statistical analyses for evaluating replication studies, provide properties for evaluating the conclusiveness of replication studies, and provide principles for designing conclusive and efficient programs of replication studies.

Lead Organization(s): 
Award Number: 
1841075
Funding Period: 
Sat, 09/01/2018 to Tue, 08/31/2021
Full Description: 

Replication of prior findings and results is a fundamental feature of science and is part of the logic supporting the claim that science is self-correcting. However, there is little prior research on the methodology for studying replication. Research involving meta-analysis and systematic reviews that summarizes a collection of research studies is more common. However, the question of whether the findings from a set of experimental studies replicate one another has received less attention. There is no clearly defined and widely accepted definition of a successful replication study or statistical literature providing methodological guidelines on how to design single replication studies or a set of replication studies. The research proposed here builds this much needed methodology.

The goal of this project is to formalize subjective ideas about the important concept of replication, provide statistical analyses for evaluating replication studies, provide properties for evaluating the conclusiveness of replication studies, and provide principles for designing conclusive and efficient programs of replication studies. It addresses three fundamental problems. The first is how to define replication: What, precisely, should it mean to say that the results in a collection of studies replicate one another? Second, given a definition of replication, what statistical analyses should be done to decide whether the collection of studies replicate one another and what are the properties of these analyses (e.g., sensitivity or statistical power)? Third, how should one or more replication studies be designed to provide conclusive answers to questions of replication? The project has the potential for impact on a range of empirical sciences by providing statistical tools to evaluate the replicability of experimental findings, assessing the conclusiveness of replication attempts, and developing software to help plan programs of replication studies that can provide conclusive evidence of replicability of scientific findings.

Promoting Engineering Problem Framing Skill-Development in High School Science and Engineering Courses

This project will develop curricular activities and assessment guidance for K-12 science and engineering educators who seek to incorporate engineering design content into their biology, chemistry, and physics classes.

Lead Organization(s): 
Partner Organization(s): 
Award Number: 
1812823
Funding Period: 
Wed, 08/01/2018 to Sat, 07/31/2021
Full Description: 

This collaborative project involving Ohio Northern University, Ohio State University, and Olathe Northwest High School will develop curricular activities and assessment guidance for K-12 science and engineering educators who seek to incorporate engineering design content into their biology, chemistry, and physics classes. This work is important because students' limited exposure to engineering activities can negatively impact their decisions to enroll in STEM courses and to pursue engineering careers. Further, many states are adopting or considering adopting the Next Generation Science Standards (NGSS), a set of classroom standards which integrate engineering content into traditional science disciplines. While high school teachers under these standards are expected to incorporate the cross-cutting engineering content into their courses, they generally receive little high-quality support for doing so. If successful, the project could provide a powerful model of how to support busy and resource-constrained STEM teachers, and create broader student interest in STEM careers.

Drawing from best practices on instructional design, the project's main objectives are to: (1) design, field-test, and evaluate the impact of 12 NGSS-aligned, engineering problem-framing design activities on students enrolled in grades 9-12 science courses and (2) design and conduct high-quality, sustained professional development that fosters participating high school science teachers' ability to deploy the NGSS concepts-linked activities. Data sources include student design artifacts, video of classroom instruction, and surveys assessing student and teacher attitudes toward engineering, student design self-efficacy and teacher self-efficacy for teaching engineering content. These data will be analyzed to determine what teachers learned from the professional development activities, how those activities informed their teaching and in turn, how students' engagement with the engineering activities relates to their engineering design skills and attitudes. In terms of intellectual merit, the project aims to develop a learning progression of students' engineering design problem-framing skills by characterizing any observed change in students' design work and attitudes over time.

Testing the Efficacy of the Strategic Observation and Reflection (SOAR) for Math Professional Learning Program

The purpose of this project is to develop, implement and test a professional development program, SOAR for Math, to build capacity for mentors and teachers to improve English learner's academic language development and mathematical content understanding.

Award Number: 
1814356
Funding Period: 
Sat, 09/01/2018 to Wed, 08/31/2022
Full Description: 
Professional development is an important way for teachers who are currently in classrooms to learn about new best practices in mathematics teaching and learning and improve their practice. Little is known about what types of professional development (PD) and teacher mentoring programs support teachers' improved practices and ultimately lead to gains in student learning. The purpose of this project is to develop, implement and test a professional development program, SOAR for Math, to build capacity for mentors and teachers to improve English learner's academic language development and mathematical content understanding.
 
This study will test the efficacy of the Strategic Observation and Reflection (SOAR) for Math professional development program. The mixed methods study is designed to answer several research questions: (1) What is the impact of teachers' participation in SOAR for Math on student achievement outcomes for current and recent grade 3-6 English learner students in treatment schools? (2) What is the impact of SOAR for Math on treatment school teachers' knowledge and practices related to their academic language and literacy development instruction for current and recent English learner students, specifically scores on the Knowledge/Use Scale? (3) What is the impact of SOAR for Math on treatment mentors' knowledge and practices related to their academic language and math instruction? A randomized controlled trial will be conducted in 80 elementary schools in one California school district. Schools serving third- through sixth-grade general education students will be eligible to participate. The research team will randomly assign 40 schools to provide SOAR for Math training to mentor teachers and 40 schools to comprise a control group receiving business-as-usual professional development. Two mentors per school will participate in the study. Measures will include state math scores and a variety of observations and questionnaires to assess fidelity of implementation. Data will be analyzed using hierarchical linear modeling to account for the nested data structure.

Development and Validation of a Mobile, Web-based Coaching Tool to Improve PreK Classroom Practices to Enhance Learning

This project will promote pre-K teachers' use of specific teaching strategies that have been shown to enhance young children's learning and social skills. To enhance teachers' use of these practices, the project will develop a new practitioner-friendly version of the Classroom Quality Real-time Empirically-based Feedback (CQ-REF) tool for instructional coaches who work with pre-K teachers.

Lead Organization(s): 
Award Number: 
1813008
Funding Period: 
Wed, 08/01/2018 to Sun, 07/31/2022
Full Description: 

Children from low-income families often enter kindergarten academically behind their more economically affluent peers. Advancing pre-kindergarten (pre-K) teachers' ability to provide all students with high-quality early math learning experiences has potential to minimize this gap in school readiness. This project will promote pre-K teachers' use of specific teaching strategies, such as spending more time on math content and listening to children during instructional activities, that have been shown to enhance young children's learning and social skills. To enhance teachers' use of these practices, the project takes a novel approach--a mobile website that helps instructional coaches who work with pre-K teachers. The Classroom Quality Real-time Empirically-based Feedback tool (CQ-REF) will guide coaches' ability to observe specific teacher practices in their classrooms and then provide feedback to help teachers evaluate their practices and set goals for improvement.  Practically, the CQ-REF addresses the need for accessible, real-time feedback on high quality pre-K classroom teaching.

This project focuses on developing a new practitioner-friendly version of the CQ-REF, originally designed as a research tool for evaluating the quality of classroom teaching, for use by coaches and teachers. At the beginning of the four-year project, the team will collect examples of high-quality classroom teaching and coaching strategies. These will be used to create a library of video and other materials that teachers and coaches can use to establish a shared definition of what effective pre-K teaching looks like. In year three of the project, the team will pilot the CQ-REF with a diverse range of pre-K teachers and their coaches to determine the tool's usability and relevance. In this validation study coaches will be randomly assigned to either use the CQ-REF tool or coach in their usual manner. After one year, the CQ-REF's impact on teacher practices and student outcomes will be assessed. Outcomes of interest include teacher and student classroom behavior and children's executive function and ability in mathematics, literacy and science. Concurrently, an external evaluation team will examine how the coaching is being conducted and used, and participants' impressions of the coaching process. In the fourth and final year, the team will focus on refining the tool based on results from prior work and on disseminating the findings to research and practitioner audiences.

Pages

Subscribe to Urban