Teacher Attitudes/Beliefs

Analysis of Effective Science Coaching: What, Why and How

This project will conduct an in-depth analysis of instructional coaching by analyzing archived video-recorded coaching sessions with middle and high school science teachers. The goal of the project is to analyzing the videos and previously collected quantitative outcome data to create descriptive profiles of instructional coaching and identify which key coaching elements lead to desired teacher and student outcomes.

Lead Organization(s): 
Award Number: 
1621308
Funding Period: 
Sat, 10/01/2016 to Mon, 09/30/2019
Full Description: 

This Exploratory project will conduct an in-depth analysis of instructional coaching by analyzing 520 hours of archived video-recorded coaching sessions with 75 middle and high school science teachers in grades 6-12 collected in a U.S. Department of Education IES-funded coaching research study. The goal of the project is to "unpack" the coaching intervention by analyzing the videos and previously collected quantitative outcome data to (a) create descriptive profiles of instructional coaching and (b) identify which key coaching elements ("active ingredients") lead to desired teacher and student outcomes.

Following a design-based research approach, relying on iterative feedback and using data saturation process to analyze data, the project will translate theorized, conceptual characteristics of coaching into empirical models to guide future coaching research and practical guidance through identification of critical elements needed for coaching to work.

Learning Evolution through Human and Non-Human Case Studies

This project will develop and test two curriculum units on the topic of evolution for high school general biology courses, with one unit focusing primarily on human case studies to teach evolution and one unit focusing primarily on case studies of evolution in other species. The two units will be compared to examine how different approaches to teaching evolution affect students and teachers.

Lead Organization(s): 
Award Number: 
1621194
Funding Period: 
Thu, 09/15/2016 to Tue, 08/31/2021
Full Description: 

This project aligns with Alabama's College & Career-Ready Standards (CCRS) for biology in grades 9-12 relating to Unity and Diversity. These standards are based on the Next Generation Science Standards (NGSS) and go into effect during the 2016-2017 school year. Building on prior work (DRL-119468), this project will develop and test two curriculum units on the topic of evolution for high school general biology courses, with one unit focusing primarily on human case studies to teach evolution and one unit focusing primarily on case studies of evolution in other species. The two units will be compared to examine how different approaches to teaching evolution affect students and teachers. The project will also develop and field test a Cultural and Religious Sensitivity (CRS) Resource to provide teachers with strategies for creating supportive learning environments where understanding of the scientific account of evolution is aided while also acknowledging the cultural controversy associated with learning about evolution. The impacts on student and teacher outcomes of using the curriculum units and the CRS Resource will be tested in classrooms by comparing the outcomes of the human versus non-human units, and by using or not using classroom strategies from the CRS Resource.

The project will examine student and teacher outcomes of four treatment groups: 1) Curriculum Unit 1, 2) Curriculum Unit 1 with the CRS Resource, 3) Curriculum Unit 2, and 4) Curriculum Unit 2 with the CRS Resource. The research questions are: 1) In what ways does using examples of human versus non-human evolution to teach core evolutionary concepts affect understanding of, acceptance of, and motivation to learn about evolution among high school introductory biology students? 2) In what ways do using teaching strategies that focus on acknowledging the cultural controversy about evolution using a procedural neutrality approach affect high school introductory biology teachers' comfort and confidence with teaching evolution? 3) In what ways does using examples of human versus non-human evolution to teach fundamental evolutionary concepts in conjunction with teaching strategies that focus on acknowledging the cultural controversy about evolution using a procedural neutrality approach affect understanding of, acceptance of, and motivation to learn about evolution among high school introductory biology students? And 4) In what ways does using examples of human versus non-human evolution to teach fundamental evolutionary concepts in conjunction with teaching strategies that focus on acknowledging the cultural controversy about evolution using a procedural neutrality approach affect high school introductory biology teachers' comfort and confidence with teaching evolution? The project will use a 2 X 2 X 2 mixed factorial quasi-experimental research design to answer these questions, and will include a total of 32 teachers, 8 in each treatment group, along with approximately 800 students. Each assessment will be administered as a pretest two weeks prior to starting the curriculum unit and as a posttest immediately after completing the unit. Test scores will be the within-subjects factors, and Curriculum Unit and CRS Resource will be the between-subjects factors.

Modest Supports for Sustaining Professional Development Outcomes over the Long-Term

This study will investigate factors influencing the persistence of teacher change after professional development (PD) experiences, and will examine the extent to which modest supports for science teaching in grades K-5 sustain PD outcomes over the long term.

Lead Organization(s): 
Award Number: 
1620979
Funding Period: 
Thu, 09/15/2016 to Mon, 08/31/2020
Full Description: 

This study will investigate factors influencing the persistence of teacher change after professional development (PD) experiences, and will examine the extent to which modest supports for science teaching in grades K-5 sustain PD outcomes over the long term. Fifty K-12 teachers who completed one of four PD programs situated in small, rural school districts will be recruited for the study, and they will participate in summer refresher sessions for two days, cluster meetings at local schools twice during the academic year, and optional Webinar sessions two times per year. Electronic supports for participants will include a dedicated email address, a project Facebook page, a biweekly newsletter, and access to archived Webinars on a range of topics related to teaching elementary school science. Modest support for replacement of consumable supplies needed for hands-on classroom activities will also be provided. The project will examine the extent to which these modest supports individually and collectively foster the sustainability of PD outcomes in terms of the instructional time devoted to science, teacher self-efficacy in science, and teacher use of inquiry-based instructional strategies. The effects of contextual factors on sustainability of PD outcomes will also be examined.

This longitudinal study will seek answers to three research questions: 1) To what extent do modest supports foster the sustainability of professional development outcomes in: a) instructional time in science; b) teachers' self-efficacy in science; and c) teachers' use of inquiry-based instructional strategies? 2) Which supports are: a) the most critical for sustainability of outcomes; and b) the most cost-effective; and 3) What contextual factors support or impede the sustainability of professional development outcomes? The project will employ a mixed-methods research design to examine the effects of PD in science among elementary schoolteachers over a 10 to 12 year period that includes a 3-year PD program, a 4-6 year span after the initial PD program, and a 3-year intervention of modest supports. Quantitative and qualitative data will be collected from multiple sources, including: a general survey of participating teachers regarding their beliefs about science, their instructional practices, and their instructional time in science; a teacher self-efficacy measure; intervention feedback surveys; electronic data sources associated with Webinars; teacher interviews; school administrator interviews; and receipts for purchases of classroom supplies. Quantitative data from the teacher survey and self-efficacy measure will be analyzed using hierarchical modeling to examine growth rates after the original PD and the change in growth after the provision of modest supports. Data gathered from other sources will be tracked, coded, and analyzed for each teacher, and linked to the survey and self-efficacy data for analysis by individual teacher, by grade level, by school, by district, and by original PD experience. Together, these data will enable the project team to address the project's research questions, with particular emphasis on determining the extent to which teachers make use of the various supports offered, and identifying the most cost-effective and critical supports.

Supporting Instructional Growth in Mathematics: Enhancing Urban Secondary Teachers' Professional Learning through Formative Feedback

This project will explore the potential of video-based formative feedback to enhance professional development around ambitious instruction for secondary teachers in urban schools.

Lead Organization(s): 
Award Number: 
1620920
Funding Period: 
Thu, 09/15/2016 to Mon, 08/31/2020
Full Description: 

Research continues to show the benefits of ambitious instruction for student learning of mathematics, yet ambitious instruction continues to be rare in U.S. schools, particularly in schools that serve historically marginalized students. Secondary teachers' learning and enactment of ambitious instruction in mathematics requires conceptual change, and their development could benefit from adequate and timely feedback close to classroom instruction. For this reason, the project will explore the potential of video-based formative feedback to enhance professional development. The focus of the partnership between university researchers and a well-regarded professional development organization, Math for America Los Angeles (MfA LA) will be on career-long learning of secondary mathematics teachers in urban schools. Results from this project will provide a theory of mathematics teachers' learning that can inform other instructional improvement efforts, with ecological validity in the critical site of urban schools. The framework and theory will be detailed at the level of specific tools and concrete practices that are learnable by teachers, school leaders, or instructional coaches. This project is funded by the Discovery Research Pre-K-12 Program, which funds research and development of STEM innovations and approaches in assessment, teaching and learning.

The question the project will address is: How can the project use formative feedback to enhance mathematics teachers' professional learning environments that support their development of ambitious instruction in urban schools? Formative feedback refers to tools and processes that ascertain teachers' current understandings and responsively adapt learning activities to better guide them toward their learning goals. Professional learning environments refer to the multiple sites of teachers' learning, from formal professional development activities to their school workplace. Ambitious instruction is defined as teaching approaches that aim to provide all students with ample opportunities to develop conceptual understanding of key mathematical ideas, participate in mathematical argumentation, connect multiple mathematical representations, as well as become fluent with mathematical procedures and processes. The persistence of typical mathematics instruction is framed as, in large part, an issue of teacher learning. Using design-based implementation research and interpretive methods, the project team will co-develop video-based formative assessment processes to guide teachers' evolving classroom practice.

An Online STEM Career Exploration and Readiness Environment for Opportunity Youth

This project aims to create a web-based STEM Career Exploration and Readiness Environment (CEE-STEM) that will support opportunities for youth ages 16-24 who are neither in school nor are working, in rebuilding engagement in STEM learning and developing STEM skills and capacities relevant to diverse postsecondary education/training and employment pathways.

Award Number: 
1620904
Funding Period: 
Thu, 09/15/2016 to Mon, 08/31/2020
Full Description: 

CAST, the University of Massachusetts-Amherst, and YouthBuild USA aim to create a web-based STEM Career Exploration and Readiness Environment (CEE-STEM). This will support opportunities for youth ages 16-24 who are neither in school nor are working, in rebuilding engagement in STEM learning and developing STEM skills and capacities relevant to diverse postsecondary education/training and employment pathways. The program will provide opportunity youth with a personalized and portable tool to explore STEM careers, demonstrate their STEM learning, reflect on STEM career interests, and take actions to move ahead with STEM career pathways of interest.

The proposed program addresses two critical and interrelated aspects of STEM learning for opportunity youth: the development of STEM foundational knowledge; and STEM engagement, readiness and career pathways. These aspects of STEM learning are addressed through an integrated program model that includes classroom STEM instruction; hands-on job training in career pathways including green construction, health care, and technology.


Project Videos

2019 STEM for All Video Showcase

Title: Building a Diverse STEM Talent Pipeline: Finding What Works

Presenter(s): Tracey Hall

2018 STEM for All Video Showcase

Title: Bridging the Gap Between Ability and Opportunity in STEM

Presenter(s): Sam Johnston


Improving the Implementation of Rigorous Instructional Materials in Middle Grades Mathematics: Developing a System of Practical Measures and Routines (Collaborative Research: Ahn)

The goal of this project is to improve the implementation of rigorous instructional materials in middle-grades mathematics at scale through a system of practical measures and routines for collecting and using data that both assesses and supports implementation.

Award Number: 
1911492
Funding Period: 
Sat, 10/01/2016 to Thu, 09/30/2021
Full Description: 

The goal of this 5-year research project is to improve the implementation of rigorous instructional materials in middle-grades mathematics at scale. Many projects seek to improve mathematics instruction, but are not able to easily track their efforts at improvement. The primary product of this project will be a system of practical measures and routines for collecting and using data that both assesses and supports the implementation of rigorous instructional materials in middle-grades mathematics. In contrast to research and accountability measures, practical measures are assessments that require little time to administer and can thus be used frequently. The data can be analyzed rapidly so that teachers can receive prompt feedback on their progress, and instructional leaders can use the data to decide where to target resources to support improvement in the quality of instruction and student learning. The system of practical measures and routines will include 1) measures of high-leverage aspects of teachers' instructional practices that have been linked to student learning (e.g., rigor of tasks, quality of students' discourse) and attend to equitable student participation; and 2) measures of high-leverage aspects of key supports for improving the quality of teachers' practice (e.g., quality of professional development; coaching); and 3) a set of routines regarding how to use the resulting data to engage in rapid, improvement efforts. A key principle of the proposed project is that the system of measures and routines can be adapted to a wide range of school and district contexts. This project is supported by the Discovery Research preK-12 (DRK-12) program. The DRK-12 program supports research and development of STEM education innovations and approaches in assessment, learning, and teaching.

The project will establish three research-practice partnerships with five districts, in three different states, that are currently implementing rigorous instructional materials in middle-grades mathematics. Year 1 will focus on the development of a set of practical measures of classroom instruction. Year 2 will focus on testing the use of the classroom measures in the context of supports for teachers' learning, and the development of practical measures of key supports for teachers' learning. Years 3-4 will focus on how the project can "learn our way to scale" (Bryk et al., 2015), which requires strategically implementing measures and routines in increasingly diverse conditions. The project will engage in rapid improvement cycles in which researchers will work alongside district leaders and professional development (PD) facilitators to analyze the data from the measures of both classroom instruction and the quality of support for teacher learning to test the effectiveness of improvements in intended supports for teacher learning and to adjust the design of the support based on data. Across Years 1-4, the project will use recent developments in technology and information visualization to test and improve 1) the collection of practical measures in situ and 2) the design of data representations (or visualizations) that support teachers and leaders to make instructional improvement decisions. In Year 5, the project will conduct formal analyses of the relations between supports for teachers' learning; teachers' knowledge and classroom practices; and student learning.

This project was previously funded under award #1620900 and 1719744.

 

CAREER: Multilevel Mediation Models to Study the Impact of Teacher Development on Student Achievement in Mathematics

This project will develop a comprehensive framework to inform and guide the analytic design of teacher professional development studies in mathematics. An essential goal of the research is to advance a science of teaching and learning in ways that traverse both research and education.

Lead Organization(s): 
Award Number: 
1552535
Funding Period: 
Thu, 09/01/2016 to Tue, 08/31/2021
Full Description: 

This is a Faculty Early Career Development Program (CAREER) project. The CAREER program is a National Science Foundation-wide activity that offers the most prestigious awards in support of junior faculty who exemplify the role of teacher-scholars through outstanding research, excellent education and the integration of education and research. The intellectual merit and broader impacts of this study lie in two complementary contributions of the project. First, the development of the statistical framework for the design of multilevel mediation studies has significant potential for broad impact because it develops a core platform that is transferable to other STEM (science, technology, engineering, and mathematics) education areas and STEM disciplines. Second, the development of software and curricular materials to implement this framework further capitalize on the promise of this work because it distributes the results in an accessible manner to diverse sets of research and practitioner groups across STEM education areas and STEM disciplines. Together, the components of this project will substantially expand the scope and quality of evidence generated through mathematics professional development and, more generally, multilevel mediation studies throughout STEM areas by increasing researchers' capacity to design valid and comprehensive studies of the theories of action and change that underlie research programs.

This project will develop a comprehensive framework to inform and guide the analytic design of teacher professional development studies in mathematics. The proposed framework incorporates four integrated research and education components: (1) develop statistical formulas and tools to guide the optimal design of experimental and non-experimental multilevel mediation studies in the presence of measurement error, (2) develop empirical estimates of the parameters needed to implement these formulas to design teacher development studies in mathematics, (3) develop free and accessible software to execute this framework, and (4) develop training materials and conduct workshops on the framework to improve the capacity of the field to design effective and efficient studies of teacher development. An essential goal of the research is to advance a science of teaching and learning in ways that traverse both research and education.

Science, Technology, Engineering and Mathematics Scholars Teacher Academy Resident System

This project will investigate the effectiveness of a teacher academy resident model to recruit, license, induct, employ, and retain middle school and secondary teachers for high-need schools in the South. It will prepare new, highly-qualified science and mathematics teachers from historically Black universities in high-needs urban and rural schools with the goal of increasing teacher retention and diversity rates.

Lead Organization(s): 
Award Number: 
1621325
Funding Period: 
Fri, 07/15/2016 to Wed, 06/30/2021
Full Description: 

This project at Jackson State University will investigate the effectiveness of a teacher academy resident model to recruit, license, induct, employ, and retain middle school and secondary science and mathematics teachers for high-need schools in the South. It will prepare new, highly-qualified science and mathematics teachers from historically Black universities in high-needs urban and rural schools. The project involves a partnership among three historically Black universities (Jackson, State University, Xavier University of Louisiana, and the University of Arkansas at Pine Bluff), and diverse urban and rural school districts in Jackson, Mississippi; New Orleans, Louisiana; and Pine Bluff Arkansas region that serve more than 175,000 students.

Participants will include 150 middle and secondary school teacher residents who will gain clinical mentored experience and develop familiarity with local schools. The 150 teacher residents supported by the program to National Board certification will obtain: state licensure/certification in science teaching, a master's degree, and initiation. The goal is to increase teacher retention and diversity rates. The research question guiding this focus is: Will training STEM graduates have a significant effect on the quality of K-12 instruction, teacher efficacy and satisfaction, STEM teacher retention, and students? Science and mathematics achievement? A quasi-experimental design will be used to evaluate project's effectiveness.

Supporting Teacher Practice to Facilitate and Assess Oral Scientific Argumentation: Embedding a Real-Time Assessment of Speaking and Listening into an Argumentation-Rich Curriculum (Collaborative Research: Greenwald)

The fundamental purpose of this project is to support teacher practice and professional learning around oral scientific argumentation in order to improve the quality of this practice in classrooms. The key outcome of this work will be a research-informed and field-tested prototype to improve the quality of teaching and learning argumentation in middle school science classrooms usable in different learning environments.

Partner Organization(s): 
Award Number: 
1621441
Funding Period: 
Thu, 09/01/2016 to Mon, 08/31/2020
Full Description: 

This is an early-stage design and development collaborative study submitted to the assessment strand of the Discovery Research PreK-12 (DRK-12) program, in response to Program Solicitation NSF 15-592. The fundamental purpose of this project is to support teacher practice and professional learning around oral scientific argumentation in order to improve the quality of this practice in classrooms. To achieve this purpose, the project will examine the validity of a new technology-based formative assessment tool for classroom argumentation--"Diagnosing the Argumentation Levels of Groups" (DiALoG)--for which psychometric validation work has been conducted in a laboratory setting. The DiALoG assessment tool allows teachers to document classroom talk and display scores across multiple dimensions--both intrapersonal and interpersonal--for formative assessment purposes. The project will work with 6th-8th grade science teachers to monitor and support argumentation through real-time formative assessment data generated by the DiALoG instrument. DiALoG will be used in conjunction with "Amplify Science", a Lawrence Hall of Science-developed curriculum that incorporates the science practice of engaging in argument from evidence, and a suite of newly developed Responsive Mini-Lessons (RMLs), which consist of 20-30 minute instructional strategies designed to assist teachers to provide feedback to students' thinking and follow-up to argumentation episodes that the DiALoG tool identifies in need of further support. The study will allow the refinement and expansion of DiALoG and evaluation of its impact on teacher pedagogical content knowledge and formative assessment practices in widespread classroom use.

The project will address two specific research questions: (1) How can DiALoG be refined to provide a formative assessment tool for oral argumentation that is reliable, practical, and useful in middle school classrooms?; and (2) How does the use of DiALoG affect teacher formative assessment practices around evidence-based argumentation, when implementing science units designed to support oral argumentation? In order to answer these questions, the project will conduct a randomized control trial with 100 teachers: 50 will teach argumentation-focused curriculum with DiALoG, 50 will teach the same curriculum without DiALoG. Both control and treatment teachers will receive all digital and physical materials needed to teach three Amplify Science curriculum units. Treatment teachers will be provided also with the most recent version of DiALoG, including the linked RMLs, as well as support materials for using DiALoG with the Amplify curriculum. A subgroup of focus teachers (5 from the treatment group, and 5 from the control group) will be the subject of additional data collection and analysis. Three focus lessons, in which students are engaging in small-group or whole-class oral argumentation, will be selected from each of the three Amplify Science curricular units. Teacher measures for the randomized control trial will include validated instruments, such as (a) a pre- and post-assessment of teacher pedagogical content knowledge; (b) post-lesson and post-unit surveys in which teachers will self-report on their formative assessment practices; and (c) video recordings of selected lessons in the focus classrooms. In order to observe potential differences in formative assessment practices between treatment and control, protocols will be used to analyze the video recordings of focus classrooms, including (a) Reformed Teaching Observation Protocol; (b) Assessment of Scientific Argumentation inside the Classroom; and (c) Formative Assessment for Teachers and Students. The key outcome of this work will be a research-informed and field-tested prototype to improve the quality of teaching and learning argumentation in middle school science classrooms usable in different learning environments.

Supporting Teacher Practice to Facilitate and Assess Oral Scientific Argumentation: Embedding a Real-Time Assessment of Speaking and Listening into an Argumentation-Rich Curriculum (Collaborative Research: Henderson)

The fundamental purpose of this project is to support teacher practice and professional learning around oral scientific argumentation in order to improve the quality of this practice in classrooms. The key outcome of this work will be a research-informed and field-tested prototype to improve the quality of teaching and learning argumentation in middle school science classrooms usable in different learning environments.

Lead Organization(s): 
Award Number: 
1621496
Funding Period: 
Thu, 09/01/2016 to Mon, 08/31/2020
Full Description: 

This is an early-stage design and development collaborative study submitted to the assessment strand of the Discovery Research PreK-12 (DRK-12) program, in response to Program Solicitation NSF 15-592. The fundamental purpose of this project is to support teacher practice and professional learning around oral scientific argumentation in order to improve the quality of this practice in classrooms. To achieve this purpose, the project will examine the validity of a new technology-based formative assessment tool for classroom argumentation--"Diagnosing the Argumentation Levels of Groups" (DiALoG)--for which psychometric validation work has been conducted in a laboratory setting. The DiALoG assessment tool allows teachers to document classroom talk and display scores across multiple dimensions--both intrapersonal and interpersonal--for formative assessment purposes. The project will work with 6th-8th grade science teachers to monitor and support argumentation through real-time formative assessment data generated by the DiALoG instrument. DiALoG will be used in conjunction with "Amplify Science", a Lawrence Hall of Science-developed curriculum that incorporates the science practice of engaging in argument from evidence, and a suite of newly developed Responsive Mini-Lessons (RMLs), which consist of 20-30 minute instructional strategies designed to assist teachers to provide feedback to students' thinking and follow-up to argumentation episodes that the DiALoG tool identifies in need of further support. The study will allow the refinement and expansion of DiALoG and evaluation of its impact on teacher pedagogical content knowledge and formative assessment practices in widespread classroom use.

The project will address two specific research questions: (1) How can DiALoG be refined to provide a formative assessment tool for oral argumentation that is reliable, practical, and useful in middle school classrooms?; and (2) How does the use of DiALoG affect teacher formative assessment practices around evidence-based argumentation, when implementing science units designed to support oral argumentation? In order to answer these questions, the project will conduct a randomized control trial with 100 teachers: 50 will teach argumentation-focused curriculum with DiALoG, 50 will teach the same curriculum without DiALoG. Both control and treatment teachers will receive all digital and physical materials needed to teach three Amplify Science curriculum units. Treatment teachers will be provided also with the most recent version of DiALoG, including the linked RMLs, as well as support materials for using DiALoG with the Amplify curriculum. A subgroup of focus teachers (5 from the treatment group, and 5 from the control group) will be the subject of additional data collection and analysis. Three focus lessons, in which students are engaging in small-group or whole-class oral argumentation, will be selected from each of the three Amplify Science curricular units. Teacher measures for the randomized control trial will include validated instruments, such as (a) a pre- and post-assessment of teacher pedagogical content knowledge; (b) post-lesson and post-unit surveys in which teachers will self-report on their formative assessment practices; and (c) video recordings of selected lessons in the focus classrooms. In order to observe potential differences in formative assessment practices between treatment and control, protocols will be used to analyze the video recordings of focus classrooms, including (a) Reformed Teaching Observation Protocol; (b) Assessment of Scientific Argumentation inside the Classroom; and (c) Formative Assessment for Teachers and Students. The key outcome of this work will be a research-informed and field-tested prototype to improve the quality of teaching and learning argumentation in middle school science classrooms usable in different learning environments.

Pages

Subscribe to Teacher Attitudes/Beliefs