Mixed Methods

Developing a Suite of Standards-based Instructionally Supportive Tools for Middle School Computer Science

This project will develop a set of educational resources, assessment tools and teacher professional development (PD) activities to support teachers in developing knowledge of CS content and standards. Improved CS instruction that is responsive to the needs and challenges of the student population is particularly critical in school districts with a large population of students who are typically underserved and under-represented in computer science.

Lead Organization(s): 
Award Number: 
2010591
Funding Period: 
Fri, 05/15/2020 to Sun, 04/30/2023
Full Description: 

As computing has become an integral part of the world and the workforce, demand for computer science (CS) education in K-12 classrooms is growing. States and school districts in the U.S. are increasing CS course offerings, increasing the need for teachers with CS content and teaching knowledge. However, many CS teachers are not originally certified to teach computer science and often lack the necessary tools, resources, and training. This project will develop a set of educational resources, assessment tools and teacher professional development (PD) activities to support teachers in developing knowledge of CS content and standards. Improved CS instruction that is responsive to the needs and challenges of the student population is particularly critical in school districts with a large population of students who are typically underserved and under-represented in computer science. The project, a partnership between SRI International, the Milwaukee Public School District, and the San Francisco United Public School District, will provide professional development experiences tied to standards. Teachers will receive training via a combination of virtual webinars and face-to-face instruction. Teachers will have opportunities to evaluate their own teaching and measure their students' progress towards the standards.

The research will examine how these teacher professional development activities can help improve CS content and pedagogical knowledge for teachers. The team will use a mixed-methods design to answer three research questions: 1) How can CS standards-aligned educative instructional supports be designed to be informative and useful to middle school CS teachers using different CS curricula and what professional development (PD) do teachers need to be able to use and benefit from these educative instructional supports? 2) What are the different ways in which teachers adapt and use the standards-aligned educative resources and instructionally supportive CS assessment tools in their CS classes? 3) How can standards-aligned instructional supports and teacher PD improve middle school teachers' CS pedagogical content knowledge and improve their implementation of standards-aligned CS instruction? To answer research question one, the team will use an Evidence-Centered Design approach to systematically unpack each standard and develop aligned instructionally supportive assessments and scoring guides. Data analysis for research question one includes qualitative analysis of student cognitive interviews to determine the student's proficiencies and challenges. Inter-rater reliability analysis of teacher and researcher scores on assessments. Psychometric analysis of student responses for reliability and validity evidence. Analysis of classroom observations of teachers responding to data from assessments. Teacher interviews providing feedback on the usefulness of the tasks and scoring guides that have been developed. For research questions two and three, the project will collect and analyze data from multiple sources, including teacher interviews, classroom observations, teacher PCK (pedagogical content knowledge) surveys, and teacher logs to determine the impacts of the project. Data analysis for questions two and three will include analysis of shifts in teacher PCK between the start of year two and the end of year three. Qualitative analysis of observations for instructional practices teachers are using in their classroom from the classroom pilot and case studies. The project will recruit 24 teachers of varying experience levels. Additionally, 450 middle school students will be recruited with a significant number of female, African-American, and Hispanic students represented in the sample. Project evaluation will examine the overall achievement of program goals and objectives. Project results will be disseminated widely at national conferences and through submissions to refereed journals. The project resources and instructionally supportive tools including PD Webinars will be made available online to school districts and teachers.

The Discovery Research preK-12 program (DRK-12) seeks to significantly enhance the learning and teaching of science, technology, engineering and mathematics (STEM) by preK-12 students and teachers, through research and development of innovative resources, models and tools. Projects in the DRK-12 program build on fundamental research in STEM education and prior research and development efforts that provide theoretical and empirical justification for proposed projects.

This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

Leveraging Simulations in Preservice Preparation to Improve Mathematics Teaching for Students with Disabilities (Collaborative Research: Cohen)

This project aims to support the mathematics learning of students with disabilities through the development and use of mixed reality simulations for elementary mathematics teacher preparation. These simulations represent low-stakes opportunities for preservice teachers to practice research-based instructional strategies to support mathematics learning, and to receive feedback on their practices.

Lead Organization(s): 
Partner Organization(s): 
Award Number: 
2009939
Funding Period: 
Fri, 05/01/2020 to Tue, 04/30/2024
Full Description: 

The preparation of general education teachers to support the mathematics learning of students with disabilities is critical, as students with disabilities are overrepresented in the lower ranks of mathematics achievement. This project aims to address this need in the context of elementary mathematics teacher preparation through the development and use of mixed reality simulations. These simulations represent low-stakes opportunities for preservice teachers to practice research-based instructional strategies to support mathematics learning, and to receive feedback on their practices. Learning units that use the simulations will focus on two high leverage practices: teacher modeling of self-monitoring and reflection strategies during problem solving and using strategy instruction to teach students to support problem solving. These high-leverage teaching practices will support teachers engaging all students, including students with disabilities, in conceptually sophisticated mathematics in which students are treated as sense-makers and empowered to do mathematics in culturally meaningful ways.

The project work encompasses three primary aims. The first aim is to develop a consensus around shared definitions of high-leverage practices across the mathematics education and special education communities. To accomplish this goal, the project will convene a series of consensus-building panels with mathematics education and special education experts to develop shared definitions of the two targeted high leverage practices. This work will include engaging with current research, group discussion, and production of documents with specifications for the practices. The second aim is to develop learning units for elementary mathematics methods courses grounded in mixed reality simulation. These simulations will allow teacher candidates to enact the high leverage practices with simulated students and to receive coaching on their practice from the research team. The impact of this work will be assessed through the analysis of interviews with teacher educators implementing the units and observations and artifacts from the implementations. The third aim will be to assess the effectiveness of the simulations on teacher candidates? practices and beliefs through small-scaled randomized control trials. Teacher candidates will be randomly assigned to conditions that address the practices and make use of simulations, and a business as usual condition focused on lesson planning, student assessment, and small group discussions of the high leverage practices. The impact of the work will be assessed through the analysis of baseline and exit simulations, measures of teacher self-efficacy for teaching students with disabilities, and observations of classroom teaching in their clinical placement settings.

Evolving Minds: Promoting Causal-Explanatory Teaching and Learning of Biological Evolution in Elementary School

Adopting a teaching and curricular approach that will be novel in its integration of custom explanatory storybook materials with hands-on investigations, this project seeks to promote third grade students' understanding of small- and large-scale evolution by natural selection. By studying students across multiple school districts, this research will shed light on the benefits to diverse students of instruction that focuses on supporting children's capacities to cogently explain aspects of the biological world rather than learn disparate facts about it.

Lead Organization(s): 
Partner Organization(s): 
Award Number: 
2009176
Funding Period: 
Mon, 06/01/2020 to Fri, 05/31/2024
Full Description: 

Natural selection is a fundamental mechanism of evolution, the unifying principle of biology. It is central to understanding the functional specialization of living things, the origin of species diversity and the inherent unity of biological life. Despite the early emergence of tendencies that can make evolution increasingly challenging to learn over time, natural selection is currently not taught until middle or high school. This is long after patterns of misunderstanding are likely to have become more entrenched. The current research responds to this situation. It targets elementary school as the time to initiate comprehensive instruction on biological evolution. Adopting a teaching and curricular approach that will be novel in its integration of custom explanatory storybook materials with hands-on investigations, it seeks to promote third grade students' understanding of small- and large-scale evolution by natural selection. By studying students across multiple school districts, this research will shed light on the benefits to diverse students of instruction that focuses on supporting children's capacities to cogently explain aspects of the biological world rather than learn disparate facts about it. It will also illuminate the value of simple tools, like explanatory storybooks, for elementary school teachers who are often expected to teach counterintuitive topics such as natural selection while not feeling confident in their own understanding.

This project will investigate changes in Grade 3 students' learning and reasoning about living things during implementation of a guided inquiry curriculum unit on evolution by natural selection that emphasizes causal-mechanistic explanation. Classroom inquiry activities and investigations into a range of real-world phenomena will be framed by engagement with a sequence of innovative custom causal-explanatory storybook, animation and writing prompt materials that were developed under prior NSF support to promote transferable, scientifically accurate theory- and evidence-based reasoning about natural selection. In response to the distinctive challenges of life science and evolution learning, the project will integrate and thematically unify currently disparate Next Generation Science Standards (NGSS) content and practice standards to create a comprehensive unit that addresses all three NGSS dimensions and is accompanied by evidence-based approaches to teacher professional development (PD). Using a design based research approach, and informed by cognitive developmental findings, this 4-year project will engage at least 700 students and their teachers and include partners from at least four school districts, Boston University, and TERC.

Responding to an Emerging Epidemic through Science Education

This research project will produce curricular materials designed to help students learn about viral epidemics as both a scientific and social issue. It will engage students in scientific modeling of the epidemic and in critical analyses of media and public health information about the virus. This approach helps students connect their classroom learning experiences with their lives beyond school, a key characteristic of science literacy.

Partner Organization(s): 
Award Number: 
2023088
Funding Period: 
Sun, 03/01/2020 to Sun, 02/28/2021
Full Description: 

At this moment, there is global concern about the coronavirus disease 2019 (COVID-19) and its potential to become an epidemic in the U.S. and other countries. Reports of past studies on student understanding of epidemics and how they are taught in school indicate that teachers are reticent to teach the material because the science is unclear given the emerging nature of evidence, or because they don?t understand it well themselves. Curricular resources are limited. Consequently, many students are left on their own to grapple with a potential public health emergency that could affect them and their families. The problem is further complicated by misinformation that may be spread through social media. There is less public understanding about the science of the virus and how it spreads; the risk of being infected; treatment, or, the severity of the illness. This research project will produce curricular materials designed to help students learn about viral epidemics as both a scientific and social issue. It will engage students in scientific modeling of the epidemic and in critical analyses of media and public health information about the virus. This approach helps students connect their classroom learning experiences with their lives beyond school, a key characteristic of science literacy. This project is an example of how science education can be both engaging and relevant.

Researchers at the University of North Carolina and the University of Missouri have been studying how to teach about issues at the crossroads of science and social concerns such as community health; they have developed a framework to build curriculum materials focused on student learning of such complex issues through modeling and inquiry. For this study on the coronavirus disease 2019 (COVID-19); first, the researchers will study student responses to the epidemic in real time, collecting data on student initial understandings and concerns. Then, using this information, they will work with 7 high school science teachers familiar with their framework to build a prototype curriculum unit, and test it in classrooms in 4 high schools selected for their socio-economic and ethnic/racial diversity. The study will gather data on student interest in the epidemic, as well as how students access information about it through various forms of media, and how they vet news reports and social media. The researchers will also use pre- and post-test data to assess student learning. After this initial enactment of the curriculum materials developed to teach about the epidemic, researchers and teachers will revise the curriculum materials to make them more effective. The final products will be a curriculum unit that will be readily available and modifiable for teaching and learning about future epidemics, as well as greater understanding about how students deal with vast amounts of information about societal issues that affect their immediate lives and the science behind them.

CAREER: Promoting Equitable and Inclusive STEM Contexts in High School

This project focuses on fostering equitable and inclusive STEM contexts with attention to documenting and reducing adolescents' experiences of harassment, bias, prejudice and stereotyping. This research will contribute to understanding of the current STEM educational climates in high schools and will help to identify factors that promote resilience in the STEM contexts, documenting how K-12 educators can structure their classrooms and schools to foster success of all students in STEM classes.

Award Number: 
1941992
Funding Period: 
Sat, 02/01/2020 to Fri, 01/31/2025
Full Description: 

This project focuses on fostering equitable and inclusive STEM contexts with attention to documenting and reducing adolescents' experiences of harassment, bias, prejudice and stereotyping. An important barrier to persistence in STEM fields for marginalized groups, including women and ethnic minorities, relates to a culture in many STEM organizations, such as academic institutions, that fosters discrimination, harassment and prejudicial treatment of those from underrepresented groups. This research will contribute to understanding of the current STEM educational climates in high schools and will help to identify factors that promote resilience in the STEM contexts, documenting how K-12 educators can structure their classrooms and schools to foster success of all students in STEM classes. Further, this work will explore how to create schools where students stand-up for each other and support each other so that any student who is interested will feel welcome in STEM classes and programs.

This research aims to examine cultures of discrimination and harassment in STEM contexts with attention to: 1) assessing STEM climates in high schools in order to identify the character of discrimination and harassment, 2) understanding how youth think about these instances of bias and discrimination; 3) identifying pathways to resilience for underrepresented youth pursuing STEM interests, and 4) testing an intervention to promote bystander intervention from those who witness discrimination and harassment in STEM contexts. This research will take an intersectional approach recognizing that those who are marginalized by multiple dimensions of their identity may experience STEM contexts differently than those who are marginalized by one dimension of their identity. Because adolescence is a critical developmental period during which youth are forming their attitudes, orientations and lifelong behaviors, this research will attend to issues of bias and discrimination well before individuals enter college STEM classrooms or the STEM workforce: namely, during high school. Further, this work will examine the creation of equitable STEM climates in both college-preparation classes as well as workforce development STEM programs offered though or in partnership with high schools. This research will provide clear evidence to document the current culture of STEM contexts in high schools, using mixed methods, including surveys, qualitative interviews and longitudinal measurement. Further, the project will involve development and implementation of an intervention, which will provide the first test of whether bystander intervention can be fostered in STEM students and will involve training STEM students in key 21st century skills, such as social-cognitive capacities and interpersonal skills, enabling them to speak up and support peers from marginalized backgrounds when they observe discrimination and harassment.

CAREER: Supporting Model Based Inference as an Integrated Effort Between Mathematics and Science

This project will design opportunities for mathematics and science teachers to coordinate their instruction to support a more coherent approach to teaching statistical model-based inference in middle school. It will prepare teachers to help more students develop a deeper understanding of ideas and practices related to measurement, data, variability, and inference and to use these tools to generate knowledge about the natural world.

Award Number: 
1942770
Funding Period: 
Sat, 02/01/2020 to Fri, 01/31/2025
Full Description: 

This project will design opportunities for mathematics and science teachers to coordinate their instruction to support a more coherent approach to teaching statistical model-based inference in middle school. It will prepare teachers to help more students develop a deeper understanding of ideas and practices related to measurement, data, variability, and inference. Since there is little research to show how to productively coordinate learning experiences across disciplinary boundaries of mathematics and science education, this project will address this gap by: (1) creating design principles for integrating instruction about statistical model-based inference in middle grades that coordinates data modeling instruction in mathematics classes with ecology instruction in science classes; (2) generating longitudinal (2 years) evidence about how mathematical and scientific ideas co-develop as students make use of increasingly sophisticated modeling and inferential practices; and (3) designing four integrated units that coordinate instruction across mathematics and science classes in 6th and 7th grade to support statistical model-based inference.

This project will use a multi-phase design-based research approach that will begin by observing teachers' current practices related to statistical model-based inference. Information from this phase will help guide researchers, mathematics teachers, and science teachers in co-designing units that integrate data modeling instruction in mathematics classes with ecological investigations in science classes. This project will directly observe students' thinking and learning across 6th and 7th grades through sample classroom lessons, written assessment items, and interviews. Data from these aspects of the study will generate evidence about how students make use of mathematical ideas in science class and how their ecological investigations in science class provoke a need for new mathematical tools to make inferences. The resulting model will integrate mathematics and science learning in productive ways that are sensitive to both specific disciplinary learning goals and the ways that these ideas and practices can provide a better approximation for students to knowledge generating practices in STEM disciplines.

CAREER: Developing Elementary Preservice Teachers' Understandings and Abilities to Support Emerging Bilingual Students Scientific Sensemaking

This project will study ways to improve classroom instruction grounded in science practices to address inequities in science education for emerging bilingual students. The project will create research-based resources for teacher educators that focus on developing preservice elementary teachers' understanding and abilities to support emerging bilingual students' engagement in science practices.

Lead Organization(s): 
Award Number: 
1942912
Funding Period: 
Wed, 01/15/2020 to Tue, 12/31/2024
Full Description: 

This project will study ways to improve classroom instruction grounded in science practices to address inequities in science education for emerging bilingual students. Currently, many elementary school teachers are unfamiliar with science practices and are unprepared to teach emerging bilingual students since they never received training in either area. This project will address this lack of training and create research-based resources for teacher educators that focus on developing preservice elementary teachers' understanding and abilities to support emerging bilingual students' engagement in science practices. The study will be guided by the following objectives, which are to research: (1) the understandings of exemplary elementary teachers around science, language, and emerging bilingual students, and the relationship between these understandings and their instructional practices for supporting student sensemaking; (2) preservice teachers' understandings and practices related to supporting emerging bilingual students' sensemaking; (3) the development of an elementary science methods course, and educator resources, that support teacher learning about the role of language in science practices and approaches for supporting emerging bilingual students' sensemaking; and (4) the impact of this course, and its teacher educator resources, on preservice teachers' understandings and instructional practices. With little prior research having looked at the intersection of science and language learning, this project will advance knowledge in this regard.

Through a mixed-methods design, this project will investigate interrelated aspects of teacher understandings, teacher practice, and teacher learning around supporting emerging bilingual students' scientific sensemaking. Phase 1 of the project includes examining the instructional approaches around science practices of exemplary elementary school teachers that work in different types of school contexts with emerging bilingual students. Such strategies will go beyond traditional subject-matter knowledge and skills to include teacher encouragement of students using linguistic and nonlinguistic modes for communicating ideas; development of a deeper understanding of natural scientific phenomena; and engagement with and valuing of students' families, communities, and lived experiences. These combined efforts will capture and illustrate compelling examples of possible instantiations of engagement in science practices while being mindful of and responsive to emerging bilingual students' language assets, needs, and English development. Findings from Phase 1 will be used for Phase 2 of this project, which focuses on iteratively designing and analyzing a science methods course and resources for preservice teachers' pedagogical development across science and language learning.

CAREER: Spreading Computational Literacy Equitably via Integration of Computing in Preservice Teacher Preparation

This project will study the effect of integrating computing into preservice teacher programs. The project will use design-based research to explore how to connect computing concepts and integration activities to teachers' subject area knowledge and teaching practice, and which computing concepts are most valuable for general computational literacy.

Lead Organization(s): 
Award Number: 
1941642
Funding Period: 
Wed, 07/01/2020 to Mon, 06/30/2025
Full Description: 

Understanding and creating computer-powered solutions to professional and personal problems enables people to be safe, resourceful, and inventive in the technology-infused world. To empower society, K-12 education is rapidly changing to spread computational literacy. To spread literacy equitably, schools must give all students opportunities to understand and design computing solutions. However, school schedules are already packed with required coursework, and most teachers graduated from programs that did not offer computer science courses. To spread computational literacy within the K-12 system, this project will integrate computing into all preservice teacher programs at Georgia State University. This approach enables all teachers, regardless of primary discipline or grade band, to introduce their students to authentic computing solutions within their discipline and use these solutions as powerful tools for teaching disciplinary content and practices. In addition, this approach ensures equity because all preservice teachers will learn to use computing tools through their regular coursework, rather than a self-selected group that chooses to engage in elective courses or professional development on the topic. The project will also require preservice teachers to use computing-integrated activities in their student teaching experiences. This requirement helps teachers gain the confidence to use the activities in their future classrooms and immediately benefits students in the Atlanta area, who are primarily from groups that are underrepresented in computing, including women, people of color and those who are from low-income families.

This project will study the effect of computing integration in preservice teacher programs on computational literacy. Preservice teacher programs, like K-12 school schedules, are loaded with subject area, pedagogy, and licensure requirements. Therefore, research needs to examine the most sustainable methods for integrating computing into these programs. The proposed project will use design-based research to explore 1) how to connect computing concepts and integration activities to teachers' subject area knowledge and teaching practice, and 2) which computing concepts are most valuable for general computational literacy. Because computational literacy is a relatively new literacy, the computing education community still debates which concepts are foundational for all citizens. By studying computing integration in a range of grade bands and subject areas, this project will explore which computing concepts are applicable in a wide range of subjects. These research activities will feed directly into the teaching objective of this project ? to provide computing education and computational literacy to all preservice teachers. This project will prepare about 1500 preservice teachers (more than half of them will be women) across all grades and subject areas who can teach computing integrated activities.

 

Looking Back and Looking Forward: Increasing the Impact of Educational Research on Practice

The focus of this conference is to carefully examine past and current research with an eye toward improving its impact on practice and to create concrete steps that could shape the nature and impact of mathematics education research.

Lead Organization(s): 
Award Number: 
1941494
Funding Period: 
Sun, 09/01/2019 to Mon, 08/31/2020
Full Description: 

The focus of the proposed conference is to carefully examine past and current research with an eye toward improving its impact on practice. This conference is designed to create concrete steps that could shape the nature and impact of mathematics education research for years to come. A diverse group of 50 participants will be invited to participate. Participants include 10 experienced K-12 educators whose perspectives will be used to anchor the conference in problems of practice. Other participants represent senior through more junior scholars who have demonstrated a commitment to addressing the disconnect between research and practice, along with technology experts to advise participants on capabilities and innovative uses of modern technologies for instruction, assessment and data management.

The overarching goal for the conference is to help the field of mathematics education think deeply about the most productive ways to answer the following questions: [1] Why hasn't past research had a more direct impact on practice? What can be learned from this historical analysis for future research? [2] What is a possible vision for research that would have a more direct impact on practice? What questions should be asked? What methods should be used? What concrete steps can be taken to launch the new research programs? [3] What are the implications of adopting new kinds of research programs? If they gain traction, how will such changes affect the broader education community and infrastructure, including preservice teacher education, teacher professional development, and the training of future researchers? How should the roles of researchers and teachers change? What incentive structures might motivate these changes? How will new programs of research interact with existing programs?

Design and Implementation of Immersive Representations of Practice

This project will address the potential positive and negative impacts of using 360-degree video for bridging the gap between theory and practice in mathematics instruction by investigating how preservice teachers' tacit and explicit professional knowledge are facilitated using immersive video technology and annotations.

Lead Organization(s): 
Award Number: 
1908159
Funding Period: 
Sun, 09/01/2019 to Wed, 08/31/2022
Full Description: 

Various researchers have documented that a large proportion of preservice teachers (PSTs) demonstrate less sophisticated professional knowledge for teaching both fractions and multiplication/division. Use of representations of practice (i.e., video, animation), and accompanying annotation technology, are effective in improving such professional knowledge, but PSTs continue to demonstrate a lack of precision in attending to or noticing particular mathematics in classroom scenarios. Fortunately, a new technology, 360-degree video, has emerged as a means of training novices for professional practice. This project will address the potential positive and negative impacts of using 360-degree video for bridging the gap between theory and practice in mathematics instruction. Specifically, PSTs demonstrate difficulty in synthesizing explicit knowledge learned in the college classroom with tacit professional knowledge situated in professional practice. The initial pilot of the technology resulted in PSTs demonstrating specific attention to the mathematics. The purpose of the project will be to investigate how PSTs' tacit and explicit professional knowledge are facilitated using immersive video technology and annotations (technologically embedded scaffolds). To do this, the project will examine where and what PSTs attend to when viewing 360-degree videos, both at a single point in the classroom and through incorporating multiple camera-perspectives in the same class. Additionally, the project will examine the role of annotation technology as applied to 360-degree video and the potential for variations in annotation technology. Findings will allow for an improved understanding of how teacher educators may support PSTs' tacit and explicit knowledge for teaching. The project will make video experiences publicly available and the platform used in the project to create these video experiences for teacher educators to use, create, and share 360-degree video experiences.

The project will examine how representations of practice can facilitate preservice teachers' professional knowledge for teaching fractions and multiplication/division. The project will: examine the effect of single versus multiple perspective in PSTs' professional knowledge; examine how PSTs use annotation technology in immersive video experiences, and its effect on PSTs' professional knowledge for teaching fractions and multiplication/division; and design a platform for teacher educators to create their own 360 video immersive experiences. Using an iterative design study process, the project team will develop and pilot single and multi-perspective 360-degree video experiences in grade 3-5 classrooms including developing a computer program to join multiple 360-degree videos. They will also develop an annotation tool to allow PSTs to annotate the single and multi-perspective 360 video experiences. Using a convergent mixed methods design, the project team will analyze the quantitative data using multiple regressions of pre-post data on mathematical knowledge for teaching and survey data on PSTs reported immersion and presence in viewing the videos to compare single and multi-perspective 360-degree video data. They will also qualitatively analyze heat maps generated from eye tracking, written responses from PSTs' noticing prompts, and field notes from implementation to examine the effect of single versus multiple perspectives. The team will use similar methods to examine how PSTs use the annotation technology and its effect. The results of the research and the platform will be widely disseminated.

Pages

Subscribe to Mixed Methods