Pre-Kindergarten

Methods for Assessing Replication

The goal of this project is to formalize subjective ideas about the important concept of replication, provide statistical analyses for evaluating replication studies, provide properties for evaluating the conclusiveness of replication studies, and provide principles for designing conclusive and efficient programs of replication studies.

Lead Organization(s): 
Award Number: 
1841075
Funding Period: 
Sat, 09/01/2018 to Tue, 08/31/2021
Full Description: 

Replication of prior findings and results is a fundamental feature of science and is part of the logic supporting the claim that science is self-correcting. However, there is little prior research on the methodology for studying replication. Research involving meta-analysis and systematic reviews that summarizes a collection of research studies is more common. However, the question of whether the findings from a set of experimental studies replicate one another has received less attention. There is no clearly defined and widely accepted definition of a successful replication study or statistical literature providing methodological guidelines on how to design single replication studies or a set of replication studies. The research proposed here builds this much needed methodology.

The goal of this project is to formalize subjective ideas about the important concept of replication, provide statistical analyses for evaluating replication studies, provide properties for evaluating the conclusiveness of replication studies, and provide principles for designing conclusive and efficient programs of replication studies. It addresses three fundamental problems. The first is how to define replication: What, precisely, should it mean to say that the results in a collection of studies replicate one another? Second, given a definition of replication, what statistical analyses should be done to decide whether the collection of studies replicate one another and what are the properties of these analyses (e.g., sensitivity or statistical power)? Third, how should one or more replication studies be designed to provide conclusive answers to questions of replication? The project has the potential for impact on a range of empirical sciences by providing statistical tools to evaluate the replicability of experimental findings, assessing the conclusiveness of replication attempts, and developing software to help plan programs of replication studies that can provide conclusive evidence of replicability of scientific findings.

Development and Validation of a Mobile, Web-based Coaching Tool to Improve PreK Classroom Practices to Enhance Learning

This project will promote pre-K teachers' use of specific teaching strategies that have been shown to enhance young children's learning and social skills. To enhance teachers' use of these practices, the project will develop a new practitioner-friendly version of the Classroom Quality Real-time Empirically-based Feedback (CQ-REF) tool for instructional coaches who work with pre-K teachers.

Lead Organization(s): 
Award Number: 
1813008
Funding Period: 
Wed, 08/01/2018 to Sun, 07/31/2022
Full Description: 

Children from low-income families often enter kindergarten academically behind their more economically affluent peers. Advancing pre-kindergarten (pre-K) teachers' ability to provide all students with high-quality early math learning experiences has potential to minimize this gap in school readiness. This project will promote pre-K teachers' use of specific teaching strategies, such as spending more time on math content and listening to children during instructional activities, that have been shown to enhance young children's learning and social skills. To enhance teachers' use of these practices, the project takes a novel approach--a mobile website that helps instructional coaches who work with pre-K teachers. The Classroom Quality Real-time Empirically-based Feedback tool (CQ-REF) will guide coaches' ability to observe specific teacher practices in their classrooms and then provide feedback to help teachers evaluate their practices and set goals for improvement.  Practically, the CQ-REF addresses the need for accessible, real-time feedback on high quality pre-K classroom teaching.

This project focuses on developing a new practitioner-friendly version of the CQ-REF, originally designed as a research tool for evaluating the quality of classroom teaching, for use by coaches and teachers. At the beginning of the four-year project, the team will collect examples of high-quality classroom teaching and coaching strategies. These will be used to create a library of video and other materials that teachers and coaches can use to establish a shared definition of what effective pre-K teaching looks like. In year three of the project, the team will pilot the CQ-REF with a diverse range of pre-K teachers and their coaches to determine the tool's usability and relevance. In this validation study coaches will be randomly assigned to either use the CQ-REF tool or coach in their usual manner. After one year, the CQ-REF's impact on teacher practices and student outcomes will be assessed. Outcomes of interest include teacher and student classroom behavior and children's executive function and ability in mathematics, literacy and science. Concurrently, an external evaluation team will examine how the coaching is being conducted and used, and participants' impressions of the coaching process. In the fourth and final year, the team will focus on refining the tool based on results from prior work and on disseminating the findings to research and practitioner audiences.

Integrating Science with Mathematics and Engineering: Linking Home and School Learning for All Young Learners

This study will investigate the integration of science with mathematics and engineering and develop resources that provide preschool children with integrated STEM learning experiences. The study will also investigate the connection between home and school learning and will develop resources that strengthen children's experiences at school and home.

Lead Organization(s): 
Award Number: 
1813280
Funding Period: 
Sat, 09/01/2018 to Mon, 02/28/2022
Full Description: 

Children in preschool programs have few opportunities to engage meaningfully in science, technology, engineering, and mathematics (STEM) disciplines. This is especially true in programs serving children from low-income communities, where resources are scarce. This study will investigate the integration of science with mathematics and engineering and develop resources that provide preschool children with integrated STEM learning experiences. The study will also investigate the connection between home and school learning and will develop resources that strengthen children's experiences at school and home. This will include investigating the needs of and designing for dual language learners who represent a large (and growing) proportion of the population served in public preschool programs.

Using design based research (DBR), the researchers will: (1) Develop learning blueprints to guide the design of classroom and family learning resources. (2) Co-design resources with teachers and parents from low-income as well as culturally and linguistically diverse communities. (3) Conduct a series of formative pilot studies with partner teachers and parents. (4) Conduct a quasi-experimental field study in preschool classrooms and homes to examine both implementation and learning outcomes. Data sources will include observations in classrooms and homes, surveys and interviews with teachers and parents, and child learning assessments. Analysis will include qualitative approaches to examine patterns of interaction and engagement with resources in classrooms and homes, as well as quantitative approaches to examine children's learning accounting for the multilevel structure of the data. The project involves a collaboration between Digital Promise Global, Education Development Center, WGBH and multiple early childhood programs in California and New York. A total of 28 preschool centers, 56 classroom teachers, 208 families and 560 children are expected to participate. Results from this project are intended to inform understanding of how young children learn STEM, how adults at school and home can support children's early STEM learning, and what supports are useful to diverse learners specifically. Results could also highlight design principles that can inform future early STEM education research and development efforts integrating media and technology.

CAREER: Mechanisms Underlying the Relation Between Mathematical Language and Mathematical Knowledge

The purpose of this project is to examine the process by which math language instruction improves learning of mathematics skills in order to design and translate the most effective interventions into practical classroom instruction.

Project Email: 
Lead Organization(s): 
Award Number: 
1749294
Funding Period: 
Wed, 08/01/2018 to Mon, 07/31/2023
Project Evaluator: 
Full Description: 

Successful development of numeracy and geometry skills during preschool provides a strong foundation for later academic and career success. Recent evidence shows that learning math language (e.g., concepts such as more, few, less, near, before) during preschool supports this development. The purpose of this Faculty Early Career Development (CAREER) project is to examine the process by which math language instruction improves learning of mathematics skills in order to design and translate the most effective interventions into practical classroom instruction. The first objective of this project is to examine if quantitative and spatial math language effect the development of different aspects of mathematics performance (e.g., numeracy, geometry). The second objective is to examine how quantitative math language versus numeracy instruction, either alone or in combination, effect numeracy development. The findings from this study will not only be used to improve theoretical understanding of how math language and mathematics skills develop, but the instructional materials developed for this study will also result in practical tools for enhancing young children's math language and mathematics skills.

This project is focused on evaluating the role of early math language skills in the acquisition of early mathematics skills. Two randomized control trials (RCTs) will be conducted. The first RCT will be used to evaluate the effects of different types of math language instruction (quantitative, spatial) on distinct aspects of mathematics (numeracy, geometry). It is expected that quantitative language instruction will improve numeracy skills and spatial language instruction will improve geometry skills. The second RCT will be used to examine the unique and joint effects of quantitative language instruction and numeracy instruction on children's numeracy skills. It is expected that both types of instruction alone will be sufficient to generate improvement on numeracy outcomes compared to an active control group, but that the combination of the two will result in enhanced numeracy performance compared to either alone. Educational goals will be integrated with and supported through engaging diverse groups of undergraduate and graduate students in hands-on research experiences, training pre- and in-service teachers on mathematical language instruction, and building collaborative relationships with early career researchers. Intervention materials including storybooks developed for the project and pre- and in-service teacher training/lesson plan materials will be made available at the completion of the project.

Alternative video text
Alternative video text: 

Networking Urban Resources with Teachers and University to Enrich Early Childhood Science (NURTURES) Phase II: Expansion and Evaluation

Building on successful prior work, this project simultaneously targets young children's teachers and families/caregivers in an effort to build both parties' capacity to promote student interest in science, technology, engineering and mathematics (STEM) learning.

Lead Organization(s): 
Award Number: 
1721059
Funding Period: 
Fri, 09/01/2017 to Tue, 08/31/2021
Full Description: 

Building on successful prior work, this University of Toledo project, Networking Urban Resources with Teachers and University to enRich Early Childhood Science (NURTURES): Researching the impact of teacher professional development and family engagement on PreK-3 achievement, simultaneously targets young children's teachers and families/caregivers in an effort to build both parties' capacity to promote student interest in science, technology, engineering and mathematics (STEM) learning. Teachers participate in a two-week summer professional development program and receive support across the school year in the form of individualized coaching and participation in professional learning communities. Families receive science inquiry packets (sent home from school) four times a year and attend community STEM events throughout the year. Inquiry packets and community events encourage science inquiry, discourse, and further exploration of key science ideas. Project participants will include 120 teachers, 2,400 PreK-3 children and over 7,200 family members in Ohio and Michigan.

Extending the initial NURTURES project, developed with NSF Math and Science Partnership funding, this follow-up project aims to: 1) Transform early childhood science teaching based upon Next Generation Science Standards (NGSS) to measurably increase student science, literacy, and math achievement, and 2) Engage families of PreK-3 students in science inquiry practices to measurably improve student science, literacy, and math achievement. A particularly important facet of this follow-up project is the research effort to parse and understand how each component (teacher professional development versus family engagement) impacts student learning. The project will use a randomized control group research design (RCT) to compare student achievement outcomes among three groups: Children whose teachers received professional development and family engagement activities, children whose teachers received only professional development, and a control group. The project will use standardized tests (the TerraNova Complete Battery) to measure impact on learning gains in science, mathematics, reading, and early literacy for children in grades K- 3. The Lens on Science assessment will measure science learning in preschool children. This project will result in an NGSS-based program for teachers and families that has been systematically tested and may ultimately be scaled up to an impact study and dissemination at a broad level.

Readiness through Integrative Science and Engineering: Refining and Testing a Co-constructed Curriculum Approach with Head Start Partners

Building upon prior research on Head Start curriculum, this phase of Readiness through Integrative Science and Engineering (RISE) will be expanded to include classroom coaches and community experts to enable implementation and assessment of RISE in a larger sample of classrooms. The goal is to improve school readiness for culturally and linguistically diverse, urban-residing children from low-income families, and the focus on science, technology, and engineering will address a gap in early STEM education.

Lead Organization(s): 
Award Number: 
1621161
Funding Period: 
Sat, 10/01/2016 to Wed, 09/30/2020
Full Description: 

Readiness through Integrative Science and Engineering (RISE) is a late stage design and development project that will build upon the results of an earlier NSF-funded design and development study in which a co-construction process for curriculum development was designed by a team of education researchers with a small group of Head Start educators and parent leaders. In this phase, the design team will be expanded to include Classroom Coaches and Community Experts to enable implementation and assessment of the RISE model in a larger sample of Head Start classrooms. In this current phase, an iterative design process will further develop the science, technology, and engineering curricular materials as well continue to refine supports for teachers to access families' funds of knowledge related to science, technology, and engineering in order to build on children's prior knowledge as home-school connections. The ultimate goal of the project is to improve school readiness for culturally and linguistically diverse, urban-residing children from low-income families who tend to be underrepresented in curriculum development studies even though they are most at-risk for later school adjustment difficulties. The focus on science, technology, and engineering will address a gap in early STEM education.

The proposed group-randomized design, consisting of 90 teachers/classrooms (45 RISE/45 Control), will allow for assessment of the impact of a 2-year RISE intervention compared with a no-intervention control group. Year 1 will consist of recruitment, induction, and training of Classroom Coaches and Community Experts in the full RISE model, as well as preparation of integrative curricular materials and resources. In Year 2, participating teachers will implement the RISE curriculum approach supported by Classroom Coaches and Community Experts; data on teacher practice, classroom quality, and implementation fidelity will be collected, and these formative assessments will inform redesign and any refinements for Year 3. During Year 2, project-specific measures of learning for science, technology, and engineering concepts and skills will also be tested and refined. In Year 3, pre-post data on teachers (as in Year 2) as well as on 10 randomly selected children in each classroom (N = 900) will be collected. When child outcomes are assessed, multilevel modeling will be used to account for nesting of children in classrooms. In addition, several moderators will be examined in final summative analyses (e.g., teacher education, part or full-day classroom, parent demographics, implementation fidelity). At the end of this project, all materials will be finalized and the RISE co-construction approach will be ready for scale-up and replication studies in other communities.

Development of the Electronic Test of Early Numeracy

The project will develop and refine an electronic Test of Early Numeracy (e-TEN) in English and Spanish that will assess informal and formal knowledge of number and operations in domains including verbal counting, numbering, numerical relationships, and mental addition/subtraction. The overarching goal of the assessment design is to create a measure that is more accurate, more accessible to a wider range of children, and easier to administer than existing measures.

Partner Organization(s): 
Award Number: 
1621470
Funding Period: 
Thu, 09/15/2016 to Tue, 08/31/2021
Full Description: 

The project will develop and refine an electronic Test of Early Numeracy (e-TEN) in English and Spanish, focused on number and operations. The assessment will incorporate a learning trajectory that describes students' development of the understanding of number. The electronic assessment will allow for the test to adapt to students' responses and incorporate games to increase children's engagement with the tasks. These features take advantage of the electronic format. The achievement test will be designed to be efficient, user-friendly, affordable, and accessible for a variety of learning environments and a broad age range (3 to 8 years old). The overarching goal of the assessment design is to create a measure that is more accurate, more accessible to a wider range of children, and easier to administer than existing measures. This project is funded by the Discovery Research Pre-K-12 Program, which funds research and development of STEM innovations and approaches in assessment, teaching and learning.

The e-TEN will assess informal and formal knowledge of number and operations in domains including verbal counting, numbering, numerical relationships, and mental addition/subtraction. The items will be designed using domain-based learning trajectories that describe students' development of understanding of the topics. The test will be designed with some key characteristics. First, it will be semi-adaptive over six-month age spans. Second, it will have an electronic format that allows for uniform implementation and an efficient, user-friendly administration. The test will also be accessible to Spanish speakers using an inclusive assessment model. Finally, the game-based aspect should increase children's engagement and present more meaningful questions. The user-friendly aspect includes simplifying the assessment process compared to other tests of numeracy in early-childhood. The first phase of the development will test a preliminary version of the e-TEN to test its functionality and feasibility. The second phase will focus on norming of the items, reliability and validity. Reliability will be assessed using Item Response Theory methods and test-retest reliability measures. Validity will be examined using criterion-prediction validity and construct validity. The final phase of the work will include creating a Spanish version of the test including collecting data from bilingual children using both versions of the e-TEN.

Developing Formative Assessment Tools and Routines for Additive Reasoning

This design and development project is an expansion of the Ongoing Assessment Project (OGAP), an established model for research-based formative assessment in grades 3-8, to the early elementary grades. The project will translate findings from research on student learning of early number, addition, and subtraction into tools and routines that teachers can use to formatively assess their students' understanding on a regular basis and develop targeted instructional responses.

Lead Organization(s): 
Award Number: 
1620888
Funding Period: 
Thu, 09/01/2016 to Thu, 02/28/2019
Full Description: 

This design and development project is an expansion of the Ongoing Assessment Project (OGAP), an established model for research-based formative assessment in grades 3-8, to the early elementary grades. OGAP brings together two powerful ideas in mathematics education - formative assessment and research based learning trajectories - to enhance teacher knowledge, instructional practices, and student learning. Building on a proven track record of success with this model, the current project will translate findings from research on student learning of early number, addition, and subtraction into tools and routines that teachers can use to formatively assess their students' understanding on a regular basis and develop targeted instructional responses. The project involves a development component focused on producing and field testing new resources (including frameworks, item banks, pre-assessments and professional development materials) and a research component designed to improve the implementation of these resources in school settings. The materials that are developed from this project will help teachers be able to more precisely assess student understanding in the major mathematical work of grades K-2 in order to better meet the needs of diverse learners. With the addition of these new early elementary materials, OGAP formative assessment resources will be available for use from kindergarten through grade 8.

Although much attention has been paid to the improvement of early literacy, building strong mathematical foundations and early computational fluency is equally critical for later success in school and preparation for STEM careers. This project will develop and field test tools, resources, and routines that teachers can employ to help young students develop deeper conceptual understandings and more powerful and efficient strategies in the early grades. The project emerged from the needs of school-based practitioners looking for instructional support in the primary grades and uses design-based research methodology. The new materials will be developed, tested, and revised through multiple iterations of implementation in schools. Research-based learning trajectories will be consolidated into simplified frameworks that illustrate the overall progression of major levels of student thinking in the domains of counting, addition, and subtraction. A bank of formative assessment items will be developed, field tested, and refined through a three-phase validation process. Professional development modules will be designed and field tested to support teacher knowledge and effective use of the formative assessment tools and routines. Data collected on key activities in the formative assessment process (including teacher selection of items, analysis of student work, instructional implications, and enacted instructional response) will be used to continually inform development as well as illuminate the conditions under which formative assessment leads to productive changes in instruction and student learning in the classroom. The project will yield a set of field tested tools and resources ready for both broader dissemination and further research on the promise of the intervention, as well as an understanding of how to support effective implementation.

Pages

Subscribe to Pre-Kindergarten