Measurement

TRUmath and Lesson Study: Supporting Fundamental and Sustainable Improvement in High School Mathematics Teaching (Collaborative Research: Schoenfeld)

Given the changes in instructional practices needed to support high quality mathematics teaching and learning based on college and career readiness standards, school districts need to provide professional learning opportunities for teachers that support those changes. The project is based on the TRUmath framework and will build a coherent and scalable plan for providing these opportunities in high school mathematics departments, a traditionally difficult unit of organizational change.

Award Number: 
1503454
Funding Period: 
Wed, 07/01/2015 to Sun, 06/30/2019
Full Description: 

Given the changes in instructional practices needed to support high quality mathematics teaching and learning based on college and career readiness standards, school districts need to provide professional learning opportunities for teachers that support those changes. The project will build a coherent and scalable plan for providing these opportunities in high school mathematics departments, a traditionally difficult unit of organizational change. Based on the TRUmath framework, characterizing the five essential dimensions of powerful mathematics classrooms, the project brings together a focus on curricular materials that support teaching, Lesson Study protocols and materials, and a professional learning community-based professional development model. The project will design and revise professional development and coaching guides and lesson study mathematical resources built around the curricular materials. The project will study changes in instructional practice and impact on student learning. By documenting the supports used in the Oakland Unified School District where the research and development will be conducted, the resources can be used by other districts and in similar work by other research-practice partnerships.

This project hypothesizes that the quality of classroom instruction can be defined by five dimensions - quality of the mathematics; cognitive demand of the tasks; access to mathematics content in the classroom; student agency, authority, and identity; and uses of assessment. The project will use an iterative design process to develop and refine a suite of tool, including a conversation guide to support productive dialogue between teachers and coaches, support materials for building site-based professional learning materials, and formative assessment lessons using Lesson Study as a mechanism to enact reforms of these dimensions. The study will use a pre-post design and natural variation to student the relationships between these dimensions, changes in teachers' instructional practice, and student learning using hierarchical linear modeling with random intercept models with covariates. Qualitative of the changes in teachers' instructional practices will be based on coding of observations based on the TRUmath framework. The study will also use qualitative analysis techniques to identify themes from surveys and interviews on factors that promote or hinder the effectiveness of the intervention.

CAREER: Advancing Secondary Mathematics Teachers' Quantitative Reasoning

Advancing Reasoning addresses the lack of materials for teacher education by investigating pre-service secondary mathematics teachers' quantitative reasoning in the context of secondary mathematics concepts including function and algebra. The project extends prior research in quantitative reasoning to develop differentiated instructional experiences and curriculum that support prospective teachers' quantitative reasoning and produce shifts in their knowledge.

Award Number: 
1350342
Funding Period: 
Tue, 07/15/2014 to Sun, 06/30/2019
Full Description: 

Science, Technology, Engineering and Mathematics [STEM] and STEM education researchers and policy documents have directed mathematics educators at all levels to increase emphasis on quantitative reasoning so that students are prepared for continued studies in mathematics and other STEM fields. Often, teachers are not sufficiently prepared to support their students' quantitative reasoning. The products generated by this project fill a need for concrete materials at the pre-service level that embody research-based knowledge in the area of quantitative reasoning. The accessible collection of research and educational products provides a model program for changing prospective mathematics teachers' quantitative reasoning that is adoptable at other institutions across the nation. Additionally, the support of early CAREER scholars in mathematics education will add to the capacity of the country to address issues in mathematics education in the future.

Advancing Reasoning addresses the lack of materials for teacher education by investigating pre-service secondary mathematics teachers' quantitative reasoning in the context of secondary mathematics concepts including function and algebra. The project extends prior research in quantitative reasoning to develop differentiated instructional experiences and curriculum that support prospective teachers' quantitative reasoning and produce shifts in their knowledge. Three interrelated research questions guide the project: (i) What aspects of quantitative reasoning provide support for prospective teachers' understanding of major secondary mathematics concepts such as function and algebra? (ii) How can instruction support prospective teachers' quantitative reasoning in the context of the teaching and learning of major secondary mathematics concepts such as function and algebra? (iii) How do the understandings prospective teachers hold upon entering a pre-service program support or inhibit their quantitative reasoning? Advancing Reasoning addresses these questions by enacting an iterative, multi-phase study with 200 prospective teachers enrolled in a secondary mathematics education content course over 5 years. The main phase of the study implements a series of classroom design experiments to produce knowledge on central aspects of prospective teachers' quantitative reasoning and the instructional experiences that support such reasoning. By drawing this knowledge from a classroom setting, Advancing Reasoning contributes research-based and practice-driven deliverables that improve the teaching and learning of mathematics.

Supports for Science and Mathematics Learning in Pre-Kindergarten Dual Language Learners: Designing and Expanding a Professional Development System

SciMath-DLL is an innovative preschool professional development (PD) model that integrates supports for dual language learners (DLLs) with high quality science and mathematics instructional offerings. It engages teachers with workshops, classroom-based coaching, and professional learning communities. Based on initial evidence of promise, the SciMath-DLL project will expand PD offerings to include web-based materials.

Lead Organization(s): 
Partner Organization(s): 
Award Number: 
1417040
Funding Period: 
Tue, 07/01/2014 to Sat, 06/30/2018
Full Description: 

The 4-year project, Supports for Science and Mathematics Learning in Pre-Kindergarten Dual Language Learners: Designing and Expanding a Professional Development System (SciMath-DLL), will address a number of educational challenges. Global society requires citizens and a workforce that are literate in science, technology, engineering, and mathematics (STEM), but many U.S. students remain ill prepared in these areas. At the same time, the children who fill U.S. classrooms increasingly speak a non-English home language, with the highest concentration in the early grades. Many young children are also at risk for lack of school readiness in language, literacy, mathematics, and science due to family background factors. Educational efforts to offset early risk factors can be successful, with clear links between high quality early learning experiences and later academic outcomes. SciMath-DLL will help teachers provide effective mathematics and science learning experiences for their students. Early educational support is critical to assure that all students, regardless of socioeconomic or linguistic background, learn the STEM content required to become science and mathematics literate. Converging lines of research suggest that participation in sustained mathematics and science learning activities could enhance the school readiness of preschool dual language learners. Positive effects of combining science inquiry with supports for English-language learning have been identified for older students. For preschoolers, sustained science and math learning opportunities enhance language and pre-literacy skills for children learning one language. Mathematics skills and science knowledge also predict later mathematics, science, and reading achievement. What has not been studied is the extent to which rich science and mathematics experiences in preschool lead to better mathematics and science readiness and improved language skills for preschool DLLs. Because the preschool teaching force is not prepared to support STEM learning or to provide effective supports for DLLs, professional development to improve knowledge and practice in these areas is required before children's learning outcomes can be improved.

SciMath-DLL is an innovative preschool professional development (PD) model that integrates supports for DLLs with high quality science and mathematics instructional offerings. It engages teachers with workshops, classroom-based coaching, and professional learning communities. Development and research activities incorporate cycles of design-expert review-enactment- analysis-redesign; collaboration between researcher-educator teams at all project stages; use of multiple kinds of data and data sources to establish claims; and more traditional, experimental methodologies. Based on initial evidence of promise, the SciMath-DLL project will expand PD offerings to include web-based materials, making the PD more flexible for use in a range of educational settings and training circumstances. An efficacy study will be completed to examine the potential of the SciMath-DLL resources, model, and tools to generate positive effects on teacher attitudes, knowledge, and practice for early mathematics and science and on children's readiness in these domains in settings that serve children learning two languages. By creating a suite of tools that can be used under differing educational circumstances to improve professional knowledge, skill, and practice around STEM, the project increases the number of teachers who are prepared to support children as STEM learners and, thus, the number of children who can be supported as STEM learners.

GRIDS: Graphing Research on Inquiry with Data in Science

The Graphing Research on Inquiry with Data in Science (GRIDS) project will investigate strategies to improve middle school students' science learning by focusing on student ability to interpret and use graphs. GRIDS will undertake a comprehensive program to address the need for improved graph comprehension. The project will create, study, and disseminate technology-based assessments, technologies that aid graph interpretation, instructional designs, professional development, and learning materials.

Award Number: 
1418423
Funding Period: 
Mon, 09/01/2014 to Sat, 08/31/2019
Full Description: 

The Graphing Research on Inquiry with Data in Science (GRIDS) project is a four-year full design and development proposal, addressing the learning strand, submitted to the DR K-12 program at the NSF. GRIDS will investigate strategies to improve middle school students' science learning by focusing on student ability to interpret and use graphs. In middle school math, students typically graph only linear functions and rarely encounter features used in science, such as units, scientific notation, non-integer values, noise, cycles, and exponentials. Science teachers rarely teach about the graph features needed in science, so students are left to learn science without recourse to what is inarguably a key tool in learning and doing science. GRIDS will undertake a comprehensive program to address the need for improved graph comprehension. The project will create, study, and disseminate technology-based assessments, technologies that aid graph interpretation, instructional designs, professional development, and learning materials.

GRIDS will start by developing the GRIDS Graphing Inventory (GGI), an online, research-based measure of graphing skills that are relevant to middle school science. The project will address gaps revealed by the GGI by designing instructional activities that feature powerful digital technologies including automated guidance based on analysis of student generated graphs and student writing about graphs. These materials will be tested in classroom comparison studies using the GGI to assess both annual and longitudinal progress. Approximately 30 teachers selected from 10 public middle schools will participate in the project, along with approximately 4,000 students in their classrooms. A series of design studies will be conducted to create and test ten units of study and associated assessments, and a minimum of 30 comparison studies will be conducted to optimize instructional strategies. The comparison studies will include a minimum of 5 experiments per term, each with 6 teachers and their 600-800 students. The project will develop supports for teachers to guide students to use graphs and science knowledge to deepen understanding, and to develop agency and identity as science learners.

Teaching STEM with Robotics: Design, Development, and Testing of a Research-based Professional Development Program for Teachers

Using design-based research, with teachers as design partners, the project will create and refine project-based, hands-on robotics curricula such that science and math content inherent in robotics and related engineering design practices are learned. To provide teachers with effective models to capitalize on robotics for elucidating science and math concepts, a design-based Professional Development program will be built using principles of technological, pedagogical, and content knowledge (TPACK).

Lead Organization(s): 
Award Number: 
1417769
Funding Period: 
Mon, 09/01/2014 to Fri, 08/31/2018
Full Description: 

Offering meaningful and motivating engineering contexts, such as robotics, within science and math courses constitutes a compelling strategy to address the Next Generation Science Standards and the Common Core State Standards for Math while enhancing science and math learning for all students. Using design-based research, with teachers as design partners, the project will create and refine project-based, hands-on curricula such that science and math content inherent in robotics and related engineering design practices are learned. To provide teachers with effective models to capitalize on robotics for elucidating science and math concepts, a design-based Professional Development program will be built using principles of technological, pedagogical, and content knowledge (TPACK). To ensure that teachers are well prepared, research-based practices and features of effective Professional Development will be adopted. Experts in robotics, engineering, education, curriculum design, and assessment--with experience in K-12 education, training, and outreach--have formed an interdisciplinary team to make robotics central to and sustainable in middle school science and math classrooms.

The research questions addressed in this project are qualitative in nature as appropriate for design research questions. The methodologies include teacher needs assessment, teachers' perceptions of robotics, pre and post testing, classroom observations, and surveys. Examples of the research questions are:

What characteristics of robotics promote effective learning of middle school science and math?

What elements of Professional Development engender teachers' TPACK of robotics and link it with classroom science and math?

What are student prerequisites to effectively use robotics in science and math learning?

What are the gains in students' STEM engagement, interest, persistence, and career awareness?

The robotics curriculum will include physical science used in robot performance expectations and motion stability. Additionally the curriculum will include the engineering design process consisting of problem definition, solution development, and design improvement. Robotics provides opportunities to support science and engineering practices of the Next Generation Science Standards such as developing and using models, planning and conducting investigations, designing solutions, and analyzing and interpreting data. The project will be aimed at middle school students and will provide substantial teacher professional development to implement the new curriculum modules. The partner schools have student bodies drawn from a diverse student population in New York City.

Changing Culture in Robotics Classroom (Collaborative Research: Shoop)

Computational and algorithmic thinking are new basic skills for the 21st century. Unfortunately few K-12 schools in the United States offer significant courses that address learning these skills. However many schools do offer robotics courses. These courses can incorporate computational thinking instruction but frequently do not. This research project aims to address this problem by developing a comprehensive set of resources designed to address teacher preparation, course content, and access to resources.

Lead Organization(s): 
Partner Organization(s): 
Award Number: 
1418199
Funding Period: 
Mon, 09/01/2014 to Thu, 08/31/2017
Full Description: 

Computational and algorithmic thinking are new basic skills for the 21st century. Unfortunately few K-12 schools in the United States offer significant courses that address learning these skills. However many schools do offer robotics courses. These courses can incorporate computational thinking instruction but frequently do not. This research project aims to address this problem by developing a comprehensive set of resources designed to address teacher preparation, course content, and access to resources. This project builds upon a ten year collaboration between Carnegie Mellon's Robotics Academy and the University of Pittsburgh's Learning Research and Development Center that studied how teachers implement robotics education in their classrooms and developed curricula that led to significant learning gains. This project will address the following three questions:

1.What kinds of resources are useful for motivating and preparing teachers to teach computational thinking and for students to learn computational thinking?

2.Where do teachers struggle most in teaching computational thinking principles and what kinds of supports are needed to address these weaknesses?

3.Can virtual environments be used to significantly increase access to computational thinking principles?

The project will augment traditional robotics classrooms and competitions with Robot Virtual World (RVW) that will scaffold student access to higher-order problems. These virtual robots look just like real-world robots and will be programmed using identical tools but have zero mechanical error. Because dealing with sensor, mechanical, and actuator error adds significant noise to the feedback students' receive when programming traditional robots (thus decreasing the learning of computational principles), the use of virtual robots will increase the learning of robot planning tasks which increases learning of computational thinking principles. The use of RVW will allow the development of new Model-Eliciting Activities using new virtual robotics challenges that reward creativity, abstraction, algorithms, and higher level programming concepts to solve them. New curriculum will be developed for the advanced concepts to be incorporated into existing curriculum materials. The curriculum and learning strategies will be implemented in the classroom following teacher professional development focusing on computational thinking principles. The opportunities for incorporating computationally thinking principles in the RVW challenges will be assessed using detailed task analyses. Additionally regression analyses of log-files will be done to determine where students have difficulties. Observations of classrooms, surveys of students and teachers, and think-alouds will be used to assess the effectiveness of the curricula in addition to pre-and post- tests to determine student learning outcomes.

A Study Group on Diversity, Equity and Excellence in Achievement and Assessment in Science, Technology, Engineering and Mathematics Education

This project seeks to find ways to make the measurement sciences more useful to the production of intellective competence in diverse students of the STEM disciplines. A Study Group on Diversity, Equity and Excellence in Achievement and Assessment in STEM Education will be established to address a set of issues posed as critical to the future of assessment for education and will undertake a series of activities culminating in the production of a report.

Lead Organization(s): 
Award Number: 
1433181
Funding Period: 
Mon, 09/01/2014 to Mon, 02/29/2016
Full Description: 

This project seeks to find ways to make the measurement sciences more useful to the production of intellective competence in diverse students of the STEM disciplines. A Study Group on Diversity, Equity and Excellence in Achievement and Assessment in Science, Technology, Engineering and Mathematics Education will be established to address a set of issues posed as critical to the future of assessment for education. Building on the work of the Gordon Commission on the Future of Assessment in Education, the Study Group will undertake a series of activities culminating in the production of a report to the field including conceptual analyses, knowledge syntheses findings, and recommended specifications for a program of research and development to advance STEM education through assessment for education.

The Study Group will consist of fifteen research scientists and scholars of pedagogical practice who are being organized to inquire into the potential of the measurement sciences to more effectively inform the teaching and learning of STEM subject matter for students whose development is challenged by the demands of diversity, equity and excellence in intellective competence. Group members are especially interested in balancing the capabilities of the measurement sciences in the assessment of developed abilities, with equal strength in the analysis, documentation and understanding of the learning and teaching processes by which intellective competence is developed. The Group will conduct a conceptual inquiry into the interrelatedness of diversity, equity, and achievement in STEM. Special attention will be given to variance in attributions, contexts and perspectives associated with differences in life conditions, cultural experience and cultural identity. The Study Group will utilize in-person and virtual deliberations; consultative conversations; and commissioned position and review papers to generate recommendations and suggested specifications for programs of research, development and praxis designed to better inform the teaching and, especially, the learning of STEM disciplines.

Developing Rich Media-Based Materials for Practice-Based Teacher Education

This research and development project is premised on the notion that recent technological developments have made it feasible to represent classroom work in new ways. In addition to watching recorded videos of classroom interactions or reading written cases, teacher educators and teachers can now watch animations and image sequences, realized with cartoon characters, and made to depict activities that happened, or could have happened, in a mathematics classroom.

Award Number: 
1316241
Funding Period: 
Thu, 08/15/2013 to Tue, 07/31/2018
Full Description: 

The 4-year research and development project, Developing Rich Media-based Materials for Practice-based Teacher Education, is premised on the notion that recent technological developments have made it feasible to represent classroom work in new ways. In addition to watching recorded videos of classroom interactions or reading written cases, teacher educators and teachers can now watch animations and image sequences, realized with cartoon characters, and made to depict activities that happened, or could have happened, in a mathematics classroom. Furthermore, teacher educators and teachers can react to such animations or image sequences by making their own depictions of alternative moves by students or teachers in classroom interaction. And all of that can take place in an on-line, cloud-based environment that also supports discussion fora, questionnaires, and the kinds of capabilities associated with learning management systems. Such technologies offer important affordances to teacher educators seeking to provide candidates with course-based experiences that emphasize the development of practice-based skills. The focus of the project is on mathematics teacher education. This joint project of the University of Maryland Center for Mathematics Education and the University of Michigan will produce 6 to 8 field-tested modules for use in different courses that are a part of mathematics teacher preparation programs. The following two-pronged research question will be resolved: What are the affordances and constraints of the modules and the environment as supports for: (1) practice based teacher education and (2) a shift toward blended teacher education?

The project involves the following activities: (1) a teacher education materials development component; (2) a related evaluation component; and (3) two research components. The development phase seeks to develop both the LessonSketch.org platform and six to eight mathematics teacher education modules for use in preservice teacher education programs from around the country. The modules will be written with practice-based teacher education goals in mind and will use the capacities of the LessonSketch.org platform as a vehicle for using rich-media artifacts of teaching with preservice teacher candidates. LessonSketch Teacher Education Research and Development Fellows will be chosen through a competitive application process. They will develop their respective modules along with teams of colleagues that will be recruited to form their inquiry group and pilot the module activities. The evaluation activity will focus on the materials development aspect of the project. Data will be collected by the LessonSketch platform, which includes interviews with Fellows and their teams, perspectives of module writers, descriptive statistics of module use, and feedback from both teacher educator and preservice teacher end-users about the quality of their experiences. The first research activity of the project is design research on the kinds of technological infrastructure that are useful for practice-based teacher education. The PIs will identify tools that teacher educators need and want beyond the current capabilities for web-based support for use of rich media and will produce prototype tools inside the LessonSketch environment to meet these needs. The second research activity of the project will supplement the evaluation activity by examining the implementation of two of the modules in detail. This aspect of the research will examine the goals of the intended curriculum, the proposed modes of media use, the fidelity of the implemented curriculum, and learnings produced by preservice teachers. This research activity will help the field understand the degree to which practice-based teacher education that is mediated by an online access to rich media would be a kind of practice that could be easily incorporated into existing teacher education structures.

The project will produce 6 to 8 LessonSketch modules for use in teacher education classes. Each module will be implemented in at least eight teacher education classes across the country, which means that between 720 and 960 preservice teacher candidates will study the materials. The project aims to shift the field toward practice-based teacher education by supporting university programs to implement classroom-driven activities that will produce mathematics teachers with strong capabilities to teach mathematics effectively and meaningfully.

CAREER: Reciprocal Noticing: Latino/a Students and Teachers Constructing Common Resources in Mathematics

The goal of this project is to extend the theoretical and methodological construct of noticing to develop the concept of reciprocal noticing, a process by which teacher and student noticing are shared. The researcher argues that through reciprocal noticing the classroom can become the space for more equitable mathematics learning, particularly for language learners.

Lead Organization(s): 
Partner Organization(s): 
Award Number: 
1253822
Funding Period: 
Wed, 05/15/2013 to Mon, 04/30/2018
Full Description: 

The goal of this project is to extend the theoretical and methodological construct of noticing to develop the concept of reciprocal noticing, a process by which teacher and student noticing are shared. The researcher argues that through reciprocal noticing the classroom can become the space for more equitable mathematics learning, particularly for language learners. Thus, the focus of the project is on developing the concept of reciprocal noticing as a way to support better interactions between teachers and Latino/a students in elementary mathematics classrooms.

The project uses a transformative teaching experiment methodology and is guided by the initial conjectures that to make mathematics classrooms intellectually attractive places, Latino/a students and teachers need to learn to develop common resources for teaching and learning mathematics, and that reciprocal noticing as a process supports teachers and students in developing these common resources for teaching and learning mathematics. The project design centers around two research questions:How do teachers and Latino/a students tune to each other's mathematical ideas and explicitly indicate to one another how their ideas are important for discourse that promotes mathematical reasoning in classrooms characterized by reciprocal noticing? What patterns emerge across four classrooms when teachers and Latino/a students engage in reciprocal noticing?

The concept of reciprocal noticing can significantly enhance emerging research in mathematics education about the importance of teacher noticing. Further, this revised concept of noticing can transform mathematics classroom to better support English Language Learners.

The PI will incorporate project findings and videos into methods courses for preservice elementary teachers.

CAREER: Fraction Activities and Assessments for Conceptual Teaching (FAACT) for Students with Learning Disabilities

This project is studying and supporting the development of conceptual understanding of fractions by students with learning disabilities (LD).  Rather than focusing on whether students can or cannot develop conceptual understanding, the project is focused on uncovering the complex understanding students DO have.

Award Number: 
1708327
Funding Period: 
Tue, 07/01/2014 to Sun, 06/30/2019
Project Evaluator: 
Dr. Mary Little
Full Description: 

Dr. Hunt, a former middle school and elementary school mathematics in inclusive settings in a state-demonstration STEM school, works with students deemed to be at risk for mathematics difficulties or labeled as having disabilities. Hunt contends that research and pedagogical practice for children with disabilities should begin from a respect for children's ways of knowing and learning. Rather than focusing on whether students can or cannot develop conceptual understanding, research should attempt to uncover the complex understanding students DO have. She argues that teaching based in learning theory that positions children's learning as adaptation advances reasoning, sense-making, and co-construction of meaning.

The goal of Hunt's project- "CAREER: Fraction Activities and Assessments for Conceptual Teaching (FAACT)"-  is to study and support the development of conceptual understanding of fractions by students with learning disabilities (LD).  Dr. Hunt is re-conceptualizing intensive intervention as children's knowing and learning in "Small Environments". This approach suggests a redirect of research and instructional practice in mathematics for an underserved population of students. The project has the potential to offer a transformative approach to mathematics instruction for students with LD, bringing together expertise on learning disabilities and mathematics education to address an area in which there is very little research. 

The main outcomes of the project include (a) a theory of knowing, learning, and teaching connected to students with LDs in the small environment of supplemental and intensive intervention, (b) selected research-based trajectories specific to the conceptual understandings of fractions evidenced by students with LD presented in case study format, and (c) a set of practices and tools for teaching in the small environment (e.g., explicated knowing and learning framework; a set of learning situations to be used for teaching and/or formative assessment in fraction concepts, and suggestions for instructional decision making to aid teachers in designing student-centered instruction both in small groups and individualized formats).

This project was previously funded under award #1253254 and 1446250.


Project Videos

2019 STEM for All Video Showcase

Title: Fractional Reasoning: Students with Learning Disabilities

Presenter(s): Jessica Hunt, Andy Khounmeuang, Kristi Martin, Blain Patterson, & Juanita Silva


Pages

Subscribe to Measurement