Statistics

Formative Assessment Delivery System (FADS)

This project uses new psychometric techniques to create a technological tool that could evaluate how well students in the 4th-8th mathematics and science classrooms respond to complex performance tasks. The purpose of this tool is to improve the instruction of teachers in mathematics and science. It will produce real-time individualized diagnoses of instructional needs to help teachers plan instruction that specifically addresses the learning needs of each student in that class.

Project Email: 
Award Number: 
0733334
Funding Period: 
Wed, 08/15/2007 to Sat, 07/31/2010
Project Evaluator: 
Julie Koppich
Full Description: 

This project addresses the Measurement goal under the Mathematics and Science Education research program. Specifically, we propose developing and refining an assessment development, delivery, scoring, and report-generating system in the area of mathematics, centered on statistics and modeling.  We have been engaged with colleagues at Vanderbilt University in designing a formative assessment system to support (and help evaluate) their innovative curriculum in this area: the Assessing Data Modeling and Statistical Reasoning (ADM) system developed by Rich Lehrer and his colleagues (Lehrer & Schauble, 2007).  This assessment system has been created using the principles of the BEAR Assessment System (BAS; Wilson, 2005), and it and the curriculum it supports is currently being used in several states (WI, AK, TN), and is being adopted into a broader curriculum that is widely used.  The aim of the current project is: (a) to refine a set of software programs that the Berkeley Evaluation and Assessment Research (BEAR) Center has been developing over the last 10 years that support the development, calibration, use and training for the assessment system, and to develop software interconnections among those programs to allow them to operate seamlessly for users whose roles range from assessment developers to teachers to school administrators, to those who provide professional development for teachers; (b) as a first full trial of that software,  to embed the existing ADM materials in the software, construct computer-deliverable and computer-scorable task equivalents of the current  item bank, and develop new computerized reports and support materials for teachers; and (c) to investigate the usefulness of this new software in the context of the ADM curriculum.

The positive effects of innovative assessments are widely acknowledged (Black & Wiliam, 1998), and we are happy that the BAS is seen as one such innovation.  But we are strongly concerned that the good effects that one can find from early-adopters of such innovations will not be sustained unless the considerable burden of teacher scoring of their students’ formative assessments is lightened.  We believe that it is essential that teachers become experts in interpreting their student’s responses to assessments.  But, equally, we see that it is wise to then relieve them of the burden of continual scoring of large amounts of student work.  Hence, the strategy we have adopted is to involve teachers early on in a deep program of professional development that will include close work with curriculum materials, assessments and student responses to assessments (preferably including a large proportion of work from their own students).  However, once teachers have shown their mastery of the role of scorer and interpreter of such student products, we then provide the teacher with computerized assessments that will deliver and score equivalent assessments for their students, and generate rich interpretational materials to help them with diagnosis and planning.  We expect that teachers will still be called upon to evaluate unusual student responses, and also will need to carry out occasional hand-scoring to keep up their mastery and to adapt to innovations in the curriculum.

Data Games—Tools and Materials for Learning Data Modeling (Collaborative Research: Konold)

This project is developing software and curriculum materials in which data generated by students playing computer games form the raw material for mathematics classroom activities. Students play a short video game, analyze the game data, conjecture improved strategies, and test their strategies in another round of the game.

Award Number: 
0918653
Funding Period: 
Tue, 09/01/2009 to Fri, 08/31/2012
Project Evaluator: 
Jim Hammerman
Full Description: 

Students playing computer games generate large quantities of rich, interesting, highly variable data that mostly evaporates into the ether when the game ends. What if in a classroom setting, data from games students played remained accessible to them for analysis? In software and curriculum materials being developed by the Data Games project at UMass Amherst and KCP Technologies, data generated by students playing computer games form the raw material for mathematics classroom activities. Students play a short video game, analyze the game data, conjecture improved strategies, and test their strategies in another round of the game.

 

The video games are embedded in TinkerPlots and Fathom, two data analysis learning environments widely used in grades 5–8 and 8–14 respectively. The game data appear in graphs in real time, allowing several cycles of strategy improvement in a short time. The games are designed so that these cycles im- prove understanding of specific data modeling and/or mathematics concepts. Lessons will be embedded in LessonLink from Key Curriculum Press to facilitate their integration into standard curricula. The three- year project expands research in students’ understanding of data modeling and their ability to learn mathematical content embedded in data-rich contexts.

The Development of Student Cohorts for the Enhancement of Mathematical Literacy in Under Served Populations

This project is developing and conducting research on the Cohort Model for addressing the mathematics education of students that perform in the bottom quartile on state and district tests. The predicted outcome is that most students will remain in the cohort for all four years and that almost all of those who do will perform well enough on college entrance exams to be admitted and will test out of remedial mathematics courses.

Lead Organization(s): 
Award Number: 
0822175
Funding Period: 
Mon, 09/01/2008 to Wed, 08/31/2011
Project Evaluator: 
Inverness Research, Inc.
Full Description: 

Project Summary

This is a Full Research and Development proposal which addresses the Contextual Challenge: How can the learning of significant STEM content be achieved to ensure public literacy and workforce readiness?  Our nation is failing to prepare millions of youth for meaningful and productive participation in an information-based society. The target population are those students performing in the bottom quartile on state and national tests, many of these are children of color living in under resourced communities, and most of these young people do not finish high school and end up diverted into an underground economy, gangs, and prisons.   

This project addresses this failure by further developing and testing an approach that the Algebra Project is developing for high school mathematics, in which students form a cohort that stays together for all four years of high school, study mathematics every day using project-designed curricular materials with teachers who participate in project professional development, and are supported by local community groups. 

The Algebra Project seeks to stimulate a demand for math literacy in those most affected by its absence -- the young people themselves.  It stresses the importance of peer culture, using lessons learned from experiences in the 1960s Civil Rights Movement, as well as in the emergence of project graduates into a group with their own perspectives and initiatives. 

In the 60s, project founders learned how to use the meeting place as a tool to engage and empower the people that the meeting was intended to serve.  In the proposed project, there are two meeting places: the students’ high school mathematics classroom and supplementary education activities; and the network of sites around the country that are communicating and learning how to develop and implement cohorts. Young peoples’ roles in each of these settings are key to creating the motivation and commitment needed for student success as well as developing local interest.  The combination of classroom and professional development work, innovative curriculum materials, and community involvement creates an intervention that can significantly transform the peer culture, even in the face of negative forces.

The Algebra Project has developed a cohort model that we predict will stimulate and enable students to pass the state and district mandated tests in mathematics, to pass the mathematics portions of any graduation test, and to score well enough on the SAT or ACT to enter college, and to place into mathematics courses for college credit (not remedial courses).  Building on previous awards, the project will continue to research and develop the cohort model, and will create a small network of cohorts to establish that our model can be widely successful.

Intellectual merit:  This project will demonstrate how students entering high school performing in the bottom quartile nationally and state-wide can be prepared for college-level mathematics, using lessons learned from many years of past experience working in such communities and in their middle schools, and more recently in their high schools and in collaboration with university mathematicians.  The research results are critical to the nation’s learning how to improve mathematics achievement for all children – to gaining a sense of what such a program “looks and feels like”, and what resources and commitments are required, from which institutions. 

Broader impact:  The results of this discovery research project will advance understanding of how to improve mathematics learning and achievement in low performing districts, so students are prepared to take college mathematics without repeating high school mathematics in early college.  It will also demonstrate the resources and commitments needed to reach this result.

Connecting Content and Pedagogical Education of Pre-service Teachers (CONCEPT)

The primary goal of the project is to enhance secondary mathematics teacher education for pre-service teachers by developing, implementing and disseminating resources from a four-course curriculum that brings together the study of mathematics content and pedagogy. Three of the courses are problem-based technology enhanced (PBTE) courses in Algebra and Calculus, Geometry, and Probability and Statistics. A fourth course is a capstone course in Teaching and Learning Secondary School Mathematics.

Lead Organization(s): 
Award Number: 
0455797
Funding Period: 
Wed, 06/01/2005 to Sun, 05/31/2009

Pages

Subscribe to Statistics