Chemistry

Promoting Engineering Problem Framing Skill-Development in High School Science and Engineering Courses

This project will develop curricular activities and assessment guidance for K-12 science and engineering educators who seek to incorporate engineering design content into their biology, chemistry, and physics classes.

Lead Organization(s): 
Partner Organization(s): 
Award Number: 
1812823
Funding Period: 
Wed, 08/01/2018 to Sat, 07/31/2021
Full Description: 

This collaborative project involving Ohio Northern University, Ohio State University, and Olathe Northwest High School will develop curricular activities and assessment guidance for K-12 science and engineering educators who seek to incorporate engineering design content into their biology, chemistry, and physics classes. This work is important because students' limited exposure to engineering activities can negatively impact their decisions to enroll in STEM courses and to pursue engineering careers. Further, many states are adopting or considering adopting the Next Generation Science Standards (NGSS), a set of classroom standards which integrate engineering content into traditional science disciplines. While high school teachers under these standards are expected to incorporate the cross-cutting engineering content into their courses, they generally receive little high-quality support for doing so. If successful, the project could provide a powerful model of how to support busy and resource-constrained STEM teachers, and create broader student interest in STEM careers.

Drawing from best practices on instructional design, the project's main objectives are to: (1) design, field-test, and evaluate the impact of 12 NGSS-aligned, engineering problem-framing design activities on students enrolled in grades 9-12 science courses and (2) design and conduct high-quality, sustained professional development that fosters participating high school science teachers' ability to deploy the NGSS concepts-linked activities. Data sources include student design artifacts, video of classroom instruction, and surveys assessing student and teacher attitudes toward engineering, student design self-efficacy and teacher self-efficacy for teaching engineering content. These data will be analyzed to determine what teachers learned from the professional development activities, how those activities informed their teaching and in turn, how students' engagement with the engineering activities relates to their engineering design skills and attitudes. In terms of intellectual merit, the project aims to develop a learning progression of students' engineering design problem-framing skills by characterizing any observed change in students' design work and attitudes over time.

The Spectrum Laboratory: Towards Authentic Inquiry for All

This project proposes to design, implement, and investigate the impact on students of an innovative curriculum supplement called the Spectrum Laboratory. The Spectrum Lab will be an online, interactive learning environment that enables students to make use of the database of publicly available spectra from research scientists, as well as from students.

Award Number: 
1814077
Funding Period: 
Tue, 05/01/2018 to Sat, 04/30/2022
Full Description: 

This project addresses physics, astronomy, and chemistry education at the high-school level. Spectroscopy is the single most important diagnostic tool in the sciences, and is required for inquiry at the frontiers of science across many disciplines, yet is unavailable to most classrooms. The Smithsonian Astrophysical Observatory proposes to design, implement, and investigate the impact on students of an innovative curriculum supplement called the Spectrum Laboratory. The Spectrum Lab will be an online, interactive learning environment that enables students to make use of the database of publicly available spectra from research scientists, as well as from students. The online learning resource and associated materials are purposefully being developed and tested with a demographically diverse set of schools. The project will determine how the design of a spectroscopy workspace can help students to use spectra while gaining fluency with a range of important science practices. The project's significance and importance is to greatly increase the opportunities for high school students to engage in authentic inquiry. Being able to evaluate and interpret real-world data is a hallmark of data literacy that is developed with Spectrum Lab. Project will potentially benefit the field through advances with respect to education and diversity, and benefit society by equipping high school students with the perceptual and cognitive factors that promote students' reasoning about spectra.

The Spectrum Lab's initial design applies research-based principles recommended for educational interfaces that engage students with graphical data advancing knowledge from prior research into understanding of how students make sense of spectroscopic data and its graphical representations. The project will be developed in collaboration with partner teachers in up to eight high school classrooms, representing a diverse population of learners, and then tested with a national group of 20 teachers with 600 to 800 students. A mix of quantitative and qualitative measures, including pre/post surveys and assessments, analysis of student project work, classroom video, and teacher surveys, will help address researcher's questions about students' experiences with the Spectrum Lab. The data to be gathered will be used to iteratively improve the design of the laboratory to aid students understand the source of these authentic data coming from spectroscopy to address real-world science questions of interest and importance to them. The Spectrum Lab will enable students to engage in a broad range of inquiry projects that were previously inaccessible, including projects near the frontiers of science. The students will become involved in their authentic inquiry projects, where each activity engages them in key science practices, including generating model spectrum plots to make predictions, assessing and interpreting data, and reasoning from evidence (and models) in support of a claim. The students will be using graphs of well-documented experiments and in physics, more challenging graphs of spectra of less familiar wavelength axis. The students in chemistry will learn how to relate the bright lines observed in an atom's spectrum to energy levels of the atom.  There will be studies that track students' eye movements show that students associate the peaks or valleys of a spectrum with individual atoms in a molecule, rather than with the overall properties of the molecule. The resources developed by the project will be freely available online for teachers and researchers. The Spectrum Lab is an advance in education technology that uses modern tools for enabling interactive data visualization. Its features enable students to integrate and apply the most important elements of science practice, such as the ability to draw evidence-based conclusions, as well as the ability to gather, evaluate and interpret data, intended to help students' science practice more closely resemble how research is done. The Spectrum Lab will modernize a critical part of high-school science classrooms, help teachers meet the expectations of the Next Generation Science Standards, and will better prepare students for college work.

CAREER: Supporting Elementary Science Teaching and Learning by Integrating Uncertainty Into Classroom Science Investigations

The goal of this study is to improve elementary science teaching and learning by developing, testing, and refining a framework and set of tools for strategically incorporating forms of uncertainty central to scientists' sense-making into students' empirical learning.

Lead Organization(s): 
Award Number: 
1749324
Funding Period: 
Fri, 06/01/2018 to Wed, 05/31/2023
Full Description: 

The goal of this study will be to improve elementary science teaching and learning by developing, testing, and refining a framework and set of tools for strategically incorporating forms of uncertainty central to scientists' sense-making into students' empirical learning. The framework will rest on the notion that productive uncertainty should be carefully built into students' empirical learning experiences in order to support their engagement in scientific practices and understanding of disciplinary ideas. To re-conceptualize the role of empirical investigations, the study will focus on the transitions between the experiences and processes students seek to understand, classroom investigations, evidence, and explanatory models as opportunities for sense-making, and how uncertainty can be built into these transitions. The project's underlying assumption is that carefully implementing these forms of uncertainty will help curriculum developers and teachers avoid the oversimplified investigations that are prevalent in K-8 classrooms that stand in stark contrast to authentic science learning and the recommendations of the Framework for K-12 Science Education (National Research Council, 2012). Accordingly, the project will seek to develop curriculum design guidelines, teacher tools, professional development supports, and four elaborated investigations, including sets of lessons, videos, and assessments that embed productive uncertainty for second and fifth graders and designed for use with linguistically, culturally, and socio-economically diverse students.

The hypothesis of this work is that if specific forms of scientific uncertainty are carefully selected, and if teachers can implement these forms of uncertainty, elementary students will have more robust opportunities to develop disciplinary practices and ideas in ways consistent with the Next Generation Science Standards (NGSS) (Lead States, 2013). Employing Design-Based Research, the three research questions will be: (1) What opportunities for sense-making do elementary school empirical investigations afford where we might strategically build uncertainty?; (2) How can we design learning environments where uncertainty in empirical investigations supports opportunities for learning?; and (3) In classrooms with sustained opportunities to engage with uncertainty in empirical investigations, what progress do students make in content understandings and the practices of argumentation, explanation, and investigation? The work will consist of three design cycles: Design Cycle 1 will involve two small groups of six teachers in adapting their curricula to incorporate uncertainty, then describe how students engage around uncertainty in empirical investigations. Design Cycle 2 will involve the same small groups in implementing and refining task structures, tools, and teacher instructional strategies. In Design Cycle 3, teachers and researchers will further refine lesson materials, assessments, and supports. The project will partner with one school district and engage in design research with groups of teachers to develop: (1) a research-based description, with exemplars of opportunities for student sense-making within empirical investigations at both early and upper elementary grades; (2) a set of design principles and tools that allow teachers to elicit and capitalize on sense-making about uncertainty in investigations; and (3) four elementary investigations elaborated to incorporate and exemplify the first two products above. These materials will be disseminated through a website, and established networks for supporting implementation of the NGSS. An advisory board will oversee project progress and conduct both formative and summative evaluation.

Developing and Validating Assessments to Measure and Build Elementary Teachers' Content Knowledge for Teaching about Matter and Its Interactions within Teacher Education Settings (Collaborative Research: Mikeska)

The fundamental purpose of this project is to examine and gather initial validity evidence for assessments designed to measure and build kindergarten-fifth grade science teachers' content knowledge for teaching (CKT) about matter and its interactions in teacher education settings.

Lead Organization(s): 
Partner Organization(s): 
Award Number: 
1813254
Funding Period: 
Sun, 07/01/2018 to Thu, 06/30/2022
Full Description: 

This is an Early-Stage Design and Development collaborative effort submitted to the assessment strand of the Discovery Research PreK-12 (DRK-12) Program. Its fundamental purpose is to examine and gather initial validity evidence for assessments designed to measure and build kindergarten-fifth grade science teachers' content knowledge for teaching (CKT) about matter and its interactions in teacher education settings. The selection of this topic will facilitate the development of a proof-of-concept to determine if and how CKT assessments can be developed and used to measure and build elementary teachers' CKT. Also, it will facilitate rapid and targeted refinement of an evidence-centered design process that could be applied to other science topics. Plans are to integrate CKT assessments and related resources into teacher education courses to support the ability of teachers to apply their content knowledge to the work of teaching and learning science. The project will combine efforts from prior projects and engage in foundational research to examine the nature of teachers' CKT and to build theories and hypotheses about the productive use and design of CKT assessment materials to support formative and summative uses. Likewise, the project will create a set of descriptive cases highlighting the use of these tools. Understanding how CKT science assessments can be leveraged as summative tools to evaluate current efforts, and as formative tools to build elementary teachers' specialized, practice-based knowledge will be the central foci of this effort.

The main research questions will be: (1) What is the nature of elementary science teachers' CKT about matter and its interactions?; and (2) How can the development of prospective elementary teachers' CKT be supported within teacher education? To address the research questions, the study will employ a mixed-methods, design-based research approach to gather various sources of validity evidence to support the formative and summative use of the CKT instrument, instructional tasks, and supporting materials. The project will be organized around two main research and development strands. Strand One will build an empirically grounded understanding of the nature of elementary teachers' CKT. Strand Two will focus on developing and studying how CKT instructional tasks can be used formatively within teacher education settings to build elementary teachers' CKT. In addition, the project will refine a conceptual framework that identifies the science-specific teaching practices that comprise the work of teaching science. This will be used as well to assess the CKT that teachers leverage when recognizing, understanding, and responding to the content-intensive practices that they engage in as they teach science. To that end, the study will build on two existing frameworks from prior NSF-funded work. The first was originally developed to create CKT assessments for elementary and middle school teachers in English Language Arts and mathematics. The second focuses on the content challenges that novice elementary science teachers face. It is organized by the instructional tools and practices that elementary science teachers use, such as scientific models and explanations. These instructional practices cut across those addressed in the Next Generation Science Standards' (NGSS; Lead States, 2013) disciplinary strands. The main project's outcomes will be knowledge that builds and refines theories about the nature of elementary teachers' CKT, and how CKT elementary science assessment materials can be designed productively for formative and summative purposes. The project will also result in the development of a suite of valid and reliable assessments that afford interpretations on CKT matter proficiency and can be used to monitor elementary teachers learning. An external advisory board will provide formative and summative feedback on the project's activities and progress.


Project Videos

2020 STEM for All Video Showcase

Title: Building Content Knowledge for Teaching about Matter

Presenter(s): Jamie Mikeska, Emily Borda, Katherine Castellano, Dante Cisterna, Dan Hanley, Debi Hanuscin, & Josie Melton


Integrating Chemistry and Earth Science

This project will design, develop, and test a new curriculum unit for high school chemistry courses that is organized around the question, "How does chemistry shape where I live?" The new unit will integrate relevant Earth science data, scientific practices, and key urban environmental research findings with the chemistry curriculum to gain insights into factors that support the approach to teaching and learning advocated by current science curriculum standards.

Award Number: 
1721163
Funding Period: 
Tue, 08/15/2017 to Wed, 07/31/2019
Full Description: 

This Integrating Chemistry and Earth science (ICE) project will design, develop, and test a new curriculum unit for high school chemistry courses that is organized around the question, "How does chemistry shape where I live?" The new unit will integrate relevant Earth science data, scientific practices, and key urban environmental research findings with the chemistry curriculum to gain insights into factors that support the approach to teaching and learning advocated by current science curriculum standards. The overarching goal of the project is to develop teacher capacity to teach and evaluate student abilities to use the practices of scientists and concepts from Earth science and chemistry to understand important phenomena in their immediate, familiar environments. The project has the potential to serve as a model for how to make cutting edge science directly accessible to all students. The project is a collaborative effort that engages scientists, science education researchers, curriculum developers, school curriculum and instruction leaders, and science teachers in the longer term challenge of infusing Earth science concepts and practices across the core high school science courses.

Current guidelines and standards for science education promote learning that engages students in three interrelated dimensions: disciplinary core ideas, scientific practices, and crosscutting ideas. This project is guided by the hypothesis that when provided sustained opportunities to engage in three-dimensional learning experiences, in an integrated Earth science and chemistry context, students will improve in their ability to demonstrate the coordination of disciplinary core ideas, scientific practices, and crosscutting concepts when solving problems and developing explanations related to scientific phenomena. This project will employ a design based research approach, and during the two development-enactment-analysis-and-redesign cycles, the project team will collect student assessment data, teacher interview data, observational data from lessons, teacher surveys, and reflective teacher logbooks. These collected data will provide information about how teachers implement the lessons, what students do during the lessons, and what students learn from them that will lead to better design and a better understanding of student learning. This information will be used to inform the modification of lessons from cycle to cycle, and to inform the professional development materials for teachers. The research agenda for the project is guided by the following questions: 1. What are the design features of ICE lessons that support teachers in enacting three-dimensional instruction within the context of their classroom? 2. What are the design features of embedded three-dimensional assessments that yield useful classroom data for teachers and researchers regarding their students' abilities to integrate core ideas, scientific practices, and crosscutting concepts? 3. What is the nature of student learning related to disciplinary core ideas, scientific practices, and crosscutting concepts that results from students' engagement in ICE lesson sets? 4. What differences emerge in student engagement and learning outcomes for ICE lessons that incorporate local phenomena or data sets as compared to lessons that do not? 5. What contextual factors (i.e., school context, administrative support, time constraints, etc.) influence teachers' implementation of three-dimensional instruction embedded within ICE lessons?


Project Videos

2021 STEM for All Video Showcase

Title: Building and Sustaining a PLC in a Virtual World

Presenter(s): Bess Caplan, Alan Berkowitz, Kevin Fleming, Kevin Garner, & Jonathon Grooms

2019 STEM for All Video Showcase

Title: Integrating Chemistry and Earth Science (ICE)

Presenter(s): Alan Berkowitz, Vonceil Anderson, Bess Caplan, Kevin Garner, & Jonathon Grooms


Building Capacity to Retain Underrepresented Students in STEM Fields

This workshop provides minority serving institutions with an opportunity to engage in dialogue about effective ways to create, implement, and evaluate models of intervention that will advance knowledge about retaining underrepresented minorities in STEM fields. It will advance knowledge in life science and the biosciences for K-12 and undergraduate students attending local schools or eligible minority-serving institutions.

Lead Organization(s): 
Award Number: 
1741748
Funding Period: 
Mon, 05/01/2017 to Mon, 04/30/2018
Full Description: 

The NSF invests in a number of programs targeting underrepresented populations and institutions relative to its meeting its goals for broadening participation in STEM. This workshop provides minority serving institutions with an opportunity to engage in dialogue about effective ways to create, implement, and evaluate models of intervention that will advance knowledge about retaining underrepresented minorities in STEM fields. It will advance knowledge in life science and the biosciences for K-12 and undergraduate students attending local schools or eligible minority-serving institutions. The workshop will focus on assisting minority serving institutions with use of research designs, and review of best practices for intervention shown to be effective in helping underrepresented student cope with chronic stresses that interfere with their retention in STEM fields and careers. The target audience for the workshop will be the participating institutions and their undergraduate students, in partnership with local K-12 schools.

In collaboration with Quality Education for Minority and MERAssociates, Rutgers University Newark will provide a unique setting to convene more than 100 participants to attend the workshop. The participants will include deans and/or department chairs; STEM faculty; educational researchers, and institutional representatives such as Vice Presidents of Academic Affairs, Provosts, or other administrators. The participants will work in teams of 4-5 to address science research topics and activities related to curriculum development, teacher support, and student engagement. Outcomes from the workshops will provide insights about successful strategies, areas of future research, and awareness about the need for better intervention models that support underrepresented minority students in STEM.

Youth Participatory Science to Address Urban Heavy Metal Contamination

This project is focused on the work and learning of teachers as they engage youth from underrepresented groups in studying chemistry as a subject relevant to heavy metal contamination in their neighborhoods. The project will position Chicago teachers and students as Change Makers who are capable of addressing the crises of inequity in science education and environmental contamination that matter deeply to them, while simultaneously advancing their own understanding and expertise.

Award Number: 
1720856
Funding Period: 
Mon, 05/15/2017 to Sat, 04/30/2022
Full Description: 

This project is focused on the work and learning of teachers as they engage youth from underrepresented groups in studying chemistry as a subject relevant to heavy metal contamination in their neighborhoods. The project is a collaboration of teachers in the Chicago Public Schools, science educators, chemists, and environmental scientists from the University of Illinois at Chicago, Northwestern University, Loyola University, and members of the Chicago Environmental Justice Network. The project is significant because it leverages existing partnerships and builds on pilot projects which will be informed by a corresponding cycle of research on teachers' learning and practice. The project will position Chicago teachers and students as Change Makers who are capable of addressing the crises of inequity in science education and environmental contamination that matter deeply to them, while simultaneously advancing their own understanding and expertise. The project will examine the malleable factors affecting the ability of teachers to engage underrepresented students in innovative urban citizen science projects with a focus on the synergistic learning that occurs as teachers, students, scientists, and community members work together on addressing complex socio-scientific issues.

The goal is to provide a network of intellectual and analytical support to high school chemistry teachers engaged in customizing curricula in response to urban environmental concerns. The project will use an annual summer institute where collaborators will develop curriculum and procedures for collecting soil and water samples. In the project, the teachers and students will work with university scientists to analyze these samples for heavy metals, and students will share their results in community settings. The study design will be multiple case and be used to study the content knowledge learned and mobilized by participating teachers as they develop these authentic projects. The project includes explicit focus on the professional development of high school science teachers while it also aims to create rich learning opportunities for underrepresented high school students in STEM fields. The contextualized science concepts within students' everyday experiences or socio-scientific issues will likely have a positive impact on student motivation and learning outcomes, but the experiences of urban students are less likely to be reflected by the curriculum, and the practices of effective secondary science teachers in these contexts are under-examined.

The following article is in press and will be available soon:

Morales-Doyle, D., Childress-Price, T., & Chappell, M. (in press). Chemicals are contaminants too: Teaching appreciation and critique of science in the era of NGSS. Science Education. https://doi.org/10.1002/sce.21546

Sonified Interactive Simulations for Accessible Middle School STEM

For this project, researchers will iteratively develop simulations to include sonifications, non-speech sounds that represent visual information, aimed at enhancing accessibility for all learners, but particularly for those with visual impairments to produce sonified simulations, professional development resources, design guidelines and exemplars, and publications.

Lead Organization(s): 
Award Number: 
1621363
Funding Period: 
Sat, 10/01/2016 to Mon, 09/30/2019
Full Description: 

Students with disabilities often have fewer opportunities for experiential learning, an important component of quality STEM education. Computer based simulations in science can provide valuable opportunities for these students to experience and manipulate natural phenomena related to critical STEM ideas. However, existing simulations remain largely inaccessible to students with visual impairments in particular. Recent advances in technology related to sonification use with simulations can make it possible for these students to have a more complete and authentic experience. Sonification is the use of non-speech sounds, such as musical tones, to represent visual information including data. Such sounds can be manipulated temporally and spatially and can also vary by amplitude and frequency to convey information that is more traditionally displayed visually. 

Researchers will iteratively develop five middle school physical science simulations to include sonifications aimed at enhancing accessibility for all learners, but particularly for those with visual impairments. Data collection activities will include focus groups and interviews with students and teachers focused on engagement. The end products of this project will include sonified simulations, professional development resources, design guidelines and exemplars, and publications.

InquirySpace 2: Broadening Access to Integrated Science Practices

This project will create technology-enhanced classroom activities and resources that increase student learning of science practices in high school biology, chemistry, and physics. InquirySpace will incorporate several innovative technological and pedagogical features that will enable students to undertake scientific experimentation that closely mirrors current science research and learn what it means to be a scientist.

Lead Organization(s): 
Partner Organization(s): 
Award Number: 
1621301
Funding Period: 
Thu, 09/15/2016 to Tue, 08/31/2021
Full Description: 

This project will create technology-enhanced classroom activities and resources that increase student learning of science practices in high school biology, chemistry, and physics courses. The project addresses the urgent national priority to improve science education as envisioned in the Next Generation Science Standards (NGSS) by focusing less on learning facts and equations and instead providing students with the time, skills, and resources to experience the conduct of science and what it means to be a scientist. This project builds on prior work that created a sequence of physics activities that significantly improved students' abilities to undertake data-based experiments and led to productive independent investigations. The goal of the InquirySpace project is to improve this physics sequence, extend the approach to biology and chemistry, and adapt the materials to the needs of diverse students by integrating tailored formative feedback in real time. The result will be student and teacher materials that any school can use to allow students to experience the excitement and essence of scientific investigations as an integral part of science instruction. The project plans to create and iteratively revise learning materials and technologies, and will be tested in 48 diverse classroom settings. The educational impact of the project's approach will be compared with that of business-as-usual approaches used by teachers to investigate to what extent it empowers students to undertake self-directed experiments. To facilitate the widest possible use of the project, a complete set of materials, software, teacher professional development resources, and curriculum design documents will be available online at the project website, an online teacher professional development course, and teacher community sites. The Discovery Research K-12 program (DRK-12) seeks to significantly enhance the learning and teaching of science, technology, engineering and mathematics (STEM) by preK-12 students and teachers, through research and development of innovative resources, models and tools (RMTs). Projects in the DRK-12 program build on fundamental research in STEM education and prior research and development efforts that provide theoretical and empirical justification for proposed projects.

InquirySpace will incorporate several innovative technological and pedagogical features that will enable students to undertake scientific experimentation that closely mirrors current science research. These features will include (1) educational games to teach data analysis and interpretation skills needed in the approach, (2) reduced dependence on reading and writing through the use of screencast instructions and reports, (3) increased reliance on graphical analysis that can make equations unnecessary, and (4) extensive use of formative feedback generated from student logs. The project uses an overarching framework called Parameter Space Reasoning (PSR) to scaffold students through a type of experimentation applicable to a very large class of experiments. PSR involves an integrated set of science practices related to a question that can be answered with a series of data collection runs for different values of independent variables. Data can be collected from sensors attached to the computer, analysis of videos, scientific databases, or computational models. A variety of visual analytic tools will be provided to reveal patterns in the graphs. Research will be conducted in three phases: design and development of technology-enhanced learning materials through design-based research, estimation of educational impact using a quasi-experimental design, and feasibility testing across diverse classroom settings. The project will use two analytical algorithms to diagnose students' learning of data analysis and interpretation practices so that teachers and students can modify their actions based on formative feedback in real time. These algorithms use computationally optimized calculations to model the growth of student thinking and investigation patterns and provide actionable information to teachers and students almost instantly. Because formative feedback can improve instruction in any field, this is a major development that has wide potential.

Misconceptions Oriented Standards-Based Assessment Resource for Teachers of High School Physical Sciences (MOSART HSPS)

This project builds upon the widely used K-12 Misconception Oriented Standards-based Assessment Resource for Teachers (MOSART). The project is developing 500 new test items that are intended to assess disciplinary core ideas in chemistry and physics aligned to Next Generation Science Standards. The new measures will be used to measure the knowledge acquired in a year of study by 10,000 students and 200 teachers in chemistry and physics.

Lead Organization(s): 
Award Number: 
1621210
Funding Period: 
Thu, 09/01/2016 to Mon, 08/31/2020
Full Description: 

The Discovery Research K-12 program (DRK-12) seeks to significantly enhance the learning and teaching of science, technology, engineering and mathematics (STEM) by preK-12 students and teachers, through research and development of innovative resources, models and tools (RMTs). Projects in the DRK-12 program build on fundamental research in STEM education and prior research and development efforts that provide theoretical and empirical justification for proposed projects.

Researchers in the Harvard Smithsonian Center for Astrophysics at Harvard University are developing and validating assessment instruments intended to measure chemistry and physical science concepts for students and teachers in grades 9 through 12. This project builds upon the widely used K-12 Misconception Oriented Standards-based Assessment Resource for Teachers (MOSART) developed by this research team. The project is developing 500 new test items that are intended to assess disciplinary core ideas in chemistry and physics aligned to Next Generation Science Standards. The new measures will be used to measure the knowledge acquired in a year of study by 10,000 students and 200 teachers in chemistry and physics. The new assessment items and instruments will be made available to other researchers and practitioners through the project website and the on-line MOSART assessment system.

The assessment development process is based on prior research conducted to develop similar MOSART items and instruments, which includes design efforts of assessment specialists, content experts, and research scientists. Pilot items are tested with a national sample of approximately 20,000 high school students and their teachers. Data will be analyzed using item response theory to model student responses. Outcomes consist of item parameters, test and sub-test characteristics, and predictive linkages among items. Descriptive statistics are generated to establish the state of student knowledge, pre-and post-test performance by item and by standard, and teacher knowledge. Descriptive analyses are followed by hierarchical linear modeling (HLM) to examine the relationships between teacher-level and program-level variables.

The MOSART instruments have been widely used and are based on a model of cognition with a strong research base in misconceptions in science education. These additional Grade 9-12 chemistry and physics instruments will address gaps in the current MOSART system of assessments. The new instruments focused on chemistry and physics disciplinary core ideas provide a much needed set of assessments for researchers and practitioners, particularly teacher professional development providers.

Pages

Subscribe to Chemistry