High

A Primer for Developing Measures of Science Content Knowledge for Small-Scale Research and Instructional Use

The credibility of conclusions made about the effectiveness of educational interventions depends greatly on the quality of the assessments used to measure learning gains. This essay, intended for faculty involved in small-scale projects, courses, or educational research, provides a step-by-step guide to the process of developing, scoring, and validating high-quality content knowledge assessments. We illustrate our discussion with examples from our assessments of high school students’ understanding of concepts in cell biology and epigenetics.

Author/Presenter

Kristin M. Bass

Dina Drits-Esser

Louisa A. Stark

Lead Organization(s)
Year
2016
Short Description

This essay, intended for faculty involved in small-scale projects, courses, or educational research, provides a step-by-step guide to the process of developing, scoring, and validating high-quality content knowledge assessments.

Who Chooses STEM Careers? Using a Relative Cognitive Strength and Interest Model to Predict Careers in Science, Technology, Engineering, and Mathematics

Career aspirations in science, technology, engineering, and mathematics (STEM) are formulated in adolescence, making the high school years a critical time period for identifying the cognitive and motivational factors that increase the likelihood of future STEM employment. While past research has mainly focused on absolute cognitive ability levels in math and verbal domains, the current study tested whether relative cognitive strengths and interests in math, science, and verbal domains in high school were more accurate predictors of STEM career decisions.

Author/Presenter

Ming-Te Wang

Feifei Ye

Jessica Lauren Degol

Lead Organization(s)
Year
2016
Short Description

While past research has mainly focused on absolute cognitive ability levels in math and verbal domains, the current study tested whether relative cognitive strengths and interests in math, science, and verbal domains in high school were more accurate predictors of STEM career decisions.

Resource(s)

Staying Engaged: Knowledge and Research Needs in Student Engagement

In this article, we review knowledge about student engagement and look ahead to the future of study in this area. We begin by describing how researchers in the field define and study student engagement. In particular, we describe the levels, contexts, and dimensions that constitute the measurement of engagement, summarize the contexts that shape engagement and the outcomes that result from it, and articulate person-centered approaches for analyzing engagement. We conclude by addressing limitations to the research and providing recommendations for study.

Author/Presenter

Ming-Te Wang

Jessica Degol

Lead Organization(s)
Year
2014
Short Description

In this article, we review knowledge about student engagement and look ahead to the future of study in this area.

Resource(s)

Motivational pathways to STEM career choices: Using expectancy-value perspective to understand individual and gender differences in STEM fields

The United States has made a significant effort and investment in STEM education, yet the size and the composition of the STEM workforce continues to fail to meet demand. It is thus important to understand the barriers and factors that influence individual educational and career choices. In this article, we conduct a literature review of the current knowledge surrounding individual and gender differences in STEM educational and career choices, using expectancy–value theory as a guiding framework.

Author/Presenter

Ming-Te Wang

Jessica Degol

Lead Organization(s)
Year
2013
Short Description

In this article, we conduct a literature review of the current knowledge surrounding individual and gender differences in STEM educational and career choices, using expectancy–value theory as a guiding framework.

Resource(s)

Gender Gap in Science, Technology, Engineering, and Mathematics (STEM): Current Knowledge, Implications for Practice, Policy, and Future Directions

Although the gender gap in math course-taking and performance has narrowed in recent decades, females continue to be underrepresented in math-intensive fields of Science, Technology, Engineering, and Mathematics (STEM). Career pathways encompass the ability to pursue a career as well as the motivation to employ that ability. Individual differences in cognitive capacity and motivation are also influenced by broader sociocultural factors.

Author/Presenter

Ming-Te Wang

Jessica L. Degol

Lead Organization(s)
Year
2016
Resource(s)

Using qualitative methods to develop a survey measure of math and science engagement

Student engagement in math and science is vital to students' academic achievement and long-term participation in science, technology, engineering, and mathematic (STEM) courses and careers. In this study, we conducted in-depth interviews with 106 students from sixth to twelfth grade and 34 middle and high school teachers about how they conceptualized math and science engagement and disengagement. Our qualitative analysis of student and teacher interviews supported the multidimensional construct of engagement outlined in the academic literature.

Author/Presenter

Jennifer A. Fredricks

Ming-Te Wang

Jacqueline Schall Linn

Tara L. Hofkens

Hannah Sung

Alyssa Parr

Julia Allerton

Lead Organization(s)
Year
2016
Short Description

In this study, we conducted in-depth interviews with 106 students from sixth to twelfth grade and 34 middle and high school teachers about how they conceptualized math and science engagement and disengagement.

Resource(s)

The math and science engagement scale: Development, validation, and psychometric properties

There is an urgent need to develop appropriate instruments to measure student engagement in math and science for the fields of research and practice. The present study developed and validated student- and teacher-report survey measures of student engagement in math and science. The measures are built around a multidimensional perspective of engagement by using a bifactor modeling approach. The sample was recruited from an ethnically and socioeconomically diverse middle and high school student population in the United States.

Author/Presenter

Ming-Te Wang

Jennifer A. Fredricks

Feifei Ye

Tara L. Hofkens

Jacqueline Schall Linn

Lead Organization(s)
Year
2016
Resource(s)

Use of Automated Scoring and Feedback in Online Interactive Earth Science Tasks

In formative assessment, constructed response questions are typically used for scientific argumentation, but students seldom receive timely feedback while answering these questions. The development of natural language processing (NLP) techniques makes it possible for the researchers using an automated scoring engine to provide real-time feedback to students. As is true for any new technology, it is still unclear how automated scoring and feedback may impact learning in scientific  argumentation.

Author/Presenter

Mengxiao Zhu

Ou Lydia Liu

Liyang Mao

Amy Pallant

Lead Organization(s)
Year
2016
Short Description

In this study, we analyze log data to examine the granularity of students’ interactions with automated scores and feedback and investigate the association between various students’ behaviors and their science performance

Challenges to Using the Regression Discontinuity Design in Educational Evaluations: Lessons from the Transition to Algebra Study

Interest in the regression discontinuity (RD) design as an alternative to randomized control trials (RCTs) has grown in recent years. There is little practical guidance, however, on conditions that would lead to a successful RD evaluation or the utility of studies with underpowered RD designs. This article describes the use of RD design to evaluate the impact of a supplemental algebra-readiness curriculum, Transition to Algebra, on students’ mathematics outcomes.

Author/Presenter

Josephine Louie

Christopher Rhoads

June Mark

Year
2016
Short Description

This article describes the use of RD design to evaluate the impact of a supplemental algebra-readiness curriculum, Transition to Algebra, on students’ mathematics outcomes.

STEM-focused high schools as a strategy for enhancing readiness for postsecondary STEM programs

The logic underlying inclusive STEM high schools (ISHSs) posits that requiring all students to take advanced college preparatory STEM courses while providing student-centered, reform-oriented instruction, ample student supports, and real-world STEM experiences and role models will prepare and inspire students admitted on the basis of STEM interest rather than prior achievement for postsecondary STEM. This study tests that logic model by comparing the high school experiences and achievement of students in ISHSs and comparison schools in North Carolina.

Author/Presenter

Barbara Means

Haiwen Wang

Viki Young

Vanessa L. Peters

Sharon J. Lynch

Lead Organization(s)
Year
2016
Short Description

This study tests that logic model by comparing the high school experiences and achievement of students in ISHSs and comparison schools in North Carolina.