Evaluation / en Developing Transmedia Engineering Curricula Using Cognitive Tools to Impact Learning and the Development of STEM Identity /resources/developing-transmedia-engineering-curricula-using-cognitive-tools-impact-learning-and <span class="field field--name-title field--type-string field--label-hidden">Developing Transmedia Engineering Curricula Using Cognitive Tools to Impact Learning and the Development of STEM Identity</span> <div class="clearfix text-formatted field field--name-body field--type-text-with-summary field--label-hidden field__item"><p>This paper examines the use of Imaginative Education (IE) to create an NGSS-aligned middle school engineering curriculum that supports transfer and the development of STEM identity. In IE, cognitive tools—such as developmentally appropriate narratives, mysteries and fantasies—are used to design learning environments that both engage learners and help them organize knowledge productively. We have combined IE with transmedia storytelling to develop two multi-week engineering units and six shorter engineering lessons. An overview of the curriculum developed to date and a more detailed description of the engineering design unit is presented in this paper.</p> <p>The curriculum is currently being implemented in treatment and non-treatment classrooms in middle schools throughout the Springfield, MA public school system (SPS). In tandem with pilot-year implementation of the curriculum, we have developed an assessment instrument to measure student learning outcomes associated with a transfer variant known as preparation for future learning (PFL). An analysis of the results from the PFL assessment support the position that a curriculum employing IE cognitive tools can facilitate both transfer-in thinking and the capacity of students to “think with” and thereby interpret important engineering concepts.</p> <p>Ellis, G. W., Pina, J., Mazur, R., Rudnitsky, A., McGinnis-Cavanaugh, B., Huff, I., Ellis, S., Ford, C. M., Lytton, K., &amp; Cormier, K. C. (2020, June). Developing transmedia engineering curricula using cognitive tools to impact learning and the development of STEM identity. Paper presented at 2020 ASEE Virtual Annual Conference Content Access, Virtual On line. 10.18260/1-2--34438</p> </div> <span class="field field--name-uid field--type-entity-reference field--label-hidden"><a title="View user profile." href="/index%2ephp/users/cadre-admin" class="username">Cadre-Admin</a></span> <span class="field field--name-created field--type-created field--label-hidden"><time datetime="2021-03-19T21:54:32-04:00" title="Friday, March 19, 2021 - 21:54" class="datetime">Fri, 03/19/2021 - 21:54</time> </span> <div class="field field--name-field-resource-file field--type-file field--label-hidden field__items"> <div class="field__item"> <span class="file file--mime-application-pdf file--application-pdf"> <a href="/index%2ephp/https%3A//cadrek12.org/sites/default/files/Smith%20et%20al%202021.pdf" type="application/pdf">Smith et al 2021.pdf</a></span> </div> </div> <div class="field field--name-field-publication-publisher field--type-link field--label-hidden field__items"> <div class="field__item"><a href="https://peer.asee.org/34438">https://peer.asee.org/34438</a></div> </div> Sat, 20 Mar 2021 01:54:32 +0000 Cadre-Admin 13588 at Developing Transmedia Engineering Curricula Using Cognitive Tools to Impact Learning and the Development of STEM Identity /resources/developing-transmedia-engineering-curricula-using-cognitive-tools-impact-learning-and <span class="field field--name-title field--type-string field--label-hidden">Developing Transmedia Engineering Curricula Using Cognitive Tools to Impact Learning and the Development of STEM Identity</span> <div class="clearfix text-formatted field field--name-body field--type-text-with-summary field--label-hidden field__item"><p>This paper examines the use of Imaginative Education (IE) to create an NGSS-aligned middle school engineering curriculum that supports transfer and the development of STEM identity. In IE, cognitive tools—such as developmentally appropriate narratives, mysteries and fantasies—are used to design learning environments that both engage learners and help them organize knowledge productively. We have combined IE with transmedia storytelling to develop two multi-week engineering units and six shorter engineering lessons. An overview of the curriculum developed to date and a more detailed description of the engineering design unit is presented in this paper.</p> <p>The curriculum is currently being implemented in treatment and non-treatment classrooms in middle schools throughout the Springfield, MA public school system (SPS). In tandem with pilot-year implementation of the curriculum, we have developed an assessment instrument to measure student learning outcomes associated with a transfer variant known as preparation for future learning (PFL). An analysis of the results from the PFL assessment support the position that a curriculum employing IE cognitive tools can facilitate both transfer-in thinking and the capacity of students to “think with” and thereby interpret important engineering concepts.</p> <p>Ellis, G. W., Pina, J., Mazur, R., Rudnitsky, A., McGinnis-Cavanaugh, B., Huff, I., Ellis, S., Ford, C. M., Lytton, K., &amp; Cormier, K. C. (2020, June). Developing transmedia engineering curricula using cognitive tools to impact learning and the development of STEM identity. Paper presented at 2020 ASEE Virtual Annual Conference Content Access, Virtual On line. 10.18260/1-2--34438</p> </div> <span class="field field--name-uid field--type-entity-reference field--label-hidden"><a title="View user profile." href="/index%2ephp/users/cadre-admin" class="username">Cadre-Admin</a></span> <span class="field field--name-created field--type-created field--label-hidden"><time datetime="2021-03-19T21:54:32-04:00" title="Friday, March 19, 2021 - 21:54" class="datetime">Fri, 03/19/2021 - 21:54</time> </span> <div class="field field--name-field-resource-file field--type-file field--label-hidden field__items"> <div class="field__item"> <span class="file file--mime-application-pdf file--application-pdf"> <a href="/index%2ephp/https%3A//cadrek12.org/sites/default/files/Smith%20et%20al%202021.pdf" type="application/pdf">Smith et al 2021.pdf</a></span> </div> </div> <div class="field field--name-field-publication-publisher field--type-link field--label-hidden field__items"> <div class="field__item"><a href="https://peer.asee.org/34438">https://peer.asee.org/34438</a></div> </div> Sat, 20 Mar 2021 01:54:32 +0000 Cadre-Admin 13588 at Think Alouds: Informing Scholarship and Broadening Partnerships Through Assessment /resources/think-alouds-informing-scholarship-and-broadening-partnerships-through-assessment <span class="field field--name-title field--type-string field--label-hidden">Think Alouds: Informing Scholarship and Broadening Partnerships Through Assessment</span> <div class="clearfix text-formatted field field--name-body field--type-text-with-summary field--label-hidden field__item"><p>Think alouds are valuable tools for academicians, test developers, and practitioners as they provide a unique window into a respondent’s thinking during an assessment. The purpose of this special issue is to highlight novel ways to use think alouds as a means to gather evidence about respondents’ thinking. An intended outcome from this special issue is that readers may better understand think alouds and feel better equipped to use them in practical and research settings.</p> <p>Bostic, J. (2021). Think alouds: Informing scholarship and broadening partnerships through assessment. <em>Applied Measurement in Education, 34</em>(1), 1-9. DOI: 10.1080.08957347.2020.1835913</p> </div> <span class="field field--name-uid field--type-entity-reference field--label-hidden"><a title="View user profile." href="/users/cadre-admin" class="username">Cadre-Admin</a></span> <span class="field field--name-created field--type-created field--label-hidden"><time datetime="2021-03-19T18:57:25-04:00" title="Friday, March 19, 2021 - 18:57" class="datetime">Fri, 03/19/2021 - 18:57</time> </span> <div class="field field--name-field-resource-file field--type-file field--label-hidden field__items"> <div class="field__item"> <span class="file file--mime-application-pdf file--application-pdf"> <a href="/sites/default/files/Think_Alouds_Informing_Scholarship_and_Broadening_Partnerships_through_Assessment.pdf" type="application/pdf">Think_Alouds_Informing_Scholarship_and_Broadening_Partnerships_through_Assessment.pdf</a></span> </div> </div> <div class="field field--name-field-publication-publisher field--type-link field--label-hidden field__items"> <div class="field__item"><a href="https://www.tandfonline.com/doi/full/10.1080/08957347.2020.1835914">https://www.tandfonline.com/doi/full/10.1080/08957347.2020.1835914</a></div> </div> Fri, 19 Mar 2021 22:57:25 +0000 Cadre-Admin 13572 at Challenges to Using the Regression Discontinuity Design in Educational Evaluations: Lessons from the Transition to Algebra Study /resources/challenges-using-regression-discontinuity-design-educational-evaluations-lessons <span class="field field--name-title field--type-string field--label-hidden">Challenges to Using the Regression Discontinuity Design in Educational Evaluations: Lessons from the Transition to Algebra Study</span> <div class="clearfix text-formatted field field--name-body field--type-text-with-summary field--label-hidden field__item"><p>Interest in the regression discontinuity (RD) design as an alternative to randomized control trials (RCTs) has grown in recent years. There is little practical guidance, however, on conditions that would lead to a successful RD evaluation or the utility of studies with underpowered RD designs. This article describes the use of RD design to evaluate the impact of a supplemental algebra-readiness curriculum, Transition to Algebra, on students’ mathematics outcomes. Lessons learned highlight the need for evaluators to understand important data requirements for strong RD evaluation studies, the need to collaborate with informed and committed partners to ensure successful RD design implementation, the value of embedding an RCT within an RD design whenever possible, and the need for caution when contemplating an RD design with a small sample. Underpowered RD studies—unlike underpowered RCTs—may not produce useful evaluation results, particularly if other RD data requirements are not met.</p> <p>Louie, J., Rhoads, C., &amp; Mark, J. (2016). Challenges to using the regression discontinuity design in educational evaluations: Lessons from the Transition to Algebra study. <em>American Journal of Evaluation, 37</em>(3).</p> </div> <span class="field field--name-uid field--type-entity-reference field--label-hidden"><a title="View user profile." href="/users/cadre-admin" class="username">Cadre-Admin</a></span> <span class="field field--name-created field--type-created field--label-hidden"><time datetime="2017-02-09T11:42:25-05:00" title="Thursday, February 9, 2017 - 11:42" class="datetime">Thu, 02/09/2017 - 11:42</time> </span> <div class="field field--name-field-publication-publisher field--type-link field--label-hidden field__items"> <div class="field__item"><a href="http://journals.sagepub.com/doi/abs/10.1177/1098214015621787">http://journals.sagepub.com/doi/abs/10.1177/1098214015621787</a></div> </div> Thu, 09 Feb 2017 16:42:25 +0000 Cadre-Admin 11166 at Evaluation in DR K-12 Projects: Options /resources/evaluation-dr-k-12-projects-options <span class="field field--name-title field--type-string field--label-hidden">Evaluation in DR K-12 Projects: Options</span> <div class="clearfix text-formatted field field--name-body field--type-text-with-summary field--label-hidden field__item"><p>The Discovery Research K-12 (DR K-12) Program of the National Science Foundation (NSF) supports research and development (R&amp;D) on innovative resources, models, and tools for use by students, teachers, administrators, and policy makers. Each project has formative and summative evaluation, which are different from the project’s own R&amp;D activities and instead should support and measure the effectiveness of those activities.</p> <p>Evaluation options for investigators and evaluators to consider could include the following:</p> <p style="padding-left: 30px;">■ Use evaluation skills and approaches that can add value to the project, such as logic modeling, identification and use of existing instruments and analytic techniques, and developmental evaluation</p> <p style="padding-left: 30px;">■ Let the evaluator think “outside the project,” gathering or interpreting some data independently, and attending to the context in which the project is operating</p> <p style="padding-left: 30px;">■ Take a longer-term perspective, documenting project processes and, if feasible, conducting a retrospective analysis or looking across projects</p> <p>Read the full paper for a description of these options.</p> </div> <span class="field field--name-uid field--type-entity-reference field--label-hidden"><a title="View user profile." href="/users/cadre-admin" class="username">Cadre-Admin</a></span> <span class="field field--name-created field--type-created field--label-hidden"><time datetime="2012-11-26T12:04:02-05:00" title="Monday, November 26, 2012 - 12:04" class="datetime">Mon, 11/26/2012 - 12:04</time> </span> <div class="field field--name-field-resource-file field--type-file field--label-hidden field__items"> <div class="field__item"> <span class="file file--mime-application-pdf file--application-pdf"> <a href="/sites/default/files/CADRE%20DR%20K-12%20Evaluation%20Options.pdf" type="application/pdf">CADRE DR K-12 Evaluation Options.pdf</a></span> </div> </div> Mon, 26 Nov 2012 17:04:02 +0000 Cadre-Admin 7842 at