Technical Assistance / en Fidelity of Implementation /session/fidelity-implementation <span class="field field--name-title field--type-string field--label-hidden">Fidelity of Implementation</span> <div class="clearfix text-formatted field field--name-field-session-short-description field--type-text-long field--label-hidden field__item"><p>In this session, Hulleman discusses the advantages of assessing fidelity of implementation, elaborates a procedure for systematically assessing fidelity, and invites participants to discuss applications to their work.</p> </div> <span class="field field--name-uid field--type-entity-reference field--label-hidden"><a title="View user profile." href="/users/cadre-admin" class="username">Cadre-Admin</a></span> <span class="field field--name-created field--type-created field--label-hidden"><time datetime="2018-04-27T17:04:49-04:00" title="Friday, April 27, 2018 - 17:04" class="datetime">Fri, 04/27/2018 - 17:04</time> </span> <div class="field field--name-field-session-date-time field--type-daterange field--label-above"> <div class="field__label">Date/Time</div> <div class="field__items"> <div class="field__item"><time datetime="2018-06-08T08:30:00Z" class="datetime">Friday, June 8, 2018 - 08:30</time> - <time datetime="2018-06-08T10:00:00Z" class="datetime">Friday, June 8, 2018 - 10:00</time> </div> </div> </div> <div class="field field--name-field-session-location field--type-link field--label-above"> <div class="field__label">Location</div> <div class="field__item"><a href="/sites/default/files/Full%20Map%202018%20PI%20Meeting.pdf">Coolidge</a></div> </div> <div class="field field--name-field-presenters field--type-entity-reference field--label-above"> <div class="field__label">Presenters</div> <div class="field__items"> <div class="field__item"><a href="/users/chris-hulleman" hreflang="und">Chris Hulleman</a></div> </div> </div> <div class="clearfix text-formatted field field--name-body field--type-text-with-summary field--label-hidden field__item"><p>A program’s effectiveness is judged by whether it produces positive outcomes for participants, with the randomized experiment being the gold standard for determining the efficacy of an intervention. However, there are many ways to evaluate program effectiveness, including design-based and implementation methods. The intervention implemented usually differs—to a greater or lesser degree—from the program that was designed, making it unclear whether unfavorable results are due to an ineffective program model or implementation failure. It is therefore vital to accurately assess fidelity of implementation and, where possible, to incorporate fidelity data in the analysis of outcomes.</p> <p>The objectives of this workshop are to (1) elaborate a five-step procedure for systematically assessing fidelity in the context of program evaluation, (2) describe the advantages of assessing fidelity with this approach when conducting evaluations of educational programs, and (3) use examples to illustrate how this procedure can may be applied.</p> </div> <div class="field field--name-field-session-types field--type-entity-reference field--label-above"> <div class="field__label">Session Types</div> <div class="field__items"> <div class="field__item"><a href="/category/2016-session-types/technical-assistance" hreflang="en">Technical Assistance</a></div> <div class="field__item"><a href="/category/2016-session-types/concurrent-session" hreflang="en">Concurrent Session</a></div> </div> </div> <div class="field field--name-field-theme-strand field--type-entity-reference field--label-above"> <div class="field__label">Theme/Strand</div> <div class="field__items"> <div class="field__item"><a href="/category/themestrand/project-design-implementation-dissemination" hreflang="en">Project Design, Implementation, &amp; Dissemination</a></div> </div> </div> <section class="field field--name-field-comments field--type-comment field--label-above comment-wrapper"> </section> Fri, 27 Apr 2018 21:04:49 +0000 Cadre-Admin 11854 at Using Scenario-based Questionnaires to Investigate Teaching Knowledge and Practice at Scale /session/using-scenario-based-questionnaires-investigate-teaching-knowledge-and-practice-scale <span class="field field--name-title field--type-string field--label-hidden">Using Scenario-based Questionnaires to Investigate Teaching Knowledge and Practice at Scale</span> <div class="clearfix text-formatted field field--name-field-session-short-description field--type-text-long field--label-hidden field__item"><p>Presenters use illustrations from a project that used scenario-based, graphics-enhanced online questionnaires to introduce participants to the use of these techniques to study teaching knowledge and practice.</p> </div> <span class="field field--name-uid field--type-entity-reference field--label-hidden"><a title="View user profile." href="/users/cadre-admin" class="username">Cadre-Admin</a></span> <span class="field field--name-created field--type-created field--label-hidden"><time datetime="2018-04-27T16:40:13-04:00" title="Friday, April 27, 2018 - 16:40" class="datetime">Fri, 04/27/2018 - 16:40</time> </span> <div class="field field--name-field-session-date-time field--type-daterange field--label-above"> <div class="field__label">Date/Time</div> <div class="field__items"> <div class="field__item"><time datetime="2018-06-07T14:15:00Z" class="datetime">Thursday, June 7, 2018 - 14:15</time> - <time datetime="2018-06-07T15:45:00Z" class="datetime">Thursday, June 7, 2018 - 15:45</time> </div> </div> </div> <div class="field field--name-field-session-location field--type-link field--label-above"> <div class="field__label">Location</div> <div class="field__item"><a href="/sites/default/files/Full%20Map%202018%20PI%20Meeting.pdf">Harding</a></div> </div> <div class="field field--name-field-presenters field--type-entity-reference field--label-above"> <div class="field__label">Presenters</div> <div class="field__items"> <div class="field__item"><a href="/users/daniel-chazan" hreflang="und">Daniel Chazan</a></div> <div class="field__item"><a href="/users/patricio-herbst" hreflang="und">Patricio Herbst</a></div> </div> </div> <div class="clearfix text-formatted field field--name-body field--type-text-with-summary field--label-hidden field__item"><p>The objective of this session is to enable researchers to use scenario-based questionnaires in the study and assessment of teaching knowledge and practice. Presenters show examples of items from 15 instruments developed to study teachers’ decisions in instructional situations, their recognition of specific norms of mathematics instruction, and their dispositions toward professional obligations of teaching. After participants peruse the items and instruments, they are walked through the steps taken by presenters to develop, pilot, revise, and implement this set of instruments. Session leaders describe processes used to validate the measures developed and illustrate their use with sample results of the analysis. At least 45 minutes is dedicated to consultations with participants about their possible uses of these techniques: Participants might use these procedures and tools if they are interested in displaying classroom practices to ask questions about them or if they are interested in engaging respondents in branching scenarios (a.k.a., choose your own adventure). Presenters provide assistance conceptualizing those scenarios and the associated questionnaires.</p> </div> <div class="field field--name-field-session-types field--type-entity-reference field--label-above"> <div class="field__label">Session Types</div> <div class="field__items"> <div class="field__item"><a href="/category/2016-session-types/technical-assistance" hreflang="en">Technical Assistance</a></div> <div class="field__item"><a href="/category/2016-session-types/concurrent-session" hreflang="en">Concurrent Session</a></div> </div> </div> <div class="field field--name-field-theme-strand field--type-entity-reference field--label-above"> <div class="field__label">Theme/Strand</div> <div class="field__items"> <div class="field__item"><a href="/category/themestrand/project-design-implementation-dissemination" hreflang="en">Project Design, Implementation, &amp; Dissemination</a></div> </div> </div> <section class="field field--name-field-comments field--type-comment field--label-above comment-wrapper"> </section> Fri, 27 Apr 2018 20:40:13 +0000 Cadre-Admin 11849 at Designing and Analyzing Studies to Detect Moderation and Mediation /session/designing-and-analyzing-studies-detect-moderation-and-mediation <span class="field field--name-title field--type-string field--label-hidden">Designing and Analyzing Studies to Detect Moderation and Mediation</span> <div class="clearfix text-formatted field field--name-field-session-short-description field--type-text-long field--label-hidden field__item"><p>This session provides practical training in the concepts and application of moderation and mediation within the context of STEM education.</p> </div> <span class="field field--name-uid field--type-entity-reference field--label-hidden"><a title="View user profile." href="/users/cadre-admin" class="username">Cadre-Admin</a></span> <span class="field field--name-created field--type-created field--label-hidden"><time datetime="2018-04-27T16:22:37-04:00" title="Friday, April 27, 2018 - 16:22" class="datetime">Fri, 04/27/2018 - 16:22</time> </span> <div class="field field--name-field-session-date-time field--type-daterange field--label-above"> <div class="field__label">Date/Time</div> <div class="field__items"> <div class="field__item"><time datetime="2018-06-07T14:15:00Z" class="datetime">Thursday, June 7, 2018 - 14:15</time> - <time datetime="2018-06-07T15:45:00Z" class="datetime">Thursday, June 7, 2018 - 15:45</time> </div> </div> </div> <div class="field field--name-field-session-location field--type-link field--label-above"> <div class="field__label">Location</div> <div class="field__item"><a href="/sites/default/files/Full%20Map%202018%20PI%20Meeting.pdf">Wilson A</a></div> </div> <div class="field field--name-field-presenters field--type-entity-reference field--label-above"> <div class="field__label">Presenters</div> <div class="field__items"> <div class="field__item"><a href="/users/benjamin-kelcey" hreflang="und">Benjamin Kelcey</a></div> <div class="field__item"><a href="/users/jessaca-spybrook" hreflang="und">Jessaca Spybrook</a></div> </div> </div> <div class="clearfix text-formatted field field--name-body field--type-text-with-summary field--label-hidden field__item"><p class="m-9097105494430838692msolistparagraph">This session provides applied training in the principles and practice of designing and analyzing studies to address questions of moderation and mediation. Presenters outline the motivation and critical value of complementing “what works”-type questions with explanatory investigations that address for whom a program works, under what conditions it works, and how it works for different groups. A practical outline of the concepts of moderation and mediation is presented through several STEM case studies. Through practical examples, presenters demonstrate the analysis and design of several studies using common statistical software. They then consider multilevel extensions to these concepts in STEM settings and probe participant-generated considerations and challenges. The session concludes with a discussion of practical STEM-based strategies to address common challenges in implementing design and analysis.</p> </div> <div class="field field--name-field-session-types field--type-entity-reference field--label-above"> <div class="field__label">Session Types</div> <div class="field__items"> <div class="field__item"><a href="/category/2016-session-types/technical-assistance" hreflang="en">Technical Assistance</a></div> <div class="field__item"><a href="/category/2016-session-types/concurrent-session" hreflang="en">Concurrent Session</a></div> </div> </div> <div class="field field--name-field-theme-strand field--type-entity-reference field--label-above"> <div class="field__label">Theme/Strand</div> <div class="field__items"> <div class="field__item"><a href="/category/themestrand/project-design-implementation-dissemination" hreflang="en">Project Design, Implementation, &amp; Dissemination</a></div> </div> </div> <section class="field field--name-field-comments field--type-comment field--label-above comment-wrapper"> </section> Fri, 27 Apr 2018 20:22:37 +0000 Cadre-Admin 11845 at Measuring Latent Constructs /session/measuring-latent-constructs <span class="field field--name-title field--type-string field--label-hidden">Measuring Latent Constructs</span> <div class="clearfix text-formatted field field--name-field-session-short-description field--type-text-long field--label-hidden field__item"><p>The session details the measurement of latent constructs and provides practical training on the use of confirmatory factor analysis and latent trait models.</p> </div> <span class="field field--name-uid field--type-entity-reference field--label-hidden"><a title="View user profile." href="/users/cadre-admin" class="username">Cadre-Admin</a></span> <span class="field field--name-created field--type-created field--label-hidden"><time datetime="2018-04-27T14:45:12-04:00" title="Friday, April 27, 2018 - 14:45" class="datetime">Fri, 04/27/2018 - 14:45</time> </span> <div class="field field--name-field-session-date-time field--type-daterange field--label-above"> <div class="field__label">Date/Time</div> <div class="field__items"> <div class="field__item"><time datetime="2018-06-07T10:45:00Z" class="datetime">Thursday, June 7, 2018 - 10:45</time> - <time datetime="2018-06-07T12:15:00Z" class="datetime">Thursday, June 7, 2018 - 12:15</time> </div> </div> </div> <div class="field field--name-field-session-location field--type-link field--label-above"> <div class="field__label">Location</div> <div class="field__item"><a href="/sites/default/files/Full%20Map%202018%20PI%20Meeting.pdf">Hoover</a></div> </div> <div class="field field--name-field-presenters field--type-entity-reference field--label-above"> <div class="field__label">Presenters</div> <div class="field__items"> <div class="field__item"><a href="/users/benjamin-kelcey" hreflang="und">Benjamin Kelcey</a></div> <div class="field__item"><a href="/users/finbarr-sloane" hreflang="und">Finbarr Sloane</a></div> </div> </div> <div class="clearfix text-formatted field field--name-body field--type-text-with-summary field--label-hidden field__item"><p>This session provides an accessible introduction to the principles and practice of measuring latent traits in STEM studies as well as their implementation in common statistical software. Presenters first outline the motivation for latent traits and the practical challenges to measuring them in STEM studies. They then introduce case studies focused on measuring several different types of latent constructs associated with STEM education in different contextual settings. Presenters consider applied illustrations in detail and demonstrate them through hands-on examples of confirmatory factor analyses in software. They then consider multilevel extensions to these concepts in STEM settings and investigate other participant-generated considerations and challenges. The session concludes with a discussion of practical measurement plans related to study design and the assessment of intervention effects.</p> </div> <div class="field field--name-field-session-types field--type-entity-reference field--label-above"> <div class="field__label">Session Types</div> <div class="field__items"> <div class="field__item"><a href="/category/2016-session-types/technical-assistance" hreflang="en">Technical Assistance</a></div> <div class="field__item"><a href="/category/2016-session-types/concurrent-session" hreflang="en">Concurrent Session</a></div> </div> </div> <div class="field field--name-field-theme-strand field--type-entity-reference field--label-above"> <div class="field__label">Theme/Strand</div> <div class="field__items"> <div class="field__item"><a href="/category/themestrand/project-design-implementation-dissemination" hreflang="en">Project Design, Implementation, &amp; Dissemination</a></div> </div> </div> <section class="field field--name-field-comments field--type-comment field--label-above comment-wrapper"> </section> Fri, 27 Apr 2018 18:45:12 +0000 Cadre-Admin 11837 at /session/measuring-latent-constructs#comments Exploring Variation in Discourse and Interactional Analyses /session/exploring-variation-discourse-and-interactional-analyses <span class="field field--name-title field--type-string field--label-hidden">Exploring Variation in Discourse and Interactional Analyses</span> <div class="clearfix text-formatted field field--name-field-session-short-description field--type-text-long field--label-hidden field__item"><p>Presenters engage the audience in various theories and methods for discourse and interactional analysis, exploring the ways in which these approaches shape researchers’ claims.</p> </div> <span class="field field--name-uid field--type-entity-reference field--label-hidden"><a title="View user profile." href="/users/cadre-admin" class="username">Cadre-Admin</a></span> <span class="field field--name-created field--type-created field--label-hidden"><time datetime="2018-04-27T14:41:15-04:00" title="Friday, April 27, 2018 - 14:41" class="datetime">Fri, 04/27/2018 - 14:41</time> </span> <div class="field field--name-field-session-date-time field--type-daterange field--label-above"> <div class="field__label">Date/Time</div> <div class="field__items"> <div class="field__item"><time datetime="2018-06-07T10:45:00Z" class="datetime">Thursday, June 7, 2018 - 10:45</time> - <time datetime="2018-06-07T12:15:00Z" class="datetime">Thursday, June 7, 2018 - 12:15</time> </div> </div> </div> <div class="field field--name-field-session-location field--type-link field--label-above"> <div class="field__label">Location</div> <div class="field__item"><a href="/sites/default/files/Full%20Map%202018%20PI%20Meeting.pdf">Wilson A</a></div> </div> <div class="field field--name-field-presenters field--type-entity-reference field--label-above"> <div class="field__label">Presenters</div> <div class="field__items"> <div class="field__item"><a href="/users/megan-bang" hreflang="und">Megan Bang</a></div> <div class="field__item"><a href="/users/leema-berland" hreflang="und">Leema Berland</a></div> <div class="field__item"><a href="/users/sylvia-celedon-pattichis" hreflang="und">Sylvia Celedon-Pattichis</a></div> <div class="field__item"><a href="/users/beth-herbel-eisenmann" hreflang="und">Beth Herbel-Eisenmann</a></div> </div> </div> <div class="field field--name-field-session-types field--type-entity-reference field--label-above"> <div class="field__label">Session Types</div> <div class="field__items"> <div class="field__item"><a href="/category/2016-session-types/technical-assistance" hreflang="en">Technical Assistance</a></div> <div class="field__item"><a href="/category/2016-session-types/concurrent-session" hreflang="en">Concurrent Session</a></div> </div> </div> <div class="field field--name-field-theme-strand field--type-entity-reference field--label-above"> <div class="field__label">Theme/Strand</div> <div class="field__items"> <div class="field__item"><a href="/category/themestrand/project-design-implementation-dissemination" hreflang="en">Project Design, Implementation, &amp; Dissemination</a></div> </div> </div> <section class="field field--name-field-comments field--type-comment field--label-above comment-wrapper"> </section> Fri, 27 Apr 2018 18:41:15 +0000 Cadre-Admin 11836 at /session/exploring-variation-discourse-and-interactional-analyses#comments Designing Multilevel Studies /session/designing-multilevel-studies <span class="field field--name-title field--type-string field--label-hidden">Designing Multilevel Studies</span> <div class="clearfix text-formatted field field--name-field-session-short-description field--type-text-long field--label-hidden field__item"><p>Using practical training and STEM study examples, presenters provide training on planning efficient and effective impact studies in multilevel settings.</p> </div> <span class="field field--name-uid field--type-entity-reference field--label-hidden"><a title="View user profile." href="/users/cadre-admin" class="username">Cadre-Admin</a></span> <span class="field field--name-created field--type-created field--label-hidden"><time datetime="2018-04-26T17:10:43-04:00" title="Thursday, April 26, 2018 - 17:10" class="datetime">Thu, 04/26/2018 - 17:10</time> </span> <div class="field field--name-field-session-date-time field--type-daterange field--label-above"> <div class="field__label">Date/Time</div> <div class="field__items"> <div class="field__item"><time datetime="2018-06-06T12:00:00Z" class="datetime">Wednesday, June 6, 2018 - 12:00</time> - <time datetime="2018-06-06T14:00:00Z" class="datetime">Wednesday, June 6, 2018 - 14:00</time> </div> </div> </div> <div class="field field--name-field-session-location field--type-link field--label-above"> <div class="field__label">Location</div> <div class="field__item"><a href="/sites/default/files/Full%20Map%202018%20PI%20Meeting.pdf">Jackson</a></div> </div> <div class="field field--name-field-presenters field--type-entity-reference field--label-above"> <div class="field__label">Presenters</div> <div class="field__items"> <div class="field__item"><a href="/users/jessaca-spybrook" hreflang="und">Jessaca Spybrook</a></div> <div class="field__item"><a href="/users/finbarr-sloane" hreflang="und">Finbarr Sloane</a></div> </div> </div> <div class="clearfix text-formatted field field--name-body field--type-text-with-summary field--label-hidden field__item"><p>The purpose of this session is to train researchers in how to plan efficient and effective studies in multilevel settings (e.g., students nested within classrooms and schools) using several common designs. Topics include the basic concepts of multilevel design, the rationale for multilevel designs, identifying and selecting an appropriate design, practical study considerations and constraints, planning and estimating the necessary scale of studies with different designs, and strategies for reducing the sample sizes needed to conduct studies<a id="_anchor_1" name="_msoanchor_1" href="#_msocom_1"></a>. Explication of each of these topics is anchored in the STEM-specific examples and combines lecture, software demonstrations, and practical exercises for participants in the free software PowerUP!</p> </div> <div class="field field--name-field-session-types field--type-entity-reference field--label-above"> <div class="field__label">Session Types</div> <div class="field__items"> <div class="field__item"><a href="/category/2016-session-types/technical-assistance" hreflang="en">Technical Assistance</a></div> <div class="field__item"><a href="/category/2016-session-types/concurrent-session" hreflang="en">Concurrent Session</a></div> </div> </div> <div class="field field--name-field-theme-strand field--type-entity-reference field--label-above"> <div class="field__label">Theme/Strand</div> <div class="field__items"> <div class="field__item"><a href="/category/themestrand/project-design-implementation-dissemination" hreflang="en">Project Design, Implementation, &amp; Dissemination</a></div> </div> </div> <section class="field field--name-field-comments field--type-comment field--label-above comment-wrapper"> </section> Thu, 26 Apr 2018 21:10:43 +0000 Cadre-Admin 11824 at /session/designing-multilevel-studies#comments