{"id":17645,"date":"2019-01-31T01:33:45","date_gmt":"2019-01-31T06:33:45","guid":{"rendered":"https:\/\/fcit.usf.edu\/matrix\/?p=17645"},"modified":"2019-07-06T00:07:20","modified_gmt":"2019-07-06T04:07:20","slug":"roles-for-research-and-evaluation","status":"publish","type":"post","link":"https:\/\/fcit.usf.edu\/matrix\/roles-for-research-and-evaluation\/","title":{"rendered":"Leveraging TIM Tools Roles for Research and Evaluation"},"content":{"rendered":"<p>[et_pb_section bb_built=&#8221;1&#8243; inner_width=&#8221;auto&#8221; inner_max_width=&#8221;none&#8221;][et_pb_row][et_pb_column type=&#8221;4_4&#8243; custom_padding__hover=&#8221;|||&#8221; custom_padding=&#8221;|||&#8221;][et_pb_image _builder_version=&#8221;3.19.4&#8243; src=&#8221;https:\/\/fcit.usf.edu\/matrix\/wp-content\/uploads\/2019\/01\/ResearchRolesHeader.jpg&#8221; align_last_edited=&#8221;on|desktop&#8221; align_tablet=&#8221;center&#8221; \/][et_pb_text _builder_version=&#8221;3.22.7&#8243; text_text_shadow_horizontal_length=&#8221;text_text_shadow_style,%91object Object%93&#8243; text_text_shadow_vertical_length=&#8221;text_text_shadow_style,%91object Object%93&#8243; text_text_shadow_blur_strength=&#8221;text_text_shadow_style,%91object Object%93&#8243; link_text_shadow_horizontal_length=&#8221;link_text_shadow_style,%91object Object%93&#8243; link_text_shadow_vertical_length=&#8221;link_text_shadow_style,%91object Object%93&#8243; link_text_shadow_blur_strength=&#8221;link_text_shadow_style,%91object Object%93&#8243; ul_text_shadow_horizontal_length=&#8221;ul_text_shadow_style,%91object Object%93&#8243; ul_text_shadow_vertical_length=&#8221;ul_text_shadow_style,%91object Object%93&#8243; ul_text_shadow_blur_strength=&#8221;ul_text_shadow_style,%91object Object%93&#8243; ol_text_shadow_horizontal_length=&#8221;ol_text_shadow_style,%91object Object%93&#8243; ol_text_shadow_vertical_length=&#8221;ol_text_shadow_style,%91object Object%93&#8243; ol_text_shadow_blur_strength=&#8221;ol_text_shadow_style,%91object Object%93&#8243; quote_text_shadow_horizontal_length=&#8221;quote_text_shadow_style,%91object Object%93&#8243; quote_text_shadow_vertical_length=&#8221;quote_text_shadow_style,%91object Object%93&#8243; quote_text_shadow_blur_strength=&#8221;quote_text_shadow_style,%91object Object%93&#8243; header_text_shadow_horizontal_length=&#8221;header_text_shadow_style,%91object Object%93&#8243; header_text_shadow_vertical_length=&#8221;header_text_shadow_style,%91object Object%93&#8243; header_text_shadow_blur_strength=&#8221;header_text_shadow_style,%91object Object%93&#8243; header_2_text_shadow_horizontal_length=&#8221;header_2_text_shadow_style,%91object Object%93&#8243; header_2_text_shadow_vertical_length=&#8221;header_2_text_shadow_style,%91object Object%93&#8243; header_2_text_shadow_blur_strength=&#8221;header_2_text_shadow_style,%91object Object%93&#8243; header_3_text_shadow_horizontal_length=&#8221;header_3_text_shadow_style,%91object Object%93&#8243; header_3_text_shadow_vertical_length=&#8221;header_3_text_shadow_style,%91object Object%93&#8243; header_3_text_shadow_blur_strength=&#8221;header_3_text_shadow_style,%91object Object%93&#8243; header_4_text_shadow_horizontal_length=&#8221;header_4_text_shadow_style,%91object Object%93&#8243; header_4_text_shadow_vertical_length=&#8221;header_4_text_shadow_style,%91object Object%93&#8243; header_4_text_shadow_blur_strength=&#8221;header_4_text_shadow_style,%91object Object%93&#8243; header_5_text_shadow_horizontal_length=&#8221;header_5_text_shadow_style,%91object Object%93&#8243; header_5_text_shadow_vertical_length=&#8221;header_5_text_shadow_style,%91object Object%93&#8243; header_5_text_shadow_blur_strength=&#8221;header_5_text_shadow_style,%91object Object%93&#8243; header_6_text_shadow_horizontal_length=&#8221;header_6_text_shadow_style,%91object Object%93&#8243; header_6_text_shadow_vertical_length=&#8221;header_6_text_shadow_style,%91object Object%93&#8243; header_6_text_shadow_blur_strength=&#8221;header_6_text_shadow_style,%91object Object%93&#8243; z_index_tablet=&#8221;500&#8243;]<\/p>\n<p>The addition of customizable roles in TIM Tools v6.0 has made it convenient to create and track different groups when evaluating technology initiatives, PD programs, or other interventions. The new roles feature defines eight different sets of permissions, or roles, within the TIM Tools environment. For example, the role of \u201cTeacher\u201d may have permission to take the TUPS, while the role of \u201cSchool Observer\u201d may have permission to conduct observations using the TIM-O.  Any of the default roles can be duplicated and then renamed as needed for your purposes. The roles feature was created primarily for administrative purposes, but we can extend the functionality to become a valuable tool in research and evaluation. <\/p>\n<p>While the procedures outlined here would apply for other roles, this post will assume that you are going to look at teacher data. If, for example, you want to compare teachers who participated in a special summer institute with a matched group of teachers who did not participate, you could simply create two duplicates of the current \u201cTeacher\u201d role, and then name one of the new roles \u201cTeacher: Summer Institute\u201d and the other new role \u201cTeacher: No Summer Institute.\u201d Then, change the role of the individual teachers in each of your groups from \u201cTeacher\u201d to either \u201cTeacher: Summer Institute\u201d or \u201cTeacher: No Summer Institute\u201d as appropriate, and you are ready to generate reports for both the treatment and control groups.<\/p>\n<p>If, instead of participation in a particular training or event, you want to evaluate the effect of access to a TIM Tools application component, you may want to adjust the access given to different teachers for a particular tool. For example you may want your control group not to have access to the Reflection Tool and the experimental group to have access. Or you might use access to ARTI (the action research tool) as your differentiating element. We will discuss these options for further extending the roles feature for research and evaluation in an upcoming post. <\/p>\n<p>&nbsp;<\/p>\n<h2>How To Create a New Role<\/h2>\n<p>In the TIM Tools Admin Center, go to&nbsp;<strong>Members &gt; Define Member Roles<\/strong>. At the top of the page you will see a section entitled Add Role. Use the dropdown menu to select the role you would like to duplicate and then enter a name for the new role. When you click the&nbsp;<strong>GO<\/strong>&nbsp;button, the new role will be created and added to the grid of roles and permissions below.<\/p>\n<p><img decoding=\"async\" loading=\"lazy\" src=\"https:\/\/fcit.usf.edu\/matrix\/wp-content\/uploads\/2019\/01\/CreateRole.jpg\" alt=\"\" width=\"960\" height=\"391\" class=\"alignnone size-full wp-image-17585\" srcset=\"https:\/\/fcit.usf.edu\/matrix\/wp-content\/uploads\/2019\/01\/CreateRole.jpg 960w, https:\/\/fcit.usf.edu\/matrix\/wp-content\/uploads\/2019\/01\/CreateRole-300x122.jpg 300w, https:\/\/fcit.usf.edu\/matrix\/wp-content\/uploads\/2019\/01\/CreateRole-768x313.jpg 768w, https:\/\/fcit.usf.edu\/matrix\/wp-content\/uploads\/2019\/01\/CreateRole-610x248.jpg 610w\" sizes=\"(max-width: 960px) 100vw, 960px\" \/><\/p>\n<p><em>Figure 1. Creating the &#8220;Teacher X&#8221; role.<\/em><\/p>\n<p>&nbsp;<\/p>\n<p><img decoding=\"async\" loading=\"lazy\" src=\"https:\/\/fcit.usf.edu\/matrix\/wp-content\/uploads\/2019\/01\/CreateRole2-1.jpg\" alt=\"\" width=\"960\" height=\"391\" class=\"alignnone size-full wp-image-17590\" srcset=\"https:\/\/fcit.usf.edu\/matrix\/wp-content\/uploads\/2019\/01\/CreateRole2-1.jpg 960w, https:\/\/fcit.usf.edu\/matrix\/wp-content\/uploads\/2019\/01\/CreateRole2-1-300x122.jpg 300w, https:\/\/fcit.usf.edu\/matrix\/wp-content\/uploads\/2019\/01\/CreateRole2-1-768x313.jpg 768w, https:\/\/fcit.usf.edu\/matrix\/wp-content\/uploads\/2019\/01\/CreateRole2-1-610x248.jpg 610w\" sizes=\"(max-width: 960px) 100vw, 960px\" \/><\/p>\n<p><em>Figure 2. The &#8220;Teacher X&#8221; role appears in the Roles\/Permissions grid.<\/em><\/p>\n<p>&nbsp;<\/p>\n<p>You can name the new role anything you like. However, we suggest that you retain \u201cTeacher\u201d as part of the name, for example: Teacher 1:1, Teacher Tech Initiative, Teacher Tablet Cohort, etc. This naming convention may avoid confusion later. If you wish to create a report that includes all teacher data, it\u2019s easier to select Teacher and Teacher 1:1 rather than trying to remember to select names like Tech Gurus or Cart Classrooms.<\/p>\n<p>There is no technical limit to the number of roles you can create in a TIM Tools instance, although if you make a great many roles, your Role\/Permission grid will become a bit unwieldily to manage. <\/p>\n<p>&nbsp;<\/p>\n<h2>How To Tag the Teachers with the New Role<\/h2>\n<p>If you have just a small number of teachers that you would like to assign the new role, you may find it practical just to use either the&nbsp;<strong>Alphabetical List<\/strong>&nbsp;or the&nbsp;<strong>Search Members<\/strong>&nbsp;tab to bring up each teacher\u2019s profile and use the dropdown menu to reassign them to the new role. If you have more than a handful of teachers to reassign roles for, it\u2019ll be much quicker to use the spreadsheet method. From the&nbsp;<strong>Members by Spreadsheet<\/strong>&nbsp;tab, download the current list of members. If your district has many thousands of teachers this may take a minute or two. When you open the Excel file, you\u2019ll see that column E is labeled \u201cRole.\u201d Simply change the role number from 1 (that\u2019s the default Teacher role) to the ID number for the new role. You\u2019ll find the new role ID on the Roles\/Permissions grid. In Figure 2 above, the ID number for the \u201cTeacher X\u201d role is 16. Once you\u2019ve made the desired changes to the spreadsheet, upload it back into the system using the&nbsp;<strong>Members by Spreadsheet<\/strong>&nbsp;tab.<\/p>\n<p>&nbsp;<\/p>\n<h2>Accessing the Data<\/h2>\n<p>Now that you have your teachers grouped into two or more roles, you can start to pull data from your TIM Tools instance by any one role or combination of roles. Whether you are using the Report Tool to build a report for TUPS, TIM-O, TIM-LP, or TIM-R, or downloading the data from the Admin Center for use in the corresponding templates, you\u2019ll be able to select just the role or roles you want to include. In both the Report Tool and in the spreadsheet download interfaces, you\u2019ll see a dropdown menu for Roles. Simply select the role or roles you\u2019d like included. Control-click (command-click on a Mac) to select more than one role.<\/p>\n<p>BTW, don\u2019t be surprised to see that the dropdown menu has appended an \u201cs\u201d to your newly-created role\u2019s name. The system does that automatically because in most cases that makes it appear more natural.&nbsp;<\/p>\n<p>And, as always, you can download the raw data for use in your preferred statistics package. The role for each member will be indicated by the role ID you see on the Roles\/Permissions grid.<\/p>\n<p>Related post: See <a href=\"https:\/\/fcit.usf.edu\/matrix\/rockin-roles-in-tim-tools-6-0\/\">Rockin&#8217; Roles in TIM Tools 6.0<\/a> for more on creating and modifying roles.<\/p>\n<p>[\/et_pb_text][et_pb_text admin_label=&#8221;CH Bio Text&#8221; _builder_version=&#8221;3.19.9&#8243; saved_tabs=&#8221;all&#8221; global_module=&#8221;17647&#8243;]<\/p>\n<p><em><strong>Christine Harmes<\/strong> is a consultant on research, measurement, and evaluation. \u00a0Her research\u00a0interests focus on improving teacher use of\u00a0technology, computer-based testing and usability. \u00a0At the\u00a0Florida Center for Instructional Technology at the University of South Florida, Dr. Harmes focuses on research and tool development related to technology integration.<\/em><\/p>\n<p>[\/et_pb_text][et_pb_text admin_label=&#8221;Newsletter Subscription Call to Action&#8221; _builder_version=&#8221;3.17.6&#8243; saved_tabs=&#8221;all&#8221; global_module=&#8221;17425&#8243;]<\/p>\n<p><strong>FCIT Newsletter<\/strong><\/p>\n<p>Each month FCIT publishes a newsletter with short articles on teaching and learning with technology, using digital content in the classroom, and technology integration. <a href=\"https:\/\/fcit.usf.edu\/project\/subscribe-to-the-fcit-newsletter\/\" rel=\"noopener noreferrer\" target=\"_blank\">Subscribe today!<\/a> The subscription form will open in a new window. When you have subscribed, you can close the new window to return to this page.<\/p>\n<p>[\/et_pb_text][et_pb_code admin_label=&#8221;AddThis Global Code Module&#8221; _builder_version=&#8221;3.0.92&#8243; saved_tabs=&#8221;all&#8221; global_module=&#8221;14658&#8243;]&lt;!&#8211; AddThis Button BEGIN &#8211;&gt;&lt;!&#8211; [et_pb_line_break_holder] &#8211;&gt;&lt;div class=&quot;addthis_toolbox addthis_default_style &quot;&gt;&lt;!&#8211; [et_pb_line_break_holder] &#8211;&gt;  &lt;a class=&quot;addthis_button_preferred_1&quot;&gt;&lt;\/a&gt;&lt;!&#8211; [et_pb_line_break_holder] &#8211;&gt;  &lt;a class=&quot;addthis_button_preferred_2&quot;&gt;&lt;\/a&gt;&lt;!&#8211; [et_pb_line_break_holder] &#8211;&gt;  &lt;a class=&quot;addthis_button_preferred_3&quot;&gt;&lt;\/a&gt;&lt;!&#8211; [et_pb_line_break_holder] &#8211;&gt;  &lt;a class=&quot;addthis_button_preferred_4&quot;&gt;&lt;\/a&gt;&lt;!&#8211; [et_pb_line_break_holder] &#8211;&gt;  &lt;a class=&quot;addthis_button_compact&quot;&gt;&lt;\/a&gt;&lt;!&#8211; [et_pb_line_break_holder] &#8211;&gt;  &lt;a class=&quot;addthis_counter addthis_bubble_style&quot;&gt;&lt;\/a&gt;&lt;!&#8211; [et_pb_line_break_holder] &#8211;&gt;&lt;\/div&gt;&lt;!&#8211; [et_pb_line_break_holder] &#8211;&gt;&lt;script type=&quot;text\/javascript&quot;&gt;var addthis_config = {&quot;data_track_addressbar&quot;:false};&lt;\/script&gt;&lt;!&#8211; [et_pb_line_break_holder] &#8211;&gt;&lt;script type=&quot;text\/javascript&quot; src=&quot;\/\/s7.addthis.com\/js\/300\/addthis_widget.js#pubid=roywinkelman&quot;&gt;&lt;\/script&gt;&lt;!&#8211; [et_pb_line_break_holder] &#8211;&gt;&lt;!&#8211; AddThis Button END &#8211;&gt;[\/et_pb_code][\/et_pb_column][\/et_pb_row][\/et_pb_section]<\/p>\n<!-- AddThis Advanced Settings generic via filter on the_content --><!-- AddThis Share Buttons generic via filter on the_content -->","protected":false},"excerpt":{"rendered":"<p><div class=\"et_pb_row et_pb_row_0 et_pb_row_empty\">\n\t\t\t\t\n\t\t\t\t\n\t\t\t\t\n\t\t\t\t\n\t\t\t\t\n\t\t\t<\/div> The addition of customizable roles in TIM Tools v6.0 has made it convenient to create and track different groups when evaluating technology initiatives, PD programs, or other interventions. The new roles feature defines eight different sets of permissions, or roles, within the TIM Tools environment. For example, the role of \u201cTeacher\u201d may have permission [&hellip;]<\/p>\n<p><!-- AddThis Advanced Settings generic via filter on get_the_excerpt --><!-- AddThis Share Buttons generic via filter on get_the_excerpt --><\/p>\n","protected":false},"author":7,"featured_media":17650,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_et_pb_use_builder":"on","_et_pb_old_content":"","_et_gb_content_width":""},"categories":[146],"tags":[],"_links":{"self":[{"href":"https:\/\/fcit.usf.edu\/matrix\/wp-json\/wp\/v2\/posts\/17645"}],"collection":[{"href":"https:\/\/fcit.usf.edu\/matrix\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/fcit.usf.edu\/matrix\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/fcit.usf.edu\/matrix\/wp-json\/wp\/v2\/users\/7"}],"replies":[{"embeddable":true,"href":"https:\/\/fcit.usf.edu\/matrix\/wp-json\/wp\/v2\/comments?post=17645"}],"version-history":[{"count":6,"href":"https:\/\/fcit.usf.edu\/matrix\/wp-json\/wp\/v2\/posts\/17645\/revisions"}],"predecessor-version":[{"id":18882,"href":"https:\/\/fcit.usf.edu\/matrix\/wp-json\/wp\/v2\/posts\/17645\/revisions\/18882"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/fcit.usf.edu\/matrix\/wp-json\/wp\/v2\/media\/17650"}],"wp:attachment":[{"href":"https:\/\/fcit.usf.edu\/matrix\/wp-json\/wp\/v2\/media?parent=17645"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/fcit.usf.edu\/matrix\/wp-json\/wp\/v2\/categories?post=17645"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/fcit.usf.edu\/matrix\/wp-json\/wp\/v2\/tags?post=17645"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}