{"id":1632,"date":"2017-07-21T20:56:09","date_gmt":"2017-07-21T20:56:09","guid":{"rendered":"http:\/\/geoffcain.com\/blog\/?p=1632"},"modified":"2017-10-07T22:50:19","modified_gmt":"2017-10-07T22:50:19","slug":"evaluating-online-courses-a-prelude","status":"publish","type":"post","link":"https:\/\/geoffcain.com\/blog\/evaluating-online-courses-a-prelude\/","title":{"rendered":"Evaluating Online Courses: a prelude"},"content":{"rendered":"<p><img loading=\"lazy\" decoding=\"async\" class=\"alignright size-medium wp-image-1633\" src=\"http:\/\/geoffcain.com\/blog\/wp-content\/uploads\/2017\/07\/rubrics-cube-300x300.png\" alt=\"Rubrics cube. \" width=\"300\" height=\"300\" srcset=\"https:\/\/geoffcain.com\/blog\/wp-content\/uploads\/2017\/07\/rubrics-cube-300x300.png 300w, https:\/\/geoffcain.com\/blog\/wp-content\/uploads\/2017\/07\/rubrics-cube-150x150.png 150w, https:\/\/geoffcain.com\/blog\/wp-content\/uploads\/2017\/07\/rubrics-cube.png 365w\" sizes=\"auto, (max-width: 300px) 100vw, 300px\" \/><span style=\"font-weight: 400;\">This is the first of a seven part series examining how different institutions evaluate online courses. Each of the seven blog postings after this will feature a different rubric from a different institution for evaluating online courses. \u00a0I am specifically interested in what institutions have created, adapted, or purchased and why. Each posting will attempt to look at:<\/span><\/p>\n<ul>\n<li><span style=\"font-weight: 400;\">What problems does this rubric solve?<\/span><\/li>\n<li><span style=\"font-weight: 400;\">How is this solution tied into the campus community?<\/span><\/li>\n<li><span style=\"font-weight: 400;\">What is unique to this campus culture that is addressed by this rubric?<\/span><\/li>\n<\/ul>\n<p><span style=\"font-weight: 400;\">Some of the issues I have had as an instructor, instructional designer, and administrator is that the evaluation of online courses tends to be an afterthought &#8211; something you do only after a course is created and built. It is important that the specifications for online courses are communicated to faculty before the design process begins. This assumes that there is a \u201cdesign process\u201d and that is not always the case. For the use of rubrics for online course evaluation to work effectively, they must be a part of the course development process. This is not as intuitive as it sounds because different departments in a college may have historical processes for getting online courses created that differ from department to department.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">All of this begs the question: why use a rubric for evaluating courses at all? We don\u2019t have rubrics for evaluating face-to-face courses, why do we need them for online courses? First of all, instructors and students have had a life-long experience of being in face-to-face classrooms and there are accepted standards as to what constitutes a face-to-face classroom and how it should work. We do not have that yet in online learning despite the decades colleges have been offering online classes. With some notable exceptions, early online courses were concerned with the transfer of information which is not the same as teaching and learning. <\/span><\/p>\n<p><span style=\"font-weight: 400;\">Many instructors and institutions were not clear on how learning occurs online. Since the 90s, there has been a lot of research on how people teach and learn online successfully. Interestingly enough, that research follows the same lines of research around how to teach effectively in face-to-face courses. I am thinking here of Chickering and Ehrmann\u2019s <\/span><a href=\"http:\/\/www.tltgroup.org\/programs\/seven\"><span style=\"font-weight: 400;\">online follow-ups<\/span><\/a><span style=\"font-weight: 400;\"> to Chickering and Gamson\u2019s research in <\/span><a href=\"http:\/\/teaching.uncc.edu\/best-practice\/education-philosophy\/seven-principles\"><span style=\"font-weight: 400;\">face-to-face undergraduate success<\/span><\/a><span style=\"font-weight: 400;\">. The rubrics for evaluating online courses can be a method for communicating the expectations or best practices of online learning and teaching for new teachers or for teachers who have not had a lot of experience online. <\/span><\/p>\n<p><span style=\"font-weight: 400;\">All of that said, these rubrics are not a teacher evaluation tool. One can build a course to the specifications of a rubric and still have an unsuccessful course. Its implementation and success will always rest in the teacher\u2019s hands. <\/span><\/p>\n<p><span style=\"font-weight: 400;\">And not all rubrics are created equal. Some of them are very basic, some of them try to evaluate things that are difficult to account for in a rubric: cultural inclusivity, for instance, is something that may best be accounted for by formal peer and student evaluations. Not all of the rubrics stress enough of the things that we now know are critical to online course success such as community, or the latest research around <a href=\"http:\/\/www.itdl.org\/Journal\/Jan_05\/article01.htm\">Connectivism<\/a> and <a href=\"https:\/\/library.educause.edu\/resources\/2016\/8\/7-things-you-should-read-about-open-pedagogy-and-the-evolution-of-the-lms\">Open Pedagogy<\/a>. Despite the research into successful online learning, there can still be great disparities in universities between their online courses and face-to-face. One cause of this is because despite the widespread implementation of various solutions, each institution is unique &#8211; each institution is embedded in a community with different needs. The question I hope to answer this summer, is how do we account for this uniqueness while attempting to apply a solution from outside the institution? What we are really doing when we adopt a course evaluation rubric? What are the concerns or opportunities when adopting a rubric?<\/span><\/p>\n<p><span style=\"font-weight: 400;\">My goal at the end of these postings will be to present a meta-rubric for evaluating course evaluation rubrics (something along the lines of <\/span><a href=\"http:\/\/www.asu.edu\/courses\/asu101\/asuonline\/temp\/rubric_%20for_rubrics.pdf\"><span style=\"font-weight: 400;\">Dr. Mollinix at Monmouth University<\/span><\/a><span style=\"font-weight: 400;\">) and to develop an adoption plan for instructors, departments, or institutions that will address the needs of the learning community, the professional development of the instructors, and the goals of the departments or institutions.<\/span><\/p>\n<p>The rubrics I am evaluating include:<\/p>\n<ol>\n<li style=\"font-weight: 400;\"><a href=\"http:\/\/ccconlineed.org\/wp-content\/uploads\/2015\/11\/oei-ocdr_r1-20150501-CC-license.pdf\"><span style=\"font-weight: 400;\">OEI: Course Design Rubric for the Online Education Initiative<\/span><\/a>, (California Community College&#8217;s Chancellor&#8217;s Office)<\/li>\n<li><a href=\"https:\/\/www.qualitymatters.org\/\">Quality Matters<\/a><\/li>\n<li><a href=\"http:\/\/www.ion.uillinois.edu\/initiatives\/qoci\/rubric.asp\">Quality Online Course Initiative Rubric and Checklist<\/a> (Illinois Online Network)<\/li>\n<li><a href=\"http:\/\/www.toddhitchcock.com\/resources\/OCEP.pdf\">Online Course Evaluation Project (OCEP)<\/a>, (Monterey Institute for Technology and Education)<\/li>\n<li><a href=\"http:\/\/globalapp.cmich.edu\/CIDForms\/#\/quality-assurance\">Quality Assurance Checklist<\/a> (Central Michigan University)<\/li>\n<li><a href=\"http:\/\/www.wcu.edu\/WebFiles\/PDFs\/facultycenter_OCAT_v2.0_25apr07.pdf\">Online Course Assessment Tool (OCAT) and Peer Assessment Process<\/a>, (Western Carolina University).<\/li>\n<li><a href=\"http:\/\/courseredesign.csuprojects.org\/wp\/qualityassurance\/qolt-instruments\/\">Quality Online Learning and Teaching<\/a>, (California State University)<\/li>\n<\/ol>\n<p>Let me know if you would like me to look at others or to let me know about your experience with online course evaluation rubrics (the good, the bad, and the ugly). I would love to hear from you.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>This is the first of a seven part series examining how different institutions evaluate online courses. Each of the seven blog postings after this will feature a different rubric from a different institution for evaluating online courses. \u00a0I am specifically &hellip; <a href=\"https:\/\/geoffcain.com\/blog\/evaluating-online-courses-a-prelude\/\">Continue reading <span class=\"meta-nav\">&rarr;<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[73],"tags":[1053,1129,1256,274,1060,1278,1020],"class_list":["post-1632","post","type-post","status-publish","format-standard","hentry","category-education","tag-assessment","tag-elearning","tag-evaluation","tag-online-learning","tag-open-pedagogy","tag-qarubrics","tag-rubrics"],"_links":{"self":[{"href":"https:\/\/geoffcain.com\/blog\/wp-json\/wp\/v2\/posts\/1632","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/geoffcain.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/geoffcain.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/geoffcain.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/geoffcain.com\/blog\/wp-json\/wp\/v2\/comments?post=1632"}],"version-history":[{"count":0,"href":"https:\/\/geoffcain.com\/blog\/wp-json\/wp\/v2\/posts\/1632\/revisions"}],"wp:attachment":[{"href":"https:\/\/geoffcain.com\/blog\/wp-json\/wp\/v2\/media?parent=1632"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/geoffcain.com\/blog\/wp-json\/wp\/v2\/categories?post=1632"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/geoffcain.com\/blog\/wp-json\/wp\/v2\/tags?post=1632"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}