{"id":277,"date":"2011-10-26T17:58:00","date_gmt":"2011-10-26T17:58:00","guid":{"rendered":"http:\/\/geoffcain.com\/blog\/uncategorized\/openness-and-learning-analytics\/"},"modified":"2011-10-26T17:58:00","modified_gmt":"2011-10-26T17:58:00","slug":"openness-and-learning-analytics","status":"publish","type":"post","link":"https:\/\/geoffcain.com\/blog\/openness-and-learning-analytics\/","title":{"rendered":"Openness and Learning Analytics"},"content":{"rendered":"<p><span style=\"clear: right;\"><a href=\"http:\/\/www.flickr.com\/photos\/36521981180@N01\/2284812361\" style=\"clear: right; display: block; float: right; margin-left: 1em; margin-right: 1em;\"><img loading=\"lazy\" decoding=\"async\" alt=\"Human Graphing - 20\" height=\"240\" src=\"http:\/\/farm4.static.flickr.com\/3034\/2284812361_7a87024cd6_m.jpg\" style=\"border: none; font-size: 0.8em;\" width=\"159\" \/><\/a><span style=\"clear: both; float: right; margin-left: 1em; margin-right: 1em; width: 159px;\"><span style=\"font-family: Arial, Helvetica, sans-serif; font-size: xx-small;\">Image by <a href=\"http:\/\/www.flickr.com\/photos\/36521981180@N01\/2284812361\">nep<\/a> via Flickr<\/span><\/span><\/span><b>Speakers:<\/b> John Rinderle Norman Bier<br \/>Revise\/Remix can build a 1000 points of <a href=\"http:\/\/en.wikipedia.org\/wiki\/Open_educational_resources\" rel=\"wikipedia\" title=\"Open educational resources\">OER<\/a> light. Can these lights converge to fire authentic <a href=\"http:\/\/en.wikipedia.org\/wiki\/Learning\" rel=\"wikipedia\" title=\"Learning\">learning<\/a> <a href=\"http:\/\/en.wikipedia.org\/wiki\/Analytics\" rel=\"wikipedia\" title=\"Analytics\">analytics<\/a> &amp; <a href=\"http:\/\/en.wikipedia.org\/wiki\/Share-alike\" rel=\"wikipedia\" title=\"Share-alike\">share-alike<\/a> <a href=\"http:\/\/en.wikipedia.org\/wiki\/Data_model\" rel=\"wikipedia\" title=\"Data model\">data models<\/a>?<\/p>\n<p>Conventional wisdom in the OER community maintains that one of the more important features of the <a href=\"http:\/\/en.wikipedia.org\/wiki\/Open_education\" rel=\"wikipedia\" title=\"Open education\">open education<\/a> approach is the malleability and customizability of materials, allowing freely available component resources to be remixed, adapted and modified to suit specific institutional directives, student needs or faculty interests.  These features are important enough that the ability to revise and remix content is a core part of the commonly accepted 4R framework that defines <a href=\"http:\/\/en.wikipedia.org\/wiki\/Open_content\" rel=\"wikipedia\" title=\"Open content\">open content<\/a>.  While the ability to tailor OER to meet changing or specific needs is one compelling part of the open model, the infinity variety that this encourages creates serious obstacles for another expected benefit of openness: using learning analytics to drive adaptive teaching and learning, support iterative improvement, and demonstrate effectiveness.<\/p>\n<p>The ability to deliver meaningful learning analytics has been one promise of the open education approach.  A use-driven design process for OER depends on the resources being used by a large number of students with varied background knowledge, relevant skills and future goals\u2014a student population that open and well-used resources should be able to provide.  Such a process can use such interaction data to iteratively improve courses in a meaningful and empirical way.  Beyond improvement analytics, this same data can be used mid-stream to improve the effectiveness of learners and instructors.<\/p>\n<p>Despite this promise, the OER community has not been able to create or take advantage of widespread, generally applicable learning analytics tools.  While some organizations have had success in developing analytics platforms and approaches, such successes have tended to focus on specific resources, often developed with <a href=\"http:\/\/en.wikipedia.org\/wiki\/Data_collection\" rel=\"wikipedia\" title=\"Data collection\">data collection<\/a> in mind and not always falling at the \u201cmost open\u201d end of the open content continuum.  One barrier to more widespread analytic tools has been the variety of OER afforded by <a href=\"http:\/\/en.wikipedia.org\/wiki\/Remix\" rel=\"wikipedia\" title=\"Remix\">remixing<\/a> and revising.<\/p>\n<p>This presentation will explore the benefits and trade-offs to be made between adaptability and analytics.  In the course of this exploration, we will argue that the benefits to be had from an approach that places a higher priority on analytics may outweigh those to be gained from endless variety in the OER space.  Similarly, we will discuss some approaches to better harness open education\u2019s promised ability to drive learning analytics, with greater and lesser compromises to the adaptability of OER. We will propose open communities of use and evaluation coalesced around individual OERs using learning analytics to improve the resource through coordinated revision and remix. Open education has embraced share alike licenses for materials. The next logical step is the open exchange of learning data and evidence of effectiveness, to \u201cshare alike and share data\u201d. We will also suggest approaches to integrating disparate analytics-enabled OER into common platforms and the development of OER to published standards for learning analytic data.<\/p>\n<p><b>Notes:<\/b><br \/><a href=\"http:\/\/en.wikipedia.org\/wiki\/Open_learning\" rel=\"wikipedia\" title=\"Open learning\">Open Learning<\/a> Initiative:<br \/>Produce and improve scientifically-based courses and course materials which enact instruction and support instructors<\/p>\n<p>Outcomes:<br \/>Shared understanding of challenges, tensions, and possibilities in learning analytics<br \/>Describe community-based analytics plans<\/p>\n<p>Driving feedback loops. We have a huge opportunity to use assessment data around OERs. There are enormous amounts of data available. &nbsp;&#8220;Infinite points of light&#8221; around all the OER repositories and initiatives.<\/p>\n<p>Infinite proliferation<\/p>\n<p>The 4 Rs<\/p>\n<ol>\n<li>Reuse<\/li>\n<li>Redistribute<\/li>\n<li>Revising<\/li>\n<li>Remix<\/li>\n<\/ol>\n<p>Not recreate but to evaluate &#8211; recreate is a barrier to reuse.<\/p>\n<p>What drives change in these settings?<\/p>\n<ul>\n<li>Data&nbsp;<\/li>\n<li>Intuition<\/li>\n<li>Market demand<\/li>\n<li>Instructor preferences &#8211; change happens because an instructor gets bored with material, but with no real idea if the changes are improving the course.<\/li>\n<\/ul>\n<div>Effectiveness: An OER is effective when it demonstrably supports students in meeting articulated,&nbsp;measurable&nbsp;learning outcomes in a given set of contexts.&nbsp;<\/div>\n<div><\/div>\n<div>They are also looking at new forms of assessment for gathering data.<\/div>\n<div><\/div>\n<div>Rory McGreal asked whether or not there was a clearer way to talk about what is demonstrable. There are a lot of variables in the initial statement.<\/div>\n<div><\/div>\n<div>Why have we not been doing this?<\/p>\n<ul>\n<li>It&#8217;s hard<\/li>\n<li>Costly<\/li>\n<li>Individual faculty need support<\/li>\n<li>It can be threatening to educators<\/li>\n<li>Disparate systems for collecting data<\/li>\n<\/ul>\n<\/div>\n<p>What do we mean by &#8220;learning analytics&#8221;?<br \/>Proxies vs. authentic assessment and evaluation<\/p>\n<p>Analytics Definition<br \/><a href=\"http:\/\/en.wikipedia.org\/wiki\/Data_collection\" rel=\"wikipedia\" title=\"Data collection\">Data collection<\/a> &gt; reporting &gt; Decision making &gt; Intervention &gt; Action<br \/>Collecting data is not enough. We also need to make sense of it in ways that are actionable.<\/p>\n<p>Types of analytics<br \/>Education\/classroom management<br \/>Learning outcomes<\/p>\n<p>We need common, agreed upon standards, a core collection, and a space for exploration.<\/p>\n<p>Problems include privacy and technical issues.<\/p>\n<p>Tools that already exist:<br \/>DataShop, Evidence Hub, Learning registry, and communities of evidence<\/p>\n<p>Community College Open Learning Initiative<\/p>\n<p>And build new things:<br \/>We need better mechanisms to share data.<br \/>We need a community-based approach.<\/p>\n<p>Learning Intelligence Systems<br \/>What would be giving up? This approach forces us to allow our minds to be charged by evidence.<\/p>\n<p>Next Steps?<br \/>Innovate<br \/>Standardize<br \/>Scale<\/p>\n<ul>\n<li>Commitment to assessment and evaluation<\/li>\n<li>Community definition of analytics enabled OER<\/li>\n<li>Common approach to data<\/li>\n<li>Shared and private analytics platforms<\/li>\n<\/ul>\n<p><\/p>\n<div>\n<h6 style=\"font-size: 1em; margin: 1em 0 0 0;\">Related articles<\/h6>\n<ul>\n<li><a href=\"http:\/\/www.downes.ca\/post\/56118\/rd\">Taking OER beyond the OER Community<\/a> (downes.ca)<\/li>\n<li><a href=\"http:\/\/radar.oreilly.com\/2011\/07\/education-data-analytics-learning.html\">How data and analytics can improve education<\/a> (radar.oreilly.com)<\/li>\n<\/ul>\n<\/div>\n<div style=\"height: 15px; margin-top: 10px;\"><a href=\"http:\/\/www.zemanta.com\/\" title=\"Enhanced by Zemanta\"><img decoding=\"async\" alt=\"Enhanced by Zemanta\" class=\"zemanta-pixie-img\" src=\"http:\/\/img.zemanta.com\/zemified_e.png?x-id=26659644-068f-45f2-8441-d98ea508400f\" style=\"border: none; float: right;\" \/><\/a><\/div>\n","protected":false},"excerpt":{"rendered":"<p>Image by nep via FlickrSpeakers: John Rinderle Norman BierRevise\/Remix can build a 1000 points of OER light. Can these lights converge to fire authentic learning analytics &amp; share-alike data models? Conventional wisdom in the OER community maintains that one of &hellip; <a href=\"https:\/\/geoffcain.com\/blog\/openness-and-learning-analytics\/\">Continue reading <span class=\"meta-nav\">&rarr;<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[258,186,590,39,189,167,87],"tags":[155,365,591],"class_list":["post-277","post","type-post","status-publish","format-standard","hentry","category-analytics","category-assessment","category-data","category-oer","category-open-education","category-open-education-resources","category-open-educational-resources","tag-google","tag-open-content","tag-open-learning"],"_links":{"self":[{"href":"https:\/\/geoffcain.com\/blog\/wp-json\/wp\/v2\/posts\/277","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/geoffcain.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/geoffcain.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/geoffcain.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/geoffcain.com\/blog\/wp-json\/wp\/v2\/comments?post=277"}],"version-history":[{"count":0,"href":"https:\/\/geoffcain.com\/blog\/wp-json\/wp\/v2\/posts\/277\/revisions"}],"wp:attachment":[{"href":"https:\/\/geoffcain.com\/blog\/wp-json\/wp\/v2\/media?parent=277"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/geoffcain.com\/blog\/wp-json\/wp\/v2\/categories?post=277"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/geoffcain.com\/blog\/wp-json\/wp\/v2\/tags?post=277"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}