Week #4 - EDUC5101G Responses to Posts

Mary-Anne's Post: 
http://mvardakas.weebly.com/blog/week-4-evaluating-digital-tools-for-education-looking-at-lori-and-techpuddings-evaluation-checklist-for-tech-tools#comments

Hi Mary-Ann!  I enjoyed reading your blog.  You have chosen the interesting topic that we discussed in class this week – the criteria/checklist for evaluating digital tools.  As we know, there are many checklists available – you have completed a thorough review and comparison of the Learning Object Review Instrument (LORI) and Chan’s Checklist for Evaluating Tech Tools, Apps, Software and Hardware.  I have experienced the same when reviewing these checklists - just when you think a list is quite complete and makes sense, you come across a different list that reminds you of other criteria that is important.  As you have discussed in your blog, these checklists have evolved over time.  They are now much more learner-centred with an emphasis on accessibility, technical support, quality pedagogy, collaboration and security.  I couldn’t agree with you more – we need tools that develop the required critical thinking and higher order thinking skills – essential skills for today’s workplace.  In my workplace, I am not aware that we use checklists before investing in a digital tool for learning, which is unfortunate.  However, cost, compatibility, functionality, tech support and privacy would be the important criteria we would consider.  After recognizing the value that these checklists bring, I will be recommending that we do reference a recent one, such as Chan’s checklist, before making a business decision on a standard tool to use.

In doing my own research on this topic, I came across another approach to evaluating new technology, and it included a process (see below) – Scan, Focus, Evaluate and Decide. I personally feel this process would be useful prior to reviewing a specific checklist.  

A company called Bottom-Line Performance (who created this process) needed a way to objectively evaluate technologies and separate the good from the bad – enabling them to make smarter technology adoption decisions.  This company also developed a checklist to accompany this process (Huhn, 2013).

.

References:

Huhn, J. (2013). Technology evaluation checklist for learning professionals. Bottom-Line Performance Lessons on learning. Retrieved from http://www.bottomlineperformance.com/technology-evaluation-checklist-for-learning-professionals-free-download/

Michelle Mouton's Post:
http://moutondigitaltools.blogspot.ca/2016/02/week-4-blog-4.html#comment-form

Hi Michelle!  I enjoyed reading your post.  Since I do not work for a College, it was interesting to learn about OntarioLearn.  What a great job you have and an important one!  To ensure each course is of high quality can’t be an easy task.  It sounds like the Quality Matters Rubric is the King of all rubrics.  I think the concept of alignment is a critical one and you are “hitting the mark” by placing such an importance on ensuring course components work together to ensure that learners achieve the desired learning outcomes.  We are attracted to the new technology that comes our way, so it is important that we are grounded in meeting the learning objectives.

To answer your question about the use of the Quality Matters Rubric, I don’t believe it will be easy for faculty.  With any new process, there is a learning curve to grasp the concepts and the value it brings.  It will take time and aligning the tools with learning outcomes will not be straight forward – additional support will be required.  You are correct when saying knowledge of the tool and pedagogy are both required.  Not only does faculty have limited time to learn new tools and implement them, but there is a wide range of technical knowledge that needs to be considered.

I came across a site that speaks to another rubric for evaluating online courses--California State University’s  Chico Rubric for Online Instruction.  The priority for this rubric is to create and enhance high quality learning environments.   Apparently, there is an updated version of the Chico rubric which is a checklist format with additional dimensions and similar to the Quality Matters Rubric.  A reader commented that they prefer the updated version of Chico compared to the Quality Matters Rubric as its more approachable, less lengthy and less rigid.  This site might interest you as it speaks about why assessing quality is difficult in online education and the limitations with online assessments.  Here is the link https://onlinelearninginsights.wordpress.com/tag/quality-standards-for-online-courses/

References:

Online Learning Insights (2015). Quality standards for online courses. How good is your online course? Five steps to assess course quality.  Retrieved from https://onlinelearninginsights.wordpress.com/tag/quality-standards-for-online-courses/