The disruptive influence of massive online open courses, or ‘MOOCs’, has been well documented on The Conversation and elsewhere. The arrival of major players, edX, Udacity and Coursera create opportunities and challenges for Australian educational institutions.
My colleagues at Deakin University are playing close attention to the phenomenon; our Vice-Chancellor has written that
We know for sure the digital economy is as inexorable as the industrial revolution in its day. Other industries — newspapers, retail, book publishers and sellers — are all changing their practices and business models. Those in higher education would be foolish to ignore it even though outcomes are not clear and many uncertainties exist.
Some Australian universities have already begun to embrace this mode of delivery, while others have warned that the ‘mass provision product’ may devalue other university offerings, while also identifying difficulties with assessment.
While the academic commentariat has been quick to identify challenges and opportunities of MOOCs, this has generally been divorced from the first-person experiences of students. As an empirical researcher, and having studied at four Australian universities, some of which pride themselves on their online and distance courses (see Deakin University and the University of New England), I thought I’d enroll in a Coursera course to gain a student perspective.
The experience was illuminating.
The Course
Although there are now almost 200 courses on Coursera, there are very few for someone with my research interests and activities. 25 of the 33 universities are based in the US, and there is a clear bias to science and technology units. I enrolled in ‘Gamification’, taught by the University of Pennsylvania’s Kevin Werbach. I thought that this area might contribute to my teaching practice, and assist me in some of the community work I do. According to the Coursera website:
Gamification is the application of game elements and digital game design techniques to non-game problems, such as business and social impact challenges. This course will teach you the mechanisms of gamification, why it has such tremendous potential, and how to use it effectively.
The course ran for six weeks, with two units covered each week. Each unit comprised 40-60 minutes of video lectures, with Kevin speaking to camera, using slides with a graphic overlay. The delivery was accessible, the content was not particularly incomprehensible, and Kevin was an engaging and pleasant teacher.
Over 80,000 students enrolled in the Gamification course; at week 6, over 43,000 students had watched lecture videos online. While 43,000 is a large audience, the fact that almost half of enrolled students suggests a general lack of engagement for large swathes of the group.
Melbourne University’s Ben Loveridge, who also enrolled in the course, identifies the technology (being less technically savvy, I defer to Ben’s summary):
On a technical note, Kevin uses the Mac software Screenflow to live capture and edit the lectures, while using the free application OmniDazzle to create the live graphic overlays. The video is captured by what looks a webcam on top of a monitor and the audio is clear and of good quality however the capture device is out of shot so I can’t see what is being used. As well as having an interesting lecturer and a well-framed video, the quality of the audio is paramount to the success of content delivery.
There were also optional readings for each unit; I didn’t engage with these resources, but clearly some of my peers did.
Supporting the core materials were discussion forums, a wiki, face-to-face meetups and engaged conversations on Twitter and Facebook. Again, I didn’t engage with these supporting materials, but they clearly built a strong and supportive virtual network of students.
Assessment
There were three areas of assessment:
- 4 Homework Quizzes (multiple choice) – 35% of final grade
- 3 Written Assignments (peer assessed) – 5%, 10%, and 20%, for a total of 35% of final grade
- Final Exam (multiple choice, covering the entire course with emphasis on the second half) – 30% of final grade
My Deakin colleague, Beverley Oliver, has discussed the challenges of the Coursera (and MOOC) assessment regimes, given the large number of students. The multiple choice questions worked well, providing useful feedback, but not all disciplines are able to use multiple choice tests to assess students’ learning, including my discipline of law.
The other form of assessment was three short written assignments. Each student is asked to assess five other papers on one-two measures, with a detailed marking rubric. Assessors are then asked to provide comments on ‘What I like was…’ and ‘What could have made this submission better was…’. After completing this assessment for five others, students are then asked to assess their own work, both within the marking rubric and providing comments in response to the two questions. Approximately 12,800 students submitted the first of the three assignments and 10,700 students successfully submitted written assignment 2. Again an impressively large group, but less than 15% of those enrolled completed each assignment.
In “traditional” conditions, where sanctions and consequences apply, there’s greater likelihood that students will provide proper peer review of others’ work. But crowdsourcing can’t be relied upon when self-interest is at play.
Certainly, I provided impartial assessment of my peers’ work and identified strengths and weaknesses. This then allowed me to critically reflect on my own work, identifying strengths and opportunities for improvement. However, in both of the assignments I submitted (I missed one while I was away at a conference), I provided the highest numerical score available. I genuinely think the pieces merited this mark, but this is such a subjective assessment that it provides little comfort. The platform suggests that the marks are ‘calculated based on a combination of the grade you received from your peers and the grade you gave yourself’, but fairness should dictate that my own assessment has little influence on these marks.
Reflections
Like many Australian academics, I have observed the MOOC phenomenon with interest and trepidation.
The course delivery platform is generally equal to the platforms I’ve used at four tertiary institutions where I’ve studied, with a couple of minor improvements (the ‘chunking’ of lectures into smaller videos; the ‘vote’ function on discussion boards to raise important or interesting topics to the top of the forum; integrating self-test multiple choice questions into video). However, Australian universities shouldn’t feel that the technology is much more advanced than our existing learning management systems.
Assessment was thoughtfully developed and appropriate for the course content. The feedback and critical self-reflection demonstrate clear pedagogical objectives, but the subjectivity of some of the self assessment presents challenges for the model.
MOOCs are rightly being observed as a disruptive force in higher education. However, until these courses can contribute to the credentials of a degree from a reputable educational institution, they will be a diversion from an integrated, scaffolded degree or diploma.
But for me, I’m proud of my Coursera achievement and my certificate, and will certainly be adding it to my CV to impress potential employers and others, and I think many Australian and international students will too.