Ok, hello #eci834 classmates! It’s been a little bit since our last flurry of posts, hasn’t it? As we are all fully engaged with building and helping one another design online learning experiences, it’s nice to get a breather and shift focus i a different direction. To add to this , Alec has left us with as much leeway as we could ask for in determining our own area of interest this week.
I didn’t have any particular direction in mind, apart from wanting to look at something I hadn’t really put much thought into beforehand. In reading a summary of emerging trends in online education for the year 2018, moderated by Tony Bates, I came across a the use of analytics in education. Interesting! The use of data in schools is definitely not new. I’ve been a part of developing strategic plans that respond to collected data for years. But to see it as an emerging field on its own is interesting to me!
The concept of analytics is not new to me in and of itself. But my exposure and engagement with meta analytical statistics is mainly confined to sports. The movie Moneyball is the glorified, Brad Pitt delivered story of a small market, perpetual underdog Oakland Athletics baseball team using analytics to punch well above their weight in league play. They ended up coming close to winning a World Series with a team of relatively unknown baseball players.
Tony Bates mention of education analytics was mainly to point out its perceived limitations and that it is not, as of yet, widely used. But as he points out so well … “actual usage today does not necessarily predict future usage.”
Good enough for me! I’m hooked!
so what is it?
In their study they describe learning analytics as using large pools of data to increasingly personalize education. Learning analytics uses data from sources like user clicks, survey feedback and participation online.Specifically, this trio of researchers were trying to model a practical use of learning analytics on a large scale. They collected learner data (self-report surveys) and learning data (from learning management systems).
Not surprisingly, for something as labour intensive as collecting and interpreting large sets of data, industry is ready to step in!
Yetanalytics, Civitas Learning, Brightbytes, Panorama Education, and Education Analytics are but a few examples of many companies that are out there and ready to support our educators and teaching practice. For a modest profit, of course.
ANALYTICS at work: EXAMPLE
To familiarize myself with analytics in an education context, I followed Tony Bates’ link to a recorded keynote address by Bart Rienteis, professor of Learning Analytics with the Open University in the United Kingdom. It is a 40 minute address, to I found it well worth the time to watch., found here. Rienteis engagingly relates observations made from study on student satisfaction with online courses by pooling data from over 100 000 post-secondary student surveys, through 151 separate online learning modules. Through dissemination of this vast data, there were some surprising revelations!
For one, while common sense might lead one to believe (myself included) that there would be a correlation between student success with and achievement in online modules, results look like this:
“There are amazing modules, with tremendously high pass rates, that get relatively low satisfaction scores by students.” Rienteis
This kind of larger scale inference, that student surveys showing relative satisfaction with a course may have little to do with how students are actually performing, would have not really been easily possible without that vast pool of data. I certainly can’t see how that inference can be drawn from the results of a survey from a single online course… As Rientais says, there are clearly other factors at play, beyond academic success, that are determining whether a student feels satisfied with an online course!
I’m sure we’ll be hearing more from learning analytics as our respective ministries and school boards continue to build strategic plans based on data that filter down to our schools and classroom planning.
Thanks for reading!