2017-02-18

"Testing online courses is not standard practice at traditional colleges," points out a new article at EdSurge -- though beta-testing
is part of the process for other online learning sites.
jyosim summarizes their report:
Coursera has recruited a volunteer corp of more than 2,500 beta testers to try out MOOCs before they launch. Other free online course providers have set up systems that catch things like mistakes in tests, or just whether videos are confusing. Traditional colleges have shied away from checking online course content before going live, citing academic freedom. But some colleges are developing checklists to judge course design and accessibility.

"It would be lovely if universities would consider ways of adopting the practice of beta testing," says Phillip Long, chief innovation officer and associate vice provost for learning sciences at the University of Texas at Austin. One factor, though, is cost. "How do you scale that at a university that has thousands of courses being taught," he asks... How much beta testing makes sense for courses, and what's the best way to do it?

A senior instructional designer at the State University of New York says "On most campuses, instructional designers have their hands full and don't have time to review the courses before they go live... We're still trying to find the magic bullet that motivates people to review other people's courses when they're not being paid."

What?

By alzoron



2017-Feb-18 17:50

• Score: 3
• Thread

Traditional colleges have shied away from checking online course content before going live, citing academic freedom.

What the hell sense does that make? That's like saying I don't check my texts for errors before hitting send because "Freedom of Speech, bitch!"

Why is this different from traditional classes?

By Anonymous Coward



2017-Feb-18 18:15

• Score: 4, Insightful
• Thread

In many cases, the beta testing of classes taught in traditional settings is just to teach them. As someone who is teaching an online science course and doing so for the first time, I'm building my class based on lectures when I taught the same class in a traditional setting. Although it's a different instructional format, I'm not sure that beta testing would have been helpful. My class is an elective requirement, and although my students might never care about meteorology again, I try to teach them a bit about how science works (in general) and force them to do higher order thinking (~80% of the grade is based on levels of thinking above recall in Bloom's Taxonomy).

It's a legitimate science class, and any good instructor should be constantly testing their teaching and trying to improve. Every semester I've taught, I've learned from what I've done well and what needed improvement throughout the semester. There isn't a single beta test, but any worthwhile instructor should always be working to improve the quality of instruction. That's been no different this semester, even though it's an online class. I have made a couple of changes to my instruction this semester, which I believe are for the better. You can't simply prepare a class from the beginning and expect that you won't have to change anything during the semester. Instead, you need to have clear objectives for your class, and make changes as needed to either assess whether those objectives are being met (assignments and tests) and how to prepare the students to meet those objectives (instruction).

Any good instructor is always working to improve a class, even during the class. Instead of a single beta test, each week of my class is like Patch Tuesday, where I learn from how the students did the previous week, and always make minor or major tweaks. It might be as simple as explaining concepts again that students didn't understand as well or as complex as making changes to my learning assessments.

For a good instructor, a beta test isn't as important as the continual revisions during the semester. I can certainly say that I've gotten better at teaching this class as the semester has gone on. If I'd prepared the entire class prior to the semester and beta tested it, I might have missed some things that could be improved upon during the semester. Beta tests are no substitute for periodic updates to software. And they're no substitute for continually improving courses.

Length of courses more important than content

By laughingskeptic



2017-Feb-18 20:00

• Score: 3
• Thread

In some cases, I'm guessing when a college or a state writes a contract for creating these courses, the length of time of the video content must be the most important clause in the contract. My son signed up for Texas' online high school physics class last summer in order to avoid taking it during the school year. It was very clear that the objective of the course materials was to consume required amount of time and not really to teach physics. It was more like a remedial drivers ed class one takes as punishment for speeding than anything that resembled a real class. I imagine that quite a few online classes come into being based on this "time content" model.

Faulty premise

By Hognoxious



2017-Feb-18 20:03

• Score: 3
• Thread

We're still trying to find the magic bullet that motivates people to review other people's courses when they're not being paid.

I think I've spotted the flaw in this plan. Anyone else?

Show more