« ISD Models | Main | Treo 600 »

October 1, 2003

SCORM or Scorn? Starting the conversation…

This post is intended to begin the conversation for the upcoming panel discussion at the 2003 AECT conference with David Wiley, Joe Scandura, Brian Beatty, and me! The session will be held in Anaheim on Friday October, 24 from 11:45 to 1:00pm.

A little background on this session: At last year’s conference, Brian and I had a roundtable discussion to describe the basics of SCORM and some potential work we were doing in that area. 20 minutes before the session began we had three rings of chairs around the table with people wanting to join the session! We were able to find a large, unused room and started with our presentation on what SCORM was and our thoughts on its use in e-Learning. We ended up having a great discussion that brought together experts who believed SCORM had great potential value and those who thought it was an effort that would end up relegated to the scrap heap of many past attempts at standardization.

Two of the people who tended toward opposite ends of the spectrum were David and Joe (I will leave it to your imagination as to which side of the debate these two were on!)

A number of people emailed us wanting to continue the discussion in Anaheim this year and we have decided to try to have another open discussion as an invited session (by the AECT Distance Learning Division). Our goal is not to give a lengthy presentation or present case studies but to continue the fruitful conversation that was started last year by including a high level of audience participation.

I will start with some of my thoughts as a "radical pragmatist" working at a large company developing an instructional content delivery strategy…

I work at Eli Lilly and Company, which is a mid-sized (40,000+ employees) pharmaceutical company. I am also adjunct faculty at Indiana University for the Instructional Systems Technology Distance Master’s Degree program. Both of these contexts have given me opportunities to think about utilizing learning objects.

In our presentation last year, I noted that I had listened to vendor after vendor describe how they could produce "SCORM-compliant" training products. When pressed, however, most had to admit that they had not yet done so for any existing clients. Even fewer were able to engage in any meaningful discussion about the technological aspects of SCORM and there was no mention of any pedagogical implications.

Fast-forward to this year: content vendors are now increasingly able to demonstrate actual products that are SCORM conformant. The LMS/LCMS vendors are also now beginning to show how such content operates via their systems and some basic content repository strategies are emerging to share the SCORM-built objects within their systems. So, there has been a decided improvement in the uptake of SCORM over the last year.

Has it moved me off the fence to fully recommend SCORM as the standard for e-learning development? Not yet. Unfortunately, the instructional implementation of SCORM is still mostly at the page-turner level of e-learning design. One reason for this is the same for just about any weak e-learning: poor instructional design. However, another problem is that many large scale LCMSs only allow somewhat limited presentation of learning objects, usually through a very tightly controlled player.

What this means is that the potential sharability factor is improving rapidly because it is relatively easy to maintain a very tight reign on how the objects are used. Flexibility of instructional design following SCORM standards, however, is still not ideal on a large-scale basis. Problems can be seen, for example, when a designer attempts to develop an interactive simulation, which requires a more robust interplay between content and content management system. Currently, such work typically requires "breaking" from the standard to make it work. The next generation of SCORM (2.0) is supposed to address standards for simulation design.

My basic stance: There have been vast improvements to the SCORM and its use but I would only recommend certain types of development require development via the SCORM. Any LCMS still needs to be flexible enough to allow development and delivery of non-SCORM-compliant content for the foreseeable future.

Comments, thoughts? The goal is to start a conversation before the conference begins and continue after it has ended!

Posted by Rovy at October 1, 2003 10:37 AM

Comments

Having worked on the business and academic side of e-learning ("online learning" in academia, of course), I am still looking for an effective use of the reusable learning object model in education. Of course, if whole courses are treated as "reusable learnign objects" the applications are easy - and in wide use today. But the more traditional approach of using smaller pieces of instruction over in multiple courses or training "packages" is much more difficult to use in education. It just doesn't seem to fit well with faculty/teacher control over specific course content. Is higher education ready for a completely new way of thinking about course delivery? What implications would this have for intellectual property rights? Course quality control? etc. Where are the brave pioneers in the education sector?

Posted by: Brian at October 3, 2003 12:43 PM

Unfortunately, I won’t be able to make it out to AECT this year, but I would like to add some of my thoughts to what Rovy and Brian have said.

I work for a custom e-learning company that delivers content via a SCORM-compliant learning delivery system. I agree with Rovy and Brian that SCORM itself has not prompted much new thought on instructional strategies and mostly focuses on delivery and reusability. However, I have found a use for it that, in my mind, supports an instructional approach as well as making content management and reusability easier to implement.

I’m currently building a sales simulation that is accompanied by several e-learning lessons. The lessons cover concepts and principles that the student puts to use in the simulation. The lessons contain about 8 hours of content and are made up of 40 – 50 SCOs per lesson. The simulation takes approximately 1.5 – 2 hours to complete and (for now at least) is one SCO. In the simulation, the student (in the role of the salesperson) must meet with different customers, uncover needs, defuse objections, and create a business case for a sale. The simulation is very dynamic and no two students will have the same experience. Without getting into too much detail, one of the ways in which the simulation provides feedback to the student is through a “coach”. The coach program assesses the student’s performance and provides guidance as well as recommendations for topics in the e-learning that the student should review in order to perform better in the simulation. For example, after a meeting with a customer in which the student made some poor decisions, the coach might recommend 5 or 6 topics in the e-learning for the student to review… and here’s where following SCORM standards pays off:

If the student decides to review the topics, he clicks on the “e-learning” button and exits the simulation. A new course map of e-learning content then appears in the learning delivery environment which contains the SCOs specific to the topics which were remediated by the coach. This “linking” to the e-learning content does not break SCORM standards since it is handled by the SCORM manifest (which knows where each of the SCOs reside) and not by a “hard” link. In addition to creating customized course maps of SCOs from the e-learning lessons designed for the simulation, SCOs from other courses which also cover the remediated topics can also be accessed and presented as part of the course map. In this way, targeted remediation can occur using SCOs across the entire sales curriculum.

I’m not sure if this would be a considered an instructional strategy, or merely a content management strategy, but it does allow for remediation to specific SCOs which in my opinion increases the instructional value of the simulation and e-learning. Because of this, the student can proceed through the course in different ways. He can take all the e-learning and then the simulation, being remediated to topics in the e-learning he is still not grasping… or, using a problem-centered approach, the student can choose to take the simulation first and learn by failure which topics in the e-learning he needs to study. In this way, the simulation becomes a performance-based pre-test, as well as a post-test for demonstrating mastery. There are other benefits of SCORM that we’re taking advantage of as well, including SCO completion tracking, gap analysis, and allowing students to search for relevant SCOs when they want to learn about a given concept or principle…. but I won’t get into them here. Suffice it to say, they are useful from a learning management perspective.

I’d be interested in your thoughts about how we’re using SCORM to support our remediation strategy. Perhaps, as I mentioned before, this is not entirely an instructional strategy… but with that said, it would be difficult to implement without SCORM, especially with the amount of content we’re dealing with. Ultimately, I think using SCORM can really help facilitate targeted, instructional feedback for learners. I’ll be the first to say that there definitely need to be some additions to the SCORM standards, including how to make simulations SCORM compliant (without making them one big SCO), but I’m now finding SCORM more useful than I ever thought I would.

Posted by: Jack at October 21, 2003 9:19 AM