Evaluating Interactive Learning

Thomas C. Reeves

Professor of Instructional Technology, University of Georgia

Mary Marlino

Director of the University Corporation for Atmospheric Research, Boulder, Colorado

Ms Marlino was previously Director of Educational Technology and Associate Professor of Instructional Technology at the United States Air Force Academy.

Objectives/Outcomes:

Participants in this tutorial will learn how to implement specific models and procedures for evaluating interactive learning at all levels of education. The content of the tutorial includes specific plans, strategies, and tools for all four major facets of evaluating interactive learning, including:
  1. documentation evaluation
  2. formative evaluation
  3. effectiveness evaluation, and
  4. impact evaluation.

Content:

The following topics will be presented in this tutorial: In addition, participants will be provided with copies of an electronic performance support system (EPSS) designed to help educators evaluate interactive learning.

Overview:

The tutorial will include presentations, demonstrations, and hands-on activities with a variety of evaluation strategies. After attending this tutorial, the participants will be able to perform the following tasks:

1. Describe different paradigms for evaluation in education and training.

2. Compare and contrast various evaluation "models."

3. Distinguish between:

4. Implement four facets of evaluation for interactive learning:

5. Write an evaluation plan for various forms of interactive learning.

6. Evaluate interactive learning in a variety of practical situations.

7. Analyse the data collected during an evaluation.

8. Report an evaluation of interactive learning for maximum impact.

Importance:

A comprehensive approach to evaluating interactive learning requires multiple approaches. No single evaluation strategy can provide the complete picture of the effectiveness and impact of interactive learning. To conduct a comprehensive evaluation of interactive learning requires a "triangulation" approach whereby multiple models and procedures are applied. Conducting comprehensive evaluations of interactive learning

in a timely and efficient manner is the focus of this tutorial.

Why is evaluation of interactive learning so important?

Around the world, each month sees the introduction of more and more commercially produced or locally developed software packages promoted by their developers as effective learning systems. Yet systematic evaluation of the implementation and efficacy of these systems is sadly lacking. This tutorial is specifically designed to establish evaluation as a key strategy throughout the design, development, and implementation of interactive learning at all levels of education.

Intended Level of Presentation:

Designers and developers of interactive learning systems including computer-based training, interactive multimedia, and instructional applications of the World Wide Web.

Max./Min. Number of Participants:

15-100