On-line delivery has been widely adopted by Tertiary institutions for the presentation of post-graduate subjects and courses to part time distance education students. The road to success for this group of students is often quite rough. The ubiquity and the pervasiveness of the Internet and world wide web provide a ready platform for the development of virtual learning communities with the potential to make this rough road a little smoother. They also raise equity issues for participation and retention.This paper reviews the factors which make the web so attractive for on-line learning. Two Information Technology based subjects are offered by on-line delivery at a multi-campus university. A number of factors indicates the success of this initiative in meeting the individual needs of these post-graduate distance learners. However, it is evident that on-line delivery raises its own set of barriers to engagement in learning in addition to those encountered by part time students studying in distance mode. For some, combinations of these barriers prove insurmountable while for the majority these are only temporary hurdles to straddle in achieving success. It concludes that those who succeed, develop more positive attitudes to the technology and are empowered by the acquisition of new knowledge and skills to apply these in the workplace and in other learning situations.
Hara & Kling (2000) conclude that the majority of academic literature, popular press and promotional material emphasise the virtues of on-line courses. Institutions become more viable and distance education students benefit by way of convenience and enhanced learning materials. The difficulties of providing these courses are minimised. Issues raised by academics including the development and ownership of the teaching material, determining the actual costs of delivering these courses and therefore their profitability, and the difficulties that students face in studying these courses are not so prominent.
One barrier for this group was purely administrative. The names of some students enrolled in non-Sydney campuses were not included on the enrolments lists. Subsequently, the pre-study information including web-site details and the time and place for the first teleconference, was not received in one or two instances. Four of the seven respondents indicated that technology-related factors presented a barrier to their participation or retention in the subject. A failure to make our expectations of participants' computer literacy clear up front was a contributing factor in at least two cases. One respondent provided a comprehensive analysis of personal barriers faced in on-line study of a technology-based unit. A lack of background in and familiarity with the software application, high levels of frustration at lack of progress in acquiring the skills after hours of work, lack of relevance of the application in the home and in the work environment all contributed. A second respondent overcame initial difficulties related to lack of technological literacy but failed to overcome further technological deficiencies during the study period. The third respondent was feeling a bit overwhelmed by the fact that she was not connected to the Internet when news of her pregnancy provided a ready excuse for not commencing studies. Another stated that failure to attend vital teleconferences in which software skills were introduced was difficult to recover from.
It is arguable that some of the participants in this group failed to make the connections to the Internet or to our site on one or more occasions and were put off by that. The data collected so far indicates that these technological barriers are important in decisions not to commence or to complete the study period.
The data provide a clear indication that part-time post-graduate students studying by distance mode face a combination of barriers to engagement in their learning. Three sets of barriers were identified: those related to part-time study, those common to distance education students and those created by "technological" barriers. It is the last group of these on which the study is particularly focussed.
The first group of barriers relates directly to the participant's role as an educator studying part time. The majority were in full time employment. The barriers include job pressures of time, changing family commitments including pregnancies, accidents and illness, changes of study plans, changes in work situations including transfers and promotions as well as moving from part time to full time employment.
The second group of barriers results from the remoteness of the students from the virtual study centre. They include a lack of peer support and social contact, isolation, lack of immediate feedback from the instructor, the inability of the instructor to respond to body language and feelings of isolation. Hirumi & Bermudez (1996) and Mellon (1999) argue that the effect these factors have on the learner depends on individual learning styles. These range from interpersonal learners who learn best by collaborating face-to-face with peers to those for whom the ability to study from home without travel, overcomes any negative effects of the distance. Roblyer (1999) concludes that where students are provided with a choice between face-to-face and on-line learning, that enjoyment is often less important than convenience.
No conclusions have been made regarding the relevant effects of these first two sets of barriers on those who successfully overcame them. All that is sure is that the barriers did have varying negative effects on participation and engagement by the participants.
For some, the assumptions made about their literacy levels meant that the level of instruction was not explicit enough at times. Lack of confidence with processes such as FTP led to an inability to enter the correct settings to ensure uploading of web pages. Lack of knowledge of the functions of a Web-browser even caused problems. A failure to realise that the "Refresh" button ensured the latest version of the web page was viewed, led to protracted aggravation from the fear that the FTP process was failing to upload latest versions of web pages. Most times these problems were overcome on a one-to-one basis by e-mail or telephone calls.
It was apparent that the majority of the participants had little formal training in "computing" and therefore had limited understanding of computing principles which are essential for effective computer use. The lack of these basic competencies adversely affected interaction with the learning community to varying degrees and lengths of time.
Kartsen & Roth (1998) argue that while a wide range of experiences enhances students perception of their competence, it is the relevance of the experience to the particular context rather than the quantum of this experience which is most reliable as a predictor of performance in on-line studies. While computer self-efficacy is significant, it is not strong in its relationship to performance. Gist, Schwoerer & Rosen (1989) demonstrate that computer self-efficacy is positively correlated with a willingness to choose and participate in computing activities, expectations of success, persistence when faced with computer-related difficulties and computer-related performance.
Participants' attitudes to the technology itself affected the way in which they interacted with the learning community. Some were very tentative at the beginning of the learning period. Attitudes to the technology improved over the study period although not all embraced the technology by the end of the first subject. However, no person who successfully completed the first subject and was enrolled for both subjects withdrew from that second subject. One participant now saw a role as an innovator in a school in which most colleagues were not computer literate. The experience of on-line study provided participants with the chance to explore technologies by using the technologies. Many developed attitudes and the competence to apply technology to classroom and other on-line learning situations. Again, it is clear that attitudes to the technology affect participation and engagement in learning to varying degrees.
Hardware is a primary requirement for on-line study. For some participants, hardware factors provided real barriers. Some of these were temporary while other were on-going. System failures, disk crashes, time lost for warranty work to be carried out, lack of knowledge of how to "fix' small problems and loss of data, all created frustration of varying degrees. Those who had access to hardware in their own homes had fewer barriers raised than those who relied on hardware in their work place.
Software also created barriers. Some had not purchased the software by the commencement of the teleconference tutorials at which the basics were introduced. Those who chose to use earlier versions of designated software often had problems in trying to follow the instruction. Those who downloaded limited period trial versions of the software ultimately ran into troubles when its life expectancy ran out. Others had difficulty downloading essential software such as Acrobat Reader. Some reported that the software, especially the database program, was quite difficult to master for participants with a non-technology background. For a very few, the effort was not worth it.
Internet connections provided essential access and support but also barriers. The majority of participants had few prolonged problems in this regard although some were not connected in time for the commencement of the study period. The sources of the problems were not always apparent but they included the reliability of the Internet Service Provider and related hardware and software problems. At certain times participants were barred access to the web site for one or more reasons. Some had initial problems establishing contact with the site because of their lack of experience with user names and passwords. For others, the names and passwords had not been correctly entered by the system support staff. At times hacker activity at the web server outed the site for varying periods of time. This caused most frustration at weekends during which time the server was not attended. On a few occasions, traffic congestion and other factors led to failure of major links to the Internet. The non-user friendly messages which result are not very reassuring for a user struggling to come to grips with on-line access to study materials.
E-mail was the prime method for support in the subjects but also presented barriers to engagement. At times it was used for mass communication of an important message. Some participants used more than one service provider throughout the study period and sometimes more than one at any one time and did not check all accounts as frequently as they should have. Some had quite unreliable providers, a problem when many of the participants in one semester were provided access to one of these by their employing authority. Subsequently, some vital messages did not get through. Sending and receiving attachments even in rich text format were problematic and very difficult to overcome. Those who persisted in using web-based "free" services such as Hotmail were of most concern.
Teleconference workshops in which the software package was introduced in hands on workshops, generally were vital for the majority of non-technology participants in these subjects. Some participants missed one or more of these.
Evidence has been presented to support our assertion that on-line delivery raises its own set of barriers to engagement. These are compounded in a technology-based subject where participants are required to do more that just access the web for study material, and, perhaps, participate in on-line discussions. In these subjects participants from non-technology backgrounds had to "learn" quite sophisticated software skills by "doing". The barriers are due to three sets of factors: the workload and obligations of part-time students, the distance from the learning centre; and the technology factors required to engage in learning in the subjects. The last group provides fundamental barriers as they have to be overcome to study on-line.
Those who complete the learning activities successfully, report very positively about how the model has met their varying needs. Many report that the experience has not been an easy one. The workload is evidently greater than for other MEd subjects. The misunderstanding and misconceptions due to lack of computer competence create barriers which remain in place for weeks on end. These raise high levels of anxiety which influence attitudes about the technology and on-line learning.
Successful participants report a shift in attitudes to their own learning, even though Cohen (1997) doubts that learning styles are affected after a period of one year even in a "technology rich environment". One participant reported a more proactive role as a learner. Another recognised a greater responsibility for collecting and analysing information that was of interest and relevance. One participant observed that learning is not confined to "narrow outcomes" as the processes required to study on-line are also integral to the learning. One became aware of a changing role as a teacher - more as the facilitator of learning since "often, school students knew more about the technology and how to access information than the teacher did". Another was less impressed since on-line study required self-motivation which he just hated.
To study the subjects on-line, participants acquired additional knowledge and skills which are not listed in the subject outcomes. Acquisition of these will affect the manner in which participants perform in other on-line subjects (See Chesterton, 1999) as well as their confidence and ability to apply these in their workplace. In the main, attitudes to the technology changed in a positive way over the study period, while a few deteriorated. As attitudes became more positive, so did the students' level of computer self-efficacy and confidence to work with the technology in their work setting. Those who succeeded were empowered by the acquisition of new knowledge, skills and an enhanced understanding of their own learning.
This preliminary study has raised more questions that it has answered. Much had been stated about the benefits of on-line delivery of subjects to universities and to students and how the ubiquity of the world wide web lowers the barriers to entry for remotely distributed students. The study has made us aware that on-line delivery also raises its own special set of barriers. These have the potential to prevent or impair successful engagement in the learning because the attitudes and competencies required to study on-line are lacking. The study has not provided a clear indication of how these factors interact and the varying degrees to which they affect engagement. We have not yet found hard data to compare participation and retention rates with traditional distance education. These are the focus of future directions of our ongoing studies.
Chesterton, P. (1999). Issues in the evaluation of information technology based educational programs. Proceeding of 'Evaluation: Challenging Boundaries', 1999 International Conference of the Australian Evaluation Society, Perth WA, 93-99.
Cohen, V. L. (1997). Learning styles in a technology-rich environment. Journal of Research on Computing in Education, 29(40), 338-350.
Dusick, D. M. (1998). What social cognitive factors influence faculty members' use of computers for teaching? A literature review. Journal of Research on Computing in Education, 32(2), 123-137.
Gist, M. E., Schwoerer, C., & Rosen, B. (1989). Effects of alternative training methods on self-efficacy and performance in computer software training. Journal of Applied Psychology, 74(6), 884-891.
Hara, H., & Kling, R. (2000). Students distress with a Web-based Distance education Course. Information, Communication and Society (in press)
Hirumi, A., & Berbudez, A. (1996). Interactivity, distance education, and instructional systems design convergence on the information superhighway. Journal of Research on Computing in Education, 29(1), 1-16.
Kartsen, R., & Roth, R. M. (1998). The relationship of computer experience and computer self-efficacy to performance in introductory computer literacy courses. Journal of Research on Computing in Education, 31(1), 14-24.
Lazenby, K. (1998). The creation of a virtual campus in higher education: Two case studies. ASCILITE'98 Conference Proceedings, pp. 441-452. http://www.ascilite.org.au/conferences/wollongong98/asc98-pdf/lazenby0116.pdf
Maguire, M. (2000). On-Line Delivery: Engaging the Participants. In Schuck, S., & Segal, G. (Eds), Change and Choice in the New Century: Is Education Y2K Compliant? Proceedings of the CERG Research Symposium, 4-5 February 2000, 130-137. Sydney, NSW: Change in Education Research Group.
Maguire, M., & Matejka, D. (1999). Better than sliced bread: An evaluation of on-line delivery. In Proceedings of AARE-NZARE'99. [verified 13 Oct 2001] http://www.swin.edu.au/aare/99pap/mag99620.htm
Mellon, C. A. (1999).Technology and the Great Pendulum of Education. Journal of Research on Computing in Education, 32(1), 21-33.
Mitra, A. (1998). Categories of computer use and their relationships with attitudes towards computers. Journal of Research on Computing in Education, 30(3), 281-295.
Proost, K., Elen, J., & Lowyck, J. (1997). Effects of gender on perception of and preferences for telematics learning environments. Journal of Research on Computing in Education, 29(4), 370-380.
Richards, C., & Ridley, D. (1997). Factors affecting college student's persistence on online computer-managed instruction. College Student Journal, 31, 490-495.
Roblyer, M. D. (1999). Is choice important in distance learning? A study of student motives for taking Internet-based courses at the high school and community college levels. Journal of Research on Computing in Education, 32(1), 157-171.
Romiszowski, A. (1997). Web-Based distance learning and teaching: revolutionary invention or reaction to necessity? In B. H. Khan (Ed), Web-based Instruction (pp. 25-40). Englewood Cliffs: NJ: Educational Technology Publications.
Simonson, M. R., Maurer, M., Monta-Toradi, M., & Whitaker, M. (1987). Development of a standardized test of computer literacy and computer anxiety index. Journal of Educational Computing Research, 3(2), 231-247.
Thomerson, D., & Smith, C. (1996). Student perceptions of affective experiences encountered in distance learning courses. American Journal of Distance Education, 10(3), 37-48.
West, R. (1998). Learning for life: Review of higher education financing and policy. Department of Employment, Education, Training and Youth Affairs. Canberra: Australian Government Publishing Services. http://www.detya.gov.au/archive/highered/hereview/toc.htm
Young, J. (1998). Skeptical academics see perils in information technology. The Chronicle of Higher Education [On-line serial]. http://chronicle.com/
Zelmer, A. C. L. (1999). Flexible learning: The new world order and NTEU. NTEU Advocate, August, 28-29.
Authors: Dr Martin Maguire, Senior Lecturer, School of Education (NSW), Australian Catholic University Phone (02) 9739 2428 Fax (02) 9739 2105 Email m.maguire@mary.acu.edu.au
Des Matejka, Lecturer, School of Education (NSW), Australian Catholic University
|