e-Journal of Instructional Science and Technology (e-JIST) Vol. 9 No. 2

Looking for Critical Thinking in Online Threaded Discussions



Paula San Millan Maurino
Farmingdale State University
pmaurino@optonline.net

Abstract

Threaded discussion forums have been a popular topic for the past few years in distance education research and studied as a factor in student participation, satisfaction, learning outcomes, social presence and interaction. Only recently has it been considered as a potential vehicle for the development of critical thinking skills and deep learning. Thirty-seven current studies on critical inquiry, deep learning, presence and interaction in distance education were synthesized. The studies were compared for findings about participation quality, participation quantity, critical thinking skills and deep learning, and recommendations. The synthesis revealed that current literature touts the potential for development of deep learning and critical thinking skills through online threaded discussions. For the most part, however, research does not show this happening at a high level or to any great extent. Confounding the issue is the fact that current research is predominated by examination of education and graduate level online classes and is mainly focused on student perceptions and outcomes. This is at odds with the profile of today’s “typical” distance education student. The need for more instructor involvement and effort is indicated in much of the research, but bulk of the research has focused on students and not teachers.

Introduction

Learning through discussions or conversations is a fundamental part of teaching and learning, particularly in higher education. New communication technologies enable discussions to be held online as well as in the classroom. These discussions may form a component of a totally online distance education class or be used as a supplement to a traditional face-to-face class. The discussions can be synchronous, with participants “talking” at the same time, or asynchronous, where communication turnaround can be delayed by hours or days.

Online threaded discussions provide students with access to the forum twenty-four hours a day, seven days a week. Students can thus participate whenever they have the time and desire and at their own pace. This online “talk” can be more thoughtful since it offers the chance for reflection. Students have time to read each other's contributions and to think carefully about their own contributions. Messages can be composed and revised as needed and this writing may encourage discipline and rigor in thinking and communicating.

The characteristics of anonymity may also serve to promote enhanced and more intensive discussion. Students can concentrate on the content of the message instead of the presenter and may be more open and honest about themselves. They may divulge information that is more personal and revealing which will, in turn, encourage others to do the same.

On the other hand, threaded discussions are written discussions and lack the affordances of oral conversation. Some students feel that these discussions are just a series of messages and there is no sense of community. The lack of facial expressions and voice make the process less human. The fact that there are no nonverbal clues to guide them can also lead to misunderstandings and misinterpretations. Asynchronous discussions may lack the speed, the spark and energy of a face-to-face conversation and hinder the development of dynamic and interactive discussion [1]. Fewer teacher prompts online and the “out of sight, out of mind” adage may serve to increase student procrastination. Further, multiple simultaneous threads can be confusing to follow and to respond to. Some students may overpost and others suffer from “communication anxiety”. They feel detached and are not sure who is really out there, when to expect a response and what kind of a response it will be [2].

Discussion

Threaded discussion forums have been a popular topic for the past few years in distance education research and studied as a factor in student participation, satisfaction, learning outcomes, social presence and interaction. Only recently has it been considered as a potential vehicle for the development of critical thinking skills and deep learning. In an effort to determine the efficacy of threaded online discussions in this regard, thirty-seven current research studies were analyzed and synthesized. The volume of research within these areas in recent years is substantial. In an effort to condense and summarize the research, a chart was constructed. The chart is shown at the end of this section of the paper. The research studies are listed alphabetically by author followed by date of the study. The next column indicates whether the study was conducted with a graduate, undergraduate, professional or high school level group. The purpose of the study as stated in the journal article is shown next, followed by the methodology used. The next column indicates whether the class was totally online or if just the discussions were online as a part of a face-to-face class. The last column contains the major findings of the study.

Of the thirty-seven studies reviewed, nineteen studies evaluated classes at the graduate level and eleven at the undergraduate level. Although this paper deals with college level distance education courses, several other studies were included because they were cited frequently within other studies and considered valuable literature. Of these seven, two were on a high school level and five were on a professional level.

The majority of studies were performed with education classes. Of the thirty studies involving college classes, thirteen were education classes. Five were business related classes and four were computer related classes. The other classes varied across discipline.

The majority of the education classes were at the graduate level. Only one undergraduate education class was researched. It is assumed that this is because education professionals are more interested in distance education research than researchers in other disciplines and they have access to education classes and students as subjects. Why so many researchers have chosen graduate level instead of undergraduate level education classes is not known. The predominance of graduate level classes for research, however, is at variance with the current statistical profile and demographics of current distance education students. The changing nature and demographics of the distance education student are discussed later in this paper.

As stated previously, studies were selected for review if the article indicated that the purpose of the research was to investigate critical inquiry, deep learning, presence, and interaction. The methodology varied and a number of studies used triangulation. Content analysis of class transcripts, discussion threads, or listservs was a popular method. These archived records have only been available for research the last five or ten years and as a result, are a popular newer method of data collection and analysis. It was used to some extent in 22 of the 37 studies. This content analysis was generally performed in an effort to analyze student responses. These student responses were then often categorized for quantity or quality. Some studies ranked student responses using a scale or taxonomy such as Bloom’s Taxonomy, Biggs’ SOLO Taxonomy, or Garrison’s Four Cognitive Processing Categories.

Another common research design was to compare student conversations online with face-to-face classes. Seven studies followed this methodology. Student interviews and questionnaires were also popular, frequently in addition to other methods. Of the 37 studies, fifteen interviewed or questioned students.

2.1 Research Findings

Kreijns, Kirschner, and Jochems in a 2002 study stated that there is a concomitant body of research that reports low participation rates, varying degrees of disappointing collaboration, low learning performance and quality of learning in distance education [3]. The analysis of these 37 studies supports some of these findings.

2.2 Participation Quantity

Some studies did report low participation rates [4] [5] [6] [7] [8] [9] [10]. Other studies specifically studied “lurkers” or low participants [4] [11] [12], but found that these “lurkers” do learn by observing others. Hung and Nichoni in a 2002 study further stated that lurking is a necessary step in getting familiar with a particular culture [12]. A 2002 study by Picciano found that there was no difference in learning outcomes for low, moderate and high participants [10].

Chen and Zimitat in a 2004 study found that online classes had more participation than in-class discussions [13], but the more common finding was widely varying degrees of participation by students in the same class [14] [10]. Hara, Bonk, and Angeli in a 1998 study reported that online participation by students was limited to the mandatory number required by the instructor [15].

2.3 Participation Quality

Online discussions were described as less personal than face-to-face discussions [16], perfunctory [5], less interactive and lacking in speed, spontaneity and energy [5] [17] [1]. However, some studies reported more honest reflective discussion online [18] [14] [15] [17] [19]. Online participation was described as good for information exchange [20] [21], but not for creative problem exploration and idea generation [22].

Other studies reported that threaded discussions do not encourage team building or group processes [8] [23]. Some online environments culturally condition students to agree with each other and challenging each others ideas in discussion is considered a personal affront. There is little social discord [24] [25] [26]. Vonderwell in a 2002 study found that students claimed to all have similar ideas and thus there was nothing to really talk about [16].

2.4 Critical Thinking Skills and Deep Learning

Chen and Zimitat in a 2004 study reported that deeper understanding was shown in face-to-face classes than online classes [27]. On the other hand, similar amounts of critical thinking were found in face-to-face and online classes by Newman et al. in 1997 [22]. Hara, Bonk and Angeli in 1998 did find cognitively deep, lengthy postings with peer references, but still noted that students posted only the required number of postings and that comments were highly dependent on the directions of the discussion starter [15]. Heckman and Annabi in 2002 stated that based on their work, online discussions can generate cognitive levels equal to a face-to-face discussion [28].

When critical inquiry or deep learning was categorized in hierarchical levels, most messages or responses were ranked at the lower cognitive levels [1] [20] [21].

2.5 Literature Recommendations

Despite the difficulties cited above, most of the studies stated that online discussions have the potential for the development and fostering of critical thinking skills and deep learning. However, overwhelming it was stated that this was not yet happening at a high level or to a great extent.

Recommendations and suggestions to improve critical thinking skills development and deep learning included combining online discussions with other activities such as collaborative group work [26], case studies [26], production of tangible products [8], and problem and project based learning activities [19]. Other recommendations included developing more appropriate teaching and social presence [29] [24].

Mentioned most often as needed for improving deep learning in online discussions was better instructor efforts [30] [5] [6] [26] [18] [31] [1] [32]. Along these same lines, setting of clearer goals for discussion topics was frequently mentioned [14] [33]. Problems relating to a lack of clear goals or shared purpose for discussion was discussed in a number of studies [34] [35] [20] [14].

Most researchers placed responsibility for social interaction squarely on the back of instructors. It is up to the instructor to create a sense of online community and make a space for social interaction to take place [36]. This space must foster intimacy, openness and connectedness. The teacher then must direct online discussions, influence the discussion by entering new topics, share new material and redirect conversational patterns as necessary [3].

It was stated that an interactive teaching style is the best pedagogical approach to Internet-based learning [37] [30] and the type of questions the instructor asks are extremely important. The questions must be interesting as well as probing and prodding. They must elicit self explanations from the learner, critical clarification and refinement [38].

Instructors are also responsible, according to the literature, for providing the scaffolding that allows students to advance from passive to deep learning. Teachers are the content experts and must guide and assist students in their quest for knowledge. They must diagnose misconceptions, inject knowledge from diverse sources, and respond to technical concerns [39]. On the other hand, there are researchers that recommend a “guide on the side” approach with a laissez faire approach to moderating student discussions. There is some conflict between these two approaches and disagreement about whether the teacher in an online class should be a facilitator or a content provider. Further disagreement exists about which of the two approaches is more student centered.

It is interesting to note that although better instructor efforts were mentioned frequently, there were not many studies that actually interviewed or focused on instructors. Mortera-Gutierrez in a 2002 study conducted three unstructured interviews with three instructors and found that the pragmatic approach of the instructor affects class interaction, skills, and strategies [40]. In 2003, Trollip and Blignaut categorized instructor postings and classified them as affective, administrative, other, corrective, informative and Socratic [32]. Li, in a 2003 study, interviewed one teacher to learn of problems of first time online students [9].

2.6 Other Factors

Some of the studies did not take place in entirely online classes. Students taking a blended class where they have some face-to-face meetings with the instructor and other students may not require the same level of social and teacher presence online. Students in these blended classes may have more time to devote to developing in-depth conversations since less time is needed for developing social connections. Also, the face-to-face discussions may stimulate idea generation for later online discussions. These opportunities are not available for students taking classes that are totally online.

Three of the studies also used synchronous discussions. Synchronous and asynchronous conversations have their own advantages and disadvantages and are not comparable in many ways. As mentioned with the blended classes above, students in classes with synchronous discussions may not have the same needs for development of teacher and student presence.

Lastly, some of the studies did mention that other factors affect critical thinking. Bullen in a 1998 study and LaPointe in a 2003 study mentioned the importance of learner characteristics [25] [41]. Guzdial et al. in 2002 and and Rourke et al. in 1999 discussed the influence of discipline and culture [6] [24]. Students enrolled in technical disciplines are accustomed to a more didactic lecture approach and are not accustomed to discussing controversial or ethical issues. These students have been taught correct procedures and how apply them, not how to discuss these procedures.

In summary, perhaps the most consistent finding was that deep learning does NOT happen spontaneously [41] and that when it does happen; it is difficult to measure [43].

2.7 The Changing Distance Education Student

The original target group of distance education was adults with occupational, social and family commitments wanting to improve and update professional knowledge. Distance education has traditionally been interwoven with adult learning theory and lifelong learning. In 1991, Verduin and Clark described distance education as a form of adult education traditionally offered through extension units of colleges and universities, offering a choice of time and location, and designed for adults with the adult learning traits of self direction and internal motivation [44]. The typical online student has been generally described as over 25, employed, a caretaker, who has already completed some higher education. These learner demographics may have been true in the past, but are no longer valid.

The National Center for Education states that online enrollment now spans all age groups. As of December 31, 1999, 65% of l8 year olds had enrolled in an online course. It was also reported that 57% of traditional undergraduates aged 19 to 23 have been enrolled in an online course. These students are taking online classes at the same time as face-to-face classes. Online classes are not replacing face-to-face classes, they are being offered as supplements or alternatives within traditional college certificate and degree programs. Combining distance education with traditional degree programs is becoming a dominant theme [44].

The National Center for Education also reported that over one-half of the increase in distance education classes from 1997-8 to 2000-01 was attributable to public two year colleges. This is particularly impressive, since general enrollment in four year colleges has been outpacing enrollment in two year colleges [45].

Schools granting associate degrees had the largest number of students taking at least one online course, representing about half of all the students studying online. Strong increases were predicted by all classes of schools offering associate degrees [45].

Fourteen years ago, Verduin and Clark described three major types of programs for adult learning and distance education: adult basic education for acquiring basic skills needed to function in a changing, increasingly technology based society; career education; and leisure and enrichment education [46]. The nature of online education has changed as well as the typical (if there is a typical) online student. A more common online student today may well be a young, full time associate degree student taking college courses online as well as in the classroom.

Table 1: Current Research

Levels: G = graduate; U = undergraduate; P = professional; HS = high school

Author

Level

Discipline

Purpose

Methodology

All

Online?

Findings

Anderson

2001

G

Education

Health

Create a model to evaluate teacher presence

Content analysis of class transcripts

Y

Tool created is useful because of its simplicity and diagnosis capacity.

Arbaugh

2000

G

MBA

Determine factors that make online courses an effective learning experience

Survey of students

Y

Student learning is related to instructor efforts to create interactive environment. Instructor must foster intimacy and provide interesting discussions for learning.

Armitt

2002

G

Health

Evaluate SYNCHRONOUS communication to develop deep learning

Transcript analysis using SOLO

Y

Deep learning does NOT happen spontaneously. Groups that interact effectively develop cognitively more quickly.

Aviv

2000

U

Computer Science

Evaluate ALN performance

Content analysis

2 weeks ALN discussions

N

High level reasoning can result IF there is effective cooperation and group dynamics. Actual results are difficult to measure.

Beaudoin

2002

G

Education

Determine if non-participants and low level participants are learning

Survey of low level participating students

Y

Learning occurs behind the scenes. Some learners are more reflective and need less stimulation and interaction.

Bullen

1998

U

CIS

Find factors that affect critical thinking and participation

Student interviews

Y

Effectiveness is dependent on student characteristics, course design, and facilitation. It is not a simple task.

Chen

Zimitat

2004

G

Computer Science

Determine quality of higher order learning outcomes from online SYNCHRONOUS discussions compared to F2F blended class

Content analysis of transcript using SOLO

Y for online class

More discussion in online class.

Deeper understanding shown in F2F blended class.

Ellis

2004

U

E-commerce

Evaluate what students learn through discussion and how they learn it

Compared F2F and online discussions

Y for online class

Online students more reflective due to control over time.

Reflection not found in F2F.

Significant misunderstanding about goals obscured purpose of discussion.

Wide variety of levels of participation.

Participation quantity and quality attributed in a large part to instructor/tutor.

Eustace

2003

G

Policy studies

Find Educational value of online SYNCHRONOUS participant interaction

Examined chat room transcripts

Y

Peer dialogue provides mechanism for deep learning experiences.

Can be combined with problem and project based learning activities.

Analysis of chat records by students can promote peer review and reflective practice

Garrison

Anderson, Archer

2004

G

Education

Health

Judge nature and quality of online critical discourse

Analyzed and categorized message units for three one-week exchanges

Y

Critical, practical inquiry can be created and supported online with appropriate teaching and social presence.

In this particular study, there were not many higher level message units.

Goodell

2005

G

Education

Describe attempts to develop a community of practice among students engaging in online dialogue

Analyzed Web CT records and transcripts

N

Only 75% of students participated. Students did not respond to each other. Postings were perfunctory. Instructors did not participate. There was no recognition of the benefits of online discussion.

Guzdial Carroll

2002

U

English Comp

Determine learning that occurs when participation is low in online discussions

Student interviews

N

Learning arises from construction of a shared understanding. Students don’t have to participate if others present their questions and explanations. Learning arises from the inquiry and reflection even if no posting occurs.

Guzdial Ludoice Realff

Morley Carroll

2002

U

Math, Science,

Comp science

Find reasons for the failure of online collaboration in certain areas

Interviews

Questionnaires

N

Students and faculty did not participate due to cultural issues in areas of engineering, mathematics, and computer science. Did not see the need for collaboration, did not feel it was appropriate for these disciplines. Felt lecture based, competitive classes more appropriate.

Hara

Bonk

Angeli

1998

G

Education Psych

Examine supplementary online discussions

Content analysis of teacher and student messages

N

Students posted only the required number of postings. Postings were cognitively deep, embedded with peer references, and lengthy. Comments were highly dependent on the directions of the discussion starter.

Hawkes, Romiszowski

2001

G

Education

Compare F2F discussions with online discussions for critically reflective discourse

Content analysis

Y for online

Online dialogue was less interactive than F2F. Online dialogue was more reflective.

Heckman

Annabi

2002

G

Education

Compare F2F and ALN discussions

Content analysis of discussions

N

When combined with case studies, ALN discussions can generate cognitive levels equal to a F2F discussion.

Hung

Nichoni

2002

-

Analyze peer apprenticeship learning concept to foster working relationships between novices and masters in an activity context

Case study ethnography

observe after school learning clubs programs

N

Social learning techniques help students cooperate and collaborate. Learners then move from peripheral to central participation. “Lurking” is a necessary step in getting familiar with culture.

Kanuka

2002

P

Education

Explore how teaching and learning principles can be applied to facilitate higher levels of learning in distance education

Surveyed experts and scholars in field of distance education

-

Online discourse is often ineffective because instructors do NOT facilitate guided discourse effectively. Collaborative group work and threaded discussions can be combined with case studies to help students understand complex problems.

Kanuka

Anderson

1998

P

Understand and assess online learning

Used a constructivist interaction analysis model and a student telephone survey

-

Overwhelming number of messages were lower phase of knowledge construction – sharing/comparing. Participants valued the form for sharing and receiving information – not constructing new knowledge. Little social discord.

Kehoe

2005

U

Business

Find perceptions of learners on flexible delivery methods

Student survey

Y

50% of students would prefer traditional lecture mode. They took online courses for practical reasons. Online is not a replacement, but a supplement.

37% were reluctant to participate in online discussions.

33% said they would not come to a F2F class if points were not awarded for attendance and participation.

Kippen

2003

-

Examine relationship of reflection to deep learning

Theoretical – analyzed theories of learning and connected them to teacher reflection online

-

Reflection can promote deep learning online. Students are more honest in online discussions. The teaching environment online must be adapted.

Klemm

Snell

1996

U

Compare student groups and tangible work products to threaded topic discussions

Observed educational list servs and threaded discussions

Y

Threaded discussions do not encourage team building or group processes. There are lurkers and superficial participants. Learners should produce tangible products – not just give opinions.

LaPointe

2003

U

Varied

Determine variables influencing peer interaction and learning outcomes in CMC

Online questionnaires

Y

Found 5 variables that influenced interaction and outcomes: self –construal, teaching presence, task design, prior CMC experience, and course requirements.

Li

2003

U

Human Environ-ment

Study problems of first time online students

Interviews with students and one teacher

Document review

Y

Only 44% of students participated regularly.

Students were initially confused, frustrated, and not comfortable. Most changed attitudes by the end of the semester.

Mason

1991

Prof

Mgmt Skills

Determine the nature of moderating skills needed

Conference messages

Interviews

The moderator must play several roles including organization, social and intellectual.

Meyer

2003

G

Education

Compare experiences of F2F discussions with threaded discussions

Evaluate threaded discussions for higher order thinking skills

Content analysis using Garrison’s 4 cognitive processing categories

Student interviews

Critical thinking did occur, but 51% was at the exploratory level. Faculty need to be more directive in guiding discussion. Online was more reflective but students found it lacking in speed, spontaneity, and energy.

Mortera-Gutierrez

2002

Varied Discipline

Analyze design strategies and interaction of instructors.

Unstructured interviews with 3 instructors

-

Instructors have different sets of interaction than students. The pragmatic approach of the instructor affects interaction, skills, strategy, etc.

Murphy

Coleman

2004

G

Education

Find purpose and value of online discussions

Content analysis of threaded discussions

Y

Some students dominated conversation leaving others excluded and alone. Some felt inadequate when no one responded to their posting. Shift of control from teacher is not beneficial if passed to dominating students.

Discussion can support more reflection, constructions and critical thinking, but these benefits may NOT be achieved.

Students may misunderstand, misinterpret, and not participate.

Newman

Johnson

Webb

Cochrane

1997

U

Info Mgmt

Compare F2F seminar with computer conferencing

Evaluate discussion as a means of promoting deep learning and critical thinking

Content analysis

Student questionnaires

N

Similar amounts of critical thinking in both classes. Higher depth in computer conferencing. Students in that class brought in more outside information from personal experience, other sources, etc. F2F was better for creative problem exploration and idea generation since it was more spontaneous.

Picciano

2002

G

Education

Examine online performance in relation to student interaction and sense of presence

Student survey

Discussion board statistical analysis

Y

No difference in outcome for low, moderate, and high participants.

Rourke

et al.

1999

G

Education

Determine implications and benefits of assessing social presence

Analysis of discussion transcripts

Y

Fairly high levels of social presence are necessary to support development of deep and meaningful learning. Further study is needed to determine the optimal amount. Too much social presence may be detrimental.

Sherry

2000

HS

Create guidelines for online conversations

Analysis of online conversation

Student focus group

N

Each conversation should have a published goal and guidelines. Combine with creating a project. Make supportive comments.

Singleton

2003

G

Education

Gain insight into learner perception of online learning

Student survey

Y

Students felt course design was the most important factor. Challenges were lack of community, time management and unclear goals.

Tolmie

Boyle

1999

G

Education

Compare F2F seminar with online seminar

Examination of conference records

Student logs of activity and contact

Student questionnaire

N

Computer conferencing was used for information exchange. Overall usage was not high. There was a particular need for shared purpose.

Trollip

Blignaut

2003

G

Business

Create a taxonomy to measure teacher presence

Analysis of teacher postings in threaded discussions

Survey of decision makers

Y

Categorized instructor postings as administrative, affective, other, corrective, informative and Socratic.

Found a wide range of expectations as to ideal performance.

Vonderwell

2002

U

Education

Analyze student perceptions regarding interaction and quality of learning online

Student interviews

Analysis of email

Analysis of discussion transcripts

Y

An increase in number of messages does not necessarily increase quality of learning.

Students felt online was less personal and missed the 1 to 1 with teacher. They wanted faster feedback.

Students felt they did not learn from each other since they all had similar answers.

Woods

2002

G

.

Org. Comm

Find out if more instructor initiated personal emails outside of class discussion would affect student perceptions

Divide class in groups

Each group received a different number of personal emails from instructor

Student survey

Y

No difference in rating faculty/student relationships.

Conclusion

Current research literature touts the potential for development of deep learning and critical thinking skills through online threaded discussions. For the most part, this has not yet happened at a high level or to any great extent. Further research is needed to investigate the nature of this disparity. The need for more instructor involvement and effort is indicated in much of the research, but the brunt of the research has focused on students and not faculty. There is thus a need for additional research conducted from the standpoint of the instructor. What do instructors hope to achieve by using an online threaded discussion and have they succeeded in this quest? Is deep learning the main objective or are there other goals and objectives that are just as important in these virtual discussions?

Another confounding problem appears to be a mismatch between the target groups under research and the actual online student population. Current research is predominated by examination of education and graduate level online classes. The typical online student is not a graduate student and does not take education classes. The changing nature of online students must be taken into consideration in future research. Student characteristics, education level and academic discipline/course may affect the teaching methods and objectives of online instructors.

The preponderance of the research is also of a quantitative nature. Class databases are counted, summarized, categorized and graphed. There is a need for rich, in depth data which would call for research of a qualitative nature, particularly from the point of view of the online instructor.

References

[1] Meyer, Katrina. Face-to-face versus threaded discussions: The role of time and higher-order thinking. Journal of Asynchronous Learning Networks. 7 (3), 2003. http://www.sloan-c.org/publications/jaln/v8n2/pdf/v8n2_meyer.pdf (accessed on August 20, 2005).

[2] Feenberg, A. Computer conferencing and the humanities. Instructional Science. 16: 169-186, 1987.

[3] Kreijns, Karel, Paul A. Kirschner, and Wim Jochems. The sociability of computer-supported collaborative learning environments. Educational Technology and Society 5 (1): 8-22, 2002.

[4] Beaudoin, Michael F. Learning or lurking? Tracking the “invisible” online student. Internet and Higher Education 5: 147-155, 2002.

[5] Goodell, Joanne and Brian Yusko. Overcoming barriers to student participation in online discussions. Contemporary Issues in Technology and Teacher Education. 5 (1): 77-92, 2005.

[6] Guzdial, M., P. Lodovice, M. Realf, T. Morley, and K. Carroll. When collaboration doesn't work. Paper presented at the 5th. International Conference of the Learning Sciences, Seattle, 2002.

[7] Kehoe, Jo, Beth Tennent, and Karen Becker. Student perceptions and expectations of flexible learning and teaching approaches research report. Queensland University, 2005. http://learning.cqu.edu.au/lt_grants/files/GrantreportKehoe2004.pdf (accessed on September 10, 2005).

[8] Klemm, W.R., & Snell, J.R. Enriching computer-mediated group learning by coupling constructivism with collaborative learning. Electronic Journal of Instructional Technology, 1(1), 1996. http://www.usq.edu.au/electpub/e-jist/klemm.htm (accessed on May 10, 2005).

[9] Li, Sha. The format-shifting dilemma in distance education. Quarterly Review of Distance Education, 2003. http://stuinfo.aamu.edu/shali/home/Formatshift%20dilemma.pdf (accessed on July 19, 2005).

[10] Picciano, Anthony G. Beyond student perceptions: Issues of interaction, presence, and performance in an online course. Journal of Asynchronous Learning Networks 6 (1), 2002. http://www.aln.org/alnweb/journal/jaln-vol6issue1.htm (accessed on November 6, 2002).

[11] Guzdial, M., and K. Carroll. Explaining the lack of dialogue in computer-supported collaborative learning, Proceedings of the Computer Supported Collaborative Learning Conference 2002. Mahwah, NJ: Lawrence Erlbaum Associates, 2002.

[12] Hung, David and Maish Ramlal Nichani. Bringing communities of practice into schools: Implications for instructional technologies from Vygotskian perspectives. International Journal of Instructional Media. 29 (2): 171-83, 2002.

[13] Chen, Nian-Shing and Craig Zimitat. Differences in the quality of learning outcomes in a F2F blended versus wholly online course. In Beyond the comfort zone: Proceedings of the 21st ASCILITE Conference, Perth, December 5-8, 175-179, 2004. http://www.ascilite.org.au/conferences/perth04/procs/chen.html (accessed on August 29, 2005).

[14] Ellis, R. A., R. Calvo, D. Levy, and K. Tan. Learning through discussions. Educational Media International 41 (3): 263-274, 2004.

[15] Hara, Noriko, Curtis J. Bonk, and Charoula Angeli. Content analysis of online discussion in an applied educational psychology course. Instructional Science 28 (2): 115-152, 1998.

[16] Vonderwell, Selma. An examination of asynchronous communication experiences and perspectives of students in an online course: A case study. The Internet and Higher Education 6: 77-90, 2002.

[17] Hawkes, Mark and Alexander Romiszowski. Examining the reflective outcomes of asynchronous computer-mediated communication on in service teacher development. Journal of Technology and Teacher Education 9 (2): 285-308, 2001.

[18] Kippen, Sandra. Teacher reflection and theories of learning online. Journal of Educational Enquiry 4 (1): 19-30, 2003.

[19] Eustace, Ken. Educational value of e-learning in conventional and complementary computing education. Proceedings of 16th Annual Conference of the National Advisory Committee on Computing Qualifications, Palmerston North, New Zealand, July 6-9, 2003.

[20] Tolmie, Andrew and James Boyle. Factors influencing the success of computer mediated communication (CMC) environments in university teaching: A review and case study. Computers and Education 34:119-140, 2000.

[21] Kanuka Heather and Terry Anderson. On-line social interchange, discord and knowledge construction. Journal of Distance Education 13 (1): 57-74, 1998.

[22] Newman, D. R., Chris Johnson, Brian Web, and Clive Cochrane. Evaluating the quality of learning in computer supported co-operative learning. Journal of American Society for Information Science 48 (6): 484-495, 1997.

[23] Murphy, Elizabeth and Elizabeth Coleman. Graduate students’ experiences of challenges in online asynchronous discussions. Canadian Journal of Learning and Technology 9 (2), 2004. http://www.cjlt.ca/content/vol30.2/cjlt30-2_art-2.html (accessed on August 15, 2005).

[24] Rourke, Liam, Terry Anderson, Randy Garrison, and Walter Archer. Assessing social presence in asynchronous text based computer conferencing. Journal of Distance Education 14 (3): 51-70, 1999.

[25] Bullen, Mark. Participation and critical thinking in online university distance education. Journal of Distance Education 13 (2): 1-32, 1998.

[26] Kanuka, Heather. A principled approach to facilitating distance education: The Internet, higher education and higher levels of learning. Journal of Distance Education. 17 (2): 70-86, 2002.

[27] Chen, Nian-Shing and Craig Zimitat. Differences in the quality of learning outcomes in a F2F blended versus wholly online course. In Beyond the comfort zone: Proceedings of the 21st ASCILITE Conference, Perth, December 5-8, 175-179, 2004. http://www.ascilite.org.au/conferences/perth04/procs/chen.html (accessed on August 29, 2005).

[28] Heckman, Robert and Hala Annabi. A content analytic comparison of F2F and ALN case-study discussion. Proceedings of the 36th International Conference on System Sciences (HICSS’03) IEEE, 2003. http://www.hicss.hawaii.edu/HICSS36/HICSSpapers/CLALN01.pdf (accessed on September 10, 2005).

[29] Garrison, D. R, Terry Anderson, and Waler Archer. Critical thinking, cognitive presence, and computer conferencing in distance education. American Journal of Distance Education, 15 (1): 7-23, 2001.

[30] Arbaugh, J. B. How classroom environment and student engagement affect learning in Internet-based MBA classes. Business Communication Quarterly 63 (4): 9-26, 2000.

[31] Mason, R. 1991. Moderating educational computer conferencing. DEOSNEWS 19 (1), 19911. http://www.emoderators.com/papers/mason.html (accessed on August 14, 2005).

[32] Trollip, Stanley R. and A. Seugnet Blignaut. Measuring faculty participation in ALN as a basis for faculty development. Paper presented at the 19th Annual Conference on Distance Teaching and Learning, 2003. http://www.uwex.edu/disted/conference/Resource_library/proceedings/03_53.pdf (accessed on August 14, 2005).

[33] Sherry, Lorraine. The Nature and purpose of online discourse: A brief synthesis of current research as related to the WEB project. International Journal of Educational Telecommunications 6 (1): 19-51, 2000.

[34] Song, Liyan, Ernise S. Singleton, Janette R. Hill, and Myung Hwa Koh. Improving online learning: Student perceptions of useful and challenging characteristics. The Internet and Higher Education 7: 59-70, 2003.

[35] Sherry, Lorraine and Shelley H. Billig. Good online conversation: Building on research to inform practice. Journal of Interactive Learning Research. 11 (1): 85-127, 2000.

[36] Gunawardena, C. N., C. A. Lowe, and Anderson, T. Analysis of a global online debate and the development of an interaction analysis model for examining social construction of knowledge in computer conferencing. Journal of Educational Computing Research, 17: 395 -429, 1997.

[37] Harasim, L. Online education: An environment for collaboration and intellectual amplification. In Online education: Perspectives on a new environment, ed. L. Harasim, 133-169, New York: Praeger, 1990.

[38] Cook, J. The role of dialogue in computer-based learning and observing learning: An evolutionary approach to theory. Journal of Interactive Media in Education 5, 2002. http://www-jime.open.ac.uk/ (accessed on August 22, 2005).

[39] Anderson, Terry, Liam Rourke, D. Randy Garrison and Walter Archer. Assessing teaching presence in a computer conferencing context. Journal of Asynchronous Learning Networks 5(2), 2001. http://www.aln.org/alnweb.journal/ (accessed on August 31, 2005).

[40] Mortera-Gutierrez, Fernando. Instructor interactions in distance education environments. Journal of Interactive Learning Research 13 (3): 191-209, 2002.

[41] LaPointe, Deb. Effects of peer interaction facilitated by computer-mediated conferencing on learning outcomes. Paper presented at DEC2003, 10th Annual Distance Education Conference, 2003. http://www.cdlr.tamu.edu/dec_2003/decProceedings/17-LaPointe-Effects.pdf (accessed on October 1, 2005).

[42] Armitt, Gillian, Frances Slack, Sharon Green and Martin Beer. The development of deep learning during a synchronous, collaborative on-line course. Paper presented at CSCL 2002 conference, Boulder, Colorado, 2002. http//newmedia.colorado.edu/cscl/70.pdf (accessed on August 22, 2005).

[43] Aviv, Reuven. Educational performance of ALN via content analysis. Journal of Asychronous Learning 4 (2): 53-72, 2000.

[44] National Center for Education Statistics, U.S. Department of Education. The condition of education 2005, Indicator 7: Past and projected undergraduate enrollments. Institute of Education Sciences, 2005.

[45] National Center for Education Statistics, U.S. Department of Education. The condition of education 2004, Indicator 32: Distance education at postsecondary institutions. Institute of Education Sciences NCES 2004-077, 2004.

[46] Verduin, John R., Jr. and Thomas A. Clark. Distance education: The foundations of effective practice. San Francisco: Jossey-Bass Publishers, 1991.

© University ofSouthern Queensland