Advice
for Reviewers print
version
The
Role of Reviewers
Reviewers provide an independent assessment of the quality of each paper
submission. Whilst Reviewers have considerable latitude, and a considerable
responsibility for interpretation of the concept of quality, we hope that
the notes below will help us towards a reasonable uniformity of perception
of quality standards, a fair, unbiased review process, and helpful, formative
and constructive feedback for authors.
Papers under review
and completed Review Forms are confidential and the contents are not to
be revealed to other persons.
Double
blind reviewing
ascilite Conferences use a double blind review process. That is, reviewers
are not given the names and institutional affiliations of the authors,
and authors are not given the names of the reviewers assigned to their
article. If you feel that your objectivity as a Reviewer has been compromised
because you have identified an author, either inadvertently through routine
checking of references, or other avenues, please advise the Program Committee
and we will seek a replacement reviewer if appropriate.
Ascilite2010 requires
two double blind reviews for each full and concise paper, although in
the event of non-arrival of a review, the Committee may elect to seek
an additional review. Reviews may be supplemented, if appropriate, with
non-blind reviews obtained from members of the Committee.
Selecting
and appointing Reviewers
Reviewers are appointed on the basis of their expertise and experience
in areas relevant for the Conference. It is an honorary role, being rewarded
through acknowledgement in the online and USB drive versions of the Conference
Proceedings. Each ascilite Conference relies to a large extent upon Reviewers
commissioned from previous Conferences and Reviewers sought through sister
organisational networks such as the Association of Learning Technology
(ALT) in the United Kingdom. This has helped us sustain a uniformly high
standard of reviewing over the years, as most of our Reviewers are 'experienced'.
The ranks of 'experienced' Reviewers are supplemented from other sources,
such as AJET reviewers and authors. It is not necessary for Reviewers
to be members of ascilite, or to be registrants for the Conference. Ascilite
Conferences also have an established policy of encouraging the induction
of 'novice' Reviewers, who will broaden the Reviewer pool, and be in line
to become the next generation of 'experienced' Reviewers. This policy
is facilitated by ensuring, as best we can, that a review allocated to
a 'novice' Reviewer is also allocated to 'experienced' Reviewers, and
is backed up by Program Committee reviews, if appropriate.
The
Review Process
Accessing papers and forms
We anticipate that each Reviewer will be allocated 2 to 3 papers, usually
a mix of full and concise papers, made available on Monday 12
July, with a due date Monday 2 August 2010.
You will be advised by email about your login name (it will be your email
address) and password for your access to the Conference paper review system,
Whilst three weeks
may seem to be a hectic deadline, it is the same as review process deadlines
used for past Conferences. Given that ascilite Conferences offer authors
the latest possible submission dates, it is essential that Reviewers maintain
good turnaround times. If you find that you must call for help and seek
re-allocation of all or part of the reviewing assigned to you, it will
be vitally important to inform the Program Committee sooner rather than
later!
After downloading
and reading the papers assigned to you, we recommend that you compose
your 'Summary of contribution' and 'Detailed comments' (see below) in
your word processor. Save your composition for doing 'copy and paste'
entries during your next login to the Conference paper review system.
If using an MS Word format, keep it simple, because MyReview will record
your entry in plain text format, and advice to authors will be made in
plain text email. For example, separate paragraphs with a blank line and
do not use the 'space after paragraph' facility; use asterisks instead
of an automated, bulleted list; etc.
The
review criteria
Reviewers use the criteria outlined below to assign ratings and make recommendations
to the Committee on acceptance, conditional acceptance or rejection of
submissions. Offers of acceptance specify a publication and presentation
format, and include advice on any required or desirable revisions.
As with previous ascilite
conferences, one of the purposes for the review process is to obtain DEEWR
(2009) recognition of the work, in the Conference publication category.
To this end, the Committee confirms that refereed proposals accepted for
ascilite 2009 Conference publication will:
- Meet the definition
of research in relation to creativity, originality, and increasing humanity's
stock of knowledge;
- Be selected on
the basis of a DEEWR compliant peer review process (independent, qualified
expert review; double blind reviews conducted on the full articles,
prior to publication);
- Be published and
presented at a conference having national and international significance
as evidenced by registrations and participation;?and
- Be made available
widely through the Conference web site (DEEWR, 2009).
Category |
Description |
Weight |
Quality,
of Research/ Scholarship |
As
appropriate for a full* or concise*
paper:
- The paper
meets DEEWR ARC standards
- The paper
reports on informed scholarship, critical reflection or empirical
and evidence-based research
- It demonstrates
academic merit and appropriate critical analysis
- It is situated
in current literature and/or policy with a well articulated
conceptual or theoretical framework and arguments
- It adopts
an appropriate research methodology with related research questions/aims
for the purpose of the paper.
OR
-
It presents a synthesis or re-interpretation of existing research;
a critique of practice development(s), theoretical arguments
or conceptual frameworks; or a critical/reflective analysis
|
40% |
Originality
& scholarly contribution |
As
appropriate for a full* or concise*
paper
-
The paper is original, and clearly identifies broad and insightful
implications for theory and/or policy and/or practice.
-
Insightful critical analysis and interpretation that leads to
clear, logical findings, conclusions and implications for theory
and/or policy and/or practice.
|
35% |
Relevance
and suitability to ascilite 2010 |
The
paper is relevant to ascilite 2010 conference theme, sub themes
and to the intended audience. |
15% |
Quality
of written presentation |
The
quality of written presentation demonstrates a high standard of
writing, coherency and logical flow, ease of reading, attention
to grammar and spelling and adherence to ascilite formatting and
referencing guidelines. |
10% |
Applying
the review criteria
You
will have to use your own best judgment on the four criteria listed above,
weighted as shown. For each criterion you will be asked to select a rating
from the seven point scale:
Strong
Accept |
Accept |
Weak
Accept |
Neutral |
Weak
Reject |
Reject |
Strong
Reject |
Rating
the papers
The following sections provide a guide to assigning a rating for three
of the seven selection criteria.
Quality
of research/ scholarship |
Strong
Accept: The informed scholarship, critical reflection
or empirical and evidence-based research outlined in the paper
meets DEEWR ARC standards (It outlines the topic in relation to
creativity, originality, and increasing humanity's stock of knowledge).
This criterion also evaluates the academic merit of the paper,
whether the level of critical analysis is appropriate, whether
the paper is situated in contemporary literatures with a well-defined
conceptual or theoretical framework with relevant research questions/aims/arguments,
and finally, whether the authors adopt a research methodology
or critical analysis that is fit for the purpose of the paper/study. |
Weak
Accept with revisions: Situated in the
university context with limited but relevant connection to teaching
and learning literature and/or policy, demonstrating some linkage
to research question or theoretical framework. Appropriate methodology
or critical analysis |
Reject:
Knowledge of literature and /or policy context is not
demonstrated or integrated into the paper. Methodology lacks academic
rigor, or paper lacks appropriate analysis and insight. |
Originality
and scholarly contribution |
Strong
Accept: Accept The paper is original, provides insightful
critical analysis and clearly identifies broad and insightful
implications for theory, practice and/or policy. The paper presents
feasible propositions, inferences and conclusions that are consistent
with research study /conceptual/ theoretical limitations |
Weak
Accept with revisions: The paper requires
further analysis and interpretation. Findings and conclusions
require more clarification. The paper draws basic implications
for other practitioners. The scholarly contribution of the paper
may need to be further substantiated as valid and trustworthy. |
Reject:
The paper does not extend beyond its immediate context
or over-extends its scope in terms of what can realistically be
applied beyond the immediate context. Findings, conclusions and
implications are ambiguous or unsupported. Substantial components
of the paper (including the same data set) have been published
elsewhere. |
Relevance
and suitability to ascilite 2010 |
The
theme of ascilite 2010 is Curriculum, technology & transformation
for an unknown future. Papers and presentations are invited that
explore developments, experiences and future possibilities in
the following areas:
-
leadership, policy and strategy
-
learners, learning and educational practice
-
academic development practices
-
industry relationships
-
mobility of learners, teachers and workers
-
innovation and technology
You
are encouraged to examine the information on the website about
each of the sub-themes (see http://www.ascilite.org.au/conferences/sydney10/cfp.htm).
Prospective authors who are not familiar with ascilite Conferences
are also advised to spend some time browsing previous proceedings
available from http://www.ascilite.org.au/index.php?p=conference
to help ascertain the suitability of a potential submission. The
paper must address the theme and/or sub-themes of the conference.
It should also be relevant for the target audience which includes
educational practitioners, tertiary sector leaders, government
and ministry officials, managers, ICT professionals, researchers,
private training organisations and secondary and vocational education
representatives and members of the wider Australasian and international
higher education community
|
Strong
Accept: Clear relevance to one or more of the conference
themes. Relevant to several delegate groups. |
Weak
Accept with revisions: Relevant to at least
one conference theme and relevant to at least some delegate groups.
|
Reject:
Relevant to at least one conference theme and relevant
to at least some delegate groups. |
Quality
of written presentation |
Strong
Accept: The paper conforms to a high standard of
academic writing, and demonstrates a coherency and logical flow.
It is easy for the reader to follow and grammar, spelling and
referencing standards and guidelines are followed. |
Weak
Accept with revisions: The paper is of
an acceptable standard of academic writing but requires some attention
to coherency and flow and/or ease of readership and/or grammar,
spelling and referencing standards and guidelines. |
Reject:
The paper is poorly written and the argument or logic
is difficult to follow. Grammar, spelling and referencing standards
and guidelines have not been followed. |
|