home
download pdf
download powerpoint



On-line assessment

Assessing large classes

Minimising plagiarism

Assessing group work

Assessing students unfamiliar with assessment practices


the imperative to renew assessment practices

five contemporary assessment issues

 

 

 

 


 


A new era in assessing student learning

A new era quote
 

The Assessing Student Learning resources have been developed to assist Australian universities to maintain high quality assessment and grading practices, and to respond to new issues in the assessment of student learning.

Renewal of assessment practices lies at the forefront of efforts to improve teaching and learning in Australian higher education. Many universities, faculties and departments have recently undertaken reviews to examine assessment issues and to develop comprehensive assessment policies. At the same time, there is new attention to developing creative ways to assess student learning. Much of the innovation is designed to align assessment tasks more closely with the processes of problem-solving in the workplace (access to resources and colleagues) in the belief that traditional examinations may not resemble the work and life situations in which graduates use their knowledge and skills. The new technological possibilities are also a major source of innovation, with universities actively exploring the potential of computer-based assessment to assess learning and provide students with rapid and informative feedback.

The imperative to renew assessment practices

Conventional thinking about the role and practice of assessment in higher education has been challenged by the convergence of a number of factors, including:

  • heightened awareness of the importance of assessment requirements in establishing expectations and guiding student learning, particularly in more flexible, independent learning environments;
  • the prominence attached to the development of generic skills, such as communication skills, teamwork skills and critical thinking, in the desired outcomes of higher education and the desire to assess these skills, one outcome of which is the rise of assessable group work;
  • the perceived threat of an increase in plagiarism, particularly from on-line sources, and the damage any such trend would do to confidence in the quality of assessment and academic standards;
  • the efforts of academic staff to find cost- and time-effective assessment techniques in the face of larger and more diverse student cohorts;
  • the emergence of new technological possibilities for assessment, including the potential to integrate assessment in new ways with other teaching and learning activities; and
  • the changing nature of the students themselves, in their diverse backgrounds, abilities, expectations and engagement with the learning process.

The final factor is of particular significance. Universities are recognising and responding to the changing nature of student lives and priorities. Many undergraduate students are less involved in university life than students of the past, in part due to the pressure of part-time work. Centre for the Study of Higher Education research into the first year experience shows that an increasing proportion of full-time first year students are working part-time and those who are working are tending to work longer hours than previously.

From the perspective of students with busy and complex lives, poorly planned continuous assessment, for example, can be just as tyrannous as the ‘one-chance’ final examination. For academics, the new realities of student lives indicates the need for imaginative assessment practices which do not in any way compromise on the integrity and rigour of academic requirements.

A final imperative for renewing assessment practices is associated with standards and accountability. As university entrance pathways and the modes of student participation diversify, the maintenance of standards through entry pre-requisites and ‘time spent on task’ are significantly less important mechanisms for ensuring standards than they once were. The accurate measurement and reporting of student knowledge, skills, achievement or performance is increasingly the final measure of academic standards.

Five contemporary assessment issues in higher education

1. Capturing the potential of on-line assessment

On-line assessment is an unparalleled opportunity for rethinking assessment in higher education. Extensive experimentation is under way in universities into the possibilities for effective and efficient on-line assessment. The experience of staff working in this area indicates that the design of assessment tasks rapidly becomes more sophisticated, since computers offer the potential to present students with complex scenarios and interactive resources.

Academics involved in developing on-line assessment believe this mode of assessment opens up exciting new possibilities for:

  • providing interactive assessment tasks that are in themselves learning experiences (including on-line test questions that incorporate information-rich images, sound and text);
  • improving the quality and rate of feedback to students, including capturing the potential for immediate feedback;
  • providing greater opportunities for students to practise their knowledge and skills;
  • randomising assessment tasks;
  • reducing costs and staff workloads through automation of routine assessment tasks;
  • offering students more flexibility in time, place and the selection of assessment options; and
  • providing equitable opportunities for international students to demonstrate their knowledge (such as reducing or eliminating time constraints on answering questions).

The ways in which on-line assessment might be used to deliver benefits such as these are still to be fully explored. Key issues in the development of these approaches to assessment — and with most other forms of assessment too — are whether on-line assessment techniques are assessing the full range of higher order learning outcomes (as opposed to narrow reproduction), whether there is equity for all students in the opportunities to demonstrate their knowledge, and whether the approaches being adopted by universities to verify individual student performance are robust. On-line assessment

2. Designing efficient and effective assessment for large classes

The growing size of the student body is a significant factor in the day-to-day decisions academics are making about assessment methods. Larger class sizes have encouraged academic staff to look for time-efficient assessment techniques as they find the time they are spending on marking and grading is rising. The introduction of modular and more flexible courses may also have increased the assessment workload for teaching staff.

In the search for time efficient assessment methods questions are naturally raised about the maintenance of the intellectual quality of assessment: which means being alert to approaches to assessment that might reward superficial, shallow or reproductive approaches to learning, or which may fail to direct students into the type of study that leads to the higher-order objectives of university education. Assessment for large classes must be highly targeted and strategic in measuring the desired learning outcomes: excessive assessment is neither helpful in directing students into effective approaches to study, nor any more precise in measuring their learning. The challenge for staff in assessing larger classes is to optimise the efficiency of assessment requirements while at the same time neither compromising the role of assessment in guiding student learning nor reducing the capacity of the assessment methods to validly and reliably measure student learning. Assessing large classes

3. Responding to plagiarism and developing policies to foster academic honesty

Universities have acted quickly and comprehensively to introduce policies to reduce the threat of plagiarism. Detection software identifying plagiarised material is in widespread use. While there is little reliable evidence to indicate whether or not the incidence of plagiarism has risen in higher education, there is a much greater awareness among both staff and students of the possibilities for plagiarism created by electronic technologies. When the new technological possibilities are coupled with the growing complexity of student lives, the conditions are ripe for plagiarism to occur: many students are under great pressure for success and many are working long hours in paid employment, circumstances in which plagiarism may be the act of a desperate student rather than an intrinsically dishonest one.

Plagiarism varies in both intent and extent, ranging from deliberate fraud, to negligent or accidental failure to acknowledge sources of paraphrased material and misunderstandings about the conventions of authorship. Many students who represent someone else’s work as their own are aware they are cheating. Plagiarism also arises from ignorance of the conventions for attribution and differing assumptions in regard to the origins of ideas. The more subtle manifestations of plagiarism highlight the need for effective educative campaigns alongside rigorous detection methods. The problem of plagiarism needs a sustained attention that includes educative, preventive and detection strategies. Minimising plagiarism

4. Using assessment to guide effective group work

There has been a significant trend in recent years to incorporate generic skills explicitly alongside traditional subject-specific knowledge in the expected learning outcomes in higher education. Typically these generic skills include communication skills, leadership skills and teamwork skills — a direct response to the objective of preparing graduates with the capacity to function successfully as team members in the workplace.

One outcome of the broadening of intended learning outcomes is that students are increasingly required to participate in group learning activities. These activities are often designed to mimic the approaches to problem-solving found in the workplace and students are expected to learn approaches to resolving conflict, planning and managing time. Both the processes and products of these activities are often assessable course components.

There is a sound educational rationale for expecting students to participate in group work. There are also well-known challenges. Not all students believe they benefit from group work. Many academics are cautious about group assessment too — equity of individual contribution to group work and the verification of this contribution are significant issues, among others, in the implementation of effective group activities and fair assessment of them.

The design of assessment is central to the educational effectiveness of group work. Assessment requirements do a great deal to establish the dynamics of student groups. Carefully designed assessment, which fairly assesses as appropriate individual contribution as well as the achievements of the group as a whole, will help create productive groups. Assessing group work

5. Recognising the needs of students unfamiliar with assessment practices in Australian higher education

In a mass higher education system, universities enrol a more diverse student body. This diversity is apparent in the differing cultural and socioeconomic backgrounds, ethnicities, and educational experiences of students and their families. One educational consequence of student diversity is that universities teach some students with little prior exposure to the unwritten rules and conventions of higher education. International students are a particular example of students less familiar with assessment practices in Australian higher education.

Assessment is one of the areas of possible confusion and uncertainty for international students, particularly during their first year of study in Australia. At the least, the diversity in grading nomenclature and interpretation across universities may confuse international students who are familiar with systems in which grades are handled in quite different ways. More significantly, misunderstanding and confusion about assessment requirements and the correct attribution of original ideas may result in inadvertent plagiarism. Academic staff have a critical role in recognising the likely areas of uncertainty about assessment experienced by international students, in offering clear guidelines on what is required, and in providing suggestions for studying efficiently and effectively in a new educational setting. Providing advice to students less familiar with assessment practices in Australian higher education

 
 

Back to Top