In recent years substantial and rapid developments have occurred in the provision of computer based testing. These developments have raised issues such as standards of administration, security of tests and test results and control over the testing process. Guidelines and standards are available to those wishing to develop computer based testing. The aim of this article is to provide a 'jump start' to access resources.

The Journal Psychological Assessment published (2007) an article by Howard Garb on computer administered interviews and rating scales. Garb recommends that computer based testing is combined with clinical judgment, to avoid false positive diagnosis. For more information on participant and technological issues read Heidi Leeson's, 2006 review in the International Journal of Testing.

Comprehensive guidance is available from the International Test Commission who have produced Guidelines on Computer-Based and Internet-Delivered Testing. The Psychological Testing Centre also provides Guidelines for the Development and Use of Computer-based Assessments and the British Standards' Institute, code of practice for the use of information technology for the delivery of assessments 2007 update is also available.  

More Information and Links

Computer-Administered Interviews and Rating Scales
Garb, H. N.
Psychological Assessment. 2007 Mar Vol 19(1) 4-13

To evaluate the value of computer-administered interviews and rating scales, the following topics are reviewed in the present article: (a) strengths and weaknesses of structured and unstructured assessment instruments, (b) advantages and disadvantages of computer administration, and (c) the validity and utility of computer-administered interviews and rating scales. Computer-administered evaluations are more comprehensive and reliable and less biased than evaluations routinely conducted in clinical practice. Also, the use of continuous monitoring systems, which increasingly entail the use of computer administration, has been related to improved treatment outcome. However, the use of computer-administered interviews and rating scales will sometimes lead to false positive diagnoses, and for this reason, it is recommended that computer assessment be combined with clinical judgment.

Available online to registered users:

The Mode Effect: A Literature Review of Human and Technological Issues in Computerized Testing

Leeson H.V. Faculty of Education, University of Auckland, New Zealand

International Journal of Testing. 2006, Vol. 6, No. 1, Pages 1-24

(doi:10.1207/s15327574ijt0601_1)

In addition to the potential that computer-based testing (CBT) offers, empirical evidence has found that identical computerized and paper-and-pencil tests have not produced equivalent test-taker performance. Referred to as the "mode effect," previous literature has identified many factors that may be responsible for such differential performance. The aim of this review was to explore these factors, which typically fit into two categories, participant and technological issues, and highlight their potential impact on performance.

Available online to registered users:

Documents

Guidelines:

ITC International Guidelines on Computer-Based and Internet-Delivered Testing 

These are internationally agreed guidelines specifically aimed at computer/Internet based testing. The guidelines highlight good practice.

Web based online version:

British Psychological Society Psychological Testing Centre

British Psychological Society Psychological Testing Centre (2002) Guidelines for the Development and Use of Computer-based Assessments . Leicester: British Psychological Society.

Standards:

British Standards Institute

British Standards' Institute (BSI). BS 23988 (2007). A code of practice for the use of information technology for the delivery of assessments. British Standards' Institute.

BS ISO/IEC 23988:2007
Information technology. A code of practice for the use of information technology (IT) in the delivery of assessments
ISBN: 9780580502248
Module(s): GBM25
Publication Date: 28/02/07
Pagination: 48
Replaces: BS 7988:2002
Developments in the capabilities of IT have led to its growing use to deliver, score and record responses of tests and assessments in a wide range of educational and other contexts. Suitably used, IT delivery offers advantages of speed and efficiency, better feedback and improvements in validity and reliability, but its increased use has raised issues about the security and fairness of IT-delivered assessments, as well as resulting in a wide range of different practices. BS 7988:2002 A code of practice for the use of information technology (IT) in the delivery of assessments has achieved international status to become BS ISO/IEC 23988:2007.BS ISO/IEC 23988:2007 gives recommendations on the use of IT to deliver assessments to candidates and to record and score their responses. Its scope is defined in terms of three dimensions: the types of assessment to which it applies, the stages of the assessment life cycle to which it applies and this standard's focus on specific IT aspects. Normative references, terms, definitions, guiding principles and the interface between assessment content and IT delivery are discussed.

British Standards Institute

Conference

The 6^th International Test Commission conference will be on 'The impact of testing on people and society: Enhancing the value of test use'. The conference will be held in Liverpool, United Kingdom in 2008 (14-16th July 2008).

The conference will bring together researchers, educators, psychologists, policy experts, testing specialists and those who use tests on a regular basis to discuss the impact of testing on people and society. The conference will address methodological, technical, professional and ethical issues in relation to policy and practice issues within testing, which includes the value and utility of testing, policy and practice issues in testing, advances in testing, the availability and use of tests in small and developing countries and the impact of tests and testing on people and society. The conference will consist of invited lectures, workshops, symposia, paper sessions and posters and will cover the areas of work, health, leisure and educational contexts.

The conference website will be announced shortly, but If you want to know more or have a suggestion for topics that you feel would fit within the conference's themes click here: