umu.sePublications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Is This Reliable Enough?: Examining Classification Consistency and Accuracy in a Criterion-Referenced Test
Umeå University, Faculty of Social Sciences, Department of applied educational science.
2016 (English)In: International journal of assessment tools in education, ISSN 2148-7456, Vol. 3, no 2, 137-150 p.Article in journal (Refereed) Published
Abstract [en]

One important step for assessing the quality of a test is to examine the reliability of test score interpretation. Which aspect of reliability is the most relevant depends on what type of test it is and how the scores are to be used. For criterion-referenced tests, and in particular certification tests, where students are classified into performance categories, primary focus need not be on the size of error but on the impact of this error on classification. This impact can be described in terms of classification consistency and classification accuracy. In this article selected methods from classical test theory for estimating classification consistency and classification accuracy were applied to the theory part of the Swedish driving licence test, a high-stakes criterion-referenced test which is rarely studied in terms of reliability of classification. The results for this particular test indicated a level of classification consistency that falls slightly short of the recommended level which is why lengthening the test should be considered. More evidence should also be gathered as to whether the placement of the cut-off score is appropriate since this has implications for the validity of classifications.

Place, publisher, year, edition, pages
IJATE-INT JOURNAL ASSESSMENT TOOLS EDUCATION , 2016. Vol. 3, no 2, 137-150 p.
Keyword [en]
reliability, criterion-referenced test, driving licence test, classification consistency, decision nsistency, single administration
National Category
Probability Theory and Statistics Educational Sciences
Identifiers
URN: urn:nbn:se:umu:diva-139826DOI: 10.21449/ijate.245198ISI: 000409392100003OAI: oai:DiVA.org:umu-139826DiVA: diva2:1143724
Available from: 2017-09-22 Created: 2017-09-22 Last updated: 2017-09-22Bibliographically approved

Open Access in DiVA

No full text

Other links

Publisher's full text

Search in DiVA

By author/editor
Alger, Susanne
By organisation
Department of applied educational science
Probability Theory and StatisticsEducational Sciences

Search outside of DiVA

GoogleGoogle Scholar

Altmetric score

Total: 17 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf