umu.sePublications
Change search
ReferencesLink to record
Permanent link

Direct link
Validating cut scores set by Angoff procedures with results from equating procedures
Umeå University, Faculty of Social Sciences, Department of applied educational science, Departement of Educational Measurement.ORCID iD: 0000-0003-3028-1299
2015 (English)Conference paper, Presentation (Refereed)
Abstract [en]

In Sweden the cut scores for each new test form of national tests in mathematics are set before test administration. This demand has existed ever since the transition to the current criterion-referenced system in 1994. One argument given for this requirement is to make sure that teachers no longer score and interpret the test score in a relative manner. The cut scores are set with a judgemental Angoff procedure, without inclusion of item field test data and with no regular equating or linking procedure. Therefore, a relevant question is if it is naïve to assume that the cut scores are equivalent over years. In these studies the equivalence of the cut scores for two, different and separate, pairs of tests are investigated, by comparing cut scores set by Angoff procedures with the results from equating procedures. In both examples a non-equivalent group anchor test (NEAT) design was used. The cut scores was compared to equating procedures with linear and equipercentile methods. The results show that there are validity arguments supporting that the Angoff procedure is working. However, the equating procedures reveal several methodological and practical challenges.

Place, publisher, year, edition, pages
2015.
National Category
Educational Sciences
Research subject
didactics of educational measurement
Identifiers
URN: urn:nbn:se:umu:diva-111086OAI: oai:DiVA.org:umu-111086DiVA: diva2:867121
Conference
Standard-setting: International state of research and practices in the Nordic countries, Oslo, 21-23 september, 2015
Available from: 2015-11-04 Created: 2015-11-04 Last updated: 2015-11-04

Open Access in DiVA

No full text

Search in DiVA

By author/editor
Lind Pantzare, Anna
By organisation
Departement of Educational Measurement
Educational Sciences

Search outside of DiVA

GoogleGoogle Scholar
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

Total: 144 hits
ReferencesLink to record
Permanent link

Direct link