Change search
ReferencesLink to record
Permanent link

Direct link
Methods for Examining the Psychometric Quality of Subscores: A Review and Application
Umeå University, Faculty of Social Sciences, Department of applied educational science, Departement of Educational Measurement.
Umeå University, Faculty of Social Sciences, Department of applied educational science, Departement of Educational Measurement.
2015 (English)In: Practical Assessment, Research & Evaluation, ISSN 1531-7714, E-ISSN 1531-7714, Vol. 20, 21Article in journal (Refereed) Published
Abstract [en]

When subscores on a test are reported to the test taker, the appropriateness of reporting them depends on whether they provide useful information above what is provided by the total score. Subscores that fail to do so lack adequate psychometric quality and should not be reported. There are several methods for examining the quality of subscores, and in this study seven such methods, four of which are based on classical test theory and three of which are based on item response theory, were reviewed and applied to empirical data. The data consisted of test takers' scores on four test forms – two administrations of a first version of a college admission test and two administrations of a second version – and the analyses were carried out on the subtest and section levels. The two section scores were found to have adequate psychometric quality with all methods used, whereas the results for subtest scores ranged from almost all scores having adequate psychometric quality to none having adequate psychometric quality. The authors recommend using Haberman's method and the related utility index because of their solid theoretical foundation and because of various issues with the other subscore quality methods.

Place, publisher, year, edition, pages
2015. Vol. 20, 21
Keyword [en]
subscores, score reporting, mean squared error, factor analysis, IRT, college admissions tests
National Category
Pedagogy Psychology
Research subject
didactics of educational measurement
URN: urn:nbn:se:umu:diva-112181OAI: diva2:876398
Available from: 2015-12-03 Created: 2015-12-03 Last updated: 2015-12-11Bibliographically approved

Open Access in DiVA

fulltext(605 kB)59 downloads
File information
File name FULLTEXT01.pdfFile size 605 kBChecksum SHA-512
Type fulltextMimetype application/pdf

Other links


Search in DiVA

By author/editor
Wedman, JonathanLyrén, Per-Erik
By organisation
Departement of Educational Measurement
In the same journal
Practical Assessment, Research & Evaluation

Search outside of DiVA

GoogleGoogle Scholar
Total: 59 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

Total: 393 hits
ReferencesLink to record
Permanent link

Direct link