Umeå University's logo

umu.sePublications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Item response theory-based continuous norming
Department Psychometrics and Statistics, University of Groningen, Netherlands.
Department Psychometrics and Statistics, University of Groningen, Netherlands.
Umeå University, Faculty of Social Sciences, Umeå School of Business and Economics (USBE), Statistics.ORCID iD: 0000-0001-5549-8262
Department Psychometrics and Statistics, University of Groningen, Netherlands.
2024 (English)In: Psychological methods, ISSN 1082-989X, E-ISSN 1939-1463Article in journal (Refereed) Epub ahead of print
Abstract [en]

In norm-referenced psychological testing, an individual’s performance is expressed in relation to a reference population using a standardized score, like an intelligence quotient score. The reference population can depend on a continuous variable, like age. Current continuous norming methods transform the raw score into an age-dependent standardized score. Such methods have the shortcoming to solely rely on the raw test scores, ignoring valuable information from individual item responses. Instead of modeling the raw test scores, we propose modeling the item scores with a Bayesian two-parameter logistic (2PL) item response theory model with age-dependent mean and variance of the latent trait distribution, 2PL-norm for short. Norms are then derived using the estimated latent trait score and the age-dependent distribution parameters. Simulations show that 2PL-norms are overall more accurate than those from the most popular raw score-based norming methods cNORM and generalized additive models for location, scale, and shape (GAMLSS). Furthermore, the credible intervals of 2PL-norm exhibit clearly superior coverage over the confidence intervals of the raw score-based methods. The only issue of 2PL-norm is its slightly lower performance at the tails of the norms. Among the raw score-based norming methods, GAMLSS outperforms cNORM. For empirical practice this suggests the use of 2PL-norm, if the model assumptions hold. If not, or the interest is solely in the point estimates of the extreme trait positions, GAMLSS-based norming is a better alternative. The use of the 2PL-norm is illustrated and compared with GAMLSS and cNORM using empirical data, and code is provided, so that users can readily apply 2PL-norm to their normative data.

Place, publisher, year, edition, pages
American Psychological Association (APA), 2024.
Keywords [en]
two-parameter item response theory model, psychological tests, norm-referenced tests
National Category
Probability Theory and Statistics
Research subject
Statistics
Identifiers
URN: urn:nbn:se:umu:diva-231255DOI: 10.1037/met0000686ISI: 001369790600001Scopus ID: 2-s2.0-85206668111OAI: oai:DiVA.org:umu-231255DiVA, id: diva2:1908863
Funder
Swedish Research Council, 2022-02046Available from: 2024-10-29 Created: 2024-10-29 Last updated: 2025-04-24Bibliographically approved

Open Access in DiVA

fulltext(9076 kB)41 downloads
File information
File name FULLTEXT01.pdfFile size 9076 kBChecksum SHA-512
346caa44d0c3885f9ab24e8407ed421a93b20f42a2d7a9f7d2dc7f41654bc035d70fc18c6214d7f64a41edd87105d9cd0acb354cb7e11ec9648abc7f81ee2571
Type fulltextMimetype application/pdf

Other links

Publisher's full textScopus

Authority records

Wiberg, Marie

Search in DiVA

By author/editor
Wiberg, Marie
By organisation
Statistics
In the same journal
Psychological methods
Probability Theory and Statistics

Search outside of DiVA

GoogleGoogle Scholar
Total: 41 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

doi
urn-nbn

Altmetric score

doi
urn-nbn
Total: 198 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf