Umeå University's logo

umu.sePublications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Using the information metric to analyze clinical rating scales
McGill University, Canada.
Ottawa Hospital Research Institute, Canada.
University of Manitoba, Canada.
Dalhousie University, Canada; University of Manitoba, Canada.
Show others and affiliations
2026 (English)In: Journal of educational and behavioral statistics, ISSN 1076-9986, E-ISSN 1935-1054, Vol. 51, no 2, p. 395-418Article in journal (Refereed) Published
Abstract [en]

A rating scale is a set of categories designed to obtain information about a quantitative or a qualitative attribute. Item response theory (IRT) proposes that a probability function over a single latent variable represents the overall attribute evolution that the scale is designed to assess. Here we utilize an information theory approach to IRT to analyze rating scale data. The proposed IRT analyses, based on surprisal, offer new tools for assessing raters, rated items, and the whole rating scale. The information transformation from probability to surprisal is a new lens from which to view choice data and is an important augmentation of probability-based IRT. It also offers new graphical tools to measure the amount of information captured by an item in an additive metric, and to measure covariation among items using mutual information. The proposed methodology is illustrated using two scales from real clinical data and the proposed approach is compared with analyses made with the commonly used parametric IRT graded response model. Practical implications of the proposed methodology are provided.

Place, publisher, year, edition, pages
Sage Publications, 2026. Vol. 51, no 2, p. 395-418
Keywords [en]
surprisal, information manifold, scope, scale information, score index, entropy, mutual entropy
National Category
Probability Theory and Statistics
Identifiers
URN: urn:nbn:se:umu:diva-242839DOI: 10.3102/10769986251314833ISI: 001429984000001Scopus ID: 2-s2.0-86000757638OAI: oai:DiVA.org:umu-242839DiVA, id: diva2:1987842
Funder
Swedish Research Council, 2022-02046Marianne and Marcus Wallenberg Foundation, MMW 2019.0129Available from: 2025-08-08 Created: 2025-08-08 Last updated: 2026-06-03Bibliographically approved

Open Access in DiVA

fulltext(5489 kB)4 downloads
File information
File name FULLTEXT02.pdfFile size 5489 kBChecksum SHA-512
1d76bf93f764d58153aad9e2e69b8fa948d5263c6d77cc17d17fd4659fb0cb2177c8197080edf4d0d23682afba8cef465bb01b9098f30f9531d45f1337dd04c4
Type fulltextMimetype application/pdf

Other links

Publisher's full textScopus

Authority records

Wallmark, JoakimWiberg, Marie

Search in DiVA

By author/editor
Wallmark, JoakimWiberg, Marie
By organisation
Statistics
In the same journal
Journal of educational and behavioral statistics
Probability Theory and Statistics

Search outside of DiVA

GoogleGoogle Scholar
Total: 70 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

doi
urn-nbn

Altmetric score

doi
urn-nbn
Total: 463 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf