Umeå universitets logga

umu.sePublikationer
Driftstörningar
Det förekommer återkommande driftstörningar på några av sök-portalerna på grund av hög belastning. Vi arbetar på att lösa problemet, ni kan tillfälligt mötas av ett felmeddelande.
Ändra sökning
RefereraExporteraLänk till posten
Permanent länk

Direktlänk
Referera
Referensformat
  • apa
  • ieee
  • vancouver
  • Annat format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annat språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf
Group Differences in the Value of Subscores: A Fairness Issue
Umeå universitet, Samhällsvetenskapliga fakulteten, Institutionen för tillämpad utbildningsvetenskap.
Umeå universitet, Samhällsvetenskapliga fakulteten, Institutionen för tillämpad utbildningsvetenskap, Beteendevetenskapliga mätningar (BVM).
2020 (Engelska)Ingår i: Frontiers in Education, E-ISSN 2504-284X, Vol. 5, artikel-id 55Artikel i tidskrift (Refereegranskat) Published
Abstract [en]

The aim of this paper was to study fairness in testing by analyzing the quality of subscores for different groups of test takers. This is done by studying the value added ratio (VAR) for all subscores in the test, which here is a Swedish college admission test. Comparisons were made between test takers who take the regular test and test takers who are taking the test with extended time adaptation, as well as between males and females. Significant group differences in such subscore value would raise questions about fairness for that testing program. In particular, differences in subscore value between subgroups based on accommodations could indicate problems with the appropriateness of the accommodation. We found that the value added ratio (VAR) for all subscores in the studied test were slightly larger for males than for females. There were some differences between subgroups with respect to the extended time accommodation, but they were not systematic in the same way as for males and females. While the differences in the subscores' added value were small in general, they may in some instances be large enough to pose a threat to a valid and fair interpretation and use of test scores, and thus raises questions about fairness.

Ort, förlag, år, upplaga, sidor
Frontiers Media S.A., 2020. Vol. 5, artikel-id 55
Nyckelord [en]
fairness, subscores, gender, dyslexia, test, adaptation, accomodation
Nyckelord [sv]
Rättvisa, Högskoleprovet, Antagning, Dyslexi
Nationell ämneskategori
Utbildningsvetenskap
Forskningsämne
beteendevetenskapliga mätningar
Identifikatorer
URN: urn:nbn:se:umu:diva-174413DOI: 10.3389/feduc.2020.00055ISI: 000682678700001Scopus ID: 2-s2.0-85089410688OAI: oai:DiVA.org:umu-174413DiVA, id: diva2:1460377
Tillgänglig från: 2020-08-24 Skapad: 2020-08-24 Senast uppdaterad: 2023-09-05Bibliografiskt granskad
Ingår i avhandling
1. A fair score?: group independent validity arguments for college admission tests
Öppna denna publikation i ny flik eller fönster >>A fair score?: group independent validity arguments for college admission tests
2020 (Engelska)Doktorsavhandling, sammanläggning (Övrigt vetenskapligt)
Abstract [en]

This thesis aims to investigate fair use of test scores for admission to higher education. In this thesis, fairness is narrowed down to an instrumental definition relating to a fair interpretation of test scores. The focus is on the use of the Swedish Scholastic Aptitude Test (SweSAT) for admission decisions. The main questions targeted are whether the scores generated from an adaptation with extended time for test takers with dyslexia are fair and whether the SweSAT-scores may disadvantage students with an immigrant background.

The thesis is based on validity theory and an established argument-based validity concept is used to link the results to crucial aspects of fairness. This thesis adds explicit fairness-related issues in some detail to this already established framework used for validity research related to the SweSAT. This approach involves some propositions about fairness, each of which can be investigated empirically which, to some extent, has been conducted in separate studies in this thesis.

The individual studies contain a variety of results. In the first study, sub-scores of the SweSAT was found to have differential values for certain groups of test takers. This could cause unfairness if the sub-scores are used for admission decisions, but it also indicates that the internal structure of the test is inconsistent across groups. In the second article, the SweSAT was found to be speeded, meaning that the time limit is affecting the test score, and that test takers with dyslexia generally benefit from being given extra time to complete the test. It could not be ruled out that the extra time causes a beneficial experience of lower speededness compared to the rest of the test population, who take the test with no extra time. In the third article, we discover, to our surprise, that immigrant groups generally perform worse than expected in higher education when the expectations are based on their SweSAT and upper secondary school grades. In other words, the instruments used does not create an unintentional obstacle for immigrants in general since the ability of these groups to complete higher education is overestimated when grades and SweSAT-Scores are used for selection. However, in the final article, test items that may cause an unfair disadvantage for immigrant students was identified.

In summary, the results contribute to expanding and, to some extent, strengthening the validity of using the SweSAT for admission. However, certain fairness issues have been noted.

Ort, förlag, år, upplaga, sidor
Umeå: Umeå universitet, 2020. s. 54
Serie
Academic dissertations at the department of Educational Measurement, ISSN 1652-9650 ; 13
Nyckelord
Fairness, Validity, Immigration, Dyslexia, Special populations, SweSAT
Nationell ämneskategori
Utbildningsvetenskap Övrig annan samhällsvetenskap
Forskningsämne
beteendevetenskapliga mätningar
Identifikatorer
urn:nbn:se:umu:diva-176761 (URN)978-91-7855-400-3 (ISBN)978-91-7855-401-0 (ISBN)
Disputation
2020-12-11, Aula Biologica, Biologihuset, Umeå, 10:00 (Svenska)
Opponent
Handledare
Tillgänglig från: 2020-11-20 Skapad: 2020-11-17 Senast uppdaterad: 2020-11-17Bibliografiskt granskad

Open Access i DiVA

fulltext(1279 kB)246 nedladdningar
Filinformation
Filnamn FULLTEXT04.pdfFilstorlek 1279 kBChecksumma SHA-512
8db30c6ce26a39751dd85cf69666ec0485ad8ef00e0e6c5e127e8dfb553686d161e960f37a60a90b13a3754dc834ca29bc1988af500b47f68d7ade715dcaac30
Typ fulltextMimetyp application/pdf

Övriga länkar

Förlagets fulltextScopus

Person

Strömbäck Hjärne, MarcusLyrén, Per-Erik

Sök vidare i DiVA

Av författaren/redaktören
Strömbäck Hjärne, MarcusLyrén, Per-Erik
Av organisationen
Institutionen för tillämpad utbildningsvetenskapBeteendevetenskapliga mätningar (BVM)
I samma tidskrift
Frontiers in Education
Utbildningsvetenskap

Sök vidare utanför DiVA

GoogleGoogle Scholar
Totalt: 253 nedladdningar
Antalet nedladdningar är summan av nedladdningar för alla fulltexter. Det kan inkludera t.ex tidigare versioner som nu inte längre är tillgängliga.

doi
urn-nbn

Altmetricpoäng

doi
urn-nbn
Totalt: 921 träffar
RefereraExporteraLänk till posten
Permanent länk

Direktlänk
Referera
Referensformat
  • apa
  • ieee
  • vancouver
  • Annat format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annat språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf