Umeå universitets logga

umu.sePublikationer
Driftmeddelande
För närvarande är det driftstörningar. Felsökning pågår.
Ändra sökning
RefereraExporteraLänk till posten
Permanent länk

Direktlänk
Referera
Referensformat
  • apa
  • ieee
  • vancouver
  • Annat format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annat språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf
A fair score?: group independent validity arguments for college admission tests
Umeå universitet, Samhällsvetenskapliga fakulteten, Institutionen för tillämpad utbildningsvetenskap.
2020 (Engelska)Doktorsavhandling, sammanläggning (Övrigt vetenskapligt)
Abstract [en]

This thesis aims to investigate fair use of test scores for admission to higher education. In this thesis, fairness is narrowed down to an instrumental definition relating to a fair interpretation of test scores. The focus is on the use of the Swedish Scholastic Aptitude Test (SweSAT) for admission decisions. The main questions targeted are whether the scores generated from an adaptation with extended time for test takers with dyslexia are fair and whether the SweSAT-scores may disadvantage students with an immigrant background.

The thesis is based on validity theory and an established argument-based validity concept is used to link the results to crucial aspects of fairness. This thesis adds explicit fairness-related issues in some detail to this already established framework used for validity research related to the SweSAT. This approach involves some propositions about fairness, each of which can be investigated empirically which, to some extent, has been conducted in separate studies in this thesis.

The individual studies contain a variety of results. In the first study, sub-scores of the SweSAT was found to have differential values for certain groups of test takers. This could cause unfairness if the sub-scores are used for admission decisions, but it also indicates that the internal structure of the test is inconsistent across groups. In the second article, the SweSAT was found to be speeded, meaning that the time limit is affecting the test score, and that test takers with dyslexia generally benefit from being given extra time to complete the test. It could not be ruled out that the extra time causes a beneficial experience of lower speededness compared to the rest of the test population, who take the test with no extra time. In the third article, we discover, to our surprise, that immigrant groups generally perform worse than expected in higher education when the expectations are based on their SweSAT and upper secondary school grades. In other words, the instruments used does not create an unintentional obstacle for immigrants in general since the ability of these groups to complete higher education is overestimated when grades and SweSAT-Scores are used for selection. However, in the final article, test items that may cause an unfair disadvantage for immigrant students was identified.

In summary, the results contribute to expanding and, to some extent, strengthening the validity of using the SweSAT for admission. However, certain fairness issues have been noted.

Ort, förlag, år, upplaga, sidor
Umeå: Umeå universitet , 2020. , s. 54
Serie
Academic dissertations at the department of Educational Measurement, ISSN 1652-9650 ; 13
Nyckelord [en]
Fairness, Validity, Immigration, Dyslexia, Special populations, SweSAT
Nationell ämneskategori
Utbildningsvetenskap Övrig annan samhällsvetenskap
Forskningsämne
beteendevetenskapliga mätningar
Identifikatorer
URN: urn:nbn:se:umu:diva-176761ISBN: 978-91-7855-400-3 (tryckt)ISBN: 978-91-7855-401-0 (digital)OAI: oai:DiVA.org:umu-176761DiVA, id: diva2:1501571
Disputation
2020-12-11, Aula Biologica, Biologihuset, Umeå, 10:00 (Svenska)
Opponent
Handledare
Tillgänglig från: 2020-11-20 Skapad: 2020-11-17 Senast uppdaterad: 2020-11-17Bibliografiskt granskad
Delarbeten
1. Group Differences in the Value of Subscores: A Fairness Issue
Öppna denna publikation i ny flik eller fönster >>Group Differences in the Value of Subscores: A Fairness Issue
2020 (Engelska)Ingår i: Frontiers in Education, E-ISSN 2504-284X, Vol. 5, artikel-id 55Artikel i tidskrift (Refereegranskat) Published
Abstract [en]

The aim of this paper was to study fairness in testing by analyzing the quality of subscores for different groups of test takers. This is done by studying the value added ratio (VAR) for all subscores in the test, which here is a Swedish college admission test. Comparisons were made between test takers who take the regular test and test takers who are taking the test with extended time adaptation, as well as between males and females. Significant group differences in such subscore value would raise questions about fairness for that testing program. In particular, differences in subscore value between subgroups based on accommodations could indicate problems with the appropriateness of the accommodation. We found that the value added ratio (VAR) for all subscores in the studied test were slightly larger for males than for females. There were some differences between subgroups with respect to the extended time accommodation, but they were not systematic in the same way as for males and females. While the differences in the subscores' added value were small in general, they may in some instances be large enough to pose a threat to a valid and fair interpretation and use of test scores, and thus raises questions about fairness.

Ort, förlag, år, upplaga, sidor
Frontiers Media S.A., 2020
Nyckelord
fairness, subscores, gender, dyslexia, test, adaptation, accomodation, Rättvisa, Högskoleprovet, Antagning, Dyslexi
Nationell ämneskategori
Utbildningsvetenskap
Forskningsämne
beteendevetenskapliga mätningar
Identifikatorer
urn:nbn:se:umu:diva-174413 (URN)10.3389/feduc.2020.00055 (DOI)000682678700001 ()2-s2.0-85089410688 (Scopus ID)
Tillgänglig från: 2020-08-24 Skapad: 2020-08-24 Senast uppdaterad: 2023-09-05Bibliografiskt granskad
2. Just Enough Time to Level the Playing Field: Time Adaptation in a College Admission Test
Öppna denna publikation i ny flik eller fönster >>Just Enough Time to Level the Playing Field: Time Adaptation in a College Admission Test
2021 (Engelska)Ingår i: Scandinavian Journal of Educational Research, ISSN 0031-3831, E-ISSN 1470-1170, Vol. 65, nr 6, s. 941-955Artikel i tidskrift (Refereegranskat) Published
Abstract [en]

Extended time is a commonly-used test adaptation for standardised high-stakes tests. In this study, extended time provided for test-takers with dyslexia is examined. Data from standard versions of the Swedish Scholastic Aptitude Test (SweSAT) and data from test administrations where extra time is provided was used. Indications are that the standard version of the test is speeded and that the extra time provided improves test results for test-takers with dyslexia. There are, however, no conclusive indications supporting differential speededness due to the extra time. Findings from this study shows the beneficial effects of providing extra time for test-takers with dyslexia, but it does not conclusively disprove that this extra time cause an unfair advantage.

Ort, förlag, år, upplaga, sidor
Routledge, 2021
Nyckelord
Adaptation, accommodation, fairness, bias, extended time
Nationell ämneskategori
Psykologi (exklusive tillämpad psykologi)
Identifikatorer
urn:nbn:se:umu:diva-173761 (URN)10.1080/00313831.2020.1788143 (DOI)000548939000001 ()2-s2.0-85088026372 (Scopus ID)
Anmärkning

First published online: 14 Jul 2020

Tillgänglig från: 2020-07-31 Skapad: 2020-07-31 Senast uppdaterad: 2021-12-30Bibliografiskt granskad
3. Predictive Validity in Selection to Higher Education: Potential Barriers for Students with Immigrant Backgrounds
Öppna denna publikation i ny flik eller fönster >>Predictive Validity in Selection to Higher Education: Potential Barriers for Students with Immigrant Backgrounds
(Engelska)Manuskript (preprint) (Övrigt vetenskapligt)
Nationell ämneskategori
Utbildningsvetenskap
Forskningsämne
beteendevetenskapliga mätningar
Identifikatorer
urn:nbn:se:umu:diva-176758 (URN)
Tillgänglig från: 2020-11-17 Skapad: 2020-11-17 Senast uppdaterad: 2020-11-17
4. Differential item functioning and item bias related to immigrant background in the Swedish Scholastic Aptitude Test
Öppna denna publikation i ny flik eller fönster >>Differential item functioning and item bias related to immigrant background in the Swedish Scholastic Aptitude Test
(Engelska)Manuskript (preprint) (Övrigt vetenskapligt)
Nationell ämneskategori
Utbildningsvetenskap
Forskningsämne
beteendevetenskapliga mätningar
Identifikatorer
urn:nbn:se:umu:diva-176759 (URN)
Tillgänglig från: 2020-11-17 Skapad: 2020-11-17 Senast uppdaterad: 2020-11-17

Open Access i DiVA

fulltext(1009 kB)552 nedladdningar
Filinformation
Filnamn FULLTEXT01.pdfFilstorlek 1009 kBChecksumma SHA-512
bfc200067c75233f2420d5eea1bedfecff1e34f55960c01928492bd725d6ddb1d5a44c55e93f551d5025970ae6f6c1955e9c07ddc2e62f570aa841a35fded4f0
Typ fulltextMimetyp application/pdf
spikblad(349 kB)77 nedladdningar
Filinformation
Filnamn SPIKBLAD01.pdfFilstorlek 349 kBChecksumma SHA-512
8424adb73299b6928f2783a2377ae6f0702499ea443dd99286e5d969453a08c4f5ce4e3eb945b6e9be26ffcbbdb39e0749c57cfb60e31e403b9ca01a361b557d
Typ spikbladMimetyp application/pdf

Person

Strömbäck Hjärne, Marcus

Sök vidare i DiVA

Av författaren/redaktören
Strömbäck Hjärne, Marcus
Av organisationen
Institutionen för tillämpad utbildningsvetenskap
UtbildningsvetenskapÖvrig annan samhällsvetenskap

Sök vidare utanför DiVA

GoogleGoogle Scholar
Totalt: 552 nedladdningar
Antalet nedladdningar är summan av nedladdningar för alla fulltexter. Det kan inkludera t.ex tidigare versioner som nu inte längre är tillgängliga.

isbn
urn-nbn

Altmetricpoäng

isbn
urn-nbn
Totalt: 2524 träffar
RefereraExporteraLänk till posten
Permanent länk

Direktlänk
Referera
Referensformat
  • apa
  • ieee
  • vancouver
  • Annat format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annat språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf