Umeå University's logo

umu.sePublications
Planned maintenance
A system upgrade is planned for 10/12-2024, at 12:00-13:00. During this time DiVA will be unavailable.
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Equivalence in multilanguage mathematics assessment
Umeå University, Faculty of Science and Technology, Department of Science and Mathematics Education. Umeå University, Faculty of Science and Technology, Umeå Mathematics Education Research Centre (UMERC).ORCID iD: 0000-0002-3211-8906
Umeå University, Faculty of Science and Technology, Department of Science and Mathematics Education. Umeå University, Faculty of Science and Technology, Umeå Mathematics Education Research Centre (UMERC).ORCID iD: 0000-0002-4727-8064
Umeå University, Faculty of Science and Technology, Department of Science and Mathematics Education. Umeå University, Faculty of Science and Technology, Umeå Mathematics Education Research Centre (UMERC). Mid Sweden University, Sweden.
2023 (English)In: Nordisk matematikkdidaktikk, NOMAD: [Nordic Studies in Mathematics Education], ISSN 1104-2176, Vol. 28, no 1-2, p. 7-29Article in journal (Refereed) Published
Abstract [en]

When mathematics tasks are used in multilanguage assessments, it is necessary that the task versions in the different languages are equivalent. The purpose of this study is to deepen the knowledge on different aspects of equivalence for mathematics tasks in multilanguage assessment. We analyze mathematics tasks from PISA 2012 given to students in English, German and Swedish. To measure formal equivalence, we examine three linguistic features of the task texts and compare between language versions. To measure functional equivalence, a Differential item functioning (DIF) analysis is conducted. In addition, we examine statistically if there is a relation between DIF and the differences regarding linguistic features. The results show that there is both DIF and differences regarding the linguistic features between different language versions for several PISA tasks. However, we found no statistical relation between the two phenomena.

Place, publisher, year, edition, pages
Göteborgs universitet, 2023. Vol. 28, no 1-2, p. 7-29
National Category
Didactics Pedagogical Work Mathematics
Identifiers
URN: urn:nbn:se:umu:diva-161960OAI: oai:DiVA.org:umu-161960DiVA, id: diva2:1341167
Note

Originally included in thesis in manuscript form with tite: "The relation between linguistic features and DIF in multilanguage mathematics assessments"

Available from: 2019-08-07 Created: 2019-08-07 Last updated: 2023-08-29Bibliographically approved
In thesis
1. Does language matter?: sources of inequivalence and demand of reading ability of mathematics tasks in different languages
Open this publication in new window or tab >>Does language matter?: sources of inequivalence and demand of reading ability of mathematics tasks in different languages
2019 (English)Doctoral thesis, comprehensive summary (Other academic)
Alternative title[sv]
Spelar språket någon roll? : källor till inekvivalens och krav på läsförmåga för matematikuppgifter på olika språk
Abstract [en]

Practicing mathematics is not possible without the use of language. To communicate mathematical content, not only words in natural language are used but also non-verbal forms of communication such as mathematical symbols, graphs, and diagrams. All these forms of communication can be seen as part of the language used when doing mathematics. When mathematics tasks are used to assess mathematical competence, it is important to know how language can affect students’ possibility to solve the task. In this thesis, two different but related aspects of the relation between language and mathematics tasks are investigated. The first aspect concerns linguistic features of written mathematics task that can make the task more difficult to read and/or to solve. These features may result in unnecessary and unwanted reading demands, that is, the task then partially assesses students’ reading ability instead of their mathematical ability. The second aspect concerns differences between different language versions of mathematics tasks used in multilanguage assessments. These differences may cause inequivalence between the language versions, that is, the task may be more difficult to solve for students of one language group than students of another. Therefore, the purpose of this thesis is to investigate some of the effects that language can have on written mathematics tasks, in particular, on the validity of mathematics assessments. The thesis focuses on unnecessary reading demands and inequivalence in multilanguage assessments. The data in this thesis are obtained from tasks of the Programme for International Student Assessment (PISA) 2012. The task texts and the student results on these tasks are analyzed quantitatively to identify the occurrence and possible sources of unnecessary reading demands and inequivalence. Think-aloud-protocols and task-based interviews of students who had worked with some of the tasks, serve to qualitatively identify possible sources of reading demands and inequivalence, respectively.

The results showed both unnecessary reading demands and inequivalence in some of the tasks. Some linguistic features were identified as possible sources of these reading demands, while others were not related to them. For example, sentence length was not related to reading demands of tasks in Swedish, whereas sentence structure was identified as a possible source of unnecessary reading demands. Some linguistic differences between different language versions of mathematics tasks were also identified as possible sources of inequivalence, and in addition there were curricular differences that were such potential sources. The findings of this thesis have implications for designing mathematics tasks both in one language and in multilingual settings. They may help to ensure validity of mathematics assessments, but also to make mathematics texts easier to understand for students in general.

Place, publisher, year, edition, pages
Umeå: Umeå universitet, 2019. p. 36
Series
Doktorsavhandlingar i pedagogiskt arbete, ISSN 1650-8858 ; 87
Series
Umeå Studies in the Educational Sciences ; 35
Keywords
mathematics tasks, reading, equivalence, DIF, multilingual assessments, PISA
National Category
Didactics Pedagogical Work Mathematics
Research subject
didactics of mathematics; educational work
Identifiers
urn:nbn:se:umu:diva-161963 (URN)978-91-7855-091-3 (ISBN)
Public defence
2019-09-12, KBE301, KBC-huset, 13:00 (Swedish)
Opponent
Supervisors
Available from: 2019-08-15 Created: 2019-08-08 Last updated: 2019-08-12Bibliographically approved

Open Access in DiVA

fulltext(509 kB)90 downloads
File information
File name FULLTEXT01.pdfFile size 509 kBChecksum SHA-512
779e54078350dde8f76604d02efb7ee14710425f1b004d61dab4af7b2c6bd08beb005015ca2a36d4babdba73cccbdb9ca4ec688e6a552d90a99ef3173c2e5e9f
Type fulltextMimetype application/pdf

Other links

NOMAD 2023:28(1-2)

Authority records

Theens, FrithjofBergqvist, EwaÖsterholm, Magnus

Search in DiVA

By author/editor
Theens, FrithjofBergqvist, EwaÖsterholm, Magnus
By organisation
Department of Science and Mathematics EducationUmeå Mathematics Education Research Centre (UMERC)
In the same journal
Nordisk matematikkdidaktikk, NOMAD: [Nordic Studies in Mathematics Education]
DidacticsPedagogical WorkMathematics

Search outside of DiVA

GoogleGoogle Scholar
Total: 90 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

urn-nbn

Altmetric score

urn-nbn
Total: 586 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf