Umeå University's logo

The mathematics PISA tasks are primarily supposed to measure mathematical ability and not reading ability, so it is important to avoid unnecessary demands of reading ability in the tasks. Many readability formulas are using both word length and sentence length as indicators of text difficulty. In this study, we examine differences and similarities between English, German, and Swedish mathematics PISA tasks regarding word length and sentence length. We analyze 146 mathematics PISA tasks from 2000–2013, in English, German, and Swedish. For each task we create measures of mean word and sentence length. To analyze if there are any differences between the three language versions of the tasks, we use t-tests to compare the three languages pairwise. We found that in average, the German versions have the longest words, followed by Swedish and then English. Average sentence length was highest for English, followed by German and then Swedish.