Umeå University's logo

umu.sePublications
Change search
ExportLink to record
Permanent link

Direct link
BETA

Project

Project type/Form of grant
Project grant
Title [sv]
Vad kan vi lära av storskaliga internationella komparativa kunskapsmätningar för att utveckla den svenska skolan?
Title [en]
What can we learn from large-scale international comparative assessments in order to develop the Swedish school?
Abstract [en]
Results from comparative international large-scale assessment studies, such as TIMSS and PISA generally reflect a downward trend for Swedish students? results in subjects such as mathematics, science and reading comprehension. Descriptive analyses are compiled after each assessment, but there is a lack of more analytical analyses. Nevertheless, presented results receive a lot of attention in the public arena and educational investments are often based on results from these assessments. A valid question is on what groundwork the decisions are made, i.e. the interpretations and conclusions that reinforce the political decisions. It is fundamental that the assessment instruments (the subject tests and the background questionnaires) provide reliable and valid information about the concepts and abilities they intend to measure. It is also of vital importance that this works in a similar manner for all students in the examined country. Furthermore, if the international comparative studies should be able to make a substantial contribution to the knowledge of educational science field, there is an urge for deepened and extended analysis of data from these assessments. In addition, it is important to use the vast amount of collected background information (questionnaire data) in order to develop schools and thereby promote student success, not least in the light of the growing focus on assessments which imply that students and the teachers devote considerable time in participating in assessments and to preparations. The overall purpose is to examine the quality of the information TIMSS and PISA provide for different groups of students and to examine the relevance of this information for development of the Swedish school and thereby enhance student success. This is conducted by content analysis of the instruments and statistical analyses and modelling of the students? test achievements. In order to take into account the hierarchical data structure of TIMSS and PISA and control for the student backgrounds when analyzing the results, multilevel analysis will be used. Project funding is sought for five years (2016-2020). Available data include data from PISA (2015, 2012, 2009, 2006, 2003, and 2000) and TIMSS (2015, 2011, 2007 and 2003). Regarding TIMSS data, eight grade students will be used, since this group of students are about the same age as those assessed in PISA. Primary, the most recent available data will be used but to conduct comparisons over time, older data are used provided that the content of the tests and questionnaires are not altered too much. The project time period ensures that the 2015 international data bases for both TIMSS and PISA are published and that there are time to analyze the results. In TIMSS, four kinds of instruments are available; student test results, students? questionnaires?, teachers? questionnaires and the principals? questionnaires. In PISA similar instruments are available except that there are no teachers? questionnaires. The fact that both TIMSS and PISA are distributed during 2015 creates a unique opportunity to both study the Swedish students? results on the test, as well as the instruments used in an international context. Within this project the students? results on TIMSS 2015 will also be connected with their national test scores and grades to examine how this assessment instrument work in the Swedish context. The results will contribute to unique knowledge of how Swedish student performance on large-scales assessment, relate to their national test results, grades and home background. The project will also shed light on how TIMSS and PISA relate to each other and how we can use data from TIMSS and PISA to develop the Swedish schools and thereby enhance student success. An important aspect will be to put the Swedish students? results in an international context through country comparisons. The results will be published in international peer-review journals and presented on international confe
Publications (2 of 2) Show all publications
Laukaityte, I., Rolfsman, E. & Wiberg, M. (2024). TIMSS vs. PISA: what can they tell us about student success?—a comparison of Swedish and Norwegian TIMSS and PISA 2015 results with a focus on school factors. Frontiers in Education, 9, Article ID 1323687.
Open this publication in new window or tab >>TIMSS vs. PISA: what can they tell us about student success?—a comparison of Swedish and Norwegian TIMSS and PISA 2015 results with a focus on school factors
2024 (English)In: Frontiers in Education, E-ISSN 2504-284X, Vol. 9, article id 1323687Article in journal (Refereed) Published
Abstract [en]

This paper explores the measurement capabilities of the Trends in International Mathematics and Science Study (TIMSS) and the Program for International Student Assessment (PISA) in assessing school factors that influence student performance. We specifically focus on the 2015 assessments of the science performance of eighth graders in Sweden and Norway. This was the latest year when the two assessments were conducted in the same year and science was the major subject area in the PISA assessment, which was essential for maximizing the assessments’ comparability. Using multilevel models, the study identifies common and unique factors across the assessments and investigates the factors that influence student performance at different proficiency levels. The findings highlight the importance of school-level factors, which are significant in both assessments. Moreover, both assessments provide information on overlapping sets of factors that have varying influence on the performance of students with different proficiency levels. Overall, there are limited common factors between TIMSS and PISA. School factors vary between low-performing and high-performing schools, with differing significance in Norway and Sweden. The results indicate that TIMSS and PISA assessments offer complementary information, particularly for low-performing schools. Our findings suggest that different school types may benefit or suffer from distinct school factors. The findings are relevant for both educational professionals and policy-makers.

Place, publisher, year, edition, pages
Frontiers Media S.A., 2024
Keywords
multilevel models, student success, school-factors, TIMSS, PISA
National Category
Educational Sciences
Identifiers
urn:nbn:se:umu:diva-221346 (URN)10.3389/feduc.2024.1323687 (DOI)001174910400001 ()2-s2.0-85186547719 (Scopus ID)
Funder
Swedish Research Council, 2015-02160
Available from: 2024-02-21 Created: 2024-02-21 Last updated: 2024-04-03Bibliographically approved
Laukaityte, I. & Rolfsman, E. (2020). Low, medium, and high-performing schools in the Nordic countries: Student performance at PISA Mathematics 2003-2012. Education Inquiry, 11(3), 276-295
Open this publication in new window or tab >>Low, medium, and high-performing schools in the Nordic countries: Student performance at PISA Mathematics 2003-2012
2020 (English)In: Education Inquiry, E-ISSN 2000-4508, Vol. 11, no 3, p. 276-295Article in journal (Refereed) Published
Abstract [en]

Decreasing performance in several core subjects among students in Sweden and the increasing segregation of schools are urgent issues in relation to equity in education, which has been a long-term goal in Sweden. The aim of this study is to identify factors in the school environment associated with student performance in PISA in mathematics at different performance levels in the Nordic countries. In order to separate the effects of school-level variables from the effects of student background factors, and to deal with the multistage sampling design used in PISA, multilevel analysis was used in this exploratory study. Based on data from PISA 2003 and 2012, which are the most recent assessments with a focus on mathematics, results have shown that a few school-level factors seemed to be associated with student success, and then mainly among low and medium-performing schools. Overall, school-level factors associated with success (or lack of it) partially differ between countries and over the years. These results have implications for educational professionals since some of the school-level factors identified inhibit potential for change.

Place, publisher, year, edition, pages
Taylor & Francis Group, 2020
Keywords
Large-scale comparative studies, Multilevel modelling, Performance levels, School-effectiveness, School-level factors.
National Category
Pedagogical Work
Identifiers
urn:nbn:se:umu:diva-168017 (URN)10.1080/20004508.2020.1721256 (DOI)000993479000005 ()2-s2.0-85079170159 (Scopus ID)
Funder
Swedish Research Council, 2015-02160
Available from: 2020-02-10 Created: 2020-02-10 Last updated: 2023-09-05Bibliographically approved
Principal InvestigatorRolfsman, Ewa
Coordinating organisation
Umeå University
Funder
Period
2016-01-01 - 2020-12-31
National Category
Pedagogy
Identifiers
DiVA, id: project:1440Project, id: 2015-02160_VR

Search in DiVA

Pedagogy

Search outside of DiVA

GoogleGoogle Scholar