umu.sePublikasjoner
Endre søk
RefereraExporteraLink to record
Permanent link

Direct link
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Annet format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annet språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf
Using plausible values in secondary analysis in large–scale assessments
Umeå universitet, Samhällsvetenskapliga fakulteten, Handelshögskolan vid Umeå universitet, Statistik.ORCID-id: 0000-0001-7282-5384
Umeå universitet, Samhällsvetenskapliga fakulteten, Handelshögskolan vid Umeå universitet, Statistik.ORCID-id: 0000-0001-5549-8262
2017 (engelsk)Inngår i: Communications in Statistics - Theory and Methods, ISSN 0361-0926, E-ISSN 1532-415X, Vol. 46, nr 22, s. 11341-11357Artikkel i tidsskrift (Fagfellevurdert) Published
Abstract [en]

Plausible values are typically used in large–scale assessment studies, in particular in the Trends in International Mathematics and Science Study and the Programme for International Student Assessment. Despite its large spread there are still some questions regarding the use of plausible values and how such use affects statistical analyses. The aim of this paper is to demonstrate the role of plausible values in large–scale assessment surveys when multilevel modelling is used. Different user strategies concerning plausible values for multilevel models as well as means and variances are examined. The results show that some commonly used user strategies give incorrect results while others give reasonable estimates but incorrect standard errors. These findings are important for anyone wishing to make secondary analyses of large–scale assessment data, especially those interested in using multilevel models to analyze the data.

sted, utgiver, år, opplag, sider
Taylor & Francis, 2017. Vol. 46, nr 22, s. 11341-11357
Emneord [en]
Achievement, design study, multilevel modelling, simulation studies, testing
HSV kategori
Identifikatorer
URN: urn:nbn:se:umu:diva-128615DOI: 10.1080/03610926.2016.1267764ISI: 000412555500031OAI: oai:DiVA.org:umu-128615DiVA, id: diva2:1054844
Merknad

Originally included in thesis in manuscript form 

Tilgjengelig fra: 2016-12-09 Laget: 2016-12-09 Sist oppdatert: 2018-06-09bibliografisk kontrollert
Inngår i avhandling
1. Statistical modeling in international large-scale assessments
Åpne denne publikasjonen i ny fane eller vindu >>Statistical modeling in international large-scale assessments
2016 (engelsk)Doktoravhandling, med artikler (Annet vitenskapelig)
Alternativ tittel[sv]
Statistisk modellering i internationella komparativa mätningar
Abstract [en]

This thesis contributes to the area of research based on large-scale educational assessments, focusing on the application of multilevel models. The role of sampling weights, plausible values (response variable imputed multiple times) and imputation methods are demonstrated by simulations and applications to TIMSS (Trends in International Mathematics and Science Study) and PISA (Programme for International Student Assessment) data.

The large-scale assessments use multistage sampling design, which means that the units such as schools, classrooms, or students at some or all stages are selected with unequal probabilities. In order to make valid estimates and inferences sampling weights should be used. Thus, in the first paper, we examine different approaches and give recommendations concerning handling sampling weights in multilevel models when analyzing large-scale assessments.

Due to limitations in time and the number of students, the complex surveys use matrix sampling of items. This means that a response variable, i.e. students' performance, contains a large amount of information that is missing by design. Therefore, in order to estimate students' proficiency, TIMSS and PISA use the plausible values approach, which results in a set of five plausible values – proficiencies, computed for each student. In the second paper, different user strategies concerning plausible values for multilevel models as well as means and variances are examined with both real and simulated data. Missing information that is present because of the matrix sampling design for instance like the one used in PISA, can be arranged into a non-monotone missing data pattern, where all variables are incomplete and highly positively correlated. In the third paper, we compare a few imputation methods: a single imputation from a conditional distribution (with and without weights) and multiple imputation, for data with a non-monotone missing pattern (with no complete variables) and high positive correlation between variables.

In several of the recent international large-scale assessments, students in Sweden demonstrate a decreasing performance. Some previous research has shown that changes in performance depend on students’ performance levels. In the fourth paper, we studied the relationship between student performance and the between-school variance and tried to identify factors associated with student performance in mathematics in PISA in low-, medium-, and high- performing schools in the Nordic countries.

sted, utgiver, år, opplag, sider
Umeå: Umeå universitet, 2016. s. 18
Serie
Statistical studies, ISSN 1100-8989 ; 51
Emneord
multilevel model, plausible values, sampling weights, missing information, multiple imputation, non-monotone missing pattern, TIMSS, PISA
HSV kategori
Forskningsprogram
statistik; pedagogik
Identifikatorer
urn:nbn:se:umu:diva-128618 (URN)978-91-7601-612-1 (ISBN)
Disputas
2017-01-12, Hörsal E, Humanisthuset, Umeå Universitet, Umeå, 10:00 (engelsk)
Opponent
Veileder
Tilgjengelig fra: 2016-12-16 Laget: 2016-12-09 Sist oppdatert: 2018-06-09bibliografisk kontrollert

Open Access i DiVA

Fulltekst mangler i DiVA

Andre lenker

Forlagets fulltekst

Personposter BETA

Laukaityte, IngaWiberg, Marie

Søk i DiVA

Av forfatter/redaktør
Laukaityte, IngaWiberg, Marie
Av organisasjonen
I samme tidsskrift
Communications in Statistics - Theory and Methods

Søk utenfor DiVA

GoogleGoogle Scholar

doi
urn-nbn

Altmetric

doi
urn-nbn
Totalt: 640 treff
RefereraExporteraLink to record
Permanent link

Direct link
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Annet format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annet språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf