umu.sePublications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Reliabilitets-, validitets- och diskriminationsmått för kriterierelaterade prov
Umeå University, Faculty of Social Sciences, Department of Education.
1973 (Swedish)Report (Other academic)Alternative title
Reliability, validity and discrimination measures for criterion-referenced tests (English)
Abstract [sv]

Denna undersökning har teoretiskt och empiriskt behandlat reliabilitets-, validitets- och diskriminationsrnått i anslutning till kriterierelaterade prov. Syftet med den empiriska studien var att undersöka relationer mellan olika diskriminationsrnått och vilka reliabilitets- och validi-tetseffekter som urval av uppgifter med dessa mått medförde. De olika diskriminationsmåtten var överlag måttligt interkorrelerade. Särskilt intressant att observera var de måttliga interkorrelationerna mellan de tre diskriminationsmåtten definierade som differensen i lösningaproportion mellan a) de 27 % bästa och de 27 % sämsta individerna utifrån eftertestningens resultat, b) resultaten på för-, och eftermätning och c) resultaten från en expertgrupp och en icke-expertgrupp. Reliabiliteten definierad som överensstämmelsen mellan resultaten vid två mättillfällen påverkades positivt oavsett vilket av de tre diskriminationsmåtten a), b) eller c) som användes för urval av uppgifter. Beträffande de beslutsorienterade reliabilitets-måtten var emellertid effekterna något olika för olika uppgiftsurval. Resultaten visade också att en ökning av reliabiliteten inte nödvändigtvis be-höver innebära en ökning av validiteten definierad som skillnaden mellan resultaten på en för- och eftermätning. Avslutningsvis behandlas begränsningar i undersökningen och förslag till-fortsatta prövningar ges.

Abstract [en]

This study has, theoretically and empirically, dealt with reliability, validity and discrimination measures in connection with criterion-referenced tests. The purpose of the empirical study was to investigate relations between different discrimination' measures and what effects on reliability and validity that selection of items gave with the help of these measures. The different discrimination measures were on the whole moderately intercorre-lated. It was especially interesting to observe the moderate intercorrelations between the three discrimination measures defined as the differences in item difficulty between a) the upper and lower 27 per cent of the subjects according to the results of the posttest, b) the results of the pre- and posttests and c) the results from an expert group as well as a non-expert one. The reliability defined as the agreement between the results of two posttests was positively influenced no matter which one of the three discrimination measures a), b) or c)that was used for the selection of the items. As for the decision-oriented reliability measures the effects were, however, somewhat different for the 'different selections of items. Moreover, the results showed that an increase in reliability does not necessarily imply an increase in validity defined "as the difference between the results of pre- and posttests. Finally restrictions of the study are dealt with and suggestions for further investigations are made.

Place, publisher, year, edition, pages
Umeå: Umeå universitet och Lärarhögskolan , 1973. , 49 p.
Series
Pedagogiska rapporter Umeå, ISSN 0348-9388 ; 34
National Category
Pedagogy
Identifiers
URN: urn:nbn:se:umu:diva-68313OAI: oai:DiVA.org:umu-68313DiVA: diva2:616359
Projects
digitalisering@umu
Available from: 2013-04-16 Created: 2013-04-16 Last updated: 2013-04-18Bibliographically approved
In thesis
1. Mätproblem i norm- och kriterierelaterade prov: några analyser och försök med tonvikt på reliabilitets- och diskriminationsmått
Open this publication in new window or tab >>Mätproblem i norm- och kriterierelaterade prov: några analyser och försök med tonvikt på reliabilitets- och diskriminationsmått
1973 (Swedish)Doctoral thesis, comprehensive summary (Other academic)
Alternative title[en]
Problems of measurement in norm- and criterionreferenced tests : some analyses and investigations with emphasis on reliability and discrimination measures
Abstract [en]

The present report is a summary discussion of a number of studies in connection with the following problemas a) analysis and empirical investigations of some test theoretical formulae and principles, b) differential scoring of multiple-choice questions and c) criterion-referenced tests: theoretical and empirical implications. In studies associated with the first problem is shown how some test theoretical formulae and principles can be derived from the information in the inter-item-covariancs matrix as well as how this information can be used to explain empirically found relations. In the latter respect the standard error of measurement and various biserial correlation techniques are dealt with. Studies carriëd out within the second field of problems account for reliability and validity effects with differential scoring of multiple-choice questions. A priori as well as empirical weight systems have been used. Systematically ordered alternatives gave higher reliability with differential scoring compared to conventional scoring. At the same time, however, the dimensionality of the test changed with negative validity effects as a consequence. The trends of the results were the same for the two types of weight systems. In connection with the third field of problems the development of criterion-referenced tests, their qualities and restrictions are discussed. Three aspects are quite closely penetrated, viz. the defining of objectives, the homogeneity and the different cutting-scores of the tests. Furthermore theoretical as well as empirical problems of measurement techniques when evaluating data from criterion-referenced measurement are dealt with. In the empirical study especially low and moderate correlations between norm- and criterion-referenced discrimination indices were received, as well as between different criterion-referenced discrimination indices. Moreover, the results indicated that increased vali- . dity defined in terms of the difference between pre- and post-tests does not necessarily imply increased reliability when placing subjects above and below a fixed cutting-score.

Place, publisher, year, edition, pages
Umeå: Umeå universitet, 1973. 26 p.
Series
Akademiska avhandlingar vid Pedagogiska institutionen, Umeå universitet, ISSN 0281-6768 ; 4
Series
Pedagogiska rapporter Umeå, 35
National Category
Pedagogy
Identifiers
urn:nbn:se:umu:diva-16620 (URN)
Projects
digitalisering@umu
Available from: 2007-10-07 Created: 2007-10-07 Last updated: 2013-04-18Bibliographically approved

Open Access in DiVA

Reliabilitets-, validitets- och diskriminationsmått för kriterierelaterade prov(4872 kB)124 downloads
File information
File name FULLTEXT01.pdfFile size 4872 kBChecksum SHA-512
020e512e6781cdf9f2d690385aed3c07a0ca02a0360cce6ef144f7b6e427e11376cd819b30d99b0259f37aad3b38beae451a3c6e9a35b1f32f5fb543ba81fd60
Type fulltextMimetype application/pdf

Search in DiVA

By author/editor
Wedman, Ingemar
By organisation
Department of Education
Pedagogy

Search outside of DiVA

GoogleGoogle Scholar
Total: 124 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

urn-nbn

Altmetric score

urn-nbn
Total: 110 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf