Umeå universitets logga

umu.sePublikationer
Ändra sökning
RefereraExporteraLänk till posten
Permanent länk

Direktlänk
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Annat format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annat språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf
The Swedish Evaluation Machinery in Higher Education: Expansion, operation and complexity
Umeå universitet, Samhällsvetenskapliga fakulteten, Pedagogiska institutionen.ORCID-id: 0000-0003-1998-1948
Umeå universitet, Samhällsvetenskapliga fakulteten, Pedagogiska institutionen.
Umeå universitet, Samhällsvetenskapliga fakulteten, Institutionen för tillämpad utbildningsvetenskap.
Umeå universitet, Samhällsvetenskapliga fakulteten, Institutionen för tillämpad utbildningsvetenskap.ORCID-id: 0000-0002-0209-558X
2019 (Engelska)Konferensbidrag, Enbart muntlig presentation (Övrigt vetenskapligt)
Abstract [en]

Contribution: Evaluation and quality assurance (EQA) policy and practice in higher education (HE) has expanded during the last decades. It picked up speed after the Bologna agreement, and today 27 countries are members of the European Association for Quality Assurance in Higher Education (ENQA). This organization promotes and disseminates EQA policy and practice through publications, workshops and meetings, etc. (ENQA n.d.). In Sweden, national EQA systems have been Implemented since the 1990s, and the most recent system has been particularly influenced by the European EQA policy.

In this presentation, our aim is to analyse the different national EQA systems in Sweden from 1995 until today. We are particularly interested in the relations between governing, evaluation and knowledge and our ambition is to pinpoint the particularity of evaluation in HE as a social practice that makes knowledge work for governing. We ask: What are the main characteristics of these systems? What is the European policy influence? How do the systems operate as modes of governing, by whom, and what types of knowledge do they require?

Drawing on Dahler-Larsen's metaphore "evaluation machine" (2012), we portray the Swedish systems as the development of an institutionalized evaluation machinery. We explore the evaluation machinery from a governing perspective by describing its automated technologies. We also highlight the work required to run the machinery, by highlighting its operators, who we have termed qualocrats (Lindgren, Rönnberg, Hult & Segerholm forthcoming). In understanding the quoalocrats and their EQA work, we draw on discussions on different forms of knowledge (Freeman & Sturdy 2014) and observe the “the burden of judgements” (Molander 2011) that are inevitably linked to these processes.

Theoretically, governing is conceptualised as a verb, as a way to emphasise the actual work that is done of and in evaluative practices. We see governing as activities composed of assemblages of places, people, policies, practices and power (Clarke 2015). In particular, we emphasize the "complexity, contestation and translation of governing practices” (Clarke 2015, p. 12-13). We also draw on the work of Freeman and Sturdy (2014), who conceptualise knowledge as embodied; for example, through tacit and verbal experience, inscribed in different forms of texts and artefacts, and enacted, via what is actually done or carried out. We identify and describe forms and movements of knowledge that are manifested, incorporated and transformed in governing by evaluation as a social practice encompassing several arenas and groups of actors.

Method: This paper synthetises several sub-studies from the research project Governing by Evaluation in Higher Education, financed by the Swedish Research Council (2012-2018). The analysis draws on a range of different materials. We used public reports, including for instance Government Bills as well as material from the Swedish Higher Education Authority (SHEA) and ENQA reports, for the analysis of the national systems characteristics and the European influence. We also carried out six case studies of HE institutions. These studies include interviews with employees at different levels of the HEIs who have different functions in relation to EQA. Local documents were also collected and analysed. These case studies contributed to our understanding of the European influence as well as the details in the evaluation processes, and on the types of knowledge that is activated and needed in the evaluation processes. Interviews with ten top-level administrative and organisational staff, called national policy brokers, were also included in our analysis of system design and European influence. Furthermore, we interviewed staff at the SHEA to get detailed information about the evaluation processes from the Agency's point of view. Altogether during the six sub-studies we performed approximately 100 interviews and analysed an enormous number of documents.

Expected Outcomes: Our analysis of the Swedish case displays a general expansion of EQA within and between the different national systems, making the “machinery” analogy particularly useful. Automated technologies such as visibility, comparability, standardisation and economic incentives have been embedded in the machinery over time, but we also show how embodiment is crucial for the construction and operation of the machinery. The analysis underscore how evaluation in HE includes extensive work when it comes to preparing, making, receiving and acting on judgements on the quality of intangible phenomena such as processes, responsibilities, routines, competences, relations, and support. A comprehensive evaluation machinery, like the contemporary Swedish one, requires many activities and operators and we draw attention to a particular group of “specialists”, the qualocrats, who are embodying particular forms of EQA knowledge that are crucial to carrying out the activities tied to the machinery. We argue that evaluation constitute a certain form of epistemic governing that presupposes, uses and produces certain forms of knowledge about a present condition that is extrapolated into a desired future. In this sense, there is a utopian dimension in which evaluation is used to generate, promote and mediate certain forms of knowledge to pledge (constant) change in ways that fits well with contemporary governing ambitions. High level of formalisation in Swedish EQA, in the forms of the detailed frameworks and guidelines that are intended to increase homogeneity and comparability, requires substantial human interpretation and translation in processes of enactment. Finally, our findings on the increased complexity in the construction and operation of the evaluation machinery is discussed by drawing on Tainter's (1988) ideas on organisational complexity. We discuss the expansion and increasing complexity of EQA work in higher education and point to some possible implications and problematisations.

Ort, förlag, år, upplaga, sidor
2019.
Nationell ämneskategori
Pedagogik
Identifikatorer
URN: urn:nbn:se:umu:diva-167221OAI: oai:DiVA.org:umu-167221DiVA, id: diva2:1385088
Konferens
European Conference for Educational Research (ECER), Hamburg, Germany, September 2-6, 2019
Anmärkning

Network:23. Policy Studies and Politics of Education

Tillgänglig från: 2020-01-13 Skapad: 2020-01-13 Senast uppdaterad: 2022-01-03Bibliografiskt granskad

Open Access i DiVA

Fulltext saknas i DiVA

Person

Segerholm, ChristinaHult, AgnetaLindgren, JoakimRönnberg, Linda

Sök vidare i DiVA

Av författaren/redaktören
Segerholm, ChristinaHult, AgnetaLindgren, JoakimRönnberg, Linda
Av organisationen
Pedagogiska institutionenInstitutionen för tillämpad utbildningsvetenskap
Pedagogik

Sök vidare utanför DiVA

GoogleGoogle Scholar

urn-nbn

Altmetricpoäng

urn-nbn
Totalt: 176 träffar
RefereraExporteraLänk till posten
Permanent länk

Direktlänk
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Annat format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annat språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf