umu.sePublikasjoner
Endre søk
RefereraExporteraLink to record
Permanent link

Direct link
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Annet format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annet språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf
Governance by Glass-Box: Implementing Transparent Moral Bounds for AI Behaviour
Umeå universitet.ORCID-id: 0000-0002-8423-8029
Umeå universitet.ORCID-id: 0000-0001-9499-1535
Umeå universitet.
Umeå universitet.ORCID-id: 0000-0001-7409-5813
2019 (engelsk)Inngår i: Proceedings of the 28th International Joint Conference on Artificial Intelligence, 2019Konferansepaper, Publicerat paper (Annet vitenskapelig)
Abstract [en]

Artificial Intelligence (AI) applications are being used to predict and assess behaviour in multiple domains which directly affect human well-being. However, if AI is to improve people’s lives, then people must be able to trust it, by being able to understand what the system is doing and why. Although transparency is often seen as the requirementin this case, realistically it might not always be possible, whereas the need to ensure that the system operates within set moral bounds remains.

In this paper, we present an approach to evaluate the moral bounds of an AI system based on the monitoring of its inputs and outputs. We place a ‘Glass-Box’ around the system by mapping moral values into explicit verifiable norms that constrain inputs and outputs, in such a way that if these remain within the box we can guarantee that the system adheres to the value. The focus on inputs and outputs allows for the verification and comparison of vastly different intelligent systems; from deep neural networks to agent-based systems.

The explicit transformation of abstract moral values into concrete norms brings great benefits interms of explainability; stakeholders know exactly how the system is interpreting and employing relevant abstract moral human values and calibrate their trust accordingly. Moreover, by operating at a higher level we can check the compliance of the system with different interpretations of the same value.

sted, utgiver, år, opplag, sider
2019.
Emneord [en]
artificial intelligence, ethics, verification, safety, transparency
HSV kategori
Forskningsprogram
datalogi
Identifikatorer
URN: urn:nbn:se:umu:diva-159953OAI: oai:DiVA.org:umu-159953DiVA, id: diva2:1322782
Konferanse
28th International Joint Conference on Artificial Intelligence (IJCAI-19), Macao, China, August 10-16, 2019.
Forskningsfinansiär
Wallenberg AI, Autonomous Systems and Software Program (WASP)EU, Horizon 2020, 825619Tilgjengelig fra: 2019-06-11 Laget: 2019-06-11 Sist oppdatert: 2019-10-30bibliografisk kontrollert

Open Access i DiVA

Fulltekst mangler i DiVA

Andre lenker

ArXiv

Personposter BETA

Aler Tubella, AndreaTheodorou, AndreasDignum, FrankDignum, Virginia

Søk i DiVA

Av forfatter/redaktør
Aler Tubella, AndreaTheodorou, AndreasDignum, FrankDignum, Virginia
Av organisasjonen

Søk utenfor DiVA

GoogleGoogle Scholar

urn-nbn

Altmetric

urn-nbn
Totalt: 726 treff
RefereraExporteraLink to record
Permanent link

Direct link
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Annet format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annet språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf