Ändra sökning
RefereraExporteraLänk till posten
Permanent länk

Direktlänk
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Annat format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annat språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf
On the Definition of Appropriate Trust and the Tools that Come with it
Jönköping University, Internationella Handelshögskolan.ORCID-id: 0000-0001-9633-0423
2023 (Engelska)Ingår i: 2023 Congress in Computer Science, Computer Engineering, & Applied Computing (CSCE), Institute of Electrical and Electronics Engineers (IEEE), 2023, s. 1555-1562Konferensbidrag, Publicerat paper (Övrigt vetenskapligt)
Abstract [en]

Evaluating the efficiency of human-AI interactions is challenging, including subjective and objective quality aspects. With the focus on the human experience of the explanations, evaluations of explanation methods have become mostly subjective, making comparative evaluations almost impossible and highly linked to the individual user. However, it is commonly agreed that one aspect of explanation quality is how effectively the user can detect if the predictions are trustworthy and correct, i.e., if the explanations can increase the user's appropriate trust in the model. This paper starts with the definitions of appropriate trust from the literature. It compares the definitions with model performance evaluation, showing the strong similarities between appropriate trust and model performance evaluation. The paper's main contribution is a novel approach to evaluating appropriate trust by taking advantage of the likenesses between definitions. The paper offers several straightforward evaluation methods for different aspects of user performance, including suggesting a method for measuring uncertainty and appropriate trust in regression.

Ort, förlag, år, upplaga, sidor
Institute of Electrical and Electronics Engineers (IEEE), 2023. s. 1555-1562
Nyckelord [en]
Appropriate Trust, Calibrated Trust, Comparative Evaluations, Evaluation of Explanations, Explanation Methods, Metrics, XAI
Nationell ämneskategori
Människa-datorinteraktion (interaktionsdesign)
Identifikatorer
URN: urn:nbn:se:hj:diva-64149DOI: 10.1109/CSCE60160.2023.00256Scopus ID: 2-s2.0-85191166512ISBN: 979-8-3503-2759-5 (digital)OAI: oai:DiVA.org:hj-64149DiVA, id: diva2:1856553
Konferens
2023 Congress in Computer Science, Computer Engineering, and Applied Computing, CSCE 2023 Las Vegas 24 July 2023 through 27 July 2023
Forskningsfinansiär
KK-stiftelsen, 20160035Tillgänglig från: 2024-05-07 Skapad: 2024-05-07 Senast uppdaterad: 2024-05-07Bibliografiskt granskad

Open Access i DiVA

Fulltext saknas i DiVA

Övriga länkar

Förlagets fulltextScopusPreprint

Person

Löfström, Helena

Sök vidare i DiVA

Av författaren/redaktören
Löfström, Helena
Av organisationen
Internationella Handelshögskolan
Människa-datorinteraktion (interaktionsdesign)

Sök vidare utanför DiVA

GoogleGoogle Scholar

doi
isbn
urn-nbn

Altmetricpoäng

doi
isbn
urn-nbn
Totalt: 24 träffar
RefereraExporteraLänk till posten
Permanent länk

Direktlänk
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Annat format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annat språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf