Epistemic Interaction - tuning interfaces to provide information for AI support

Paper presented at SYNERGY workshop at AVI 2024, Genoa, Italy. 3rd June 2024

https://alandix.com/academic/papers/synergy2024-epistemic/

As machine learning integrates deeper into human-computer interactions, the concept of epistemic interaction emerges, aiming to refine these interactions to enhance system adaptability. This approach encourages minor, intentional adjustments in user behaviour to enrich the data available for system learning. This paper introduces epistemic interaction within the context of human-system communication, illustrating how deliberate interaction design can improve system understanding and adaptation. Through concrete examples, we demonstrate the potential of epistemic interaction to significantly advance human-computer interaction by leveraging intuitive human communication strategies to inform system design and functionality, offering a novel pathway for enriching user-system engagements.

1. Alan Dix, Ben Wilson, Matt Roach, Tommaso Turchi and Alessio Malizia https:// alandix.com /academic/papers/synergy2024-epistemic/ Epistemic Interaction tuning interfaces to provide information for AI support

2. temperature setting buttons 20° 17° current temperature target temperature “currently heating” icon

3. “I want it cooler” button “I want it warmer” button

4. 20° 17° more information for adaptation

5. AI and User Interaction HCI for AI Rich Systems Intelligent Interfaces Ethics Social Justice Governance H uman like C omputing Interfaces for AI developers Big Data and Evaluation

6. HCI for AI Rich Systems Intelligent Interfaces Ethics Social Justice Governance H uman like C omputing Interfaces for AI developers Big Data and Evaluation AI helping UI UI helping AI front-end user-facing back-end developer-facing

7. HCI for AI Rich Systems Intelligent Interfaces Ethics Social Justice Governance H uman like C omputing Interfaces for AI developers Big Data and Evaluation Intelligent Interfaces HCI for AI Rich Systems

8. good AI+HCI not about developing the most accurate AI but creating the most effective and enjoyable overall human-technical system

9. synergy cooperation and adaptation adapting AI for human interaction adapting user interfaces for AI AI

10. adapting AI for interaction full automation – best/safe human in the loop – suggest and inform

11. synergy cooperation and adaptation adapting AI for human interaction adapting user interfaces for AI AI

12. adapting interaction for AI ‘best’ UI – short term gain epistemic interaction – long term gains

13. human–{X} interactions human–object ecological psychology affordance epistemic action

14. epistemic action wondering what’s inside? just peek

15. human–{X} interactions human–object ecological psychology affordance epistemic action DESIGN Norman’s use of ‘affordance’

16. human–{X} interactions human–object ecological psychology, affordance, epistemic action human–human common ground, collaborative principle, feedthrough, onomatopoeic action, accountability human–system passive sensing, SSD framework, implicit and incidental interaction

17. human–{X} interactions human–object human–human human–system DESIGN human–AI

18. epistemic interaction redesign user interactions to make more information available for machine adaptation

19. document results – option 1 – scroll scroll down to see more results

20. document results – option 2 – accordion press ‘+’ to expand interesting items

21. which option? – epistemic interaction … scroll accordion A-B user testing scroll a little better accordion gives more data for AI adaptation

22. Epistemic Interaction tuning interfaces to provide information for AI support https:// alandix.com /academic/papers/synergy2024-epistemic/