Measuring Navigation Efficiency in the IDE

My slides for IWESEP 2016 (7th IEEE International Workshop on Empirical Software Engineering in Practice)

1. Measuring Navigation

Efficiency in the IDE
Roberto Minelli, Andrea Mocci, Michele Lanza
REVEAL @ Faculty of Informatics

University of Lugano, Switzerland
@robertominelli

2. What is Interaction Data?
developer IDE

3. What is Interaction Data?
developer IDE
navigate

4. What is Interaction Data?
developer IDE
navigate
edit

5. What is Interaction Data?
developer IDE
navigate
editinspect

6. What is Interaction Data?
developer IDE
navigate
user inputeditinspect

7. What is Interaction Data?
developer IDE
navigate user interface
user inputeditinspect

8. What is Interaction Data?
developer IDE
navigate user interface
user inputeditinspect
interaction
data

9. DFlow: Interaction Profiler
developer IDE
navigate user interface
user inputeditinspect
interaction
data
DFlow
I know what you did last summer: 

An investigation of how developers spend their time
R. Minelli, A. Mocci, M. Lanza
ICPC 2015, pp. 25–35

10. DFlow: Conceptual Model

11. DFlow: Conceptual Model
Event
Timestamp
Window ID

12. DFlow: Conceptual Model
Entities
Meta Event
Navigation EventInspect Event Edit Event
Event
Timestamp
Window ID

13. DFlow: Conceptual Model
Position
User Input Event
Attributes
Mouse Event
Key Combination
Keystroke Event
Mouse Moved Mouse Button Mouse Wheel
DirectionButton ID
Start Point
End PointEntities
Meta Event
Navigation EventInspect Event Edit Event
Event
Timestamp
Window ID

14. DFlow: Conceptual ModelPosition
User Input Event
Attributes
Mouse Event
Key Combination
Keystroke Event
Mouse Moved Mouse Button Mouse Wheel
DirectionButton ID
Start Point
End Point
User Interface Event
Attributes
Window Event
Window CollapsedWindow ExpandedWindow Moved Window Resized
Window Activated Window Closed Window LabelledWindow Opened
Old Label
New Label
Initial Position
Initial Extent
Old Position
New Position
Old Size
New SizeEntities
Meta Event
Navigation EventInspect Event Edit Event
Event
Timestamp
Window ID

15. Our Dataset
765sessions
6developers
211ktotal events
>500 htotal time
40 minavg. session duration
214 (29)navigation events (entities)
11 (5)edit events (entities)
51 (7)inspect events (entities)

16. Navigation Efficiency

17. ideal navigation effort
real navigation effort
Navigation Efficiency

18. ideal navigation effort
real navigation effort
Navigation Efficiency
Number of
Navigation Events

19. ideal navigation effort
real navigation effort
Navigation Efficiency
Number of
Navigation Events
?

20. Ideal Navigation Effort
The sum of the navigation costs

needed to reach the edited entities

21. Ideal Navigation Effort
The sum of the navigation costs

needed to reach the edited entities

22. Navigating Source Code

23. Navigating Source Code
package

24. Navigating Source Code
package class

25. Navigating Source Code
package class protocol

26. Navigating Source Code
package class methodprotocol
source
code

27. Navigating Source Code
package class methodprotocol
cost = 1 cost = 2 cost = 3 cost = 4

28. Navigating Source Code (alternative)

29. Navigating Source Code (alternative)
cost = 1

30. Ideal Navigation Effort
The sum of the navigation costs

needed to reach the edited entities

31. Ideal Navigation Effort
The sum of the navigation costs

needed to reach the edited entities

32. Interaction History
t

33. Edited Entities
viewed entity
Program Entities
t

34. Edited Entities
t
viewed entity
edited entity
Program Entities

35. Edited Entities
tA BA.m1 A.m1A.m1 BC B.m2 B.m3

36. Edited Entities
tA BA.m1 A.m1A.m1 BC B.m2 B.m3
Working Sequence

37. Edited Entities
A B
A.m1A.m1 A.m1 B
C
B.m2B.m3
Working Set

38. ideal navigation effort
real navigation effort
Navigation Efficiency

39. Navigation Efficiency
Navigation Efficiency

40. Navigation Efficiency
Working Sequence
Unitary cost
Max cost
9.6%
38.7%
Navigation Efficiency
Navigation Efficiency

41. Navigation Efficiency
Working Sequence
Unitary cost
Max cost
9.6%
38.7% 1.6x
9x
Navigation Efficiency
Navigation Efficiency

42. Navigation Efficiency
Working Set
Unitary cost
Max cost
5.1%
20.6%Working Sequence Unitary cost Max cost 9.6% 38.7% 1.6x 9x
Navigation Efficiency
Navigation Efficiency

43. Navigation Efficiency
Working Set
Unitary cost
Max cost
5.1%
20.6%Working Sequence Unitary cost Max cost 9.6% 38.7%
19x1.6x 9x
4x
Navigation Efficiency
Navigation Efficiency

45. Developers navigate 

code with a raft...

46. ...what about this 

for the future?

47. @robertominelli