Noise Canceling RUM by Tim Vereecke, Akamai

Noisy Real User Monitoring (RUM) data can ruin your P99!

We introduce a fresh concept called ""Human Visible Navigations"" (HVN) to tackle this risk; we focus on the experiences you actually care about when talking about the speed of our sites:

- Human: We exclude noise coming from bots and synthetic measurements.
- Visible: We remove any partial or fully hidden experiences. These tend to be very slow but users don’t see this slowness.
- Navigations: We ignore lightning fast back-forward navigations which usually have few optimisation opportunities.

Adopting Human Visible Navigations provides you with these key benefits:
- Fewer changes staying below the radar
- Fewer data fluctuations
- Fewer blindspots when finding bottlenecks
- Better correlation with business metrics

This is supported by plenty of real world examples coming from the world's largest scale modeling site (6M Monthly visits) in combination with aggregated data from the brand new rumarchive.com (open source)

After attending this session; your P99 and other percentiles will become less noisy and easier to tune!

1. Noise Canceling RUM Tim Vereecke Web Performance Architect at Akamai

2. Real User Monitoring

3. P99

4. Very NOISY

5. Noise Canceling RUM

6. time speed Deploy

7. time speed Deploy ☺

8. time speed ☹ Deploy

9. time speed ☹ ☹ Deploy

10. time speed Gap Deploy

11. Noise

12. 15 % noise 1% noise 6% noise

13. 78% HVN 15 % noise 1% noise 6% noise

14. Navigations

15. Navigation Types

16. Page Group Back-Forward Noise Homepage 8.1% Search 22.9% PDP (Kits) 9.3% PDP (Aftermarket) 5.9%

17. Page Group Back-Forward Noise Homepage 8.1% Search 22.9% PDP (Kits) 9.3% PDP (Aftermarket) 5.9% Blindspot

18. Page Group Back-Forward Noise Homepage 8.1% Search 22.9% PDP (Kits) 9.3% PDP (Aftermarket) 5.9% Hours wasted tuning Database queries

19. My site is different!

20. https://rumarchive.com/

21. Navigation Types

22. TTFB per Navigation Type

23. Visible

24. Visibility States

25. Page Group (Partially) Hidden Noise Homepage 10.8% Search 1.5% PDP (Kits) 6.2% PDP (Aftermarket) 10.1%

26. Page Group (Partially) Hidden Noise Homepage 10.8% Search 1.5% PDP (Kits) 6.2% PDP (Aftermarket) 10.1% Blindspot

27. Page Group (Partially) Hidden Noise Homepage 10.8% Search 1.5% PDP (Kits) 6.2% PDP (Aftermarket) 10.1% Hours wasted tuning Database queries

28. Visibility States (MPA) Visibility States (MPA)

29. Human

30. CLS Spikes due to Bot(s)

31. Navigation type: Back-Forward, Reload Visibility-State Always & Partially Hidden Bot Type Any non-human 15 % noise 1% noise 6% noise 78% HVN

32. Navigation type: Back-Forward, Reload Visibility-State Always & Partially Hidden Bot Type Any non-human 15 % signal 1% signal 6% signal 78% noise

33. Focus on Human Visible Navigations

34. Tim Vereecke [email protected] @timvereecke Thank you! Let’s connect.