Test Automation for Dynamic Applications _ Applitools in Action.pdf

Discover how Applitools' AI-powered solutions tackle the challenges of dynamic applications and content in test automation. Session resources and more info at https://applitools.info/vl4

• Establish a consistent testing pipeline for applications with frequently changing data.
• Minimize testing maintenance efforts while expanding coverage and precision.
• Implement baselines that identify only significant UI changes, increasing test dependability.

1. Test Automation
for Dynamic Applications

September 5th, 2024
Talia Melamed

2. Testing as an Alerting System
Reliability is Key
●The Cost of Unreliable Tests
●Lost Trust
●Wasted Resources


Reliable test suite→ Predictable and consistent behavior

3. Test Automation












% Predictability
reduces as we
climb up the
Pyramid

4. Common (Un)predictability Factors in UI Testing

#1 Dynamic Dom Elements
Manual, broken or dynamically generated locators


#2 Tests Environment
Browser, Device and Screen Size Variability

#3 Dynamic Content
Modern applications are dynamic by nature

5. Solution #1 - The Execution Cloud
First AI Selenium Grid

Self-healing locators

Reliably identify
broken UI elements at
run-time

6. Solution #2 - The Ultrafast Grid
Challenge - Inconsistent Rendering
●Browser Compatibility
●Device /Screen Size Variability

The Ultrafast Grid -
●Cross Browser Execution
●Cross Device Testing
●Uses DOM, HTML, CSS file, etc.
●Rendering in Parallel

Result-
●Increased stability
●Improved efficiency
●Reduced execution time
●Faster feedback

7. → designing the baseline image to represent the predicted behavior
Solution #3 - Modern Apps - Dynamic by Nature

8. Solution #3 - The Layout Matching Algorithm
Use cases-
1)Fixed structure + Dynamic data
Date field, dynamic ID number
2)Localisation - cross languages testing

Implementation -
●Full page validation
●Layout regions
○Coded Layout region
○Via dashboard - Element Selector -
Autonomous
●Auto-maintenance capability

9. Localization Testing
Support multiple languages
Best Practices:
1)Maintaining a baseline for structurally related languages
2)Maintaining a baseline image per language - recommended

10. Same Content / Dynamic Location - Floating Region

Same Content / Dynamic Color - Ignore Color Region

11. Baselines - Easy to Create and Maintain
Use-case:
The application changes per user type: Admin / Student / Manager

Solution:
Creating a baseline per user type
Automatically maintaining the results - Auto-maintenance capability

12. Dynamic Structure / Fixed # Combinations
Solution:
Multi-baseline variations

Example:
Banners
Widgets
“Search” results # items
User Input Variations

13. Testing Dynamic Applications - Infinite Options
Implementation:

●Split the test
●Granular screenshots: Header, Footer, Body

14. Summary
Goals: Testing predictability is key to stability
Challenge:
●Code-base
●Environment
●Dynamic behaviour
Tools:
●Infrastructure - Execution Cloud, Ultrafast Grid
●Intelligent Test Case Generation - Algorithms
●Robust Testing Design
Steps:
●Categorise the use-case pattern
Fixed structure & Dynamic content (combinations)
●Aligning the solution

15. Documentation & Resources
How to use Applitools match levels
Baseline management
Layout region, Floating region
Why Use Match Level Regions?
Multi-baseline Variations
Coded Layout region
Applitools Self-healing Execution Cloud
Ultrafast Grid: Streamlining Cross Browser Testing