Climate Impact of Software Testing Testit

My slides at Testit 2024 #testit2024 conference in Malmö 17.9.2024 about sustainability and climate impact of software testing. There's a lot we can do, of course the big thing is to create good software that has a carbon handprint i.e. a positive impact on our customers' and user' businesses. But we should also look into how good our software is in terms of climate impact; we can measure that quality attribute too, keep making choices that are wise from energy use point of view. And in testing itself, we can be greener, using test techniques that optimize the number of test cases needed, use test automation, small on-demand test environments, agile and DevOps.

1. Climate Impact of Software Testing
Kari Kakkonen
https://www.linkedin.com/in/karikakkonen/
Dragons Out Oy
Testit Malmö
17.9.2024
1© CopyrightDragons Out Trainings 2024

2. ROLES
•Dragons Out Oy, Director of Training, Trainer
and Coach
•Children’s and testing author at Dragons Out
Oy
•TMMi, Board of Directors
•Treasurer of Finnish Software Testing Board
(FiSTB)
ACHIEVEMENTS
•Tester of the Year in Finland 2021
•EuroSTAR Testing Excellence Award 2021
•Exemplary DevOps Instructor Award 2023 by
DASA
•ISTQB Executive Committee 2015-2021
•Influencing testing since 1996
•Ranked in 100 most influential IT persons in
Finland (Tivi magazine)
•Great number of presentations in Finnish and
international conferences
•TestausOSY/FAST founding member.
•Co-author of Agile Testing Foundations book
•Regular blogger in Tivi-magazine
•Growing Knowit to Testing Leader 2002-2024
Kari Kakkonen, Lead Testing Consultant
SERVICES
•ISTQB Advanced, Foundation, Agile Testing, AI Testing
•Quality Professional
•DASA DevOps
•Quality & Test process and organization development,
Metrics, TMMi and other assessments
•Agile testing, Scrum, Kanban, Lean
•Leadership
•Test automation, Mobile, Cloud, DevOps, AI
•Quality, cost, benefits
EDUCATION
•ISTQB Expert Level Test Management & Advanced Full
& Agile Tester certified
•DASA DevOps, Scrum Master and SAFe certified
•TMMi Professional, Assessor, Process Improver certified
•SPICE provisionary assessor certified
•M.Sc.(Eng), Helsinki University of Technology (present Aalto
University), Otaniemi, Espoo
•Marketing studies, University of Wisconsin-Madison,
the USA.
BUSINESS DOMAINS
Wide spread of business domain knowledge: Embedded,
industry, public, training, telecommunications, commerce,
Insurance, banking, pension.
2
twitter.com/kkakkonen
dragonsout.com
act2lead.net
MORE INFORMATION
linkedin.com/in/karikakkonen/
© CopyrightDragons Out Trainings 2024

3. The book project ”Dragons Out!”
•Mission
•“Software testing brought to children”
•Book
•Author Kari Kakkonen
•Illustrator Adrienn Széll
•Text and illustration rights Dragons Out Oy
•In Finnish, English, Polish, French and growing
•For ages of 10-99
•Free “Dragon lesson in software testing”
presentation under Creative Commons –license
•Translated to 20 languages!
•More info: www.dragonsout.com
•Also other books coming out
3© CopyrightDragons Out Trainings 2024

4. ACT 2 LEAD as a book
●Easy to read - chapters can be read in any order.
●Structure: questions, answers and cases.
○34 main chapters = questions, see next page.
●270+ pages, in Finnish and soon in English (softback, e-
book).
●For people like CxO, director, head of, manager, product
owner, designer, developer, test manager, tester and
student.
●Teaches to lead testing, not to test.
Buy the book: https://bit.ly/act2lead-book
Get notified: https://leanpub.com/act2lead
4

5. ISTQB

GLOBAL PRESENCE
•Numberof exams
administered:over1,2 million
•Numberof certifications
issued:845,000
•In 130 countries
© CopyrightDragons Out Trainings 2024 5

6. TMMi for test improvement in all kinds of testing,
including agile and DevOps
© CopyrightDragons Out Trainings 2024 6

7. Agenda
•Green ICT
•Green Testing
•Testingmeasurescarbon
footprint
•Minimize
carbon footprint
of test environments
•Minimize
carbon footprint
of testing
•Whatnext?
7© CopyrightDragons Out Trainings 2024

8. Green ICT
8© CopyrightDragons Out Trainings 2024

9. Climate change
•Climate change has been a
major topic in political debate in
recent years.
•The Paris climate conference
(COP21) in 2015 set a target of
limiting global warming to below
1.5°C compared to pre-industrial
levels.
9© CopyrightDragons Out Trainings 2024

10. United Nations Sustainable Development Goals
© CopyrightDragons Out Trainings 2024 10

11. Green ICT
“Green ICT isthe study and practice of using computing resources
efficiently and effectively with minimal or no impact on the
environment.”
Handbook of Research on Green ICT, B. Unhelkar
“To combat climate change, all viable avenues must be explored, and
the ICT industry must also play a role.”
Green Code, Janne Kalliola
11© CopyrightDragons Out Trainings 2024

12. Carbon footprint and handprint
“A carbon footprint is the total amount of greenhouse gases (including
carbon dioxide and methane) that are generated by our actions.”
Nature.org
“A carbon handprint is the opposite of a footprint. It recognises the
actions you take to have a positive impact on the climate, over and
above reducing your own carbon footprint if you do enough of these
they might even outweigh the size of your carbon footprint.”
https://go-positive.co.uk/climate-positive
12© CopyrightDragons Out Trainings 2024

13. Towards carbon handprint
13
Carbon
footprint
Minimize
carbon
footprint
Carbon
handprint
© CopyrightDragons Out Trainings 2024

14. IT has clear carbon handprint
•All too often we in IT are content that we can help other industries
reduce their carbon footprint
•Let’s move your servers to the cloud
•Let’s create a paperless process
•Let’s streamline how your business process works with this software
•That’s great, but…
•IT also has a carbon footprint – so let’s minimize it!
14© CopyrightDragons Out Trainings 2024

15. Green Testing
15© CopyrightDragons Out Trainings 2024

16. Green Testing can help
•Testing can’t change the world of ICT on its own
•But
•Testing can measure the climate impact of ICT
•Testing can choose to be as green as it can in its own practices
•Find the green aspect in the testing practices
16 © CopyrightDragons Out Trainings 2024

17. Sustainable Software Testing
•Optimising Resource Utilisation
•Test Automation
•Performance Testing and Optimisation
•Defect Prevention and Early Detection
•Test Environment Efficiency
•Green Testing Techniques
•Collaboration and Knowledge Sharing
17
https://www.experimentus.com/sustainable-software-testing
© CopyrightDragons Out Trainings 2024

18. Testingmeasures
carbonfootprint
18© CopyrightDragons Out Trainings 2024

19. ISO 25010 qualityattributes,
expandedbyClimateImpact
Climate impact
© CopyrightDragons Out Trainings 2024 19

20. Sustainability in quality criteria
•Rikard Edgren at the TestEye
http://thetesteye.com/posters/TheTestEye_SoftwareQualityCharacteristics.pdf
•Sogeti at TMap
https://www.tmap.net/wiki/quality-characteristic-sustainability
20© CopyrightDragons Out Trainings 2024

21. QualitycostsPAFF-model(Feigenbaum)
21
Qualitycostsareallthe coststhatwoulddisappearifeverythingwasdonerightthe firsttime.
Prevention costs
Coststhataimto preventthe creationof defects.
•Qualitysystems
•Methodologies
•Training
•Understanding customer expectations
•Codereviews
Appraisalcosts
Coststhataimto maintainthe company
qualitylevel.
•Test planningand execution
•Test management
•Test environmentsand tools
Failurecosts(internal)
Coststo fixdefectsthatarefoundbefore
deliveringthe software to customerand its
users.
•Debugging
•Defectfixes
•Retesting
Failurecosts(external)
Coststhatoccurwhendefectsarefoundin the
software thatthe customerhasalreadytaken
into productionusage.
.•Guaranteecosts
•Penalties
•Price reductions
•Product call-backsand disposals
•Image, PR
Investments
Costs
and
penalties
PAFF = Preventioncosts, Appraisalcosts, Failurecosts(internal), Failurecosts(external)

22. QualitycostsPAFF-model(Feigenbaum)
withclimateimpact
22
Qualitycostsareallthe coststhatwoulddisappearifeverythingwasdonerightthe firsttime.
Prevention costs
Coststhataimto preventthe creationof defects.
•Qualitysystems, incl. climateimpactof code
•Methodologies
•Training
•Understanding customer expectations
•Codereviews
Appraisalcosts
Coststhataimto maintainthe company
qualitylevel.
•Test planningand execution
•Test management
•Test environmentsand tools
•Measurementof climateimpactof code
Failurecosts(internal)
Coststo fixdefectsthatarefoundbefore
deliveringthe software to customerand its
users.
•Debugging
•Defectfixes
•Retesting
•Testingtimeand environments
Failurecosts(external)
Coststhatoccurwhendefectsarefoundin the
software thatthe customerhasalreadytaken
into productionusage.
.•Guaranteecosts
•Penalties, climatesanctions, CO2 compensation
•Price reductions
•Product call-backsand disposals
•Image, PR
Investments
Costs
and
penalties
PAFF = Preventioncosts, Appraisalcosts, Failurecosts(internal), Failurecosts(external)

23. When to apply the climate impact criterion
•In the Definition of Done
•In test planning and design
•In reviews
•In coding and testing
23© CopyrightDragons Out Trainings 2024

24. Minimize
carbonfootprint
of testenvironments
24© CopyrightDragons Out Trainings 2024

25. Later is more expensive
25
https://reqtest.com/general/a-bug-goes-skateboarding-on-boehms-curve/
More time
More test
environments
Larger
environments
Bigger
carbon
footprint
© CopyrightDragons Out Trainings 2024

26. Smaller test environments early
26
https://reqtest.com/general/a-bug-goes-skateboarding-on-boehms-curve/
Smaller
environment
early
Smaller carbon
footprint
© CopyrightDragons Out Trainings 2024

27. •Virtualization •Serverless/FaaS
On-demand test
environments in the cloud
Shared
machine
Less carbon
footprint
© CopyrightDragons Out Trainings 2024 27

28. •Virtualization •Serverless/FaaS
Automated test environmentsFaster
environment
setup
Smaller carbon
footprint
© CopyrightDragons Out Trainings 2024 28

29. Cheap, affordable test environments
give feedback to the team faster
Faster
feedback
Smaller carbon
footprint
© CopyrightDragons Out Trainings 2024 29

30. Minimize
carbonfootprint
of testing
30© CopyrightDragons Out Trainings 2024

31. Product Vision Requirements Test Design
Coding &
Testing
Test
Automation in
CI/CD pipeline
Monitoring in
production
Minimizing carbon footprint in the value stream
https://tieke.fi/en/projects/green-ict-project/ workshops 2022
Shift Left
© CopyrightDragons Out Trainings 2024 31

32. •Target for carbon handprint with the software
•Include sustainability of coding and testing in the product vision
•Require sustainability in requests for proposals of systems
development
•Include energy efficiency in the concept of quality
Climate impact in the product vision
Sustainable
big picture
Smaller carbon
footprint
https://tieke.fi/en/projects/green-ict-project/ workshops 2022
© CopyrightDragons Out Trainings 2024 32

33. •Define requirements well enough
•Require energy-efficient code, done with energy-efficient tools
•Consider static data design over dynamic polling
•Minimize the number of features in the product, is MVP enough?
•Review for
•Climate impact
•Testability
•Test automation
Reviewed requirements mean easier tests
Easier tests
Smaller carbon
footprint
https://tieke.fi/en/projects/green-ict-project/ workshops 2022
© CopyrightDragons Out Trainings 2024 33

34. •Remove duplicate coverage in the test suite
•Remove unnecessary tests
•Prioritize tests to find defects faster
•Do it for first-time tests and regression tests
•Use
•Test techniques
•Risk analysis
•AI models
Optimized test suite means less tests
Less tests
Smaller carbon
footprint
https://tieke.fi/en/projects/green-ict-project/ workshops 2022
© CopyrightDragons Out Trainings 2024 34

35. •Run easy, fast tests first
•Use earlier test results for smarter tests
•Test critical things first, run only needed tests
•Simulate first (APIs, models), only then use real environments
•Use on-demand test environments
Optimized test execution
Smarter tests
Smaller carbon
footprint
https://tieke.fi/en/projects/green-ict-project/ workshops 2022
© CopyrightDragons Out Trainings 2024 35

36. •Smaller environments
•Test automation is developed in smaller environments
•Test automation should run first in smaller environments, then in larger ones
•Test automation executes faster than manual tests, resulting in
resource efficiency
•Automate test data creation
Use test automation
36
Faster tests
Smaller carbon
footprint
https://tieke.fi/en/projects/green-ict-project/ workshops 2022
© CopyrightDragons Out Trainings 2024

37. •Continue testing in production
•Monitor performance, and tune it
•Observe user experience, and tune it
•Measure energy usage of use, compare to energy use of development
Monitor production
37
Production
monitoring
Smaller carbon
footprint
https://tieke.fi/en/projects/green-ict-project/ workshops 2022
© CopyrightDragons Out Trainings 2024

38. •Shift left means testing earlier, resulting in less rework in coding and
testing
•Early feedback saves time and resources
Use Agile and DevOps
38
Less rework
Smaller carbon
footprint
https://tieke.fi/en/projects/green-ict-project/ workshops 2022
© CopyrightDragons Out Trainings 2024

39. Whatnext?
39© CopyrightDragons Out Trainings 2024

40. What next
•Learn more about Green ICT and Green Testing
•Check how green your testing is – luckily sustainability often goes
hand in hand with good testing
•Testing early
•Agile
•DevOps
•Optimizing test
•Test automation
•Adjust your testing to be greener!
40© CopyrightDragons Out Trainings 2024

41. •https://www.exove.com/green-code/
•https://julkaisut.valtioneuvosto.fi/handle/10024/162912 (ICT Climate strategy)
•https://www.experimentus.com/sustainable-software-testing
•https://www.infoq.com/articles/fight-climate-change-software-engineer/
•https://principles.green/
•https://greensoftware.foundation/manifesto
•https://labs.sogeti.com/how-sustainability-testing-helps-reduce-the-carbon-footprint-of-
your-it-landscape/
•https://www.functionize.com/blog/how-green-is-your-testing-softwares-dirty-secret-
revealed
•https://www.austriantestingboard.at/aspects-of-sustainable-test-processes/
•https://link.springer.com/chapter/10.1007/978-3-319-08581-4_8
Additional reading
© CopyrightDragons Out Trainings 2024 41

42. Any questions?
Follow and share the Kari’s testing book projects:
•https://www.dragonsout.com
•https://www.act2lead.net/
•Get notified https://leanpub.com/act2lead
Social media
•Kari https://www.linkedin.com/in/karikakkonen/
•Dragons Out https://www.facebook.com/DragonsOutOy
Ask questions:
[email protected]
42© CopyrightDragons Out Trainings 2024