The importance of Quality Assurance for ICT Standardization

Presentation at the QRS/STV workshop 2024, Cambridge (UK).

1. The importance of Quality Assurance
for ICT Standardization
Axel Rennoch & Martin Schneider
Fraunhofer FOKUS Institute for Open Communication Systems
QRS/STV’24, Cambridge (UK), July4
th
, 2024
© Betty Images

2. QRS/STV Cambridge (UK), July4th, 2024 © Fraunhofer FOKUS Page2
Annual research budget of roughly 3.4 billion euros,
3.0 billion euros of which is designated as contract research
▪AroundtwothirdsoftheFraunhofer-Gesellschaft’scontract
researchrevenueisderivedfromcontractswithindustryand
frompubliclyfinancedresearchprojects
▪AroundonethirdiscontributedbytheGerman federaland
stategovernmentsin form ofbasefunding
The Fraunhofer-Gesellschaft
32.000
Employees
76
Institutes andresearchunits

3. © Fraunhofer FOKUS Page3
Fields of application and strategic topics of FOKUS
QRS/STV Cambridge (UK), July4th, 2024
Fields OfApplication
Artificial Intelligence Quantum Computing Sustainability
″Digitale Vernetzung″ Digital Life Digital Governance Security/Certification
Strategic Topics

4. Agenda
1.Quality Assurance
▪What is Quality?
▪Activities
2.ICT Standardization
▪Domains
▪Gaps
3.Selected Samples
▪DOSS project
4.Summary & Conclusions
QRS/STV Cambridge (UK), July 4th, 2024 © Fraunhofer FOKUS Page4

5. —
Quality Assurance
Page5 QRS/STV Cambridge (UK), July 4th, 2024 © Fraunhofer FOKUS

6. What is Quality?
We all have a feeling about quality
Quality is difficult to define
Many views on quality
QRS/STV Cambridge (UK), July 4th, 2024 © Fraunhofer FOKUS Page6

7. Total Quality Management (1985)
•W. Edwards Deming (creates TQM):
Quality is defined in terms of customers satisfaction
•Total Quality Management (TQM) can be defined as
directing the whole production process
to produce an excellent (quality) product or service(1985)
Customers satisfaction
QRS/STV Cambridge (UK), July 4th, 2024 © Fraunhofer FOKUS Page7

8. Quality accordingtoISO
QRS/STV Cambridge (UK), July4th, 2024 © Fraunhofer FOKUS Page8
ISO 9126 (1991)
•The degree to which a software productsatisfies stated and implied
needswhen used under specified conditions
Fit for purpose
ISO 25010 (2011)
•The set of attributes of a software productthat bear on its ability to
satisfy stated or implied needs
Conformanceto specification
ISO QualityModel basedon McCalland Boehm

9. Quality Assurance activities
1.Framework/modelfor the evaluation of software product quality
•ISO/IEC 25000, also known as
SQuaRE(System and Software Quality Requirements and Evaluation)
2.Well-defined Requirement catalogues
3.Harmonized Conformance Test procedures
4.Detailed Test specifications & implementation
5.Maturity model and guidancefor a maturity assessment, e.g.
•ISO/IEC CD 30186 Digital twin
6.Best practicesfor use case projects, e.g.
•ISO/IEC TR 30194 Internet of Things (IoT) and Digital Twin
QRS/STV Cambridge (UK), July4th, 2024 © Fraunhofer FOKUS Page9

10. —
ICT Standardization
Page10 QRS/STV Cambridge (UK), July 4th, 2024 © Fraunhofer FOKUS

11. ICT
Sensors and
actuators,
(Internet of
Things)
Information and
communication
networks
(WiFi, 5G, Tetra,
Starlink, …)
Data and
computing
centers
(Microsoft,
AWS, Meta, …)
End devices
(computer,
laptops,
handhelds)
Smart devices
(smart phones,
smart cars, smart
buildings, …)
Page11 QRS/STV Cambridge (UK), July 4th, 2024 © Fraunhofer FOKUS

12. ICT energy consumption
Belkhir, Lotfi, and Ahmed Elmeligi. "Assessing ICT global
emissions footprint: Trends to 2040 & recommendations."Journal
of cleaner production177 (2018): 448-463.
Page12 QRS/STV Cambridge (UK), July 4th, 2024 © Fraunhofer FOKUS

13. Standardisation Bodies
Standards Developing Organisations(SDOs)
•National, e.g. DIN, BSI, AFNOR
•European, e.g. ETSI, CEN/CENELEC
•International, e.g. ISO/IEC, ITU
Industrial interest groups/associations
•e.g. OMG, oneM2M, IEEE, W3C, IETF, 3GPP
QRS/STV Cambridge (UK), July4th, 2024 © Fraunhofer FOKUS Page13

14. Standardisation Gaps: IoT and Edge Computing
StandICT/EUOS
Standardisation Gap analysis
AIOTI
Landscape reports
QRS/STV Cambridge (UK), July4th, 2024 © Fraunhofer FOKUS Page14

15. #chall Description IEC ETSI 3GPP ISO/IECCEN/CENELECIEEE ITU W3C IETFOneM2M #SDO #Specs
2.1.1Challenges reported in DataPorts: A Data Platform for the Cognitive Ports of the Future 41 2 31 37 1 5 24 7 141
2.1.2Challenges reported in DEMETER: IoT-based data analysis to improve farming 31 1 4 1 4 37
2.1.3Challenges reported in IoTAC: Security By Design IoT Development and Certificate Framework with Front-end Access Control 10 5 8 3 1 27 6 54
2.1.4Challenges reported in IoT-NGIN: Next Generation IoT as part of Next Generation Internet 3 1 3 1 25 6 6 39
2.1.5Challenges reported in SHAPES: Smart and Healthy Ageing through People Engaging in Supportive Systems 1 2 2 3
2.1.6Challenges reported in ASSIST-IoT: Architecture for Scalable, Self-*, human-centric, Intelligent, Secure, and Tactile next generation IoT9 5 3 1 1 2 4 21 1 9 47
2.1.7Challenges reported in IM-TWIN: from Intrinsic Motivations to Transitional Wearable INtelligent companions for autism spectrum disorder 3 1 2 4
2.1.8Challenges reported in GATEKEEPER: Smart Living Homes – Whole Interventions Demonstrator For People At Health And Social Risks 1 10 2 3 13
2.1.9Challenges reported in CHARM: Challenging environments tolerant Smart systems for IoT and AI 22 1 1 1 4 25
2.1.10Challenges reported in ATLAS: Agricultural Interoperability and Analysis System 1 1 2 2
2.1.11Challenges reported in TERMINET: nexT gEneRation sMart INterconnectEd ioT 5 3 6 1 4 15
2.1.12Challenges reported in Hexa-X: A flagship for B5G/6G vision and intelligent fabric of technology enablers connecting human, 3 4 2 4 5 5 18
2.1.13Challenges reported in InterConnect: Interoperable Solutions Connecting Smart Homes, Buildings and Grids 3 1 3 4 9 5 20
2.1.14Challenges reported in IntellIoT: Intelligent, distributed, human-centered and trustworthy IoT environments 1 2 1 4 1 5 9
2.2.1Green machine learning for the IoT 0 0
2.2.2Software Containers at the Edge 3 1 3
2.2.3Semantic interoperability of IoT data spaces 41 2 8 20 1 1 2 15 8 9 98
2.2.4Digital Twins – overall 1 2 2 3
2.2.5Heterogeneous vocabularies and ontologies in Digital Twins 4 1 4
2.2.6Quality of metadata in Digital Twins 2 1 2
2.2.7IoT Swarms 0 0
2.2.8Digital for Green 1 2 5 8 26 5 42
2.3.1IoT and Edge Computing Granularity 1 2 2 3
2.3.2IoT Edge and X-Continuum Paradigm 0 0
2.3.3Intelligent Connectivity 11 87 2 98
2.3.4Energy-Efficient Intelligent IoT and Edge Computing Systems 1 1 2 2
2.3.5Heterogeneous Cognitive Edge IoT Mesh 0 0
2.3.6IoT Digital Twins, Modelling and Simulation Environments 1 1 2 2
2.3.7Internet of Things Senses 0 0
2.3.8Decentralised and Distributed edge IoT Systems 20 3 7 99 4 129
2.3.9Federated Learning, Artificial Intelligence technologies and learning for edge IoT Systems 2 1 2
2.3.10Operating Systems and Orchestration Concepts for edge IoT Systems 0 0
2.3.11Dynamic Programming Tools and Environments for Decentralised and Distributed IoT Systems 1 2 2 3
2.3.12Heterogeneous Edge IoT Systems Integration 1 7 2 3
2.3.13Edge IoT sectorial and Cross-Sectorial Open Platforms 3 1 3
2.3.14 IoT Verification, Validation and Testing (VV&T) Methods 17 11 2 16 25 2 6 73
2.3.15IoT Trustworthiness and Edge Computing Systems Dependability 13 11 3 26 8 5 61 IoT challenges covered/worked out by SDOs
QRS/STV Cambridge (UK), July4th, 2024 © Fraunhofer FOKUS Page15

16. —
Selected samples
Page16 QRS/STV Cambridge (UK), July 4th, 2024 © Fraunhofer FOKUS

17. EU Project DOSS
Design and Operation
of
Secure IoT Supply
Chain
QRS/STV Cambridge (UK), July4th, 2024 © Fraunhofer FOKUS Page17

18. DOSS Goals
DOSS elaboratesa secure-by-design methodology
implementsrelated technology for
complex IoT architecturesbased on
1.SUPPLY CHAIN MONITORING
2.COMPONENT TESTING
3.ARCHITECTURE MODELLING
QRS/STV Cambridge (UK), July4th, 2024 © Fraunhofer FOKUS Page18

19. The “Device Security Passport” (DSP)
A machine-readabledocument containing
diverse security related product information
•Existing (probably with extensions) of quasi or de facto standards to be included
•Certificates(if any),
•Software Bill of Material (SBOM),
•Hardware Bill of Material (HBOM),
•Manufacturer Usage Description file (MUD),
•Vulnerability Exploitability eXchange(VEX),
•intended security level of usage scenario (EU CSA type labelling) and
potentially other relevant information.
•Probably using OSCAL (from NIST): the Open Security Controls Assessment Language
QRS/STV Cambridge (UK), July4th, 2024 © Fraunhofer FOKUS Page19

20. Potential ideasforStandardization(NWI)
Submission of results for consideration
1.Technical Specification (TS)
•Security validation methodology for supply trust chains (Component Tester)
2.Technical Specification (TS)
•Specificationof a Device Security Passport
3.Technical Specification (TS)
•Integrated IoT supply trust chain concept
4.Technical Report (TR)
•Supply Trust Chain Applicationsand Assurance
QRS/STV Cambridge (UK), July4th, 2024 © Fraunhofer FOKUS Page20

21. Page21
—
Summary& Conclusions
QRS/STV Cambridge (UK), July 4th, 2024 © Fraunhofer FOKUS

22. Summary & conclusions
1.Quality Assurance comprises many aspects like testing, validation, certification
2.ICT Standardization
▪Involves various stakeholders (engineers, testers, certifiers, users, vendors)
▪Harmonizes technologies/processes and supports trustworthiness
3.ICT Selected Samples
▪Successful in the past: Mobile communication (GSM -> UMTS -> LTE -> 5G)
▪Required for future technologies: IoT, Edge and AI
▪DOSS project focus on secure supply chain
QRS/STV Cambridge (UK), July4th, 2024 © Fraunhofer FOKUS Page22

23. Sources and References
1.ISO/IEC 25000,
also known as SQuaRE(System and Software Quality Requirements and Evaluation)
2.AIOTI report:
https://aioti.eu/wp-content/uploads/2024/01/AIOTI-High-Priority-IoT-Gaps-R3-Final.pdf
3.StandICTpublications:
https://www.standict.eu/landscape-analysis-reports
4.DOSS project:
https://dossproject.eu/
5.JørgenBøegh: A System View on Quality
(International Standard Conference on Trustworthy Computing and Services, November 28-
29, 2014, High-Tech Mansion BUPT, Beijing, China)
6.Ina Schieferdecker: (Un)Certainties of Environmental Change and AI
(WeizenbaumConference, June 18, 2024, WeizenbaumInstitut, Berlin, Germany)
QRS/STV Cambridge (UK), July4th, 2024 © Fraunhofer FOKUS Page23

24. Contact
—
Project manager
Axel Rennoch
Phone [phone]
[email protected]
Fraunhofer FOKUS
Institute forOpen Communication Systems
Kaiserin-Augusta-Allee 31
10589 Berlin, Germany
[email protected]
www.fokus.fraunhofer.de
Head ofTesting
Martin Schneider
Tel. [phone]
[email protected]