2021 10 21 (07) EEC SDMX DSDs - International Recommendations for DSDs Development

International Recommendations for DSDs Development

1. International Recommendations for DSDs Development Steven Vale UNECE [email protected]

2. Introduction SDMX Governance What is a DSD? Code lists Guidelines Resources

3. SDMX Governance SDMX Sponsors SDMX Statistical Working Group Content-oriented guidelines SDMX Technical Working Group Technical specifications

4. What is a DSD? A Data Structure Definition is: “A set of structural metadata associated to a Data Set, which includes information about how Concepts are associated with the Measures, Dimensions, and Attributes of a data cube, along with information about the Representation of data and related descriptive metadata” SDMX Glossary v2.1 (December 2020): https://sdmx.org/wp-content/uploads/SDMX_Glossary_version_2_1-Final-2.docx

5. “To exchange or disseminate statistical information, an institution needs to specify which statistical concepts are necessary for identifying the series (and for use as Dimensions) and which statistical concepts are to be used as attributes and measures. These definitions form the Data Structure Definition … The specification of the Data Structure Definition is often a collaborative venture between the collecting institution and its partners” What is a DSD?

6. A standard way of describing the structure and contents of a data set What is a DSD?

7. Dimensions, Attributes, Measures Measures Number of … % of … Ratio of … Data Set Attributes Title Confidentiality status Other notes Dimensions Time Location Indicator Sex Age group Civil status …..

8. Code lists - CL_CIVIL_STATUS Recommended code values descriptions Annotations S Single person This code includes persons who have never been married or in registered partnership. M Married person This code covers both persons living in a same-sex marriage as well as in an opposite-sex marriage. This code excludes legally separated persons. W Widowed person This code includes persons whose marriage ended with the death of the partner and who are not remarried or in a registered partnership. D Divorced person This code includes persons whose marriage ended with a divorce procedure and who are not remarried or in a registered partnership. L Legally separated person This code includes persons who are separated: they are still married, but "officially" separated. ….. …… …….

9. Code lists - CL_CONF_STATUS Recommended code value Recommended code description F Free (free for publication) N Not for publication, restricted for internal use only C Confidential statistical information D Secondary confidentiality set by the sender, not for publication S Secondary confidentiality set and managed by the receiver, not for publication A Primary confidentiality due to small counts O Primary confidentiality due to dominance by one unit T Primary confidentiality due to dominance by two units …. ….

10. Where to find code lists Human readable – SDMX website https://sdmx.org/?page_id=3215 Machine readable – SDMX Global Registry https://registry.sdmx.org/overview.html

11. Creating code lists Guidelines for the Creation and Management of SDMX Code Lists https://sdmx.org/wp-content/uploads/SDMX_Guidelines_for_CDCL.docx Generic codes _O Other Used to cover residual information not contained in other categories of the code list (in some contexts, e.g. classifications, referred to as n.e.s. , not elsewhere specified, n.e.c. , not elsewhere classified, etc.) _S Subtotal Used for expressing intermediate totals _T Total Used for expressing totals _U No data/unknown Failure to obtain a measurement (e.g. non response, no data available, information not known by the respondent unit, etc.)

12. SDMX Content-Oriented Guidelines Cross-domain code lists Cross-domain concepts Statistical subject-matter domains Glossary https://sdmx.org/?page_id=4345

13. Other SDMX guidelines Guidelines on using SDMX Annotations Standardising Reference Metadata Reporting in SDMX Governance of commonly used SDMX metadata artefacts Modelling Statistical Domains in SDMX Guidelines for representing methodological changes in DSDs Guidelines for SDMX Data Structure Definitions Guidelines for the Creation and Management of SDMX Code Lists Guidelines on the Versioning of SDMX Artefacts Guidelines on Non-Calendar Year Reporting of Data Possible Ways of Implementing the Observation Status Concept Guidelines for Confidentiality and Embargo in SDMX Guidelines on coding time transformations in SDMX Guidelines for SDMX Concept Roles Checklist for SDMX Data Providers SDMX Global Registry Content Policy

14. Other SDMX guidelines Guidelines on using SDMX Annotations Standardising Reference Metadata Reporting in SDMX Governance of commonly used SDMX metadata artefacts Modelling Statistical Domains in SDMX Guidelines for representing methodological changes in DSDs Guidelines for SDMX Data Structure Definitions Guidelines for the Creation and Management of SDMX Code Lists Guidelines on the Versioning of SDMX Artefacts Guidelines on Non-Calendar Year Reporting of Data Possible Ways of Implementing the Observation Status Concept Guidelines for Confidentiality and Embargo in SDMX Guidelines on coding time transformations in SDMX Guidelines for SDMX Concept Roles Checklist for SDMX Data Providers SDMX Global Registry Content Policy

15. Guidelines for SDMX DSDs 1 Aim of this document 2 General design principles 3 Usage contexts 4 Data structuring approaches 5 Minimum structural and semantic requirements 6 Step-by-step guide 7 Annex 1. Glossary of Terms 8 Annex 2. What is a DSD? 9 Annex 3. References

16. Existing DSDs https://registry.sdmx.org/data/datastructure.html

17. Existing DSDs https://unstats.un.org/sdgs/iaeg-sdgs/sdmx-working-group/

18. Thank-you for your attention!