Quality of Open Data and Metadata An Introduction to the NQDM - Project Lina Bruns Fraunhofer FOKUS Prague, 2nd November 2018
2 Agenda Fraunhofer FOKUS Open Data in Germany Quality of Open Data NQDM - Project
3 The Fraunhofer-Gesellschaft 25.000 Employees 72 Institutes and research units 2.3 Billion euros Research Volume
4 Fraunhofer FOKUS
5 Digital Public Services – DPS eGovernment infrastructures and processes Open Government Data and service platforms Usability of specialist applications Electronic file – selection and launch Digitization and society Certification assistance in CC certification processes DPS bundles the activities encompasing eGovernment and public IT and suppports politics, administration and industry in the digitization in the public space and in public administration. © Matthias Heyde/ Fraunhofer FOKUS
6 Open Data in Germany
7 Structure of Open Data in Germany Municipal Portals State / Specialist Portals Overall Data Portal … … … …
8 Structure of Open Data in Germany
9
Publishing Open Data
Internal
Data Collection
Internal Data
Enhancement
Decentral Data
Release
Central Data
Access
Data
Re-Use
10 Quality of Open Data
11 Open Data Quality Issues I
12 Open Data Quality Issues II
13 Importance of Data Quality • Processing of low-quality data is difficult and often requieres • Manual data enhancing Data User Data Publisher • High quality data can be re-used by public administration • Data quality prevents misinterpretation How can quality of data be increased?
14 Increasing Quality – Approaches Tools for Data Enhancement e.g. anonymization tools, automated quality check of metadata
15 Increasing Quality – Approaches e.g.: Standardization of publishing process Improving Publishing Process Tools for Data Enhancement e.g. anonymization tools, automated quality check of metadata https://www.oeffentliche-it.de/
16 Increasing Quality – Approaches e.g.: Standardization of publishing process Improving Publishing Process Tools for Data Enhancement Employee Training e.g. anonymization tools, automated quality check of metadata e.g. Development of draft standard for quality data and metadata
17 NQDM Normentwurf für Qualitative Daten und Metadaten (Draft Standard for Qualitative Data and Metadata)
18 NQDM – Project Lack of quality of published data and metadata Create a guide that helps data publishers to publish high quality open data and metadata Research project funded by Federal Ministry of Economic Affairs and Energy 01.09.2017 - 31.08.2019
19 NQDM – Project Definitions of relevant terms Rating schemes for quality Quality Characteristics Decision Support File Format specific recommendation Evaluation matrix for metadata
20 NQDM – Target Group Employees of public administration responsible for publishing data with • Little knowledge of open data • Little or no knowledge of data quality aspects • Little or no knowledge of file formats Questions adressed: • How to get started with publishing high quality data? • What is data / metadata quality? • What are suitable formats? • Which tools support publication?
21 NQDM – Project ~20 Members • Data publisher • Data users • Scientists • Politics Evaluation and Support Expert Panel Prototypical Implementation Use Case – Approach Data Blending for • identifying quality issues and • testing recommendations from NQDM
22 Current Status & Next Steps • First Draft created • Content Coordination with Expert Panel • First Feedback Iteration running • Fine-Tuning with Expert Panel in November • Extension of Content • Finalization of Draft • Preparation of Publishing as Specification or Draft Standard Done To Be Done
23 Contact Fraunhofer FOKUS Institute for Open Communication Systems Kaiserin-Augusta-Allee 31 10589 Berlin, Germany [email protected] www.fokus.fraunhofer.de Lina Bruns Phone +49 (30) 34 63 -7283 [email protected]