copy the linklink copied! Annex B. OECD methodology for constructing the OURdata Index
This annex provides further information on the process and methodology of the OECD 2017 Open-Useful-Reusable Government Data Index (OURdata Index). It also presents in more details the performance of the South East Asian countries regarding the three different pillars of the OURdata Index 2017.
The OECD OURdata Index 2017 aims to measure government efforts in line with the three main stages of the data value chain. That is, the Index assesses governments’ progress towards 1) higher data availability, 2) efficient data accessibility and 3) greater support for data reuse. In measuring these three different elements, the Index considers the availability of different formal requirements (either applicable for all ministries and agencies or just in some agencies), implementation gaps and the presence of oversight mechanisms.
Data used to construct the composite index are from the OECD Open Government Data Survey 3.0. The survey is composed of 80 questions representing 170 data points (with some data points corresponding to sub-questions). The survey was designed to monitor the implementation of the International Open Data Charter (IODC) adopted in October 2015. The IODC corresponds to a comprehensive international instrument that provides a set of principles on open government data (OGD). The IODC adds to the OECD Recommendation for enhanced access and more effective use of Public Sector Information (OECD, 2008b). Additionally, the survey and the composite index are also based on the OECDs expertise in the field of OGD and on a roadmap developed in 2013 (Ubaldi, 2013).
The Index construction follows the guidelines from the OECD/EU Handbook on Constructing Composite Indicators (2008) that are necessary for meaningful construction of composite or synthetic indexes. This approach is particularly useful for addressing the common problems associated with composite indexes and is thus the most effective solution to summarise the discrete, qualitative information on key aspects of OGD.
Thus, four main types of analyses were conducted with the data to ensure the highest standards of indicator reliability and validity (OECD-EU, 2008):
-
correlation analysis
-
confirmatory Principal-Component Factor analysis
-
Cronbach alpha testing (scale reliability coefficient)
-
sensitivity testing (Monte Carlo Simulation)
The OURdata Index is based on 140 data points (meaning that a total number of 30 data points were dropped). Each pillar of the Index (data availability, data accessibility, and government support for data reuse) has three sub-pillars. The score for each pillar corresponds to an unweighted simple average of each sub-pillar. For the sub-pillar level, implicit weighting was avoided since three sub-pillars were systematically retained under each main pillar.
Additionally, each sub-pillar has parameters (factors) identified via expert judgement and factor analysis. The score of each sub-pillar is computed as the unweighted simple average of each parameter. There are nine parameters in Pillar 1, eight parameters in Pillar 2 and seven parameters in Pillar 3.
Data collection for Southeast Asian countries was conducted from February 2017 to June 2018. Respondents were high-level government officials (in many cases the national Chief Information Officer). It was completed by all SEA countries except Lao PDR and Myanmar. OECD average is based on 32 OECD countries (data are not available for Hungary, Iceland and Luxembourg). Data refer only to central/federal governments and exclude practices at the state/local levels.
The figures for country scores on the Overall index (OUR data) and Pillar 1 (data availability) are shown under the indicator Open Government Data, whereas the other pillars of the index are provided in Figures B.1 and B.2.
Source: For SEA countries, OECD (2018) Open Government Data Survey. For OECD countries, OECD (2017) Open Government Data Survey.
Source: For SEA countries, OECD (2018) Open Government Data Survey. For OECD countries, OECD (2017) Open Government Data Survey.
Metadata, Legal and Rights
https://doi.org/10.1787/9789264305915-en
© OECD, ADB 2019
This Work is available under the Creative Commons Attribution Non-Commercial No Derivatives 3.0 IGO (CC BY-NC-ND 3.0 IGO) public license.
