3. Strategy

A strategy for public integrity is essential for supporting a coherent and comprehensive integrity system. However, it is not an end in itself but rather a means to an end. The process of strategy development is therefore as important as the resulting strategy. An inclusive and rigorous strategy development process can help select relevant strategic objectives that are meaningful to citizens and businesses; prioritise and sequence actions in an open manner to address the most crucial integrity risks; and provide the necessary evidence for the interventions that are most cost-effective and likely to have the greatest impact. Strategies are also a way of demonstrating commitment and can be used to establish institutional responsibilities. If however strategies do not lead to visible gains – for example, due to inadequate implementation – they can at best become irrelevant and at worst erode public confidence in national authorities.

The OECD Recommendation on Public Integrity states that adherents should “develop a strategic approach for the public sector that is based on evidence and aimed at mitigating public integrity risks, in particular through:

  1. a. Setting strategic objectives and priorities for the public integrity system based on a risk-based approach to violations of public integrity standards, and that takes into account factors that contribute to effective public integrity policies;

  2. b. Developing benchmarks and indicators and gathering credible and relevant data on the level of implementation, performance and overall effectiveness of the public integrity system” (OECD, 2017[1]).

In essence, a strategic approach for public integrity is one that is formalised and run through existing government procedures for strategy development in consultation with relevant stakeholders; is based on evidence; takes a system-wide perspective; and focuses on the key integrity risks. To foster the conditions for increasing ethical behaviour, integrity strategies increasingly balance values-based with rules-based approaches. A comprehensive approach can result in many strategic objectives aimed at reducing integrity risks that are mainstreamed into existing government strategies. Some countries opt for a single national integrity or anti-corruption strategy, though a strategic approach does not necessitate a single strategy document. Regardless of the form, a strategic approach to public integrity contains all of the following elements:

  • problem analysis: risk identification, analysis and mitigation

  • strategy design: prioritising the objectives, policy consultation and co-ordination

  • developing indicators with baselines, milestones and targets

  • drafting the action plan, distributing responsibilities and costing activities

  • implementing, monitoring, evaluating, and communicating the results of monitoring and evaluation, including evaluation prior to implementation.

The risk-based approach has implications for strategy development, implementation, monitoring and evaluation. In particular, it emphasises a problem analysis stage that identifies and analyses the integrity risks that are most harmful to public integrity. Inherent in this approach is the realisation that not all problems can be tackled at once, so prioritisation is necessary. A solid evidence base allows an informed choice as to which strategic objectives should be prioritised.

As the problem analysis process includes identifying, analysing and mitigating risks, it draws on the risk assessment process covered in Chapter 10, which deals with risk management. The two processes, however, are not the same. Risk management has a technical focus; it is used to design and adapt controls to address risks to public integrity. The problem analysis phase involves using the results of the risk assessment process to inform an integrity strategy for the national, sub-national, sectoral or organisational level. A problem analysis process could also reasonably cover risks to the whole-of-government or whole-of-society, and identify relevant mitigation strategies to address these areas.

Thus the problem analysis phase can draw inspiration from key elements of risk management – namely, the risk assessment process, including risk identification, analysis, and mitigation:

  • risk identification – identifying types of integrity risks (bribery, nepotism, absenteeism, conflict of interest violations, procurement fraud, etc.) in a given process or system, based on a risk model

  • risk analysis – estimating the likelihood and impact of each risk, among other factors

  • risk mitigation – based on the results of the risk analysis, implementing measures to treat the risk and monitor and evaluate the measures.

The problem analysis phase aims at identifying problems and their causes, as well as challenges and opportunities for reform. At a minimum, it identifies specific types of relevant integrity breaches, the actors likely to be involved, and the expected likelihood and impact if the risk materialises. Problem analysis is used to select the most effective risk mitigation measures (activities) later, when the strategy and its action plan are developed.

Many of the available methods and techniques for conducting problem analysis are time- and resource-intensive, and may require specialist skills. As a first step in the process, the team in charge needs to formulate a realistic plan for data collection to identify supporting evidence (UNODC, 2015[2]). A key choice at the outset is whether to outsource the problem analysis work, conduct it in-house, or combine the two approaches. There are advantages and disadvantages to each option, depending on the context, resources and skills available, and scope of the exercise (see Table 3.1). Regardless of the option chosen, a proper problem analysis takes time. Relevant data are rarely readily available, and it is also crucial to engage and consult various stakeholders – both state and non-state actors – in the design, implementation and output of the analytical work. This matters for validity, take-up and accountability.

Strategic objectives for integrity may be located in several government documents owned by various authorities. As such, and depending on the structure of the government, it is recommended to periodically provide a mandate to an inter-institutional body, such as a joint task force with members from relevant central government bodies and oversight institutions, to prepare an analytical report on public integrity risks. This report could formulate recommendations and identify priorities for the whole public integrity system (Box 3.1).

Before conducting a problem analysis, an additional consideration is which analytical framework(s) and data sources to use (for an overview of possibilities, see (Johnson and Soreide, 2013[5]; OECD, 2019[6]; OECD, 2009[7]; UNDP, 2015[8]; UNODC, 2013[9]). Commonly used frameworks for strategy development are for example SWOT (Strengths, Weaknesses, Opportunities, Threats) analysis, PESTLE (Political, Economic, Sociological, Technological, Legal and Environmental factors) and problem tree analysis (for more on SWOT and PESTLE, see (OECD, 2018[3])). Such frameworks are useful to facilitate thinking within the team and with external stakeholders. However, without robust data the process may be inclusive but not evidence-based. The following sources of information can provide useful insights to identify and analyse integrity risks:

  • employee, household or business surveys

  • other survey data, such as user surveys or polls from local research institutions

  • data from public registries (e.g. law enforcement, audit institutions, national statistics offices)

  • published research documents from national or international organisations or academia (e.g. articles, reports, working papers, political economy analysis)

  • commissioned research

  • indicators from international organisations or research institutions

  • interviews or focus groups with relevant stakeholders

  • risk assessments conducted by ministries or other government entities for their own programmes.

All of the above sources can be useful for identifying potential integrity risks, but not all can be used to analyse the magnitude or impact of different types of risks. Administrative data from public registries and reliable survey data can be used to both identify and assess the level of risk, whereas for example focus group discussions are mainly useful to identify types of risks.

In Estonia, regular surveys on ethics, corruption and trust conducted by the Ministry of Justice informed the development of the Anti-Corruption Strategy for 2013-20 (Box 3.2).

Reviews conducted by international organisations can also provide input to problem analysis and policy recommendations. Examples include the Implementation Review Mechanism of the UN Convention against Corruption (UNCAC), the Council of Europe’s Group of States against Corruption (GRECO) evaluations, OECD Working Group on Bribery (WGB) evaluations and OECD Integrity Reviews.

Understanding the current context, performance and challenges within a specific country or organisation allows strategic prioritisation of areas for action and identification of realistic objectives. A thorough diagnosis of integrity risks to inform strategic planning is however often lacking in practice in the integrity and anti-corruption field (UNODC, 2015[2]; UNDP, 2014[13]; Hussmann, Hechler and Peñailillo, 2009[14]). The consequence is that priority setting in the strategic process is biased, and ultimately the effectiveness of the integrity system in mitigating risks is undermined (OECD, 2018[15]). By identifying the major integrity risks in the problem analysis phase, policy makers begin a process of reflection on the potential consequences if such risks materialise, as well as the relevant skills and equipment required to manage those consequences (OECD, 2018[16]). A meaningful and realistic strategy is hard to develop without a robust problem analysis. Equally important though is that the design process for the strategy actually takes into account the findings of the problem analysis, and that strategic objectives are prioritised systematically on the basis on evidence (OECD, 2005[17]).

Having conducted a thorough problem analysis, the next step is to develop the strategy for mitigating the risks identified. The key driver for choosing the strategy type – whether it be a single strategy or mainstreaming integrity into existing policy plans and strategies – is to ensure coherence among organisations, policies and objectives. A single strategy can more easily signal commitment, and the centralisation of efforts can make co-ordination and a system-wide approach easier. However, as described below, in practice single strategies face multiple challenges when it comes to implementation, and require focus and a suitable institutional setup.

On the other hand, mainstreaming integrity into existing policy plans and strategies is also challenging. To be effective, a strategic approach for public integrity that is based on mainstreaming involves establishing primary (first-level) objectives1 for mitigating integrity risks across strategies, as well as ensuring adequate coverage to constitute a system-wide approach.

Regardless of the type of strategy document, any strategy development process benefits from taking a systematic, inclusive approach to i) identifying and prioritising objectives; and ii) consulting and co-ordinating among relevant stakeholders.

Regardless of whether a single strategy or a mainstreamed approach is chosen, strategic objectives are the guiding stars for those responsible for executing the strategy, and are used to form indicators and targets on the basis of which the strategy will be evaluated. Objectives must be aligned with the overall vision established for public integrity, as well as specific sector policy. Strategic objectives, from the general to the specific, directly link the findings of the problem analysis and align with indicators, their baselines (i.e. those of the indicators) and targets. Major integrity risks identified in the problem analysis should be addressed through primary objectives, which then cascade down to more specific secondary objectives, actions, indicators, milestones and targets.

Generally, the following areas usually benefit from a focus on integrity risk management:

  • human resource management, including violations of public integrity standards

  • public financial management, including reducing fraud and financial mismanagement

  • internal control and general risk management frameworks

  • public procurement.

In addition to these cross-cutting areas, a system-wide strategic approach will also have primary strategic objectives aimed at mitigating integrity risks in sector strategies – for example health, education, housing, taxation, customs and infrastructure. An advanced strategic framework continues beyond the public sector and recognises the role of the private sector, civil society and individuals in respecting public integrity values in their interactions with the public sector, as stated in the principle of whole-of-society (see Chapter 5). Box 3.3 describes the cross-governmental approach in Finland to developing an anti-corruption strategy. An advanced strategic framework could have objectives to mitigate public integrity risks in the private sector, public corporations, state-owned enterprises or public-private partnerships, as well as in interactions with civil society organisations.

The strategy development process should ensure the appropriate participation of actors responsible for carrying out any part of the strategy. As discussed in Chapter 2, various agencies, departments, units and individuals across different branches of power have responsibilities when it comes to implementing elements of a strategy, and their acceptance and active support will be critical for the strategy to succeed.

When drafting strategy that involves several bodies, one option is to assign to a small committee the primary responsibility for drafting the strategy document and granting it a reasonable degree of autonomy in developing the draft; the committee would be composed of representatives from the relevant public bodies. Representatives from civil society – such as business or professional associations, think tanks and academia – may also be invited to participate, either as full members or observers (Box 3.4). Including a broad range of voices in the development process can help build a common vision and increase the legitimacy of the strategy, and hence augment political support for it in the wider society (UNODC, 2015[2]). The business community, civil society organisations, the media, academics and the public in general can provide valuable inputs, not only in the drafting stage but also in the later monitoring and evaluation of the strategy (UNDP, 2014[13]).

The drafting body can be chaired by an individual with sufficient stature, legitimacy and political influence to act as an effective “champion” for the drafting body, and ultimately for the strategy itself (UNODC, 2015[2]). As noted above, the UK Anti-corruption Strategy was drafted by the Joint Anti-Corruption Unit (JACU) in the Home Office, and the anti-corruption strategy in Finland was developed by a cross-government group that included police, local government and CSOs (Pyman and Eastwood, 2018[4]).

The body in charge of formulating any strategy containing objectives relating to public integrity should consider consulting the following bodies: the anti-corruption authority; the supreme audit institution; the central institution responsible for internal control; the ombudsman institution; the police, the public procurement authority; the tax or customs authorities; and the prosecution authority or court administration. For the public consultation process, all supporting documentation should be made available to the public, including for example the results of regulatory impact assessments or white papers. It should also be made clear how comments provided by the public and organisations have been considered in the final version of the strategy, including explanations for those comments not taken on board.

Implementing established procedures for intergovernmental and public consultations can increase public acceptance of policies and prevent policy capture (for more, see Chapter 13). Moreover, for strategies relating to public integrity, it is often recommended that participation go “above and beyond”, for example with open town hall-style meetings or social media outreach. Strategies can be adopted at different levels of government; doing so is useful to encourage support for the strategy and ensure co-ordination (UNODC, 2015[2]). At both the national and subnational (regional and municipal) level, each ministry, agency or other institution would benefit from preparing their own strategies for mitigating integrity risks within their area of responsibility. However, the system-wide perspective in the principle on strategy encourages a wider, more comprehensive and co-ordinated approach. In practice, therefore, it is recommended that strategies be adopted at least at the level of the government, meaning the council of ministers or equivalent collegial body in the executive.

Aligning new strategies with existing strategies supports coherence. For example, developing the integrity strategy of a local hospital can take into account its specific context (e.g. number of staff, situations in which corruption incidences occur), as well as the sectoral integrity strategy of the ministry of health or a wider strategy for public service delivery adopted at the level of the government.

A strategic approach also requires indicators and establishment of their baselines, milestones and targets. Indicators should reflect the strategic objectives, some of which may be part of the strategy document and others part of the action plan. As such, the development of indicators is an iterative process that can help improve strategic objectives at different levels as well as activities in the action plan.

Indicators – and in particular their baselines, milestones and targets – are often neglected in the strategy design phase, and developed too late in the process to be useful. This leaves those charged with implementation of the strategy without a proper roadmap for which concrete results should be achieved and how. It also makes it difficult for the government as well as non-state actors to assess the level of success, progress towards the strategic objectives, and necessary corrections, as needed.

The goal of indicators is to support comparability over time. This allows for benchmarking that can assess the effectiveness of different interventions in the strategy and in other parts of the public integrity system. In a national context, such benchmarks can be established using a before-and-after approach, if indicators are established and data collected well in advance of implementing the strategy, or a with-and-without approach where the performance of a comparison group is measured alongside the treatment group.2 Internally comparable indicators are scarce and benchmarking should be done with diligence and attention paid to the limitations of the methodologies used. The OECD Public Integrity Indicators can serve as the indicators monitoring implementation of the strategic approach, or can serve as inspiration for developing other indicators.

When developing indicators, it is especially necessary to consider the limitations of the “iconic indices” mentioned in Box 3.53 that have served as the main measures of corruption and anti-corruption. The majority of existing measures rely heavily on secondary data sources based on expert judgement, and lack a theory or normative framework defining what the indicators should be measuring (Oman and Arndt, 2006[19]).

Surveys – of public officials, businesses, the public or specific stakeholders – can provide valuable evidence to inform integrity policies. They are a measurement instrument that can be designed to reflect the culture and challenges of a particular country or organisation. For example, according to the OECD Strategic Human Resources Management Survey, 16 member countries include integrity at the workplace in their employee surveys (OECD, 2017[20]). Regardless of whether one undertakes a dedicated survey or integrates a module into an existing survey, such surveys enable insights into patterns of corrupt behaviour, satisfaction with services, trust in public institutions, and other related areas. In the Netherlands, a comprehensive staff survey is at the core of agenda setting for future integrity policies (Box 3.6). Moreover, some cross-country surveys can provide reliable data to inform national strategies and even to form a national baseline if done with care (Box 3.7). Other data inputs, such as those found in national data registers, can also prove valuable in informing indicators for integrity strategies, if the collected data meet reasonable quality standards.

Once the strategic objectives are established and indicators and targets are set, the next step is to plan the specific activities needed so the objectives can realistically be met. This is an action plan.

All government strategies benefit from action plans, and each country has its own set of guidelines for what constitutes a good plan. Integrity strategies do not pose any particular challenge in this respect. Nevertheless, to emphasise the need for an evidence-and risk-based approach and financial sustainability, and because integrity strategies often depend on multiple implementation agents, the following characteristics of action plans are recommended for integrity strategies (see also (Council of Europe, 2013[25])):

  • outcome-level indicators, with a baseline, milestones and targets, linked to objectives and activities

  • identification of at least lead organisations for each objective

  • description of the monitoring, reporting and evaluation arrangements

  • use of administrative data sources from existing public registries, such as human resource management information systems, procurement databases, audit reports, risk registers, court case statistics and law enforcement statistics

  • use of data sources from staff, household or business surveys

  • if relevant for the strategic objective, activities at the sub-national level

  • estimates of capital and operational expenditures

  • identification of additional costs with cost estimates

  • multi-annual financial plans that are linked with the medium-term expenditure framework

  • public availability of the full action plan, together with the corresponding monitoring reports (see Section 3.2.5).

Presentation of the action plan should be kept simple, and also enable readers from outside the administration to identify at first glance answers to key questions such as, “What are the actions?”, “Who will be responsible for them?”, “When will they happen?” and “How will their impact be measured?” (Hope, 2013[26]). Even in the seemingly simple case of whether a new code of conduct has to be drafted, breaking the process into a series of steps (e.g. drafting the code, consultations, submission for approval and dissemination) could be helpful.

An effective integrity strategy and action plan must not only lay out a comprehensive set of substantive reforms, but also indicate the means for ensuring its implementation, monitoring and evaluation. As discussed in Chapter 2, a specific body, ministry or unit under a ministry should be assigned responsibility for this task, sometimes jointly with other entities. Regardless of the specific institutional setup, each strategy needs a central co-ordination function responsible for implementation, monitoring, evaluation and reporting of the strategy and its action plan.

The entities responsible for the design of the integrity strategy and the action plan are not necessarily also responsible for all (parts) of its implementation (OECD, 2017[20]). This can hamper implementation. It will not be enough for booklets on policies to be sent round while putting them into practice is left to self-initiative and judgement (U4 Anti-Corruption Resource Centre, 2007[27]). Key to implementing an integrity strategy is therefore to join different integrity actors under a common vision and co-ordinate their action towards public integrity.

Several governments require that individual line ministries or departments prepare corruption prevention plans that are tailored to their organisation’s specific internal and external risks. Every organisation is different, and integrity risks vary depending on mandate, personnel, budget, infrastructure and IT development. For example, line ministries responsible for transferring social benefits face higher risks of fraud; likewise, departments with higher public procurement spending (such as health or defence) may face corruption risks related to that activity. Even if a strategy is implemented by multiple bodies, there needs to be a central monitoring mechanism. At a minimum, monitoring reports should:

  • be published at regular intervals, on time, and made publicly available

  • report on progress in relation to predefined indicators and targets in the action plan

  • present the rate of implementation of activities in the action plan

  • draw conclusions and provide recommendations to management

  • be discussed with relevant bodies, including non-state actors.

Individual agencies are often overly optimistic when assessing how well they are doing in implementing a programme, and the monitoring arrangements of many strategies have fallen short because they rely on implementing organisations monitoring their own progress. The agency responsible for co-ordinating implementation of the strategy should therefore ensure, whenever possible, that there is independent validation of progress. In some cases, it may be advisable to request that an organisation conduct a preliminary self-evaluation and then compare the results with an independent evaluation or audit (perhaps by the co-ordinating unit, another government department or an external monitor such as a civil society group or outside consultant). Among other advantages, doing so might help the implementing organisations understand how they can better assess their own performance (UNODC, 2015[2]). An example of how this is done is given in Box 3.8.

To properly gauge the effectiveness of an integrity strategy, it is important to specify evaluation arrangements.5 These mechanisms are often institutionalised within the policy-making process for all public policies (Jacob, Speer and Furubo, 2015[28]). Evaluation mechanisms at various stages of the policy process are defined and planned prior to implementing any actions. Having a clear idea of what data will be collected for evaluation, as well as how and when measures taken will be evaluated, informs the design and implementation of actions. It is essential to establish evaluation mechanisms before the implementation phase to ensure measurability, progress reports and accountability. Some data may overlap with what has been collected for the risk identification and assessment procedure in the ex ante stage, but the monitoring and evaluation arrangements have a different purpose: holding the implementing actors accountable for what has been achieved, and how efficiently. Similar to the problem analysis phase, the evaluation can either be done in-house or outsourced. Alternatively, it is possible to outsource only certain parts of the process. The choice depends on the purpose of the evaluation and the resources available. In short, in-house evaluations can better facilitate organisational self-reflection and learning, be less expensive, and be faster to execute; at the same time, they are also seen as less objective, and in-house staff often have neither the time nor the skills needed for a thorough evaluation. Table 3.2 details the advantages and disadvantages of each approach.

Evaluation reports for integrity strategies should be made publicly available, and it is often useful to include non-state actors either as evaluators or as part of a formal quality assurance process.6 Monitoring data should be used actively in the evaluation reports, and the ultimate goal is for the evaluation exercise to improve approaches and practices, for example by informing the design of follow-up initiatives.

Aside from monitoring and measuring the benefits of the integrity strategy, communicating progress and results to internal and external stakeholders, including the wider public, not only enables accountability but also increases the credibility of integrity efforts and stimulates future anti-corruption and integrity action. In their action plan, countries may include information and communication activities, taking into account all new information media such as social media, as well as traditional and tested approaches such as town hall meetings and public hearings (UNODC, 2015[2]).

Communication should start as soon as the integrity strategy is ready, prior to implementation. Its content and envisaged implementation and the bodies responsible for its execution should be widely publicised. This will ensure transparency and help mobilise popular support, besides creating public expectation that those involved in the reform process will live up to their commitments. The public can be informed of the strategy and its implementation progress through the media, government websites and targeted public information events as well as by civil society organisations (OSCE, 2016[29]). Chapter 5 addresses factors related to developing and implementing an effective communications strategy.

A strategic approach for public integrity may face challenges depending on whether a single national strategy is formulated or strategic objectives for integrity are mainstreamed into existing strategies. Regardless of the choice of the document, a strategic approach requires high-level commitment during the strategy design process, as well as ensuring that the approach avoids overly rigid compliance objectives and places emphasis on promoting cultural change within organisations.

Without commitment at the highest political and management levels, integrity strategies are unlikely to be effective or sustained in the long term (for more, see Chapter 1). A good practice for gathering the necessary support for the strategy and the suggested reforms throughout the administration is to ensure the appropriate participation in the strategy-drafting phase of representatives of any government agency, department or unit affected by the strategy (OSCE, 2016[29]). An advantage of involving relevant actors (responsible for implementation, enforcement and monitoring) in the strategy design process is that it can improve their co-operation in those three areas, which are all critical to the effectiveness of the integrity system (UNODC, 2015[2]). Ensuring that the process includes a representative from a high-level or central government position can also support commitment to implementation (for more, see Chapter 2).

A challenge that arises especially for single national integrity strategies relates to the need for a suitable institutional setup and political champions. Strategic objectives may be meaningful but not met if management structures, processes, information technology, data registries and staffing are inadequate, or if time and budget are insufficient to put ambitions into practice. In establishing objectives, the strategy designers need to match expectations with the implementation capacity, the time needed, and available resources of the particular public administration (Council of Europe, 2013[25]). It is crucial to avoid developing an unrealistic “wish list”. Prioritisation in strategy development can be done through establishing short-, medium- and long-term objectives, and sequencing the implementation of activities.

A strategic approach that mainstreams integrity objectives into existing strategies often faces fewer problems regarding the institutional setup, staffing and funding, as those strategies are established; however, it still needs to grapple with the challenge of a whole-of-government, collaborative approach. For example, sector ministries may be reluctant to collaborate closely with oversight institutions, anti-corruption authorities or civil society organisations in fear that the weaknesses of their integrity systems may be exposed. It is even more necessary for such approaches that an inter-institutional body is given a mandate to periodically prepare an analytical report on public integrity risks that formulates recommendations and sets priorities for the whole public integrity system, as mentioned above. Otherwise integrity risks will be identified and analysed only within specific sub-systems of government.

A common challenge for all types of integrity strategies is to achieve the proper balance between a rule-based or compliance-based approach and a strategy based on values. Over the years, governments have adopted legal and institutional frameworks to strengthen integrity in the public sector. However, in many countries these frameworks rely heavily on compliance and enforcement mechanisms.

The goal of any integrity strategy should be to increase integrity in the public sector, not simply to curb misconduct and corruption. Compliance-based approaches focus on adherence to administrative procedures and rules setting minimum standards. While these efforts provide the necessary enabling framework, an integrity strategy additionally based on values helps create an environment that supports positive ethical behaviour. The idea is for values to serve as a common framework that can be applied in the decision-making process across different functions, departments and teams (see Table 3.3).

References

[18] Centre for the Study of Democracy (2014), Civil Society Involvement in Drafting, Implementing and Assessing Anticorruption Policies: Best Practices Manuel, European Commission, https://www.files.ethz.ch/isn/185875/Best-practice-manual-civil-society-involvement.pdf.

[25] Council of Europe (2013), Designing and Implementing Anti-Corruption Policies, https://rm.coe.int/16806d8ad7 (accessed on 24 January 2020).

[12] Estonian Ministry of Justice (2016), Survey brief, https://www.korruptsioon.ee/sites/www.korruptsioon.ee/files/elfinder/dokumendid/survey_summary_in_english.pdf (accessed on 12 March 2020).

[11] Estonian Ministry of Justice (2013), Anti-Corruption Strategy 2013-2020, https://www.korruptsioon.ee/sites/www.korruptsioon.ee/files/elfinder/dokumendid/estonian_anti-corruption_strategy_2013-2020.pdf.

[22] European Commission (2017), EU Open Data Portal, https://data.europa.eu/euodp/data/dataset/S2176_88_2_470_ENG (accessed on 24 January 2020).

[32] G20 (n.d.), Issue Paper on Corruption and Economic Growth, http://www.oecd.org/g20/topics/anti-corruption/Issue-Paper-Corruption-and-Economic-Growth.pdf (accessed on 24 January 2020).

[26] Hope, T. (2013), Strengthening Anti-Corruption Policies and Practices in Turkey (TYSAP). Designing and Implementing Anti-corruption Policies for Different Sectors, Council of Europe, https://rm.coe.int/16806dd1b6 (accessed on 24 January 2020).

[14] Hussmann, K., H. Hechler and M. Peñailillo (2009), “Institutional arrangements for corruption: Considerations for the implementation of the United Nations Convention against Corruption Article 6”, U4 ISSUE, No. 2009:4, U4 Anti-Corruption Resource Centre, CHR. Michelsen Institute (CMI), https://agora-parl.org/sites/default/files/U4%20-%20Institutional%20arrangements%20for%20corruption%20prevention%20-%202009%20-%20EN%20-%20PACE_0.pdf.

[28] Jacob, S., S. Speer and J. Furubo (2015), “The institutionalization of evaluation matters: Updating the International Atlas of Evaluation 10 years later”, Evaluation, Vol. 21/1, pp. 6-31, https://doi.org/10.1177/1356389014564248.

[5] Johnson, J. and T. Soreide (2013), Methods for learning what works and why in anti-corruption: An introduction to evaluation methods for practitioners, U4, https://www.u4.no/publications/methods-for-learning-what-works-and-why-in-anti-corruption-an-introduction-to-evaluation-methods-for-practitioners.pdf (accessed on 2 September 2019).

[21] Lamboo, T. and J. de Jong (2016), “Monitoring integrity: The development of an integral integrity monitor for public administration in the Netherlands”, in Huberts, L. and A. Hoekstra (eds.), Integrity Management in the Public Sector: the Dutch Approach, Dutch National Integrity Office (BIOS), The Hague, https://www.government.nl/documents/reports/2016/01/18/integrity-management-in-the-public-sector-the-dutch-approach (accessed on 24 January 2020).

[6] OECD (2019), Analytics for Integrity: Data-Driven Approaches for Enhancing Corruption and Fraud Risk Assessments, OECD, Paris, http://www.oecd.org/gov/ethics/analytics-for-integrity.pdf (accessed on 2 September 2019).

[15] OECD (2018), Behavioural Insights for Public Integrity: Harnessing the Human Factor to Counter Corruption, OECD Public Governance Reviews, OECD Publishing, Paris, https://dx.doi.org/10.1787/9789264297067-en.

[16] OECD (2018), National Risk Assessments: A Cross Country Perspective, OECD Publishing, Paris, https://doi.org/10.1787/9789264287532-en.

[3] OECD (2018), Toolkit for the preparation, implementation, monitoring, reporting and evaluation of public administration reform and sector strategies: guidance for SIGMA partners, OECD, Paris, http://www.oecd.org/termsandconditions (accessed on 27 August 2019).

[20] OECD (2017), Government at a Glance 2017, OECD Publishing, Paris, https://dx.doi.org/10.1787/gov_glance-2017-en.

[1] OECD (2017), OECD Recommendation of the Council on Public Integrity, OECD, Paris, https://legalinstruments.oecd.org/en/instruments/OECD-LEGAL-0435 (accessed on 24 January 2020).

[31] OECD (2013), Development Results: An Overview of Results Measurement and Management, OECD, Paris, https://www.oecd.org/dac/peer-reviews/Development-Results-Note.pdf.

[7] OECD (2009), Integrity in Government: Towards Output and Outcome Measurement, Public Governance Committee, Public Governance and Territorial Development Directorate, OECD, Paris, http://www.oecd.org/officialdocuments/publicdisplaydocumentpdf/?doclanguage=en&cote=GOV/PGC/ETH(2009)4.

[30] OECD (2009), Measuring Government Activity, OECD Publishing, Paris, https://dx.doi.org/10.1787/9789264060784-en.

[17] OECD (2005), Public Sector Integrity: A Framework for Assessment, OECD Publishing, Paris, https://doi.org/10.1787/9789264010604-en.

[19] Oman, C. and C. Arndt (2006), Uses and Abuses of Governance Indicators, Development Centre Studies, OECD Publishing, Paris, https://dx.doi.org/10.1787/9789264026865-en.

[29] OSCE (2016), Handbook on Combating Corruption, Organization for Security and Co-operation in Europe, https://www.osce.org/secretariat/232761 (accessed on 24 January 2020).

[4] Pyman, M. and S. Eastwood (2018), Analysing the anti-corruption approaches of the 26 top-ranked countries: An opportunity for a new generation of strategies, Norton Rose Fulbright, https://www.nortonrosefulbright.com/-/media/files/nrf/nrfweb/imported/countries-curbing-corruption---top-26-report.pdf?la=en&revision=cd44489d-caee-4db9-b7e3-c150da13106d (accessed on 22 October 2019).

[10] Sööt, M. (2017), Corruption study in Estonia. 2017, https://www.korruptsioon.ee/sites/www.korruptsioon.ee/files/elfinder/dokumendid/survey_summary_in_english.pdf.

[27] U4 Anti-Corruption Resource Centre (2007), “Anti-corruption policy making in practice: What can be learned for implementing Article 5 of UNCAC? Synthesis report of six country case studies: Georgia, Indonesia, Nicaragua, Pakistan, Tanzania, and Zambia”, U4 Report, Vol. 1, https://www.u4.no/publications/anti-corruption-policy-making-in-practice-what-can-be-learned-for-implementing-article-5-of-uncac.pdf.

[8] UNDP (2015), User’s Guide - Measuring Corruption and Anticorruption, UNDP, https://www.undp.org/content/undp/en/home/librarypage/democratic-governance/anti-corruption/user-s-guide---measuring-corruption-and-anticorruption.html (accessed on 2 September 2019).

[13] UNDP (2014), Anti-corruption Strategies: Understanding What Works, What Doesn’t and Why? Lessons learned from the Asia-Pacific region, https://www.undp.org/content/dam/undp/library/Democratic%20Governance/Anti-corruption/UNDP%20ACS%20Asia%20Pacific%20%20Anti-corruption%20Strategies.pdf.

[23] United Nations Interregional Crime and Justice Research Institute (n.d.), ICVS - International Crime Victims Survey, http://www.unicri.it/services/library_documentation/publications/icvs/ (accessed on 11 February 2020).

[2] UNODC (2015), The United Nations Convention against Corruption. National Anti-Corruption Strategies: A Practical Guide for Development and Implementation, United Nations, Vienna, https://www.unodc.org/documents/corruption/Publications/2015/National_Anti-Corruption_Strategies_-_A_Practical_Guide_for_Development_and_Implementation_E.pdf.

[9] UNODC (2013), The United Nations Convention against Corruption: A Resource Guide on State Measures for Strengthening Corporate Integrity, United Nations Office on Drugs and Crime, New York, https://www.unodc.org/documents/corruption/Publications/2013/Resource_Guide_on_State_Measures_for_Strengthening_Corporate_Integrity.pdf (accessed on 13 February 2019).

[24] World Bank Group (n.d.), Enterprise Surveys, http://www.enterprisesurveys.org/data (accessed on 24 January 2020).

Notes

← 1. Primary or first-level objectives are those formally adopted by a council of ministers or similar body, and are applicable across government or across a sector.

← 2. This could for example be done if an integrity programme in schools is planned as part of the strategy, and because of a lack of resources the programme is first implemented in selected municipalities (treatment group) and only later, once this pilot phase has been evaluated, in other municipalities (comparison group).

← 3. For more on limitations, please see the G20 Issues Paper on Corruption and Economic Growth (G20, n.d.[32]), as well as the UNDP User’s Guide to Measuring Corruption and Anti-Corruption (UNDP, 2015[8]).

← 4. The Global Corruption Barometer and regional barometers provide actionable data on the prevalence of bribery in different sectors and the attitudes of citizens towards the efforts of the administration to curb corruption. However, due to funding pressures and operational limitations the samples can be biased – for example towards urban populations – and results are often not comparable over time.

← 5. Monitoring is a continuous function that uses systematic collection of data on specific indicators to provide an indication of the achievement of objectives. Evaluation is the systematic and objective assessment of an ongoing or completed project, programme or policy, its design, implementation and results. It differs from monitoring in that it involves a judgement of the value of the activity and its results (OECD, 2013[31]). For more about monitoring government performance, see (OECD, 2009[30]).

← 6. The European Commission’s Quality of Public Administration – Toolbox 2017 edition provides examples of how to promote the active involvement of stakeholders in evaluating public policy: http://ec.europa.eu/social/main.jsp?catId=738&langId=en&pubId=8055&type=2&furtherPubs=no.

Metadata, Legal and Rights

This document, as well as any data and map included herein, are without prejudice to the status of or sovereignty over any territory, to the delimitation of international frontiers and boundaries and to the name of any territory, city or area. Extracts from publications may be subject to additional disclaimers, which are set out in the complete version of the publication, available at the link provided.

© OECD 2020

The use of this work, whether digital or print, is governed by the Terms and Conditions to be found at http://www.oecd.org/termsandconditions.