4. Strengthening the strategic use of public procurement

As mentioned, public procurement by the central government in Malta accounted for approximately 6% of GDP in 2019 (Government of Malta, 2021[1]). Until recently, in most OECD countries, the economic and fiscal arguments have been at the forefront of government considerations and policy design, given constant budget pressures and citizens’ demands for accountability vis-à-vis public spending. Increasingly over in the past decade, however, recognising the role public procurement can play in achieving broader outcomes, the concept of value in public spending has been evolving to encompass a wider range of considerations known as “complementary policy objectives” (OECD, 2022[2]). These objectives include supporting a more resource-efficient economy, stimulating innovation, supporting small and medium-sized enterprises (SMEs) and promoting social values. (OECD, 2021[3]) The strategic use of public procurement has been long highlighted by the OECD, namely through the 2015 “OECD Recommendation of the Council on Public Procurement” (hereinafter referred to as the “OECD Recommendation”) that calls upon countries to use public procurement to pursue complementary policy objectives while balancing them against the primary objectives. This could be done by i) evaluating the use of public procurement as one method of pursuing complementary policy objectives in accordance with clear national priorities (ii) developing an appropriate strategy for integrating these policy objectives in public procurement systems, and (iii) employing appropriate impact assessment methodology to measure the effectiveness of public procurement in achieving these objectives. (OECD, 2015[4])

In fact, countries are progressively using public procurement as a strategic lever to enhance the uptake of different policy objectives. For instance, Figure 4.1. shows that all OECD countries have developed green public procurement policies at least at some level of the public sector. The majority of the OECD countries has policies to support SMEs’ access to public procurement. However, policies related to stimulating innovation, responsible business conduct and social policies are lagging behind.

Ensuring an enabling environment is pivotal to the effective integration of complementary policy objectives through public procurement. Enabling environment consists of having appropriate regulatory and institutional frameworks, developing policies and strategies, providing support tools, and establishing a monitoring mechanism. (See Figure 4.2. )

In line with the European directives and policies, Malta is committed to advancing the strategic use of public procurement. This chapter will focus on the strategic use of public procurement to advance the environmental agenda, to spur innovation and to enhance SMEs development. It aims at assessing the current state of play and elements related to the enabling environment and providing the country with concrete recommendations to support the implementation of this agenda.

Green Public Procurement (GPP) is an important tool to achieve environmental and sustainable policy goals relating to climate change, resource use and sustainable consumption and production. GPP refers to “purchasing of products and services which are less environmentally damaging when taking into account their whole life cycle” (OECD, 2015[6]). GPP is aligned with achieving international initiatives such as a European Green Deal and Sustainable Development Goals (SDGs) and plays a key role in achieving these goals. In Malta, GPP is defined as “the process where public authorities attempt to solicit services, goods and works that have a diminished environmental impact throughout their life cycle, in comparison to services, goods and works that have the same primary function”. (Ministry for the Environment, Climate Change and Planning, 2021[7]).

Malta has been taking strong initiatives to promote GPP since 2011, through implementing GPP institutional reforms and GPP National Action Plans (NAP). Indeed, the country adopted the first NAP (2012-2014) in 2011 and the second NAP (2022-2027) in 2021. Data provided by the Ministry for the Energy, Environment and Enterprise (MEEE) shows that in 2020 GPP accounted for 28% of the total number of tenders published. This corresponds to 36% of the total procurement value and 1.17% of GDP in 2020. (See Figure 4.3. ) However, the share of GPP decreased in 2020 compared with 2018 and 2019 in terms of the value. According to the MEEE, this decrease can be explained by the fact that many tenders, in particular large volume procurement with GPP criteria, were issued prior to 2020.

This section analyses an enabling environment of GPP in Malta.

Having in place a clear and coherent institutional framework with regards to GPP is key to advancing its implementation, irrespective of the entity leading the GPP agenda. While in some countries the GPP agenda is led by the entity in charge of public procurement (e.g. Public procurement office, Ministry of Finance, etc), in other countries, it is the Ministry in charge of the environment policy that undertakes this role. In Malta, the GPP initiative is led by the Green Public Procurement (GPP) Office within the Directorate for the Environment and Climate Change which is located within the MEEE, in cooperation with the Department of Contracts (DoC).

The institutional settings to implement GPP were established. These include GPP Focal Point, which is the key driving force to advance GPP implementation, the National GPP task Force, a GPP Helpdesk (to be discussed in the section 4.1.3), and GPP officer function.

GPP Focal Point has been placed within the MECP since 2011 and is responsible for the coordination of stakeholder consultations, the representation of Malta at the GPP Advisory Group Meetings of the European Union, the delivery of training and information sessions to public entities and the monitoring and contribution to reports related to GPP.

The National GPP Task Force was established in 2011 as an inter-ministerial task force (IMTF) to oversee the roll out of GPP, promote the collaboration among key stakeholders of GPP in Malta and support the development and implementation of the 1st NAP. The IMTF was chaired by the MECP, and its members consisted of governmental institutions: DoC, Ministry for Resources and Rural Affairs (MRRA), Malta Environment and Planning Authority (MEPA), Malta Council for Science and Technology (MCST), Malta Enterprise (ME), National Statistics Office (NSO), Malta Competition and Consumer Affairs Authority (MCCAA) and the Department for Local Government (DLG). This task force was re-established in 2015 and is also active currently to provide the GPP Focal Point with feedbacks on GPP policy and implementation. This IMTF contributed to setting the basis upon which the second GPP NAP 2022-2027 (to be discussed in the next section 4.1.2) was built.

Similarly to GPP Focal Point, GPP officer is placed within each Ministry. The role of the GPP officer was to carry out GPP clearance procedures until 2015. GPP clearance system was established as a quality control mechanism to ensure that GPP is used by contracting authorities in procurement procedures in line with the policies in place. Therefore, the GPP officer acted as a gatekeeper for ensuring compliance with GPP criteria, by assessing whether each tender falls within the scope of GPP and, if so, whether the correct GPP criteria were adequately included. Since 2015, the responsibility for implementing GPP clearance corresponds to the GPP Coordinator based at and employed by each Ministry.

GPP clearance is required for all contracting authorities in Malta (Schedule 2, 3, and 16) before publishing procurement procedures whose estimated amount is above EUR 10 000 excluding VAT for Calls for Tenders and above EUR 5 000 excluding VAT for Calls for Quotations. (Department of Contracts, 2022[9]) Contracting authorities shall send a GPP clearance request to a GPP coordinator. The request should be submitted together with the procurement documents. Clarification is requested by a GPP coordinator when a non-compliance is identified. Failure to amend such requirements may lead to cancellation of the tender.

The GPP coordinator ensures GPP adherence and enhances GPP compliance. However, Figure 4.5. shows that the GPP compliance rate, which represent the procedures compliant with GPP criteria under the scope of GPP, is not close to 100%. In 2020, the GPP compliance rate was at 56% in terms of number of procedures and 45% in terms of financial value, and it has been decreasing since 2018. According to the 2020 GPP Monitoring Report, the non-compliance arises not only from mistakes but also from the intentional behaviour from contracting authorities to avoid using non- mandatory GPP criteria. Contracting authorities may opt to request for a less demanding product without GPP criteria in order to avoid the risk of low competition or receiving no bids that result in cancellation of tender.”. (Ministry for the Environment, Climate Change and Planning, 2021[7])

Furthermore, communication and approval process related to GPP clearance were carried out via e-mail between the GPP coordinator and the person in charge of the procurement procedure at the contracting authorities. Carrying out GPP clearance procedures through ePPS could enhance the efficiency of the process. Indeed, this could provide a real-time traceability of the clearance status, security of information, and direct access to the data by the DoC during the vetting process. It will also enable both DoC and the MECP to monitor GPP implementation (See section 6.4.1). Therefore, Malta could consider assessing the possibility to use ePPS for GPP clearance.

Enhancing and ensuring GPP uptake needs to be grounded in the regulatory and/or strategic public procurement frameworks. These frameworks should include several mechanisms to consider environmental criteria at different phases of the public procurement cycle. (See Figure 4.6. )

During the pre-tendering phase, considering environmental aspects in market analysis can enable contracting authorities to use the appropriate mechanisms (European Commission, 2016[11]). During the tendering phase, some concrete actions can include using selection criteria, which will allow bidders to comply with specific environmental requirements to participate in the tender process. Using award criteria encourages bidders to propose higher levels of environmental performance than the minimum requirement specified in the technical specifications. Using environmental labels allows contracting authorities to identify sustainable products or services and/or to use them as means of proof of compliance with the technical specifications. Labels can be used as criteria and technical specifications. Additionally, life cycle costing approaches (LCC) can complement this by evaluating the financial proposals while considering the total costs over the life cycle of a product, service or works including (i) purchase price and all associated costs (delivery, installation, insurance, etc.); (ii) operating costs, including energy, fuel and water use, spares, and maintenance (iii) end-of-life costs, such as decommissioning or disposal; and (iv) costs imputed to environmental externalities. Finally, contract performance clauses can also require the use of environmentally friendly materials and a monitoring system. (European Commission, 2016[11])

In Malta, the public procurement regulatory framework provides the possibility to use all these mechanisms. For instance, the Public Procurement Regulations (PPR) foresee provisions related to the use of labels (Article 54), life-cycle costing (Article 239 & 240), and environmental management standards (Article 234). Environmental criteria can be integrated into the technical specifications (Article 2), award criteria (Article 239) or contract performance (Article 245). Article 16 requires contracting authorities to take appropriate measures to ensure that during the execution of a contract, economic operators comply with the applicable obligations in the fields of environmental law established by European Union law, national law, collective agreements or by the international environmental provisions listed in Schedule 13 (List of International Social and Environmental Conventions). Article 199 refers to blacklisting an economic operator from participating in a procurement procedure in case of the violation of the laws/provisions specified in Article 16. (Government of Malta, 2016[12])

GPP National Action Plan (NAP) is the most relevant GPP strategic framework in Malta, providing also GPP guidelines. The 1st NAP (2012 -2014) was approved in November 2011 and came into force in January 2012. It defines GPP targets for 18 product and service groups for which common GPP criteria have been set at the European level. It has a combination of mandatory and non-mandatory GPP criteria. Mandatory criteria were set for 5 procurement categories: i) Copying and Graphic Paper, ii) Office IT Equipment, iii) Textiles, iv) Gardening Products and Services, and v) Cleaning Products and Services.

In June 2014, a Cabinet made the decision to enshrine GPP as a cornerstone of the Government’s green agenda, and set the target of 75% to progressively increase the share of GPP, as laid down in the Greening Economy Action Plan: Greening our Economy – Achieving a Sustainable Future.

In line with international good practices, the MECP carried out public consultation for the development of the 2nd NAP in 2019; all stakeholders, including contracting authorities, the private sector, civil society organisations were given the opportunity to provide their feedbacks. The 2nd NAP, launched in October 2021, is more ambitious than the 1st NAP and the Greening Economy Action Plan. It intends to cover a wider range of environmental objectives: (i) waste prevention and reduction, (ii) water availability, (iii) climate change, and (iv) energy efficiency. It sets the GPP uptake target to be met by 2027 at 90% through progressively increasing the share of GPP. It defines the target for 17 product and service groups. They included 6 new product and service groups: i) Electrical and electronic equipment used in health care , ii) Vending machines and hospitality catering, iii) Sanitary tapware, iv) Toilets and urinals, v) Road design, construction and maintenance and, vi) Office building design, construction and management. 14 of these 17 product and service groups are classified as mandatory. Only three product groups will retain their non-mandatory status: furniture, vending machines and electric & electronic equipment used in health care.

The ambition of the 2nd NAP goes beyond simply setting higher targets for the forthcoming years and giving mandatory status to additional product and service groups as well as introducing new GPP criteria for additional sectors. The 2nd NAP defines the following objectives to be accomplished by 2027 in order to achieve the vision for GPP and enhance the uptake and inclusion of GPP criteria within tendering processes:

  • To continuously engage economic operators, contracting authorities and other relevant stakeholders by providing necessary training through information sessions, workshops and established communication channels.

  • To facilitate GPP implementation by managing the GPP Helpdesk Facility and an interactive National GPP web-responsive application; www.gpp.gov.mt (conveniently accessible on mobile phones) enabling users to attain further knowledge on specific queries.

  • To increase awareness amongst economic operators and contracting authorities on the benefits of GPP which extend beyond the provision of services and products and instils an environmental conscience amongst the business community.

These objectives will be measured by the following key performance indicators every six-monthly basis:

  • Percentage of public tenders expressed in number of tenders and values in each product/service group

  • Number of training and information sessions held, number of participants attended, and a survey rating the training given

  • Frequency of meetings held with CAs, stakeholders and economic operators.

  • Number of requests received on the GPP generic email or through other channels and answered.

In addition to the NAP, other environmental policies aim at enhancing the uptake of GPP. For instance, the Waste Management Plan 2014-2020 had identified GPP as an instrument for creating resources from waste, a concept that is carried forward into the Long-term Waste Management Plan (2021 to 2030). (Ministry for the Environment, Climate Change and Planning, 2021[13]) This holistic approach to waste management demonstrates the relevance of GPP as mechanism for tackling environmental challenges. This approach reinforces the policy coherence with the 2nd NAP. Construction and Demolition Waste Strategy for Malta 2021-2030: Managing Construction & Demolition Resources, published in 2021, which sets re-use & recycling targets on excavated materials and construction materials for the construction of high-density residential developments. (Environment and Resources Authority, 2021[14]) Public service strategy, launched in November 2021, includes initiative No. 37 on Green Public Procurement Plans. It recognises that GPP plays a key role in promoting more environmentally friendly choices given the volume of public spending. (Office of the Prime Minister, 2021[15])

As already discussed, the 2nd NAP is more ambitious than the 1st NAP in terms of targets (90% for the share of GPP). In 2016, the MECP launched a survey to contracting authorities and economic operators in order to assess the effectiveness of the 1st NAP and their view of GPP. The result shows that the majority of participants (75%) indicated no significant difficulties in their experience with respect to the conditions imposed by the established GPP criteria. However, discussions with some interviewed contracting authorities highlighted that some targets of the 2nd NAP are quite ambitious and are perceived as difficult to be achieved. For instance, the target could be easily achieved for the transport category with the procurement of electric cars. However, for some specific products under the transport category such as specialised engines, this target could be difficult to reach. In addition, some contracting authorities mentioned that the market will have difficulties in adapting to the increased GPP requirements of the 2nd NAP. However, most Maltese enterprises are not manufactures but act as wholesalers. Thus, they could easily adapt to increased requirements through international manufacturers. To ensure the feasibility of all targets of the 2nd NAP, the MEEE should monitor the implementation of the 2nd NAP to identify eventual bottlenecks and challenges related to achieving its higher goals.

Regarding the GPP criteria, MEEE identified as challenges the fact that some EU GPP criteria are very technical and difficult to be understood by procurement officials at contracting authorities. Sometimes, the criteria can be understood only by officials with an engineering or technical backgrounds. However, in that case, the use of adequate labels could have the potential to alleviate this technical challenge. Article 54 of PPR allows contracting authorities to use eco labels for the environmental purpose. (Government of Malta, 2016[12]) Malta could consider the possibility of promoting the use of specific eco labels, when relevant, in each GPP criteria through the capability-building activities.

Different measures can reinforce the capability of procurement officials in using GPP criteria, including the provision of training, manuals and guidelines, help desks and standardised templates. (See Figure 4.7. ). Standardised templates are ready-to-use forms that contracting authorities can use to facilitate their work. The help desk is a contact point centre to assist contracting authorities and/or economic operators in clarifying their inquiries related to their daily tasks of public procurement. It represents an efficient tool to provide quick and tailor-made information. Developing a methodological assistance contributes to supporting procurement officials and economic operators to undertake the processes related to public procurement effectively, and it complements what is learnt through training courses. (OECD, Fothcoming[16])

In 2022, DoC issued the Contracts Circular No. 6 2022, Green Public Procurement: implications of the Second National Action Plan, in order to provide contracting authorities with the guidance on GPP (Department of Contracts, 2022[9]). The 2nd NAP can be considered as a comprehensive guideline of GPP. It provides the detailed GPP criteria for each product group. The 2nd NAP also includes the standardised template for contracting authorities to request for the GPP clearance procedure. However, discussions with contracting authorities highlighted that the 2nd NAP provides only general requirements and criteria for each product category which makes it difficult to apply for specific products. Currently, the MEEE has the plan to publish more detailed guidelines in respect to GPP specifications, verification documents, sample certification and other similar supplementary documentation. (Department of Contracts, 2022[9]) In this context, Malta could benefit from complementing the existing guidelines on GPP by adding concrete case studies and examples.

In terms of trainings, MEEE also provides a 5-hour GPP training through the IPS. This training course covers various GPP elements with practical case studies and a test:

  • What is GPP evolution of GPP in Malta

  • The 2nd National Action Plan

  • Understanding the GPP criteria

  • GPP in Practise

This GPP training was provided to 250 public procurement officials in 2021 (188 in 2018, 190 in 2019, and 60 in 2020 due to the Covid-19 pandemic). However, this GPP course is mandatory only to the GPP officers and one member of the Tender Evaluation Committee, and optional to procurement officials at contracting authorities. For reference, 61% of the ProcurCompEU survey participants carried out for this project have completed this course. Malta could consider the possibility of making the GPP training mandatory, and update the course module as the guidelines and manuals are revised with concrete case studies and examples.

Recognising the need to provide timely support and advice to contracting authority and economic operators, MEEE also operates the GPP Helpdesk since 2011. The GPP Helpdesk provides support via telephone, email, and the organisation of meetings. The helpdesk is committed to respond to questions or request within a period of 48-72 hours. Malta could consider the possibility of preparing responses to the frequently asked questions to publish them online as well as to update the manuals and the training module.

According to the 2020 GPP Monitoring Report, the MECP also launched GPP Mobile Application in 2021 which consist of a one-stop-shop for all GPP-related information such as: lists of GPP certified products, GPP publications, current GPP technical specifications, or for booking GPP training sessions, etc. Users are also able to communicate directly with the GPP office through the built-in chat function found in the app. It is expected to contribute to further increasing GPP compliance.

The OECD Recommendation calls upon adherent countries to employ appropriate impact assessment methodologies to measure its effectiveness (OECD, 2015[4]). Malta has a solid monitoring system of GPP implementation. Indeed, the role of the MEEE shifted from a purely vetting and screening role to one that is more focused on monitoring and training ( (Ministry for the Environment, Climate Change and Planning, 2021[8]). Contracting authorities were required to submit the weekly report to the GPP office through their GPP coordinator, in accordance with the template that includes the following information:

  • The date of tender publication

  • The details of the ministry and/or contracting authority publishing the tender

  • Indication of whether the tender falls under the scope of the GPP criteria

  • Indication of whether the tender is compliant or not (if all the applicable GPP criteria have been inserted the CA)

  • Indication of whether the tender can be classified as variant (this would be the case if the tender contains some GPP criteria but not all the applicable ones).

  • The tender or quotation title

  • The estimated budget of the tender or quotation

  • Indication of which GPP criteria are included in the tender

With the introduction of the GPP module on ePPS, a quarterly report is sent to the GPP office. This Office then assures the quality of the information reported in the quarterly report by verifying it with the actual call for tender actually published in the government gazette. Therefore, the GPP Office could identify tenders that were not reported in the quarterly report in a correct manner, and can request the GPP coordinator to follow up with the contracting authority. GPP coordinators at each ministry also submit a quality assurance report to the MECP on a quarter basis. This quarterly report shall include all GPP related information and data, including but are not limited to, vetted calls for quotations and calls for tenders, GPP clearances, GPP-related clarifications and / or rectifications.

DoC developed a GPP module on ePPS in collaboration with the MEEE in order to set up a real-time, comprehensive, and digitalised monitoring system through ePPS. This module that went live when the 2nd NAP became applicable aims at facilitating the GPP data collection from all contracting authorities which are obliged to answer to a set of questions in ePPS prior to publishing a tender document. These questions include the application of the scope of the GPP, information on the GPP criteria, and justifications in case of not including GPP criteria. Failure to do so would prohibit them from publishing tender, since the correspondent fields in ePPS are set as mandatory. (See Figure 4.8)

GPP module on ePPS is expected to increase the compliance of GPP criteria as well as facilitating the data collection on the implementation of GPP. Malta could benefit from communicating on the compliance of GPP criteria on a regular basis.

Public procurement can provide an enormous potential market for innovative products and services. Used strategically, public procurement can help governments boost innovation at both the national and local levels. Strategic use of public procurement for innovation (PPI) is defined as “any kind of public procurement practice (pre-commercial or commercial) that is intended to stimulate innovation through research and development and the market uptake of innovative products and services.” (OECD, 2017[17]). In other words, it refers to any procurement that has (i) buying the process of innovation – research and development services – with (partial) outcomes, and/or (ii) buying the outcomes of innovation. It brings various benefits including (i) boosting the post COVID-19 economic recovery, the green and digital transition and improving resilience, (ii) delivering higher quality public service on an optimal budget, (iii) addressing an arising need, (iv) modernising public services, (v) helping start-ups and innovative SMEs launch and grow, and (vi) moving markets towards innovation (European Commission, 2021[18])

In Malta, public procurement is still under-used as a strategic tool to stimulate innovation. As of the end of 2021, only two PPI procedures have been implemented by the Special Projects Unit within the Operations Directorate of the DoC on behalf of contracting authorities. (See Box 4.1)

PPI is under-used in Malta due to the absence of various elements that support a proper Procurement for Innovation strategy such as having a leading entity, an approved strategy, raising awareness, and the right capabilities accompanied by supporting tools. According to the EC study on the innovation procurement policy frameworks, Malta ranked 18th out of the 30 countries analysed (EU 27 Member States, UK, Norway and Switzerland) with the overall score of 20.4% in 2018, which is below the European average of 26.6%. (See Figure 4.9. ) The EC study pointed out the lack of many elements such as a national competence centre, action plan, spending target, monitoring system and systematic capacity building. (European Commission, 2021[19])

Discussions with contracting authorities in Malta highlighted that they are not familiar with the concept of procurement schemes to stimulate innovation such as innovation partnerships, and even not aware of its benefits. These findings are also supported by the result of the OECD survey to contracting authorities. (Figure 4.10). This section discusses these enabling factors to promote the use of PPI in Malta.

As mentioned in section 4.1.1, in order to advance the strategic use of any policy objectives, it is key to have in place a clear and coherent institutional framework to advance its implementation, irrespective of the entity leading the agenda. In Malta, no entity is leading the public procurement for innovation agenda. The mapping of stakeholders identified several relevant entities that could work together to advance the innovation agenda: Malta Council for Science and Technology (MCST), Malta Enterprise (ME) and the DoC. MCST was established with the specific scope of advising the government on science and technology policy. MCST is responsible for promoting the Research and Innovation (R&I) aspects in the local market, and champions R&I engagement across public, academic and private sectors. In addition, it also provides researchers, technologists and stakeholders with the necessary mentoring and support measures to translate innovative ideas into tangible products and/or services. R&I Programmes Unit of MCST manages national funds for R&I through the development and operation of R&I programmes. The ME is a national economic development agency. Its mandate is to attract new foreign direct investment and facilitate the growth of existing operations. It also provides incentives to assist Industrial Research and Experimental Development activities required by the industry with the scope of acquiring knowledge and skills in relation to innovation. This will in turn lead to the development of innovative products and solutions especially in sectors such as ICT, healthcare, aviation, maritime and manufacturing. In addition, the Special Projects Unit within the DoC provides contracting authorities with technical advice, assistance and guidance related to the implementation of complex procurement schemes such as innovation partnerships.

The example of Austria provides insights on institutional framework of PPI. In 2011, the Austrian Ministry of Economy, Family and Youth (BMWFJ), currently the Ministry for Digital and Economic Affairs (BMDW), and the Ministry of Transport, Innovation and Technology (BMVIT) took the role as the leading agencies to promote PPI, and in 2011 prepared an Austrian Action Plan on Public Procurement Promoting Innovation through the engagement processes with stakeholders such as the Austrian Federal Procurement Agency (BBG) the Austrian Institute of Technology (AIT). This action plan included initiatives such as the establishment of a competence centre in BBG as well as the implementation of pilot projects of pre-commercial procurement (PCP). The two Ministries are responsible for the political commitment, the strategic governance, and financing for the initiatives of the Action Plan. BBG serves as a competence centre and the AIT supports the other key actors providing scientific support. (The Ministry of Economy, Family and Youth (BMWFJ) and Ministry of Transport, Innovation and Technology (BMVIT), 2011[20])

The Maltese Government should assign the leading role on Procurement of Innovation to one entity and ensure coordination mechanisms with the other stakeholders

In 2018, about 70% of OECD countries had developed policies or strategies related to public procurement for innovation (OECD, 2019[5]). In Malta, no strategy with specific roadmaps to promote the implementation of PPI has been developed regardless of the availability of the regulatory frameworks of PPI, given the absence of a leading agency of PPI. This part overviews the regulatory frameworks and the strategy related to PPI in Malta.

Malta introduced the concept of PPI by transposing the EU Public Procurement Directives (Directive 2014/24/EU) into the Public Procurement Regulations (PPR). PPR foresees the procurement mechanism that can be used to stimulate innovations such as competitive procedure with negotiation (Articles 123-127), Innovation Partnership (Articles 128-139), competitive dialogue (Articles 140-149) and design contest (Articles 157-160). (See Box 4.2) Article 245 stipulates that contracting authorities may lay down conditions relating to the contract performance such as economic, innovation-related, environmental, social or employment-related considerations. (Government of Malta, 2016[12]) From the strategic viewpoint, PPI opens the door to higher quality and more efficient solutions that value environmental and social benefits, better cost-effectiveness; and new business opportunities for enterprises. (European Commission, 2021[18])

From the technical viewpoint, innovative procurement schemes help contracting authorities in overcoming challenges that they face in drafting technical specifications when they intend to procure innovative goods and services. Indeed, technical specifications are identified as the most commonly used measures by contracting authorities (See Figure 4.12. ). SPD also shared the same view that technical specifications are most often used by contracting authorities to procure innovative goods and services. However, the SPD considers that drafting technical specifications is the biggest weakness of contracting authorities when it comes to procuring innovative procurement.

The innovative procurement schemes such as pre-commercial procurement and innovation partnerships can contribute to solving this weakness. Article 130 of PPR stipulates that the contracting authority shall identify in the procurement documents the need for an innovative product, service or works that cannot be met by purchasing products, services or works already available on the market. In other words, the innovative procurement schemes such as innovation partnerships will allow contracting authorities to start their procedures by asking for innovative solutions for the problems they identify, without preparing detailed technical specifications, allowing the market to innovate.

In addition to these regulatory frameworks, some strategies related to innovation mentions the role of public procurement in stimulating innovation. National Research and Innovation Strategy 2020, published in June 2014, included the action line Embedding a culture for innovation, creativity, risk-taking and entrepreneurship in order to achieve a comprehensive R&I support ecosystem. (Malta Council for Science & Technology, 2014[22]) This action line recognised that public procurement plays a key role in generating increased demand for innovation. It also states that procurement for innovation generates considerable benefits in terms of leveraging private sector R&I and providing greener, innovative and potentially cost-effective, public services, although it is often more complex and time-consuming. Malta’s Smart Specialization Strategy (RIS3) 2021-2027, published in 2020, mentions the potential of public procurement for stimulating innovation in health sector, recognising that research and innovation in the health sector had to speedily rise to new challenges, realities and opportunities presented by the COVID-19 pandemic. (Malta Council for Science & Technology, 2020[23]) It also states that national funds can and should be tailored to provide support for public procurement of innovation. It recognises that there is very little use of PPI in practice regardless of the availability of this scheme and recommends that Malta should investigate the barriers preventing the public sector from utilising this method to incentivise innovation and promote its use, especially in the selected smart specialisation areas.

However, no more specific roadmaps are mentioned in these two strategies. For example, unlike the case of GPP specified in the 2nd NAP, no target is set on the uptake of PPI in terms of percentage of total public procurement (number of procedures and/or amounts), although ePPS provides the data on the procurement procedures related to PPI. Setting a target is a powerful way of expressing political mandate that can create strong institutional incentives for overcoming administrative inertia and risk aversion, as PPI requires a cultural shift not only among public buyers but also among the entire ecosystems such as economic operators, auditors, and academic sector (European Commission, 2021[18]). For example, the Finnish government set a target of PPI at 10 % of total procurement in order to increase competitiveness of the country. In order to achieve this target and further promote PPI, the Ministry of Economic Affairs and Employment of Finland published in 2020 the action plan for increasing the use of innovative public procurement, through a close stakeholder engagement process. (Ministry of Economic Affairs and Employment of Finland, 2020[24]) In Lithuania, the National Progress Plan (2021-2030), published by the Government of Lithuania in 2020, set a target of PPI at 5% by 2025 and 20% by 2030 with concrete actions such as the establishment of a national Lithuanian Innovation procurement competence centre. The Ministry of Economy and Innovation of Lithuania leads this strategic plan to promote PPI in collaboration with the Public Procurement Office. (The Government of the Republic of Lithuania, 2020[25])

In addition, there is no initiative led by the government to incentivise the use of PPI among contracting authorities such as the financial support and pilot initiatives. This leads to fewer incentives for contracting authorities to use PPI, in addition to the lack of supporting tools to be discussed in the next section. In Finland, contracting authority can apply for innovative public procurement funding provided through Business Finland in order to develop innovative solutions to reform services and operations. This funding can be used for a wide varieties of purposes: (i) planning and preparation (market mapping, definition of the procurement), (ii) tendering (e.g. a competitive negotiated procedure, innovation partnership), and (iii) co-development and piloting to develop an innovative solution with a chosen partner. (Business Finland, n.d.[26]) Poland has proven evidence as a catalyst and promoter of PPI through the implementation of pilot projects. National Centre for Research and Development (NCRD) of Poland, the agency in charge of ESIF R&I projects, initiated an e-Pioneer project financed under the ESIF Operational Programme "Digital Poland 2014-2020, under which the PCP scheme was used by beneficiaries to procure innovative solutions. This initiative contributed to encouraging a larger pool of interested contractors to participate in the ESIF R&I projects by using PCP. (See Box 4.3)

Malta could benefit from developing a comprehensive strategy / action plan to advance PPI such as defining the roles of key institutions and the incentive mechanisms (e.g. specific targets of the PPI uptake, financial support, and pilot initiatives).

Promoting the implementation of PPI shall be supported by the solid capability-building system. As already shown in Figure 4.10, both the OECD survey result to the selected contracting authorities and the perspective of the SPD identify the lack of trainings, the lack of capacity to implement this scheme, and the lack of guidelines as the three biggest barriers to the use of PPI by contracting authorities.

In Malta, several gaps have been identified in the capability-building system on this topic. First, no tailored guidelines and manuals are available for PPI. Currently, it is limited to the link of the DoC website to the Guidance on Innovation Procurement issued by the European Commission in 2018. Ideally, the guidelines and manuals could be developed by including, but are not limited to, the contents such as the regulatory framework of PPI, specific procedures, steps from the planning to the contract management, and actual case examples. For example, Malta could prepare the guidelines and manuals by adapting the manuals developed by the European Assistance For Innovation Procurement (EAFIP). (See Box 4.4) The Public Procurement Office of Poland published a manual for PPI called Public Procurement of Innovation. It describes the concept of public procurement for innovation, and demonstrates actual good practices from a wide range of contracting authorities in Poland including the central government administration, the local government entity, and the academic sector. (Public Procurement Office of Poland, 2020[27])

DoC offers a specific session within the specialised training programme (a Follow-Up Booster) through the Institute for Public Service (IPS), which has a duration of 4 hours and is mostly dedicated to the procurement procedures related to innovation, such as competitive dialogue and the innovation partnership. The Special Projects Unit of the DoC provides technical advice, assistance and guidance. Furthermore, the DoC can connect a contracting authority to seek guidance with another one that have already conducted similar procurement procedures.

Currently, Malta does not have a competence centre on innovation procurement, while countries like Finland and Germany have already set it up. A competence centre on innovation procurement is defined as an organisation/organisational structure that has been assigned the task by its government and has a mandate according to national law to encourage wider use of pre-commercial procurement (PCP) and public procurement of innovation (PPI) that includes among others providing practical and/or financial assistance to public procurers in the preparation and/or implementation of PCP and PPI across all sectors of public interest. (Procure2Innovate, 2020[30]) A competence centre is expected to contribute to reinforcing the capability through a wide variety of mandates to promote PPI (See Box 4.5).

For example, the Finnish Competence Centre for Sustainable and Innovative Procurement (KEINO), which acts as a competence centre and professional network for sustainable and innovative procurement, offers specific capacity building measures to public procurement professionals in the area of innovative procurement, such as issuing guidelines, disseminating best practises and case studies, and providing templates and tools. (See Box 4.6)

Malta could benefit from reinforcing the capability-building system of PPI by developing a practical manual and establishing a competence centre for innovation procurement.

Small and medium-sized enterprises (SMEs) play a vital role in the economy by representing large shares of employment and GDP. In 2021, SMEs accounted for 99.8% of the total enterprises in Malta, which is equal to the EU average (99.8%). They generated 71.9% of value added and 82.4% of employment, which exceeds the respective EU averages of 51.8% and 64.4%. (European Commission, 2022[32]) They play a critical role in the economy, in particular, in retaining and creating jobs in the post-COVID-19 era. Public procurement is a key area for SMEs development and performance, given the volume that it represents in the overall economy. (See Figure 4.13. ).

SMEs can be agents of innovation. (Aaron G. Grech, 2018[34]) They, in particular start-ups, are typically involved in R&D and innovative approaches, with a view to introduce new processes and products. They are also major contributors to achieving a sustainable recovery from the Covid-19 crisis and accelerating the twin green and digital transitions, while also creating new jobs. (European Commission, 2022[32]) Indeed, PPI can provide innovative SMEs with opportunities to meet the specific needs of the public sector to tackle these twin transitions (European Commission, 2015[35]).

According to the European Commission’s 2019 Small Business Act (SBA) fact sheet based on the data from the TED (Tenders Electronic Daily) of the EU, the majority of public procurement suppliers are SMEs. Indeed, 97.2% of the total contract value was awarded to SMEs in 2017. (European Commission, 2019[36]) This data echoes the result of the OECD survey sent to 14 contracting authorities which shows that the majority of contracts were awarded to SMEs.

Therefore, SME’s participation in public procurement is not identified as a big challenge by the government of Malta. However, promoting the strategic use of public procurement still requires the institutional framework as well as the provision of supporting tools for SMEs. This section discusses these enabling environments.

In Malta, the Ministry for the Economy, European Funds and Lands (MEFL) is responsible for promoting the development of SMEs. The MEIB Mission Statement states that the Ministry ‘is committed in its legislative, administrative and coordinating role to further and uphold a forward-looking Maltese economy that ensures stability and growth’. Since SMEs and family businesses are the backbone of the Maltese economy, MEIB encourages ‘growth and opportunities, catering for businesses at every stage of their life-cycle. In addition, the DoC is the entity in charge of the public procurement system (See section 1.1).

In line with the European public procurement directives, the Maltese procurement regulatory framework includes several provisions that enhance SMEs’ access to public procurement, such as the division of contracts into lots (Article 33 and 34) and subcontracting (Article 60). (Government of Malta, 2016[12]). In addition, the DoC has taken various measures to promote the SMEs participation in public procurement throughout the past years. These measures aim at decreasing the administrative burden for SMEs and decreasing the costs of participating in public procurement opportunities (See Box 4.7). In particular, it is worth noting that the bid bond is not required anymore. On the other hand, the performance guarantee is required for contract of all the categories above EUR 10 000 which could represent an administrative and financial burden for SMEs. In the United Stated, for example, Part 28 of the Federal Acquisition Regulation requires the performance bond (above USD 150 000) or alternative protection mechanisms such as the certificate of deposit (above 35 000 but below 150 000) only for the contacts related to public works. Performance bonds for non-construction contracts are required, although requesting for them is not prohibited. (General Services Administration, 2022[37]) In this context Malta could consider the possibility of assessing the impact of performance bonds on SMEs participation and, if relevant, increasing the threshold for requesting such bonds.

According to the SPD, the division of contracts into lots is the most common measure used by contracting authorities to enhance SME access to public procurement opportunities. In addition, SPD also pays attention to the subcontracting conditions during the vetting process.

Regardless of these measures, there are no official documents related to SMEs development such as strategies that refer to the role of public procurement in promoting SMEs development. This is attributable to the fact that promoting SMEs participation in public procurement is not given priority at the MEFL or DoC, considering that most of the contracts are awarded to SMEs. However, an SME Strategy for a sustainable and digital Europe, published by the EC in 2020, clearly mentions the role of public procurement in supporting SME development as well as the role of SMEs in bringing innovative solutions to achieve EU’s twin transitions to a sustainable and digital economy. (European Commission, 2020[39]) Therefore, Malta could benefit from an SME strategy that clearly mention not only the role of public procurement in promoting SMEs development but also the role that SMEs play in promoting innovative solutions through public procurement.

To enhance data monitoring on SMEs participation in public procurement, the DoC introduced in November 2020 an improvement in ePPS for companies to input their size. This will enable to gather comprehensive data on contracts awarded to SMEs and the participation of SMEs in public procurement opportunities which are key indicator to assess the performance of the procurement system.

Useful supporting tools help SMEs to participate in public procurement opportunities. Despite the measures taken to facilitate SMEs participation in public procurement, no dedicated supporting tools have been developed on SMEs access to public procurement for both suppliers and contracting authorities.

While no specific supporting tools have been developed for SMEs, economic operators including SMEs have access to the general guidelines in the website of DoC. They are also eligible to IPS trainings provided by DoC’s IT Unit, on ePPS. This training covers, among other things, the portal interface, searching for information, the use of the Tender Preparation Tool (TPT) and the uploading of the bid proposal.

From the contracting authorities’ perspective, the OECD survey shows that all the top three challenges of contracting authorities in using public procurement to promote SMEs participation are related to the capability: lack of supporting tools (trainings and guidelines) and lack of adequate capacity to undertake this procedure. (See Figure 4.14) In addition, the EC will issue guidance and support to contracting authorities to enhance opportunities for SMEs, according to the SME Strategy for a sustainable and digital Europe. (European Commission, 2020[39]) Under this context, Malta could consider the possibility of developing supporting tools to promote SMEs participation in public procurement and their role in bringing innovative solutions through public procurement.

This section briefly discusses the use of best price-quality ratio (BPQR) criteria and market analysis, which were already discussed in the Section 1.1.1 and 2.2.3, from the viewpoint of strategic procurement.

Encouraging the use of BPQR can constitute key elements to promote strategic procurement schemes including GPP and PPI. As the Section 2.2.3 discussed, only 3.2% of call for tenders (CfTs) used BPQR criteria on average in the last 3 years (2018-2020). In addition, life-cycle costing was never used in the said last 3 years, regardless of the fact that ePPS provides the functionality of using LCC as award criteria.

GPP criteria of each product group, defined in the 2nd NAP, consists of (i) subject matter (suggestion on how to draft the tender title), (ii) technical specifications, and/or (iii) award criteria (BPQC, LCC). GPP criteria of the 2nd NAP provides some examples of specific BPQR criteria for each product group. However, it is considered as optional, considering from the description “Award criteria (to be considered when BPQR is utilised,” (Ministry for the Environment, Climate Change and Planning, 2021[8])

As Figure 4.15. demonstrates, the OECD survey shows that award criteria (BPQR / LCC) is the least used measure by contracting authorities when implementing GPP, while technical specifications are the most-often used one which might contribute to the use of the lowest-price criteria. SPD also shared the same view that contract award criteria (BPQR and LCC) are least often used by contracting authorities to implement GPP and at the same time the biggest weakness of contracting authorities. The same indicator for PPI was 2nd in the OECD survey as shown in Figure 4.15. , but there was almost no difference among 2nd (award criteria) and 4th (object of contract) compared with 1st main measure (technical specification). This implies that promoting the use of BPQR criteria will contribute to increasing the uptake of strategic procurement such as GPP and IPP.

Austrian Federal Real Estate Agency demonstrates good practice in using BPQR criteria to carry out an innovation partnership to procure innovative solutions in the development of software of public building management. (See Box 4.8)

Carrying out market analysis prior to calls for tender contributes to enhancing the quality and reflecting the reality of the market. Almost all Maltese contracting authorities surveyed implement market analysis for every procurement procedure, while only a few do it on an occasional basis when necessary. Most of the contracting authorities associate the market analysis with its orthodox purposes such as obtaining the price quotation to estimate the value of procurement and/or drafting technical specifications which reflect what is available in the market. Only one contracting authority mentioned setting up the better price to quality ratio, and public market consultation for complex tender procedures. Market analysis will bring more added values when it is used for setting up better BPQR criteria rather than only obtaining the price quotations. Under the context of procurement procedures that seek innovative solutions, it is an essential process during the tender preparation to interact with potential economic operators in order to inform them of the needs of the public sector and hear initial feedbacks. It allows contracting authorities to find creative ideas from the market, define the conditions for solving the problem, create opportunities for market to work with the public sector, and measure its ability to take on the risk of innovation. (European Commission, 2021[18]) Thus, it will contribute to promoting the use of strategic procurement. For example, Austria developed the digital platform to facilitate the process of the market research and consultation by building a bridge between contracting authorities and potential suppliers. (See Box 4.9)

Therefore, Malta could consider the possibility of promoting the use of BPQR criteria and market analysis in order to increase the uptake of GPP and PPI.

References

[34] Aaron G. Grech (2018), SMEs’ contribution to the Maltese economy and future prospects, Central Bank of Malta, https://ideas.repec.org/p/mlt/ppaper/0118.html.

[26] Business Finland (n.d.), Innovative public procurement funding, https://www.businessfinland.fi/en/for-finnish-customers/services/funding/research-and-development/innovative-public-procurement (accessed on 17 August 2022).

[9] Department of Contracts (2022), Green Public Procurement - Implications of Second National Action Plan (Circulars 06 2022), https://contracts.gov.mt/en/Circulars/2022/Pages/Circulars2022.aspx (accessed on 12 August 2022).

[38] Department of Contracts (2015), Procurement Policy Note #22 The Performance Guarantee and the Single Bond (Single Performance Guarantee).

[21] Difi (2017), Strategic use of public procurement.

[14] Environment and Resources Authority (2021), Construction and Demolition Waste Strategy for Malta 2021-2030: Managing Construction & Demolition Resources.

[29] European Assistance for Innovation Procurement (eafip) (n.d.), Innovation procurement toolkit, https://eafip.eu/toolkit/ (accessed on 22 August 2022).

[32] European Commission (2022), SME Performance Review Annual Report 2021/2022, https://single-market-economy.ec.europa.eu/smes/sme-strategy/sme-performance-review_en#paragraph_887 (accessed on 16 August 2022).

[18] European Commission (2021), Guidance on Innovation Procurement, https://ec.europa.eu/docsroom/documents/45975 (accessed on 17 June 2022).

[19] European Commission (2021), The strategic use of public procurement for innovation in the digital economy, https://op.europa.eu/en/publication-detail/-/publication/7f5a67ae-8b8e-11eb-b85c-01aa75ed71a1 (accessed on 17 June 2022).

[39] European Commission (2020), An SME Strategy for a sustainable and digital Europe.

[31] European Commission (2020), “Study on professionalisation of public procurement in the EU and selected third countries”, https://op.europa.eu/fr/publication-detail/-/publication/400d4892-8542-11eb-af5d-01aa75ed71a1/language-en.

[36] European Commission (2019), 2019 SBA (Small Business Act) Fact Sheet Malta, https://ec.europa.eu/docsroom/documents/38662/attachments/20/translations/en/renditions/native (accessed on 15 February 2022).

[11] European Commission (2016), “Buying green! A handbook on green public procurement”, https://doi.org/10.2779/246106.

[35] European Commission (2015), Public procurement as a driver of innovation in SMEs and public services, https://op.europa.eu/en/publication-detail/-/publication/f5fd4d90-a7ac-11e5-b528-01aa75ed71a1/ (accessed on 16 August 2022).

[41] Federal Procurement Agency of Austria (BBG). (n.d.), IÖB Innovationsplattform, https://www.ioeb-innovationsplattform.at/ (accessed on 19 August 2022).

[37] General Services Administration (2022), Federal Acquisition Regulation, https://www.acquisition.gov/far/part-28#FAR_28_102 (accessed on 16 August 2022).

[1] Government of Malta (2021), Second Green Public Procurement Action Plan 2022-2027, https://environment.gov.mt/en/decc/Pages/environment/gpp/secondNap.aspx.

[12] Government of Malta (2016), Public Procurement Regulations, https://legislation.mt/eli/sl/601.3/eng/pdf (accessed on 15 February 2022).

[40] ICLEI European Secretariat (2021), Developing ICT solutions for smart and efficient building management: BIG, Winner of the 2020 Procura+ Outstanding Innovation Procurement in ICT award.

[23] Malta Council for Science & Technology (2020), Malta’s Smart Specialization Strategy (RIS3) 2021-2027, https://mcst.gov.mt/wp-content/uploads/2022/01/RIS3-Strategy-2020-2027.pdf (accessed on 15 February 2022).

[22] Malta Council for Science & Technology (2014), National Research and Innovation Strategy 2020.

[7] Ministry for the Environment, Climate Change and Planning (2021), Green Public Procurement Annual Monitoring Report 2020.

[13] Ministry for the Environment, Climate Change and Planning (2021), Long-term Waste Management Plan (2021 to 2030), https://environment.gov.mt/en/Documents/ministerialConsultations/longTermWasteManagementPlan.pdf (accessed on 15 February 2022).

[8] Ministry for the Environment, Climate Change and Planning (2021), Second Green Public Procurement National Action Plan 2022-2027, https://environment.gov.mt/en/decc/Pages/environment/gpp/secondNap.aspx (accessed on 14 February 2022).

[28] Ministry of Development and Technology of Poland (2022), State purchasing policy of Poland (2022-2025), https://digital-strategy.ec.europa.eu/en/news/poland-sets-targets-procurement-rd-and-innovative-solutions (accessed on 18 August 2022).

[24] Ministry of Economic Affairs and Employment of Finland (2020), The public procurement as an instrument in implementing society’s important development objectives -Action plan for increasing the use of innovative public procurement, developing services and promoting sustainable growth, https://tem.fi/documents/1410877/36553790/MEE_Action_Plan.pdf/eea428b3-a5c6-2207-5775-f595f0d5a404/MEE_Action_Plan.pdf?t=1600240171125 (accessed on 17 August 2022).

[2] OECD (2022), “Integrating responsible business conduct in public procurement supply chains: Economic benefits to governments”, OECD Public Governance Policy Papers, No. 14, OECD Publishing, Paris, https://doi.org/10.1787/c5350587-en.

[3] OECD (2021), Government at a Glance 2021, OECD Publishing, Paris, https://doi.org/10.1787/1c258f55-en.

[10] OECD (2021), Unlocking the Strategic Use of Public Procurement in Bratislava, Slovak Republic, OECD Publishing, Paris, https://doi.org/10.1787/d616e4d9-en.

[5] OECD (2019), Reforming Public Procurement: Progress in Implementing the 2015 OECD Recommendation, OECD Public Governance Reviews, OECD Publishing, Paris, https://doi.org/10.1787/1de41738-en.

[17] OECD (2017), Public Procurement for Innovation: Good Practices and Strategies, OECD Public Governance Reviews, OECD Publishing, Paris, https://doi.org/10.1787/9789264265820-en.

[33] OECD (2017), Small, Medium, Strong. Trends in SME Performance and Business Conditions, OECD Publishing, Paris, https://doi.org/10.1787/9789264275683-en.

[6] OECD (2015), Going Green: Best Practices for Sustainable Procurement, http://www.oecd.org/gov/ethics/Going_Green_Best_Practices_for_Sustainable_Procurement.pdf.

[4] OECD (2015), OECD Recommendation of the Council on Public Procurement, https://legalinstruments.oecd.org/en/instruments/OECD-LEGAL-0411.

[16] OECD (Fothcoming), “Towards the development of a comprehensive public procurement measurement framework”.

[15] Office of the Prime Minister (2021), Achieving a Service of Excellence: A 5-year Strategy for the Public Service.

[30] Procure2Innovate (2020), How to set up a competence centre for innovation procurement, https://procure2innovate.eu/fileadmin/user_upload/Documents/Procure2Innovate_HowtosetupacompetencecentreonInnovationProcurement.pdf (accessed on 18 August 2022).

[27] Public Procurement Office of Poland (2020), Public Procurement of Innovation, http://www.ccpg.com.pl (accessed on 16 April 2021).

[25] The Government of the Republic of Lithuania (2020), National Progress Plan for 2021-2030, https://e-seimas.lrs.lt/portal/legalAct/lt/TAD/c1259440f7dd11eab72ddb4a109da1b5?jfwid=-whxwii77y (accessed on 17 August 2022).

[20] The Ministry of Economy, Family and Youth (BMWFJ) and Ministry of Transport, Innovation and Technology (BMVIT) (2011), Austrian Action Plan Public Procurement Promoting Innovation, https://era.gv.at/policies/innovation-procurement/austrian-action-plan-public-procurement-promoting-innovation/ (accessed on 18 August 2022).

Metadata, Legal and Rights

This document, as well as any data and map included herein, are without prejudice to the status of or sovereignty over any territory, to the delimitation of international frontiers and boundaries and to the name of any territory, city or area. Extracts from publications may be subject to additional disclaimers, which are set out in the complete version of the publication, available at the link provided.

© OECD 2023

The use of this work, whether digital or print, is governed by the Terms and Conditions to be found at https://www.oecd.org/termsandconditions.