External evaluator

The Algemene Rekenkamer is looking for a candidate that can perform an external evaluation of the Sharaka-II programme we are carrying out with Arab Supreme Audit Institutions. As Sharaka-II is a multiyear cooperation programme (2021-2026), the evaluation will result in several reports. The engagement concerns an mid-term evaluation of the regional cooperation projects and of the bilateral cooperation with SAI Libya and a final evaluation of all cooperation projects.

Context

The Sharaka-II programme consists of three successive regional projects and three bilateral cooperation projects. Its aim is to strengthen good governance, effective public service and robust financial management. In the Sharaka-II programme we are working with seven SAIs in the MENA region (Middle East, North Africa): Algeria, Iraq, Jordan, Libya, Morocco, the Palestinian Territories and Tunisia.

The first regional project has already been completed (June 2022 – June 2023). It involved a parallel performance audit relating to the sustainable development goals (SDGs), more specifically to SDG 11 (sustainable cities and communities). The Kick-off Conference for the second regional theme was held in Rabat, Morocco, in January 2024. This second regional theme will include parallel performance audits of SDG 6 (clean water and sanitation) and SDG 13 (climate action). A Mid-term Conference will be held in The Hague in October 2024. Completion of the second regional theme is planned for Q1 2025. A third regional theme will then be launched. The topic is still to be decided. Completion of this third regional theme is expected at the end of Q2 2026.

Besides the regional projects, the Sharaka-II programme includes three bilateral cooperation projects, with Algeria, Libya and Morocco. These projects consist principally of intensive, one-on-one knowledge-sharing, advisory work and audit support (specifically for performance audits). The bilateral projects cover a variety of themes, such as facilitating and organising training courses regarding audit of government policy (performance audits), communication and stakeholder relations, setting up internal training programmes and integrity training. These themes are agreed in consultation with the Arab partners based on needs analysis. About half of the regional activities have already taken place as we are at the mid-point of the second regional project. Planning of the bilateral cooperation differs from country to country. The bilateral cooperation with Algeria to support performance audit is nearing completion. The cooperation on communication and stakeholder relations is progressing according to plan. Cooperation on quality control and quality assurance is slightly behind schedule and is still at an early stage. The bilateral cooperation with Libya to support performance audit has been completed. Cooperation on integrity is progressing as planned. The communication and stakeholder relations component will begin in Q1 2025. This bilateral cooperation is expected to be completed in mid-2026. The bilateral cooperation with Morocco relates to training of trainers and IT audit/data analysis and will start this Autumn. Communication and stakeholder relations cooperation is on schedule. The bilateral cooperation with Morocco is expected to be completed by the end of 2025.

Activities

Planning of the bilateral projects is not standardised. This was a deliberate decision but requires a tailored approach to ensure the consistency of the evaluation findings and lessons.

A mid-term evaluation report of the bilateral cooperation with Algeria and Morocco is not required. Final evaluation reports were prepared for the cooperation with them during the Sharaka-I programme (2016-2021). They should be used as a reference framework for the final evaluation of the bilateral cooperation with these two countries.

The current engagement therefore consists of six reports to be issued as follows: 

  • Report 1: a final evaluation of the bilateral cooperation with Algeria; 
  • Report 2: a mid-term evaluation of the bilateral cooperation with Libya; 
  • Report 3: a final evaluation of the bilateral cooperation with Libya; 
  • Report 4: a final evaluation of the bilateral cooperation with Morocco;
  • Report 5: a mid-term evaluation of the regional cooperation;
  • Report 6: a final evaluation of the regional cooperation.
The evaluator will be responsible for the organisation, performance, and reporting of the evaluation. The evaluator will prepare a project proposal setting out the applicable approach, criteria, and methodology. It will in any event include analyses of project proposals (including intended goals, activities and output results), workshop programmes, work reports, and other documents, and analyses of internal evaluations, interviews and/or surveys with relevant respondents, and baseline and outcome measurements. The final agreed findings will be presented with conclusions and recommendations/lessons in a series of final reports. For each report, the evaluator will be asked to give a presentation of the outcomes.

A terms of reference will be drawn up before the engagement is awarded (model terms of reference are enclosed). They will lay down the specific goals, criteria, and agreements for the evaluation. An activity will be organised in The Hague from 14-18 October where initial talks can take place in person. The engagement must be formalised by 30 September.

Evaluation criteria

Evaluation must meet at least the OECD-DAC criteria and cover the following aspects:

1. Relevance
2. Coherence
3. Effectiveness
4. Efficiency
5. Impact 
6. Sustainability

These criteria are described in detail at: http://www.oecd.org/dac/evaluation/daccriteriaforevaluatingdevelopmentassistance.htm

Certain specific issues also need to be addressed.
  • Describe the institutional position and capacity of the Sharaka partners as a baseline from which to measure the programme’s development in the period evaluated.
  • Assess the extent to which the project has met its stated objectives, taking into account the broader context within which the SAIs operate.
  • Assess the added value and impact of the project in terms of strengthening good governance, accountability, public financial management and effectiveness of public services in the participating countries.
  • Assess the sustainability of the project outputs and outcomes, and identify the key risks that might prevent a Sharaka partner continuing with its institutional development programme. To what extent can institutional development be continued without the support of the donors and the NCA as institutional partner? How high is the ownership of results?
  • Assess the project design and implementation (relevance, effectiveness and efficiency), including an assessment of the level of ambition and the effectiveness of different working methods and different forms of support, i.e. peer-to-peer cooperation, working visits to the Netherlands, the kick-off and mid-term review meetings, the nomination of ‘ambassadors’, etc.

Location of the activities

The activities will take place in both the Netherlands and the countries concerned. The actual location will be decided in consultation with the evaluator.

Required experience/expertise 

  • Knowledge and experience of the public sector and supreme audit institutions, especially in an international context.
  • Experience working in the MENA (Arab) region.
  • Knowledge of the international standards of Supreme Audit Institutions.
  • Demonstrable experience evaluating peer-to-peer cooperation in the public sector in an international setting.
  • Broadbased knowledge and experience measuring the effectiveness of capacity building, knowledge transfer and change management (in a fragile context).
  • Capable of making qualitative assessments with practical advice based on analyses of situations that are difficult to measure quantitatively.
  • Excellent written English: documents and reports must also be sent in English to partner institutions and donors (Ministry of Foreign Affairs, Netherlands Enterprise Agency).

The procedure

Experience and expertise that are specifically requested must be demonstrated by a CV, references, and reports on previous projects. Award procedure The Netherlands Court of Audit will award the engagement based on the above criteria and requirements, taking account of the project proposal submitted for the evaluation (with references) and budget.

  • Deadline is 11 september at 09:00.
  • The interviews will take place between 16 - 20 september.
  • Per supplier you can offer a maximum of two CV's. 
  • Candicates can only be offered through our system esd.next. We do not accept CV's by e-mail. 
    • CV's must be included with:

      • Hourly rate
      • availability of the candidate
      • Place of residence
      • E-mailaddress
      • Start date
      • Planned vacation within 3 months


    It is not permitted to introduce employees who are employed by another agency. The customer wants to conclude hiring assignment with the shortest possible chain, preference is for an employed employee or a freelancer without the intervention of an agency.

    When a freelancer is offered through an agency, the freelancer will be contracted directly and we will conclude a margin agreement with the agency.

    The Supplier agrees that after 1850 hours, the agency margin will expire and the hiring assignment will be concluded immediately with the freelancer without a non-competition clause, non-solicitation clause or other clause being imposed on an external party.

    The hourly rate of the freelancer and the agency margin are stated (margins higher than 15 euros are not accepted). If a freelancer is proposed through an agency, this must be clearly stated in the proposal.

Deze vacature is ingetrokken op 11-9-24 om 09:56. Reageren is niet meer mogelijk.
Toch opzoek naar iets anders? Bekijk onze andere vacatures.

Contactpersoon

Vragen over de opdracht?

Delen