Evaluation Consultant – Montreal (Job Number: 22012)

negotiable / YEAR Expires in 2 days

JOB DETAIL

The Organizational Setting

The mandate of the Office of Internal Oversight (OIO) is to assist the Secretary General in ensuring that ICAO is managed effectively, efficiently and economically and in conformity with the applicable regulations and rules, and to provide him/her with independent and objective assurance, advice, insight and foresight through performing internal audits, evaluations, and other oversight assignments. OIO assesses and contributes to the improvement of governance, risk management, and control processes; and to the improvement of programme management and achievement of results, using a systematic and disciplined approach that ensures accountability for the effective and efficient use of organizational resources in accordance with the approved Budget and Business Plan.

Evaluation is mainly focused on assessing the relevance, coherence, effectiveness, efficiency, impact and sustainability of projects, programmes, policies and strategies against established plans and objectives. Internal audit ensures that a system of cost-effective governance and risk management processes, and corresponding internal controls has been established to mitigate potential risks to the Organization, to ensure compliance with policies, regulations, rules and administrative directives, and to ensure accountability for the proper, efficient and economical use of resources, consistent with organizational objectives and applicable best practices.

Major duties and Responsibilities

Under the general guidance of the Chief, Office of Internal Oversight (OIO), and reporting to the Evaluation Specialist, the evaluation consultant will assess the Regional Portfolio of the Eastern and Southern African (ESAF) and the Comprehensive Regional Implementation Plan for Aviation Security and Facilitation in Africa (AFI SECFAL PLAN), conduct analysis of findings, and produce evaluation reports with practical recommendations. The overall objective of the evaluation is to examine the relevance, coherence, effectiveness, and efficiency of ICAO’s support to the Civil Aviation Authority in the Region, identify lessons, best practices, and provide recommendations for improvement, as appropriate. The consultant will conduct the evaluation in line with the Norms and Standards for Evaluation in the United Nations System approved by the United Nations Evaluation Group (UNEG) in April 2016.

Function 1 (incl. Expected results)

Develop and finalize the drafts Inception report and tools. 

The Inception report will provide evidence‐based information that is credible, reliable, and useful. The evaluation consultant is expected to develop inception report and data collection tools in line with the Evaluation TOR under the supervision and in consultation with the evaluation specialist and key stakeholders both in Montreal and the Regional Office.

Function 2 (incl. Expected results)

Collects and analyses data for the evaluation. 

The Evaluation Consultant will review all relevant sources of information, such as the Business Plans, ESAF Regional Office Operating Plans, AFI SECFAL PLAN project documents, Global Plans, Regional aviation safety, air navigation and security and facilitation plans and programmes, plans, projects, reports, etc., and any other materials that the Consultant considers useful for this evidence-based assessment. A list of documents will be provided to the Consultant. In addition, the Evaluation Consultant, with the support of the Evaluation Specialist, will:

  • Collect data from existing ICAO information systems;
  • Collect data and information through face to face and virtual interviews and surveys as well as other data collection methods from ICAO Headquarters, Regional Office, Stakeholders in the regions;
  • Prepare summary interview notes;
  • Analyze data/information and perform technical quality assurance of the interpretation of the results of such analyses; and
  • Prepare and present initial findings in Power Point.
Function 3 (incl. Expected results)

Develop conclusions and actionable recommendations and draft Evaluation Report. 

The report should be prepared and presented following the guidance document clearly responding to the evaluation questions under each criterion. The consultant, with the support from the evaluation Specialist will:

  • Prepare the draft report following the evaluation report outline and the TOR;
  • Collect and analyze comments received during the briefing and address them as necessary;
  • Submit final Evaluation Report.
Function 4 (incl. Expected results)

Performs other related duties, as assigned

Result of Service
  • Inception report – draft and final
  • Summary Interview Note of all the meetings/interviews
  • PowerPoint presentation of preliminary findings, conclusions, and recommendations – Draft and final
  • Evaluation reports – draft and final
QUALIFICATIONS AND EXPERIENCE
Educational background

An advanced level university degree (Masters’ degree or equivalent) in an aviation-related field, evaluation, economics, engineering, business management, social science or any other related field, is required. A first-level university degree in combination with additional years of qualifying experience may be accepted in lieu of the advanced university degree.

Advertisement
Professional experience and knowledge

Essential:

  • A minimum of 10 years of professional experience in evaluation, specifically in evaluating projects and programmes, is required;
  • Experience in project management, is required;
  • Familiarity in dealing with State Representatives as well as governmental and non-governmental entities at different levels, is required;
  • Sound knowledge of RBM systems and strong Monitoring and Evaluation (M&E) experience, and M&E approaches (including quantitative, qualitative and participatory), information analysis and report writing, is required;
  • Knowledge and experience of the UN System, is required;
  • Experience in using UNEG Norms and Standards for evaluation, is required;
  • Excellent communication and interview skills, is required;
  • Excellent report writing skills, is required;
  • Demonstrated ability to deliver quality results within strict deadlines, is required.

Desirable: 

  • Experience in evaluating aviation related projects in Africa, is desirable;
  • Extensive knowledge of and experience in the management and implementation of aviation programmes and projects at international, regional or national levels, is desirable;
  • Thorough knowledge of the Convention on International Civil Aviation, ICAO Standards and Recommended Practices (SARPs), is desirable;
  • Experience working at a management level or in an advisory capacity in areas related to aviation safety and air navigation, is desirable.
Language Skills

Essential

•      Fluent reading, writing and speaking abilities in English and French, is required.

Desirable

•      A working knowledge of a second language of the Organization (Arabic, Chinese, Spanish or Russian), is desirable.

Conditions of Employment

Evaluation consultants will be held to the highest ethical standards and are required to sign a Code of Conduct upon acceptance of the assignment. This Evaluation shall be conducted in accordance with the principles outlined in the UNEG ‘Ethical Guidelines for Evaluations’.

The selected consultant is expected to be employed within the period of 15 December 2024 – 30 May 2025, up to a maximum of 50 working days.

Montreal, Canada