UNDP is committed to achieving workforce diversity in terms of gender, nationality and culture. Individuals from minority groups, indigenous groups and persons with disabilities are equally encouraged to apply. All applications will be treated with the strictest confidence.
UNDP does not tolerate sexual exploitation and abuse, any kind of harassment, including sexual harassment, and discrimination. All selected candidates will, therefore, undergo rigorous reference and background checks.
The project “Procurement Support Services to the Ministry of Health of Ukraine, Phase II” (2020-2022) funded by the Ministry of Health of Ukraine is a continuation of the Procurement Support Services to the Ministry of Health of Ukraine Project. Back in 2015, UNDP started procuring medicines and medicinal products on behalf of the Ministry of Health of Ukraine, as an emergency response and following a request of the government of Ukraine. This emergency temporary measure was designed to restore supply of medicines to Ukrainian citizens, which had been previously interrupted due to inefficiencies. The respective cost sharing agreement was signed at the end of 2015 and since then UNDP conducted procurement for 111 programmes for the 2015-2019 State Budget funds. In 2020-2021 under the MoH PSS, Phase II Project UNDP was entrusted with procurement of medicines for 14 programmes. The total budget for these budget cycles is USD 90 mln.
The overall goal of the Project is to support the implementation of the health reform in Ukraine through strengthening the medicine procurement capacity and enhancing the efficiency, effectiveness, transparency and accountability of the national healthcare procurement system, which ultimately will improve the quality, accessibility and affordability of health services. The specific objectives of the Project are:
I. To strengthen the capacity of the Ministry of Health of Ukraine to ensure transparency, accountability and effectiveness of the public procurement of medicines and other medical products.
II. To procure medicines and medical products for the national public health programme
III. To support the capacity building of the Ministry of Health in implementation the health procurement reform.
|Project/Outcome title||Procuremnt Support Services to the Ministry of Health of Ukraine, Phase II|
|Corporate outcome and output||Contributing Outcome (UNDAF/CPD, RPD or GPD):
UNDAF Outcome 3. By 2022, women and men, girls and boys participate in decision-making and enjoy human rights, gender equality, effective, transparent and non-discriminatory public services
CPD Output 1.1. Regional and local authorities have scaled up knowledge and skills to engage communities in planning, coordination, delivery and monitoring of public services provision.
|Project dates||Start||Planned end|
|November 2020||March 2023|
|Current Year Budget||USD 26,318,979.88|
|Project expenditure at the time of evaluation (without commitments)||USD 8,854,222.36|
|Funding source||MOH-UKR, donor 12562|
Please find more information about the project in its Project Document at https://open.undp.org/projects/00132175.
The Project follows a human-rights-based approach to programming under which policies, processes and planned activities are anchored in the system of rights and corresponding obligations established by international law and ensures gender-mainstreaming in all its components providing opportunities for equal participation of women and men in capacity building, advocacy and grant activities.
The cross-cutting topic of gender equality is also addressed through this project. Efficient procurement of medicine related to women’s and children’s health significantly contributes to promoting gender equality and women’s empowerment as women in Ukraine are primary caregivers for children and especially mothers of children with certain conditions, diseases or disabilities. The project ensures gender mainstreaming by working with women’s and patients’ organizations, preparing gender-sensitive analytical products, ensuring equal involvement of men and women both in expert and training work, promoting gender activities as part of the communication work and other actions.
Additionally, to the health reform challenges, Ukraine continues to have a concentrated HIV epidemic among key populations (including people who use drugs, sex workers, men who have sex with men, transgender people and prisoners). The HIV epidemic is characterized by a growing number of registered HIV cases in most regions of the country. The rapid assessment data of HIV service organizations report indicates growth of risk behaviour (especially in the collective centres for internally displaced persons, losses of prevention networks and increased use of drugs (including injecting). UNDP MoH PSS, Phase II Project contains a component related to HIV/TB response in Ukraine.
Also, in 2018 UNDP began implementation of the Sustainable Health in Procurement Project (SHiPP) in collaboration with Health Care Without Harm (HCWH), and funded by the Swedish International Development Agency, that aims to reduce the harm to people and the environment caused by the manufacture, use and disposal of medical products and by the implementation of health programmes. SHiPP is a four-year project aiming to promote sustainable procurement in the health sector, in the United Nations (UN) Agencies, and in key project countries through the reduction of toxicity of chemicals and materials in health products, the reduction of greenhouse gases in the supply chain and the conservation of resources. Project countries include Guatemala, Moldova, Ukraine, Tanzania, Vietnam, and Zambia. SHiPP is one of the components of MoH PSS, Phase II Project.
As currently MoH PSS, Phase II is in its phasing out stage, it is important to engage the national consultant to support international evaluator to assess the extent to which project objectives were achieved and contribute to future programming, policymaking and overall organizational learning with a focus on lessons learnt and best practice.
2. MAIN OBJECTIVE OF THE ASSIGNMENT
The major objective of the assignment is to provide support to independent international consultants in conducting a final evaluation of MoH PSS, Phase II implementation to assess the extent to which the project objectives were achieved, summarize the key results, lessons learned and best practices, analyse project’s relevance, effectiveness, efficiency, sustainability, and coherence, with a view to contribute to future adaptation, programming, policymaking and overall organizational learning by outlining recommendations for the next phase of UNDP’s health activities.
DESCRIPTION OF RESPONSIBILITIES/SCOPE OF WORK
The national consultant with work under the supervision and guidance of the Team Leader and in close cooperation with coordination of international consultant. She/he will assist in preparation for and the scheduling of meetings with project stakeholders, UNDP team, translation of documents and interpretation during the meetings, sourcing and compilation of relevant documents for the evaluation and support the evaluation team in the creation of the deliverables of the evaluation effort as described below.
The key products expected to be produced by the evaluation team is a comprehensive evaluation report (up to maximum 25-30 pages without annexes, single spacing, Myriad Pro font, size 11) with key findings and a maximum of 7 key actionable recommendations. The evaluation report should include, but is not limited to the following components:
In addition to a final evaluation report, the executive summary on the key findings, lessons learned and best practices and recommendations (no more than 5 pages long) has to be produced by the evaluation team.
The evaluation at a minimum will cover the OECD-DAC evaluation criteria of relevance, effectiveness, efficiency, sustainability and coherence. The evaluation team should also address how the Project applied the human rights-based approach and mainstreamed gender in development efforts. The evaluation should be conducted in accordance with the guidance, rules and procedures established by UNDP and as reflected in the UNDP Evaluation Policy.
Specifically, it will cover (but not be limited to) the following areas and questions:
The report will examine the extent to which the project is relevant to the:
Focus and cross-cutting issues, such as HRBA and gender should be carefully evaluated and be integrated across the evaluation.
The final list of evaluation questions and tools to be proposed by the evaluation team and agreed with UNDP in an Inception Report.
Recommendations on the cost efficiency assessment.
As part of the evaluation exercise, an efficiency assessment on the procurement of medicine and medical products needs to be conducted. This scope of activities foresees:
The scope of the final evaluation will cover all activities undertaken in the framework of the Procurement Support Services to the MOH, Phase II Project.
The evaluation must provide evidence based and transparently obtained information that is credible, reliable and useful. The evaluation will need to use mixed methods and tools to ensure that data gathering and analysis deliver evidence-based qualitative and quantitative information, based on diverse sources: desk studies and literature review, cost-benefit analysis, individual interviews, surveys and direct observation. This approach will not only enable the evaluation to assess causality through quantitative means but also to provide reasons for why certain results were achieved or not and to triangulate information for higher reliability of findings. The national consultant is expected to follow a participatory and consultative approach ensuring close engagement with government counterparts, CSOs, international partner organisations, UNDP Country Office and Project team.
An evaluation of Project efficiency will be carried out against targets set out in the Project Logical Framework/ Results Framework, which provides performance and impact indicators for Project implementation along with their corresponding means of verification. It is suggested that the evaluation should use a mixed method approach – collecting and analyzing both qualitative and quantitative data using multiple sources in order to draw valid and evidence-based findings and conclusions and practical recommendations. All data provided in the report should be disaggregated by sex and other social variables, where possible.
The evaluation team will also identify lessons learnt and best practices from the Project which could be applied to future and other on-going UNDP interventions.
The conclusions should be comprehensive and balanced, and highlight the strengths, weaknesses, challenges and significant outcomes and outputs of the Project. They should be well substantiated by the evidence and logically connected to the final evaluation findings. They should respond to key evaluation questions and provide insights into the identification of and/or solutions to important problems or issues pertinent to Project beneficiaries, UNDP and MoH PSS, Phase II.
The final evaluation methodology and approach to be discussed and agreed with UNDP shall include, as a minimum, the following elements / sources of information:
a) The original project documents, databases monitoring reports, action plans, M&E frameworks, assessments, and financial documents (such as the cost-sharing agreement with MoH);
b) Notes from meetings involved in the projects (such as board meeting minutes);
c) Other project-related material produced by the projects (such as datasets, publications, audio-visual materials and consultancies reports).
For each of these key informant interviews, the national consultant is encouraged to develop and present his/her ideas for the content and format of the interview forms (e.g. interview guides defining the structure of future interviews and key proposed questions to be asked) that will be applied to capture the information required, as well as the method to be used in administering them and tabulating the results.
The Evaluator should provide the following deliverables:
|Deliverable #||Task description||Timing|
|Deliverable #1||Support, in close cooperation with and coordination of international evaluation consultants, desk research of the PSS MOH, Phase II Project core documentation (cost-sharing agreements, project documents, databases, annual work plans and progress reports, project implementation plans, board meeting minutes, etc.), including translation, sourcing and consolidation of materials as requested. The set of documents to be reviewed will be prepared by UNDP.
Support with the development of an evaluation methodology and strategy to collect the required information, plans and forms for the interview with partners and counterparts, as well as the questionnaire for a beneficiary satisfaction survey.
Output: the inception report (10-15 pages), including workplan and evaluation schedule (with detailed description of the methodology and evaluation matrix) is produced; annotated structure of the report is developed; a toolkit for gathering information (questionnaire and interview plans, a questionnaire for a beneficiary satisfaction survey) is designed. All documents are submitted to UNDP for final approval.
|5 days, by 15 December 2022|
|Deliverable #2||In close cooperation and coordination of international consultants, provide organisational/ logistics support with scheduling and conducting (online and/or face-to-face) necessary consultations and interviews with the UNDP/ project staff and partners. Provide interpretation and support with taking notes of the interviews/ meetings.
Output: Debrief on the preliminary findings of the evaluation. Discuss observations, lessons learned, best practices and early recommendations in a triangulation workshop with Project team and relevant UNDP CO staff (can be done on-line).
|10 days, by 13 January 2023|
|Deliverable #3||Support data collection and management and perform other tasks as assigned by Team Leader to contribute to a draft report of the evaluation with key findings and a maximum of 7 recommendations. The report should be evidence-based and cover all items detailed in the paragraph #3 of the present TOR with definition of the lessons learned and best practices.
Output: draft of the report produced and submitted for UNDP comments and agreed with Donors and Key Stakeholders (UNDP review will take up to 10 days). Tables of baselines, tables of the unit costs of the same medicine products procured by state or nonstate agents, and tables with calculations submitted to UNDP.
|7 days, by 27 January 2023|
|Deliverable #4||Support with processing and integration of comments from UNDP into the final version of the evaluation report, producing audit trail detailing how comments, questions and clarifications have been addressed
The key product expected is a comprehensive evaluation report (up to 40 pages without annexes, single spacing, Myriad Pro font, size 11), which includes, but is not limited to, the following components:
The detailed structure of the final report should be agreed with UNDP and reflect all key aspects in focus.
Output: Final evaluation report containing evaluation audit trail, as well as all required annexes indicated in the paragraph #3 of the present TOR, submitted to UNDP for final review and approval.
|5 days, by 10 March 2023|
|Deliverable #5||Together with international consultants support preparation of a detailed PowerPoint presentation of the evaluation study (in English) and presentation of the results during the meeting between UNDP and MOH, in Kyiv, Ukraine (can be arranged online depending on the epidemiological situation).
Should the simultaneous translation be needed for the presentation, it will be provided by UNDP. Consultations regarding UNDP expectations from the presentation will be held with the Contractor prior to the event.
Output: PowerPoint presentation prepared and delivered during the joint meeting of interested parties (to cover major findings and lessons learned from the evaluation as defined in section 3 of this TOR, with diagrams/pictures, where applicable).
|3 days, by 17 March 2023|
6. IMPLEMENTATIONS arrangements
The detailed schedule of the evaluation and the length of the assignment will be discussed with the evaluator prior to the assignment. The duration of the assignment is 30 working days (December 2022 – March 2023).
A team of three independent consultants will conduct the evaluation – one international team leader (with experience and practice of participation in projects and evaluations in other regions of the world and knowledge of health governance), one international expert (with expertise in public procurement), supported by national evaluation assistant.
Evaluation manager will review and approve inception reports including evaluation questions and methodology, review and comment on evaluation report, circulate draft evaluation report, collect and consolidate comments and share with the Evaluator for finalization of the evaluation report. The satisfactory completion of each of the deliverables shall be subject to the endorsement of the UNDP Evaluation Manager.
The evaluation team will be supported by the Evaluation Focal Team (EFT) comprising of representatives of UNDP Ukraine (Health Programme Specialist, UNDP Democratic Governance Analyst, and relevant project staff). The EFT will assist in providing the available documentation for the analysis and research, setting up the meetings with partners and external actors connecting the evaluation team with the regional partners and key stakeholders, arranging field visits, identifying key partners for interviews.
The evaluation team will inform UNDP of any problems, issues or delays arising during the implementation of the assignment and take necessary steps to address them.
The key product expected is a comprehensive evaluation report (with parameters indicated above). The report must be as free as possible of technical jargon in order to ensure accessibility to its wide and diverse audience. The report should be in line with UNDP’s principles of gender-responsive communication and should be prepared in English.
All reports and results are to be submitted to the UNDP in electronic form (*.docx, *.xlsx, *.pptx, and *.pdf or other formats accepted by UNDP).
This evaluations will be conducted in accordance with the principles outlined in the United Nations Evaluation Group (UNEG) ‘Ethical Guidelines for Evaluations’.
The consultant must safeguard the rights and confidentiality of information providers, interviewees and stakeholders through measures to ensure compliance with legal and other relevant codes governing collection of data and reporting on data. The consultant must also ensure security of collected information before and after the evaluation and protocols to ensure anonymity and confidentiality of sources of information where that is expected. The information knowledge and data gathered in the evaluation process must also be solely used for the evaluation and not for other uses with the express authorization of UNDP and partners.
Evaluation consultants will be held to the highest ethical standards and are required to sign a pledge of ethical conduct upon acceptance of the assignment.
The evaluators selected should not have participated in the project preparation and/or implementation and should not have conflict of interest with project related activities.
The consultants must also agree to hold in trust and confidence any information or documents (“confidential information”) disclosed to them or discovered by them or prepared by them in the course of or as a result of the evaluation and agree that it shall be only used for the purposes of this evaluation and shall not be disclosed to any party without UNDP approval.
Applicants shall submit the following documents:
|Letter of interest/proposal,;|
|Professional Resume CV and P11|
|Financial proposal (according to defined deliverables);|
Lump sum contract
The financial proposal shall specify a total lump sum amount in USD, and payment terms around specific and measurable (qualitative and quantitative) deliverables (i.e. whether payments fall in instalments or upon completion of the entire contract). Payments are based upon output, i.e. upon delivery of the services specified in the TOR. In order to assist the requesting unit in the comparison of financial proposals, the financial proposal will include a breakdown of this lump sum amount (including travel, per diems, and number of anticipated working days).
All envisaged travel costs will be paid separately according to UNDP rules and procedures and should not be included in the financial proposal. This includes all travel to join duty station/repatriation travel. In general, UNDP should not accept travel costs exceeding those of an economy class ticket. Should the Individual Consultant wish to travel on a higher class he/she should do so using their own resources. In the case of unforeseeable travel, payment of travel costs including tickets, lodging and terminal expenses should be agreed upon, between the respective business unit and Individual Consultant, prior to travel and will be reimbursed.
Maximum available technical score – 70 points.
Contract award shall be made to the incumbent whose offer has been evaluated and determined as:
a) responsive/compliant/acceptable, and
b) having received the cumulative highest score out of a pre-determined set of weighted technical and financial criteria specific to the solicitation.
* Technical Criteria weight: 70%
* Financial Criteria weight: 30%
Only candidates obtaining a minimum 70% from the maximum available technical score (49 points) would be considered for the Financial Evaluation
The maximum number of points assigned to the financial proposal is allocated to the lowest price proposal and will equal to 30. All other price proposals will be evaluated and assigned points, as per below formula:
30 points [max points available for financial part] x [lowest of all evaluated offered prices among responsive offers] / [evaluated price].
The proposal obtaining the overall cumulatively highest score after adding the score of the technical proposal and the financial proposal will be considered as the most compliant offer and will be awarded a contract.