Terms of Reference

for the Final External Evaluation of the project

“Emergency Assistance for People forcefully displaced from Nagorno-Karabakh”

(EA28/2023 – Armenia – RR)

1. BACKGROUND AND DESCRIPTION OF HE PROJECT

After the large-scale offensive unleashed by Azerbaijan against the people of Artsakh (aka Nagorno-Karabakh – NK) on 19th September, 2023 in blatant violation of the international law and Trilateral Statement of November 9, 2020, around 101,800 people were displaced from NK and found refuge in the Republic of Armenia.

The Government of Armenia has assumed responsibility for assisting displaced people and has implemented a strategy whereby all INGOs and local NGOs operate in coordination with the government through the Ministry of Labour and Social Affairs (MLSA). This strategy is designed to prevent duplications and maximize the impact of initiatives across the board.

Additionally, UN Agencies in Armenia have reactivated the coordination mechanism initially established in 2020 for partners on the ground. This includes the revitalization of working groups focused on areas such as Cash, Protection, Shelter/NFI, Healthcare, and Early Relief. These efforts are aimed at enhancing collaboration and synergy among stakeholders to better address the needs of communities and individuals affected by various challenges.

The needs of registered displaced individuals have been assessed through the online platform of the MLSA. Simultaneously, a comprehensive donor mapping exercise has been conducted to identify all potential resources that could support the government’s response to this humanitarian crisis

Displaced households typically comprise six members, encompassing parents, children of all ages, and sometimes grandparents. As of October 2023, displaced people in Armenia were in urgent need of assistance to access sufficient food, hygiene items, bedding, and warm clothing. Furthermore, the wounded, elderly, and pregnant women required medical support, while many individuals were also in need of psychosocial assistance to address the emotional toll of their displacement.

Armenian Caritas is a part of UN working groups demonstrating its commitment to collaborative efforts in addressing humanitarian needs. Moreover, AC has joined the Armenia Refugee Response Plan (RRP) – October 2023-March 2024 that was launched by UNHCR in October 2023. RRP brings together 60 partners, including 43 national NGOs, and covers relief efforts for a six-month period, until the end of March 2024.

Based on the gaps and needs identified during the UN Working Groups’ meetings, bilateral meetings with MLSA and non-state stakeholders as well as based on conflict-affected families’ expressed needs Armenian Caritas launched the EA28/2023 – Armenia – RR “Emergency Assistance for People forcefully displaced from Nagorno-Karabakh” project with support of Caritas Internationalis through the Caritas Confederation Rapid Response fundraising tool.

The project was executed in the provinces of Syunik and Ararat, as well as in the capital city of Yerevan. All activities, including the identification of the most vulnerable communities, target groups, and the allocation of resources to address urgent needs, were conducted in close collaborations with the Government of Armenia through the Ministry of Labour and Social Affairs (MLSA), regional authorities, and local municipalities and in coordination with UN respective WGs .

To streamline the processes, an Umbrella Cooperation Agreement for the coordination of assistance efforts for forcibly displaced people from Nagorno Karabakh was signed with the Ministry of Labour and Social Affairs (MLSA) on December 4, 2023.

 

2. THE PROJECT LOGICAL FRAMEWORK

Goal : Forcefully displaced population from Nagorno Karabakh lives in dignity in the areas of temporary residence in Armenia

Strategic Objective 1 (SO1): 1567 displaced households meet their basic needs

Output 1.1a: Displaced households utilize cash or vouchers to address their priority needs

Two modalities of cash assistance were planned within the project : cash transfers and voucher assistance.

Cash assistance: The RA Government has developed 3 Cash assistance programmes encouraging all stakeholders to joining them. In the framework of the Project AC has joined the State Cash Assistance program adopted by the “Decree of the Government of the Republic of Armenia dated November 9, 2023 No. 1957-Լ on the approval of the Program and Procedures for Providing Social Assistance for Primary Consumer Needs to Forcibly Displaced Individuals from Nagorno Karabakh”.

For this according to the clauses of the Cooperation Agreement between AC and MLSA, a Trilateral Contract was signed among AC, Unified Social Services of MLSA and a Ameriabank on the transfer mechanisms of cash assistance. According to the provisions of the Agreeement, a total number of 1,745 forcibly displaced individuals from Nagorno Karabakh  (1245 within the EA Project, 500 – within another Emergency assistance Project) distributed across Ararat, Syunik provinces, and Yerevan received cash assistance of 50,000 AMD (equivalent to approximately 125 Euro) per person to address their essential winterization needs within the Project.

Voucher assistance: Following negotiations with the RA Government and discussions within the UN Cash Working Group, all stakeholders collaborated closely with targeted regional authorities and local municipalities in the provinces, and with the MLSA for Yerevan, regarding the Voucher assistance program. To formalize this collaboration, a Cooperation Agreement on the voucher mechanisms was signed between MLSA and AC on 21.02.2024.

The most vulnerable communities with the biggest numbers of vulnerable displaced people in Syunik and Ararat provinces were identified in coordination with the respective Regional Governments. Data on beneficiaries in the communities of Syunik and Ararat were provided by the local municipalities; in Yerevan – by MLSA USS based on AC criteria.

Voucher assistance of an average amount of 50.000 AMD (equivalent to approximately 125 Euro) was provided to at least to 1276 HHs in Syunik and Ararat provinces and Yerevan.

 

Output 1.1b: Displaced households utilize in-kind items to meet their essential needs for food, living supplies and hygiene items

In parallel with cash assistance Armenian Caritas had planned also in-kind modality to be mainly utilized if Armenian Caritas confirmed that the market in the targeted area was not functioning or inaccessible. This assistance would help vulnerable households displaced from Nagorno-Karabakh meet their basic needs especially during winter months. Based on the general approach for this component negotiations were carried out with the Regional authorities of Syunik and Ararat provinces As an outcome the most vulnerable communities with biggest numbers of vulnerable displaced people were identified. Data of beneficiaries matching AC vulnerability criteria were provided by the local municipalities, needs’ assessment was conducted by the project case managers.

Based on the results of needs assessment, winterization assistance (warm blankets and linen, heaters, household appliances, etc) in an average amount of 78.000 AMD (equivalent to approximately 195 Euro) was provided to around 233 HHs in the targeted communities of Syunik and Ararat provinces. For Yerevan it was decided to shift to voucher assistance given the availability of supermarkets and preferences raised by the displaced people.

 

Output 1.2: Displaced persons receive Post-traumatic psychosocial services (PTPSS)

Within the psychosocial support services case management was provided to 1509 cases that benefited from the voucher and in-kind assistance. Case management was conducted through needs assessment, referrals. Post-traumatic psycho-social support was provided to 48 displaced individuals through groups sessions and self-support groups.

 

Total Programme Budget requested: 250,000 EUR

Fundraised: 402,940 EUR

Duration planned 15.11.2023 – 15.01.2024; extended to 15.03.2024

 

3. OBJECTIVES OF THE EVALUATION

The final evaluation will focus on the following key objectives:

• Assess the extent to which the project achieved its purpose and delivered intended results/ outputs
• To assess the relevance, effectiveness, coordination, efficiency, and accountability of the programme
• Assess the effectiveness of the leadership of Armenian Caritas in coordinating the activities within the project target locations and regions;
• The extent to which cross-cutting issues (gender equality, social inclusion and environmental protection) were applied;
• Identify lessons learned, best practices and recommendations to inform future programme design.

 

4. KEY QUESTIONS

Relevance/appropriateness

• Was programme design based on an impartial assessment of needs? Are needs assessments disaggregated by age, sex and disability? Do they include people’s needs, vulnerabilities and capacities?
• Did the assistance provided by Armenian Caritas meet the needs of the affected population? Were the persons most in need identified, selected, and supported by the programme?
• To what extent has the programme followed international humanitarian quality standards, such as SPHERE Minimum Standards and CHS in Humanitarian Response?
• Which parts of the assistance were the most appropriate and why? Which were least appropriate and why? Were activities aligned with the affected population’s needs and priorities?
• Were recommendations and learning from past reviews and evaluations applied to the response?

Effectiveness

• Was the response timely?
• What internal and external factors affected the speed of the response?
• Was the internal organizational and managerial structure of the project effective?
• Were there appropriate systems in place to monitor activities, outputs and outcomes of the programme? Did monitoring outcomes inform programme adjustments/revisions?
• Did the project activities lead towards the achievement of the expected results/indicators as set in the Results Framework?

 

Accountability

• To what extent has the affected population been involved in the design or implementation of the programme?
• Were appropriate systems of downwards accountability (participation, information sharing and feedback/complaints), put in place and used by project participants? Were project participants aware of the feedback/complaints mechanism?
• Were project participants and communities aware of selection criteria?
• Were project participants and communities aware of the assistance they should receive?

Coordination

• How effective was Armenian Caritas in coordinating internally?
• How effective was Armenian Caritas in coordinating CI MOs?
• How effective was Armenian Caritas in coordinating with external stakeholders such as other agencies, organisations, the local and national government?
• What aspects of coordination could be improved in the future and how?

Impact/Sustainability

• Has the response strengthened local capacities?
• What are the intended and unintended, positive and negative effects of the project?
• What, if any, aspects of the programme will have a longer-term impact?

 

5. METHODOLOGY

The final evaluation will rely on two main evaluation stages (1) design phase (2) field phase

Design phase

• The evaluator(s) will undertake a desk review of programme documentation including planning documents, project proposals, situation reports;
• The evaluator(s) will also review other relevant documentation such as minutes of decision-making meetings, assessment and registration forms, MEAL tool;
• The evaluator(s) will review other monitoring and reporting documents from secondary sources.
• The evaluator(s) should also conduct interviews and obtain feedback from the Emergency Response Officer in charge at Caritas Internationalis.

Field phase

• After the design phase, the evaluator(s) will conduct fieldwork to collect and analyse data in order to answer the evaluation questions;
• Data collection methods should be inclusive and utilise a range of methods, including focus group discussions and key informant interviews and with key project stakeholders. The use of surveys and other remote data collection tools should also be explored by the evaluators to maximise data collection;
• The evaluator(s) should ensure a systematic triangulation of data sources and data collection methods and tools, and seek to validate data through regular exchanges with programme staff where appropriate.

 

6. EXPECTED OUTPUTS

The evaluator(s) should produce the following key deliverables:

• Draft Evaluation Report to be submitted to Armenian Caritas / CI support mechanism (if applicable) and the CI Humanitarian Department
• Final Evaluation Report inclusive of:
• Executive Summary
• Background
• Introduction
• Context
• Description of Methodology
• Main findings
• Conclusions inclusive of best practices and lessons learned

 

7. USE OF THE EVALUATION RESULTS

The intended audience for the evaluation is Armenian Caritas key staff, including senior management, CI MOs who have supported the programme, the Caritas Internationalis Humanitarian Department and the Caritas Confederation. Evaluation findings will be shared with programme participants as appropriate.

 

8. REQUIRED COMPETENCIES

The competencies required from the External Evaluator are:

• Advanced degree in social sciences, political sciences, economics, development or related fields;
• Experience in leading evaluations, especially in the field of humanitarian response;
• Ability to use participatory approaches to evaluation;
• Experience of operational management of humanitarian/development programmes;
• Good knowledge of the local context;
• Good analytical skills;
• Excellent writing skills in a CI Confederation language (EN/FR/ES);
• Any other appropriate language skills;
• Understanding of the Catholic Church and Caritas structure and mission.

The consultant is to conduct the evaluation in accordance with the principles outlined in the “Caritas Internationalis management standards” document, “Code of conduct” and “Children and Vulnerable Adults Safeguarding Policy” of Armenian Caritas.

 

9. CONSULTANT’S PROPOSAL

Proposals should include:

• Proposed evaluation methodology (if different from above);
• Description of deliverables and a timeline;
• A financial proposal including the cost implication for other evaluators if any;
• CV(s) of evaluator(s). 

 Read More…

Please submit your proposal (technical and financial) with supporting documentation to l.stepanyan@caritas.am and info@caritas.am by April 21, 2024.