End of “Creating Attractive Opportunities for Livelihood of Youth in Agriculture – COOL-YA ” Project Evaluation

1. Introduction & Background

Finn Church Aid (FCA) is the largest Finnish organization for development cooperation and the second-largest provider of humanitarian assistance. FCA operates in twelve countries across Africa, Asia, and the Middle East, drawing on over 70 years of experience in international aid. FCA specializes in supporting local communities across three priority areas: Right to Livelihood, Right to Quality Education, and Right to Peace. Its operations encompass long-term development cooperation, humanitarian assistance, and advocacy.

Since 2012, FCA has operated in Jordan, initially focusing on addressing the needs of refugees and vulnerable host communities impacted by the regional crisis. Over time, FCA’s priorities have evolved from Education in Emergencies to initiatives supporting long-term resilience and reduced aid dependency among refugees and host communities, particularly through livelihood interventions.

The Cool-Ya Project, titled Creating Attractive Opportunities for Livelihood of Youth in Agriculture, was implemented by FCA in partnership with Jordanian organizations, including the Jordanian University of Science and Technology (JUST), the Jordan Exporters and Producers Association for Fruit & Vegetables (JEPA), and the Jordan Agricultural Engineers Association (JAEA). Running from January 2022 to December 2024, Cool-Ya aims to empower Jordanian youth and Syrian refugees in the agricultural sector by fostering skills development, increasing job opportunities, and boosting agricultural productivity in Jordan Valley, Mafraq, and Irbid.

The project builds on FCA’s successful model of creating and expanding sustainable enterprises for refugees and host communities. By targeting youth and supporting their involvement in modernized, market-driven agriculture, Cool-Ya addresses economic vulnerabilities and improves household incomes. Through interventions that enhance livelihood opportunities in agriculture and support community resilience, Cool-Ya aims to reduce dependency and promote sustainable economic participation, especially for vulnerable groups like young women and refugees.

2. Rationale, Purpose, and Priority Objectives of the Evaluation

As the three-years Cool-Ya project approaches its conclusion in December 2024, FCA aims to conduct an external evaluation to:
– Ensure accountability to donors and stakeholders by assessing project outcomes.
– Support organizational learning by identifying successful strategies and areas for improvement.
– Generate insights for shaping future programming in similar contexts.

Objectives of the Evaluation:
1. Assess the quality and effectiveness of the project’s implementation across targeted communities.
2. Measure the project’s impact on improving socio-economic outcomes for youth, refugees, and vulnerable community members.
3. Identify key lessons learned and develop recommendations for FCA and potential future donors.

3. Scope of the Evaluation

The primary focus of the evaluation is to assess the impact of Cool-Ya on the socio-economic prospects of youth, refugees, and vulnerable households within the project’s target areas of Jordan Valley, Mafraq, and Irbid.

Outputs to be Evaluated:

1. Economic Impact:
   • Output 1: Agrobusinesses or cooperatives have received equipment, technical support, and training.
   • Output 2: Micro and small agro-businesses (including food processing and production) have been supported and resourced.
2. Social Outcomes:
   • Output 1: Young men and women have received agriculture training.
   • Output 2: Talents and innovative solutions of youth have been supported by the project.
   • Output 3: Businesses and startups have received support from the project.
3. Technical Improvements:
   • Output 1: Channels and linkages are created, and barriers (gender, cultural, societal, etc.) are overcome to improve accessibility for youth to decent employment opportunities.
   • Output 2: The agro Gig platform has been supported and is functional.
   • Output 3: Women have been actively supported to join the labor market.

The evaluation will align with the Core Humanitarian Standards (CHS) framework for quality and accountability.

4. Evaluation Criteria and Questions

Relevance
– How the project implementation and activities related to the Project design, conducted activities are the same in the Log frame.

Efficiency
– To what extent the intervention implementation was aligned with the planned timeframe? Did the implementers mitigate COVID pandemic risks that affected their promised deliverables? How?

Effectiveness
– To what extent did the project activities strengthen entrepreneurial skills, provide access to financial support, and improve job readiness for youth and vulnerable groups?

Coordination
– How effectively did the project engage local stakeholders and organizations, including government bodies, cooperatives, and community groups?
– What were the perspectives of stakeholders on the project’s economic impact?

Impact
– What changes have beneficiaries reported in their socio-economic situations compared to before the project?
– To what degree did the project contribute to measurable income improvements and new job opportunities?

Sustainability
– How many of the businesses supported by Cool-Ya remained operational, and how have they developed post-project?
– What factors have beneficiaries and staff identified as critical to sustaining these businesses, particularly in the context of challenges like COVID-19?

5. Methodology Required and Available Data

The evaluation team will have full access to the project documents and data through SharePoint and OneDrive. The available resources on SharePoint will be utilized to inform the design of the evaluation and relevant assessment tools. Primarily, the evaluation team will be requested to align the data collection tools with the inputs of the project’s logical framework. The evaluation team is expected to design interview tools and survey forms, collect and analyze outputs which address the four main aspects mentioned under section 3 – Scope. The data collected by the evaluation team will be stored on a Data Collection Platform/Tool. In addition, the evaluation team will collect both qualitative and quantitative data through semi-structured and structured interview approaches. Quantitative data will be analyzed using Microsoft Excel to provide key business statistics, while qualitative analysis will supplement the results and explore in depth the issues or challenges raised by the right holders.

Data Collection Methods:

– Quantitative Methods: To assess income levels, employment status, and business outcomes.
– Qualitative Methods: To gather in-depth feedback from beneficiaries and stakeholders.
– Document Review: Including baseline and progress reports, financial records, and training materials.

6. Deliverables

Activity

Deliverable

Duration (Days)

Payment

• Document review (Project documents, progress reports, baseline survey report and any other documents)
• Evaluation design, methodology and detailed work plan

Inception Meeting with FCA Jordan (to be followed by arrangements for the field

visits – travel, logistics, interviews – as per approved plan; sometimes feedback is

sought from colleagues before approving the inception report so some time needs to be reserved for this)

Inception report

7

15% Upon approval of the Inception report

Data collection

Data collection

20

85%

Upon Approval of final report

• Data analysis
• Presentation workshop of initial findings

(to be followed by a review period of the draft report by FCA, compiling and communicating feedback)

Draft Report

15

• Finalization of Evaluation report incorporating feedback provided by stakeholders
• Submission to FCA with a presentation workshop

Final evaluation report

8

TOTAL DURATION

50

8. Duration

Duration: The agreement will be effective from 20/11/2024 to 31/01/2025, with potential for early termination if required, and an early start if the procurement process is finalized before.

9. Service Terms

• The Consultant is responsible for payment of all social costs, other employment related costs and insurance contributions and for all other liabilities of a statutory nature.
• The consultant will have to abide by FCA CoC, Child Safeguarding policy and any other relevant policies.
• Changes in total number of assignment days are allowed if below 60 days only, nevertheless the applicant can make changes on allocated days for each deliverable and provide justification for each change.
• Copyright for the report will remain with FCA.
• FCA do not provide any mean of transportation for consultant.
• FCA intends to contract the Consultant for three months pending finalizing all activities and reviewing the final project evaluation report

10. Budget

• Please provide a detailed budget of the assignment with VAT.
• Budget limit is 11500 JODs VAT inclusive.
• Bids exceeding this amount will not be eligible for evaluation.
• Applicants’ proposals must include a detailed and competitive budget inclusive of all fees, costs
• and taxes.
• Processing time for financial payments is 10 working days and will be only transferred to consultant’s bank account.
• 5% income tax will be deducted from each of consultancy instalment. A certification will be submitted to income tax department.

11. Validity

Tenders/Offers shall remain valid and open for acceptance for a period of 10 working days after the closing date for the submission.

Prior to the expiry of the original tender/offer validity period, the Contracting Agency may ask tenderers/candidates in writing to extend this period. Tenderers/candidates that agree to do so will not be permitted to modify their tenders/offers. If they refuse, their participation in the tender procedure will be terminated.

12. Timetable & Payment Modalities

See the deliverables section.

13. Required Expertise and Qualification

1. Education qualification of the consultant/s:

   At least a bachelor’s degree from a recognized university.

2. Experience & Expertise of the Consultant/s:

• A minimum of 5 years of proven experience in conducting project evaluations, particularly in livelihood, agriculture, or youth-focused projects.
• Demonstrated experience in both quantitative and qualitative data collection and analysis methods.
• Experience with evaluations in the MENA region and familiarity with the socio-economic context of Jordan is highly desirable.
• Knowledge of the Core Humanitarian Standards (CHS) framework or similar standards is advantageous.

• 14. Eligibility Criteria

• The service providers will initially be verified for eligibility according to the criteria below.
• #
• Description
• Means of verification and required documentation
• 1
• Curriculum Vitae/ Portfolio
• Curriculum Vitae/ Portfolio
• 2
• Bachelor’s degree from a recognized university
• University degree certificate
• 3
• Financial Proposal, and availability.
• Budget including VAT
• 4
• Experience in project evaluations within similar contexts
• Experience in project evaluations within similar contexts
• 5
• Recommendations letter
• Up to 3 recommendation letters

• 15. Contract Award Criteria

• The offers will be evaluated according to the contract award criteria below:
• #
• Description
• Weight
• Scoring methodology
• 1
• Technical Portfolio/CV/Recommendation Letters
• 35%
• • Points awarded based on the relevance of academic qualifications, experience in similar projects, and quality of recommendations.
• • Evaluation of proposed methodology for conducting the evaluation, with emphasis on alignment with project objectives and understanding of evaluation scope.
• 2
• Interview
• 35%
• • Scoring based on depth and relevance of experience discussed during the interview.
• • Assessment of the candidate’s problem-solving skills, communication abilities, and fit with the project’s requirements.
• 3
• Methodology and Approach
• 10%
• • Evaluation of the proposed methodology’s robustness, practicality, and innovation.
• • Scoring based on how well the approach addresses the specific needs and context of the Cool-Ya project.
• 4
• Financial Score
• 20%
• Lowest bid receives highest score, others scored proportionally