Job Description

1. BACKGROUND INFORMATION

1.1. About CARE International

CARE works around the globe to save lives, defeat poverty and achieve social justice. We seek a world of hope, inclusion and social justice, where poverty has been overcome, and all people live with dignity and security, with a specific focus on the empowerment of women and girls. CARE’s Vision 2030 strategy includes six broad impact areas, with specific impact targets and metrics aligned with the Sustainable Development Goals. CARE anticipates that its impact will increasingly be achieved at the systems level as part of its quest for sustainable impact at scale, achieved through local leadership in partnership with governments, the private sector and civil society actors. CARE has been assisting communities in Somalia since 1981. CARE works in partnership with the government, international NGOs, civil society, leaders and local authorities to bring effective and lasting change to the most vulnerable communities. This project falls under Education and Gender Equality (EGE) Pillar.

1.2. About Maamul Wadaag Project

The Maamul-Wadaag consortium brings together CARE Nederland, CARE International Somalia, the Somali Youth Development Network (SOYDEN), and the Puntland Youth Associations Network (PYAN). With support from the EU, the project will be implemented in Somalia (Puntland, South-West States and Banadir Regional Administration) for a duration of 36 months (Dec 2022-Dec 2025).The project aims to aims to strengthen the capacity of local Civil Society Organisations (CSOs) on accountable leadership, while elevating their voices and facilitating effective participation to cultivate their ability to support inclusive governance and influence key policy processes to improve service delivery in Somalia. As non-government and non-market actors, CSOs are in a unique position to foster collaboration among relevant stakeholders, influence agenda-setting and hold the government and private sector accountable for their promises and actions.

Overall Objective: to strengthen local CSOs in Somalia as independent actors of good governance and development in their own right. This is envisaged to be accomplished through two specific objectives:

1. To strengthen local CSOs’ capacities to engage in policy dialogue, advocacy, implementation, and monitoring of national development plans and programmes.
2. To increase local CSOs’ capacities to advance gender equality and support more inclusive governance.

Target groups: The project targets 114 Community Based Organisations (CBOs), including: Southwest State: 20 Village Loans and Savings Associations (VSLAs), 4 Peace Committees and 2 Youth Networks; Banadir Regional Administration: 55 VSLAs, 11 Peace Committees and 2 Youth Networks; Puntland State: 15 VSLAs, 3 Peace Committees and 2 Youth Networks; 36 District,12 State NGOs (2 and 4 per region respectively); Six PLWD organisations/networks; and, Six State level umbrellas/CSO networks/social movements (two per state).

2.     OBJECTIVE OF THE ENDLINE

CARE Somalia is seeking to procure the services of a consultant to conduct an endline study of Maamul Wadaag project in the target locations (Puntland, South-West States and Banadir Regional Administration). The study will employ a mixed-methods, gender-sensitive endline evaluation to assess the progress made towards the project outputs, outcomes and impact level indicators. This endline will be inclusive with all project stakeholders i.e (the communities, CSOs, and Public Authorities, and some components seek support from the consortium partners). The endline will be implemented by an external consultant identified in close coordination with the partners. It is considered to be external to ensure objectivity and impartiality, but this does not exclude the technical support from CARE Somalia, the partners and CARE Netherland.

2.1 Overall Objective

The results of this evaluation are expected to provide detailed measure of the degree of which the stated overall and specific objectives were achieved. The main objective of this endline is to assess the project impact, as well as the endline assessment for indicators in the results framework. It should generate relevant findings, lessons learned and recommendations which will be shared with key stakeholders of the project and used by the implementing agencies to guide and inform on the best practices and strategies in for improving education programs. The end line evaluation of Maamul Wadaag assess the relevance, effectiveness, efficiency, impact, sustainability, and capacities strengthened of the Maamul Wadaag project and provide actionable recommendations for future inclusive governance programming in Somalia.

2.2 Specific Objective

·         To measure the extent to which the project achieved its intended results to inform the project’s relevance, effectiveness, efficiency, impact, sustainability, coherence, validity of design, factors affecting performance, alternative strategies and its strengths and weaknesses.

·         To evaluate the impacts made through local civil society organization in inclusive good governance

·         To assess the sustainability of interventions (civil society strengthened, social cohesion-built ad Ministry both state and federal capacity built) and local ownership (CBSo and CSOs contributions).

·         Evaluate the effectiveness and impact of financial support provided to CSOs under the project.

·         Document best practices, challenges, and provide actionable recommendations for future inclusive good governance programming.

3.     THE SCOPE OF THE ENDLINE EVALUATION

The endline evaluation will examine project design, implementation, outputs, outcome and impact of the project against the logical framework indicators. The the evaluation will be conducted in all the target locations in Puntland, South-West states and Banadir Regional Administration - (security permitting), using both quantitative and qualitative approaches. It will also include a formal coherence check of the logical framework and indicator set to confirm that implemented and reported activities are aligned to output, outcome, and impact indicators with required disaggregation.The assignment will involve a visit to the target CSOs and CBOs based on samples derived in consultations with CARE and the implementing partners. The consultancy will conduct a desk review, field data collection, data analysis and report writing and presentation of findings during a validation workshop to be organized for partners and the donor. He/she should take into consideration the evaluation criteria of relevance, effectiveness, efficiency, impact, sustainability and project performance rating. Other cross cutting approach that should looked in include human rights, gender sensitivity, inclusivity, safety and protection, promoting health, community engagement etc.

The consultant will provide a rating scale for grading the level of achievement of the main activities projected to be implemented by the project and give a summative mean grade for all the activities evaluated and graded. The mean grade will provide the overall performance of the project.

4.     TECHNICAL APPROACH AND METHODOLOGY

The evaluation will use a mixed-methods, complexity-aware and inclusive approach, combining qualitative and quantitative techniques. Quantitative data will be triangulated with qualitative data obtained from a variety of stakeholder groups through key informant interviews and focus group discussions. It is expected that the triangulation of quantitative and qualitative data will allow the project to better understand unexpected patterns in quantitative results, as well as to explore the motivations/interests of stakeholders and the challenges and opportunities for the design and implementation of activities. The methodology will include a structured review of the logical framework and indicators to verify alignment between activities, outputs, outcomes, and impact indicators.

Additionally, the consultant will be required to take into account all ethical protocols at all stages of the exercise, have a risk and risk mitigating plan in place, quality assurance plan that sets out the systems and processes for quality assuring the research process and deliverables from start to finish.

5.     EXPECTED TASKS

The consultant will be responsible for defining and carrying out the evaluation tasks. This will include the design of the evaluation methodology (specification of the techniques for data collection and analysis), development of data collection tools, structured field visits and interactions with beneficiaries. The methodology and data collection tools will be reviewed and validated with the consortium partners, CARE Netherlands and approved by the European Union Representatives. Specifically, the consultant shall carry out the following activities

•       Conduct desk review of internal and external materials that are relevant and would inform the study.

•       Submit an inception report inclusive of the proposed tools, sampling approach, detailed analysis framework, quality control measures and work plan.

•       Submit a detailed work plan as part of the inception report and updated data collection plan following training of enumerators. The work plan should include plans/framework for data collection, data entry, data cleaning, transcription, and translation.

•       Submit a quality assurance plan that sets out the systems and processes for quality assuring the research process and deliverables from start to finish of the project.

•       Translate data collection tools and training protocols from English to Somali. Note that back translation will be required for accuracy.  Develop electronic versions of all relevant data collection tools. 

•       Pilot the tools in the respective target locations, track changes and submit revised tools for approval.

•       Take the lead in training research assistants, following guidelines and training plans outlined in the inception report, as well as quality control protocols and guidelines for researchers.

•       Undertake data collection in the field following the approach outlined in the approved inception report. 

•       Support in data collection related logistics, including but not limited to travel and deployment of researchers to the target location, and supervisors; and where required coordination with CARE to access each area with approval from the regional states.

•       Upload datasets completed by the team daily for verification by CARE’s technical team.

•       Conduct qualitative data entry and coding.

•       Conduct all necessary data quality and ethical control measures.

•       Analyse the data as per agreed upon data analysis framework.

•       Analyse the logical framework and indicators to ensure alignment between activities and indicators. Produce an activity to indicator crosswalk, linking each implemented or reported activity to the relevant output, outcome, or impact indicator, noting evidence sources, current achievement versus target, data quality issues, and any misalignments or gaps

•       Provide a draft comprehensive technical report; a draft summary report; and a draft presentation of findings for review. Incorporate technical feedback received from CAREand relevant stakeholders and provide revised final versions of all three documents for final approval.

•       Provide a complete set of physical and electronic data collection documents, filed, and organized as per guidelines provided by the CARE, upon completion of data collection and entry. This includes but is not limited to complete datasets (anonymized and non-anonymized versions), script and analysis files; datasets used for analysis; transcribed and translated versions of FGDs and KIIs; filled surveys, questionnaires, FGD/ interview notes, daily survey logs; voice files (for electronic qualitative data collection), pictures (noting that no pictures of respondents will be allowed under any circumstances, including during data collection or before/ after data collection), etc.

6.     EXPECTED DELIVERIES

The consultant will be responsible for defining and carrying out the endline evaluation. This will include the design of the methodology (specification of the techniques for data collection and analysis), development of data collection tools, structured field visits and interactions with project participants. Specifically, the consultant shall carry out the following activities:

•       Inception report.

•       Work plan outlining all tasks to be completed within the duration mentioned for this assignment, responsible persons, timeframe for completion of each task and resources required for each task

•       Detailed data collection and analysis plan, a comprehensive risk management plan and a quality assurance plan as part of the inception report.

•       Translations of survey instruments from English into Somali, to be verified through back-translation (conducted by the evaluator) and secondary spot-checks conducted by CARE.

•       Training plan (including summaries of training sessions and relevant presentations/ exercises).

•       Complete list of enumerators/supervisors per location, including contact details.

•       Training report on the data collection process with recommendations for future data collections.  The report should catalogue and include, in annexes, the final survey and training tools used (with translations where available).

•       Complete set of files, hard copies of surveys, audio/ image/ video files etc.

•       Complete transcriptions of qualitative data both in Somali and English.

•       Clean data sets, to be reviewed and approved by CARE. 100% of the planned data is included and the final version of the database should not include any typos, out of range responses for any variable and/or illogical responses.

•       Analysis and script files.

•       Final report, based on the agreed-upon analysis framework. The methodological section should include a discussion of data collection challenges and limitations, including a summary of data collection activities and the timeline of data collection, a number of total surveys collected and the number of refusals to participate for each location, as well as detailed data collection log per region/state. The report will also include log-frame and indicator alignment matrix summarizing any misalignment.

•       Final summary report.

•       PowerPoint presentation of findings.

7.     ROLE OF CARE AND ITS PARTNERS

CARE will have the following functions: provide oversight, supervision and coordination of the assignment; coordinate document reviews and approval of all deliverables as per the terms of reference. The consultant will report to the Senior Research and MEAL manager, and dedicated project staff will be assigned to support the assessment team in coordinating the collection of data and to provide necessary information for planning purposes. Logistical and administrative support will be provided for example, office working space, transportation or associated expenses during the field data collection.

8.     CONSULTANT’S RESPONSIBILITIES

During the period of carrying out this assignment, the consultant will need to establish close coordination arrangements with the Hub Office Coordinators in Puntland and South-Central Somalia. In particular, the evaluator will be expected to work closely with the Senior MEAL Manager, program manager, Senior MEAL Officer and Project Managers of the consortium partners (SOYDEN, and PYAN).  The consultant under this assignment will: -

• Be available for the assignment.
• Prepare all their travel documents.
• Commits to complete a fully satisfactory end product within the agreed time frame;
• Provides the necessary material for use during and after the evaluation.

9.             INTELLECTUAL PROPERTY RIGHTS All documentation related to the assignment shall remain the sole and exclusive property of CARE

Experiences and Qualifications

The potential consultant/expertise required to meet the following minimum requirements to qualify for the submission of his/her proposal.

• The consultant should have at least a advanced Degree in Social science, development, Governance, Disaster risk management and/or any other relevant discipline and not less than five years of previous experience in similar tasks or consultancies
• In-depth knowledge and understanding of stakeholder mapping, CSOs capacity assessment, lobby and advocacy, DRM policy and governance context analysis, and gender analysis.
• Proven quantitative and qualitative research skills.
• Proven professional expertise and experience in the area of monitoring and evaluation and baseline research.
• Strong communicative skills and cultural sensitivity.
• Strong English writing and speaking skill.
• Ability to speak local languages is an advantage.

Skills Required

Attachment

Follow us on social media