External Programme Evaluation
Terms of Reference – Call for Proposals
“Integrated Community Development Project in Chhaeb districe, Preah Vihear province”
I. Purpose of this Document:
This Call for Proposals for an End Evaluation of DPA’s ICD Project in Preah Vihear Province seeks an evaluator to design, implement and report on the project in line with the TOR set out below.
Interested parties should provide a costed proposal setting out how they would plan to evaluate the project in line with these TOR, along with CVs of the consultants, a short document detailing their experience, and an example of a recent, similar piece of work. All submissions will be treated in confidence and will not be shared beyond those involved in the procurement process.
II. Brief Overview of the Project:
This consultancy is to evaluate the Manus Unidas and Misereor funded Development and Partnership in Action (DPA) three-years in project from 1st January 2017 to 31st December 2019 for Manus Unidas and from 1st April 2017 to 31st March 2020 for Misereor funders.
The Integrated Community Development Project is in Chhaeb districts of Preah Vihear province, in 12 villages. The project works with 3,340 direct beneficiaries (1,507 females or 45%) in 12 villages of five communes Chhaeb I, Sanker I, Sanker II, Mlou Prey I and Mlou Prey II) of the district. The beneficiaries are the Khmer poor and vulnerable and Kuy indigenous people, including smallholder farmers without the resource to step-up agricultural production from subsistence level; women headed and disabled households with little or no livelihood.
Key programme components: Support community to manage community forestry sustainability, increased food security and improved livelihoods through agricultural activities, climate resilient techniques, using forest and land resources, and women empowerment with reducing domestic violence.
Community Forestry: The ICDPVH team will work with three Community Forestry (CF) s at village level and support community people in Sangker II villages to preserve and advocate for forming CF at commune level. These activities include provide capacity to CF members in six villages (Chhab Lech, Krasagn, Sra Em, Kraloat, Sambo, and Chork Chey) though training, workshops, Meeting, exposure visits, and joining CF networks.
Agriculture: The team will work with target farmers to build up their capacity of cash crops planatatoin and animal rearing techniques to adapt to changing weather pattern. This includes trainings, coaching, reflection meetings, farmer field’s day, exposure visits, support cash crops seeds, preservation local rice variety seeds. The topics of the training include lowland rice resilient growing techniques, composting, bio-pesticides making, animal rearing and animal vaccination; vegetable resilient growing techniques; cash crops resilient growing techniques; cropping calendar. After the training each trainees will receive crop seeds to implement the techniques.
Disaster Risk Reduction (DRR) and Climate Change Adaptation (CCA): The team will facilitate to organise village meetings to select 84 members (38 females) of 12 Village Disaster Management Teams (VDMT). Each VDMT consist of seven members. The team will collaborate with Commune Disaster Management Committees (CDMC) to conduct training on DRR and Commune Base Climate Change Adaptation concept for CCDMs, VDMTs and community people in 12 villages in order to develop and review Village-level DRR Community Action Plans (DRR CAP) and incorporate their activities of DRR CAPs into Commune Investment Plan (CIP) annually.
Women have equal access to information, skills, services, and decision-making: In the collaboration with DPA Gender officer, the team will conduct training women leadership for women activists, bi-annual gender network meetings, support International Women’s day, support Gender Road Map project to eliminate all forms of domestic violence and to improve livelihoods of the selected married couples whose have domestic violence and facilitate them to discuss on the solution for improving their livelihoods and together decision-making and provide rice and vegetable seeds and chickens for increase their livelihoods.
- Logical Framework:
1.1 Overall Objective/ Goal: Empowered poor and vulnerable communities in 12 villages take the lead for their own sustainable and equitable development through a People-Led Development Process.
1.2 Specific Objective: In 12 villages in five communes, 10,020 (5,063 females) final poor and vulnerable partner community people increased their food security, improved livelihoods with integration of farming climate resilient techniques and fully exercise their rights in managing, accessing and using their forest and land resources equitably and sustainably.
1.3 Outcome indicators:
1. 2,038 (1,058 females) poor and vulnerable people in six villages protected, secured their forests and forestland protected (13,081 hectares) and sustainably used those resources as a resource for improving livelihoods.
2. 2,282 (1,356 females) poor and vulnerable people report reduced annual hunger gap by 4-6 weeks from rice, vegetable, cash crops and cows rearing.
- 2,528 (1,543 females) farmers report increased ability and resources to reduce vulnerability from natural disasters and the adverse of changing weather patterns.
- 144 women in 12 villages took leadership position and influence decision-making on social and development work at village and commune levels.
III. Project Results/ Outputs:
Results 1: Two Community Forests (CF) with 1,168 (624 females) CF members in two villages (Chhaeb Lech and Krasang) legally recognised Community Forestry Management Plan (CFMP) by MAFF and fully implemented the CFMP.
- Two CFMPs legally recognised by Ministry of Agriculture, Forestry and Fisheries (MAFF) for two CFs in two villages (Chhaeb Lech, Krasang).
- 7,528 hectares of forests and forestland in two CFs in two villages (Chhaeb Lech and Krasang) protected.
Results 2: 870 (434 females) villagers in four villages (Sra Em, Chork Ckey, Kra Loat and Sambo) claimed and protected forests and forestland 5,553 hectares as a resource for livelihood.
- 870 (434 females) villagers established two CFs in two places from four villages with 5,553 hectares (Sra Em, Chork Ckey, Kra Loat and Sambo).
Results 3: 119 (33 females) CF Management Committee (CFMC) members, Community Advocacy Focal Points (CAFPs) and Community Activists (CAs) in 6 villages increased management capacity and advocacy strategies to manage, access and using their forest and land resources equitably and sustainably.
- 119 (33 females) CFMC, CAFPs and CAs in four CF in different areas of 6 villages increased capacity in project management, advocacy strategy and networking.
- At least 6 cases of land and logging issues addressed.
Results 4: 2,536 (1,507 females) poor and vulnerable people in 12 villages increased food security (agricultural and animal productions) and livelihoods.
- 984 (589 females) farmers increased rice yield by 400 kg per hectare each year.
- 689 farmer HHs have enough rice to eat for year round.
- 1,151 (731 females) farmers have vegetables for eating and earn additional income from income from sale of the vegetable.
- 223 (137 females) farmers increased incomes from the sale of soybean, corn and cassava and onion.
- 43 Female and Poorest HHs increased income from the sale of cows (under existing cow bank scheme in 9 villages) and have draft animals for cultivation.
- 630 Female, Poor and Poorest HHs increase income from the sale of animals rearing (chickens, dugs, and pigs).
- 2,528 (1,543 females) farmers preserved their local resilient seeds (upland rice: 702; F403, lowland rice: 547; F328, and vegetable: 1,279; F812).
- 1,770 (1,080 females) farmers who received resilient agricultural techniques training, coaching and visiting applied on farming climate resilient techniques for rice, vegetables and cash crops.
- 12 village disaster management teams (VDMTs) comprise of 84 (38 females) established in 12 villages and fully trained on related DRR and CCA topics (7 VDMT members per village).
- Disaster Risk Reduction Community Action Plan (DRR CAP) developed and implemented in 12 villages.
- 50% of community suggested priorities from the 12 DRR CAPs incorporated into the annual Government Commune Investment Plans (CIP) and sign off.
- 360 women in 12 villages increased capacity in order to influence decision-making at village and commune level
- 8 women in 12 villages were elected to become Commune Councillors (CCs) during Government’s CCs election in 2017.
- 12 married couples stopped domestic violence, improved livelihoods and family’s happiness.
- Objectives of Evaluation:
- Assess and score the project’s achievement of its anticipated outcomes and outputs as set out in the project Logframe;
- Assess the relevance, efficiency, effectiveness, impact and sustainability of the project outcomes and outputs;
- Assess the extent to which the project the project integrated community development into its new design and implementation, promoted gender equality and women’s empowerment, and was able to meet the originally assessed needs of the communities;
- Provide information on what worked well, what did not, and why; and
- Provide recommendations for improvement for the upcoming project design.
- Expected Outputs/Deliverables:
The consultant will be expected to provide to DPA with:
- An inception report setting out the detailed methodology and timescale for the evaluation including sample sizes and sampling methods, developed to meet all aspects of this ToR, in line with the proposal received as part of the procurement process and the proposed budget;
- Collection of unbiased, valid, and reliable information from desktop review, surveys, focus groups, observations and interviews;
- A feedback session with each village visited to discuss and clarify key findings and observations;
- A presentation with the staffs of DPA ICD Preahy Vihear and its stakeholders to discuss preliminary findings and analyses and to reflect upon lessons learned from the evaluation;
- A full draft report, no later than the 25th of October 2019. The draft report should include a specific recommendations section, and an Evaluation Summary and Scoring Sheet (see annex 1) which includes a scoring of the projects performance against intended objectives.
- A final report will be due by the 30th of October 2019. The consultant will be responsible for writing the final report and submitting it to DPA Executive Director.
The evaluation report, which will be written in English language, should be clear, easy to understand, concise and useful for the organisations and beneficiaries. The main body of the report should usually not exceed 40 pages (A4 pages on both sides) and will include an executive summary and recommendations. Technical details should be confined to appendices that should also include a list of informants and the evaluation’s team’s work schedule. The Evaluation Summary and Scoring Sheet is considered an integral part of the evaluation report.
Background information should only be included when it is directly relevant to the report’s analysis and conclusions.
Recommendations should be recorded in a separate section and should also include details as to how they might be implemented. Each recommendation should be accompanied by a suggested date for completion and an indication of the lead actor responsible for taking it forward.
One soft copy and one hard copy of the final report (MS word 2007 and excel format – font size: 10 and Arial) will be submitted to DPA by evaluator.
- Roles of Participants:
Team Leader: The evaluation will be led by an external consultant known as the Team Leader. The specific responsibilities of the Team Leader are outlined below:
- Review and confirm with the Evaluation Committee the objectives of the evaluation, process and methods to be used, expected outcomes, and the format for the presentation of the results.
- Become familiar with the ICDPVH project by reviewing all relevant documents and through discussions with staff.
- Provide leadership to the Evaluation Team in developing appropriate interviewing techniques, preparing for village feedback sessions, and presenting preliminary findings and lessons learned to the ICDPVH team.
- Ensure that all key stakeholder groups affected by the programme (both directly and indirectly) are consulted and their views considered in the evaluation. The level and form of participation by partner staff, beneficiaries and other stakeholders should if possible go beyond consultation in order to maximise learning opportunities.
- Coordinate the activities of the Evaluation Team and keep the Evaluation Committee informed of progress.
- Use a participatory approach that encourages discussion of the findings, and ownership of the conclusions and recommendations by all primary stakeholders.
- Evaluate and recommend the extent to which the project integrated community development into its new design and implementation, and the extent to which it has promoted gender equality.
- Upon completion of the final draft, discuss the results with the Evaluation Committee.
- Complete the final evaluation report, following the outline agreed upon with the Evaluation Committee.
- Evaluation Team: The Evaluation Team will consist of Team Leader and four team members (two women) from ICD programme and other programme of DPA and will undertake the assessment in accordance with the guidelines set out in this ToR.
- Evaluation Committee: The Evaluation Committee will consist of the Executive Director, ICD Programme Manager, Monitoring and Evaluation Officer and the Promvincial Project Manager. Committee members will be available to the Team Leader for consultation on the general direction of the evaluation and to address any issues/concerns arising during the exercise.
VII. Evaluation Process:
- Preparation of an inception report detailing methodology and timescale, submitted to DPA Evaluation Committee for review.
- A discussion with the Evaluation Committee regarding the methods proposed sampling a representative cross section of the village communities studied. Approval of plan;
- Implementation of agreed methodology;
- Feedback session with each village visited to discuss and clarify key findings and observations.
- A presentation with the staff of DPA ICDPVH and its stakeholders to discuss preliminary findings and analyses and to reflect upon lessons learned from the evaluation.
- Submission of draft report to DPA for discussion and feedback during the debriefing meeting and the draft report reviewed by DPA;
- Final written report submitted and signed off by DPA; and
- Management Response prepared and all staff and stakeholders are fully briefed on the key findings, observations and recommendations the evaluation
VIII. Schedule of work:
The following is intended as a guide to the times estimated for each component of the work. The Team Leader will be required to prepare and submit a detailed work plan at the beginning of the evaluation. The evaluation is expected to take 15 days. The evaluation is scheduled to begin on the 7th of October and finished by the 30th of October 2019.
|Days||Description of Work|
|1 day||Meet with the Evaluation Team and Evaluation Committee, study relevant programme documents, design evaluation process and methods, select sample villages, develop guide questionnaires with team, finalise and submit work plan to evaluation committee.|
|7 days||Travel to Preah Vihear, meet field staff, and review field documents and Visit 4 villages, and conduct interviews and focus group discussions, and feedback findings to villagers. Also, interview programme staff, counterparts, NGOs and local government officials, and other provincial development agencies concerned. Presentation to ICD-PVH team and return to Phnom Penh.|
|½ day||Interview DPA Senior Management staff in Phnom Penh.|
|5 days||Write evaluation report and submit draft to Evaluation Committee|
|½ day||Discuss draft report with Evaluation Committee|
|1 day||Complete final report and submit report to DPA Executive Director.|
- Proposed Final Evaluation Report Outline:
A. Executive Summary
B. Introduction to the Indigenous People Integrated Community Development Programme
C. Purpose of the Evaluation
D. Evaluation Research Framework & Methodology
F. Conclusion & Recommendations