Closing date: 06 Jun 2016
Type of Contract: Plan International UK
Language: English
Contract Length: 30 Days
BACKGROUND
Typhoon Haiyan (local nomenclature: Yolanda) made landfall near Guiuan municipality of Eastern Samar, Eastern Visayas Region of the Philippines on November 8, 2013. With sustained winds of 250 km/hour and gusts up to 315 km/hour, it devastated the region causing great loss of human lives, temporary displacement, massive damage to physical infrastructure and housing, and disruption of many services.
Plan has been implementing the DEC funded 36 months long project “Strengthening Healthcare and Protection Services and supporting the rehabilitation and diversification of livelihoods for Typhoon Haiyan affected populations” in Leyte, Eastern and Western Samar. Phase 1 of the response focused on immediate needs and ensuring the inclusion of children and vulnerable groups in the transition to early recovery. Phase 2 is focusing on reconstruction and rehabilitation of services in the sectors of health, protection and livelihoods.
Please find here the table summarizing the objective level indicators of the project for Phase I and Phase 2.
PURPOSE OF EVALUATION
The purpose of the evaluation is to identify the impact, outcomes, best practice and lessons learned from the project to provide an evidence-base and practical recommendations.
It will be shared with the donor of the project (DEC) as one of several sources of verification during the project reporting process.
The evaluation will be used by Plan International (PI) to document best practices and lessons learnt.
The evaluation will also be shared with project implementing partners at a local level, to be shared with community representatives, and to enable replication of successful activities at a local scale. Other stakeholders, including local government, and other organizations working on similar activities in Philippines, will also receive a copy of the evaluation upon request.
EVALUATION OBJECTIVES
The evaluation will focus on the logframe and project design - activities, outputs, outcomes etc. It covers the geographic areas, target groups and sectors reflecting the activities undertaken.
Project sectors are related to health, food security and livelihood and protection.
The evaluation will assess the project under the criteria of effectiveness, efficiency, relevance, sustainability, impact, replicability & scale, coverage and targeting and will answer the following questions:
Effectiveness
- Have the activities been undertaken in a timely manner? Were objectives achieved on time?
- Quality of assessments: what was missing; what can we do differently next time?
- How appropriate and useful were the interventions and/ activities implemented?
- Were the beneficiaries able to provide feedback during the operation?
- Was the feedback from beneficiaries able to be incorporated into the project design?
- Have the alterations made during the project implementation had positive / negative effects to the achievement of the outputs & outcomes?
Efficiency
- Cost-benefit analysis / Has the scale of benefits been consistent with the cost?
- To what extent has the funding been utilised to directly assist beneficiaries - has project support and operational costs been reasonable (%) compared to entire budget?
- How well were the inputs (funds, people, materials and time) used to produce results?
- Efficiency in terms of logistical support for any procurement done?
Relevance
- Have the project objectives proven to be valid and appropriate to reach the intended overall goal? If not what should have been done instead?
- Has the project been consistent with the needs and priorities of the intended beneficiaries (most vulnerable in the communities)?
- Has the project complemented and been compatible with government approach?
- Has the project approach or design changed to ensure continued relevance in a changing context?
Accountability
- To which extent the Code of Conduct and Sphere have been respected?
- To which extent past lessons and the DEC Response Review and member RTE recommendations have been fulfilled?
- Have appropriate and accessible feedback mechanisms been established?
- How the feedback mechanism had been designed and implemented?
- Have affected communities been able to participate in the decision making, design, targeting, implementation and evaluation of the project?
- Has Plan maintained good and consistent communication with affected communities?
- Has the project been implemented in good coordination with government actors and other stakeholders?
- How have lessons throughout the project been captured and used?
Sustainability
- Has the project managed to put in place systems to enable sustainability, for example? in relation to the livelihood component?
Impact
- Results achieved vs planned results, if discrepancy- why?
- Has the project had any unforeseen positive and/or negative institutional impacts which have influenced Plan, prompted changes in partners’ ways of working etc.?
- Has the project been able to strengthen Plan’s presence in the community, if so how?
- Has the project been able to strengthen partners’ and communities’ capacities?
Coordination / Communication
- How effective was the coordination/collaboration between Plan and partners?
Coverageandtargeting
- Was the targeting of the beneficiaries appropriate? Was the selection criteria implemented? Was the community involved in determining the selection criteria and well informed about the decisions?
- Did the project address the needs of all intended beneficiaries in a consistent manner as per project design?
Replicability& scale
- How replicable is the project for future emergencies?
- What would be the main considerations when replicating and scaling up/down this project design for future emergencies to ensure a better quality of response (e.g. main lessons learnt)
GEOGRAPHICAL SCOPE
The evaluation will cover a sample of communities that have been part of the project interventions in Eastern and Western Samar and Leyte (communities selected to be determined).
KEY ACTIVITIES
Conduct background reading, briefing discussions with project team and preparation of resource materials;
Develop an evaluation study design (work-plan) inception report identifying information needs and including the draft data-gathering and analysis instruments;
Undertake data-collection at the office and field level including through participatory evaluation methods and meeting with project staff, community members, and other stakeholders;
Conduct data processing, analysis and draft the report preparation;
Present the evaluation results to the project team and the draft report to Plan UK office;
Finalise the evaluation report following comments received from project staff and Plan UK on the draft report.
METHODOLOGIES
The final evaluation schedule will be determined following discussions between the consultant and the project team from Plan prior to the commencement of the evaluation study. The evaluation study design (plan) and tools will be approved by Plan prior to implementation based on the inception report.
The consultant is expected to be proficient in using a range of participatory tools for data gathering and analysis, including quantitative and qualitative survey techniques, conducting key informant interviews and leading focus group discussions. The evaluation will ensure unbiased data collection from a representative sample that can be used to compare with available baseline or control group data. The consultancy will also involve substantive documentation review, report writing, and workshop presentation.
Team leader will take responsibility to submit the inception report and final report and presentation.
TEAM COMPONENT
The evaluation will be conducted by a team composed of maximum 3 members (2 team members and 1 team leader) with speciality for three sectors (Health, Food Security and Livelihood and Protection).
Team leader will take responsibility to submit the inception report and final report and presentation
DURATION AND TIMELINE
The contract will be for 30 working days between July 2016 and August 2016 (including field visits and all deliverables).
Provisional indication of timeline as follows:
1) Review of project documents & reports, secondary data... (W1)
2) Working plan & working schedule with stakeholders arranged (W2)
3) Inception report provided to Plan UK for discussion (W3&4)
4) Data collection in the project areas (W4&5)
5) Collation & standardizing of report (W5&6)
6) Presentation of preliminary results to Project Team and receive feedback (W6)
7) Final report consolidation to be submitted (W7&8)
DELIVERABLES
The evaluation will result in three outputs/deliverables:
· A short inception report highlighting the evaluation framework, work plan, tools and methodologies used for the evaluation exercise and updated evaluation questions from the TOR
· Report containing an executive summary and comprehensive but concise outline of the results of Plan’s programme across all fields of focus mentioned above (*Relevance/ appropriateness, Efficiency, Effectiveness, Sustainability and Impact and Accountability)*. The report will include details on the methodology, document review, findings, and limitations. Key lessons learnt, recommendations and tools for improving humanitarian response should be identified in English and annexed if appropriate. Annexes should include but are not limited to:
o Evaluation work plan
o TORs of the evaluation
o List of those interviewed
· Presentation of the findings, lessons learnt and recommendations
How to apply:
Interested consultants should submit expressions of interest to Fabien Maitre-Muhl Fabien.maitre-muhl@plan-uk.org by 6th June with “Evaluation: Haiyan response in the PHILIPPINES” in the subject line.
The detailed TOR including the overview of the project can be found here.
Expressions of interest must include:
CV/s of the team leader/team members
Financial proposal inclusive of budget and detailed costs (including daily rate)
Work plan and proposed timeline
2 examples of relevant work
2 work references
SELECTION CRITERIA
The following criteria will be used to select the consultant/s:
- University degree in political science, sociology, international relations, anthropology, public administration, development studies, gender studies or other relevant fields.
- Experience in carrying out program evaluations and good analytical and report writing skills
- Experience in the field of Health, Food Security and Livelihood and Protection
- Fluency in English and any of the local languages spoken in the project locations is desirable
- High quality technical proposal submitted
PLAN’S CHILD PROTECTION POLICY
Plan creates safe environments for children in all aspects of its work whether fundraising or program implementation, where children are respected, protected and empowered as their capacities evolve to contribute actively to the development of Child protection measures within Plan. Everyone who works with and engages with Plan has a responsibility to ensure that children are protected. Any consultant entering into agreement with Plan must adhere to its Child Protection Policy. All consultants visiting Plan communities must submit to a full background check.
Plan’s Child Protection Policy and Code of Conduct ensures that staff, associates, and visitors are clear about expectations placed on them to prevent and respond to child abuse and the consequences of failing to do so.
As such, Plan is requiring possible consultants to include ethical and child protection statements in their proposals detailing how such measures will be implemented during the data collection and assessment processes.
Annexes:
Full project documents will be provided once the consultancy is instructed.