|
|
|
Project evaluation seeks to assess for each project the relevance, efficiency, effectiveness, impact and sustainability. These processes are described below (method of gathering information and method of assessment are shown in brackets): · Relevance – design of projects – objective correctly addresses problems or real needs (provided in documentation, design logic assessment); · Efficiency – transformation of activities to results (monitoring of project implementation – assessment of results through survey, reports and inspections); · Effectiveness – whether the results achieved project purpose (inspection, report, survey - impact assessment); · Impact – relationship project purpose to overall AIGF objective (consideration of likely social and economic costs/benefits in the target group and wider community); and · Sustainability – of positive outcomes (longitudinal surveys – part of impact assessment). Evaluation ProcessAll AIGF projects pass through five stages. The impact assessment activities to be undertaken at each stage are as follows: Stage 1: Expression of Interest. Impact assessment needs to begin from the point at which a project is first conceptualised, which in the AIGF project cycle is the EOI stage. The EOI is required to make a statement of the intended social and economic benefits of the proposed activity – these are the benefits which will later be assessed and where possible measured. It is not necessary to be quantitative at EOI stage but applicants are expected to identify and describe the benefits and who will receive them. The EOI procedures ask for a one paragraph description. Responsibility for Task 1 lies with the institution submitting the EOI, with support as necessary from ACNARS advisers. Stage 2: Project Proposal. AIGF proposals call for a M&E framework and plan; when necessary ACNARS advisers will provide assistance to applicants to develop this plan. Applicants should provide a well argued social and economic rationale for the project which further elaborates the benefits and costs of the proposed activity, and explains why the proposed approach is the best amongst possible alternatives. In particular applicants are asked to specify: the size of the sector or industry targeted; the expected improvements in yields and/or prices; the likely adoption rates; the costs incurred by various parties; and the likely effects on markets and prices. Responsibility for Task 2 lies with the institution submitting the Project Proposal, with support as necessary from ACNARS advisers. Stage 3: Grant Agreement. The Grant Agreement between AIGF and the recipient institution is the document which binds the grant recipient to undertake the activities described in the Project Proposal and details the milestones upon which AIGF will disburse payments to the recipient. The Grant Agreement will also describe the monitoring and reporting requirements, the information which will need to be collected to undertake impact assessment, and who will be responsible for collecting this information. Stage 4: Implementation. Following an initial advance payment the grant recipient will proceed to implement the project in accordance with the grant agreement. Stage 5: Impact Assessment. Towards the end of the project implementation period, or soon after, AIGF will provide the services of a M&E Consultant to assist in assessing project impact. This will be based on information gathered by the grant recipient during the implementation period (as specified in the grant agreement), as well as additional fact-finding work by the consultant. The project cycle will be completed with preparation of a project impact assessment report which describes, and where possible quantifies, the social, financial and economic impacts of the project and the lessons learned from it. Evaluation PlanAIGF will engage 3-5 National consultants to undertake M&E and impact assessment work during the 18-month pilot phase, and these will be trained, mentored and assisted by ACNARS advisers. The following tasks will be undertaken:
Thanks to David Young for assistance with developing the M&E system and IA study. David Askin, Peter Walton and Laurie Fooks have assisted with development of tracking systems and Mike Bourke has assisted with defining the potential impact of projects.
|
|
Last updated: Monday, 08 May 2006, hosted by Global Technologies, PNG |