AGRICULTURAL INNOVATIONS GRANT FACILITY (AIGF) PNG

horizontal rule

Home
Up

Project evaluation seeks to assess for each project the relevance, efficiency, effectiveness, impact and sustainability.  These processes are described below (method of gathering information and method of assessment are shown in brackets):

·        Relevance – design of projects – objective correctly addresses  problems or real needs (provided in documentation, design logic assessment);

·        Efficiency – transformation of activities to results (monitoring of project implementation – assessment of results through survey, reports and inspections);

·        Effectiveness – whether the results achieved project purpose (inspection, report, survey - impact assessment);

·        Impact – relationship project purpose to overall AIGF objective (consideration of likely social and economic costs/benefits in the target group and wider community); and

·        Sustainability – of positive outcomes (longitudinal surveys – part of impact assessment). 

    Evaluation Process

All AIGF projects pass through five stages.  The impact assessment activities to be undertaken at each stage are as follows:

Stage 1: Expression of Interest.  Impact assessment needs to begin from the point at which a project is first conceptualised, which in the AIGF project cycle is the EOI stage.  The EOI is required to make a statement of the intended social and economic benefits of the proposed activity – these are the benefits which will later be assessed and where possible measured.  It is not necessary to be quantitative at EOI stage but applicants are expected to identify and describe the benefits and who will receive them.  The EOI procedures ask for a one paragraph description.

Responsibility for Task 1 lies with the institution submitting the EOI, with support as necessary from ACNARS advisers.

Stage 2: Project Proposal.  AIGF proposals call for a M&E framework and plan; when necessary ACNARS advisers will provide assistance to applicants to develop this plan.  Applicants should provide a well argued social and economic rationale for the project which further elaborates the benefits and costs of the proposed activity, and explains why the proposed approach is the best amongst possible alternatives.  In particular applicants are asked to specify: the size of the sector or industry targeted; the expected improvements in yields and/or prices; the likely adoption rates; the costs incurred by various parties; and the likely effects on markets and prices.

Responsibility for Task 2 lies with the institution submitting the Project Proposal, with support as necessary from ACNARS advisers.

Stage 3: Grant Agreement.  The Grant Agreement between AIGF and the recipient institution is the document which binds the grant recipient to undertake the activities described in the Project Proposal and details the milestones upon which AIGF will disburse payments to the recipient.  The Grant Agreement will also describe the monitoring and reporting requirements, the information which will need to be collected to undertake impact assessment, and who will be responsible for collecting this information.

Stage 4: Implementation.  Following an initial advance payment the grant recipient will proceed to implement the project in accordance with the grant agreement.

Stage 5: Impact Assessment.  Towards the end of the project implementation period, or soon after, AIGF will provide the services of a M&E Consultant to assist in assessing project impact.  This will be based on information gathered by the grant recipient during the implementation period (as specified in the grant agreement), as well as additional fact-finding work by the consultant.  The project cycle will be completed with preparation of a project impact assessment report which describes, and where possible quantifies, the social, financial and economic impacts of the project and the lessons learned from it. 

    Evaluation Plan

AIGF will engage 3-5 National consultants to undertake M&E and impact assessment work during the 18-month pilot phase, and these will be trained, mentored and assisted by ACNARS advisers.  The following tasks will be undertaken:

 

Task

Timing

Task 1: Recruit and train National M&E consultants and prepare detailed evaluation procedures.

The ACNARS M&E Adviser will provide a brief practical training program for the National consultants and will assist them in the design of several evaluation exercises and in conducting and analysing the evaluations.  The projects to be evaluated at this stage will be in the early stages of implementation, so these exercises will only be preliminary at this stage.

Aug - Oct

2004

Task 2: Undertake monitoring and evaluation of individual projects.

 This will be done by the National consultants during the project implementation phase, with the impact assessment to be undertaken near the end of the implementation phase or soon afterwards.  The ACNARS M&E adviser is providing ongoing guidance and comment as required.

 

2005

Task 3: Undertake a mid-term review (MTR) of all AIGF projects; timing depends on stage of each project. 

The MTR procedure is quick and inexpensive and provides a useful means of keeping track of implementation problems, making tactical adjustments to project designs, identifying the under-performing projects, and laying the foundation for end-of-project assessment. 

August 05 - March 06

Task 3: Complete overall AIGF impact assessment. 

Following completion of the individual project impact assessments the results will be aggregated and analysed to provide an overall picture of the impacts and lessons learned.  This will include direct as well as indirect impacts and both quantitative and qualitative performance measures.  The results will be used to make an informed decision on the success or failure of the pilot phase of AIGF, the lessons learned, and how to proceed in the future.

Jan - June 06

Thanks to David Young for assistance with developing the M&E system and IA study.  David Askin, Peter Walton and Laurie Fooks have assisted with development of tracking systems and Mike Bourke has assisted with defining the potential impact of projects. 

horizontal rule

 For problems or questions contact Ian Grant

Last updated: Monday, 08 May 2006, hosted by Global Technologies, PNG