Case Studies: Monitoring & Evaluation

Africa, Assessment Study of the Vi Agroforestry Programme, 2000, SIDA

The programme seeks to improve the livelihoods of small-scale rural poor farmers in the Lake Victoria area. This is achieved through direct assistance - through tree planting and agroforestry to improve land management - to increase food and nutritional security, fuelwood availability and income. LTS was contracted by SIDA to undertake the 'assessment study' of the Vi programme, which has not seen an evaluation for four years. The team appraised the relevance and efficiency of activities, specifically Vi's technical progress, capacity and cost efficiency in relation to its goals and objectives. It looked at the socio-economic impact of the activities with regard to gender, income generation and improved livelihoods of the poor. It also examined the ecological impact and sustainability of activities, the degree of local participation, the efficiency and cost effectiveness of project management, the M&E system, and sources of financing.

Ethiopia, AWASH Conservation and Development Project, 2002-2003, CARE International

CARE Ethiopia implements the AWASH Project in collaboration with the Ethiopian Wildlife Conservation Organisation (EXCO) and the Regional Governments. The concept of community approaches to conservation is considered experimental in Ethiopia, thus the project is being regarded as a testing ground for new policy direction in the wildlife sector. LTS consultants provided process support to the project and CARE Ethiopia including the development of a monitoring & evaluation plan for the project, training and re-orientation of staff and change management to enable the project to become an Integrated Conservation & Development Project (ICDP), advice on the development and implementation of participatory natural resource management planning, and policy advice.

Ghana, Protected Area Development Project, 2002, European Commission

The Protected Areas Development Programme (PADP) in Western Region, Ghana, started in 1997 and produced management plans for the Bia and Ankasa Conservation Areas. The Programme also implemented infrastructure development within each area and included a pilot off-reserve community based wildlife management initiative. LTS was commissioned to undertake a Final Evaluation of the PADP in accordance with EC evaluation guidelines and provided a team of technical and financial consultants.

Ghana, Gwira Banso Joint Forest Management Project, 2002, CARE Denmark/DANIDA

The project was implemented through close collaboration of its two components. One component focused on sustainable timber production and community benefits in their off reserve concession area, including raising awareness on the benefits of growing trees for local farmers. The second component aimed to increase the capacity of individual farmers and local institutions to implement economically, ecologically and socially sustainable land use practices which support forest maintenance and improve rural livelihoods. LTS provided an international Team Leader and specialist in participatory forest management, who was supported by a local iinstitutional development expert and a technical and policy expert.

India, Review of the Jharkhand Community Forestry Project, 2002, World Bank

The proposed five-year Jharkhand Community Forestry Project developed mechanisms to promote and sustain a transition from Joint Forest Management (JFM) to Community Forest Management (CFM). The adoption of CFM aimed to empower communities to take autonomous decisions regarding the management of forest resources. The project aimed to develop and strengthen participatory systems of natural resource management to improve the livelihoods of rural people in the forested areas. LTS was involved in reviewing the proposed project.

Indonesia, EC Indonesia Forest Sector Support Programme - Pre-completion Review, 2002, European Commission

The assignment consisted of the Forest Inventory and Monitory Project (FIMP) and the Integrated Radio Communications Systems (IRCS) Project. The Forest Fire Prevention and Control Project were also partly integrated into the programme. LTS provided an international evaluation team of undertake a pre-completion review of these project components.

Latvia, Economic and Social Impacts of the Green-Field Pulp Mill Project Baltic Pulp Investment in Latvia, 2001, Private

LTS undertook an assessment of the impacts of a proposed USD1bn pulp mill investment in Latvia. The key outputs included a concise report outlining the more significant costs and benefits of the proposed investment; recommendations for institutional changes which would enhance the Government's capacity to fully appraise the economic and social benefits that might accrue, at regional and national levels, from inward investments and projects for which State support had been requested; and a Forest Sector model which will allow decision-makers to test changes in assumptions and to evaluate different scenarios for the development of Latvia's forest industry. Validation of forecasts of future timber supply was coupled with an assessment of the raw material needs of existing and other planned processing capacity was particularly important.

Nepal, Review of the Royal Bardia National Park Buffer Zone Development Project - Phase II, 2002, CARE International

LTS provided the Team Leader to review an integrated conservation and development project working directly with NGOs, CBOs and the park authorities to effectively manage the biodiversity of the Park and it's buffer zone. LTS led project staff through an evaluation and reflection process that resulted in the Final Inception Report including an action plan to implement the reviews recommendations. The review considered all aspects of the project including the adoption of new technology that enables the sustainable intensification of agriculture, the promotion of income generation and household economic diversification to improve livelihood security.

Nigeria, Evaluation of the Living Earth Community Forestry Project in Cross River State, 2004, Living Earth UK

LTS provided the Team Leader to undertake an end of project evaluation of the EU-funded and Living Earth implemented community forestry programme based in Cross River State, Nigeria.

Panama, Costa Rica, Honduras, Nicaragua, Guatemala, El Salvador, Review of the Regional Assistance Programme for Fisheries Development in the Central American Isthmus - PRADEPESCA, 1999-2000, European Commission

The PRADEPESCA commenced in 1990 with the objective of forging the basis for co-ordinated and rational development of the fisheries sector in the Central American region. The programme aimed to encourage co-ordination between the fisheries sectors in each country and develop a regional framework for sustainable development of the sector. LTS was involved in a short term mission to review Phase 1 of the PRADPESCA programme and assess the potential for the fisheries sector in to aid the process of regional integration.

Romania, Development and Implementation of a Monitoring and Evaluation Plan, 2005, World Bank

LTS was contracted to establish a project M&E procedures for the Forest Development Project and to support the development and implementation of a Monitoring and Evaluation Systems within the Project Management Unit and at a sector level. The M&E system established is based on a key set of performance indicators that address related project interventions, including: forest ecosystem degradation, Gross National Income, Annual Allowable Cut, forest management plans, regulatory and governance capacity, and public awareness strategy. LTS provided a forestry and M&E specialist to carry out this assignment.

Tanzania, Development of a National Participatory Forest Management Monitoring System, 2003, DANIDA Denmark

The Government of Tanzania supports participatory forest management (PFM) as part of its strategy to achieve sustainable forest management by encouraging the management or co-management of forest and woodland resources by communities living closest to the resources. In addition, benefits to communities arising from PFM contribute towards reducing poverty. Faced with the challenge of acquiring information at local and national level to assess efficiency, effectiveness and impact of PFM towards achieving both National Forest Programme (NFP) and National Poverty Reduction Strategy (PRS) targets, the Government of Tanzania and DANIDA selected LTS to elaborate a PFM monitoring system. LTS mobilised a three person team to work with Forest and Beekeeping Division staff of the Ministry of Natural Resources and Tourism to review and assess existing PFM relevant monitoring systems currently in use, develop a national PFM monitoring system that builds on existing and emerging monitoring processes at local, district and national levels, and propose PFM monitoring indicators that are relevant and integrated within the National Poverty Reduction Monitoring Plan.

Tanzania, Development and Institutionalization of a National Forest Programme Monitoring Facility and Database, 2006-2007, World Bank

Tanzania's National Forest Programme (NFP) represents a ten-year strategic plan for the implementation of the Forestry Policy and Forestry Act. It is cross sectoral in scope and covers a range of activities, being implemented by players within national government, local government, local communities, civil society and the private sector. During 2006-2007, LTS will support the Forestry and Beekeeping Division and Tanzania Forest Management and Conservation Project financed by the World Bank develop a phased approach to the development of the information system to support the NFP. The primary objective of this assignment is to design, develop, establish, and institutionalize a functioning forest monitoring facility and database that draws on information generated at different levels and from different sectors, including local government. The forest information system will take into regard current information needs and future foreseen needs and integration with other national systems, and global forest information systems.

Tanzania, Mahale Ecosystem Management Project - Monitoring and Evaluation Plan, 2006 Frankfurt Zoological Society

The Mahale ecosystem bordering Lake Tanganyika is globally important for its tropical forest biodiversity as well as for supporting the local livelihoods. In recent years, there has been major disturbance to these communities and large refugee in-migration from regional conflicts. This upheaval has increased poverty and severely impacted on the ecosystem's natural resource base. LTS was contracted to lead the design and development of the monitoring and evaluation plan for the Mahale Ecosystem Management Project which was co-financed by the European Commission and implemented by Frankfurt Zoological Society in partnership with Tanzania National Parks. LTS trained project staff in logical framework based monitoring and evaluation, and facilitated the development of a monitoring and evaluation plan for the project. The task was also expanded to assist the project team to develop a similar monitoring and evaluation plan for the Mahale Mountains National Park Management Plan.

Vietnam, Output to Purpose Review of the Northern Mountains Poverty Reduction Project, 2003, UK Department for International Development

The Northern Mountains Poverty Reduction Project (NMPRP) is co-financed by the World Bank and DFID to the value of USD132.5 million and aims to benefit about 1 million rural poor, 85% of whom are ethnic minorities in six provinces of Vietnam. The project provides basic rural infrastructure and other demand led investments including basic education, health and agricultural extension services and facilities. LTS undertook a review and consultation with key stakeholders, and village interviews to assess the initial performance of the programme against the criteria set out in the project documents and logical framework; role of the programme within the broader poverty reductions efforts of the provinces, central government and other donors; and analysis of the relationships between key stakeholders in the project and the impact that they have had on the success of the project.

Vietnam, Country Strategy Paper Review, 2002, UK Department for International Development

DFID is currently in the process of reviewing its country strategy paper (CSP) in Vietnam in order to assess progress toward meeting the CSP's objectives, focussing in particular on improved income opportunities for the rural poor and a greater understanding of the causes, characteristics and consequences of poverty. LTS provided high-level governance support to the regional DFID field office in Thailand. The whole team assessed progress against the Logframe and progress against the priorities and expectations of the Government of Vietnam (GoV). Further, the level of uptake of innovative ideas and Lessons Learnt from DFID interventions within other donor funded programmes and GoV development planning provided insights to what extent DFID influenced the mind set at national level. Generic governance issues were captured through thematic case studies.

Worldwide, Darwin Initiative Monitoring and Evaluation / Management of Applications Process, 2003-2009, UK Department for Environmental Affairs

On behalf of the Edinburgh Centre for Tropical Forests, LTS is implementing the Monitoring and Evaluation and Management of the Applications Process for the Darwin Initiative for the UK Department for Food and Rural Affairs. The Darwin Initiative was launched at the Earth Summit, held in Rio de Janeiro in June 1992. The Initiative funds £5-7 million worth of projects per annum carried out by UK institutions in developing countries, Overseas Territories of the United Kingdom and countries whose economies are in transition. Successful projects are collaborative - involving local institutions and/or communities, promote and demonstrate sustainable use to contribute to poverty reduction, leave a lasting legacy and act as a catalyst for action. Building on from a successful Phase I, LTS now provides the overall technical and managerial inputs for the monitoring and evaluation project on behalf of ECTF and the Darwin Secretariat of Defra.

Worldwide, Evaluation of Finnish Forestry Sector Development Cooperation, 2002 - 2003, DIDC Finland

LTS fielded a team of 11 national and international consultants to evaluate Finnish forestry development assistance from 1990 to 2002. The aim was to focus on the programme as a whole using individual country programmes as sources of information. The target countries were Kenya, Namibia, Tanzania and the SADC Colleges programme in Africa: Laos, Nepal, Thailand and Vietnam in Asia and Mexico. Overall the findings were of high quality technical projects and good professional staff but a tendency to operate in isolation from wider issues. As a consequence, the wider impact was limited. There were several development policy changes applied by Finland during the period reviewed. The Team concluded that Finland has an important role to play in forestry development and a number of comparative advantages from its own history and its favourable political system. Nine recommendations were made to improve the focus and strategic delivery of forestry assistance within the current wider development framework. If adopted, the Team considers that there would be significantly greater wider impact from well-designed, well-managed interventions.

Worldwide, Evaluation of DFID's Ten Year Renewable Natural Resources Research Programme, 2004-2005, UK Department for International Development

LTS, in collaboration with the Oxford Policy Management Institute and the Norwegian Agricultural University, was selected to conduct an evaluation of DFID's ten year Renewable Natural Resources Research Programme. This evaluation constitutes an important opportunity to reassess and redirect DFID's RNRR programme and strategy within the context of DFID's agenda and priorities as stated in DFID's Research Funding Framework for 2005 to 2007 (final draft/May 2004). Our methodology is process based and designed to identify the impact of the Renewable Natural Resources Strategy on all its stakeholders, across the different disciplines and at practice and policy levels. We will identify key components of the research programmes that impact on poverty. Participatory methodologies will be used to ensure attribution of impacts to different stakeholders and draw together the lessons learnt from all components and relate them to the different stakeholders' interests.

Worldwide, Evaluation of International Certification Standards, 1998, Private

This study was undertaken to provide a critical assessment of international forest certification standards, including the perspective of industry on the future development of certification. LTS conducted market research to examine the views of the forest products industry, environmental NGOs, independent observers, retailers and certification organisations. A critical assessment was made of current certification standards and the future of certification.

  •