Impact Monitoring Guidelines

Revision as of 14:18, 26 October 2009

The focus of the EnDev 2 M&E Sytem has shifted from Outcome Monitoring (EnDev 1) to Outcome and Impact Monitoring (EnDev 2). Therefore the Monitoring Group are developing recommendations for a "proper" impact M&E System.

We recommend to:

conduct baseline studies before project intervention and impact studies after households, social infrastructure or SMEs got access to a form of modern energy
use a mix of quantitative (standarised household interviews) and qualitative methods (open/ semi-structured interviews with key persons and households or focus group discussions)
a theory based approach by applying the result chain for developing the study design
to include control groups if possible (households which do not have acces to modern energy) into your baseline and impact study

The following table shows typical steps for baseline and impact studies, which we would recommend and support.

Steps	Tasks	Materials/ Support	Library
Step 1: Preperation	Terms for Consultants/ Enumerators	Sample Terms for national / international consultants Sample Terms for enumerators
	Selection Consultant/ Enumerators	Consultants
	Study of available documents and statistics on national development goals and policies, national sector goals and policies, BMZ goals and concept for the partner country	Checklist on relevant development goals	UNDP Energy Services for the Millennium Development Goals BMZ Sustainable Energy for Development
	Developing of Results Chains/ Indicators	Sample Results Chain Impact Criteria and indicators	EnDev: Guide Impact Assessment (IA) IA ProBEC Malawi: Proposed Concept Cooking Energy Impacts, Observation Fields and Indicators IA Kenya: Result Chain IA Ethiopia: Result Chain IA Kenya: Model List of Impacts, Observation Fields and Indicators
	Developing of Questionnaires, interview guidelines, PRA tools (MAPP), observation criteria and other tools	Questionnaires for HH (stoves), stove producers, social institutions and restaurants using ICS PRA tools for focus group discussions (MAPP) Interview guidelines for village authorities Observation criteria for stoves in use (example lists of good cooking practices and of stove conditions)	Questionnaires, PRA tools, Interview Guidelines, Observation Criteria: Country Example documents / Impact Studies Material
	Sampling/ Selection target Group	Guidelines/ Selection Criterias Poverty criteria for selection of HH	Kenya: Selection Criteria for HH, SI, PU and Producers IA Malawi IA ProBec: Final Scope Kenya: Local Poverty criteria (example from local village authorities)
	Training of Supervisors and Enumerators/ Pretesting	Training Material Training Agenda	Supervisors and Enumerators Example Training Agenda Kenya: ICS Training of Enumerators
Step 2: Implementation	Logistics	Checklist on how to implement HH Interviews
	Conducting Interviews		Manual Conducting Interviews (french version)
	Data entry
Step 3: Data Analysis/ Reporting	Data analysis	Guiding Question for data analysis	Kenya Stove HH: Guiding Question for data analysis Kenya Stove Producer: Guiding Question for data analysis
	Data interpretation – in exchange with the project team (in a workshop)	Checklist for data interpretation
	Report writing	Example for report summary Example for ICS description (Annex)

@@ Line 53: / Line 53: @@
 |
-*EnDev [http://www.endev.info/index.php?option=com_docman&task=doc_download&gid=175&&Itemid=13 Guide Impact Assessment (IA)&nbsp;]&nbsp;
+*EnDev: [http://www.endev.info/index.php?option=com_docman&task=doc_download&gid=175&&Itemid=13 Guide Impact Assessment (IA)&nbsp;]&nbsp;
-*IA ProBEC Malawi [http://www.endev.info/index.php?option=com_docman&task=doc_download&gid=176&&Itemid=13 Proposed Concept]&nbsp;
+*IA ProBEC Malawi: [http://www.endev.info/index.php?option=com_docman&task=doc_download&gid=176&&Itemid=13 Proposed Concept]&nbsp;
 *Cooking&nbsp;[http://www.endev.info/index.php?option=com_docman&task=doc_download&gid=381 Energy Impacts, Observation Fields and Indicators]
-*IA Kenya [http://www.endev.info/index.php?option=com_docman&task=doc_download&gid=183&&Itemid=13 Result Chain]
+*IA Kenya: [http://www.endev.info/index.php?option=com_docman&task=doc_download&gid=183&&Itemid=13 Result Chain]
-*IA Ethiopia [http://www.endev.info/index.php?option=com_docman&task=doc_download&gid=206&&Itemid=13 Result Chain]
+*IA Ethiopia: [http://www.endev.info/index.php?option=com_docman&task=doc_download&gid=206&&Itemid=13 Result Chain]
-*IA Kenya [http://www.endev.info/index.php?option=com_docman&task=doc_download&gid=181&&Itemid=13 Model List of Impacts, Observation Fields and Indicators]
+*IA Kenya: [http://www.endev.info/index.php?option=com_docman&task=doc_download&gid=181&&Itemid=13 Model List of Impacts, Observation Fields and Indicators]
 |
@@ Line 82: / Line 82: @@
 |
-*Kenya&nbsp;[http://www.endev.info/index.php?option=com_docman&task=doc_download&gid=185&&Itemid=13 Selection Criteria for HH, SI, PU and Producers IA]
+*Kenya:&nbsp;[http://www.endev.info/index.php?option=com_docman&task=doc_download&gid=185&&Itemid=13 Selection Criteria for HH, SI, PU and Producers IA]
-*Malawi IA ProBec [http://www.endev.info/index.php?option=com_docman&task=doc_download&gid=184&&Itemid=13 Final Scope]
+*Malawi IA ProBec: [http://www.endev.info/index.php?option=com_docman&task=doc_download&gid=184&&Itemid=13 Final Scope]
-*Kenya: [http://www.endev.info/wiki/index.php/Impact_Studies_Material#General Local Poverty criteria (example from local village authorities)]
+*Kenya: [http://www.endev.info/index.php?option=com_docman&amp;task=doc_download&amp;gid=505 Local Poverty criteria (example from local village authorities)]
 |

Community

About

Help

Contact

Search

Main Page

About energypedia

Technologies

Energy Use

Cross Cutting Issues

energypedia consult

Search

Toolbox

Namespaces

Variants

Views

Actions

Impact Monitoring Guidelines

Revision as of 14:18, 26 October 2009

Log in / create account

Community

About

Help

Contact

Search

Main Page

About energypedia

Technologies

Energy Use

Cross Cutting Issues

energypedia consult

Search

Toolbox

Namespaces

Variants

Views

Actions

Impact Monitoring Guidelines

Revision as of 14:18, 26 October 2009