Impact Monitoring Guidelines

Revision as of 13:10, 30 November 2009

The focus of the EnDev 2 M&E Sytem has shifted from Outcome Monitoring (EnDev 1) to Outcome and Impact Monitoring (EnDev 2). Therefore the Monitoring Group are developing recommendations for a "proper" impact M&E System.

We recommend to:

use the recommended list of indicators
conduct baseline studies before project intervention and impact studies after households, social infrastructure or SMEs got access to a form of modern energy
a theory based approach by applying the result chain for developing the study design
use a mixed methods approach: the logic of the comparative advantages of methods: that means the mix of quantitative (standarised household interviews) and qualitative methods (open/ semi-structured interviews with key persons and households or focus group discussions)
to include control groups if possible (households which do not have acces to modern energy) into your baseline and impact study

The following table shows typical steps for baseline and impact studies, which we would recommend and support.

Steps	Tasks	Materials/ Support	Library
Step 1: Preperation	Terms for Consultants/ Enumerators	Sample Terms for national / international consultants Sample Terms for enumerators	ToR Consultants: Tor Baseline Study (Rwanda PSP Hydro) german version ToR Survey french version ToR Evaluation english version Further Documents
	Selection Consultant/ Enumerators	Consultants
	Study of available documents and statistics on national development goals and policies, national sector goals and policies, BMZ goals and concept for the partner country	Checklist on relevant development goals	UNDP Energy Services for the Millennium Development Goals BMZ Sustainable Energy for Development
	Developing of Results Chains/ Indicators	Sample Results Chain Impact Criteria and indicators	Rural Electrifciation: Result Chain german version Result Chain engl. version Result Chain french version Cooking Energy Impacts, Observation Fields and Indicators IA Kenya: Result Chain IA Ethiopia: Result Chain IA Kenya: Model List of Impacts, Observation Fields and Indicators Further Documents
	Developing of Questionnaires, interview guidelines, PRA tools (MAPP), observation criteria and other tools	Questionnaires for HH (stoves), stove producers, social institutions and restaurants using ICS PRA tools for focus group discussions (MAPP) Interview guidelines for village authorities Observation criteria for stoves in use (example lists of good cooking practices and of stove conditions)	General Questionnaire HH (french version) Questionnaires, PRA tools, Interview Guidelines: Country documents / Impact Studies Material Uganda: Stove Observation Criteria Kenya: Good Cooking Practises Further Documents
	Sampling/ Selection target Group	Guidelines / Sampling & Selection Criterias Poverty criteria for selection of HH	Kenya: Selection Criteria for HH, SI, PU and Producers IA Kenya: Local Poverty criteria (example from local village authorities) Further Documents
	Training of Supervisors and Enumerators/ Pretesting	Training Material Training Agenda	Supervisors and Enumerators Example Training Agenda (french version) Kenya: ICS Training of Enumerators Further Documents
Step 2: Implementation	Logistics	Checklist on how to implement HH Interviews
	Conducting Interviews		Manual Conducting Interviews (english version) Manual Conducting Interviews (french version) Further Documents
	Data entry
Step 3: Data Analysis/ Reporting	Data analysis	Guiding Questions for data analysis	Kenya Stove HH: Guiding Questions for data analysis Kenya Stove Producer: Guiding Question for data analysis Further Documents
	Data interpretation – in exchange with the project team (in a workshop)	Checklist for data interpretation
	Report writing	Example for report summary Example for ICS description (Annex)

@@ Line 67: / Line 67: @@
 *IA Kenya: [http://www.endev.info/index.php?option=com_docman&task=doc_download&gid=183&&Itemid=13 Result Chain]
 *IA Ethiopia: [http://www.endev.info/index.php?option=com_docman&task=doc_download&gid=206&&Itemid=13 Result Chain]
 *IA Kenya: [http://www.endev.info/index.php?option=com_docman&task=doc_download&gid=181&&Itemid=13 Model List of Impacts, Observation Fields and Indicators]
+*[http://www.endev.info/wiki/index.php/Library_Further_Documents Further Documents]
 |
@@ Line 83: / Line 84: @@
 *Questionnaires, PRA tools, Interview Guidelines:[[Examples Questionnaires|&nbsp;Country documents]]&nbsp;/ [http://www.endev.info/wiki/index.php/Impact_Studies_Material#General Impact Studies Material&nbsp;]
 *Uganda: [http://www.endev.info/index.php?option=com_docman&task=doc_download&gid=498 Stove Observation Criteria]
 *Kenya: [http://www.endev.info/index.php?option=com_docman&task=doc_download&gid=499 Good Cooking Practises]
+*[http://www.endev.info/wiki/index.php/Library_Further_Documents Further Documents]
 |
@@ Line 95: / Line 97: @@
 |
 *Kenya:&nbsp;[http://www.endev.info/index.php?option=com_docman&task=doc_download&gid=185&&Itemid=13 Selection Criteria for HH, SI, PU and Producers IA]&nbsp;
 *Kenya: [http://www.endev.info/index.php?option=com_docman&task=doc_download&gid=505 Local Poverty criteria (example from local village authorities)]
+*[http://www.endev.info/wiki/index.php/Library_Further_Documents Further Documents]
 |
@@ Line 107: / Line 110: @@
 |
 *Supervisors and Enumerators&nbsp;[http://www.endev.info/index.php?option=com_docman&task=doc_download&gid=511 Example Training Agenda]&nbsp;(french version)&nbsp;
 *Kenya: [http://www.endev.info/index.php?option=com_docman&task=doc_download&gid=504 ICS Training of Enumerators]
+*[http://www.endev.info/wiki/index.php/Library_Further_Documents Further Documents]
 |
@@ Line 126: / Line 130: @@
 |
 *Manual <font color="#002bb8">[http://www.endev.info/index.php?option=com_docman&task=doc_download&gid=520 Conducting Interviews]</font>&nbsp;(english version)&nbsp;
 *Manual [http://www.endev.info/index.php?option=com_docman&task=doc_download&gid=515 Conducting Interviews]&nbsp;(french version)&nbsp;
+*[http://www.endev.info/wiki/index.php/Library_Further_Documents Further Documents]
 |
@@ Line 143: / Line 148: @@
 |
 *Kenya Stove HH: [http://www.endev.info/index.php?option=com_docman&task=doc_download&gid=523 Guiding Questions for data analysis]
 *Kenya Stove Producer: [http://www.endev.info/index.php?option=com_docman&task=doc_download&gid=192&&Itemid=13 Guiding Question for data analysis]
+*[http://www.endev.info/wiki/index.php/Library_Further_Documents Further Documents]
 |

Community

About

Help

Contact

Search

Main Page

About energypedia

Technologies

Energy Use

Cross Cutting Issues

energypedia consult

Search

Toolbox

Namespaces

Variants

Views

Actions

Impact Monitoring Guidelines

Revision as of 13:10, 30 November 2009

Log in / create account

Community

About

Help

Contact

Search

Main Page

About energypedia

Technologies

Energy Use

Cross Cutting Issues

energypedia consult

Search

Toolbox

Namespaces

Variants

Views

Actions

Impact Monitoring Guidelines

Revision as of 13:10, 30 November 2009