|
|
| Line 22: |
Line 22: |
| | ===== '''Quantitative impact evaluation''' ===== | | ===== '''Quantitative impact evaluation''' ===== |
| | | | |
| − | Quantitative impact evaluation have a comparative advantage in addressing the issue of attribution: <span style="font-size: 10pt"><font face="Arial">Evaluations can either be <font color="#002bb8">[[Experimental Design|experimental]]</font> (or randomized control designed) as when the evaluator purposely collects data and designs evaluations in advance or <font color="#002bb8">[[Quasi-Experimental or Non-Experimental Designs|quasi-experimental]]</font> as when data are collected to mimic an experimental situation. [http://www.endev.info/wiki/extensions/FCKeditor/fckeditor/editor/Multiple%20Regression%20Analysis <font color="#002bb8">Multiple regression analysis</font>] is the all-purpose technique that can be used in virtually all settings; when the experiment is organized in such a way that no controls are needed, a simple comparison of means can be used instead of a regression since it will give the same answer.</font></span><span style="font-size: 10pt"><font face="Arial"><span style="font-size: 10pt; font-family: 'arial','sans-serif'">Three related problems that quantitative impact evaluation techniques attempt to address are the following: </span></font></span> | + | Quantitative impact evaluation have a comparative advantage in addressing the issue of attribution: <span style="font-size: 10pt"><font face="Arial">Evaluations can either be <font color="#002bb8">[[Experimental Design|experimental]]</font> (or randomized control designed) as when the evaluator purposely collects data and designs evaluations in advance or <font color="#002bb8">[[Quasi-Experimental or Non-Experimental Designs|quasi-experimental]]</font> as when data are collected to mimic an experimental situation. [http://www.endev.info/wiki/extensions/FCKeditor/fckeditor/editor/Multiple%20Regression%20Analysis <font color="#002bb8">Multiple regression analysis</font>] is the all-purpose technique that can be used in virtually all settings; when the experiment is organized in such a way that no controls are needed, a simple comparison of means can be used instead of a regression since it will give the same answer.</font></span><span style="font-size: 10pt"><font face="Arial"><span style="font-size: 10pt; font-family: 'arial','sans-serif'">Three related problems that quantitative impact evaluation techniques attempt to address are the following: </span></font></span> |
| | | | |
| | *<span style="font-size: 10pt; font-family: 'arial','sans-serif'">the establishment of a ''counterfactual'': What would have happened in the absence of the intervention(s); </span> | | *<span style="font-size: 10pt; font-family: 'arial','sans-serif'">the establishment of a ''counterfactual'': What would have happened in the absence of the intervention(s); </span> |
| Line 30: |
Line 30: |
| | ===== '''Qualitative impact evaluation''' ===== | | ===== '''Qualitative impact evaluation''' ===== |
| | | | |
| − | <span style="font-size: 10pt; mso-bidi-font-family: arial"><font face="Arial">Survey data collection and <font color="#002bb8">(descriptive) analysis</font>, <font color="#002bb8">semi-structured interviews</font>, and <font color="#002bb8">focus-group interviews are</font> but a few of the specific methods that are found throughout the landscape of methodological approaches to impact evaluation.</font></span><span style="font-size: 9pt; font-family: 'univers-condensed','sans-serif'; mso-bidi-font-family: univers-condensed">Qualitative techniques cannot quantify the changes attributable to interventions but should be used </span><span style="font-size: 9pt; font-family: 'univers-condensed','sans-serif'; mso-bidi-font-family: univers-condensed">to evaluate important issues for which quantification is not feasible or practical, and to develop complementary </span><span style="font-size: 9pt; font-family: 'univers-condensed','sans-serif'; mso-bidi-font-family: univers-condensed">and in-depth perspectives on processes of change induced by interventions.</span> | + | <span style="font-size: 10pt; mso-bidi-font-family: arial"><font face="Arial">Survey data collection and <font color="#002bb8">(descriptive) analysis</font>, <font color="#002bb8">semi-structured interviews</font>, and <font color="#002bb8">focus-group interviews are</font> but a few of the specific methods that are found throughout the landscape of methodological approaches to impact evaluation.</font></span><span style="font-size: 9pt; font-family: 'univers-condensed','sans-serif'; mso-bidi-font-family: univers-condensed">Qualitative techniques cannot quantify the changes attributable to interventions but should be used </span><span style="font-size: 9pt; font-family: 'univers-condensed','sans-serif'; mso-bidi-font-family: univers-condensed">to evaluate important issues for which quantification is not feasible or practical, and to develop complementary </span><span style="font-size: 9pt; font-family: 'univers-condensed','sans-serif'; mso-bidi-font-family: univers-condensed">and in-depth perspectives on processes of change induced by interventions.</span> |
| | | | |
| | ===== '''Other approaches''' ===== | | ===== '''Other approaches''' ===== |
| Line 36: |
Line 36: |
| | <span style="font-size: 10pt; font-family: 'arial','sans-serif'">Nowadays, participatory methods have become ‘mainstream’ tools in development in almost every area of policy intervention. Participatory evaluation approaches are built on the principle that stakeholders should be involved in some or all stages of the evaluation. In the case of impact evaluation this includes aspects such as the determination of objectives, indicators to be taken into account, as well as stakeholder participation in data collection and analysis. </span> | | <span style="font-size: 10pt; font-family: 'arial','sans-serif'">Nowadays, participatory methods have become ‘mainstream’ tools in development in almost every area of policy intervention. Participatory evaluation approaches are built on the principle that stakeholders should be involved in some or all stages of the evaluation. In the case of impact evaluation this includes aspects such as the determination of objectives, indicators to be taken into account, as well as stakeholder participation in data collection and analysis. </span> |
| | | | |
| − | *<span style="font-size: 10pt; font-family: 'arial','sans-serif'">Methodologies commonly included under this umbrella include: </span>
| + | <span style="font-size: 10pt; font-family: 'arial','sans-serif'">Methodologies commonly included under this umbrella include: </span> |
| − | *<span style="font-size: 10pt; font-family: 'arial','sans-serif'">Appreciative Inquiry (AI),</span>
| + | |
| − | *<span style="font-size: 10pt; font-family: 'arial','sans-serif'"> Citizen Report Cards (CRCs), </span>
| + | *<span style="font-size: 10pt; font-family: 'arial','sans-serif'">Participatory Impact Monitoring </span> |
| − | *<span style="font-size: 10pt; font-family: 'arial','sans-serif'">Community Score Cards (CSCs), </span>
| + | *<span style="font-size: 10pt; font-family: 'arial','sans-serif'">the Participatory Learning and Action (PLA) family</span> |
| − | *<span style="font-size: 10pt; font-family: 'arial','sans-serif'">Beneficiary Assessment (BA),</span>
| + | *<span style="font-size: 10pt; font-family: 'arial','sans-serif'">including Rapid Rural Appraisal (RRA), </span> |
| − | *<span style="font-size: 10pt; font-family: 'arial','sans-serif'"> Participatory Impact Monitoring </span> | + | |
| − | *<span style="font-size: 10pt; font-family: 'arial','sans-serif'">the Participatory Learning and Action (PLA) family</span> | + | |
| − | *<span style="font-size: 10pt; font-family: 'arial','sans-serif'"> including Rapid Rural Appraisal (RRA), </span> | + | |
| | *<span style="font-size: 10pt; font-family: 'arial','sans-serif'">Participatory Rural Appraisal (PRA), and </span> | | *<span style="font-size: 10pt; font-family: 'arial','sans-serif'">Participatory Rural Appraisal (PRA), and </span> |
| | *<span style="font-size: 10pt; font-family: 'arial','sans-serif'">Participatory Poverty Assessment (PPA), </span> | | *<span style="font-size: 10pt; font-family: 'arial','sans-serif'">Participatory Poverty Assessment (PPA), </span> |
| − | *<span style="font-size: 10pt; font-family: 'arial','sans-serif'">Policy and Social Impact Analysis (PSIA), Social Assessment (SA), </span> | + | *<span style="font-size: 10pt; font-family: 'arial','sans-serif'">Policy and Social Impact Analysis (PSIA), Social Assessment (SA).</span> |
| − | *<span style="font-size: 10pt; font-family: 'arial','sans-serif'">Systematic Client Consultation (SSC), </span>
| + | |
| − | *<span style="font-size: 10pt; font-family: 'arial','sans-serif'">Self-esteem, associative strength, </span><span style="font-size: 10pt; color: windowtext; font-family: 'arial','sans-serif'">resourcefulness, action planning and responsibility (SARAR), and </span>
| + | |
| − | *<span style="font-size: 10pt; color: windowtext; font-family: 'arial','sans-serif'">Objectives-Oriented Project Planning (ZOPP).</span>
| + | |
| | | | |
| | | | |
Quantitative impact evaluation have a comparative advantage in addressing the issue of attribution: Evaluations can either be experimental (or randomized control designed) as when the evaluator purposely collects data and designs evaluations in advance or quasi-experimental as when data are collected to mimic an experimental situation. Multiple regression analysis is the all-purpose technique that can be used in virtually all settings; when the experiment is organized in such a way that no controls are needed, a simple comparison of means can be used instead of a regression since it will give the same answer.Three related problems that quantitative impact evaluation techniques attempt to address are the following:
