Archive for the ‘Uncategorized’ Category

Qualitative Comparative Analysis – A Rigorous Qualitative Method for Assessing Impact

Saturday, June 6th, 2015

A Coffey How-To note, June 2015, by Carrie Baptist and Barbara Befani. Available as pdf Summary QCA is a case based method which allows evaluators to identify different combinations of factors that are critical to a given outcome, in a given context. This allows for a more nuanced understanding of how different combinations of ...

Category refinement in humanitarian needs assessments

Wednesday, May 27th, 2015

MODERATE NEED, ACUTE NEED Valid categories for humanitarian needs assessments? Evidence from a recent needs assessment in Syria 26 MARCH 2015 by Aldo Benini, Needs assessments in crises seek to establish, among other elements, the number of persons in need. “Persons in need” is a broad and fuzzy concept; the estimates that local key informants provide ...

Impact Evaluation: A Guide for Commissioners and Managers

Monday, May 18th, 2015

Prepared by Elliot Stern for the Big Lottery Fund, Bond, Comic Relief and the Department for International Development, May 2015 Available as pdf 1. Introduction and scope 2 2. What is impact evaluation? 4 Defining impact and impact evaluation 4 Linking cause and effect 5 Explanation and the role of ‘theory’ 7 Who defines impact? 7 Impact evaluation and ...

Beneficiary Feedback in Evaluation

Friday, May 8th, 2015

Produced for DFID Evaluation Department by Lesley Groves, February 2015. Available as a pdf The purpose of this paper is to analyse current practice of beneficiary feedback in evaluation and to stimulate further thinking and activity in this area. The Terms of Reference required a review of practice within DFID and externally. ...

Straws-in-the-wind, Hoops and Smoking Guns: What can Process Tracing Offer to Impact Evaluation?

Saturday, April 25th, 2015

[Spotted via  tweet by Chris Roche] Punton, M., Welle, K., 2015. Straws-in-the-wind, Hoops and Smoking Guns: What can Process Tracing Offer to Impact Evaluation? Available as pdf See also the Annex Applying Process Tracing in Five Steps, also available as pdf Abstract:  "This CDI Practice Paper by Melanie Punton and Katharina Welle explains the methodological and theoretical ...

Evidence based medicine: a movement in crisis?

Tuesday, April 21st, 2015

Greenhalgh, T., Howick, J., Maskrey, N.,Evidence based medicine: a movement in crisis? , 2014. BMJ 348 http://www.bmj.com/content/348/bmj.g3725 Available as pdf This paper popped up in a comments made on Chris Roche's posting on the From Poverty to Power website Rick Davies comment: The paper is interesting in the first instance because both the debate and ...

Process Tracing: From Metaphor to Analytic Tool

Tuesday, March 24th, 2015

Bennett, A., Checkel, J. (Eds.), 2014. Process Tracing: From Metaphor to Analytic Tool. Cambridge University Press Search the contents via Google Books "This book argues that techniques falling under the label of process tracing are particularly well suited for measuring and testing hypothesized causal mechanisms. Indeed, a growing number of political scientists now invoke ...

How to interpret P values, according to xkcd :-)

Tuesday, March 3rd, 2015

Background:  "When you perform a hypothesis test in statistics, a p-value helps you determine the significance of your results. Hypothesis tests are used to test the validity of a claim that is made about a population. This claim that’s on trial, in essence, is called the null hypothesis....(continue here...) The xkcd view  

THE FUTURE OF EVALUATION: 10 PREDICTIONS (& you can add your votes)

Tuesday, March 3rd, 2015

From John Garnagi's EvalBlog post of 30 January 2015 See also the 40+ comments posted there as well As someone said, "Making predictions can be difficult, especially about the future" Give your opinions on these predictions via the online poll at the bottom of this page, and see what others think See also other ...

How Systematic Is That Systematic Review? The Case of Improving Learning Outcomes

Tuesday, March 3rd, 2015

(copy of a blog posting by David Evans on 2015/03/02 on the World Bank Development Impact blog) Rick Davies Comment: I have highlighted interesting bits of text in red. The conclusions, also in red, are worth noting. And...make sure you check out the great (as often)  xkcd comic at the end of ...