Archive for the ‘Uncategorized’ Category

Dealing with missing data: A list

Sunday, November 20th, 2016

In this post "missing data" does not mean absence of whole categories of data, which is a common enough problem, but missing data values within a given data set. While this is a common problem in almost all spheres of research/evaluation it seems particularly common in more qualitative and participatory inquiry, ...

The sources of algorithmic bias

Sunday, November 20th, 2016

"The foundations of algorithmic bias", by Zacharay Chase Lipton, 2016. pdf copy here. Original source here "This morning, millions of people woke up and impulsively checked Facebook. They were greeted immediately by content curated by Facebook’s newsfeed algorithms. To some degree, this news might have influenced their perceptions of the day’s news, ...

Two useful papers on the practicalities of doing Realist Evaluation

Monday, August 15th, 2016

1. Punton, M., Vogel, I., & Lloyd, R. (2016, April). Reflections from a Realist Evaluation in Progress: Scaling Ladders and Stitching Theory. IDS. Available here  2. Manzano, A. (2016). The craft of interviewing in realist evaluation. Evaluation, 22(3), 342–360. Available here. Rick Davies comment: I have listed these two papers here because I think ...

The Value of Evaluation: Tools for Budgeting and Valuing Evaluations

Thursday, August 4th, 2016

Barr, J., Rinnert, D., Lloyd, R., Dunne, D., & Hentinnen, A. (2016, August). The Value of Evaluation: Tools for Budgeting and Valuing Evaluations Research for Development Output - GOV.UK. ITAF & DFID.   Exec Summary (first part): "DFID has been at the forefront of supporting the generation of evidence to meet the increasing demand ...

Process Tracing and Bayesian updating for impact evaluation

Thursday, July 14th, 2016

Befani, B., & Stedman-Bryce, G. (2016). Process Tracing and Bayesian updating for impact evaluation. Evaluation, 1356389016654584. http://doi.org/10.1177/1356389016654584 . Abstract: Commissioners of impact evaluation often place great emphasis on assessing the contribution made by a particular intervention in achieving one or more outcomes, commonly referred to as a ‘contribution claim’. Current theory-based approaches fail ...

Pathways to change: Evaluating development interventions with qualitative comparative analysis (QCA)

Tuesday, July 5th, 2016

by Barbara Befani, May 2016. Published by the Expert Group for Aid Studies, Stockholm.  Available in hardcover and as pdf "Qualitative Comparative Analysis (QCA) is a method particularly well suited for systematic and rigorous comparisons and synthesis of information over a limited number of cases. In addition to a presentation of the ...

A Review of Umbrella Fund Evaluation – Focusing on Challenge Funds

Friday, June 17th, 2016

This is a Specialist Evaluation and Quality Assurance Service - Service Request Report, authored by Lydia Richardson with David Smith and Charlotte Blundy of TripleLine, in October 2015. A pdf copy is available As this report points out, Challenge Funds are common means of funding development aid projects but they have not received ...

USAID: A GUIDE TO THE MODIFIED BASIC NECESSITIES SURVEY WHY AND HOW TO CONDUCT BNS IN CONSERVATION LANDSCAPES

Sunday, May 1st, 2016

Published June 2015. The principle authors of this guide are Dr. David Wilkie, Dr. Michelle Wieland and Diane Detoeuf of WCS. With thanks to Dr. Rick Davies for many useful discussions and comments about adding the value of owned assets to the BNS (the modifcation). Available as pdf "This manual is offered ...

Power calculation for causal inference in social science: Sample size and minimum detectable effect determination

Saturday, April 9th, 2016

Eric W Djimeu, Deo-Gracias Houndolo, 3ie Working Paper 26, March 2016. Available as pdf Contents 1. Introduction 2. Basic statistics concepts: statistical logic 3. Power calculation: concept and applications 3.1. Parameters required to run power calculations 3.2. Statistical power and sample size determination 3.3. How to run power calculation: single treatment or multiple treatments? 4. Rules of thumb for ...

Evaluating the impact of flexible development interventions

Thursday, March 31st, 2016

ODI Methods Lab  report. . March 2016 Rick Davies. Available as pdf "Evaluating the impact of projects that aim to be flexible and responsive is a challenge. One of the criteria for good impact evaluation is rigour – which, broadly translated, means having a transparent, defensible and replicable process of data collection ...