Archive for the ‘Uncategorized’ Category

REAL-WORLD CHALLENGES TO RANDOMIZATION AND THEIR SOLUTIONS

Monday, May 8th, 2017

Kenya Heard, Elisabeth O’Toole, Rohit Naimpally, Lindsey Bressler. J-PAL North America, April 2017. pdf copy here INTRODUCTION Randomized evaluations, also called randomized controlled trials (RCTs), have received increasing attention from practitioners, policymakers, and researchers due to their high credibility in estimating the causal impacts of programs and policies. In a randomized evaluation, a random ...

Riddle me this: How many interviews (or focus groups) are enough?

Monday, May 8th, 2017

Emily Namey, R&E Search for Evidence http://researchforevidence.fhi360.org/author/enamey "The first two posts in this series describe commonly used research sampling strategies and provide some guidance on how to choose from this range of sampling methods. Here we delve further into the sampling world and address sample sizes for qualitative research and evaluation ...

How to find the right answer when the “wisdom of the crowd” fails?

Sunday, April 9th, 2017

Dizekes, P. (2017). Better wisdom from crowds. MIT Office News. Retrieved from http://news.mit.edu/2017/algorithm-better-wisdom-crowds-0125  PDF copy pdf copy Ross, E. (n.d.). How to find the right answer when the “wisdom of the crowd” fails. Nature News. https://doi.org/10.1038/nature.2017.21370 Prelec, D., Seung, H. S., & McCoy, J. (2017). A solution to the single-question crowd wisdom problem.Nature, ...

Fact Checking websites serving as public evidence-monitoring services: Some sources

Thursday, March 2nd, 2017

These services seem to be getting more attention lately, so I thought it would be worthwhile compiling a list of some of the kinds of fact checking websites that exist, and how they work. Fact checkers have the potential to influence policies at all stages of the policy development and implementation ...

Integrating Big Data into the Monitoring and Evaluation of Development Programmes

Tuesday, January 24th, 2017

Bamberger, M. (2016). Integrating Big Data into the Monitoring and Evaluation of Development Programmes (2016) |. United Nations Global Pulse. Retrieved from http://unglobalpulse.org/big-data-monitoring-and-evaluation-report  PDF copy available Context: "This report represents a basis for integrating big data and data analytics in the monitoring and evaluation of development programmes. The report proposes a ...

Monitoring and Evaluation in Health and Social Development: Interpretive and Social Development Perspectives

Tuesday, January 17th, 2017

Edited by Stephen Bell and Peter Aggleton. Routledge 2016. View on Google Books "interpretive researchers thus attempt to understand phenomena through accessing the meanings participants assign to them" "...interpretive and ethnographic approaches are side-lined in much contemporary evaluation work and current monitoring and evaluation practice remains heavily influenced by more positivist approaches" "attribution ...

New books on the pros and cons of algorithms

Thursday, January 5th, 2017

Algorithms are means of processing data in ways that can aid our decision making. One of the weak areas of evaluation practice is guidance on data analysis, as distinct from data gathering. In the last year or so I have been searching for useful books on the subject of algorithms - what ...

Dealing with missing data: A list

Sunday, November 20th, 2016

In this post "missing data" does not mean absence of whole categories of data, which is a common enough problem, but missing data values within a given data set. While this is a common problem in almost all spheres of research/evaluation it seems particularly common in more qualitative and participatory inquiry, ...

The sources of algorithmic bias

Sunday, November 20th, 2016

"The foundations of algorithmic bias", by Zacharay Chase Lipton, 2016. pdf copy here. Original source here "This morning, millions of people woke up and impulsively checked Facebook. They were greeted immediately by content curated by Facebook’s newsfeed algorithms. To some degree, this news might have influenced their perceptions of the day’s news, ...

Two useful papers on the practicalities of doing Realist Evaluation

Monday, August 15th, 2016

1. Punton, M., Vogel, I., & Lloyd, R. (2016, April). Reflections from a Realist Evaluation in Progress: Scaling Ladders and Stitching Theory. IDS. Available here  2. Manzano, A. (2016). The craft of interviewing in realist evaluation. Evaluation, 22(3), 342–360. Available here. Rick Davies comment: I have listed these two papers here because I think ...