The 9th European Evaluation Society International Conference

Date: 6-8th October 2010 (Pre-Conference training 4-5th)
Venue: Prague

“Evaluation in the public interest: participation, politics and policy”

The 2010 EES conference in the beautiful city of Prague is an invitation to evaluators and stakeholders to consider how evaluation addresses core values of human rights and citizen participation, addressing issues in such a way that the public can benefit from its work.  It is a delicate balance to achieve this while contributing useful knowledge to public policy and its
implementation.

In a world of widening socio-economic inequalities in which individuals and cultures are increasingly confronted by financial, social, environmental and spiritual upheavals, does evaluation have a meaningful role to play as an advocate for the public good? This conference title is designed to stimulate forward and expansive thinking about the way in which evaluation is embedded in democratic process.  This perspective places evaluation within the dynamic of policy making, policy interrogation and legitimation where it mediates between policy makers, those in receipt of policies and those on whose behalf our policy makers are expected to work.

How can evaluation inform the public interest and challenge the dynamics of governance and policy implementation, from local through to central and global levels of governments? Evaluators are present in an astonishing array of sectors, policy areas, cross-cutting issues, governments, civil society organisations, research and education institutions, professional milieus and communities

Evaluation encompasses a rich and growing diversity of methodologies, practices, innovations and perspectives.  The European mosaic of evaluation reflects well that diversity and vibrancy and the 2010 Conference will provide the setting for exchange, learning and the advancement of
our practice.

As evaluators we have grown accustomed to asking what difference an intervention makes; it is now time to ask what difference evaluation makes.

The Use of Social Network Analysis Tools in the Evaluation of Social Change Communications

by Rick Davies (April 2009).

This paper was produced for the Communication for Social Change Consortium, as a contribution to their paper for UNAIDS on reviewing approaches to monitoring and evaluation and advocating an expanded monitoring and evaluation framework for social change communication. All rights to this paper are with the Communication for Social Change Consortium (www.cfsc.org).]

Contents

1.Background..
2. What is Social Network Analysis? A brief introduction..
3. The use of SNA in the study of HIV/AIDS..
4. The use of SNA in the evaluation of HIV/AIDS interventions..
5. How could SNA be useful in the evaluation of HIV/AIDS programs?.
5.1. Within organisations: Moving from Logical to Social Frameworks.
5.2. Within organisations: Moving beyond linear models.
5.2.1 Mapping and modeling.
5.2.2 Looking inside and outside the network.
5.2.3 Matrix versus network models.
5.3. Amongst multiple organisations: Where there is no central planner.
6. The uses of theory..
7. Scalability..
8. Limitations..
9 Opportunities..
10. An Afterword..
References..

A Transaction Cost-Based Approach to Partnership Performance Evaluation

Denis Jobin

National Crime Prevention Center, Public Safety Canada, Canada, denis_jobin@yahoo.ca, denis.jobin@ps.gc.ca

Partnerships are often considered an alternative way to deliver programs provided by governments and organizations (potentially) more cost effectively. However, this assumption needs to be verified. Evaluators and auditors now face a challenge: how to assess the performance of this hybrid organizational form.This article suggests one powerful way of evaluating partnerships: transaction cost economics (TCE). A key hypothesis of TCE is that partners choose a governance structure that minimizes transaction costs (TCs). If a partnership’s governance structure is misaligned with its transactions, higher TCs will decrease the partnership’s performance. Hence, measuring the partnership’s TCs is essential. After defining what constitutes a partnership, the article introduces the TC framework. It then identifies relevant factors in the literature affecting partnership performance. It concludes with key steps in applying the framework and shows how it fits into partnership performance evaluation.

Key Words: evaluation partnership • performance • transaction cost

Evaluation, Vol. 14, No. 4, 437-465 (2008)
DOI: 10.1177/1356389008095487

International Aid Transparency Initiative (IATI) First Annual Conference

Date: 20th/21st October 2009

Venue: Amazon Auditorium, World Forum, The Hague

” In the conference to be opened by Bert Koenders, Dutch Development Minister, participants from donor agencies, partner country governments, and CSOs will come together to explore aid transparency within the broader context of ownership, domestic accountability and mutual accountability. Click here for the draft conference programme. Please contact r-greenhill@dfid.gov.uk for information.

Link to IATI website

US Congress Committee on Financial Services that looked into ‘The World Bank’s Disclosure Policy Review and the Role of Democratic Participatory Processes in Achieving Successful Development Outcomes’.

(from the Pelican email list)

Dear all,

In reaction to the message that I sent to you earlier today, Alnoor Ebrahim sent me a link to a recent hearing of the US Congress Committee on Financial Services that looked into ‘The World Bank’s Disclosure Policy Review and the Role of Democratic Participatory Processes in Achieving Successful Development Outcomes’.

At this hearing, he gave a testimony based on the results of research he did into the reforms and accountability efforts undertaken at the World Bank over the past fifteen years, particularly those in which civil society organizations played a significant role. A PDF of the written testimony is available here:
http://www.house.gov/apps/list/hearing/financialsvcs_dem/ebrahim.pdf <http://www.house.gov/apps/list/hearing/financialsvcs_dem/ebrahim.pdf>

The testimonies of all five witnesses (Joseph Stiglitz, Richard Bissell, Vijaya Ramachandran, Thomas Blanton and Alnoor) as well as a video of the hearing are available on this page:
http://www.house.gov/apps/list/hearing/financialsvcs_dem/FShr_091009.shtml <http://www.house.gov/apps/list/hearing/financialsvcs_dem/FShr_091009.shtml> ,

From: Niels Keijzer/ECDPM


Quality Review consultation ends: 23rd October 2009

The Quality of DFID’s Evaluation Reports and Assurance Systems

Request for comments on reports ( by Roger Riddell, Burt Perrin and Richard Manning) commissioned by IACDI.

As part of its role in monitoring evaluation quality in DFID, IACDI commissioned a review to assess the quality of DFID’s evaluation reports and its assurance systems. The review is now complete and available here on the website in 3 parts. It was undertaken by experts Burt Perrin and Richard Manning, managed by Roger Riddell, a member of IACDI, who has also produced an overview report drawing on and summarising the other two.

The review highlights 11 key recommendations for DFID to improve the quality of evaluation work, and to strengthen DFID’s approach in using evaluation work for lesson learning (see pages iii – vii of Roger Riddell’s report). As part of the review, DFID’s evaluation systems were compared with other donor agencies, and found to be broadly on par with those of comparator bilateral agencies.

IACDI now invites and welcomes comments on the reports – particularly on the overview report by Roger Riddell. IACDI will be discussing the reports at its next meeting on 4th November, and would particularly welcome comments from external stakeholders before then, so that they can be taken into account at its meeting.

Please send comments to mail@iacdi.independent.gov.uk by 23 October 2009.

Postscript (17th November 2009)

On 4th November there was a meeting in London where DFID invited people to comment on the recommendations made by Riddel, Perrin, and Manning. A summary of the issues raised in that meeting is available here. My own feedback, also provided in written form after the meeting, is available here..

Executive education course, “Evaluating Social Programs” in Santiago, Chile

Date: December 15 – 19, 2009
Venue: Santiago, Chile

The Jameel Poverty Action Lab (J-PAL) will conduct an executive education course, “Evaluating Social Programs” in Santiago, Chile from December 15 – 19, 2009. This five-day course will provide a thorough understanding of randomized evaluations and pragmatic step-by-step training for conducting one’s own evaluation. While the course focuses on randomized evaluations, many of the topics, such as measuring outcomes and dealing with threats to the validity of an evaluation, are relevant for other methodologies.  The program is designed for people from a variety of backgrounds: managers and researchers from international development organizations, foundations, governments and non-governmental organizations from around the world, as well as trained economists looking to retool.For more information, please visit our website.

Please note: The application deadline is November 1, 2009
Continue reading “Executive education course, “Evaluating Social Programs” in Santiago, Chile”

Strengthening humanitarian networks: Applying the network functions approach

Ben Ramalingam, Enrique Mendizabal and Ed Schenkenberg van Mierop April 2008

>This note< offers a simple, flexible and powerful methodology — the network functions approach (NFA) — that can be applied to analyse and strengthen humanitarian and development networks. Based on research undertaken at ODI and elsewhere, the NFA suggests there are six overlapping functions that different networks perform in varying combinations. Through reflection on a network’s current activities and how they relate to each of these functions, the NFA helps those facilitating, acting within or supporting networks to work towards an ‘ideal’ functional mix. The aim is for network strategies to be honed, thinking clarified, activities sharpened and ultimately, humanitarian performance improved.

The NFA is now undergoing a process of review. Rick Davies (manager of www.mande.co.uk) has provided ODI with a 2 page >comment< on the Background Note on the NFA

Training: Evaluation of Humanitarian Action

Date: 9-13 November 2009
Venue: Belgium

Channel Research wish to draw your attention to two forthcoming coming courses in Evaluation of Humanitarian Action, using materials developed in collaboration with ALNAP. These courses will take place in Belgium on the following dates:

9-11 November 2009 (introductory- to intermediate level)

12-13 November 2009 (advanced level)

Full details including application forms can be found by clicking on the above links.

For any further information, please contact Maria Bak on bak@channelresearch.com

Please do not hesitate to forward this information to your network

Maria Bak,

Knowledge Manager, Channel Research , 45 Route des Marnières, 1380 Lasne, Belgium, Tel: +32 2 633 6529, Fax: +32 2 633 3092 , Mobile: +32 (0) 473 12 36 23, Skype: maria_bbak, mail: bak@channelresearch.com, www.channelresearch.com

3ie will award up to $10 million in research grants to improve development effectiveness

Open Window Round 2 – Deadline: 27 November 2009

To enhance development effectiveness and ultimately improve people’s lives in developing countries, the International Initiative for Impact Evaluation (3ie) has launched a request for proposals (RFP) for quality impact evaluations. This RFP is the second round under 3ie’s Open Window, which accepts proposals for the impact evaluation of social and economic development interventions in low and middle income countries in any sector. 3ie will award up to US$10 million in grants under this round.

Preference will be given to proposals which:

  • evaluate large scale programs that affect many lives,
  • are done in partnership with an agency implementing the development intervention to be evaluated, and
  • involve developing country researchers and/or evaluators in the investigation.

Examples of studies funded under the first Open Window include:

  • the use of mobile phones to help monitor patients’ compliance to Tuberculosis treatment in Karachi;
  • the distribution of cooking oil to compensate for dowry to delay adolescent marriage in remote parts of Bangladesh;
  • early childhood development centres in Mozambique;
  • a community driven development pilot in post-conflict Sierra Leone; and upgrading of slum-houses in Peru.

Download

Read more on detailed guidelines and how to apply at: www.3ieimpact.org/openwindow
Any queries regarding this RFP should be sent to: Arun Virk, Programme Officer at proposals@3ieimpact.org

The International Initiative for Impact Evaluation (3ie) works to improve the lives of people in the developing world by supporting the production and use of evidence on what works, when, why and for how much. 3ie is a new initiative that responds to demands for better evidence, and will enhance development effectiveness by promoting better informed policies. 3ie finances high-quality impact evaluations and campaign to inform better program and policy design in developing countries.