What is MSC [2] | Core reading [3] | Online bibliography [4] | Translations [5] | Email List | [6]Trainers [7] | Software [8] | PowerPoints [9] |History [10]|
What is MSC?
In brief: The most significant change (MSC) technique is a means of “monitoring without indicators” (but can also be used in evaluations)
MSC is a form of participatory monitoring and evaluation. It is participatory because many project stakeholders are involved both in deciding the sorts of changes to be recorded and in analysing the data collected. It is a form of monitoring because it occurs throughout the program cycle and provides information to help people manage the program. It contributes to evaluation because it provides data on impact and outcomes that can be used to help assess the performance of the program as a whole.
Essentially, the process involves the collection of significant change (SC) stories emanating from the field level and the systematic selection of the most significant of these stories by panels of designated stakeholders or staff. The designated staff and stakeholders are initially involved by ‘searching’ for project impact. Once changes have been captured, selected groups of people sit down together, read the stories aloud and have regular and often in-depth discussions about the value of these reported changes, and which they think is most significant of all. In large programs there may multiple levels at which SC stories are pooled and then elected. When the technique is implemented successfully, whole teams of people begin to focus their attention on program impact.
MSC is most useful:
- Where it is not possible to predict in any detail or with any certainty what the outcome will be
- Where outcomes will vary widely across beneficiaries
- Where there may not yet be agreements between stakeholders on what outcomes are the most important
- Where interventions are expected to be highly participatory, including any forms of monitoring and evaluation of the results
Core reading
- ‘The Most Significant Change’ (MSC) Technique: A Guide to its Use” [11]by Rick Davies and Jess Dart, 2005. If you only want to read one document, read this.
- Order and Diversity: Representing and Assisting Organisational Learning in Non-Government Organisations [12]Rick Davies’ 1998 Ph.D. thesis, describing the method and its use in Bangladesh in 1994-5. See Chapter 8 [13] for a detailed description of its use by CCDB
- “An evolutionary approach to facilitating organisational learning” [14]Rick Davies’ original 1996 internet published paper providing the first public summary description of the method
- A Dialogical, Story-Based Evaluation Tool: The Most Significant Change Technique. [15] Dart J and Davies R (2003) American Journal of Evaluation 24(2): 137–155. DOI: 10.1177/109821400302400202. The first published journal article on MSC
Online bibliography
- Go to the Zotero-hosted online bibliography [16] of publications about MSC, to see a collection of 140+ documents, including journal articles, presentations, conference papers and handouts.
Translations
- The MSC Translations blog [17]is now the central repository for communications and updates regarding translations into other languages.
- Here are some of the translations completed to date
- French [18]: With thanks to Lauren Naville <dcg@drylands-group.org>, working with the Drylands Coordination Group.
- Spanish: [19]With thanks to Pablo Rodríguez Bilella for the 2011 update/revised version
- Arabic: [20]With thanks to Awny Morsy <awnyamer@live.com>
- Hindi: [21]Status of this version needs to be clarified. Hindi speakers, could you help me?
- Sinhala [22]: With thanks to Arunasalam Vaithialingam <spo2@cha.lk>
- Tamil [23]: With thanks to Arunasalam Vaithialingam <spo2@cha.lk>
- Japanese: [24] With thanks to Hiroshi Tanaka <nepalippine@gmail.com>and his team of volunteers
- Indonesian: Location lost but search underway
- Other translations underway
- Chinese: Yao Lu <chinaluyao@yahoo.com> is currently working on it.
- Italian: Maria Fabiani <info@mariafabiani.eu> is currently working on it
- Portuguese: Orlando José Leite de Castro <ojcastro@gmail.com> is currently working on it
- Other translations that have been considered, but we have no news on
- Malayam: Shaju Jospeh <shaju_v@rediffmail.com> has expressed interest
- Urdu: Ehtisham ul Hasan (ehasan@savethechildren.pk) has expressed interest
- Swahili: Kirogo Mwangi <kmwangi@path.org> has expressed interest
- Russian: Alexander Karpov <Alexander.Karpov@ecom-info.spb.ru> has expressed interest
Email list
To join the MSC email list, answer these 4 questions [25] and we will then add you to the email list
You can view previous messages posted to the MSC email list by following this link: https://groups.google.com/g/mostsignificantchange-msc-2020-email-list/ [26]
Trainers
- The most active MSC trainers are
- Clear Horizon [27] – Jess Dart and others, based in Melbourne
- Fiona Kotvojs [28], based in New South Wales, Australia
- Theo Nabben [29], based in Perth, Western Australia
- Nur Hidyati, Results in Health [30], based in the Netherlands
- Others known to me include: Natalie Moxham [31], Tracey Delaney [32], and Claus Kjaerby [33]
- New addition: SERA (Story-based Evaluation and Research Alliance) [34], 8 colleagues based in the UK
- InsightShare [35] also provide MSC training in combination with the use of participatory video
Software
- Most Significant Change database [36] (online): ” now available commercially to help manage MSC stories. It also allows you to do secondary analysis on the stories fairly easily. I have trialed it on a few projects and found it to be really good – especially in supporting the secondary analysis, and managing large numbers of stories” says Fiona Kotvojs, 25/8/2010.
Selected PowerPoint presentations
- Bahasa Indonesian PowerPoint [37] by Paul Boon, 40 slides based on the MSC Guide
- Content Analysis of Most Significant Change (MSC) stories [38]. 40 minute PowerPoint presentation with audio commentary by Rick Davies, 2013
- [more content yet to be added here]
History
[From the MSC Guide, page 9] The most significant change (MSC) technique was invented by Rick Davies in an attempt to meet some of the challenges associated with monitoring and evaluating a complex participatory rural development program in Bangladesh, which had diversity in both implementation and outcomes. The program was run by the Christian Commission for Development in Bangladesh (CCDB), a Bangladeshi non-government organisation, which in 1996 had over 500 staff and worked with more than 46,000 people in 785 villages. Approximately 80 percent of the direct beneficiaries were women. The large-scale and open-ended nature of the activities posed a major problem for the design of any system intended to monitor process and outcome (Davies, 1996).
Rick developed the MSC technique as part of the fieldwork for his PhD on organisational learning in non-government aid organisations (Davies, 1996). Both the thesis and MSC were informed by an evolutionary epistemology. While you don’t need to know this background theory in order to use MSC, you can find out more about it in Chapter 7. It is also worth noting that Jess and others have analysed the use of MSC from different theoretical perspectives to that used by Rick. This flexibility is consistent with the underlying design of MSC. More information on the history of the use of MSC, including Jess’s role in its promotion in Australia, can be found in Chapter 8.”