In my six-year academic study I developed a practical guide for assessment of conditions, and evaluation of effectiveness of Large Scale Interventions (LSI). I see LSI as a participative approach for organisational change, involving stakeholders of the central issue or task in every stage of the change process. On one or more occasions (a representation of) the whole system meets in one room, to build shared understanding and find common ground for next steps. To enable working with the whole system in the room, large group intervention methods are used, such as Open Space Technology, Future Search, Search Conferences, Real Time Strategic Change (Whole-Scale Change TM), and World Café. I am pleased to share my findings as open source, but please honour my work by mentioning my name.
The guide includes an evaluation instrument with success factors and effects, gathered in a field study with multiple methods and sources. The study comprises text analyses of more than 50 articles with reported LSIs, interviews and workshops with 35 stakeholdes (faciliators, participants and researchers of LSI) and prolonged engagement with practitioners through membership of world wide networks.
The success factors and effects, with their indicators and methods to find evidence are categorized according a general model for effectiveness of interventions. See 4.4 Table evaluation instrument 14 April 2010.pdf
From the list of success factors and effects I developed an evaluation instrument, based on audit methods used to assess the working of Quality Management systems (such as ISO 9000, ISO 14.000 and TQM systems).The instrument includes:
- an audit list with questions to obtain evidence from key players and crucial documents (contract with the consultants, design and proceedings of the large group meeting, reports of planning group et cetera. 3.3 Audit table 2 December 2009.xls
- a score table to score if a success factor or effect is complied to or not; this table is an excel file which can be folded out to three levels of detail 7.1 Score table Evaluation LSI, 14 April 2010.xls
- a table to wrap up all findings and conclusions, presented as in results of consumer tests, with ++, +, 0, -, -- overviews Score table overview case, 2 December 2009.xls
Depending on the aims of the evaluation you can use this instrument on different levels of detail, to assess pre-conditions before, assess performance during, and evaluate effectiveness after the intervention. The instrument is tested by reconstructing three cases after two years. What are sustainable effects? How effective was the LSI?
The Guide is tested in two interactive ReSearch Conferences, with up to 60 participants (researchers, practitioners, clients).
The Practical Guide will be part of the book I'm writing, the title will probably be "Effective use of Large Group Interventions. A practical guide for facilitation and evaluation of sustainable change with the whole system". Publication is planned for December 2010.
The practical guide: A practical guide to effective use of LSI, full version draft 14 april 2010.pdf