Evaluating complex interventions: A theory-driven realist-informed approach

Resource type
Authors/contributors
Title
Evaluating complex interventions: A theory-driven realist-informed approach
Abstract
There is a growing recognition that programs that seek to change people’s lives are intervening in complex systems, which puts a particular set of requirements on program monitoring and evaluation. Developing complexity-aware program monitoring and evaluation systems within existing organizations is difficult because they challenge traditional orthodoxy. Little has been written about the practical experience of doing so. This article describes the development of a complexity-aware evaluation approach in the CGIAR Research Program on Aquatic Agricultural Systems. We outline the design and methods used including trend lines, panel data, after action reviews, building and testing theories of change, outcome evidencing and realist synthesis. We identify and describe a set of design principles for developing complexity-aware program monitoring and evaluation. Finally, we discuss important lessons and recommendations for other programs facing similar challenges. These include developing evaluation designs that meet both learning and accountability requirements; making evaluation a part of a program’s overall approach to achieving impact; and, ensuring evaluation cumulatively builds useful theory as to how different types of program trigger change in different contexts.
Publication
Evaluation
Volume
23
Issue
3
Pages
294-311
Date
July 1, 2017
Journal Abbr
Evaluation
Language
en
ISSN
1356-3890
Short Title
Evaluating complex interventions
Accessed
15/10/2020, 14:36
Library Catalogue
SAGE Journals
Citation
Douthwaite, B., Mayne, J., McDougall, C., & Paz-Ybarnegaray, R. (2017). Evaluating complex interventions: A theory-driven realist-informed approach. Evaluation, 23(3), 294–311. https://doi.org/10.1177/1356389017714382