TY - BLOG TI - How to make theories of change more useful? AU - Aston, Thomas T2 - Medium AB - A fair amount has been written recently questioning the value added of theories of change. Have we gone through a hype cycle? Are they… DA - 2021/02/05/T22:42:20.434Z PY - 2021 LA - en UR - https://thomasmtaston.medium.com/how-to-make-theories-of-change-more-useful-fc969076a44d Y2 - 2021/02/18/14:44:33 ER - TY - BLOG TI - What, so what, now what? AU - Aston, Thomas T2 - Medium AB - Getting serious about systems change DA - 2022/03/18/ PY - 2022 LA - en UR - https://thomasmtaston.medium.com/what-so-what-now-what-4cef4d7e0281 Y2 - 2022/04/01/07:41:15 ER - TY - BLOG TI - (Re)making the case for adaptive management AU - Aston, Thomas T2 - Medium AB - Great overview of what to read on adaptive management. It’s a long one, so I’ve split it into two – second installment tomorrow. Christian Aid Ireland’s recent publication The Difference Learning Makes by Stephen Gray and Andy Carl made a bit of a splash. The study found that Christian Aid Ireland’s application of adaptive programming contributed to better development outcomes and supported more flexible delivery. The much vaunted MUVA programme in Mozambique is also coming to a close and presenting its results from using and adaptive approach. So, it struck me that we might be at a critical juncture in the conversation on adaptive management. We’ve had the crashing to earth of inflated expectations in recent misanthropic reflections, [misanthropic, moi? – Duncan] alongside a fragile institutionalisation of adaptive management in donor agencies, NGOs, and private sector organisations. However, I’d argue that we’ve reached the point where adaptive management has passed the proof-of-concept stage. DA - 2022/06/06/ PY - 2022 LA - en UR - https://thomasmtaston.medium.com/re-making-the-case-for-adaptive-management-d23541954604 Y2 - 2022/06/17/12:51:17 ER - TY - BLOG TI - Evaluating complexity, simplistically AU - Aston, Thomas T2 - Medium AB - A critical appraisal's of CEDIL papers on Evaluating Complex Interventions... A study was recently published by the Centre of Excellence for Development Impact and Learning (CEDIL) entitled Evaluating complex interventions in international development. This is the sort of title that raises great expectations. Complexity is a hugely popular theme and many of us are keen to know more about how to evaluate efforts that seek to achieve results amid complexity. In April 2021, CEDIL conducted a webinar on the paper, and in July 2021 CEDIL published a blog. In September 2021, I wrote a blog expressing some reservations regarding the focus of the study; its apparent over-emphasis on interventions, under-emphasis on context, as well as its choice of some supposedly under-used methods. These methods were: (1) factorial designs; (2) adaptive trials; (3) Qualitative Comparative Analysis (QCA); (4) synthetic control; (5) agent-based modelling, and system dynamics. DA - 2022/02/16/T14:42:04.608Z PY - 2022 LA - en UR - https://thomasmtaston.medium.com/evaluating-complexity-simplistically-f587778a1b32 Y2 - 2022/06/17/13:00:07 ER - TY - BLOG TI - Windows on the world: The power of assumptions in uncertain times AU - Aston, Thomas T2 - Medium AB - In my last blog on theory-based Monitoring Evaluation and Learning (MEL), I explained why relationships matter, and how to assess change… DA - 2020/12/23/T09:55:16.686Z PY - 2020 LA - en ST - Windows on the world UR - https://thomasmtaston.medium.com/windows-on-the-world-the-power-of-assumptions-in-uncertain-times-b413e6f69720 Y2 - 2021/02/18/14:53:06 ER - TY - BLOG TI - Changing theories AU - Aston, Thomas T2 - Medium AB - You may, or may not, be surprised to hear that many theories of change lack what we might generally understand as a theory. DA - 2023/10/15/T20:40:09.796Z PY - 2023 LA - en UR - https://thomasmtaston.medium.com/changing-theories-e857aa8fba05 Y2 - 2023/10/17/22:05:40 ER - TY - BLOG TI - “Real”​ process tracing: part 1 — context AU - Aston, Thomas T2 - Medium AB - When asserting the value of theory-based methods, you often here words like “black boxes” and “causal mechanisms.” These are commonly… DA - 2020/12/26/T09:59:27.959Z PY - 2020 LA - en ST - “Real”​ process tracing UR - https://thomasmtaston.medium.com/real-process-tracing-part-1-context-6a52777a6a98 Y2 - 2021/02/18/14:47:07 ER - TY - BLOG TI - Assumptions and triple loop learning AU - Aston, Thomas T2 - Medium AB - Triple loop learning DA - 2021/01/29/T22:51:08.488Z PY - 2021 LA - en UR - https://thomasmtaston.medium.com/assumptions-and-triple-loop-learning-c9699dacbeab Y2 - 2021/02/18/14:48:07 ER - TY - BLOG TI - Rubrics as a harness for complexity AU - Aston, Thomas T2 - Medium AB - In this final blog in the series, I want to look at the potential value of rubrics. While evaluability assessments can help us to… DA - 2020/12/24/T12:08:01.064Z PY - 2020 LA - en UR - https://thomasmtaston.medium.com/rubrics-as-a-harness-for-complexity-6507b36f312e Y2 - 2021/02/18/14:53:43 ER - TY - RPRT TI - The Art and Craft of Bricolage in Evaluation AU - Aston, Thomas AU - Apgar, Marina T2 - CDI Practice Paper AB - This CDI Practice Paper by Tom Aston and Marina Apgar makes the case for ‘bricolage’ in complexity-aware and qualitative evaluation methods. It provides a framework based on a review of 33 methods to support evaluators to be more intentional about bricolage and to combine the component parts of relevant methods more effectively. It discusses two cases from practice to illustrate the value added of taking a more intentional approach. It further argues that navigating different forms of power is a critical skill for bricolage, and that doing so can help to ensure rigour. CY - Brighton DA - 2022/10/14/ PY - 2022 DP - opendocs.ids.ac.uk LA - en PB - Institute for Development Studies SN - 24 UR - https://opendocs.ids.ac.uk/opendocs/handle/20.500.12413/17709 Y2 - 2023/01/10/14:54:22 ER - TY - RPRT TI - Process Tracing Innovations in Practice: Finding the Middle Path AU - Aston, Thomas AU - Wadeson, Alix T2 - CDI Practice Paper AB - Evaluation practitioners in the international development sector have given considerable attention in recent years to process tracing as a method for evaluating impact, including discussion of how to assess the relative importance of causal factors. Despite the increasing interest, there is a relative dearth of examples of practical learning and evidence of applying process tracing in practice. This CDI Practice Paper draws on comparative learning from applying three different types of process tracing in international development initiatives. It argues in favour of a ‘middle path’ of applying evidence tests and rubrics to structure evaluative judgements rather than formal Bayesian updating or looser forms of process tracing. It also calls attention to the potential added value of taking a participatory approach, offering practical recommendations for how to do this effectively. CY - Brighton DA - 2023/03/27/ PY - 2023 DP - opendocs.ids.ac.uk LA - en PB - Institute of Development Studies SN - 25 ST - Process Tracing Innovations in Practice UR - https://opendocs.ids.ac.uk/opendocs/handle/20.500.12413/17913 Y2 - 2023/03/28/09:32:09 ER - TY - JOUR TI - Monitoring and evaluation for thinking and working politically AU - Aston, Thomas AU - Roche, Chris AU - Schaaf, Marta AU - Cant, Sue T2 - Evaluation AB - This article explores the challenges of monitoring and evaluating politically informed and adaptive programmes in the international development field. We assess the strengths and weaknesses of some specific evaluation methodologies which have been suggested as particularly appropriate for these kinds of programmes based on scholarly literature and the practical experience of the authors in using them. We suggest that those methods which assume generative causality are particularly well suited to the task. We also conclude that factoring in the politics of uncertainty and evidence generation and use is particularly important in order to recognize and value diverse experiential knowledge, integrate understandings of the local context, accommodate adaptation and realistically grapple with the power relations which are inherent in evaluation processes. DA - 2022/01/01/ PY - 2022 DO - 10.1177/13563890211053028 DP - SAGE Journals VL - 28 IS - 1 SP - 36 EP - 57 J2 - Evaluation LA - en SN - 1356-3890 UR - https://doi.org/10.1177/13563890211053028 Y2 - 2022/03/21/11:55:27 ER -