Search

Government offices are filled with siloed, sector-specific digital systems that strain their capacity to make decisions, use data effectively, and achieve ambitious sustainable development goals. Public investments in digital development, transformation, and infrastructure can only meet citizen needs if data and systems are consolidated and interoperable. While interoperability is a sensible approach to building digital public infrastructure, transforming existing systems is easier said...

After eight years, I am leaving Porticus. From January 2025, I'll be starting a new chapter - working in a freelance capacity to support systems change efforts through strong learning, evaluation and strategy. Having worked with the amazing Porticus UK team for the first four years, I moved to Amsterdam in 2020 to work in the central strategy and learning team, supporting colleagues around the globe to embed strategy, evaluation and learning in their work. I loved this work. I learned a...

Explore Climate KIC’s S-ToC guide A practical and flexible resource designed to help teams and partners navigate the complexity of systems change in the face of the climate crisis. Our S-ToC approach integrates systems thinking to support adaptive monitoring, evaluation, and ongoing learning. This guide empowers users to analyse systems, identify leverage points, and co-create change-oriented strategies that evolve with context. Whether you’re working on a small-scale pilot or a...

This five-step framework, developed and tested by a foundation, embeds learning in emergent systems change strategies. It prioritizes the testing of hypotheses and assumptions, uses learning questions, and calls for examining both confirming and disconfirming evidence. --- A framework for embedding learning in systems change strategies and for testing strategic uncertainties. Learning and evaluation approaches that accompany systems change efforts need to fit with and support the emergent...

Based on a case study of the Kullana Liltanmia (All of Us for Development) (KLP) Contextual Analysis (CA) course in Sudan, this paper tells the story of how training and capacity building in Political Economy Analysis (PEA) made a difference in the lives and experiences of those involved, including in particular young people. The paper highlights three critical lessons: • At the country level, the twists and turns of Sudan’s recent history reinforce the importance of people deepening their...

The Reduced Access Analytical Methods (RAAM) toolkit is a practical resource designed to help humanitarian practitioners overcome monitoring challenges in reduced access environments. Reduced access can be caused by natural disaster, conflict, political instability, or other factors, and typically makes it difficult to conduct normal monitoring of program implementation. The RAAM toolkit offers technical and managerial tools for a menu of analytical methods that can fill information gaps...

The Local Systems Position Paper describes the key approaches USAID will use to translate systems thinking into systems practice. It focuses on ways USAID can better understand and engage local systems to support them in producing more sustainable results. Systems thinking is a mindset and set of tools that we use to understand how systems behave and produce certain results or outcomes. Systems practice is the application of systems thinking to better understand challenges and strengthen the...

Over the course of this paper we lay out the basis of the Carve-Out method, an approach that leverages a behavioural framework to allow organisations (even those burdened with layers of bureaucracy and entrenched ideas) to create intentionally designed environments that give people the space, resources and support they need to explore and test new ideas. Ideas that may go on to transform the core of their organisation. The Carve-Out method is based on a simple insight: That if we want to...

How moving from transactional to transformational relationships and organizations can save our democracy, nurture our connections, and make us happier and healthier. Powerful institutions, from schools to tech and social media companies, create breeding grounds for isolation by failing to invest in relational work. This obstacle stands in the way of our fight for racial equity, economic justice, and climate resilience. In Relationality, leading asexuality and relationship activist David...

By Robert Ricigliano and Anna Muoio

Background: The practice and profession of evaluation continue to evolve. Over the years, evaluation scholars and practitioners have developed a broad—and still broadening—range of evaluation approaches. These evaluation approaches are often combined with various study designs in real-world evaluations. To provide an overview of these approaches and designs, and inspired by my son’s love of metro trains, I created an evaluation metro map.    Purpose: The purpose of this article is to...

Background: The Garden of Evaluation Approaches (Montrosse-Moorhead, et al., 2024a) maps evaluation approaches against eight dimensions of practice and situates them in their philosophical orientations and methodological dispositions. Purpose: The Garden’s guiding question is: How do evaluation approaches compare in terms of dimensions that facilitate use and application? Primary intended users are evaluation practitioners, and secondary intended users include ecosystem actors (e.g.,...

Evaluation is a vast field of designs and methods in continuous development. The numerous parameters and choices associated with different methodological options can be difficult to fully understand without deep study and desk review. The motivation for the Periodic Table of Evaluation was to create a one-pager visual that catalogues methodological options and parameters involved in an evaluation design.

When assessing value for money (VfM), there are sound arguments for combining insights from economics and evaluation. Drawing on the complementary strengths of both disciplines supports comprehensive assessment of policies and programmes’ VfM. In this Guide we introduce an interdisciplinary approach, Value for Investment, that integrates methods and tools from both disciplines, and which has gained traction worldwide. Among the concepts and methods of evaluation that economics brings to...

The guide begins with a section on what we at TAF have learned about practicing Strategy Testing, highlighting things that we didn’t know when we started out. Some of these lessons may seem obvious, but others may strike you as less so. In any case, we believe that, when taken together, they provide a useful reminder of some of the pitfalls that arise in efforts to practice Adaptive Management. Moreover, they help to remind us that there are multiple layers to doing Strategy Testing...

With growing evidence of what works in education, governments and their partners strive towards scale. While implementation research to adapt solutions holds promise for testing what works, where and for whom, its use in education is limited. Sixty-three international education stakeholders from government, academia, think tanks, local and international non-governmental organizations, multi- and bi-laterals and foundations offer insight into three modes of implementation research that differ...

Evaluation has a long history of using experimental and quasi-experimental designs to measure the effects of programs and strategies, and through this, to infer causality. Yet, these approaches are often not appropriate when evaluating change in complex, dynamic systems. Further, programs and strategies that seek to produce change in complex settings are increasingly common. This leads to an evaluation dilemma: if and how do evaluators attend to causality amid complexity? Too often, the...

For over 50 years, evaluators have used theories of change to articulate the causal logic underpinning how an intervention is intended to bring about a desired change. From its origins in programme evaluation, the approach has been adopted more widely for purposes from program design to program management. As theories of change continue to be used for multiple purposes, it is an opportune moment for the evaluation community—where the approach originated—to provide their perspective on the...

Editor’s Note: This article, first published in print and online in 2014, has been republished by The Foundation Review with minor updates. Whether implicit or explicit, social justice and human rights are part of the mission of many philanthropies. Evaluation produced, sponsored, or consumed by these philanthropies that doesn’t pay attention to the imperatives of cultural competency may be inconsistent with their missions. The American Evaluation Association’s Statement on Cultural...