Your search

Yesterday, I had the chance to attend the public launch of a new government transparency and accountability funding mechanism – Making All Voices Count. Held at USAID headquarters, the discussion featured a veritable who’s who of open government and transparency practitioners in the Washington area; probably 250 people were packed into the room. (Announcing a …

In the last of a series of three blog posts looking at the implications of complexity theory for development, Owen Barder and Ben Ramalingam look at the implications of complexity for the trend towards results-based management in development cooperation. They argue that is a common mistake to see a contradiction between recognising complexity and focusing on results: on the contrary, complexity provides a powerful reason for pursuing the results agenda, but it has to be done in ways which...

This webpage from Tamarack Community provides links to audio files of an interview between Mark Cabaj and Michael Patton in which they discuss the topic of development evaluation. This is an "approach that has proven particularly useful and effective at addressing the unique challenges of evaluating the real nature of community change work. Learning Objectives: To deepen appreciation for the role of evaluation and evaluation thinking To explore the distinctions between various types of...

The method was developed by Robert Brinkerhoff as an alternative (or supplement) to the Kirkpatrick approach and its derivatives. It is very simple and fast (which is part of it’s appeal) and goes something like this: Step 1. Identify targeted business goals and impact expectations Step 2. Survey a large representative sample of all participants in a program to identify high impact and low impact cases Step 3. Analyze the survey data to identify: a small group of successful...

Note: Many thanks to Dave Snowden for his willingness to comment on this article prior to release Because I’m always a little behind the eight-ball, a friend of mine* recently introduced me to the …

The causal loop diagram is an analytical tool that is seldom used in Six Sigma but nonetheless is still very valuable. It is a foundational tool used in system dynamics, a method of analysis used to develop an understanding of complex systems.

This blog, by Dr David Fetterman, provides a range of resources on empowerment evaluation theory and practice. The blog includes links to videos, guides and relevant academic literature that provide a detailed analysis and discussion of using empowerment evaluation.

designed to foster collaboration, share knowledge, and promote scholarship, this TIG is a division of the American Evaluation Association (AEA).

Appreciative Inquiry is an approach to organisational change which focuses on strengths rather than on weaknesses - quite different to many approaches to evaluation which focus on deficits and problems. "Appreciative Inquiry is about the coevolutionary search for the best in people, their organizations, and the relevant world around them. In its broadest focus, it involves systematic discovery of what gives “life” to a living system when it is most alive, most effective, and most...

A case study focuses on a particular unit - a person, a site, a project. It often uses a combination of quantitative and qualitative data. Case studies can be particularly useful for understanding how different elements fit together and how different elements (implementation, context and other factors) have produced the observed impacts. There are different types of case studies, which can be used for different purposes in evaluation. The GAO (Government Accountability Office) has...

Causal Link Monitoring (CLM) integrates design and monitoring to support adaptive management of projects. CLM helps project planners and managers identify the processes that are required to achieve desired results, and then to observe whether those processes take place, and how. Result-producing processes specify the causal links between results in a logic model or results framework—in other words, the processes between results. CLM focuses on how specific individuals or organizations use...

Contribution Analysis is an approach for assessing causal questions and inferring causality in real-life program evaluations. It offers a step-by-step approach designed to help managers, researchers, and policymakers arrive at conclusions about the contribution their program has made (or is currently making) to particular outcomes. The essential value of contribution analysis is that it offers an approach designed to reduce uncertainty about the contribution the intervention is making to the...

Critical System Heuristics (CSH) provides a framework of questions about a program including what is (and what ought to be) its purpose and its source of legitimacy and who are (and who ought to be) its intended beneficiaries. CSH, as developed by Werner Ulrich and later elaborated upon in collaboration with Martin Reynolds, is an approach used to surface, elaborate, and critically consider boundary judgments, that is, the ways in which people/groups decide what is relevant to the system of...

Democratic Evaluation is an approach where the aim of the evaluation is to serve the whole community. This allows people to be informed of what others are doing and sees the evaluator as someone who brokers the process. It generally focuses on inclusive practices which foster participation and collaboration. However it is also used as a means of ensuring public accountability and transparency.

Developmental Evaluation (DE) is an evaluation approach that can assist social innovators develop social change initiatives in complex or uncertain environments. DE originators liken their approach to the role of research & development in the private sector product development process because it facilitates real-time, or close to real-time, feedback to program staff thus facilitating a continuous development loop. Michael Quinn Patton is careful to describe this approach as one choice that...

Empowerment Evaluation is an approach which provides communities with the tools and knowledge that allows them to monitor and evaluate their own performance. First developed by David Fetterman who describe it as “the use of evaluation concepts, techniques, and findings to foster improvement and self-determination.”

Horizontal evaluation is an approach that combines self-assessment by local participants and external review by peers. Originally developed to evaluate new methodologies for agricultural research and development, horizontal evaluation has wider potential for application. In its original setting, the focus of horizontal evaluation is the actual R&D methodology itself rather than the project per se or the team or organisation that developed it

Preparing an ‘innovation history’ is an option for recording and reflecting on an innovation process. People who have been involved in the innovation jointly construct a detailed written account (sometimes referred to as a ‘learning history’) based on their recollections and on available documents. The process of preparing this history stimulates discussion, reflection and learning among stakeholders. Subsequent planning drawing on the innovation history, can (i) build on the lessons...

An institutional history (IH) is a narrative that records key points about how institutional arrangements – new ways of working – have evolved over time and have created and contributed to more effective ways to achieve project or programme goals. An IH is generated and recorded in a collaborative way by scientists, farmers and other stakeholders. A key intention behind institutional histories is to introduce institutional factors into the legitimate narrative of success and failure in...

The Most Significant Change (MSC) approach involves generating and analysing personal accounts of change and deciding which of these accounts is the most significant – and why. The are three basic steps in using MSC: Deciding the types of stories that should be collected (stories about what - for example, about practice change or health outcomes or empowerment) Collecting the stories and determining which stories are the most significant Sharing the stories and discussion of values with...