Getting Beyond Hype: Four Questions to Predict Real Impact - Starr, Kevin (Stanford Social Innovation Review, 2014)
A simple way to think about investment and design.

The direction of evolution: The rise of cooperative organization - Stewart, John E. (Biosystems, 2014)
Two great trends are evident in the evolution of life on Earth: towards increasing diversification and towards increasing integration. Diversification has spread living processes across the planet, progressively increasing the range of environments and free energy sources exploited by life. Integration has proceeded through a stepwise process in which living entities at one level are integrated into cooperative groups that become larger-scale entities at the next level, and so on, producing cooperative organizations of increasing scale (for example, cooperative groups of simple cells gave rise to the more complex eukaryote cells, groups of these gave rise to multi-cellular organisms, and cooperative groups of these organisms produced animal societies). The trend towards increasing integration has continued during human evolution with the progressive increase in the scale of human groups and societies. The trends towards increasing diversification and integration are both driven by selection. An understanding of the trajectory and causal drivers of the trends suggests that they are likely to culminate in the emergence of a global entity. This entity would emerge from the integration of the living processes, matter, energy and technology of the planet into a global cooperative organization. Such an integration of the results of previous diversifications would enable the global entity to exploit the widest possible range of resources across the varied circumstances of the planet. This paper demonstrates that it's case for directionality meets the tests and criticisms that have proven fatal to previous claims for directionality in evolution.
Keywords: Direction of evolution; Evolution of a global entity; Evolution of cooperation; Evolutionary progress; Major evolutionary transitions

Measuring Results & the DCED Standard - Tanburn, Jim (2014)
This page gives an introduction to the DCED Standard, which is a framework that helps practitioners to measure results in Private Sector Development (PSD).

Realist Impact Evaluation: An introduction - Westhorp, Gill (Methods Lab, 2014)
• Realist evaluation is a member of a family of theory-based evaluation approaches which begin by clarifying the ‘programme theory’: the mechanisms that are likely to operate, the contexts in which they might operate and the outcomes that will be observed if they operate as expected. • Realist approaches assume that nothing works everywhere for everyone: context makes a big difference to programme outcomes. A realist evaluation asks not ‘what works?’ but ‘how or why does this work, for whom, in what circumstances?’ • Realist impact evaluation is most appropriate for evaluating new initiatives or programmes that seem to work but where ‘how and for whom’ is not yet understood; programmes that have previously demonstrated mixed patterns of outcomes; and those that will be scaled up, to understand how to adapt the intervention to new contexts.

What is Outcome Harvesting? - Wilson-Grau, Ricardo (2014)
Ricardo Wilson-Grau, former Chair of the Board of Stewards of the Outcome Mapping Learning Community, introduces Outcome Harvesting, an approach for retrospective identification of outcomes based on the principles of Outcome Mapping. More details here: http://www.outcomemapping.ca/nuggets/outcome-harvesting

Learning, Adaptation & Change: the future of Making All Voices Count - MAVC (Making All Voices Count, 2014)
Learning, Adaptation & Change: what Making All Voices Count has learned since September 2013 and how the programme will adapt and change in the future.

Agile, is it just a delivery mechanism? - Carignan, Louis-Philippe (Scrum.org Community Blog, 2014)
As a Agile coach, I refer to a few tools to help me think about where my Scrum teams should go next on their path to Agility. One of these tools is the Agile subway map, a list of Agile practices grouped in different categories. It helps me think how a specific practice could help …

Time for a Donor Funding Charter? - kiwanja.net (Donor's Chapter, 2014)

Adaptive Learning - Guerzovich, Florencia; Poli, Maria (Global Partnership for Social Accountability, 2014)

Theories of change in international development: Communication, learning, or accountability? - Valters, Craig (JSRP, 2014)

Sensing and Cyberinfrastructure for Smarter Water Management: The Promise and Challenge of Ubiquity - Hill David; Kerkez Branko; Rasekh Amin; Ostfeld Avi; Minsker Barbara; Banks M. Katherine (Journal of Water Resources Planning and Management, 2014)

Evaluating megaprojects: From the ‘iron triangle’ to network mapping - Lehtonen, Markku (Evaluation, 2014)
Evaluation literature has paid relatively little attention to the specific needs of evaluating large, complex industrial and infrastructure projects, often called ‘megaprojects’. The abundant megaproject governance literature, in turn, has largely focused on the so-called ‘megaproject pathologies’, i.e. the chronic budget overruns, and failure of such projects to keep to timetables and deliver the expected social and economic benefits. This article draws on these two strands of literature, identifies shortcomings, and suggests potential pathways towards an improved evaluation of megaprojects. To counterbalance the current overemphasis on relatively narrowly defined accountability as the main function of megaproject evaluation, and the narrow definition of project success in megaproject evaluation, the article argues that conceptualizing megaprojects as dynamic and evolving networks would provide a useful basis for the design of an evaluation approach better able to promote learning and to address the socio-economic aspects of megaprojects. A modified version of ‘network mapping’ is suggested as a possible framework for megaproject evaluation, with the exploration of the multiple accountability relationships as a central evaluation task, designed to reconcile learning and accountability as the central evaluation functions. The article highlights the role of evaluation as an ‘emergent’ property of spontaneous megaproject ‘governing’, and explores the challenges that this poses to the role of the evaluator.

A conceptual map of political participation - van Deth, Jan W. (Acta Politica, 2014)
How would you recognize a mode of participation if you see one? Owing to the rapid expansion of political activities in the last decades this question has become increasingly difficult to answer. Neither the development of all-embracing nominal definitions, nor deductive analyses of existing modes of participation seem to be helpful. In addition, the spread of expressive modes of participation makes it hard to avoid purely subjective definitions. The aim of this discussion paper is to develop an operational definition of political participation, which allows us to cover distinct conceptualizations systematically, efficiently and consistently. This goal can only be arrived at if the conventional approach of presenting nominal definitions to solve conceptual problems is left behind. Instead, available definitions are included in a set of decision rules to distinguish three main variants of political participation. A fourth variant is distinguished for non-political activities used for political purposes. Together, the four variants of political participation cover the whole range of political participation systematically without excluding any mode of political participation unknown yet. At the same time, the endless expansion of the modes of political participation in modern democracies does not result in an endless conceptual expansion. Implications for research and various examples are discussed.

Lessons Learned from the Forest, Climate and Communities Alliance - Boshoven, Judy (USAID, 2014)
The Forest, Climate, and Communities Alliance (FCCA) was an initiative funded by USAID’s Bureau for Economic Growth, Education, and the Environment/Office of Forestry and Biodiversity (E3/FAB) under the USAID Global Development Alliance (GDA)1 between 2009 and 2013. FCCA was one of the first USAID-funded projects for reducing emissions from deforestation and degradation (REDD+). The Rainforest Alliance (RA) implemented FCCA in Ghana and Honduras. Operating in two different contexts allowed FCCA to generate important lessons learned that may be useful as countries around the world search for approaches to prepare for and implement successful REDD+ mechanisms. In 2013, as FCCA was coming to an end, USAID tasked the Measuring Impact (MI) initiative with an independent review to generate lessons learned from FCCA. In capturing and disseminating lessons from the FCCA project, the Agency intends to contribute to the understanding of what may be effective, and under what conditions, when promoting REDD+ in conjunction with forest and agricultural product certification. MI is a five-year USAID project executed by the E3/FAB Office designed to improve the Agency’s practice of conservation by building USAID’s capacity to better design, manage, evaluate, and learn from biodiversity conservation initiatives. As such, MI was tasked with carrying out this review of lessons learned from FCCA while using RA’s general hypothesis as the basis to describe the project and its lessons.

The Good Project: Humanitarian Relief NGOs and the Fragmentation of Reason - Krause, Monika (University of Chicago Press, 2014)
NGOs set out to save lives, relieve suffering, and service basic human needs. They are committed to serving people across national borders and without regard to race, ethnicity, gender, or religion, and they offer crucial help during earthquakes, tsunamis, wars, and pandemics. But with so many ailing areas in need of assistance, how do these organizations decide where to go—and who gets the aid? In The Good Project, Monika Krause dives into the intricacies of the decision-making process at NGOs and uncovers a basic truth: It may be the case that relief agencies try to help people but, in practical terms, the main focus of their work is to produce projects. Agencies sell projects to key institutional donors, and in the process the project and its beneficiaries become commodities. In an effort to guarantee a successful project, organizations are incentivized to help those who are easy to help, while those who are hardest to help often receive no assistance at all. The poorest of the world are made to compete against each other to become projects—and in exchange they offer legitimacy to aid agencies and donor governments. Sure to be controversial, The Good Project offers a provocative new perspective on how NGOs succeed and fail on a local and global level.

Why Learning & Adaptation are Central to Making All Voices Count - Halloran, Brendan (Making All Voices Count, 2014)

Facilitator's Guide to Participatory Decision-Making - Kaner, Sam (John Wiley & Sons, 2014)
Unleash the transformative power of face to face groups The third edition of this ground–breaking book continues to advance its mission to support groups to do their best thinking. It demonstrates that meetings can be much more than merely an occasion for solving a problem or creating a plan. Every well–facilitated meeting is also an opportunity to stretch and develop the perspectives of the individual members, thereby building the strength and capacity of the group as a whole. This fully updated edition of The Facilitator′s Guide to Participatory Decision–Making guides readers through the struggle and the satisfaction of putting participatory values into practice, helping them to fulfill the promise of effective group decision–making. With previous editions already embraced by business and community leaders and consulting professionals around the world, this new book is even more insightful and easy to use. New for this edition: 60 pages of brand new skills and tools Many new case examples Major expansion and reorganization of the advanced sections of the book. New chapter: Teaching A Group About Group Dynamics Doubled in size: Classic Facilitator Challenges. Substantially improved: Designing Realistic Agendas now three chapters, with wise, insightful answers to the most vexing questions about meeting design.

Beyond 'Technology for Development' and 'Sustainability' towards Systemic and Holistic Rural Innovation: Success Factors from the Southern African Experience over 20 years - Buisson, Uys Du; Cronje, Braam; Marais, Mario; Haruperi, Emmanuel; Rensburg, Johann (2014)
Abstract: This paper describes essential, real-world activities and processes needed to develop and deploy people-centred networks enabled with innovative technologies that in turn produce "...

ALL - The question of inclusiveness in ICT-mediated citizen engagement - Berdou, Evangelia (MAVC, 2014)

The politics of legal empowerment: Legal mobilisation strategies and implications for development - Domingo, Pilar; O'Neil, Tam (ODI, 2014)
 Legal mobilisation can improve the lives of poor or marginalised people by: o contributing to pro-poor change in policy, law and regulation of service delivery across different sectors; o advancing the realisation of rights, and achieving redress for rights violations; o contesting unjust and illegal practices of resource allocation and power relations, including in relation to land and natural resources; o enabling citizens to exercise social accountability through legal action.  The outcomes of legal empowerment of the poor are not politically neutral and need to be understood within broader social and political environments;  Better coordination between justice, sector and governance interventions will maximise the development and social impact of international support for legal empowerment.

MAKING - Fostering new ideas for social inclusion and accountable, responsive governance - Edwards, Duncan (MAVC and IDS, 2014)

COUNT - Understanding the challenge of government responsiveness - McGee, Rosemary (MAVC and IDS, 2014)

VOICES - On speaking, mediation, representation and listening - Oswald, Katy (MAVC, 2014)

Complexity and the Art of Public Policy: Solving Society's Problems from the Bottom Up - Colander, David; Kupers, Roland (Princeton University Press, 2014)
Complexity science–made possible by modern analytical and computational advances–is changing the way we think about social systems and social theory. Unfortunately, economists' policy models have not kept up and are stuck in either a market fundamentalist or government control narrative. While these standard narratives are useful in some cases, they are damaging in others, directing thinking away from creative, innovative policy solutions. Complexity and the Art of Public Policy outlines a new, more flexible policy narrative, which envisions society as a complex evolving system that is uncontrollable but can be influenced. David Colander and Roland Kupers describe how economists and society became locked into the current policy framework, and lay out fresh alternatives for framing policy questions. Offering original solutions to stubborn problems, the complexity narrative builds on broader philosophical traditions, such as those in the work of John Stuart Mill, to suggest initiatives that the authors call "activist laissez-faire" policies. Colander and Kupers develop innovative bottom-up solutions that, through new institutional structures such as for-benefit corporations, channel individuals' social instincts into solving societal problems, making profits a tool for change rather than a goal. They argue that a central role for government in this complexity framework is to foster an ecostructure within which diverse forms of social entrepreneurship can emerge and blossom.

Aiding Institutional Reform in Developing Countries: Lessons from the Philippines on what works, what doesn't and why - Booth, David (The Asia Foundation, 2014)

Thinking and working politically in the transparency and accountability field - Halloran, Brendan (Transparency & Accountability Initiative, 2014)

Into the unknown: explorations in development practice - Chambers, Robert (Practical Action Publishing, 2014)
Into the Unknown reflects on the journey of learning, and encourages readers to learn from observation, curiosity, critical feedback, play and fun. This book will be of interest to development professionals, including academics, students, NGO workers and the staff of international agencies

How DFID learns - ICAI (Independent Commission for Aid Impact (ICAI), 2014)
Excellent learning is essential for UK aid to achieve maximum impact and value for money. We take learning to mean the extent to which DFID uses information and experience to influence its decisions. Each ICAI review assesses how well learning takes place. Our reports to date indicate a mixed performance. This review seeks to identify the way DFID learns and what inhibits it from doing so consistently. We drew on our reviews, assessed data from DFID’s own surveys and carried out interviews inside and outside the department. Review DFID generates considerable volumes of information, much of which, such as funded research, is publicly available. DFID does not clearly or consistently link this investment to how it can deliver better impact. We made five recommendations and gave an amber-red score. Findings DFID does not clearly identify how its investment in learning links to its performance and delivering better impact. DFID has the potential to be excellent at organisational learning if its best practices become common. DFID staff learn well as individuals. They are highly motivated and DFID provides opportunities and resources for them to learn. DFID is not yet, however, managing all the elements that contribute to how it learns as a single, integrated system. DFID does not review the costs, benefits and impact of learning. Insufficient priority is placed on learning during implementation. The emphasis on results can lead to a bias to the positive. Learning from both success and failure should be systematically encouraged. Recommendations DFID needs to focus on consistent and continuous organisational learning based on the experience of DFID, its partners and contractors and the measurement of its impact, in particular during the implementation phase of its activities. All DFID managers should be held accountable for conducting continuous reviews from which lessons are drawn about what works and where impact is actually being achieved for intended beneficiaries. All information commissioned and collected (such as annual reviews and evaluations) should be synthesised so that the relevant lessons are accessible and readily usable across the organisation. The focus must be on practical and easy-to-use information. Knowhow should be valued as much as knowledge. Staff need to be given more time to acquire experience in the field and share lessons about what works and does not work on the ground. DFID needs to continue to encourage a culture of free and full communication about what does and does not work. Staff should be encouraged always to base their decisions on evidence, without any bias to the positive.

Beyond the Pioneer: Getting inclusive industries to scale - Koh, Harvey; Hedge, Nidhi; Karamchandani, Ashish (Deloitte Touche Tohmatsu India Private Ltd (DTTIPL), 2014)

Working Politically: A story of Change about the contribution of research evidence to the new Village Law in Indonesia - Pellini, Arnaldo; Angelina, Maesy; Purnawati, Endah (Austrialian Community Development and Civil Society Strenghtening Scheme (ACCESS), 2014)
On 18 December 2013, the Indonesian House of Representatives passed the new Village Law, a vote that was the culmination of a journey that had started in 2007. This Story of Change takes the passing of the Village Law as its starting point and describes the relative influence that research-based evidence, produced by the Institute for Research and Empowerment (IRE), has had at critical junctions of the legislative process. This Story of Change concludes that good quality, research-based evidence is necessary but not sufficient to influence policy-making processes. Researchers and research organisations need to think and work politically to achieve their influencing goals and to adapt to changes in local circumstances.

Problem-driven iterative approaches and wider governance reform - Rao, Sumedh (GSDRC, University of Birmingham, 2014)
Identify evidence which suggests that problem-driven, iterative approaches to public sector reform can deliver more substantial, wider, long-term governance reform.

Achieving reforms in oligarchical democracies: the role of leadership and coalitions in the Philippines - Sidel, John T. (Developmental Leadership Program, 2014)
This paper examines the role of developmental leadership in two major reforms introduced in the Philippines in 2012: the passage into law in December of excise tax reform which significantly raised taxes on cigarettes and alcohol – generally referred to as the Sin Tax Reform – and, in July, the re-registration of voters in the Autonomous Region of Muslim Mindanao (ARMM). These reforms have a) strengthened government finances and healthcare; and b) improved the quality of elections and promoted good governance and conflict resolution in the southern Philippines. Key points: These reforms were not achieved exclusively through the executive leadership of Philippine President Benigno Aquino III, this paper argues. A broader form of developmental leadership was critical to their passage into legislation and their subsequent implementation, made up of reform coalitions that incorporated elements of government, the legislature, and civil society. While these coalitions were diverse and flexible in their form and composition, their core strength came from established advocacy groups and experienced activists. These groups and activists used highly labour-intensive, specialized and complex forms of mobilization. The success of these reform coalitions, it is argued, has implications for economic and governance reform in the developing world, particularly in systems characterised by oligarchical democracy, where competition for elected office is closely linked to the entrenched interests of business and industry.

Local Systems: a framework for supporting sustained development - USAID (USAID, 2014)

Six Simple Rules: How to Manage Complexity without Getting Complicated - Morieux, Yves; Tollman, Peter (Harvard Business Review Press, 2014)
New tools for managing complexityDoes your organization manage complexity by making things more complicated? If so, you are not alone.According to The Boston Consulting Group’s fascinating Complexity Index, business complexity has increased sixfold during the past sixty years. And, all the while, organizational complicatedness—that is, the number of structures, processes, committees, decision-making forums, and systems—has increased by a whopping factor of thirty-five. In their attempt to respond to the increasingly complex performance requirements they face, company leaders have created an organizational labyrinth that makes it more and more difficult to improve productivity and to pursue innovation. It also disengages and demotivates the workforce.Clearly it’s time for leaders to stop trying to manage complexity with their traditional tools and instead better leverage employees' intelligence. This book shows you how and explains the implications for designing and leading organizations.The way to manage complexity, the authors argue, is neither with the hard solutions of another era nor with the soft solutions—such as team building and feel-good “people initiatives”—that often follow in their wake. Based on social sciences (notably economics, game theory, and organizational sociology) and The Boston Consulting Group’s work with more than five hundred companies in more than forty countries and in various industries, authors Yves Morieux and Peter Tollman recommend six simple rules to manage complexity without getting complicated.Showing why the rules work and how to put them into practice, Morieux and Tollman give managers a much-needed tool to reinvigorate people in the face of seemingly endless complexity. Included are detailed examples from companies that have achieved a multiplicative effect on performance by using them.It’s time to manage complexity better. Employ these six simple rules to foster autonomy and cooperation and to effectively handle business complexity. As a result, you will improve productivity, innovate more, reengage your workforce, and seize opportunities to create competitive advantage.
Keywords: Complexity; Design Thinking

Participatory Budgeting as if Emancipation Mattered - Baiocchi, Gianpaolo; Ganuza, Ernesto (Politics & Society, 2014)
Participatory Budgeting has by now been widely discussed, often celebrated, and is now instituted in at least 1,500 cities worldwide. Some of its central features—its structure of open meetings, its yearly cycle, and its combination of deliberation and representation—are by now well known. In this article, however, we critically reflect on its global travel and argue for more careful consideration of some of its less well-known features, namely the coupling of the budgeting meetings with the exercise of power. We disaggregate PB into its communicative and empowerment dimensions and argue that its empowerment dimensions have usually not been part of its global expansion—and this is cause for concern from the point of view of emancipation. We thus discuss the specific institutional reforms associated with empowerment in the original version as well as its analytic dimensions. We also address some of the specific dangers of a communication-only version of PB as well as some suggestions for reintroducing empowerment.

Does Foreign Aid Really Work? An Updated Assessment - Riddell, Roger C. (Social Science Research Network, 2014)
This paper draws widely from the book Does foreign aid really work?, building on that discussion to provide an updated answer to the question based on recent evidence and contemporary debates on aid effectiveness. It starts with a brief discussion (Section 2) of the question: ‘does emergency aid work?’ This is important to the wider debate for two linked reasons. Firstly, the harshest critics of development aid are all supportive of emergency aid, with a number calling for its expansion in spite of evidence of major weaknesses and failures. Secondly, the sharp historical distinction made between emergency and development aid is becoming increasingly strained, as more emergency aid is being used a year or more after emergencies strike to rebuild lives and restore livelihoods, while more development aid is used to directly save lives.The rest of the paper focuses exclusively on development aid. Section 3 provides a rapid overview of the evidence of the impact of individual aid projects, including those of Non-Governmental Organisations (NGOs). The picture is overwhelmingly positive: well over 75% of projects meet their immediate objectives and impact has improved, even though sustaining benefits remains a challenge and there continue to be aid failures. Section 4 reviews the evidence of the wider and long-term impact of aid at the sectoral and country level, including a brief discussion of academic studies on aid and growth. Though there are still major gaps in our knowledge, the quality of the data is improving. However, there is little firm, quantitative evidence to show the specific contribution that aid has made to help achieve the Millennium Development Goals (MDGs), which are a central purpose of many current donor programmes (Section 4.2). More widely, there is plenty of evidence to suggest that aid has contributed positively to both growth and wider development at the sector and country level, though some studies suggest aid has had little or no impact. Overall, the contribution that aid makes to aggregate development is lower than the public has been led to believe (Sections 4.1, 4.3. and 4.4). Assessments of the overall impact of the aid provided by NGOs are rare, but a recent study suggests it has been positive (Section 4.5). More attention is now given to the issues of corruption in aid. Although there is evidence of aid funds being used for corrupt purposes and of aid worsening corruption, on balance it remains a minor issue. Aid has had significant successes in helping the poor affected by corruption (Section 4.6). The second half of the paper shifts focus to the large gap between what aid has done and what it might do. Section 5 discusses a range of inefficiencies within and across the aid system and their costs in terms of reduced impact, including the way aid is allocated, its growing complexity, and the volatility and unpredictability of aid flows (Section 5.1 and 5.2). These inefficiencies place in a different light the evidence of aid’s overall positive impact. The paper looks at the different initiatives that have been mounted to begin to address these weaknesses and failures, including the 2005 Paris Declaration, and discusses why donors have failed to honour the promises they have made to change the ways that they give aid.In Section 5.3, the paper argues that the most critical debate about whether aid works concerns the assessment of whether the short-term, immediate and extensive benefits that aid undoubtedly brings are outweighed by the direct and indirect systemic problems that it risks creating or accentuating. As increasingly over the last decade donors have channelled more of their aid into short-term, quick-impact projects, assessing the wider negative systemic effects of aid has become even more important. Some recent studies suggest that aid’s systemic problems are large and growing, narrowing the gap between aid’s harshest critics and broader analyses of aid impact. Against the backdrop of already too many proposals of how to make aid work better, Section 6 lays out nine concrete proposals for doing this: deepening knowledge of local contexts; ensuring short-term uses of aid are consistent with and supportive of long-term development, and that all aid is more closely related to overall recipient development goals and processes; helping build local capacities for recipients to be able to coordinate aid better; moving from rhetoric to reality in learning lessons from aid; using aid to help the poor in middle income countries; reducing volatility in aid at the country level; encouraging budget support by addressing donor-country political concerns; and rethinking ways of communicating about aid. Section 7 concludes. It suggests that, paradoxically, aid’s impact may well have been harmed by focussing too narrowly on trying to make short-term aid work better, and that the main focus of attention needs to widen to assess how aid can contribute more to a recipient’s own development goals. Additionally, donors need to help build the capacity of developing countries and developing country scholars to enable them to play a bigger role in helping to answer the question of whether aid works; unsettling though their assessments may be.

Assessing the strength of Evidence - DFID (2014)

Global Delivery at the World Bank Group - GDI (Global Delivery Initiative, 2014)

DIY - Development Impact and You: Practical Tools to Trigger and Support Social Innovation - Nesta (NESTA, 2014)
Keywords: IMPORTANT

Monitoring and evaluation of policy influence and advocacy - Tsui, Josephine; Hearn, Simon; Young, John (ODI, 2014)
Policy influence and advocacy are increasingly regarded as a means of creating sustainable policy change in international development. It is often also seen as a difficult area to monitor and evaluate. Yet there is an increasingly rich strand of innovation in options to monitor, evaluate and learn from both the successes and failures of policy influence and advocacy interventions. This paper explores current trends in monitoring and evaluating policy influence and advocacy; discusses different theories of how policy influence happens; and presents a number of options to monitor and evaluate different aspects of advocacy interventions. Case studies describe how some organisations have used these options in practice to understand their impact and improve their advocacy strategies.

The origins, development, and application of Qualitative Comparative Analysis: the first 25 years - Marx, Axel; Rihoux, Benoît; Ragin, Charles (European Political Science Review, 2014)
A quarter century ago, in 1987, Charles C. Ragin published The Comparative Method, introducing a new method to the social sciences called Qualitative Comparative Analysis (QCA). QCA is a comparative case-oriented research approach and collection of techniques based on set theory and Boolean algebra, which aims to combine some of the strengths of qualitative and quantitative research methods. Since its launch in 1987, QCA has been applied extensively in the social sciences. This review essay first sketches the origins of the ideas behind QCA. Next, the main features of the method, as presented in The Comparative Method, are introduced. A third part focuses on the early applications. A fourth part presents early criticisms and subsequent innovations. A fifth part then focuses on an era of further expansion in political science and presents some of the main applications in the discipline. In doing so, this paper seeks to provide insights and references into the origin and development of QCA, a non-technical introduction to its main features, the path travelled so far, and the diversification of applications.

Making Sense of ‘Messiness’. Monitoring and measuring change in market systems: a practitioner's perspective - Ripley, Matthew; Nippard, Daniel (2014)

Understanding the Conditions for fostering the right kind of innovation - Edwards, Duncan (Making All Voices Count, 2014)
MAVC's Duncan Edwards reflects on the first in a series of thematic discussions led by the Institute of Development Studies. The second of two posts.

Inclusion in Making All Voices Count - Kelbert, Alexandra (Making All Voices Count, 2014)
Part of a sequenced learning process for MAVC's Research and Evidence Component, the summary of a thematic discussion led by researcher Evangelia Berdou.

From ‘Feedback Loops’ to ‘Responsive Governance’ - McGee, Rosie (Making All Voices Count, 2014)
Part of a sequenced learning process for MAVC's Research and Evidence Component, the summary of a thematic discussion led by researcher Rosemary McGee.

Which Voices Are Heard and By Whom? - Oswald, Katy (Making All Voices Count, 2014)

Manifesto for Half-Arsed Development Reforms - Ramalingam, Ben (Aid on the Edge of Chaos, 2014)
Keywords: IMPORTANT

Something’s Stopping All Voices From Counting… - McGee, Rosemary (Making All Voices Count, 2014)
An outline of Making All Voices Count's Research & Evidence component led by the Institute of Development Studies.

Aid on the Edge of Chaos: Rethinking International Cooperation in a Complex World - Ramalingam, Ben (Oxford University Press, 2014)
It is widely recognised that the foreign aid system - of which every country in the world is a part - is in need of drastic overhaul. There are conflicting opinions as to what should be done. Some call for dramatic increases to achieve longstanding promises. Others bang the drum for cutting it altogether, and suggest putting the fate of poor and vulnerable people in the hands of markets or business. A few argue that what is needed is creative, innovative transformation. The arguments in Aid on the Edge of Chaos are firmly in the third of these categories. In this ground-breaking book, Ben Ramalingam shows that the linear, mechanistic models and assumptions that foreign aid is built on are more at home in early twentieth century industry than in the dynamic, complex world we face today. The reality is that economies and societies are less like machines and more like ecosystems. Aid on the Edge of Chaos explores how thinkers and practitioners in economics, business, and public policy have started to embrace new, ecologically literate approaches to thinking and acting, informed by the ideas of complex adaptive systems research. It showcases insights, experiences, and dramatic results of a growing network of practitioners, researchers, and policy makers who are applying a complexity-informed approach to aid challenges. From transforming approaches to child malnutrition, to rethinking process of macroeconomic growth, from rural Vietnam to urban Columbia, Aid on the Edge of Chaos shows how embracing the ideas of complex systems thinking can help make foreign aid more relevant, more appropriate, more innovative, and more catalytic. It argues that taking on these ideas will be a vital part of the transformation of aid, from a post-WW2 mechanism of resource transfer, to a truly innovative and dynamic form of global cooperation fit for the twenty-first century.

Probes, toolkits and prototypes: three approaches to making in codesigning - Sanders, Elizabeth B.-N.; Stappers, Pieter Jan (CoDesign, 2014)
The role of making in the design process has been growing, taking on new forms and involving new players over the past 10 years. Where we once primarily saw designers using making to give shape to the future, today we can see designers and non-designers working together, using making as a way to make sense of the future. In this paper, we describe the landscape of design research and practice at the end of 2013 with special attention to the role of making across these perspectives: approach (cultural probes, generative toolkits and design prototypes), mindset (designing for people and designing with people), focus in time (the world as it is, the near future and the speculative future) as well as variations in design intent (provoking, engaging and serving).

Strategic framework for mainstreaming citizen engagement in World Bank Group operations : engaging with citizens for improved results - Rebolledo, Miguel; Seyedian, Aaron; Peixoto, Tiago; Hernandez, Zenaida; Zakhour, Jad; Mahmood, Syed A.; Masud, Harika; Manroth, Astrid; Hamad, Qays (The World Bank, 2014)
The objective of this strategic framework is to mainstream citizen engagement in World Bank Group (WBG)-supported policies, programs, projects, and advisory services and analytics to improve their development results and within the scope of these operations, contribute to building sustainable national systems for citizen engagement with governments and the private sector. This framework will capture the diverse experiences, assess lessons learned, and outline methods and entry points to provide a more systematic and results-focused approach for the WBG. Progress toward this objective will be assessed using indicators included in program, project, and corporate results frameworks. The WBG strategy incorporates citizen engagement, including beneficiary feedback, specifically in its treatment of inclusion, which entails empowering citizens to participate in the development process and integrating citizen voice in development programs as key accelerators to achieving results. This framework builds on stocktaking and lessons learned from WBG-financed operations across regions and sectors. A key lesson is the importance of country context, government ownership, and clear objectives for citizen engagement. The approach to mainstreaming citizen engagement in WBG-supported operations is guided by five principles: 1) it is results-focused; 2) it involves engaging throughout the operational cycle; 3) it seeks to strengthen country systems; 4) it is context-specific; and 5) it is gradual. Under the right circumstances, citizen engagement can contribute to achieving development outcomes in support of the goals the WBG aims to support through all of the operations it funds: eradicating extreme poverty and boosting shared prosperity in a sustainable manner.

Kenya’s tech community will not save journalism - Benequista, Nicholas (Networked News Lab, 2014)

Assessing the use of technological tools and strategies by Oxfam Novib partners in Angola, Burundi, Egypt, Niger, Pakistan, Rwanda and Uganda - The Engine Room (2014)
This report presents findings and insights from the Oxfam Novib pilot module of TechScape, which assessed how Oxfam Novib partners in seven countries related to the use of technology in their work. This report does not aim to draw conclusions about the nature of technology use by Oxfam Novib partners per se, or even the partners included in this assessment. The dramatic difference in organizational activities, contexts and objectives are too great for that. Detailed analysis of how partners are relating to technology in their work, and specific recommendations for greater efficiency and impact are presented in the TechScape Country Briefs. This report aims instead: • to describe the context in which the assessments took place, • to propose insights gained from the cumulative process about measurement, learning and capacity development, and • to identify opportunities for Oxfam Novib to pursue capacity development and knowledge sharing between countries and across the network, through mechanisms that minimize resource demands and directly target documented needs.

Adaptive management in aid programmes (BEAM Exchange, 2014)
Aid works better – especially in complex and conflict-affected environments – when there is scope to trial and adapt programme strategies. So argues Amir Allana in Navigating Complexity, a case study of Northern Karamoja's Growth, Health and Governance (GHG) Programme that is adopting an 'adaptive management' approach. This BEAM Exchange webinar invited Amir, Tim Sparkman and Peter Roggekamp to discuss lessons from their work in Uganda and Cambodia. What does adaptive management look like in practice? And what does it require of managers and funders to make it happen? Tim and Peter share their experiences of applying adaptive management techniques to the Growth, Health and Governance Programme and the Cambodia Agricultural Value Chain Program (CAVAC). Amir highlight insights from the Navigating Complexity report, including the importance of office culture, consistent management signals, and the role of supportive tools and processes.

Navigating complexity: adaptive management and organizational learning in a development project in Northern Uganda - Allana, Amir; Sparkman, Timothy (Knowledge Management for Development Journal, 2014)
Adaptive management is a management paradigm for intervening in complex, unpredictable systems where continual learning and adaptation is vital for success. This management approach requires a fundamentally different set of tools, processes, and most importantly, staff behaviors and organizational culture than ‘traditional’ management. A facilitative approach to development, where the goal is creating systemic change that spreads in networks of local businesses, government, and civil society organizations, necessitates an adaptive approach. Mercy Corps Uganda’s Northern Karamoja Growth, Health, and Governance Program (GHG) has been an ongoing experiment in applying the principles of adaptive management and facilitation. This article details two examples from GHG where adaptation has occurred, and provides an analysis of the tools, processes, and organizational culture that exists. Three salient takeaways for effective facilitation are elaborated on: the importance of staff behaviors and underlying beliefs, particularly with regards to ‘failure’, flexibility to experiment, dissent & debate, and curiosity with the subject matter of their work; importance of consistent messaging from senior management with regards to the same; and tools and processes playing a support function to these behaviours, rather than being their source. Lessons and implications are drawn out from the GHG experience for funders and implementing organizations wanting to apply adaptive management in the context of development programming. These include building flexibility into budgeting and contracts, rethinking the structure and content of reports, and utilizing alternative hiring criteria to attract senior managers who are more likely to succeed at adaptive management.

Making Details Matter: How to Reform Aid Agencies to Generate Contextual Knowledge - Ang, Yuen Yuen (SSRN, 2014)
My essay considers a central problem of reinventing foreign aid in the twenty-first century: how to reform aid agencies to enable a “best-fit” approach to development assistance. For the past decades, the aid community has tried to transplant best practices from the developed world to the developing world. Increasingly, however, it is recognized that copying best practices does not work and may even backfire; rather, aid programs work best when they are tailored to local contexts. Yet while the idea of a best-fit approach is widely embraced in principle, actualizing it is easier said than done. For meaningful changes to take root in practice, we must first identify the obstacles to localizing development assistance and suggest ways to address these problems. To this end, I propose a three-pronged strategy to promote the generation of contextual knowledge among aid professionals, a necessary condition for crafting solutions that can fit various local contexts, namely: (1) build a bank of knowledge about unorthodox practices that work, (2) diversify expertise within aid agencies; and (3) carve experimental pockets. My proposal does not fit neatly into any one of the six themes specified in the GDN competition; rather, it concerns all of the themes. Whether it is to use aid to improve governance, apply information technology, or design financial instruments, the overarching challenge is to empower and incentivize aid professionals to learn and apply contextual knowledge to creatively solve problems in developing societies.
Keywords: Contextual knowledge; Localization; Public policy; foreign aid; international development

Increasing Participation in Evaluation - Baker, A; Bruner, B (Bruner Foundation, 2014)
The Increasing Participation in Evaluation bulletin was developed by Anita Baker with Beth Bruner to help organizations integrate evaluative thinking into their organizational practice. This three page bulletin discusses how Organization Staff, Evaluators, and Funders are typically involved in participatory evaluation. The guide also defines the term "Ripple", and how to accomplish Ripple as well as examining what it looks like when Executive Leaders and Management Staff use Evaluative Thinking. Contents How are Organization Staff, Evaluators, and Funders typically involved in Participatory Evaluation? Organization Managers/Staff Roles Evaluators/Roles Funder Roles Shared Roles What is Ripple Anyway? How do you accomplish Ripple? What does it look like when Executive Leaders and Management Staff Use Evaluative Thinking? How to use these Bulletins

Guidelines for good market development program design. A managers’ perspective - Bekkers, Harald; Roggekamp, Peter (BEAM Exchange, 2014)
Good programme design is a key factor contributing to the success of market development programmes. Unfortunately, too many current designs have major flaws which prevent programmes becoming successful even before they get started. This document considers what makes market development programmes consistently successful and how to prevent programme design from being a hurdle to sustainable and efficient impact as scale.

Assessing Impact in Dynamic and Complex Environments: Systemic Action Research and Participatory Systemic Inquiry - Burns, Danny (IDS, 2014)
This CDI Practice Paper is about the uses of Systemic Action Research (SAR) and Participatory Systemic Inquiry (PSI) for impact assessment (Burns 2006, 2007, 2011, 2012, 2013; Wadsworth 2001, 2010).

Systemic action research: Changing system dynamics to support sustainable change - Burns, Danny (Action Research, 2014)
This article explores the characteristics of systemic action research. It looks at the conceptual underpinnings of systemic action research and explores some of the ways in which it differs from (builds on) other forms of action research. It then explores some of the issues and dilemmas faced by systemic action researchers.

Citizen science in hydrology and water resources: opportunities for knowledge generation, ecosystem service management, and sustainable development - Buytaert, Wouter; Zulkafli, Zed; Grainger, Sam; Acosta, Luis; Alemie, Tilashwork C.; Bastiaensen, Johan; De Bièvre, Bert; Bhusal, Jagat; Clark, Julian; Dewulf, Art; Foggin, Marc; Hannah, David M.; et al. (Frontiers in Earth Science, 2014)
The participation of the general public in the research design, data collection and interpretation process together with scientists is often referred to as citizen science. While citizen science itself has existed since the start of scientific practice, developments in sensing technology, data processing and visualisation, and communication of ideas and results, are creating a wide range of new opportunities for public participation in scientific research. This paper reviews the state of citizen science in a hydrological context and explores the potential of citizen science to complement more traditional ways of scientific data collection and knowledge generation for hydrological sciences and water resources management. Although hydrological data collection often involves advanced technology, the advent of robust, cheap and low-maintenance sensing equipment provides unprecedented opportunities for data collection in a citizen science context. These data have a significant potential to create new hydrological knowledge, especially in relation to the characterisation of process heterogeneity, remote regions, and human impacts on the water cycle. However, the nature and quality of data collected in citizen science experiments is potentially very different from those of traditional monitoring networks. This poses challenges in terms of their processing, interpretation, and use, especially with regard to assimilation of traditional knowledge, the quantification of uncertainties, and their role in decision support. It also requires care in designing citizen science projects such that the generated data complement optimally other available knowledge. Lastly, we reflect on the challenges and opportunities in the integration of hydrologically-oriented citizen science in water resources management, the role of scientific knowledge in the decision-making process, and the potential contestation to established community institutions posed by co-generation of new knowledge.
Keywords: Citizen science; Co-generation of knowledge; Water Resources Management; hydrological sensing; poly-centric governance

Assessing Rural Transformations: Piloting a Qualitative Impact Protocol in Malawi and Ethiopia - Copestake, James; Remnant, Fiona (Centre for Development Studies (CDS), 2014)

Using Participatory Process Evaluation to Understand the Dynamics of Change in a Nutrition Education Programme - Cornwall, Andrea (IDS Working Papers, 2014)
With roots in approaches to popular education and participatory action research that place the learner and the ‘beneficiary’ of development at the centre of enquiry and action, the participatory visualisation methods associated with Participatory Rural Appraisal have been widely used as tools for learning and accountability. In this article, I reflect on lessons learnt from using these methods in a participatory process evaluation of an educational programme aimed at addressing chronic malnutrition in an East African country. Building on this experience, I explore the educative and empowering dimensions of participatory visualisation methods, and consider the contribution that these methods can make to effective evaluation.
Keywords: Kenya; nutrition; participatory impact evaluation; process evaluation; randomised controlled trials

Emerging Technologies: Smarter ways to fight wildlife crime - Cressa, Douglas; Zommers, Zinta (Environmental Development, 2014)
The illegal trade of animals—for luxury goods, traditional medicine or cultural ceremonies, pets, entertainment, and even research—is a major threat to wildlife conservation and welfare (Baker et al., 2013). Poachers and illegal traders use highly sophisticated and rapidly changing techniques to avoid detection. To keep pace with the "war on wildlife", conservation and law enforcement communities have started to adopt cutting-edge military tools and techniques. High-tech equipment can magnify counter-poaching efforts without requiring armies of rangers or risking lives. Tools include acoustic traps, mobile technology, mikrokopters, radio frequency identification tags, encrypted data digital networks, camera traps, DNA testing, radio collars, metal scanners, and satellite imagery.

Introducción a Capacity WORKS + Proyectos de Cambio - Informe - Cuéllar, Daniel (GIZ, 2014)

Collaborative Outcome Mapping - Dart, J.; Roberts, M. (Better Evaluation, 2014)
Collaborative Outcomes Reporting (COR) is a participatory approach to impact evaluation based around a performance story that presents evidence of how a program has contributed to outcomes and impacts, that is then reviewed by both technical experts and program stakeholders, which may include community members. Collaborative Outcomes Reporting (COR) is a participatory approach to impact evaluation based around a performance story that presents evidence of how a program has contributed to outcomes and impacts, that is then reviewed by both technical experts and program stakeholders, which may include community members. Developed by Jess Dart, COR combines contribution analysis andMultiple Lines and Levels of Evidence (MLLE), mapping existing data and additional data against the program logic to produce a performance story. Performance story reports are essentially a short report about how a program contributed to outcomes. Although they may vary in content and format, most are short, mention program context and aims, relate to a plausible results chain, and are backed by empirical evidence (Dart and Mayne, 2005). The aim is to tell the ‘story’ of a program’s performance using multiple-lines of evidence. COR adds processes of review by an expert panel and stakeholders, sometimes including community members, to check for the credibility of the evidence about what impacts have occurred and the extent to which these can be credibly attributed to the intervention. It is these components of expert panel review (outcomes panel) and a collaborative approach to developing outcomes (through summit workshops) that differentiate COR from other approaches to outcome and impact evaluation.

Behavioral Design: A New Approach to Development Policy - Datta, Saugato; Mullainathan, Sendhil (Review of Income and Wealth, 2014)

Learning and adapting: the use of monitoring and evaluation in countering violent extremism: a handbook for practitioners - Dawson, Laura; Edwards, Charlie; Jeffray, Calum; Royal United Services Institute for Defence and Security Studies (Royal United Services Institute for Defence and Security Studies, 2014)
IN 2013, the Royal United Services Institute for Defence and Security Studies (RUSI) was awarded a grant under the Kanishka Project to develop a handbook for monitoring and evaluating counter violent extremism (CVE) policies and programmes. The aim of this handbook is to support CVE policy-makers and practitioners (those who design, manage and evaluate CVE programmes), by providing them with key terms regarding violent extremism and radicalisation, describing the purpose of evaluation, and providing examples of key methodologies they can employ to conduct monitoring and evaluation (M&E) in this emerging policy field. The handbook will enable readers to understand why, when and how to conduct an evaluation of a CVE policy, programme or project. .
OCLC: 1079851950

The case for thinking and working politically. The implications of 'doing development differently' - DLP (DLP, 2014)
This paper discusses the steps required to build a robust evidence base for 'thinking and working politically' (TWP) in development. It argues that better understanding what works, when and why is an important step in moving TWP into mainstream development programming. The paper reviews the existing evidence base on TWP, building on this and on other literature on public sector reform and 'pockets of effectiveness' to suggest research questions, case study selection criteria, and a four-level analytical framework: 1) political context; 2) sector; 3) organisation; and 4) individual. The framework aims to help build a 'rigorous enough' evidence base to show whether and how TWP happens and whether or not it influences the effectiveness of programme implementation and outcomes. The paper also calls for more focus on gender issues, and on different – and often more fragile – political contexts.

Information lives of the poor: fighting poverty with technology - Elder, Laurent; Samarajiva, Rohan; Gillwald, Alison; Galperin, Hernan (2014)

Empowerment evaluation - Fettermen, David (2014)

Capacity WORKS - GIZ (2014)
One of GIZ’s core competencies is understanding how cooperation works in societies, and supporting that process. The kind of process we mean is cooperation between state, civil society and private-sector actors who wish to jointly shape societal changes. GIZ has systematised its knowledge on how to achieve this, and made it available in the Capacity WORKS management model. The model describes how to manage cooperation systems.

Capacity Works - online training - GIZ (GIZ, 2014)

Participatory Approaches - Guijt, Irene (UNICEF, 2014)
This guide, written by Irene Guijt for UNICEF, looks at the use of participatory approaches in impact evaluation. Using participatory approaches means involving stakeholders, particularly those affected by intervention, in the evaluation process. This includes involvement in the design, data collection, analysis, reporting, and management of the study. Excerpt "By asking the question, ‘Who should be involved, why and how?’ for each step of an impact evaluation, an appropriate and context-specific participatory approach can be developed. Managers of UNICEF evaluations must recognize that being clear about the purpose of participatory approaches in an impact evaluation is an essential first step towards managing expectations and guiding implementation. Is the purpose to ensure that the voices of those whose lives should have been improved by the programme or policy are central to the findings? Is it to ensure a relevant evaluation focus? Is it to hear people’s own versions of change rather than obtain an external evaluator’s set of indicators? Is it to build ownership of the UNICEF programme? These, and other considerations, would lead to different forms of participation by different combinations of stakeholders in the impact evaluation."

Systemic Design Principles for Complex Social Systems - Jones, Peter H. (Social Systems and Design, 2014)
Keywords: IMPORTANT

Introduction - Localising Governance: An Outlook on Research and Policy - Joshi, Anuradha; Schultze-Kraft, Markus (IDS Bulletin, 2014)

Monitoring and Evaluation in the Development Sector - KPMG (KPMG International, 2014)

Measuring Impact: A Learning Approach to Strengthening USAID Biodiversity Programs - Lauck, Liz (2014)

Steering E-Government Projects from Failure to Success: Using Design-Reality Gap Analysis as a Mid-Implementation Assessment Tool - Lessa, Lemma; Negash, Solomon; Belachew, Mesfin (Emerging Issues and Prospects in African E-Government:, 2014)
There are many e-government failures in developing countries. Most studies look at these after the event (post hoc), but this chapter takes an original approach to look mid-implementation (durante hoc) in order to provide recommendations for improvement. The authors chose a partial failure/partial success land management information system being implemented in one Ethiopian city. The project has made retrieval of land information quicker and simpler but is only partly implemented, and is still—on occasion—circumvented by public servants for personal gain. They used design-reality gap framework to understand why the project had partly failed. The authors used the design-reality gap analysis to propose an action plan that would help institutionalise the system, steering it from partial failure to success. They demonstrate the value of this framework as a tool for mid-implementation analysis of e-government projects. The authors recommend its usage on other ongoing e-government projects in developing countries.

Power, Violence, Citizenship and Agency - McGee, Rosemary (IDS Bulletin, 2014)

Political economy analysis: Topic Guide - Mcloughlin, Claire (GSDRC, University of Birmingham, 2014)
Political economy analysis (PEA) aims to situate development interventions within an understanding of the prevailing political and economic processes in society – specifically, the incentives, relationships, and distribution and contestation of power between different groups and individuals. Such an analysis can support more politically feasible and therefore more effective development strategies by setting realistic expectations …

Complexity-Aware Monitoring Discussion Note (Screencast) - Patsalides, Melissa; Britt, Heather (2014)
This screencast covers information included in the Complexity-Aware Monitoring Discussion Note. The topic is intended for those seeking cutting-edge solutions to monitoring complex aspects of strategies and projects. Most of the principles and promising approaches discussed here have a significant body of theory and practice behind them, but many have not been used to monitor USAID strategies and projects. We have much to learn about whether and how they can be applied successfully in the Agency. USAID's Office of Learning, Evaluation, and Research in the Bureau of Policy, Planning, and Learning has partnered with different groups through monitoring trials to build a body of evidence regarding which complexity-aware M&E approaches are most effective in the contexts of USAID programming.

Power Above and Below the Waterline: Bridging Political Economy and Power Analysis - Pettit, Jethro; Mejía Acosta, Andrés (IDS Bulletin, 2014)

Local First in practice - Pinnington, R (Peace Direct, 2014)

Participation Schemas: a tool to characterize collaborative participation - Prieto-Martín, Pedro (PDD2014, Contemporary difficulties and future prospects for Participatory and Deliberative Democracy, NewCastle, 2014)

Caracterizando la participación ciudadana en el marco del Gobierno Abierto - Prieto-Martín, Pedro; Ramírez-Alujas, Álvaro V. (Revista del CLAD. Reforma y Democracia, 2014)
Este artículo profundiza conceptualmente en las dimensiones del Gobierno Abierto, centrándose en el análisis y caracterización de su dimensión participativa. Se propone, en primer lugar, una tipología de actos participativos que muestra el efecto potenciador que las TIC ejercen sobre las distintas formas de participación. En segundo lugar, se presentan los denominados “Esquemas de participación” (EdP), un instrumento conceptual que facilita el análisis y la representación estandarizada de las dimensiones más importantes de la participación. Los EdP proporcionan así, por un lado, un modelo de categorización que extiende nuestra comprensión crítica de la participación y, por otro lado, una herramienta potente y flexible para la comunicación, el diseño y la evaluación de diversos tipos de iniciativas participativas.

Innovation teams and labs. A Practice Guide - Puttick, Ruth (Nesta, 2014)

From best practice to best fit: understanding and navigating wicked problems in international development - Ramalingam, Ben; Laric, Miguel; Primrose, John (ODI, 2014)

Adapting lean thinking to market systems development: Principles and practices for donors/funders - Rasmussen, Leanne (Engineers without borders, 2014)
The purpose of this paper is to provide funders and implementers of market systems development (MSD) projects with principles, practices, and structures that enables these projects to thrive. It is based on a book that has sold millions of copies worldwide, and a school of thought taught at institutions such as Harvard Business School and practiced in companies ranging from giants such as Toyota to the most successful tech start-ups in Silicon Valley. Published in 2011, Eric Ries wrote the Lean Startup as a remedy to the countless start-ups that create their own demises by getting started with the wrong goals, the wrong structures, and the wrong processes. He outlines an approach that enables the startup to navigate ambiguity and risk while using resources effectively. The conditions a MSD project faces are remarkably similar to those which a startup business faces; it needs structures and processes that are matched to the unpredictable, complex environment which it is attempting to influence. MSD projects can thus benefit from private-sector thought leadership on how start-ups can situate themselves for success. This paper starts with an overview of lean thinking, a concept that derives from lean manufacturing which is widely accepted as the leading approach to modern manufacturing. It explains how Ries’s Lean Startup adapts these principles, and then it in turn adapts these ideas for market systems development. The following three sections provide an overview of Lean Startup concepts, applying them to the development sector as appropriate. The final section summarizes and makes suggestions on next steps for funders who wish to set MSD projects up for success using a lean approach. Overall, the paper builds a case for how the Lean Startup’s approach can enable MSD projects to work successfully in ambiguity and increase their potential for achieving robust and sustainable results, all while using donor resources more efficiently.
Keywords: Adaptive Development; Lean

Theory of Change - Rogers, Patricia (UNICEF, 2014)

The politics of public sector performance: pockets of effectiveness in developing countries - Roll, Michael (Routledge, 2014)
OCLC: 869850351

Starting out on Social Return on Investment - SROI Network; Aitken, Hall (2014)
This guide, created by the SROI Network in collaboration with Hall Aitken, is aimed at providing guidance to those who have never used SROI on where to begin. The guide provides practical steps to beginning the process of SROI and includes links to tools aimed at supporting its implementation. Excerpt "Most public, private and third sector organisations have a pretty good idea of the costs of what they do. Annual accounts, management accounts, budget reports and a whole accountancy profession add up to a great deal of effort to make sure this is the case. Some organisations are quite good at counting what they do with these resources. They can track the number of users or contacts, or customers. Many can provide some evidence that these activities lead to some sort of change. But very few can explain clearly why all this matters. What would happen if they did not exist? What is the real value of what they do? Social Return on Investment sets out to redress the balance by looking at value not just cost." Contents Part one – why, what and how? Why does social value matter? What is SROI? How do I do SROI? Next steps Part two – progress tool Part three – practical next steps Steps to involve stakeholders Steps to understand what changes Steps to value the things that matter Steps to only include what is material Steps to avoid overclaiming Steps to be transparent Steps to verify the result

Beyond Ballotocracy: Citizens' Voices and the Many Faces of Unruly Politics - Tadros, Mariz (IDS Bulletin, 2014)

Organisational Performance Index - The Kenya Institute of Management (2014)
The OPI Business Excellence Model exists to help organizations improve their performance and succeed in the competitive global marketplace. We are dedicated to improving African organizations regardless of sector, size or structure. The OPI was developed in response to feedback from organization participating in Company of the Year Award (COYA) and SME of the Year Award (SMOYA), who called on the Kenya Institute of Management (KIM) to refine the assessment methodology in order to emphasize the relationship between instilling smart business processes and generating strong business results. Whilst there are numerous management tools and techniques commonly used, the OPI Excellence Model is a practical, non-prescriptive framework which provides a holistic view of the organisation and it can be used to determine how these different methods fit together and complement each other. The Model can therefore be used in conjunction with any number of these tools, based on the needs and function of the organisation, as an overarching framework for developing sustainable excellence. We also administer the Annual Company of the Year Awards (COYA) and the SME of the Year Awards (SMOYA). Our key services are to identify and recognize role-model organizations, share best management practices, and help organizations achieve best-in-class performance levels. The OPI is an excellence model that generates a rating between 1 and 10, which sets a minimum score that an organisation must attain to remain competitive. The attainment of a minimum Organisation Performance Index ( OPI) demonstrates that organisations have applied an organisational strategy that drives effectiveness and competitiveness; failure to attain the minimum OPI demonstrates the organisation has not engaged the processes required to enable world class organisational performance.

USAID’s Data Quality Standards & Conducting a DQA - USAID (2014)

Adaptive Management: From More Talk to Real Action - Williams, Byron K.; Brown, Eleanor D. (Environmental Management, 2014)
The challenges currently facing resource managers are large-scale and complex, and demand new approaches to balance development and conservation goals. One approach that shows considerable promise for addressing these challenges is adaptive management, which by now is broadly seen as a natural, intuitive, and potentially effective way to address decision-making in the face of uncertainties. Yet the concept of adaptive management continues to evolve, and its record of success remains limited. In this article, we present an operational framework for adaptive decision-making, and describe the challenges and opportunities in applying it to real-world problems. We discuss the key elements required for adaptive decision-making, and their integration into an iterative process that highlights and distinguishes technical and social learning. We illustrate the elements and processes of the framework with some successful on-the-ground examples of natural resource management. Finally, we address some of the difficulties in applying learning-based management, and finish with a discussion of future directions and strategic challenges.
Keywords: IMPORTANT

Rapid outcome mapping approach: a guide to policy engagement and influence - Young, John; Shaxson, Louise; Jones, harry; Hearn, Simon; Datta, Ajoy; Cassidy, Caroline (ODI, 2014)

The Design of Everyday Things, revised and expanded edition - Norman, Donald A. (MIT Press, 2013)
Even the smartest among us can feel inept as we try to figure out the shower control in a hotel or attempt to navigate an unfamiliar television set or stove. When The Design of Everyday Things was published in 1988, cognitive scientist Don Norman provocatively proposed that the fault lies not in ourselves, but in design that ignores the needs and psychology of people. Fully revised to keep the timeless principles of psychology up to date with ever-changing new technologies, The Design of Everyday Things is a powerful appeal for good design, and a reminder of how – and why – some products satisfy while others only disappoint.

Building tech-powered public services - Bickerstaffe, Sarah (Institute for Public Policy Research, 2013)
Given the rapid pace of technological change and take up by the public it is a question of when not if public services become tech powered This new paper asks how we can ensure that innovations are successfully introduced and deployed

Adaptive Leadership: Accelerating Enterprise Agility - Highsmith, Jim (Addison-Wesley Professional., 2013)

Politics, Political Change and International Development - Halloran, Brendan (Politics, Governance and Development, 2013)
As my inaugural post on my new blog, I thought I would re-post a short piece I wrote earlier this year about foreign aid (original here). Thomas Carothers and Diane de Garamont address this issue i…

Adaptive programming - Vowles, Pete (DFID Bloggers, 2013)
Staff blogs from the UK Department for International Development. Get real-life perspectives from those on the ground to fight poverty and join in the debate.

Learning about Theories of Change for the Monitoring and Evaluation of Research Uptake - Barnett, Chris; Gregorowski, Robbie (IDS, 2013)
This paper captures lessons from recent experiences on using ‘theories of change’ amongst organisations involved in the research–policy interface. The literature in this area highlights much of the complexity inherent in the policymaking process, as well as the challenges around finding meaningful ways to measure research uptake. As a tool, ‘theories of change’ offers much, but the paper argues that the very complexity and dynamism of the research-to-policy process means that any theory of change will be inadequate in this context. Therefore, rather than overcomplicating a static depiction of change at the start (to be evaluated at the end), incentives need to be in place to regularly collect evidence around the theory, test it periodically, and then reflect and reconsider its relevance and assumptions.
Accepted: 2013-10-01T11:27:00Z

Natural Disaster Monitoring with Wireless Sensor Networks: A Case Study of Data-intensive Applications upon Low-Cost Scalable Systems - Chen, Dan; Liu, Zhixin; Wang, Lizhe; Dou, Minggang; Chen, Jingying; Li, Hui (Mobile Networks and Applications, 2013)
The wireless sensor network (WSN) technology has applied in monitoring natural disasters for more than one decade. Disasters can be closely monitored by augmenting a variety of sensors, and WSN has merits in (1) low cost, (2) quick response, and (3) salability and flexibility. Natural disaster monitoring with WSN is a well-known data intensive application for the high bandwidth requirements and stringent delay constraints. It manifests a typical paradigm of data-intensive application upon low-cost scalable system. In this study, we first assessed representative works in this area by classifying those in the domains of application of WSNs for disasters and optimization technologies significantly distinguishing these from general-purpose WSNs. We then described the design of an early warning system for geohazards in reservoir region, which relies on the WSN technology inspired by the existing work with focuses on issues of (1) supporting reliable data transmission, (2) handling huge data of heterogeneous sources and types, and (3) minimizing energy consumption. This study proposes a dynamic routing protocol, a method for network recovery, and a method for managing mobile nodes to enable real-time and reliable data transmission. The system incorporates data fusion and reconstruction approaches to bring together all data into a single view of the geohazard under monitoring. A distributed algorithm for joint optimal control of power and rate has been developed, which can improve utility of network (> 95 %) and to minimize the energy consumption (reduction by > 20 % in comparison with LEACH). Experimental results indicate the potentials of the proposed approaches in terms of adapting to the needs of early warning on geohazards.
Keywords: Data-intensive application; Geohazard; Natural disaster monitoring; Scalable system; Wireless sensor network

“Shared learning” for building urban climate resilience – experiences from Asian cities - Orleans Reed, Sarah; Friend, Richard; Toan, Vu Canh; Thinphanga, Pakamas; Sutarto, Ratri; Singh, Dilip (Environment and Urbanization, 2013)
This paper considers how resilience thinking and, in particular, its emphasis on learning has been applied in 10 cities in Vietnam, India, Thailand and Indonesia. Applying a “shared learning” approach in the Asian Cities Climate Change Resilience Network (ACCCRN) has helped to create or strengthen networks, build appreciation for complexity and uncertainty among stakeholders, provide a space for deliberating concepts such as vulnerability and resilience, and build knowledge and capacities for stakeholders to engage and represent their own interests. Shared learning approaches face considerable challenges navigating politicized urban environments, in which the nature and value of existing systems − and therefore the value of building resilience − are contested. This article suggests that deliberate, strategic intervention by facilitators may contribute to more transformative change on behalf of equitable, socially just outcomes – and thus cautions against seeing urban climate vulnerability as a technical challenge, or shared learning as a “toolkit” for building resilience.

Defining the burden of proof in conservation - Salafsky, Nick; Redford, Kent H. (Biological Conservation, 2013)
Conservationists often must take action in the face of uncertainty about the costs and benefits of different options. Although this uncertainty can be paralyzing when the stakes are high, there is obviously a cost to inaction as well as action, and decision makers need to be encouraged to act when appropriate. Many other fields of human endeavor such as law, medicine, and public safety have formally developed the “burden and standards of proof” that decision makers have to meet in choosing to take action. In this paper, we review the standards developed in these other fields to help define a similar framework for conservation. Specifically we propose that a conservation decision maker must assume the burden of proof when there is a decision to act that substantially affects others, in which the decision maker has professional standing, where there is not immediate urgency, and where there is some, but not complete certainty about the outcomes of acting versus not acting. Once these initial tests have been met, in situations in which the decision maker is more worried about the consequences of not acting, then a relatively low standard of proof is required for taking action. If the decision maker is concerned with the consequences of acting in error, but the action is relatively reversible, then a medium standard of proof is required. And finally, if there are concerns about the consequences of acting in error, but the action is relatively irreversible, then a high standard of proof is required.
Keywords: Biodiversity; Burden of proof; Decision theory; Standard of proof; Uncertainty

Outcome Mapping - Better Evaluation (Better Evaluation, 2013)
Outcome mapping (OM) is a methodology for planning, monitoring and evaluating development initiatives in order to bring about sustainable social change. As the name suggests, its niche is understanding outcomes; the so-called ‘missing-middle’ or ‘black box’ of results that emerge downstream from the initiative’s activities but upstream from longer-term economic, environmental, political or demographic changes. At the planning stage, the process of outcome mapping helps a project team or program be specific about the actors it intends to target, the changes it hopes to see and the strategies appropriate to achieve these. For ongoing monitoring, OM provides a set of tools to design and gather information on the results of the change process, measured in terms of the changes in behaviour, actions or relationships that can be influenced by the team or program.

Learning study on 'the users' in Technology for Transparency and Accountability initiatives: Assumptions and realities - McGee, Rosemary; Carlitz, Ruth (IDS, 2013)

Pathways for Change: 10 Theories to Inform Advocacy and Policy Change Efforts - Stachowiak, Sarah (Center for Evaluation Innovation, 2013)
One of our most popular publications, this brief, produced in collaboration with ORS Impact, summarizes 10 theories grounded in social science about how policy change happens. The theories can help to untangle beliefs and assumptions about the inner workings of the policymaking process and identify causal connections supported by research to explain how and why a change may or may not occur. Advocates of all stripes seek changes in policy as a way to achieve impact at a scale and degree of sustainability that differs from what can be achieved through direct services or programs alone. Advocates and funders each come to policy work with a set of beliefs and assumptions about how change will happen, and these beliefs shape their thinking about what conditions are necessary for success, which tactics to undertake in which situations, and what changes need to be achieved along the way. These worldviews are theories of change, whether or not they explicitly have been stated or documented as such. When articulated as theories of change, these strategy and belief system roadmaps can clarify expectations internally and externally, and can facilitate more effective planning and evaluation. This brief lays out 10 theories grounded in diverse social science disciplines and worldviews that have relevance to the world of advocacy and policy change. Global and tactical theories include: - “Large Leaps” or Punctuated Equilibrium theory - “Policy Windows” or Agenda-Setting theory - “Coalition” theory or Advocacy Coalition Framework - “Power Politics” or Power Elites theory - “Regime” theory - “Messaging and Frameworks” theory - “Media Influence” or Agenda-Setting theory - “Grassroots” or Community Organizing theory - “Group Formation” or Self-Categorization theory - “Diffusion” theory or Diffusion of Innovations The theories can help to untangle beliefs and assumptions about the inner workings of the policymaking process and identify causal connections supported by research to explain how and why a change may or may not occur. This piece is not meant to be comprehensive of all possible relevant theories and approaches; rather, it introduces and illustrates a handful of theories that may be useful to advocates, funders, and evaluators.

Designing Participatory Meetings and Brownbags: A TOPS Quick Guide to Linking Development Practitioners - TOPS (Technical and Operational Performance Support Program, USAID, 2013)
Visit this resource for ideas on designing meetings and brownbags that are engaging and build inopportunities for participant dialogue.

Guidelines for the Monitoring System for Development-Related Changes (MERV) - SDC (SDC, 2013)

Smart Environmental Monitoring Using Wireless Sensor Networks - El-Bendary, Nashwa; Fouad, Mohamed; Ramadan, Rabie; Banerjee, Soumya; Hassanien, Aboul (Wireless Sensor Networks, 2013)

From a last mile century to a first mile revolution: the future is OSLO - Indy Johar (Medium, 2013)
The Future is OSLO

Citizen-Centered Governance: The Mayor's Office of New Urban Mechanics and the Evolution of CRM in Boston - Crawford, Susan P.; Walters, Dana (Social Science Research Network, 2013)
Over the last three years, the Boston Mayor's Office of New Urban Mechanics, the innovative, collaborative ethos within City Hall fostered by Mayor Menino and h

Lessons for Effective resilience programs: a case study of the RAIN program in Ethiopia - Kleiman, Shanti (Mercy Corps, 2013)
The RAIN program experience affirms the importance of multi-year and flexible funding as key program design features if progress in resilience building is to be supported in areas with high levels of structural and temporal vulnerability. These features enable management to respond effectively to changing circumstances in order to better meet the needs of communities and to create the necessary conditions for relief-to-development strategies to take hold. Finally, this study found that deliberate and effective coordination between donor agencies can ensure that development gains achieved during one program period are directly leveraged by subsequent programs, thereby increasing the effectiveness of resilience programs.

Rubrics: A Method for Surfacing Values and Improving the Credibility of Evaluation - King, Julian; McKegg, Kate; Oakden, Judy; Wehipeihana, Nan (Journal of MultiDisciplinary Evaluation, 2013)

Building a Better International NGO: Greater than the Sum of the Parts? - Crowley, James; Ryan, Morgana (Kumarian Press, 2013)
In the wake of tremendous growth in the size and scope of their activities, as well as the increased complexity of their programs, how can large international NGOs work effectively―so that the whole is greater than the sum of the parts? James Crowley and Morgana Ryan address this question, drawing on their extensive hands-on experience to offer a practical and even provocative guide. The authors cover a range of essential topics, among them: What are INGOs good at? What should they be good at? Where does new technology fit in? What about accountability? What’s the best way to tackle strategic planning? In the process, they challenge those in leadership positions to recognize and implement the changes that are needed so that their organizations can perform better―and stay relevant―in the decades to come.

What is democratic evaluation? - Picciotto, R. (2013)
This article from Robert Picciotto provides an overview of democratic evaluation, particularly with reference to its use in the European Union context. "Can evaluation strengthen the democratic process? Speciﬁcally can it help ﬁll the democratic deﬁcit (limited transparency; weak bureaucratic accountability, etc.) often ascribed to the European Union? First and foremost, evaluators operating in the European space should be committed to the ethical and democratic values of the European project and the promotion of its social inclusion and cohesion ideals. But two other sets of challenges must also be met: those that relate to evaluation in democracy and those that relate to democracy in evaluation. The former has to do with the macro positioning of evaluation processes in society. The latter has to do with the evaluation approaches and methods used in deliberative democratic decision making processes." (Picciotto, 2013)

An analysis of factors influencing success of ICT4D projects: a case study of the Schools Computerisation Programme in Mashonaland West Province, Zimbabwe. - Musiyandaka, Donna; Ranga, Gideon; Kiwa, Jacqueline Fungai (The Journal of Community Informatics, 2013)
Keywords: ICT4D programmes; success factors

Citizens Against Corruption: Report from the Front Line - Landell-Mills, Pierre (Matador, 2013)
Citizens Against Corruption: Report From The Front Line tells the story of how groups of courageous and dedicated citizens across the globe are taking direct action to root out corruption. It shows how people are no longer prepared to accept the predatory activities of dishonest officials and are challenging their scams. It draws on over 200 unique case studies that describe initiatives undertaken by 130 civil society organisations (CSOs) which engage directly with public agencies to stop the bribery and extortion that damages peoples' lives and obstructs social and economic progress. This book challenges the notion that, at best, civil society can only have a marginal impact on reducing corruption and argues that aid donors need to radically rethink their assistance for governance reform. Part 1 analyses the role citizens can play in fighting corruption and promoting good governance and briefly tells the story of the Partnership for Transparency Fund (PTF). Part 2 presents studies of India, Mongolia, Philippines, and Uganda - each with its unique history and distinctive circumstances - to illustrate activities undertaken by CSOs to root out corruption, including the tools and approaches that are being used to build pressure on corrupt public agencies to become transparent and accountable. Part 3 addresses key themes - strengthening the rule of law, putting in place effective national anti-corruption strategies and institutions, making public buying and selling honest, promoting grassroots monitoring of public expenditures and the provision of public services, mounting media campaigns to expose and defeat corruption, and empowering ordinary citizens to keep watch on what actually happens at the point of delivery of public services. Part 4 is a summary of lessons learnt and explores the potential, as well as the risks and limitations, of civic activism in a world where greed and dishonesty is the norm. Finally, the book explores the opportunities and dangers faced by aid donors in supporting local CSOs and charts a way forward. Citizens Against Corruption: Report From The Front Line will be of interest to staff working in CSOs and aid agencies, policy analysts and researchers concerned about corruption and poor governance.

Outcome Measurement in Local Governance Programmes: a Power Dimension - McGee, Rosemary; Pettit, Jethro (IDS, 2013)

Development Aid Confronts Politics: The Almost Revolution - Carothers, Thomas; de Gramont, Diane (EDS Publications Ltd., 2013)
A new lens on development is changing the world of international aid. The overdue recognition that development in all sectors is an inherently political process is driving aid providers to try to learn how to think and act politically. Major donors are pursuing explicitly political goals alongside their traditional socioeconomic aims and introducing more politically informed methods throughout their work. Yet these changes face an array of external and internal obstacles, from heightened sensitivity on the part of many aid-receiving governments about foreign political interventionism to inflexible aid delivery mechanisms and entrenched technocratic preferences within many aid organizations. This pathbreaking book assesses the progress and pitfalls of the attempted politics revolution in development aid and charts a constructive way forward.

Is It Time for a New Paradigm for "Citizen Engagement"? The Role of Context and What the Evidence Tells Us - O'Meally, Simon (People, Spaces, Deliberation, 2013)
The meteoric rise of "citizen engagement" Almost all development agencies promote some form of citizen engagement and accountability, often framed as 'voice', 'demand-side governance', 'demand for good governance' or 'social accountability'. The current World Bank president, Jim Yong Kim, recently put it that, "citizen voice can be pivotal in providing the demand-side pressure on government, service providers, and organizations such as the World Bank that is needed to encourage full and swift response to citizen needs". There has, in turn, been a mushrooming of useful operational guidance on different "tools" for social accountability - i.e. steps, inputs and methodologies - that guide discrete interventions, ranging from citizen score cards to participatory expenditure tracking. One might, however, be forgiven for thinking that some of the debates on citizen engagement need an injection of realism; especially as contextual factors can make or break a "tool's" implementation. A review of experience to date would be one good place to start.

EPE Week: Lee-Anne Molony on Collaborative Outcomes Reporting - Molony, L A (AEA365 a Tip-a-day by and for Evaluators, 2013)
This AEA365 blog, written by Lee-Anne Molony a Principal Consultant at Clear Horizon, provides a brief overview on Collaborative Outcomes Reporting (COR).

Importing Democracy: The Role of NGO's in South Africa, Tajikistan, & Argentina - Fisher, Julie (Kettering Foundation Press, 2013)
While street protesters demanding democratic reforms make headlines in the international news, Importing Democracy: The Role of NGOs in South Africa, Tajikistan, and Argentina, written by Julie Fisher and published by the Kettering Foundation Press, focuses on a quieter movement led by democratization NGOs. In South Africa, the Good Governance Learning Network shares participatory tools to make local governments more responsive. In Tajikistan, Jahan teaches local police about human rights. In Argentina, seven democratization NGOs sponsor public deliberations in local communities and have organized a nationwide citizens network to combat municipal government corruption. The book is organized around three chapters for each country, South Africa, Tajikistan, and Argentina. The first chapter of each country s section begins with the historical, political, and economic context and continues with a discussion of the general contours of civil society. The second chapter in each section deals with the role of democratization NGOs in promoting both loyal opposition and law-based civil liberties. The third chapter focuses on their role in promoting political culture and political participation. Loyal opposition and law-based civil liberties help define democratization at the national level, whereas changes in political culture and increased political participation often occur throughout society. Following the nine country chapters, the book concludes with a comparative overview and implications for international policy. Fisher, a former Kettering Foundation program officer, writes that the idea that democracy can be exported has lost credibility in recent years. In many countries, however, democratization NGOs are importing democratic ideas and recovering local democratic traditions.

It's All About MeE: Using Structured Experiential Learning (“e”) to Crawl the Design Space - Pritchett, Lant; Samji, Salimah; Hammer, Jeffrey (Center for Global Development, 2013)
This paper argues that within-project variations in design can serve as their own counterfactual, reducing the incremental cost of evaluation and increasing the direct usefulness of evaluation to implementing agencies. It suggests combining monitoring (‘M’), structured experiential learning (‘e’), and evaluation (‘E’) so as to facilitate innovation and organisational capability building while also providing accountability …

Retrospective ‘Outcome Harvesting’: Generating robust insights about a global voluntary environmental network - Rassmann, Kornelia; Smith, Richard; Mauremootoo, John; Wilson-Grau, Ricardo (Better Evaluation, 2013)

Be Nice. Fund Results. Minimize Hassle. Help Out. - Starr, Kevin (Stanford Social Innovation Review, 2013)
The word from the trenches on how funders can make life easier for everyone.

Reflections on applying iterative and incremental software development methodologies to aid and development work in developing countries - Haikin, Matt (MattHaikin.com, 2013)

Adaptive Action: Leveraging Uncertainty in Your Organization - Eoyang, Glenda H.; Holladay, Royce J. (Stanford University Press, 2013)
Rooted in the study of chaos and complexity, Adaptive Action introduces a simple, common sense process that will guide you and your organization into reflective action. This elegant method prompts readers to engage with three deceptively simple questions: What? So what? Now what? The first leads to careful observation. The second invites you to thoughtfully consider options and implications. The third ignites effective action. Together, these questions and the tools that support them produce a dynamic and creative dance with uncertainty. The road-tested steps of adaptive action can be used to devise solutions and improve performance across multiple challenges, and they have proven to be scalable from individuals to work groups, from organizations to communities. In addition to laying out the adaptive action framework and clear protocols to support it, Glenda H. Eoyang and Royce J. Holladay introduce best practices from exemplary professionals who have used adaptive action to meet personal, professional, and political challenges in leadership, consulting, Alzheimer's treatment, evaluation, education reform, political advocacy, and cultural engagement―readying readers to employ this new toolkit to meet their own goals with a sense of ingenuity and flexibility.

Making the Most of Mess: Reliability and Policy in Today's Management Challenges - Roe, Emery (Duke University Press Books, 2013)
In Making the Most of Mess, Emery Roe emphasizes that policy messes cannot be avoided or cleaned up; they need to be managed. He shows how policymakers and other professionals can learn these necessary skills from control operators who manage large critical infrastructures such as water supplies, telecommunications systems, and electricity grids. The ways in which they prevent major accidents and failures offer models for policymakers and other professionals to manage the messes they face.Throughout, Roe focuses on the global financial mess of 2008 and its ongoing aftermath, showing how mismanagement has allowed it to morph into other national and international messes. More effective management is still possible for this and many other policy messes but that requires better recognition of patterns and formulation of scenarios, as well as the ability to translate pattern and scenario into reliability. Developing networks of professionals who respond to messes is particularly important. Roe describes how these networks enable the avoidance of bad or worse messes, take advantage of opportunities resulting from messes, and address societal and professional challenges. In addition to finance, he draws from a wide range of case material in other policy arenas. Roe demonstrates that knowing how to manage policy messes is the best approach to preventing crises.

A problem-focused approach to violence against women: The political-economy of justice and security programming - Denney, Lisa; Domingo, Pilar (ODI, 2013)
The United Nations Commission on the Status of Women ended its 57th session on 15 March 2013 with an outcome document affirming the importance of eliminating violence against women (VAW). The Commission was unable, however, to achieve consensus on a global action plan. The negative reaction of some UN member states to an action plan is a worrying reminder of ongoing resistance to reform. These persistent challenges highlight the continuing struggle to gain a serious global commitment to address VAW and recognise it as a breach of women’s fundamental human rights. Engaging in this struggle, many donors have put addressing VAW generally, and in fragile and conflictaffected situations (FCAS) specifically, at the top of the development agenda and made it a major priority of international policy. But in practice progress remains difficult, not least due to entrenched resistance and discriminatory socio-political norms and gender relations that persist in many societies. The problem of violence against women therefore needs to be addressed from the perspective of the concrete socio-political and cultural conditions that shape its particular features and the relevant context specific dynamics of conflict, post-conflict patterns of violence and fragility. International efforts to support reform in the area of VAW in FCAS need to go beyond prescriptive approaches that focus on what access to protection, justice and redress should look like. We propose here an approach that engages with the specificities of the problem – paying attention to context, and the concrete political-economy dynamics of the drivers of VAW – and takes account of the real options that

Monitoring and Evaluating Conflict Sensitivity: Methodological Challenges and Practical Solutions - Goldwyn, Rachel; Chigas, Diana (DFID, 2013)

Adaptive management: where are we now? - Rist, Lucy; Campbell, Bruce M.; Frost, Peter (Environmental Conservation, 2013)
Adaptive management (AM) emerged in the literature in the mid-1970s in response both to a realization of the extent of uncertainty involved in management, and a frustration with attempts to use modelling to integrate knowledge and make predictions. The term has since become increasingly widely used in scientific articles, policy documents and management plans, but both understanding and application of the concept is mixed. This paper reviews recent literature from conservation and natural resource management journals to assess diversity in how the term is used, highlight ambiguities and consider how the concept might be further assessed. AM is currently being used to describe many different management contexts, scales and locations. Few authors define the term explicitly or describe how it offers a means to improve management outcomes in their specific management context. Many do not adhere to the idea as it was originally conceived, despite citing seminal work. Significant confusion exists over the distinction between active and passive approaches. Over half of the studies reporting to implement AM claimed to have done so successfully, yet none quantified specific benefits, or costs, in relation to possible alternatives. Similarly those studies reporting to assess the approach did so only in relation to specific models and their parameterizations; none assessed the benefits or costs of AM in the field. AM is regarded by some as an effective and well-established framework to support the management of natural resources, yet by others as a concept difficult to realize and fraught with implementation challenges; neither of these observations is wholly accurate. From a scientific and technical perspective many practical questions remain; in particular real-world assessments of the value of experimentation within a management framework, as well as of identified challenges and pathologies, are needed. Further discussion and systematic assessment of the approach is required, together with greater attention to its definition and description, enabling the assessment of new approaches to managing uncertainty, and AM itself.
Keywords: Adaptive Management; Decision making; Natural resource management; conservation; experimental management; uncertainty

Improving the Evaluability of INGO Empowerment and Accountability Programmes - Shutt, Cathy; McGee, Rosemary (Centre for Development Impact, 2013)

The Limits of Institutional Reform in Development: Changing Rules for Realistic Solutions - Andrews, Matt (Cambridge University Press, 2013)
Institutional reforms are common across the globe. Think of efforts to build new governments in Afghanistan and Iraq; or decades worth of interventions intended to improve fiscal management, reduce corruption or introduce efficient public sector service delivery in African countries.These reforms often have limited results, however. They lead to new laws that are not properly implemented, and new organizations that have poor capacities and fail to function as needed. In this book, Matt Andrews explains why reform results are frequently limited and suggests ways to overcome these limits. In the first half of the book, Andrews argues that reforms fail to make governments better when they are introduced as signals to gain short-term support–from donors and others. Reforms as signals introduce unrealistic best practices that do not fit developing country contexts and are not considered relevant by implementing agents. The result is a set of new forms that do not function properly. Andrews uses examples to prove this point, ranging from efforts to introduce fiscal rules in Argentina to reforms aimed at international accounting standard adoption in many African countries, and anti corruption interventions in Malawi and Uganda. In the second half of the book, Andrews notes that there are instances where reforms are not being introduced as signals, and are having more of an impact on government effectiveness. Examples include local government reforms in Rwanda, anti corruption initiatives in Indonesia, and a variety of initiatives ranging from results based management to civil service modernization and internal control regime adoption in governments like Kenya, Kosovo and Afghanistan. Andrews uses these examples to discuss ways in which reforms can actually provide realistic solutions to governance challenges in developing countries. Lessons from these experiences suggest that reform limits can be overcome by focusing interventions on problem solving, and promoting incremental and localized processes to find solutions, involving multiple agents who can authorize and implement reforms.

Monitoring, Evaluation and Learning in NGO Advocacy - Findings from Comparative Policy Advocacy MEL Review Project - Coe, Jim; Majot, Juliette (ODI and Oxfam, 2013)
For organizations committed to social change, advocacy often figures as a crucial strategic element. How to assess effectiveness in advocacy is, therefore, important. The usefulness of Monitoring, Evaluation and Learning (MEL) in advocacy are subject to much current debate. Advocacy staff, MEL professionals, senior managers, the funding community, and stakeholders of all kinds are searching for ways to improve practices – and thus their odds of success – in complex and contested advocacy environments. This study considers what a selection of leading advocacy organizations are doing in practice. We set out to identify existing practice and emergent trends in advocacy-related MEL practice, to explore current challenges and innovations. The study presents perceptions of how MEL contributes to advocacy effectiveness, and reviews the resources and structures dedicated to MEL.

Learning Lab - Collaborate, Learn and Adapt for better development outcomes - Learning Lab (USAID, 2013)
CLA is: a component of several missions' CDCSes. a conceptual framework for some principles and operational processes that can enable USAID to become a more effective learning organization and thereby a more effective development organization. an approach to facilitating local participation and capacity and promoting country-led development. For more information on CLA visit:

Adaptive Management in the Face of Climate Change and Endangered Species Protection - Gardner, Emily (Ecology Law Quarterly, 2013)

Impact Evaluation: Taking stock and looking ahead - Conference report - Visser, Irene; Guijt, Irene; Kusters, Cecile (Centre for Development Innovation, 2013)
This report summarises the presentations and discussions of the Conference ‘Impact evaluation. Taking stock and looking ahead’, which took place in Wageningen on March 25 and 26, 2013. The Conference was organised and funded by the Centre for

Embracing Emergence: How Collective Impact Addresses Complexity - Kania, John; Kramer, Mark (Stanford Social Innovation Review, 2013)
Collective impact is upending conventional wisdom on how we achieve social progress.

Systems Innovation - Discussion Paper - Mulgan, Geoff; Leadbeater, Charlie (NESTA, 2013)
Introduction Over the past few years there has been growing interest in systemic innovation. We are defining this as an interconnected set of innovations, where each influences the other, with innovation both in the parts of the system and in the ways in which they interconnect. Yet rather than simply theorising, we want to make this practical. We want to explore the potential of systemic innovation to help tackle some of the key challenges the UK currently faces, from supporting an ageing population to tackling unemployment. We would also like to open up the discussion, to engage with the wide and diverse range of experts already working this space to help sharpen up thinking about systemic innovation and influence practical work to advance it. About this paper The two essays contained within this paper are intended to contribute to this debate. The first paper by Geoff Mulgan addresses a number of questions about systemic – or ‘joined–up’ – innovation, asking what it means to truly transform a system, encompassing the means, methods, and actions needed to realise its potential. The second paper from Charlie Leadbeater argues that companies, governments, cities, and entire societies need to move from seeing innovation in products and services as a source of competitive advantage, to focussing on innovation with entire systems. Our next steps: helping make systemic innovation useful and useable This report is just the start. We want to work with academics, practitioners, policymakers, and others in the field, to help realise the great potential of connecting and joining up innovative products, services and processes so that the whole is more than the parts. Over the coming months we will be building upon the rich and diverse literature available (we have start collating this as an annex to this paper), as well as practitioner experience, to ensure we understand systems more rigorously, as well as the skills, capabilities, methods and means needed to help them change for the better.

Utilization-Focused Evaluation (U-FE) Checklist - Patton, Michael Quinn (The Evaluation Center, 2013)
Utilization-Focused Evaluation begins with the premise that evaluations should be judged by their utility and actual use; therefore, evaluators should facilitate the evaluation process and design any evaluation with careful consideration of how everything that is done, from beginning to end, will affect use. Use concerns how real people in the real world apply evaluation findings and experience and learn from the evaluation process. The checklist is based on Essentials of Utilization-Focused Evaluation (Patton, 2012, Sage Publications). All references in the checklist to exhibits and menus refer to this book. Step 1 Assess and build program and organizational readiness for utilization-focused evaluation. Step 2 Assess and enhance evaluator readiness and competence to undertake a utilizationfocused evaluation. Step 3 Identify, organize, and engage primary intended users. Step 4 Conduct situation analysis with primary intended users Step 5 Identify primary intended uses by establishing the evaluation’s priority purposes. Step 6 Consider and build in process uses if appropriate. Step 7 Focus priority evaluation questions. Step 8 Check that fundamental areas for evaluation inquiry are being adequately addressed. Step 9 Determine what intervention model or theory of change is being evaluated. Step 10 Negotiate appropriate methods to generate credible findings and support intended use by intended users. Step 11 Make sure intended users understand potential controversies about methods and their implications. Step 12 Simulate use of findings. Step 13 Gather data with ongoing attention to use. Step 14 Organize and present the data for use by primary intended users. Step 15 Prepare an evaluation report to facilitate use and disseminate significant findings to expand influence. Step 16 Follow up with primary intended users to facilitate and enhance use. Step 17 Metaevaluation of use: Be accountable, learn, and improve

Scaling Up Development Programmes - UNDP (UNDP, 2013)
Many development organizations, national and local governments and civil society organizations are faced with the issue of scaling up development interventions — the main questions raised time and again are: a) what should be scaled up, and how it can be scaled up; b) is there a strong reason for a particular initiative to be scaled up; and c) what should be the value-added of the scaling up efforts, and how can practitioners ensure that technological and other innovations are being integrated for improved development effectiveness? Answers to these questions depend on a host of complex realities—the relative strengths and weaknesses in national and local systems, political and economic situations, including vulnerability of country systems to shocks, commitments from development partners, power dynamics between various groups and stakeholders in a given country, regional and global environments. For the United Nations Country Teams (UNCT) and UNDP offices, another factor to consider is how to maximize our respective comparative advantages. This guidance note summarizes the main conceptual thinking available from development institutions and academia, and presents a simplified conceptual framework and roadmap for scaling up processes. It also provides UNDP programme staff and UNCTs with practical actions and checklists to consider when designing and implementing programmes that support national scaling up initiatives, and proposes actions that can be undertaken at the regional and global levels. Although intended for internal audiences, the scaling up concept and recommendations can also be used by the public and private sector, civil society and social entrepreneurs. This note benefited from a wide consultative process held in 2011, including practical recommendations and proposals from colleagues at country offices and regional/global centres. Their insights have been instrumental in the distillation of main recommendations presented in this note, and the individuals who provided substantive contributions are gratefully noted in the Acknowledgements section.

Explaining positive deviance in public sector reforms in development - Andrews, Matt (World Institute for Development Economic Research (UNU-WIDER), 2013)
Public sector reforms are commonplace in developing countries. Much of the literature about these reforms reflects on their failures. This paper asks about the successes and investigates which of two competing theories best explain why some reforms exhibi
Keywords: Development; Innovation; Reform; case survey; governance; growth; leadership

Tools for supporting sustainable natural resource management and livelihoods - Ashley, Holly; Kenton, Nicole; Milligan, Angela (2013)
OCLC: 951490115

Use Case and Requirements Analysis in a Remote Rural Context in Mali - Bon, Anna; de Boer, Victor; Gyan, Nana Baah; van Aart, Chris; De Leenheer, Pieter; Tuyp, Wendelien; Boyera, Stephane; Froumentin, Max; Grewal, Aman; Allen, Mary; Tangara, Amadou; Akkermans, Hans (Requirements Engineering: Foundation for Software Quality, 2013)
[Context & motivation] Few studies have reported on a systematic use case and requirements analysis of low-tech, low-resource contexts such as rural Africa. This, despite the widespread agreement on the importance of Information and Communication Technologies (ICT) for social and rural development, and despite the large number of ICT projects targeting underprivileged communities. [Question/problem] Unfamiliarity with the local context and differences in cultural and educational backgrounds between end-users and software engineers are the challenges for requirements engineering (RE) we encountered. [Principal ideas/results] We describe a systematic approach to RE in developing areas, based on the Living Lab methodology. Our approach is supported by extensive field research and based on co-creation within a multi-disciplinary and multi-cultural team of developers and users. This approach creates a shared understanding of the problem and its local context, and optimizes communication. [Contribution] We illustrate the approach using a case study of web- and voice-based communication services, that we developed for a rural context in Mali.

Complexity-Aware Monitoring - Britt, Heather; Patsalides, Melissa (USAID's Learning, Evaluation, and Research Office, 2013)

Review of the use of report cards for monitoring ecosystem and waterway health - Connolly, Rod; Bunn, Stuart; Campbell, Marnie; Escher, Beate; Hunter, Jane; Maxwell, Paul; Richmond, Sarah; Rissik, David; Roiko, Anne; Smart, Jim; Teasdale, Peter; Harbour, Sunrise Over Gladstone (Gladstone Healthy Harbour Partnership, 2013)

Evaluating Countering Violent Extremism: Practice and Progress - Fink, Naureen Chowdhury; Romaniuk, Peter; Barakat, Rafia (Center on Global Counterterrorism Cooperation, 2013)

The Impact of Transparency and Accountability Initiatives - Gaventa, John; McGee, Rosemary (Development Policy Review, 2013)

The P Process - Five Steps to Strategic Communication - HCCC (Johns Hopkins University, 2013)
The P Process is one of the most respected tools used in designing SBCC programs. Developed in 1982, the P Process is a tool for planning strategic, evidence-based health communication programs. More than thirty years later, communication professionals around the world are using the P Process to design, implement, monitor, and evaluate communication strategies, materials, and programs. The P Process is a step-by-step roadmap that can guide you from a loosely defined concept about changing behavior to a strategic and participatory program that is grounded in theory and has measurable impact. This update of the P Process incorporates lessons learned and acknowledges the real-time, dynamic nature of the strategic process as well as new technologies and the constantly changing nature of communication, social norms, individual behavior, and decision-making. It draws from many other disciplines, including design theory, behavioral economics, social psychology, and anthropology. At its essence though, the P Process is a tool that is only as useful as the data and thinking that go into each step. The attached file contains both the English and French versions.

Signal Left, Turn Right: Central Rhetoric and Local Reform in China - Huang, Haifeng (Political Research Quarterly, 2013)
How have local governments in China been able to break through central policy restrictions in a unitary and authoritarian political system? Why is China's official discourse in the reform era often so conservative and unfavorable to reform? The author argues the two issues are components of a signaling game between China's central government and local officials, in which local officials know that the center may be reformist, but the reformist center imitates the rhetoric of a conservative center to control the pace of local liberalization. The result is a gradualist reform of "signaling left, turning right," with glaring incongruity of speech and actions in the process.

Design reality gap issues within an ICT4D project: an assessment of Jigawa State Community Computer Center - Kanya, Rislana Abdulazeez; Good, Alice (2013)
This paper evaluates the Jigawa State Government Community Computer centre project using the design reality gap framework. The purpose of this was to analyse the shortfall between design expectations and implementation realities, in order to find out the current situation of the project. Furthermore to analyse whether it would meet the key stakeholder’s expectation. The Majority of Government ICT Projects is classified as either failure or partial failure. Our research will underpin a case study of Jigawa State Community Computer centre project. To support our argument we conducted a qualitative case study in which we conducted two interviews, and a survey to find out the current status of the project. Our findings indicated that the project can be classified as a partial failure because few of the centres, operating in some areas of the community, offered socio-economic advancement. Our results also indicated that the project design reality gap is quite significant. This gap occurred due to poor planning and implementation of the project. Our research reveals several challenges that could impact upon the successfulness of the project provide a foundation for further research and add to existing literature. The challenges associated with the project we identify include poor state of power supply, lack of community engagement during the project planning and implementation, lack of commitment from the Local Government Administration. Our research has potential in adding ICT4D literature, reveals how ICT4D project evaluation can be carried out using design reality gap framework and provides guideline for policy makers.

Managing Upward and Downward Accountability in an International Development Project - A Case Study of a World Bank Telecommunications Infrastructure Project in Benin - Kolker, Eva; Kulldorff, Catharina (Master's Thesis, Stockholm School of Economics, 2013)
Keywords: Downward accountability; Upward accountability

Definitions of Agile Software Development and Agility - Laanti, Maarit; Similä, Jouni; Abrahamsson, Pekka (Systems, Software and Services Process Improvement, 2013)
The Agile Manifesto and Agile Principles are typically referred to as the definitions of "agile" and "agility". However, many other definitions exist in the literature. Thus the different definitions provide interesting source for research. For each definition we examine where their emphasis is and compare that to the emphases found in the Agile Principles.

In the goldfish bowl: science and technology policy dialogues in a digital world - Latta, Susie; Mulcare, Charlotte; Zacharzewski, Anthony (Sciencewise, 2013)

Real Time Monitoring and the New Information Technologies - Lucas, Henry; Batchelor, Simon; Berdou, Evangelia (IDS Bulletin, 2013)
Debates as to the potential role of new Information and Communication Technologies (ICTs) in monitoring the wellbeing of vulnerable groups is often bedevilled by the failure of two principal actors – social researchers and technical experts – to address the other’s concerns or even to use language that is comprehensible to the other side. The aim here is to unpick some of the technical language relevant in this context and provide a brief introductory guide to some aspects of the current, rapidly changing and highly diverse ICT environment.

Localizing Development : Does Participation Work? - Mansuri, Ghazala; Rao, Vijayendra (Washington, DC: World Bank, 2013)
The Policy Research Report Localizing Development: Does Participation Work? brings analytical rigor to a field that has been the subject of intense debate and advocacy, and billions of dollars in development aid. It briefly reviews the history of participatory development and argues that its two modalities, community-based development and local decentralization, should be treated under the broader unifying umbrella of local development. It suggests that a distinction between organic participation (endogenous efforts by civic activists to bring about change) and induced participation (large-scale efforts to engineer participation at the local level via projects) is key, and focuses on the challenges of inducing participation. The report provides a conceptual framework for thinking about participatory development and then uses this framework to conduct a comprehensive review of the literature. The framework develops the concept of “civil society failure” and explains its interaction with government and market failures. It argues that participatory development, which is often viewed as a mechanism for bypassing market and government failures by ”harnessing” civic capacity, ought to be seen instead as a mechanism that, if done right, could help to repair important civil society failures. It distills literature from anthropology, economics, sociology, and political science to outline the challenges for effective policy in this area, looking at issues such as the uncertainty of trajectories of change, the importance of context, the role of elite capture and control, the challenge of collective action, and the role of the state. The review of the evidence looks at a variety of issues: the impact of participatory projects on inclusion, civic capacity, and social cohesion; on key development outcomes, such as income, poverty, and inequality; on public service delivery; and on the quality of local public goods. It draws on the evidence to suggest several recommendations for policy, emphasizing the key role of learning-by-doing. It then reviews participatory projects funded by the World Bank and finds the majority lacking in several arenas – particularly in paying attention to context and in creating effective monitoring and evaluation systems that allow for learning.

Mapping Context for Social Accountability: A resource paper - O'Meally, Sion C. (The World Bank, 2013)

DAC Peer Review of Switzerland - 2013 - OECD (OECD, 2013)

Guide to Evaluating Participatory Processes - Practical guide - Parés, Marc (2013)
Guide to Evaluating Participatory Processes - Practical guide
Keywords: Academia; Biology; Computer Science; Earth Sciences; Geography; History; Law; Math; Medicine; Philosophy; Physics; Political science; Psychology; Religion; Research; economics; universities

Implementation research in health: a practical guide - Peters, David; Tran, Nhan; Adam, Taghreed; Alliance for Health Policy and Systems Research; World Health Organization (World Health Organization, 2013)
Interest in implementation research is growing, largely in recognition of the contribution it can make to maximizing the beneficial impact of health interventions. As a relatively new and, until recently, rather neglected field within the health sector, implementation research is something of an unknown quantity for many. There is therefore a need for greater clarity about what exactly implementation research is, and what it can offer. This Guide is designed to provide that clarity. Intended to support those conducting implementation research, those with responsibility for implementing programs, and those who have an interest in both, the Guide provides an introduction to basic implementation research concepts and language, briefly outlines what it involves, and describes the many opportunities that it presents. The main aim of the Guide is to boost implementation research capacity as well as demand for implementation research that is aligned with need, and that is of particular relevance to health systems in low- and middle-income countries (LMICs). Research on implementation requires the engagement of diverse stakeholders and multiple disciplines in order to address the complex implementation challenges they face. For this reason, the Guide is intended for a variety of actors who contribute to and/or are impacted by implementation research. This includes the decision-makers responsible for designing policies and managing programs whose decisions shape implementation and scale-up processes, as well as the practitioners and front-line workers who ultimately implement these decisions along with researchers from different disciplines who bring expertise in systematically collecting and analyzing information to inform implementation questions. The opening chapters (1-4) make the case for why implementation research is important to decision-making. They offer a workable definition of implementation research and illustrate the relevance of research to problems that are often considered to be simply administrative and provide examples of how such problems can be framed as implementation research questions. The early chapters also deal with the conduct of implementation research, emphasizing the importance of collaboration and discussing the role of implementers in the planning and designing of studies, the collection and analysis of data, as well as in the dissemination and use of results. The second half of the Guide (5-7) detail the various methods and study designs that can be used to carry out implementation research, and, using examples, illustrates the application of quantitative, qualitative, and mixed-method designs to answer complex questions related to implementation and scale-up. It offers guidance on conceptualizing an implementation research study from the identification of the problem, development of research questions, identification of implementation outcomes and variables, as well as the selection of the study design and methods while also addressing important questions of rigor.
Section: The Chinese version is published by Guangdong Provincial Academy of Chinese Medical Sciences (Guangdong Provincial Hospital of Chinese Medicine; The Second Affiliated Hospital of Guangzhou University of Chinese Medicine), N° 111 Dade Road, Yuexiu District, Guangzhou, Guangdong, 510120, P.R. China.
Keywords: Delivery of Health Care; Health Plan Implementation; Health Policy; Health Services Research; Research Design; standards

Power Analysis: A Practical Guide - Pettit, Jethro (Sida, 2013)

Utilization focused evaluation: a primer for evaluators - Ramirez, Ricardo; Brodhead, Dal (Southbound, 2013)
Ramírez, R., & Brodhead, D. (2013). Utilization focused evaluation: A primer for evaluators. Penang, Malaysia: Southbound. Retrieved from http://evaluationinpractice.files.wordpress.com/2013/04/ufeenglishprimer... This book, authored by Ricardo Ramírez and Dal Brodhead, is designed to support evaluators and program managers implement Utilization-focused evaluation (UFE). It includes detailed discussion of the 12 steps for implementing UFE and also provides a number of case studies to guide the user. Excerpt "Throughout this Primer we refer to the value of having a mentor to assist an evaluator who is using UFE for the first time. Our collective experiences with UFE indicated having a mentor was, for many UFE participants, an essential support and it reflects how we learned and mentored UFE. Evaluators may use elements of a UFE in their work naturally, for example by engaging users in planning the process or in assisting them in the utilization of findings. This Primer, however, walks the reader through UFE by systematically covering all of the 12 steps. It reflects deeply on the UFE evaluation practice and builds from it." (Ramírez & Brodhead 2013) Contents What is Utilization Focused Evaluation? 1 The UFE Framework Summarized in Steps 3 The DECI Project 6 The UFE Steps Illustrated with Project Examples 9 Step 1 Assessing Program Readiness 10 Step 2 Assessing Evaluators’ Readiness 18 Step 3 Identifying Primary Intended Users 24 Step 4 Situational Analysis 31 Step 5 Identification of Primary Intended Users 38 Step 6 Focusing the Evaluation 44 Step 7 Evaluation Design 54 Step 8 Simulation of Use 58 Step 9 Data Collection 62 Step 10 Data Analysis 65 Step 11 Facilitation of Use 68 Step 12 Meta Evaluation 72 Summary About What Each Step Entails 76 What Benefit Does UFE Bring to Commissioners of Evaluation? 81 Take Away Lessons 83 Postscript 87 The UFE Checklist 89 Case Studies 103 Recommended Reading 110
OCLC: 856648540

Doing the Transparent State: open government data as performance indicators - Ruppert, Evelyn; others (A World of Indicators: The production of knowledge and justice in an interconnected world, 2013)

Miradi Measures Dashboard Demo - Salzer, D (2013)
Live demonstration (view in HD) of a new online measures dashboard site (http://miradi.sitkatech.com) that allows users of the Miradi Adaptive Management software (http://miradi.org) to share the progress they are making towards achieving their desired results

Perspectives on Participation in Design - Sanders, Elizabeth (Wer gestaltet die Gestaltung? Praxis, Theorie und Geschichte des partizipatorischen Designs, 2013)
OCLC: 930782596
Keywords: Design

Routledge international handbook of participatory design - Simonsen, Jesper; Robertson, Toni (Routledge, 2013)
"Participatory Design is about the direct involvement of people in the co-design of the technologies they use. Its central concern is how collaborative design processes can be driven by the participation of the people affected by the technology designed. Embracing a diverse collection of principles and practices aimed at making technologies, tools, environments, businesses, and social institutions more responsive to human needs, the International Handbook of Participatory Design is a state-of-the-art reference handbook for the subject. The Handbook brings together a multidisciplinary and international group of highly recognized and experienced experts to present an authoritative overview of the field and its history and discuss contributions and challenges of the pivotal issues in Participatory Design, including heritage, ethics, ethnography, methods, tools and techniques and community involvement. The book also highlights three large-scale case studies which show how Participatory Design has been used to bring about outstanding changes in different organisations. The book shows why Participatory Design is an important, highly relevant and rewarding area for research and practice. It will be an invaluable resource for students, researchers, scholars and professionals in Participatory Design"–
OCLC: 754734489

Chris Argyris: theories of action, double-loop learning and organizational learning - Smith, Mark K. (The encyclopedia of pedagogy and informal education, 2013)
Chris Argyris: theories of action, double-loop learning and organizational learning. The work of Chris Argyris (1923-2013) has influenced thinking about the relationship of people and organizations…

Outcome mapping for health system integration - Tsasis, Peter; Evans, Jenna; Forrest, David; Jones, Richard Keith (Journal of Multidisciplinary Healthcare, 2013)
Health systems around the world are implementing integrated care strategies to improve quality, reduce or maintain costs, and improve the patient experience. Yet few practical tools exist to aid leaders and managers in building the prerequisites to integrated care, namely a shared vision, clear roles and responsibilities, and a common understanding of how the vision will be realized. Outcome mapping may facilitate stakeholder alignment on the vision, roles, and processes of integrated care delivery via participative and focused dialogue among diverse stakeholders on desired outcomes and enabling actions. In this paper, we describe an outcome-mapping exercise we conducted at a Local Health Integration Network in Ontario, Canada, using consensus development conferences. Our preliminary findings suggest that outcome mapping may help stakeholders make sense of a complex system and foster collaborative capital, a resource that can support information sharing, trust, and coordinated change toward integration across organizational and professional boundaries. Drawing from the theoretical perspectives of complex adaptive systems and collaborative capital, we also outline recommendations for future outcome-mapping exercises. In particular, we emphasize the potential for outcome mapping to be used as a tool not only for identifying and linking strategic outcomes and actions, but also for studying the boundaries, gaps, and ties that characterize social networks across the continuum of care.

Cherry-Picked Intelligence. The Weapons of Mass Destruction Dispositive as a Legitimation for National Security in the Post 9/11 Age - van der Heide, Liesbeth (Historical Social Research / Historische Sozialforschung, 2013)
»Geheimdienste mit Scheuklappen: Das Dispositiv der Massenvernichtungswaffen als Legitimation für Nationale Sicherheit nach 9/11«. The claim that Iraq possessed Weapons of Mass Destruction (WMD) led to the invasion of Iraq in 2003 by the US army. For the George W. Bush administration, the likely presence of WMD in Iraq was the major justification for going to war. However, Bush' opponents suspected he used the WMD-dispositive as a legitimation for an invasion that was already set in motion for different reasons. The Iraq invasion and the underlying ideas about the presence of WMD thus provide a tangible case for the analysis of theories of conspiracy and security. The development of the WMD-dispositive will be contextualized using the toolkit of securitization theory. The article explores the notions of security and conspiracy that were used to build the dispositive and shows how it ultimately failed and turned into a counter-narrative in which the Bush administration itself became the Great Conspirator.

Understanding ‘the users’ in Technology for Transparency and Accountability Initiatives - Wanjiku Kelbert, Alexandra; McGee, Rosemary; Carlitz, Ruth (2013)

Time to Listen: Hearing People on the Receiving End of International Aid - Anderson, Mary B.; Brown, Dayna; Jean, Isabella (CDA Collaborative Learning Projects, 2012)
Does the way international assistance is organized make sense? Is it working as we mean it to? This book approaches these questions through the experiences of people living on the receiving side of international assistance. It reports on the ideas, insights, and analyses of almost 6,000 people across 20 countries where international aid has been provided. From such a range of locations and people, one might expect vastly different ideas and opinions. However, remarkably consistent patterns and common judgments emerged. In the midst of difference, there was striking unanimity and consistency about the processes and the effects of the international aid system. Using their words, their experiences, and their ideas, this book describes why the cumulative impacts of international aid efforts have not met expectations. It describes a way forward to make changes that, according to those on the receiving end, will lead to more effective and lasting results.

An inventory and review of countering violent extremism and insurgency monitoring systems - Carter, Lynn; Phyllis, Dinino (USAID, 2012)

Making All Voices Count: A Slam Dunk? - Global Integrity (Global Integrity, 2012)
Yesterday, I had the chance to attend the public launch of a new government transparency and accountability funding mechanism – Making All Voices Count. Held at USAID headquarters, the discussion featured a veritable who’s who of open government and transparency practitioners in the Washington area; probably 250 people were packed into the room. (Announcing a …

Mapping the Outcomes of Citizen Engagement - Gaventa, John; Barrett, Gregory (World Development, 2012)
Summary Despite the normative beliefs that underpin the concept of participation, its impact on improved democratic, and developmental outcomes has proven difficult to assess. Using a meta-case study analysis of a sample of 100 cases, we inductively create a typology of four democratic and developmental outcomes, including (a) the construction of citizenship, (b) the strengthening of practices of participation, (c) the strengthening of responsive and accountable states, and (d) the development of inclusive and cohesive societies. We find that citizen participation produces positive effects across these outcome types, though in each category there are also important types of negative outcomes as well.
Keywords: Citizen engagement; Citizenship; Development outcomes; Participation; democratic outcomes; meta-analysis

A Symbiotic View of Life: We Have Never Been Individuals - Gilbert, Scott F.; Sapp, Jan; Tauber, Alfred I. (The Quarterly Review of Biology, 2012)
The notion of the “biological individual” is crucial to studies of genetics, immunology, evolution, development, anatomy, and physiology. Each of these biological subdisciplines has a specific conception of individuality, which has historically provided conceptual contexts for integrating newly acquired data. During the past decade, nucleic acid analysis, especially genomic sequencing and high-throughput RNA techniques, has challenged each of these disciplinary definitions by finding significant interactions of animals and plants with symbiotic microorganisms that disrupt the boundaries that heretofore had characterized the biological individual. Animals cannot be considered individuals by anatomical or physiological criteria because a diversity of symbionts are both present and functional in completing metabolic pathways and serving other physiological functions. Similarly, these new studies have shown that animal development is incomplete without symbionts. Symbionts also constitute a second mode of genetic inheritance, providing selectable genetic variation for natural selection. The immune system also develops, in part, in dialogue with symbionts and thereby functions as a mechanism for integrating microbes into the animal-cell community. Recognizing the “holobiont”—the multicellular eukaryote plus its colonies of persistent symbionts—as a critically important unit of anatomy, development, physiology, immunology, and evolution opens up new investigative avenues and conceptually challenges the ways in which the biological subdisciplines have heretofore characterized living entities.
Keywords: evolution; holobiont; individuality; symbionts; symbiosis

Narrowing the climate information usability gap - Lemos, Maria Carmen; Kirchhoff, Christine J.; Ramprasad, Vijay (Nature Climate Change, 2012)
Climate-change-related risks pose serious threats to the management of a wide range of social, economic and ecological systems. Managing these risks requires knowledge-intensive adaptive management and policy-making actively informed by scientific knowledge, especially climate science1. However, potentially useful climate information often goes unused1,2. This suggests a gap between what scientists understand as useful information and what users recognize as usable in their decision-making. We propose a dynamic conceptual model to address this gap and highlight strategies to move information from useful to usable to reduce climate-related risks.

Buzzing Communities: How to build bigger, better, and more active online communities - Millington, Richard (Feverbee, 2012)
How to Build Bigger, Better, and More Active Online CommunitiesBuzzing Communities cuts through the fluff to offer a clear process for creating thriving online communities. This book combines a century of proven science, dozens of real-life examples, practical tips, and trusted community-building methods. This step-by-step guide includes a lifecycle for tracking your progress and a framework for managing your organization's community efforts. This Book Will Help You to Understand what the members of your community really want. Dramatically increase the number of newcomers that become regulars. Avoid the mistakes most organizations make when they try to build online communities. Develop a fantastic, user-friendly website for your members. Grow your online community to critical mass and beyond Keep members engaged and active in your community. Measure the community's return on investment and explain the benefits to your organization.

Accounting for a changing and uncertain climate in planning and policymaking today: lessons for developing countries - Ranger, Nicola; Garbett-Shiels, Su-Lin (Climate and Development, 2012)
Climate change is increasingly altering the pattern of climate-related risks. Developing countries and in particular least developed countries will be among the most severely impacted by climate change. These risks can seem remote in comparison with more immediate threats and needs, but if climate change is not considered upfront in existing planning and policymaking processes today, decision makers risk locking-in future impacts that may prove irreversible or much more costly and difficult to rectify than is necessary. The challenge for planners and policymakers, explored in this paper, is that future climate conditions are deeply uncertain. Decision methods are available to tackle these problems; however, these tend to be data- and resource-intensive and therefore, difficult to routinely apply. Further, a gap in currently available guidance is the explicit link to the adaptation needs of a developing country. We discuss the implications of this development context for the priorities for adaptation and the relative allocation of efforts in adaptation. This paper focuses on the identification of adaptation options and strategies that are robust to the deep uncertainties in future climate risk, culminating in a framework of six building blocks. It takes the perspective of exploring how decisions today might be adjusted to account for uncertain and changing long-term climate risks. We suggest a core principle is to focus on promoting climate-resilient development and increasing long-term adaptive capacity while, crucially, avoiding inflexible decisions that could lock-in future climate risk or foreclose adaptation options.
Keywords: Adaptation; Climate change; Development; Planning; robustness; uncertainty

Scaling Agile @ Spotify with Tribes, Squads, Chapters & Guilds - Kniberg, Henrik; Ivarsson, Anders (Spotify, 2012)

What about the results? Lessons from long-term process support to strengthen results-based management (RBM) for Swedish framework NGOs operating in Western Balkans - Ørnemark, Charlotte (NCG, 2012)
The observations and lessons outlined in this report should be seen as a contribution to the on-going learning and reflections in a wider debate on how to assess and monitor results from support to CSOs involved in complex social change processes (as opposed to those involved in more ‘classical’ service delivery and more linear development assistance). These lessons, though directly emerging from the consultancy to provide long-term RBM support to the FOs and their local CSO partners in Western Balkans, also draws on previous experiences and similar lessons from on-going initiatives. In brief, these lessons call for a certain ‘paradigm shift’ in the way we (as development professionals) regard and support RBM for actors involved in less tangible social change processes in highly contested political spaces. Some of these shifts, outlined in more detail in different sections of this report, are summarised below:  From a linear, aggregated cause-and-effect thinking around RBM to one that is linked to human factors and is embedded in systems,  From pushing the burden of reporting down in the system to a clearer division of labour between donors, recipient governments, intermediary agents like framework NGOs (FOs) and implementing CSOs with each actor using its comparative advantage and appropriate role in the RBM process and for its own learning,  From operating in programming and results frameworks where outcomes and impact are largely assumed to be predictable to setting up systems that deal with uncertainty and that capture emerging result patterns through tracking of gradual changes,  From a project/programme perspective to a focus on institutions and systems as actors and arenas for change, where organisations are enabled to act as change agents towards clearly identified processes of social transformation,  From SMART to REAL results frameworks – although SMART (specific, measurable, achievable, realistic and time-bound) principles are always good to keep in mind for the formulation of goals and indicators, the danger of coming up with fictive measuring frameworks calls for a more systematic incorporation of ‘real’ concerns, including making RBM processes rights-based, embedded in local realities (and empowering for those involved), aligned to national reform efforts and national and international human rights commitments, and learning-oriented for all different levels of operations.

10 years of Outcome Mapping - Smith, R; Mauremootoo, John; Ambrose, K.; Hearn, Simon (2012)
This webinar from the Outcome Mapping Learning Community (OMLC) presents the key findings from research conducted into the extent of Outcome Mapping use and the support required for its implementation.

The Eight-Word Mission Statement - Starr, Kevin (Stanford Social Innovation Review, 2012)
Don’t settle for more.

Escaping Capability Traps through Problem-Driven Iterative Adaptation (PDIA) - Andrews, Matt; Pritchett, Lant; Woolcock, Michael (Harvard University, 2012)
Keywords: IMPORTANT

Complexity, Adaptation, and Results - Barder, Owen; Ramalingam, Ben (Center For Global Development, 2012)
In the last of a series of three blog posts looking at the implications of complexity theory for development, Owen Barder and Ben Ramalingam look at the implications of complexity for the trend towards results-based management in development cooperation. They argue that is a common mistake to see a contradiction between recognising complexity and focusing on results: on the contrary, complexity provides a powerful reason for pursuing the results agenda, but it has to be done in ways which reflect the context. In the 2012 Kapuscinski lecture Owen argued that economic and political systems can best be thought of as complex adaptive systems, and that development should be understood as an emergent property of those systems. As explained in detail in Ben’s forthcoming book, these interactive systems are made up of adaptive actors, whose actions are a self-organised search for fitness on a shifting landscape. Systems like this undergo change in dynamic, non-linear ways; characterised by explosive surprises and tipping points as well as periods of relative stability. If development arises from the interactions of a dynamic and unpredictable system, you might draw the conclusion that it makes no sense to try to assess or measure the results of particular development interventions. That would be the wrong conclusion to reach. While the complexity of development implies a different way of thinking about evaluation, accountability and results, it also means that the ‘results agenda’ is more important than ever.
Keywords: IMPORTANT

Desired and unwanted: Policy work by participation practitioners - Escobar, Óliver (2012)
"This paper presents findings from doctoral research in a Scottish Local Authority Area, where I am developing an interpretive ethnography of ‘the work of participation’ (cf. Colebatch, 2005c, 2006). My focus is on engagement practitioners:
Keywords: Academia; Biology; Computer Science; Earth Sciences; Geography; History; Law; Math; Medicine; Philosophy; Physics; Political science; Psychology; Religion; Research; economics; universities

The Art of Community: Building the New Age of Participation - Bacon, Jono (O'Reilly Media, 2012)
Online communities provide a wide range of opportunities for supporting a cause, marketing a product or service, or building open source software. The Art of Community helps you recruit members, motivate them, and manage them as active participants. Author Jono Bacon offers experiences and observations from his 14-year effort to build and manage communities, including his current position as manager for Ubuntu.Discover how your community can become a reliable support network, a valuable source of new ideas, and a powerful marketing force. This expanded edition shows you how to keep community projects on track, make use of social media, and organize collaborative events. Interviews with 12 community management leaders, including Linus Torvalds, Tim O’Reilly, and Mike Shinoda, provide useful insights.Develop specific objectives and goals for building your communityBuild processes to help contributors perform tasks, work together, and share successesProvide tools and infrastructure that enable members to work quicklyCreate buzz around your community to get more people involvedHarness social media to broadcast information, collaborate, and get feedbackUse several techniques to track progress on community goalsIdentify and manage conflict, such as dealing with divisive personalities

The Implications of Complexity for Development - Barder, Owen (2012)
In this lecture, adapted from his May 2012 Kapuściński Lecture, Owen Barder explores the implications of complexity theory for development policy. He explains how traditional economic models have tried and failed to understand why some countries have managed to improve living standards while other countries have not.
Keywords: IMPORTANT

Agile Project Management For Dummies - Layton, Mark C. (John Wiley & Sons, 2012)
Be flexible and faster with Agile project management As mobile and web technologies continue to evolve rapidly, there is added pressure to develop and implement software projects in weeks instead of months. Agile Project Management For Dummies can make that happen. This is the first book to provide a simple, step–by–step guide to Agile Project Management approaches, tools, and techniques. With the fast pace of mobile and web technology development, software project development must keep pace; Agile Project Management enables developers to complete and implement projects more quickly and this book shows you how. Offers a practical context for understanding and applying Agile techniques, moving from theory into actual practice Explains when to use Agile and how to avoid common pitfalls Written by experts who know how to apply the principles in real–world situations Agile Project Management For Dummies enables you to understand and apply Agile principles for faster, more accurate development.

Triangulation, Respondent Validation, and Democratic Participation in Mixed Methods Research - Torrance, Harry (Journal of Mixed Methods Research, 2012)
Over the past 10 years or so the “Field” of “Mixed Methods Research” (MMR) has increasingly been exerting itself as something separate, novel, and significant, with some advocates claiming paradigmatic status. Triangulation is an important component of mixed methods designs. Triangulation has its origins in attempts to validate research findings by generating and comparing different sorts of data, and different respondents’ perspectives, on the topic under investigation. Respondent validation has sometimes been included in such processes, but it is an element that has not attracted significant attention from the MMR community. The article argues that attention to respondent validation is a significant issue for methodological debate and that it should be an important aspect of the development of democratic participation in MMR.

Budgeting for Developmental Evaluation: An Interview with Michael Quinn Patton - Better Evaluation (2012)

Review of the use of ‘Theory of Change’ in International development - Vogel, Isabel (DFID, 2012)
A new report on Theory of Change (ToC) and its use in International development has just been produced.

Adapt: Why Success Always Starts with Failure - Harford, Tim (Abacus, 2012)
Everything we know about solving the world's problems is wrong. Out: Plans, experts and above all, leaders. In: Adapting - improvise rather than plan; fail, learn, and try againIn this groundbreaking new book, Tim Harford shows how the world's most complex and important problems - including terrorism, climate change, poverty, innovation, and the financial crisis - can only be solved from the bottom up by rapid experimenting and adapting.From a spaceport in the Mojave Desert to the street battles of Iraq, from a blazing offshore drilling rig to everyday decisions in our business and personal lives, this is a handbook for surviving - and prospering - in our complex and ever-shifting world.

Collaborative geomatics and the Mushkegowuk Cree First Nations: Fostering adaptive capacity for community-based sub-arctic natural resource management - McCarthy, Daniel D. P.; Whitelaw, Graham S.; Anderson, Scott; Cowan, Donald; McGarry, Fred; Robins, Anthony; Gardner, Holly L.; Barbeau, Christine D.; Charania, Nadia A.; General, Zachariah; Liedtke, Jeff; Sutherland, Celine; et al. (Geoforum, 2012)
The remote First Nation (FN) communities of the Mushkegowuk Territory on the west coast of James Bay, Ontario, Canada are currently facing increased development pressures and the imposition of a government land use planning process. The land use planning process is mandated in the Far North Act (received Royal Assent on September 23, 2010). There is a need for capacity enhancement for community-based natural resource planning and management in the Territory. A number of frameworks are emerging for addressing change brought on by resource development and building resilience to such change at the community level. Among these include the concept of adaptive capacity. In collaboration with FN community leaders, we explored the use of “collaborative geomatics” tools to foster adaptive capacity. Our action research suggests that collaborative geomatics technologies should enhance the Mushkegowuk First Nations’ adaptive capacity to address environmental and policy change by allowing them to collect and manage data collaboratively (e.g., traditional environmental knowledge, western science) to create opportunities for innovative community development, including natural resource development and management.
Keywords: Adaptive capacity; Collaborative geomatics; Community development; Cree communities; Land use plans

Practical place-based initiatives: a better practice guide - Australian Government (Strategy and Delivery Division, Department of the Prime Minister and Cabinet, Australian Government, 2012)

A guide to Social Return on Investment - Nicholls, Jeremy; Lawlor, Eilis; Neitzert, Eva; Goodspeed, Tim (The SROI Network, 2012)
There is increasing recognition that we need better ways to account for the social, economic and environmental value that results from our activities. The language varies – ‘impact’, ‘returns’, ‘benefit’, ‘value’ – but the questions around what sort of difference and how much of a difference we are making are the same. Understanding and managing this broader value is becoming increasingly important for the public and private sectors alike. This is true whether it is civil society organisations working to create value, Governments commissioning and investing in activities to create social value, investors seeking to ensure that their investments will make a difference, or private businesses recognising both risk and opportunity in the wider effects of operations. All this means that it is also more important that we have some consistency and a shared language when we talk about value. SROI is the application of a set of principles within a framework that is designed to help bring about that consistency, whilst at the same time recognising that what is of value will be very different for different people in different situations and cultures. The first edition of this guide, which itself built on the work of three earlier SROI guides1, was prepared as part of a three year programme on measuring social value funded in 2008 by the then ‘Office of the Third Sector’ based in the Cabinet Office of the UK Government. This was delivered by a consortium of organisations: the SROI Network, nef (the new economics foundation), Charities Evaluation Services, the National Council for Voluntary Organsations and New Philanthropy Capital. In addition to this programme, the Scottish Government also supported the development of SROI, including a database of indicators to support SROI analysis. The work of the SROI Network now stretches across many different countries and continents, and this second edition of the guide reflects that interest. We have though decided to use only one currency symbol, for reasons of clarity and consistency, and so have continued to use £. However, readers will be able to find examples in various currencies and translations of the Guide on our website. For more information on the developments of SROI, please refer to the SROI Network website: www.thesroinetwork.org

Adaptive management in wildlife conservation - Organ, John; Decker, D.J.; McDonald, J.E.; Riley, Shawn; Mahoney, S.P. (The Wildlife Society Techniques Manual, 2012)
Adaptive management in wildlife conservation emerged from the wildlife profession's search for better solutions to increasingly complex conservation challenges. Adaptive management is an effective process for wildlife managers to employ to (1) deal with uncertainty in the management system, (2) learn from their management actions, and (3) achieve desired results. Being adaptable or flexible in your management approach is not the same as managing adaptively or conducting adaptive management. Adaptive management requires adhering to a stepwise process and fully executing each step. A critical step is rigorous monitoring and assessment of management interventions. Without this, wildlife managers cannot achieve the essence of adaptive management, which is the explicit goal of learning more about the management system after each management action.

Tiny Tools - Measuring Change in Communities and Groups - Causemann, Bernward; Gohl, Eberhard; Brenner, Verena (Impact+, 2012)
Introduction to the Overview: Tiny Tools Why “Tiny Tools” for assessing change? Currently, change is mostly assessed by NGO staff or external experts. The vision of this paper is that communities assess and reflect change themselves and make use of that reflection with appropriate tools. All the tools presented here are relatively quick and easy to learn (therefore “tiny”). With Tiny Tools we can assess change in one session. They can therefore be used where there are not baselines. They are structured and systematic, and they are all widely tested: Experience shows that these tools lead to new insights, mobilise enthusiasm and increase the capacity of communities to bring about further change. The Tiny Tools are in line with what Participatory Rural Appraisal (PRA) wanted to achieve. Many are slight variations of PRA tools. For a detailed description of concepts, see the NGO-IDEAs Impact Toolbox (www.ngo-ideas.net/impact_toolbox) and the NGO-IDEAs Manual Self-Effectiveness (www.ngo-ideas.net/monitoring_self_effectiveness). The tools are designed to visualise change, but also enable communities to reflect on the reasons of change or verify assessments. They may be implemented once or continuously over time. We know that the time of community members is precious, and limited. Therefore all Tiny Tools can be performed in a relatively short session, provided facilitators (it could be field staff or project officers) are experienced – and the community knows and trusts them. The amount of time spent on the application of the tools may however be prolonged according to the needs of a community or NGO. All of these tools are easy to learn for a facilitator experienced in participatory processes. Which tool should be introduced to which community? It is typically the decision of a development organisation (or external experts) which tools they want to introduce into a community. The staff need to assess which tool will lead to learning and action. It could also be that the staff realise aspects of change that they do not understand well enough. These tools are good for exploring change that we have not planned for and not anticipated. They are also good for exploring change in a context where we have no prior information. Communities are the best experts for their situation, but we emphasise that the tools should be used in ways that benefit and empower the communities or individuals participating. The tool implementations should lead to consequences on the grassroots as well as the NGO level. All Tiny Tools can be integrated into PIAR, the Analysis tool in the NGO-IDEAs Impact Toolbox. Also, the Tiny Tools can help to prepare for the application of the Toolbox tools. They help to make people aware of changes that can be observed. The following box gives some hints how Tiny Tools relate to the Impact Toolbox tools, and to what extent they help to attribute change to development interventions.