Posted by: lidcblog | October 10, 2014

Monitoring and evaluation: an insider’s guide to the skills you’ll need

Management consultant Peter Drucker said that what gets measured gets managed. Photograph: Dan Chung/The Guardian

Management consultant Peter Drucker said that what gets measured gets managed. Photograph: Dan Chung/The Guardian

In international development, everyone knows that good intentions are simply not enough. It is critical to agree on appropriate aims and then make sure that these can be achieved efficiently.

There are several different ways to achieve development goals. Take malaria, for example: approaches might include investing in vector control (reducing numbers of malaria-carrying mosquitoes); ensuring that people can access bednets; providing education on how to avoid contracting the disease; making chemoprophylaxis (prevention medication) more accessible; or treating malaria cases with better drugs, to name just a few.

We know that some ways of dealing with development challenges, such as malaria, will be more successful than others. Some approaches will have unintended consequences, they will vary in cost and will work in certain places but not in others. So how can those designing interventions decide which approaches to choose?

This is where evaluation studies come in: they aim to help development actors make the best choices. Evaluations can be used to improve programmes as they roll out and/or can try to estimate whether and how particular aims were achieved and whether this was better and more cost effective than other courses of action.

In order to design, run or interpret evaluations, budding development professionals need an understanding of the following:
1. Research study design, outcome measurement and statistical methods

Development programmes are often complex, but this does not mean that scientific methods such as experiments and careful analysis can’t aid a better understanding of whether programmes achieve their desired impact.
2. Social science methods

Development interventions depends on the complex interaction of multiple stakeholders and institutions. People’s goals and incentives differ, power is exercised and resisted in myriad ways, and choices are constrained by poverty or gender inequalities. Social science methods are required to make sense of these complexities to enable more effective implementation.
3. Cost-benefit analysis

When deciding how best to allocate limited resources, those designing interventions must be able to estimate the costs as well as the consequences of different programmes to ensure they get value for money. Cost-benefit analysis can also be used to compare programmes across different sectors, for instance, comparing heath and education interventions.
4. Evidence-based decision making

Understanding what is already known is essential to avoid duplication. Synthesising evidence means pulling together all that has been said about a subject, making judgments about what bits of information are most useful, summarising this evidence, and planning new studies that focus on the most important contributions.

Teams of development professionals will need all these skills to varying degrees. For instance, evaluation experts need to be able to design and implement evaluation studies, while programme managers offer the best perspective on what interventions may be feasible and need to know how to commission and interpret evaluations.

But it is not only development workers who need evaluation skills. Evaluation is about accountability, identifying waste and avoiding harmful effects, and so these skills will also be essential to enable civil society, democratic representatives, and government officials to hold NGOs and other development actors to account.
Where can you learn these skills?

Over the past few years, evaluation courses have mushroomed in institutions all over the world, ranging from full degrees to short courses, face-to-face or via distance learning, at various levels of difficulty. Some examples are listed below.

Evaluation skills are also developed and championed within organisations through on-the-job and peer-to-peer learning. It is great to see growing commitment within international development organisations and donor agencies to developing key evaluation skills for their staff. After all, as management consultant Peter Drucker said: “What gets measured gets managed”, and development matters too much to not be properly managed.

Some examples of training courses in impact evaluation – the list is not exhaustive.
Short courses

Evaluation for development programmes at London International Development Centre
Impact evaluation design at Institute of Development Studies
Impact evaluation for evidence-based policy in development, University of East Anglia
Planning, monitoring and evaluation for complex development programmes, University of Bologna
Building skills to evaluate development interventions, International Programme for Development Evaluation Training, Ottawa, Canada
Impact evaluation collaborative, University of California, Berkeley
Impact evaluation of interventions addressing social determinants of health, London School of Hygiene & Tropical Medicine

Degree programmes

MSc impact evaluation for international development, University of East Anglia
Diploma in public policy and programme evaluation, Carleton University
Graduate certificate in project monitoring and evaluation: course descriptions, American University

Conferences and seminars

J-Pal workshops
Annual colloquium, Campbell Collaboration
Making impact evaluation matter, Asian Development Bank and 3ie
3ie monthly seminar series: Delhi, Washington and London

Contributed by Dr James Hargreaves, director of the Centre for Evaluation, London School of Hygiene & Tropical Medicine. Follow @HargreavesJR on Twitter.

This post was first published on the blog of the Guardian Professional Development Network.


Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

Categories

%d bloggers like this: