Use evaluative thinking to make your organization shineTo many organizations, program evaluation is a dreaded affliction — something that's forced upon them as a requirement for a grant. However, you can make evaluations work for you, instead of against you.
What benefits can you get from a good evaluation?
- Discover new ideas you can use to strengthen your program
- Reduce uncertainty and make important decisions with greater confidence
- Demonstrate your true effects to funders and stakeholders
- Gain new insights you can use to design new and better solutions
A big obstacle that keeps many organizations from using evaluation to benefit them is that they have not embraced evaluative thinking: using critical thinking to improve and grow your program, and applying the same techniques to make effective decisions in everyday life.
You can do basic evaluative thinking without any special tools or research methods. It involves many of the same skills we use for making important decisions in everyday life. You can use this critical thinking technique to identify where your program works best and to pinpoint your weaknesses.
6 steps to effective program evaluation
The skills of evaluative thinking correspond to the six steps to an effective program evaluation. Here they are:
- Collaborate with stakeholders. Seek to understand the perspectives of all stakeholders — such as people receiving your program services, staff, volunteers, board members and partnering organizations — and include them in planning and assessing your program.
- Clarify how your idea works. Detail what your program is expected to achieve, how it functions to accomplish its goals and what is needed for its success.
- Assess what others have done. Look at how others have addressed your issue and their effective practices and lessons learned, using sources such as trade publications, research papers, books and conference presentations.
- Ask useful questions. Identify untested ideas and knowledge gaps that a new project or additional research might explore.
- Measure your results. Track your plan's progress to show if activities are happening as planned, if you're having the effects that you think, and why or why not.
- Share your results. Spread the word about your findings to communicate what you're learning and achieving to stakeholders, funders and others in your field.
How about your organization?
Are people at your organization doing these things on a regular basis? If not, yours may be among the many nonprofits that are doing wonderful work, but could be accomplishing so much more. Sadly, you might also be missing out on funding opportunities because you don't have good data to show the true benefits of your work. So, your ability to expand your program to make a bigger difference and help more people may seem out of reach.
In too many organizations, "program evaluation" has a bad reputation. You might have had an unfortunate experience with program evaluation data not being useful or being used to justify cuts to much-needed services. The very use of the term "evaluation" might remind you of anxiety-producing employee performance evaluations. Sounds about as much fun as a head cold.
Don't let a bad rap keep you away from a good thing. Here's an easy way to get your people pointed in the right direction!
Quick activity to introduce evaluative thinking at your organization
Making changes in people's way of thinking is never easy. However, this quick activity can spark the start of more evaluative thinking at your organization, so you can better use learning and information to increase the good you are doing and help more people.
Wade in slowly
Asking questions about long-held ideas can be uncomfortable. So, unless your group is accustomed to talking about their thinking and questioning ideas, it's best to introduce evaluative thinking concepts gently. In their blog post on evaluative thinking, Tom Archibald and Guy Sharrock suggest starting with something less threatening, like critiquing a news article.
An idea that I prefer is to talk about a situation where you'd evaluate information to make decisions in everyday life, like choosing a restaurant for lunch or buying a new car. To make this easier for you, I put together a 15-minute evaluative thinking icebreaker activity, below, that you can use to facilitate such a conversation. If more than 12 people are in the room, you might want to have people break into small groups of two to six people for small group discussion, then have the small groups report out to the large group.
15-minute evaluative thinking ice-breaker activity
Imagine you're having some friends over for dinner and you want to make something you've never made before, say a bean chili. You want your dish to be a big hit.
Discuss: How could you apply the six steps to evaluative thinking and effective evaluation to help you make sure your bean chili will be a success?
- Collaborate with stakeholders. For example, you might ask your friends do they like bean chili? Do they like it spicy hot or mild? Do they have any allergies or dietary preferences?
- Clarify how your idea works. To make sure that your idea is realistic, you might plan out things like your shopping list, when you'll get the ingredients and cook the chili, and what dishes you'll use to serve it.
- Assess what others have done. You might search for chili recipes to inspire you in your cookbooks and cooking websites, then use the best-sounding ideas to create your own recipe.
- Ask useful questions. For example, you might be unsure how much chili powder to add, so you decide to experiment by adding a little bit at first, then letting it cook for a while and tasting it to see if more is needed.
- Measure your results. To find out how your dish turned out, you might pay attention to whether your friends seem to be enjoying eating it. You might also ask them how they liked it and what changes they would suggest for next time.
- Share your results. You could share your recipe with your friends or even post it on a recipe sharing website so that others can benefit from all your hard work perfecting your bean chili masterpiece.
Get people talking and thinking
The idea of the 15-minute activity is to get people to start talking and thinking about evaluative thinking in a comfortable way before getting into questioning their long-held assumptions and ways of doing things.
Let's take back the word "evaluation" and use evaluative thinking to make our service organizations shine!
For more from Bernadette Wright, visit Meaningful Evidence.