As you probably know, I’ve been on a tear about outcomes measurement for a few months now; the current level of obsession began when I attended NTEN’s Nonprofit Data Summit in Boston in September. I thought that the presenters at the NTEN summit did a great job addressing some difficult issues – such as how to overcome internal resistance to collecting organizational data, and how to reframe Excel spreadsheets moldering away in file servers as archival data. However, I worked myself into a tizzy, worrying about the lack, in that day’s presentations, of any reference to the history and literature of quantitative analysis and social research. I could not see how nonprofit professionals would be able to find the time and resources to get up to speed on those topics.
Thanks to Bob Penna, I feel a lot better now. In yesterday’s training, he showed me and the CTK team just how far you can go by stripping away what is superfluous and focusing on what it really takes to use the best outcomes tools for job. Never mind about graduate level statistics! Managing outcomes may be very, very difficult because it requires major changes in organizational culture – let’s not kid ourselves about that. However, it’s not going to take years out of each nonprofit professional’s life to develop the skill set.
Here are some other insights and highlights of the day:
- Mia Erichson, CTK’s brilliant new marketing manager, pointed out that at least one of the outcomes tools that Bob showed us could be easily mapped to a “marketing funnel” model. This opens possibilities for aligning a nonprofits programmatic strategy with its marcomm strategy.
- The way to go is prospective outcomes tracking, with real time updates allowing for course correction. Purely retrospective outcomes assessment is not going to cut it.
- There are several very strong outcomes tools, but they should be treated as we treated a software suite that comprises applications that are gems and applications that are junk. We need to use the best of breed to meet each need.
- If we want to live in Bob Penna’s universe, we’re going to have to change our vocabulary. It’s not “outcomes measurement – it’s “outcomes management.” The terms “funder” and “grantmaker” are out – “investor” is in.
Even with these lessons learned, it’s not a Utopia out there waiting for nonprofits that become adept at outcomes management. Not only is it difficult to shift to an organizational culture that fosters it, but we have to face continuing questions about how exactly the funders (oops! I should have said “investors”) use the data that they demand from nonprofit organizations. (“Data” is of course a broad term, with connotations well beyond outcomes management. But it’s somewhat fashionable these days for them to take an interest in data about programmatic outcomes.)
We should be asking ourselves, first of all, whether the sole or primary motivation for outcomes management in nonprofits should be the demands of investors. Secondly, we should be revisiting the Gilbert Center’s report, “Does Evidence Matter to Grantmakers? Data, Logic, and the Lack thereof in the Largest U.S. Foundations.” We need to know this. Thirdly, we should be going in search of other motivations for introducing outcomes management. I realize that most nonprofits go forward with it when they reach a point of pain (translation: they won’t get money if they don’t report outcomes).
During a break in Bob’s training, some of my CTK colleagues were discussing the likelihood that many nonprofit executives simply hate the concept of outcomes management. Who wants to spend resources on it, if it subtracts from resources available for programmatic activities? Who wants to risk finding out (or to risk having external stakeholders find out) that an organization’s programs are approximately as effective as doing nothing at all? Very few – thus the need to find new motivations, such as the power to review progress and make corrections as we go. I jokingly told my CTK colleagues, “the truth will make you free, but first it will make you miserable.“ Perhaps that’s more than a joke.
Tagged: activities, assessment, best tool for the job, bob penna, community techknowledge, ctk, ctk foundation, data, does evidence matter to grantmakers, evaluation, funder, gilbert center, grantmaker, impact assessment, investor, loveable curmudgeons, methods, michael gilbert, motivation, nonprofit data, nonprofit outcomes toolbox, nten, organizational culture, outcomes, outcomes management, outcomes measurement, performance, philanthropy, quantitative analysis, research, resources, robert penna, skill set, social research, stakeholders, statistics, strategy, the truth will make you miserable, tools