Tag Archives: outcomes measurement

Workforce development for the nonprofit tech professionals of the future: It will be a consortium, not a building with a dome!

We don't need an edifice; we need a consortium!

 

It’s been about a year and a half since I starting agitating for a Massachusetts Institute of Nonprofit Technology, an initiative that will kick off by training the nonprofit data analysts of the future.

The concept has morphed and evolved a great deal in that time, thanks to all the great input from Massachusetts stakeholders, but also from a team of ELP fellows from the Center for Collaborative Leadership.

One thing that is quite clear is that there is no need to create a new institution, or raise up a building with a splendid dome.  (The Massachusetts Institute of Technology can rest easy, without fear of competition, or brand encroachment.)  I believe that all of the necessary institutions exist already here in the Bay State.  What is needed is a consortium that can knit them together for this purpose, some funding, and some candidates.

It’s a pipeline, or perhaps a career ladder that the consortium needs to build – not an edifice.  Although I love the splendid domes of MIT, we can simply admire them, and hope that eventually some of the people who work and study under those domes will become part of the consortium.

Here’s what I think we need:

  1.  Allies from workforce development, job readiness, and college readiness programs.  These are the folks who will raise awareness of the coming need for technology professionals who can provide data analysis and other data services to nonprofits, and guide them to the next rung of the career ladder. Examples include Economic Mobility Pathways (EMPath), Shriver Job Corps, International Institute of New England, JFYnet, Jobs For the Future, National Fund for Workforce Solutions, SkillWorks, Boston PIC, YearUp, and Massachusetts Department of Labor and Workforce Development.
  2. Allies who provide relevant training and education to candidates who aspire to careers in data services and data analytics for nonprofits.  Examples include Bunker Hill Community College and Tech Foundry.
  3. An organization that is able to place, mentor, and coach candidates in entry level data services positions at local nonprofit organizations.  That’s TNB Labs.  These entry level workers will be known as “data support analysts,” or DSAs.
  4. Allies from local nonprofit organizations who are willing to host (and pay for the services of) a DSA for a period of one or two years.  TNB Labs will be the official employer of these workers, providing them with a salary, benefits, a modest sum for further professional development, coaching, and mentoring.  The DSAs will be working on site at the nonprofit organizations and dedicating themselves to tasks assigned by the nonprofits.  Examples of distinguished nonprofits that could play this role are Community Servings, Saint Francis House, Community Catalyst, Health Care For All, Massachusetts Association of Community Development Corporations, Perkins School, City Year, Jewish Family & Children’s Services, Cambridge Health Alliance, Family Service of Greater Boston, Massachusetts League of Community Health Centers, Greater Boston Food Bank, the Boston Foundation, AIDS Action Committee, and the Home for Little Wanderers.  (Not that they’ve actually signed on for this, but that they would be great members of this consortium.)

At the conclusion of the one or two year placement at a nonprofit organization, I think that any of the following outcomes would count as a win:

  • The host nonprofit hires the DSA (with a raise and a promotion) as a long term regular employee.
  • The DSA lands a job providing data services at another nonprofit organization.
  • The DSA lands a job in a different field or sector that is congruent with his/her/their career aspirations.
  • The DSA is able to apply to a four-year degree program, transferring course credits, on the job experience, two-year degrees, or certifications that he/she/they have earned.

The latter scenario – of advancing in higher education – brings us to the final category of allies needed for our consortium.  The best example of this kind of ally is UMass-Boston, which has programs in related areas, such as:

In addition, our consortium has a great ally in an individual UMass-Boston faculty member, Michael Johnson, whose research focus is decision science for community-based organizations.  He has expressed a generous desire to be a mentor to community college students in this career ladder, and to encourage those who are qualified to apply to be Ph.D. students in this field.

And that’s just UMass-Boston!  I’m not as familiar with the offerings of other distinguished colleges and universities in the area, but the Boston University program in nonprofit management and leadership , the Nonprofit Leadership program at Wheelock, and the Institute for Nonprofit Practice at Tufts come to mind immediately as potential allies.

So here we are. The need is there for data service providers who can serve the missions, programs, and operations of nonprofit organizations.  If we can weave all these allies together into a network, we can meet these needs.

All that we require is:

  • Allies who are ready, willing, and able to pitch in.
  • Public awareness that this career ladder is available.
  • Funding to assist candidates cannot afford tuition for college coursework and other forms of training.
  • Funding to assist nonprofits that would like to host a data service analyst from this program, but lack the (modest) funding to support one.

Let’s do this!

How much fun is the Nonprofit Technology Conference? This much fun. (Plus some thoughts about shifting from tactical to strategic support of nonprofit organizations.)

Deborah is delighted by the artist's rendition of a concept of Tech Networks of Boston's. The photo was taken at the Netsuite.Org booth, at the 2015 Nonprofit Technology Conference .

Photo by Peggy Duvette of Netsuite.Org.

The good folks of Netsuite.Org had a great idea for their exhibit area at the Nonprofit Technology Conference this year.  They asked attendees to describe their technology visions in three words.  I chose “shared” “data,” and “outcomes.” and an artist quickly drew up a visual to express this.  (Unfortunately, I did not note down her name; I hope I can find it in order to give her proper credit for her work.)  The photo shown above was taken by Peggy Duvette, and as you can see, I was delighted to see this concept, which is part of Tech Networks of Boston’s strategic thinking, become part of the patchwork quilt of ideas that were being expressed.

Here’s a close-up of the TNB concept:

I (Deborah) took this photo at the Netsuite.Org booth, at the 2015 Nonprofit Technology Conference. Alas, I did not note down the name of the artist who did this drawing.

I took this photo at the Netsuite.Org booth, at the 2015 Nonprofit Technology Conference. Alas, I did not note down the name of the artist who did this drawing.

At TNB, we are thinking more and more about collaborative technology management – not just in terms of how we work with our nonprofit clients, but also about how clusters of NTAPs and nonprofits can work together toward a shared long term goal.   We have great relationships (and in many cases, shared nonprofit clients) with some great local nonprofit technology assistance providers, such as Annkissam* and 501Partners.  The three NTAPs are already collaborating on a series of sales-pitch-free evenings in which local nonprofit professionals are offered pro bono tech consultations.

However, the potential exists to do so much more, especially considering how many clients we share.

Wouldn’t it be great if the three NTAPs could offer their shared clients the following:

1) Seamless integration of TNB, AK, and 501P’s services.

2) Shared best practices for clusters of nonprofits with similar programs, operations, or missions.

3) Coordinated outcomes measurement and management for nonprofits that have overlapping constituencies.

The joy of #15NTC is in realizing that although we are just three NTAPs in one region, we are part of a wider movement.  In fact, if you were to look at the entire collection of artist’s renderings that were done at the Netsuite.Org exhibit area, you’d see that many nonprofit organizations are on the cusp of dreaming this dream.  Most of in the nonprofit sector understand that for lasting positive change in the world, one program at a single nonprofit organization is not enough.  The future is in sharing and coordinating our work.  What if nonprofit technology assistance providers started with that challenge, rather than the challenge of keeping a network server from crashing?  The emphasis would shift from the tactical support of nonprofits to the strategic support of their missions.  And by “missions,” I don’t mean vague statements; I mean specific (and even quantifiable) positive changes that nonprofit profits have committed themselves to delivering to their stakeholders.

Because mission achievement is why we all get up in the morning to do our jobs.

And because building a nonprofit technology movement that supports mission achievement is the best possible reason for participating in the Nonprofit Technology Conference.

 

* I also serve Annkissam directly as a consultant.

 

 

 

The Massachusetts Institute of Nonprofit Technology: Let’s Do This!

Massachusetts Institute of Nonprofit Technology

 

We need a Massachusetts Institute of Nonprofit Technology, and I can tell you what degree program we need to establish first:  Bachelor of Nonprofit Data.

The inspiration for this comes from many conversations with many people, but I’d especially like to credit Susan Labandibar, Julia Gittleman, and Laura Beals for pointing out, in their different ways, that one of the most pressing real-life challenges in nonprofit technology today is finding people who can bridge between the outcomes / impact assessment / evaluation / research team (on one hand) and the information systems team (on the other hand) at a nonprofit organization.

Not that I’m a professional full-time data analyst myself, but if I were, I’d find the numbers, and start doing the math:

  • How many brilliant computer scientists are graduating right here in Massachusetts every year from our best high schools, colleges, and universities?
  • Of those graduates, what percentage have strong skills in database design, database development, database management, or data analysis?
  • Of those who have strong data skills, what percentage would be eager to use their geek skills for good, if they were offered an attractive career ladder?

That’s our applicant pool for the Massachusetts Institute of Nonprofit Technology.  (Or MINT, if you prefer.)

Now, let’s figure out the absolute minimum of additional knowledge that these computer science graduates would need in order to be the kind of data analysts who could bridge between the outcomes / impact assessment / evaluation / research team and the information systems team  at a nonprofit:

  • Outcomes measurement
  • Outcomes management
  • Impact assessment
  • Evaluation
  • Social research methods
  • Knowledge management
  • Organizational cultures of nonprofits
  • Nonprofit operations
  • Organizational cultures of philanthropic foundations

That’s our basic curriculum.

If we want to expand the curriculum beyond the basics, we can add these elective subjects:

  • Nonprofit budgeting
  • Group dynamics
  • Ethics
  • Etiquette
  • Negotiation
  • Project management
  • Appreciative inquiry
  • Meeting facilitation

All of these electives would pave the way for other degree programs, in which they would also be extremely useful:

  • Bachelor of Nonprofit Systems Engineering
  • Bachelor of Nonprofit Web Development
  • Bachelor of Nonprofit Help Desk Support
  • Bachelor of Nonprofit Hands On Tech Support
  • Bachelor of Nonprofit Social Media

I already have my eye on some great local colleagues who could be the faculty for the Bachelor of Nonprofit Data program.  In addition to Susan, Julia, and Laura, I’d want to recruit these folks:

Please note that three members of the TNB team top the list of potential faculty members.  Why?  Because I work there, and because TNB has set a Big Hairy Audacious Goal of developing the careers of 1,000 technology professionals. This undertaking would be very congruent with its vision!

However, setting up the Massachusetts Institute of Nonprofit Technology must be a collaborative effort.  It will take a strong network of colleagues and friends to make this happen.

Do you think that this is needed?  Do you think my plan needs a lot of work?  Do you have any ideas or resources that you’d like to suggest?  Please feel free to use the comments section here to share your thoughts.

Visualizing the role of data for mission-based organizations – Round II

I am much obliged to all the good folks who have posted suggestions and feedback about my first attempt to create an image that would represent my thinking on the role of data in mission-based organizations.  Likewise, those who emailed me their thoughts deserve thanks!
I’ve created a revised version that incorporates some of the feedback.  Before you take a look at it, please bear in mind that:

  1. I am not a graphic designer.
  2. I am not attempting to create a graphic that illustrates everyone’s ideas about the role of data in a mission-based organization.  I am merely trying to illustrate my ideas.
Visualizing the role of data for mission-based organizations - Round II

Visualizing the role of data for mission-based organizations – Round II

Item #2 on the list notwithstanding, I am enjoying very much the opportunity to learn more about what others in the field think about (and visualize) when they ponder the role of data in our sector.  Once again, I invite you to post your reflections, suggestions, and questions in the comments section here on this blog.

My current daydream: The marriage of outcomes management apps with data visualization apps

The marriage of outcomes management with data visualization

Given my current preoccupation with both outcomes management and data visualization for mission-based organizations, perhaps it’s not a surprise that I’m daydreaming about integrating applications that were designed for these two tasks.

This daydream was inspired by a recent conversation with Patrice Keegan, executive director of Boston Cares (a HandsOn Network affiliate).  She is keenly interested in both outcomes and data visualization, and she leads a nonprofit of modest size that collaborates not only with many local partners but also with a national network of sister organizations that facilitate short-term volunteering.  In other words, Boston Cares provides a gateway to volunteerism for individuals, corporations, and community-based nonprofits, and then shares best practices with its counterparts across the United States.

What better poster girl could there be than Patrice, for my Cause, which is making it not only possible but easy for her to take her outcomes analyses and turn them in visuals that tell the story of the social impact of Boston Cares?

Moreover, what good is a cause and a poster child, without a poster?  Here’s mine:

Patrice Keegan of Boston Cares
Special note to software developers in the nonprofit sector:  please take a look at that bright, shining face, and give your efforts to the cause.

What I learned about outcomes management from Robert Penna

Robert Penna

Yesterday, along with a number of colleagues and friends from Community TechKnowledge, I had the privilege of attending a training by Robert Penna, the author of The Nonprofit Outcomes Toolbox.

As you probably  know, I’ve been on a tear about outcomes measurement for a few months now; the current level of obsession began when I attended NTEN’s Nonprofit Data Summit in Boston in September.  I thought that the presenters at the NTEN summit did a great job addressing some difficult issues – such as how to overcome internal resistance to collecting organizational data, and how to reframe Excel spreadsheets moldering away in file servers as archival data.  However, I worked myself into a tizzy, worrying about the lack, in that day’s presentations, of any reference to the history and literature of quantitative analysis and social research.  I could not see how nonprofit professionals would be able to find the time and resources to get up to speed on those topics.

Thanks to Bob Penna, I feel a lot better now.  In yesterday’s training, he showed me and the CTK team just how far you can go by stripping away what is superfluous and focusing on what it really takes to use the best outcomes tools for job.  Never mind about graduate level statistics! Managing outcomes may be very, very difficult because it requires major changes in organizational culture – let’s not kid ourselves about that.  However, it’s not going to take years out of each nonprofit professional’s life to develop the skill set.

Here are some other insights and highlights of the day:

  • Mia Erichson, CTK’s brilliant new marketing manager, pointed out that at least one of the outcomes tools that Bob showed us could be easily mapped to a “marketing funnel” model.  This opens possibilities for aligning a nonprofits programmatic strategy with its marcomm strategy.
  • The way to go is prospective outcomes tracking, with real time updates allowing for course correction.  Purely retrospective outcomes assessment is not going to cut it.
  • There are several very strong outcomes tools, but they should be treated as we treated a software suite that comprises applications that are gems and applications that are junk.  We need to use the best of breed to meet each need.
  • If we want to live in Bob Penna’s universe, we’re going to have to change our vocabulary.  It’s not “outcomes measurement – it’s “outcomes management.” The terms “funder” and “grantmaker” are out – “investor” is in.

Even with these lessons learned, it’s not a Utopia out there waiting for nonprofits that become adept at outcomes management.  Not only is it difficult to shift to an organizational culture that fosters it, but we have to face continuing questions about how exactly the funders (oops! I should have said “investors”) use the data that they demand from nonprofit organizations.  (“Data” is of course a broad term, with connotations well beyond outcomes management.  But it’s somewhat fashionable these days for them to take an interest in data about programmatic outcomes.)

We should be asking ourselves, first of all, whether the sole or primary motivation for outcomes management in nonprofits should be the demands of investors.  Secondly, we should be revisiting the Gilbert Center’s report, Does Evidence Matter to Grantmakers? Data, Logic, and the Lack thereof in the Largest U.S. Foundations.We need to know this. Thirdly, we should be going in search of other motivations for introducing outcomes management.  I realize that most nonprofits go forward with it when they reach a point of pain (translation:  they won’t get money if they don’t report outcomes). 

During a break in Bob’s training, some of my CTK colleagues were discussing the likelihood that many nonprofit executives simply hate the concept of outcomes management.  Who wants to spend resources on it, if it subtracts from resources available for programmatic activities?  Who wants to risk finding out (or to risk having external stakeholders find out) that an organization’s programs are approximately as effective as doing nothing at all?  Very few – thus the need to find new motivations, such as the power to review progress and make corrections as we go.  I jokingly told my CTK colleagues, “the truth will make you free, but first it will make you miserable.”  Perhaps that’s more than a joke.

What if we had a pro bono training on outcomes measurement for nonprofit professionals in Massachusetts?

question mark

As you can probably guess, I spend a lot of time these days worrying about outcomes measurement for nonprofits; I also devote time to discussing this topic with experts and with nonprofit professionals.

As I talk to some of the most impressive mavens in this field I  sometimes ask, “would you travel to Massachusetts at your own expense, to give a free day-long training on outcomes measurement to nonprofit professionals here?

Nothing ventured, nothing gained – am I right?  (Or as my dear sister once put it, I am The Mouth That Knows No Fear.)

A few really stellar experts actually agreed to do it, if a training event could be arranged to suit their schedules and other reasonable needs.  Of course, I am stunned, overwhelmed with gratitude.  Never underestimate the kindness of mavens!

So now I turn to my nonprofit colleagues in Massachusetts, with another unscientific survey.  I want to get a sense of who would be interested in day-long free training.  This survey is for them.  If you’re not a nonprofit professional based in Massachusetts, please do the honorable thing, and refrain from participating in this survey.

Outcomes measurement for nonprofits: Who does the analysis?

I invite you to participate in this survey, bearing in mind that it is for recreational purposes, and has no scientific value:

There are many reasons that this survey is of dubious value, for example:

  • No pilot testing has been done to ensure that the choices offered are both exhaustive and mutually exclusive.

The list could go on, but I’ll leave it at that.  Although most of my training is in qualitative social research, I have taken undergraduate and graduate level courses on quantitative research, and the points I made about what’s wrong with my survey are what I could pull out of memory without consulting a standard text on statistics.

In other words, when it comes to quantitative analysis, I know just enough to be dangerous.

Meanwhile, I worry about nonprofit organizations that are under pressure to collect, analyze, and report data on the outcomes of their programs.  There are a lot of fantastic executive directors, program managers, and database administrators out there – but it’s very rare for a nonprofit professional who falls into any of those three categories to also have solid skills in quantitative analysis and social research methods.  Nevertheless, I know of plenty of nonprofit organizations where programmatic outcomes measurement is done by an executive director, program manager, or database administrator whose skill set is very different from what the task demands.  In many cases, even if they come up with a report, the nonprofit staff members may not even be aware that what have done is presented a lot of data, without actually showing that there is any causal relationship between the organization’s activities and the social good that they are in business to deliver.

Let’s not be too hasty in deprecating the efforts of these nonprofit professionals.  They are under a lot of pressure, especially from grantmaking foundations, to report on programmatic outcomes.  In many cases, they do the best they can to respond, even if they have neither the internal capacity to meet the task nor the money to hire a professional evaluator.

By the way, I was delighted to attend gathering this fall, in which I heard a highly-regarded philanthropic professional ask a room full of foundation officers, “are you requiring $50,000 worth of outcomes measurement for a $10,000 grant?” It’s not the only question we need to ask, but it’s an extremely cogent one!

I’d love to see nonprofit professionals, philanthropists, and experts in quantitative analysis work together to address this challenge.

We should also be learning lessons from the online tools that have already been developed to match skilled individuals with nonprofit professionals who need help and advice from experts.  Examples of such tools include the “Research Matchmaker,” and NPO Connect.

We can do better.  It’s going to take time, effort, money, creativity, and collaboration – but we can do better.