Stanford Social Innovation Review : Informing and inspiring leaders of social change

SUBSCRIBE | HELP

Measuring Social Impact

Introducing the Impact Genome Project

A new, groundbreaking initiative will codify and quantify the factors used in social impact programs that are proven to produce outcomes.

In a recent SSIR blog post, “Cracking the Code on Social Impact,” one of us (Jason Saul) introduced our Universal Outcomes Taxonomy, which serves as a foundation for benchmarking across the social sector. Even though this is a big step forward, the critical question remains: How can we benchmark social impact programs if they have no outcomes data?

The fact is that few nonprofits have quality outcomes data today, and they likely never will; capacity, cost, time, and consistency are all factors that make it impractical to expect them to produce quality data. To overcome this challenge, we must flip the measurement paradigm from empirical, longitudinal, retrospective data to real-time, predictive, algorithm-based data. In a word, we need to create “synthetic” data.

Other sectors have been successful in using algorithm-based data to predict future behavior or outcomes. For example, when someone applies for a loan, the bank uses his or her credit score to predict the likelihood of repayment. When a student applies to a college program, the admissions committee uses a formula that considers standardized tests, high school transcripts, and other factors to predict the likelihood that the student will be successful in the program. Both of these widely used and well-regarded decision-making tools rely on “synthetic” data.

The basis of developing this “synthetic” data is a comprehensive mapping of the factors involved in predicting a specific outcome. In 1990, the Department of Energy and the National Institutes of Health launched the Human Genome Project to predict health outcomes. In 2000, Pandora created the Music Genome Project to quantify music and predict songs that are likely to produce the outcome of a heightened listening experience. And now, in 2014, we’re announcing the launch of the Impact Genome Project, a massive effort to systematically codify and quantify the factors that research has shown drive outcomes across the entire social sector.

The fundamental idea behind the impact genome is that we can fully express the set of characteristics that describe any given social impact program. The systematic process we undertake to evaluate a program against the impact genome considers information based on a program’s operation, its theory of change, its outcome potential, and other metrics and indicators. By mapping all of these factors and comparing success across programs, we can leverage predictive analytics to forecast a program’s efficacy in producing a desired outcome.

One example of how this approach works is an analysis of social impact programs focused on science, technology, engineering, and mathematics (STEM). These programs range widely in scope and include advocacy efforts, after-school enrichment, professional development, competitions, mobile museums, scholarships, career guidance, curriculum development, and science fairs. Although these programs are obviously quite different, we can compare them based on their contribution to enhancing an individual’s ability to understand and apply STEM-related knowledge and skills. In our taxonomy of standard outcomes, we call that ability “Developing Knowledge and Skills for Individuals.”

The impact genome for STEM leverages an analytical model that uses proven success factors to generate useful data for decision-making. This information includes metrics such as efficacy rate (the expected likelihood that a program will achieve an outcome), expected outcomes (the total number of people served by a program who are likely to achieve the intended outcome), and cost per outcome (the average expected cost for a program to achieve a “unit” of intended outcome).

The figure below is an example of findings derived from this process. Using the impact genome, we can evaluate a new STEM program and predict the program’s efficiency and effectiveness with confidence. It is also finally possible to compare performance across a set of programs that aim to produce the same outcome. In that way, we can understand the progress we are making on a broad scale.

Work on the STEM genome is just the beginning, and we are rapidly building out other areas of the impact genome (such as workforce development, arts, and housing) to create a comprehensive system that channels the power of data across every social impact area. The ultimate goal is to use these data so that funders—including governments, foundations, nonprofits, corporations, and individuals—can more effectively invest in social change and finally solve some of the world’s most intractable problems. It is possible. All we need are better data. Please join us in this exciting work!

Tracker Pixel for Entry
 

COMMENTS

  • BY perry yeatman

    ON April 9, 2014 11:48 AM

    I know I am biased but this is really exciting news.  If, working with others, we can map the entire social sector, we could really drive a step change in our collective ability to achieve social impact. Let’s make that happen!  And the sooner, the better!

  • Rebecca R.'s avatar

    BY Rebecca R.

    ON April 10, 2014 04:43 PM

    Can’t wait to utilize this in the near future! While it’s critical that funders have access to strong and clear data, it’s even more critical that their grantees don’t waste countless numbers measuring data and completing grant paperwork when they ought to be executing their social impact goals. Hopefully, the Social Impact Genome will streamline data collection and evaluation on every inch of the philanthropy circle.

  • Great article. But is that actually new or are other organizations like “IRIS research” also working to define outcome of the metrics used, right?

Leave a Comment

 
 
 
 
 

Please enter the word you see in the image below: