Minnesota Bridge Image
St. Anthony Main
219 Main Street SE, Suite 302
Minneapolis, Minnesota 55414

(f) 612.623.8807

Engaging in responsive evaluation and creating meaningful and accessible reports for the evaluation of a coalition

Written by Melissa Chapman Haynes, Emma Ramsbottom Wagner, and Angie Ficek

We are the contracted evaluator for the Ohio Comprehensive Cancer Control Program (CCCP), which includes the cancer Program, the Ohio Cancer Plan, and the Partnership (the coalition), the Ohio Partners for Cancer Control (OPCC). The essence of CCCP work is on facilitating partnerships, increasing coordination and reducing duplication, and creating a value added for the individuals who volunteer their time to CCCP efforts. By design, the OPCC brings together a diverse array of stakeholders working on, affected by, or interested in reducing cancer incidence, mortality, and disparities. Given the wide range of activities, types of stakeholders, and key priorities, it was a formidable challenge to create and implement a responsive yet feasible evaluation and report of the OPCC’s work!

What we did

As with most coalitions, one way that OPCC collects information about the coalition’s processes is through an annual member survey. The findings are used internally to understand the strengths and areas in need of improvement. Further, the strengths inform promotional efforts of the OPCC in an effort to recruit interested stakeholders to join the coalition. A similar survey has been done for multiple years, and there are consistently positive findings every year, though we collaborated with ODH to include some open-ended items and some demographic items so we could better understand the meaning behind those numbers. To compliment and extend the survey data, we decided to conduct interviews as well to take a deeper dive into the coalition’s processes. There was a total of 12 interviews, and they were conducted with the OPCC executive chair, committee chairs, the CCCP staff at the Ohio Department of Health, and the Ohio Department of Health’s program cancer partners.

In the end, we produced a two-page summary in PowerPoint of the coalition survey findings and intertwined some related interview findings as well. We also produced several one pagers based on the interview findings that served as success stories and descriptions of emerging partnerships. The one-pagers helped to further showcase Ohio’s CCCP’s efforts.

What we learned

The succinct, visual nature of what we produced went over very well with our client. The lollipop chart distilled a lot of information that hasn’t changed much over time into one chart, and we felt it worked better than a bar chart because it focuses your eyes on the end of the data points, which are all high. The inclusion of interview findings helped OPCC get a better sense of the context of the survey findings, and the interviews also highlighted the need for expanding OPCC membership, clarifying the resource limitations of the coalition, and coordinating the evaluation efforts across the various ODH partners, OPCC committee chairs, and internal and external evaluation efforts. We are continuing to incorporate interviews into the evaluation of the coalition, and also hope to continue to use this reporting style as we look to engage a broader array of stakeholders in partnership with ODH.


Posted in Data visualization, Real Life Examples