The Importance of Evaluation: Insights from Carya’s Presentation at CES

At Carya, we believe that effective community programs are more than just well-intentioned initiatives—they require ongoing assessment and refinement to truly meet the evolving needs of those we serve.

This belief was recently underscored at the Canadian Evaluation Society (CES) conference in early May 2024, held in Fredericton, New Brunswick, where our very own Mitchell Parkinson had the privilege of representing Carya. This pivotal event, which brings together evaluation professionals from various sectors, provided compelling reasons why program evaluation is essential.

Mitchell’s Presentation: A Leap Forward in Data Collection

Mitchell’s presentation, titled ‘Can Data Collection Ever Excite Community Members? The Results of a QR Code Pilot in a Calgary Community Hub’ provided valuable insights into how technological advancements can transform community engagement.

By transitioning from a traditional kiosk system to a QR code-based method at Village Commons, we’ve simplified the registration and attendance processes, making them more intuitive and user-friendly for community members. This transition was not just about adopting new technology but also about enhancing the interaction between the community and the services provided. It has improved the quality and integrity of the data collected, evidenced by an impressive 50% engagement rate with questionnaires, illustrating how technology can enhance both user experience and data accuracy.

Reflecting on the Role of Evaluators

Throughout the conference, Mitchell noted several key themes. Many attendees, much like himself, did not begin their careers intending to become evaluators. This ‘accidental’ path into evaluation is becoming a trend as the demand for skilled evaluators grows across various sectors. Conference discussions encouraged attendees to share these unique journeys and emphasized the importance of structured training and recognition, such as the Credentialed Evaluator designation.

Emphasizing Honesty and Transparency

Another critical discussion point was the need for honesty and transparency in reporting evaluation outcomes. It is crucial for evaluators to communicate both successes and challenges truthfully to foster genuine improvements in community programs. This honesty ensures that programs do not just appear effective but genuinely meet the needs of the community they serve.

So, why is program evaluation needed? Here’s why it matters:

1. Informed Decision-Making: Program evaluation provides data-driven insights that help us understand what works, what doesn’t, and why. This allows us to make informed decisions about program improvements and resource allocation, ensuring that our initiatives have the greatest possible impact.
2. Accountability and Transparency: By regularly assessing our programs, we demonstrate our commitment to accountability and transparency. It’s crucial for us to be open about both successes and challenges, fostering trust and credibility within the community.
3. Empowering Community Members: Evaluation isn’t just about numbers; it’s about listening to and valuing the experiences of those we serve. By incorporating feedback and data into our program development, we empower community members to have a voice in shaping the services that affect their lives.
4. Continuous Improvement: The insights gained from evaluation help identify areas for growth and development. This continuous feedback loop ensures that our programs remain relevant and effective in addressing the community’s needs.

Carya’s Commitment to Rigorous Evaluation

In 2023, Carya expanded its evaluation practices to include rigorous methods using validated instruments across all programs. Although our initial datasets are still developing, we are already seeing meaningful results.

Looking Ahead: Navigating the Future of Evaluation

The theme of the CES conference, “Renewal and Confluence: Navigating the Future of Evaluation,” deeply resonated with Mitchell and has imbued his reflections with a sense of purpose and possibility. It emphasized that evaluation is not just about assessing the past but is a critical tool for shaping the future. By embracing diverse perspectives and methodologies, evaluators can play a significant role in the adaptability and effectiveness of programs in a rapidly changing world.

Mitchell’s experiences at the CES conference highlight the critical role that thoughtful and strategic evaluation plays in our work. His insights emphasize the significant impact our efforts can have on community empowerment and program effectiveness and will undoubtedly enrich our organization and the communities we serve.