The importance of data: how EPIC meticulously evaluate effectiveness
Readers of our recently-released Activity Report will have seen that the evaluation of the difference EPIC continues to make is verified not only by client testimonials, but evaluated data, intended to assess the impact and effectiveness of our delivery.
Our senior research manager, Anca-Maria Gherghel, was instrumental in collating the figures you’ll have seen throughout the publication, and here she explains how that data is meticulously collated and rigorously scrutinised to ensure reliability and provide meaningful metrics for ongoing improvement…
At EPIC, we follow a structured and thoughtful evaluation strategy. In order to evaluate the effectiveness of EPIC’s programs, the research and evaluation team follows the Kirkpatrick Evaluation Model. The model has four main levels: level 1 (reaction), level 2 (learning), level 3 (behaviours) and level 4 (results). The model is applied in its entirety to measure the effectiveness of the programs.
Levels 1 and 2 cover the overall satisfaction and enjoyment of the sessions, including qualitative feedback and points of improvement, as well as awareness and confidence levels as a result of attending the EPIC sessions. They are usually measured using a post-session survey distributed once a session was delivered to record initial reactions and learning that might have occurred. This helps us gauge how people experienced the training.
All data collected is carefully cleaned, anonymized, and checked for consistency to ensure honest, reliable feedback that we can confidently use to strengthen EPIC’s impact.
Levels 3 and 4 cover whether attendees applied what they learned in the session in practice, whether their confidence/awareness levels have been maintained and whether the program has guided practical application of what was learnt within their roles.
Therefore, we conduct more in-depth evaluation – such as focus groups and interviews – several weeks or months after the session to understand whether any behavioral changes have taken place and whether participants have applied what they learned in their daily lives.
Our approach is centred on continual improvement: we want to know what we did well, whether we achieved our intended goals, and where we can refine our work. We recognize that meaningful insight comes from ongoing dialogue, so we prioritize speaking with participants regularly to understand what may need to change.
Discover how the learning from the data has made a meaningful difference to our clients and continually improved our quality of provision by reading our Activity Report 2024/25.
Full report → bit.ly/EPICxAR2425Full
Mobile version → bit.ly/EPICxAR2425Digi
