A multi-level evidence approach to evaluate training, performance, and system-level impact of Hamdard Force: a community mental health intervention
- 1Mental Health, Strategic Planning and Coordination Unit, Ministry of Planning, Development and Special Initiatives, Islamabad
Abstract
BackgroundThere is limited evidence to demonstrate the impact of training community mental health workers beyond knowledge acquisition. This study evaluated the training, workforce performance, and system-level outcomes of the Hamdard Force, a community mental health intervention, implemented in two districts of Khyber Pakhtunkhwa, Pakistan, as part of a multi-tiered, digital MHPSS service over 8 months.
MethodsWe followed a multi-level evidence approach, guided by the New World Kirkpatrick Model, using a mixed-methods design that combined quantitative and qualitative indicators. We assessed participants reactions, learning, behavioral outcomes, system-level outcomes of the intervention, and conducted Focus Group Discussions to identify contextual factors that influenced implementation.
ResultsAt Tier 1, a total of 403 community workers were trained, who reported satisfaction with the training content and relevance, and demonstrated significant improvement in knowledge post-training. Less than half of the trained workforce remained active in the field and referred people with mental healthcare needs under supervision. A total of 855 people were triaged by clinical psychologists at Tier 2 of the service model, and 549 cases met the criteria of being valid. The results of detailed clinical assessment and management demonstrated encouraging outcomes regarding the effectiveness of the intervention, both at the individual case and at the system-level. The Focus Group Discussions revealed the process of supervision, organizational support and digital tools of learning were significant drivers of the intervention. Challenges with internet connectivity, limited digital literacy, and persistent mental health stigma were identified as implementation barriers.
ConclusionOverall, the integrated findings suggest that the intervention helped to build the capacity of the workforce, facilitated their performance through supervision, provided services through a task-sharing approach and strengthened referral pathways. These findings underscore the importance of implementation-focused evaluations for scaling up community mental healthcare in low-and middle-income countries.
Related
- Digital training to support delivery of an evidence-based cardiac rehabilitation programme for heart failure: a mixed-methods evaluation of healthcare professionals' training experiences and intervention fidelity.
- Effects of video reinforcement following face-to-face CPR/AED training on knowledge, attitude, and simulated performance among frontline community workers: a quasi-experimental study with post-training randomized allocation
- Exploring the role of Human Factors and Ergonomics in supporting safe insulin dispensing in community pharmacy: a pilot webinar-based training intervention
- Effects of eye movement training on balance and ocular motor function in community-dwelling Japanese school-aged children: a pilot study using a single-group intervention.
- Study protocol for the Collaborative Registrar Education and Training Enhancement (CREATE) project: a mixed-methods participatory study to co-design, implement and evaluate innovations to optimise GP training.
BibTeX
@misc{humayun2026multilevel,
title = {{A multi-level evidence approach to evaluate training, performance, and system-level impact of Hamdard Force: a community mental health intervention}},
author = {A. Humayun and N. u. A. Muneeb and A. Nisa and A. Aziz},
howpublished = {medRxiv},
year = {2026},
month = sep,
doi = {10.64898/2026.09.29.26363287},
url = {https://www.medrxiv.org/content/10.64898/2026.09.29.26363287v1},
note = {CC BY-NC-ND},
}
RIS
TY - UNPB
TI - A multi-level evidence approach to evaluate training, performance, and system-level impact of Hamdard Force: a community mental health intervention
AU - A. Humayun
AU - N. u. A. Muneeb
AU - A. Nisa
AU - A. Aziz
PY - 2026
DA - 2026/09/29
PB - medRxiv
DO - 10.64898/2026.09.29.26363287
UR - https://www.medrxiv.org/content/10.64898/2026.09.29.26363287v1
AB - BackgroundThere is limited evidence to demonstrate the impact of training community mental health workers beyond knowledge acquisition. This study evaluated the training, workforce performance, and system-level outcomes of the Hamdard Force, a community mental health intervention, implemented in two districts of Khyber Pakhtunkhwa, Pakistan, as part of a multi-tiered, digital MHPSS service over 8 months. MethodsWe followed a multi-level evidence approach, guided by the New World Kirkpatrick Model, using a mixed-methods design that combined quantitative and qualitative indicators. We assessed participants reactions, learning, behavioral outcomes, system-level outcomes of the intervention, and conducted Focus Group Discussions to identify contextual factors that influenced implementation. ResultsAt Tier 1, a total of 403 community workers were trained, who reported satisfaction with the training content and relevance, and demonstrated significant improvement in knowledge post-training. Less than half of the trained workforce remained active in the field and referred people with mental healthcare needs under supervision. A total of 855 people were triaged by clinical psychologists at Tier 2 of the service model, and 549 cases met the criteria of being valid. The results of detailed clinical assessment and management demonstrated encouraging outcomes regarding the effectiveness of the intervention, both at the individual case and at the system-level. The Focus Group Discussions revealed the process of supervision, organizational support and digital tools of learning were significant drivers of the intervention. Challenges with internet connectivity, limited digital literacy, and persistent mental health stigma were identified as implementation barriers. ConclusionOverall, the integrated findings suggest that the intervention helped to build the capacity of the workforce, facilitated their performance through supervision, provided services through a task-sharing approach and strengthened referral pathways. These findings underscore the importance of implementation-focused evaluations for scaling up community mental healthcare in low-and middle-income countries.
ER -