Assessing the Fidelity of an Affirmative Cognitive Behavioural Group Intervention

Craig, S. L., Pascoe, R. V., Iacono, G., Pang, N., & Pearson, A. (2022). Assessing the fidelity of an affirmative cognitive behavioural group intervention. Research on Social Work Practice, 0(0), 1–15. https://doi.org/10.1177/10497315221110865


Highlights

Background

  • Despite an increase in interventions designed for LGBTQ+ populations, there is a paucity of social work research that systematically describes the implementation fidelity of affirmative practice (i.e., the reliability and validity of affirmative interventions by assessing adherence to the treatment protocol) 

  • The purpose of this study is to explore the implementation fidelity of an affirmative CBT group intervention designed to improve coping and reduce depression among LGBTQ+ youth and young adults 

Study Description

  • As part of a clinical trial, the AFFIRM fidelity checklist was designed to assess clinician adherence. A total of 151 audio-recorded group sessions were coded by four trained raters 

  • AFFIRM implementation fidelity followed the processes outlined by Breitenstein et al. (2010), detailed in Figure 1. This study has systematically addressed three key aspects of implementation fidelity: adherence, competence, and differentiation  

  • Adherence was high with a mean fidelity score of 84.13 (SD = 12.50). Inter-rater reliability was 81%, suggesting substantial agreement 

  • Qualitative thematic analysis of low-rated sessions identified deviations from the manual and difficulties in group facilitation, while high-rated sessions specified affirmative and effective clinical responses 

Key Findings

  • The results of this research suggest that clinicians highly adhered to the AFFIRM intervention protocol, with good treatment fidelity and inter-rater reliability. The AFFIRM fidelity score (M=84.13) is relatively consistent with other intervention research 

  • Qualitative findings suggest clinician readiness is best addressed through the recruitment of qualified clinicians that have experience delivering EBPs in addition to knowledge of the LGBTQ+ community, comprehensive training and intensive supervision and coaching throughout intervention delivery 

  • The AFFIRM Fidelity Checklist is a relatively simple tool that captures the critical elements of affirmative group CBT implementation. Such a checklist may enhance monitoring during a clinical trial or may help improve clinical training, and supervision, and generate specific implementation strategies to enhance program materials 

 

Previous
Previous

Demonstrating LGBTQ+ Affirmative Practice in Groups: Developing Competence through Simulation-Based Learning

Next
Next

Riding the wave: pandemic social work in hospitals