A site visit protocol for assessing recovery promotion at the program level: An example from the Veterans Health Administration

Abstract

OBJECTIVE: A site visit protocol was developed to assess recovery promotion in the organizational climate and culture of programs for veterans with serious mental illnesses. METHOD: The protocol was pilot-tested in 4 programs: 2 that had scored high on the pilot version of a staff survey measure of program-level recovery promotion and 2 that had scored low. Two-person teams conducted onsite visits and assigned global and organizational domain ratings. Interrater agreement was assessed by examining adjacent agreement and computing weighted kappa. RESULTS: The on-site protocol had good interrater agreement and discriminated between sites that scored high and low on the staff survey. CONCLUSIONS AND IMPLICATIONS FOR PRACTICE: This site visit protocol and procedure shows promise for evaluating recovery promotion in milieu-based programs. After further refinement of this tool, adaptations could be developed for accreditation protocols or for program self-assessment and quality improvement efforts. (PsycINFO Database Record (c) 2019 APA, all rights reserved).