Methods
The randomised trial, along with the study protocol and methods, was preregistered (https://osf.io/r9z34?view_only=52360cf7023f470898d9f11892d7d16a). All materials, data, and analysis code will be publicly released (https://osf.io/f34jp/) following embargo ending 30 April 2024, though materials can be accessed earlier for evidence synthesis, or reproducibility.
Trial design
A multisite randomised waitlist-controlled trial design was employed as it was thought unethical to entirely withhold materials which prior evidence suggested would be at least somewhat beneficial.4 5 The first author and Principal Investigator obtained approval by the Human Subjects Ethics Committee of the City University of Hong Kong (reference no. 2-2-201907-01), and each additional site obtained ethical approval from an institutional review board within country. These include IRB approval from Ethics Research Committee at the University of Pretoria (protocol number: T070/19) and the General Human Research Ethics Committee at the University of the Free State (protocol number: UFS-HSD2019/2259/0212) for South Africa; Central Investigation Committee of Universidad del Sinú (protocol number: 006) for Colombia; Ukrainian Institute of Arts and Sciences Ethics Committee (protocol number: 004) and REALIS (protocol number: G0119) for Ukraine; and Nusantara Scientific Psychology Consortium (protocol number: 007/2020 Etik/KPIN) for Indonesia. Participants in each site were randomised by computer-generated random numbers to immediate-treatment or delayed-treatment. The delayed-treatment group received the workbook 2 weeks after the immediate-treatment group. Participants were instructed to complete the workbook within 2 weeks, either by paper-and-pencil or web-based platform (method differed across sites). Participants were surveyed three times: prior to randomisation (T1), after the initial 2 week period but before the delayed-treatment group received the workbook (T2), and 2 weeks after the delayed-treatment group received the workbook (T3). Data collection at each time occurred within 3–5 days (the window varied by site) of the target 2 week date.
Participants
For inclusion, participants needed to be ≥18 years and have experienced an interpersonal transgression. Participants were recruited from six sites: Hong Kong, Indonesia, two Ukraine sites, Colombia, and South Africa. The countries selected had each experienced civil conflict or unrest in the recent past. At preregistration, the study included a site in Ghana, but no participants were ultimately enrolled at this site. Each site recruited participants from communities of their choice, including students at designated university campuses (Colombia subsite, Ukraine site 1 (supplemented with members of a Christian church)), survivors of war (Colombia subsite), members of a Christian church (Ukraine site 2), and members of the general public (Hong Kong, Indonesia, South Africa).
Site directors engaged one or more local contacts (eg, community leaders, university administrators, leaders of religious communities, leaders of non-government organisations, and well-established survey research organisations) to assist with identifying potential participants, and used trained research assistants to recruit participants, provide instructions to participants, and collect data. All participants were provided a nominal financial incentive to complete the self-report survey at all three time points.
At each site, participants were instructed to recall a previous transgression (eg, ‘Please think about someone who has deeply hurt or offended you. Without writing their name, write a brief description of what the person did to hurt or offend you’). Pilot data involving most of the sites included in this study suggest that among the most common types of transgressions that participants tend to describe are inappropriate communication or harassment (14.1%), sabotage of social connections or defamation of reputation (8.6%), and accusations or moral affronts (7.5%), and that friends (17.9%), romantic partners or spouses (16.7%), and non-spouse family members (14.4%) are among the most frequently identified perpetrators of recalled transgressions.12
Patient and public involvement
Results will be disseminated to study participants after publication and the self-guided workbook will be made freely and publicly available in all languages into which it has been translated for the study. However, participants were not otherwise involved in the design of the study.
REACH forgiveness intervention
The REACH Forgiveness8 intervention is an evidence-based approach to promote forgiveness. It has been adapted into a self-guided workbook,9 and a web-based format.11 The present workbook adapts the previously tested 7 hour workbook,9 selecting 2–3 hours of exercises thought most likely to promote forgiveness based on practical and theoretical considerations. Each letter of REACH constitutes a step: R=recall the hurt; E=empathise with the offender; A=give an altruistic, undeserved gift of forgiveness; C=commit to forgiveness experienced; and H=hold onto forgiveness. The workbook involves nine components. Participants (1) describe the hardest transgression successfully forgiven, (2) identify a target transgression to try to forgive, (3) complete assessments of their forgiveness, (4) define two types of forgiveness (decisional and emotional), (5) learn the relational, psychological, and physical benefits of forgiving, (6) work through five steps (REACH) of emotional forgiveness, (7) consider a decision to forgive, (8) complete a 12-step generalisation protocol to widen applicability beyond the target transgression, and (9) assess forgiveness of the target transgression and compare it to the original assessment (workbook assessments were not used as formal outcomes).
Outcomes
We preregistered three primary and four secondary outcomes. The primary outcomes were unforgiveness (Transgression-Related Interpersonal Motivations Inventory-18),13 depression symptoms, and anxiety symptoms (Brief Symptom Inventory-18).14 The secondary outcomes were decisional forgiveness (Decision to Forgive Scale),15 forbearance (Forbearance Scale-Short Form),16 flourishing (Secure Flourishing Index),17 and trait forgivingness (Trait Forgivingness Scale).18 Further details about each measure are in online supplemental text 1.
Statistical methods
We conducted statistical analyses in R, V.4.2.0. All sites achieved >70% retention at T2 (a preregistered criterion for sites’ inclusion in analyses). Unless otherwise indicated, all analyses were conducted using multiple imputation by chained equations for all variables with missing data. We imputed data using predictive mean matching and with the data set in wide format to account for correlation within subjects.
Analyses were conducted on an intention-to-treat basis. All reported outcomes employed standardised mean differences (SMDs).
Primary analysis
For each primary outcome, we fit a generalised estimating equations (GEE) model regressing subjects’ T2-outcomes on intervention group (immediate-treatment vs delayed-treatment). This model included fixed effects of site and no other covariates. Because this model included no site-by-treatment-group interaction terms, the estimated effect represents the average across all sites, not the effect within any given site.
Secondary analysis
Secondary outcomes
We refit the GEE model to each of the four secondary outcomes.
Effect heterogeneity
To investigate effect modification by trait forgivingness, we refit a preregistered GEE model for each primary outcome after including a T1-trait-forgivingness-by-treatment-group interaction term. To investigate whether effects differed across sites, we refit preregistered GEE models for each primary outcome after including site-by-treatment-group interactions. We used a harmonic mean p-value19 for each primary outcome to aggregate p-values for site-by-treatment-group interaction terms, yielding a global test of interaction.
We used the Bonferroni-Holm correction for multiple testing for the 10 secondary analyses: four secondary outcomes and six effect heterogeneity analyses for primary outcomes (two heterogeneity analyses per outcome).
Additional analyses
Sensitivity analysis for model specification
We refit the GEE model for each primary outcome while controlling also for precision covariates (age, sex, T1-baseline values of primary outcomes, and site).
Sensitivity analysis for treatment effect modelling
We conducted two analyses with T3 data to estimate effectiveness under assumptions stronger than randomisation alone. First, we fit an ordinary-least-squares model for each primary outcome including treatment-group-by-wave interactions. Although we had prespecified a 2×3 repeated-measures analysis of variance (ANOVA, treatment-group×wave) model, this specification within site was not estimable. The model we fit is equivalent to a standard ANOVA. Second, we used GEE to regress each primary outcome on a time-varying indicator of having received the workbook. We also conducted a posthoc analysis with T3 data that refit the aforementioned GEE model, with waves considered continuous, rather than categorical, thereby assuming that any secular trends were linear.
Effect maintenance over time
We examined outcome maintenance at T3. One subsite in Colombia obtained T2 data but was unable to obtain T3 data due to the COVID-19 pandemic; this subsite was posthoc excluded from analyses using T3 data. For each primary outcome, we estimated the proportion of the estimated improvement between T1 and T2 for the treated participants that was sustained at T3.