Politics and Education

Learning a Practical Psychotherapeutic Skill in Higher Education in Sweden: A Conceptual Paper Concerning the Importance of Constructive Alignment When Teaching Therapeutic Alliance

Ann-Sophie Lindqvist Bagge*1 , Rolf Holmqvist2 , Therése Skoog1 , Malin Hildebrand Karlén1

Clinical Psychology in Europe, 2024, Vol. 6(3), Article e12037, https://doi.org/10.32872/cpe.12037

Received: 2023-05-25. Accepted: 2024-04-12. Published (VoR): 2024-09-30.

Handling Editor: Anton-Rupert Laireiter, University of Vienna, Vienna, Austria

*Corresponding author at: Department of Psychology, University of Gothenburg, Box 500, S-Gothenburg, Sweden. E-mail: alb@gu.se

This is an open access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract

Background: In addition to theoretical education, clinical psychology programs should include practical skills training. This skill training may be tied to specific assessment and treatment methods; other skills, such as the ability to create a collaborative alliance with patients, are more generic. Previous research has shown that the ability to build a therapeutic alliance (TA) is often not systematically taught in clinical psychology programs and it is uncertain how this competence is examined. A lack of competence in establishing TA on the part of the psychologist might diminish the effects of psychotherapy. To meet the Bologna Declaration, European universities need to demonstrate constructive alignment, i.e. a relationship between elements of the course content and intended learning outcomes in course documents, and show how the acquired knowledge, abilities, and approaches are assessed.

Method: This conceptual paper reviewed the syllabuses for universities in Sweden offering the five-year clinical psychology program to illustrate how higher education in Sweden adheres to the Bologna recommendation on constructive alignment when teaching TA to future clinical psychologists.

Results: Only two universities out of all eleven universities in Sweden offering a psychology program described satisfactory constructive alignment concerning TA.

Conclusion: This conceptual paper raises awareness of the importance of pedagogic structure when teaching TA in higher education by pointing to the prevailing lack of constructive alignment in teaching TA. The increased awareness will hopefully lead to improved structuring in the teaching of TA.

Keywords: constructive alignment, clinical psychology training, psychology education, therapeutic alliance

Highlights

  • Shortcomings in TA training may reflect broader challenges in psychotherapy education across European universities.

  • TA training should be a core element of future clinical psychology program curricula.

  • European institutions are encouraged to integrate TA training consistently into curricula and ILOs.

Background

Research and theoretical reflection about the significance of general relational factors in contrast to more specific techniques and methods in psychological treatment have been in focus for decades (Norcross & Wampold, 2019). Recent theoretical and empirical work indicates a complex interaction between specific and general relational factors for patient outcomes (Heinonen & Nissen-Lie, 2020; Lorenzo-Luaces & DeRubeis, 2018; Uhl et al., 2022; Webb et al., 2010). Considering the importance of relational factors, it is interesting that professional training and clinical experience do not seem to improve the competencies needed to increase patient outcomes (Christensen & Jacobson, 1994). Hayes and colleagues (2022) recently commented on “the paradox that experience in psychological intervention reliably leads to increases in confidence but not in competence” (p. 19). In parallel with this discussion, the issue of the significance of therapists’ adhering to treatment integrity has also evoked research interest. Although the findings on this issue are heterogeneous, it seems apparent that general relational factors contribute substantially to patient change (Heinonen & Nissen-Lie, 2020; Uhl et al., 2022; Webb et al., 2010) The question of how to combine technique with relational competence is complex (Seewald & Rief, 2023).

Studies on Facilitative Interpersonal Skills (FIS; Anderson et al., 2016) have shown that factors like a therapist’s capacity for establishing warmth, persuasiveness, hopefulness, and ability to create an alliance and repair problems are associated with more positive treatment outcomes. Bennett-Levy summarized recent studies about the role of the therapist by stating that effective therapists are characterized by “the relational qualities and skills associated with alliance building and maintenance, and cognitive and emotional personal qualities such as resilience, mindfulness, tolerance of ambiguity, self-confidence, healthy self-doubt, capacity for self-reflection and self-awareness” (Bennett-Levy, 2019, p. 141).

Therapeutic Alliance (TA)

The most studied relational factor is the therapeutic alliance (TA) (Bordin, 1979; Wampold, 2015). The usual definition implies that TA consists of three components: (1) goal – the therapeutic purpose, (2) task – the therapeutic process, and (3) bond – the therapeutic relationship (Bordin, 1979). The creation of the alliance can be seen as a joint effort by the patient and therapist. The alliance contributes significantly to the effects of psychotherapy (Flückiger et al., 2018). The explicit aspect of TA concerns agreement and negotiations about goals and tasks, whereas the bond aspect of TA comprises the patient's emotional ties to the therapist and the therapist's empathetic ability and involvement in the patient's situation (Summers & Barber, 2003). A meta-analysis (Del Re et al., 2021) concludes that average differences between therapists in the alliance with their patients have a stronger influence on outcomes than differences between patients within therapists. This finding underscores the importance of stimulating therapists to improve their ability to create constructive cooperation with the patient.

Studies have shown that the quality of the TA contributes to treatment outcomes (Flückiger et al., 2018; Summers & Barber, 2003). A two-stage individual meta-analysis showed reciprocal within-patient correlations between higher ratings of alliance and lower symptom load in the first seven sessions of psychotherapeutic contact, indicating that better TA contributes to symptom reduction (Flückiger et al., 2020). The authors concluded that at least in the early phase of psychotherapeutic contact, symptoms, and alliance were reciprocally related to one other, generating a positive spiral, increasing the sense of alliance, and lowering symptom load in the subsequent sessions (Flückiger et al., 2020). The causal relationship between alliance and session outcome is complex. Most studies do, however, find that the primary causal link is from better alliance to better outcomes (Crits-Christoph & Gibbons, 2021). The alliance-outcome relationship is a key factor across different psychotherapeutic treatment approaches (Flückiger et al., 2018). This is also valid for patients with personality disorders and severe mental conditions (Caspar, 2019).

Can TA Be Taught?

Summers and Barber (2003) concluded that: (1) the ability to develop TA can improve during training, (2) trainees become more focused on TA with accumulated training and complex case formulations, (3) the goal and task aspects of TA may be more learnable and teachable than the bond aspect, and (4) there are preexisting therapeutic factors that affect the ability to develop TA (Summers & Barber, 2003). Summers and Barber (2003) further argue that of the three factors likely to influence the development of TA, namely patient characteristics, therapist characteristics, and the therapist's technical activity during treatment, it is probably the therapist's technical activity that is most susceptible to training. Zilcha-Mano (2021) points to the importance of distinguishing between trait-like and state-like aspects of the therapist’s contribution. Therapists need to be able to distinguish between their trait characteristics and their reactions which are more situational (Zilcha-Mano et al., 2019).

Ever since Delaney and Heiman (1966) and later Grace et al. (1995) showed that trainees could be taught increased sensitivity to non-verbal communication, several studies have shown positive outcomes of various forms of alliance training. Crits-Christoph and colleagues (2006) found in a small study with five therapists that TA training improved the quality of therapist- and patient-rated TA, but not patient outcomes. Another study found that guidance from a supervisor that focused on TA ability or the alliance process was associated with a reduction in psychiatric symptoms and retention of positive outcomes in patients in therapy – these patients evaluated the therapy more positively at the end of treatment (Bambling et al., 2006). In still another alliance training study, Smith-Hansen et al. (2011) found improved alliance but no patient outcome effects. Recently, interest has been focused on the restoration of alliance ruptures. Studies have found that therapies where alliance ruptures are repaired attain better outcomes (Eubanks-Carter et al., 2015; Larsson et al., 2018; Safran et al., 2002). For example, The Alliance-Focused Training program (AFT) (Eubanks-Carter et al., 2015; Safran & Muran, 2000; Safran et al., 2011) is based on studies of alliance ruptures and their reparation. This program focuses on training self-awareness, affect regulation, and interpersonal sensitivity to increase therapists’ awareness of strains in the alliance and competence in repairing conflicts and ruptures. Recently, the Facilitative Interpersonal Skills (FIS) model has been combined with the AFT to create another training model, the AFT/FIS training (Perlman et al., 2023). The Personal Practice model created by Bennett-Levy also contains elements that focus on alliance-building (Bennett-Levy & Finlay-Jones, 2018). Studies of the results of skills training of relational variables show varying results. In a research overview, Knox and Hill (2021) conclude that although some persons may have more talent than others for psychotherapy, skills training does improve performance.

Regardless of the specific programs used in training to increase prospective therapists' TA competence, Summers and Barber (2003) recommended the following pedagogical approaches to improve TA: (1) early didactic and tutoring focus on TA concept and its techniques, (2) sustained attention on TA throughout the students' practical clinical TLAs (case formulations, conceptualizations, providing clinical tutor guidance in expected alliance ruptures within the discussed cases, etc.), (3) didactic and tutorial focus on establishing appropriate, realistic, and discussed goals and on identifying the patient’s and therapist's tasks in the therapy context, and (4) the concept ‘to develop TA’ should be integrated with clinical data regarding TA in case formulations and conceptualizations when teaching TA (Summers & Barber, 2003). In addition to the authors' belief that TA should be a central learning aspect of clinical psychology programs given its significant role as TA in psychological treatment, it is important to include clinical practitioners as lecturers when teaching practical skills in higher education courses to obtain a constructive balance between theory and practice (Williams & Joyce, 2009).

The Pedagogic Necessity of Constructive Alignment (CA)

As the therapist’s ability to establish and consolidate TA is a significant factor in treatment outcome, it is important to ascertain if and how this skill is taught in clinical psychology courses. It could be expected that training in TA would be a central learning target in clinical psychology programs. As early as 1990, it was suggested that training therapists should attend to the interpersonal processes in treatment relationships (Alberts & Edelstein, 1990). Studies have found, however, that TA is often not taught systematically in higher education (Constantino et al., 2017; Constantino et al., 2013). Since TA is usually not taught systematically there is an obvious need for a pedagogic focus on how TA is taught. If this pedagogic need is not met, graduate clinical psychologists could leave higher education without sufficient TA skills, despite research showing the importance of improving TA during the education of prospective psychologists (Grace et al., 1995).

Constructive Alignment (CA)

To meet the European aim of establishing general standards of teaching in higher education, i.e., The Bologna Declaration of 19 June 1999. Joint Declaration of the European Ministers of Education (European Higher Education Area [EHEA] and Bologna Process, 1999), universities need to demonstrate a logical relationship between elements of the course content and intended learning outcomes (ILOs) in course documents and how the acquired knowledge, abilities, and approaches are assessed (EHEA, 2015; González & Wagenaar, 2003).

The pedagogic idea that a constructive link, or alignment, should exist between ILOs, Teaching and Learning Activities (TLAs) and Assessments was developed by Biggs (1999). According to Biggs, constructive alignment makes explicit the standards needed if the ILOs are to be achieved and maintained. The underlying principle of constructive alignment is that the assessment tasks should comprise an authentic representation of the ILOs (Biggs & Tang, 2011). Constructive alignment could be used as a theoretical tool for planning TLAs and assessment tasks that aim to directly address the ILOs (Biggs & Tang, 2011), where the TLAs include what the teacher does (teaching activities) and what the student does (learning activities). ILOs did not feature in the original Bologna Declaration of 1999 but were included in the 2003 Berlin Communiqué and have since become the core component for evidencing qualifications at the European level, CA has been explicitly referenced from 2015 onwards (Hailikari et al., 2022; Loughlin et al., 2021). CA is today the foundation for the current standards and policies for program specification, and declarations of ILOs, in Europe (Fransson & Friberg, 2015; Ruge et al., 2019; Schmidt, 2019) since the establishment of the European Higher Education Area in 2010 (EHEA, 2021) and the Standards and Guidelines for Quality Assurance in the European Higher Education Area (ESG) in 2015 (ENQA et al., 2015). The ECTS (The European Credit Transfer and Accumulation System) Users’ Guide is a tool of EHEA that specifies the responsibility of university teachers to ensure that the constructive alignment of ILOs, TLAs, and assessment is “an essential requirement for educational programmes” (European Commission, Directorate-General for Education, Youth, Sport and Culture, 2015).

An Illustrative Example From Swedish Higher Education

Despite the recommendations of the Bologna process, there is much heterogeneity between European countries regarding clinical psychology training (Laireiter & Weise, 2019). Sweden has been a full member of the Bologna Process/European Higher Education Area since 1999. The Bologna declaration and constructive alignment are highly relevant to the Swedish clinical psychology program. To practice as a clinical psychologist in Sweden, the student must complete five years of master’s level university studies in the national Psychology Program (Master of Science in Psychology, 300 European Credit Transfer and Accumulation System [ECTS]) and then complete one year of practical service under continuous supervision (Swe. Praktisk Tjänstgöring för Psykologer [PTP]). After approved PTP, the student is granted a license as a clinical psychologist by the Swedish National Board of Health and Welfare (https://www.government.se/government-agencies/national-board-of-health-and-welfare--socialstyrelsen/) and the psychologist can then practice clinical psychological treatment without supervision in private settings or within the Swedish public healthcare system. During the 5-year psychology program, the clinical psychotherapy courses are often taught during the latter part of the program. The psychotherapy courses are taught separately or as integrated into other courses in the psychology programs. During the psychotherapy courses, the psychology student is taught theoretical psychotherapeutic knowledge and is allowed to practice this knowledge during supervised psychotherapeutic treatment with patients with milder forms of psychological problems. To become a licensed psychotherapist in Sweden, as opposed to a licensed clinical psychologist, students who have taken the clinical psychology program must also complete another 3-year program (a graduate diploma course in psychotherapy).

This conceptual paper aimed to illustrate how higher education in Sweden adheres to the Bologna recommendation on constructive alignment when teaching TA to future clinical psychologists. To assess the extent of training in TA, we observed how TA was taught regarding CA. A country-wide overview of the course syllabuses and ILOs of TA-relevant psychotherapy courses in the clinical psychology program was performed in 2019, by two of the authors, for all eleven universities in Sweden offering the five-year clinical psychology program. The two authors analyzed independently of each other the presence of explicit mention of the term TA (or its synonyms cf. working alliance, treatment alliance, etc.) based on the definition of Bordin (1979) in the TA-relevant clinical psychotherapy courses’ syllabuses and ILOs.

The reviewed document analysis showed that out of the eleven universities in Sweden offering a clinical psychology program, only two universities specifically stated, ‘therapeutic alliance’ (or its synonyms) in the ILOs in their course syllabuses. At nine universities, different aspects of the concept of TA were in some (vague) way described in the ILOs. When TA (or its synonyms) is not mentioned in the courses’ ILOs and when imprecise TA definitions do not fully correspond to the established definition of TA, a constructive link between ILOs, TLAs, and assessment/examination when teaching TA cannot be said to exist. The obvious lack of CA was due to an absence of a clear and explicit description of TA (or its synonyms) in the ILOs of the clinical courses for nine out of the eleven universities in Sweden offering a clinical psychology program. Definitions of TA should be operationalized in the ILO for programs to be able to teach and examine the students’ TA abilities/knowledge when applying the pedagogic concept of CA. The present illustrative example shows that teaching – and training – of TA is not done systematically in Swedish universities when training clinical psychology students’ ability to create a viable and constructive cooperative alliance with patients. As the data collection was conducted in Sweden only, the results cannot be generalized to universities in other European countries. The results can, however, hopefully serve as an illustration of a pedagogical problem that has been described in scientific journals (Constantino et al., 2017; Constantino et al., 2013) as well as has been informally discussed among colleagues internationally.

Conclusion

Teaching TA is difficult as it concerns a relational and, to a large extent, implicit skill. Nevertheless, this skill – alliance building and alliance maintenance – is a precondition for effectively using specific methods in psychotherapy. At the same time, psychotherapy is a craft as well as a science, and training programs need to ascertain that the student has acquired sufficient TA competence both theoretically and practically. The craft aspect of TA may be challenging to conceptualize in traditional university teaching contexts. We fear that the illustrative example of the current paper – showing vague descriptions of TA and a lack of constructive alignment between course objectives, ILOs, and examination methods – reflects a situation where TA is not systematically taught in clinical psychology programs in Sweden. Considering the significance for psychologists and their future patients of developing competence in alliance-building, preferably through constructive alignment, and the findings in this study, it is doubtful whether the current structure for teaching TA at Swedish universities offers prospective clinical psychologists an opportunity to develop sufficient TA knowledge and skills. A lack of basic TA competence in this might diminish the efficacy of psychotherapy given by future clinical psychologists. This conceptual paper hopefully directs the focus on the structure around the teaching of practical psychotherapeutic skills in higher education, illustrated by the lack of constructive alignment when teaching TA to clinical psychology students in higher education. It is also hoped that this conceptual paper will stimulate improved structuring of the teaching of TA. Based on the backdrop of the current conceptual paper – and given the important role of TA in enhancing the effectiveness of treatment and fostering positive outcomes for patients – our strong recommendation is to make alliance-building training a core element of future clinical psychology program curricula in Sweden. A good way to start is with TA being specifically mentioned in the ILOs. The importance of TA in clinical psychology education resonates with the ESG's emphasis on fostering student-centered learning outcomes and ensuring education effectiveness (ENQA et al., 2015). The identified shortcomings in TA training may reflect broader challenges in psychotherapy education across European universities, not just in Sweden. We encourage European institutions to adhere to the ESG principles by integrating TA training consistently into curricula and aligning it with program ILOs. Such a strategic approach ensures that future clinical psychologists across Europe receive comprehensive training in TA, promoting quality in psychotherapy delivery across the region.

Funding

The authors have no funding to report.

Acknowledgments

The authors have no additional (i.e., non-financial) support to report.

Competing Interests

The authors have declared that no competing interests exist.

Data Availability

Data supporting this study are not publicly available but can be accessed upon request. Please contact alb@gu.se

References

  • Alberts, G., & Edelstein, B. (1990). Therapist training: A critical review of skill training studies. Clinical Psychology Review, 10(5), 497-511. https://doi.org/10.1016/0272-7358(90)90094-Q

  • Anderson, T., McClintock, A. S., Himawan, L., Song, X., & Patterson, C. L. (2016). A prospective study of therapist facilitative interpersonal skills as a predictor of treatment outcome. Journal of Consulting and Clinical Psychology, 84(1), 57-66. https://doi.org/10.1037/ccp0000060

  • Bambling, M., King, R., Raue, P., Schweitzer, R., & Warren, L. (2006). Clinical supervision: Its influence on client-rated working alliance and client symptom reduction in the brief treatment of major depression. Psychotherapy Research, 16(3), 317-331. https://doi.org/10.1080/10503300500268524

  • Bennett-Levy, J. (2019). Why therapists should walk the talk: The theoretical and empirical case for personal practice in therapist training and professional development. Journal of Behavior Therapy and Experimental Psychiatry, 62, 133-145. https://doi.org/10.1016/j.jbtep.2018.08.004

  • Bennett-Levy, J., & Finlay-Jones, A. (2018). The role of personal practice in therapist skill development: A model to guide therapists, educators, supervisors and researchers. Cognitive Behaviour Therapy, 47(3), 185-205. https://doi.org/10.1080/16506073.2018.1434678

  • Biggs, J. B. (1999). What the student does: Teaching for enhanced learning. Higher Education Research & Development, 18(1), 57-75. https://doi.org/10.1080/0729436990180105

  • Biggs, J. B., & Tang, C. S.-K. (2011). Teaching for quality learning at university: What the student does (4th ed.). Open University Press.

  • Bordin, E. S. (1979). The generalizability of the psychoanalytic concept of the working alliance. Psychotherapy, 16(3), 252-260. https://doi.org/10.1037/h0085885

  • Caspar, F. (2019). Plan analysis and the motive-oriented therapeutic relationship. In U. Kramer (Ed.), Case formulation for personality disorders: Tailoring psychotherapy to the individual client (pp. 265–290). Elsevier Academic Press.

  • Christensen, A., & Jacobson, N. S. (1994). Who (or what) can do psychotherapy: The status and challenge of nonprofessional therapies. Psychological Science, 5(1), 8-14. https://doi.org/10.1111/j.1467-9280.1994.tb00606.x

  • Constantino, M. J., Morrison, N. R., Coyne, A. E., & Howard, T. (2017). Exploring therapeutic alliance training in clinical and counseling psychology graduate programs. Training and Education in Professional Psychology, 11(4), 219-226. https://doi.org/10.1037/tep0000157

  • Constantino, M. J., Morrison, N. R., MacEwan, G., & Boswell, J. F. (2013). Therapeutic alliance researchers’ perspectives on alliance-centered training practices. Journal of Psychotherapy Integration, 23(3), 284-289. https://doi.org/10.1037/a0032357

  • Crits-Christoph, P., & Gibbons, M. B. C. (2021). Psychotherapy process-outcome research: Advances in understanding causal connections. In M. Barkham, W. Lutz, & L. G. Castonguay (Eds.), Bergin and Garfield's handbook of psychotherapy and behavior change (7th ed., pp. 263–295). John Wiley & Sons.

  • Crits-Christoph, P., Gibbons, M. B. C., Crits-Christoph, K., Narducci, J., Schamberger, M., & Gallop, R. (2006). Can therapists be trained to improve their alliances? A preliminary study of alliance-fostering psychotherapy. Psychotherapy Research, 16(3), 268-281. https://doi.org/10.1080/10503300500268557

  • Delaney, D. J., & Heiman, R. A. (1966). Effectiveness of sensitivity training on the perception of non-verbal communication. Journal of Counseling Psychology, 13(4), 436-440. https://doi.org/10.1037/h0023975

  • Del Re, A. C., Flückiger, C., Horvath, A. O., & Wampold, B. E. (2021). Examining therapist effects in the alliance–outcome relationship: A multilevel meta-analysis. Journal of Consulting and Clinical Psychology, 89(5), 371-378. https://doi.org/10.1037/ccp0000637

  • EHEA. (2021). Official website of the European Higher Education Area. Retrieved 12 May 2022 from http://www.ehea.info

  • ENQA, ESU, EUA, EURASHE, EI, & QEQAR. (2015). Standards and Guidelines for Quality Assurance in the European Higher Education Area [ESG]. https://www.ehea.info/media.ehea.info/file/ESG/00/2/ESG_2015_616002.pdf

  • Eubanks-Carter, C., Muran, J. C., & Safran, J. D. (2015). Alliance-focused training. Psychotherapy, 52(2), 169-173. https://doi.org/10.1037/a0037596

  • European Commission, Directorate-General for Education, Youth, Sport and Culture. (2015). ECTS users' guide 2015. https://doi.org/10.2766/87192

  • European Higher Education Area. (2015). Standards and Guidelines for Quality Assurance in the European Higher Education Area (ESG). Brussels, Belgium.

  • European Higher Education Area and Bologna Process. (1999). The Bologna Declaration of 19 June 1999. Joint Declaration of the European Ministers of Education. https://web.archive.org/web/20220331214436/http://www.magna-charta.org/resources/files/BOLOGNA_DECLARATION.pdf

  • Flückiger, C., Del Re, A. C., Wampold, B. E., & Horvath, A. O. (2018). The alliance in adult psychotherapy: A meta-analytic synthesis. Psychotherapy, 55(4), 316-340. https://doi.org/10.1037/pst0000172

  • Flückiger, C., Rubel, J., Del Re, A. C., Horvath, A. O., Wampold, B. E., Crits-Christoph, P., Atzil-Slonim, D., Compare, A., Falkenstrom, F., Ekeblad, A., Errazuriz, P., Fisher, H., Hoffart, A., Huppert, J. D., Kivity, Y., Kumar, M., Lutz, W., Muran, J. C., Strunk, D. R., . . . Barber, J. P. (2020). The reciprocal relationship between alliance and early treatment symptoms: A two-stage individual participant data meta-analysis. Journal of Consulting and Clinical Psychology, 88(9), 829-843. https://doi.org/10.1037/ccp0000594

  • Fransson, O., & Friberg, T. (2015). Constructive alignment: From professional teaching technique to governance of profession. European Journal of Higher Education, 5(2), 141-156. https://doi.org/10.1080/21568235.2014.997264

  • González, J., & Wagenaar, R. (2003). Tuning educational structures in Europe: A pilot project by and for higher education institutions supported by the European Commission in the framework of the Socrates programme. https://ehea.info/media.ehea.info/file/Tuning_project/89/3/Tuning-Educational-Structures-Europe-executive-summary_575893.pdf

  • Grace, M., Kivlighan, D. M., & Kunce, J. (1995). The effect of nonverbal skills training on counselor trainee nonverbal sensitivity and responsiveness and on session impact and working alliance ratings. Journal of Counseling and Development, 73(5), 547-552. https://doi.org/10.1002/j.1556-6676.1995.tb01792.x

  • Hailikari, T., Virtanen, V., & Vesalainen, M. (2022). Student perspectives on how different elements of constructive alignment support active learning. Active Learning in Higher Education, 23(3), 217-231. https://doi.org/10.1177/1469787421989160

  • Hayes, S. C., Ciarrochi, J., Hofmann, S. G., Chin, F., & Sahdra, B. (2022). Evolving an idionomic approach to processes of change: Towards a unified personalized science of human improvement. Behaviour Research and Therapy, 156, Article 104155. https://doi.org/10.1016/j.brat.2022.104155

  • Heinonen, E., & Nissen-Lie, H. A. (2020). The professional and personal characteristics of effective psychotherapists: A systematic review. Psychotherapy Research, 30(4), 417-432. https://doi.org/10.1080/10503307.2019.1620366

  • Knox, S., & Hill, C. E. (2021). Training and supervision in psychotherapy: What we know and where we need to go. In M. Barkham, W. Lutz, & L. G. Castonguay (Eds.), Bergin and Garfield's handbook of psychotherapy and behavior change (7th ed., pp. 327–349). John Wiley & Sons.

  • Laireiter, A.-R., & Weise, C. (2019). The heterogeneity of national regulations in clinical psychology and psychological treatment in Europe. Clinical Psychology in Europe, 1(1), Article e34406. https://doi.org/10.32872/cpe.v1i1.34406

  • Larsson, M. H., Falkenström, F., Andersson, G., & Holmqvist, R. (2018). Alliance ruptures and repairs in psychotherapy in primary care. Psychotherapy Research, 28(1), 123-136. https://doi.org/10.1080/10503307.2016.1174345

  • Lorenzo-Luaces, L., & DeRubeis, R. J. (2018). Miles to go before we sleep: Advancing the understanding of psychotherapy by modeling complex processes. Cognitive Therapy and Research, 42(2), 212-217. https://doi.org/10.1007/s10608-018-9893-x

  • Loughlin, C., Lygo-Baker, S., & Lindberg-Sand, Å. (2021). Reclaiming constructive alignment. European Journal of Higher Education, 11(2), 119-136. https://doi.org/10.1080/21568235.2020.1816197

  • Norcross, J. C., & Wampold, B. E. (Eds.). (2019). Psychotherapy relationships that work (3rd ed.). Oxford University Press.

  • Perlman, M. R., Anderson, T., Finkelstein, J. D., Foley, V. K., Mimnaugh, S., Gooch, C. V., David, K. C., Martin, S. J., & Safran, J. D. (2023). Facilitative interpersonal relationship training enhances novices’ therapeutic skills. Counselling Psychology Quarterly, 36(1), 25-40. https://doi.org/10.1080/09515070.2022.2049703

  • Ruge, G., Tokede, O., & Tivendale, L. (2019). Implementing constructive alignment in higher education – Cross-institutional perspectives from Australia. Higher Education Research & Development, 38(4), 833-848. https://doi.org/10.1080/07294360.2019.1586842

  • Safran, J. D., & Muran, J. C. (2000). Negotiating the therapeutic alliance: A relational treatment guide. Guilford Press.

  • Safran, J. D., Muran, J. C., & Eubanks-Carter, C. (2011). Repairing alliance ruptures. Psychotherapy, 48(1), 80-87. https://doi.org/10.1037/a0022140

  • Safran, J. D., Muran, J. C., Samstag, L. W., & Stevens, C. (2002). Repairing alliance ruptures. In J. C. Norcross (Ed.), Psychotherapy relationships that work (pp. 235-254). Oxford University Press.

  • Schmidt, H.-U. (2019). Learning outcomes: Core issues in higher education. In D. F. Staub (Ed.), Quality assurance and accreditation in foreign language education: Global issues, models, and best practices from the Middle East and Turkey (pp. 179-190). Springer International.

  • Seewald, A., & Rief, W. (2023). How to change negative outcome expectations in psychotherapy? The role of the therapist’s warmth and competence. Clinical Psychological Science, 11(1), 149-163. https://doi.org/10.1177/21677026221094331

  • Smith-Hansen, L., Constantino, M. J., Piselli, A., & Remen, A. L. (2011). Preliminary results of a video-assisted psychotherapist workshop in alliance strategies. Psychotherapy, 48(2), 148-162. https://doi.org/10.1037/a0022184

  • Summers, R. F., & Barber, J. P. (2003). Therapeutic alliance as a measurable psychotherapy skill. Academic Psychiatry, 27(3), 160-165. https://doi.org/10.1176/appi.ap.27.3.160

  • Uhl, J., Schaffrath, J., Schwartz, B., Poster, K., & Lutz, W. (2022). Within and between associations of clinical microskills and correct application of techniques/strategies: A longitudinal multilevel approach. Journal of Consulting and Clinical Psychology, 90(6), 478-490. https://doi.org/10.1037/ccp0000738

  • Wampold, B. E. (2015). How important are the common factors in psychotherapy? An update. World Psychiatry, 14(3), 270-277. https://doi.org/10.1002/wps.20238

  • Webb, C. A., DeRubeis, R. J., & Barber, J. P. (2010). Therapist adherence/competence and treatment outcome: A meta-analytic review. Journal of Consulting and Clinical Psychology, 78(2), 200-211. https://doi.org/10.1037/a0018912

  • Williams, J., & Joyce, M. (2009). Nursing, health and social care. In H. Fry, S. Ketteridge, & S. Marshall (Eds.), A handbook for teaching and learning in higher education: Enhancing academic practice (3rd ed., pp. 391-407). Routledge.

  • Zilcha-Mano, S. (2021). Toward personalized psychotherapy: The importance of the trait-like/state-like distinction for understanding therapeutic change. The American Psychologist, 76(3), 516-528. https://doi.org/10.1037/amp0000629

  • Zilcha-Mano, S., Roose, S. P., Brown, P. J., & Rutherford, B. R. (2019). Not just nonspecific factors: The roles of alliance and expectancy in treatment, and their neurobiological underpinnings. Frontiers in Behavioral Neuroscience, 12, Article 293. https://doi.org/10.3389/fnbeh.2018.00293