Research Articles

No1LikesU! – A Pilot Study on an Ecologically Valid and Highly Standardised Experimental Paradigm to Investigate Social Rejection Expectations and Their Modification

Lisa D’Astolfoa+, Lukas Kirchner*a+, Winfried Riefa

Clinical Psychology in Europe, 2020, Vol. 2(2), Article e2997, https://doi.org/10.32872/cpe.v2i2.2997

Received: 2019-07-11. Accepted: 2020-04-22. Published (VoR): 2020-06-30.

Handling Editor: Cornelia Weise, Philipps-University of Marburg, Marburg, Germany

*Corresponding author at: Philipps-University of Marburg, Department of Clinical Psychology and Psychotherapy, Gutenbergstraße 18, D-35032 Marburg, Germany. Tel: +49 (0)6421 2824076. Fax: +49 (0)6421 282-8904. E-mail: lukas.kirchner@uni-marburg.de

This is an open access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract

Background: Dysfunctional expectations have been suggested as core features in the development and maintenance of mental disorders. Thus, preventing development and promoting modification of dysfunctional expectations through intervention might improve clinical treatment. While there are well-established experimental procedures to investigate the acquisition and modification of dysfunctional performance expectations in major depression, paradigms for investigating other important types of dysfunctional expectations (e.g. social rejection expectations) are currently lacking. We introduce an innovative associative learning paradigm, which can be used to investigate the development, maintenance, and modification of social rejection expectations.

Method: A pilot sample of 28 healthy participants experienced manipulated social feedback after answering personal questions in supposed webcam conferences. While participants repeatedly received social rejection feedback in a first phase, differential feedback was given in a second phase (social rejection vs. social appreciation). In a third phase, explicit social feedback was omitted.

Results: Participants developed social rejection expectations in the first phase. For the second phase, we found an interaction effect of experimental condition; i.e. participants adjusted their expectations according to the differential social feedback. In the third phase, learned social expectations remained stable in accordance to the social feedback in the second phase.

Conclusion: Results indicate that the paradigm can be used to investigate the development, maintenance, and modification of social rejection expectations in healthy participants. This offers broad applications to explore the differential acquisition and modification of social rejection expectations in healthy vs. clinical samples. Further, the paradigm might be used to investigate therapeutic strategies to facilitate expectation change.

Keywords: ViolEx-Model, expectation violation, expectation persistence, expectation modification, dysfunctional expectations, social rejection, No1LikesU!

Highlights

  • This paradigm can be used to induce and modify social rejection expectations.

  • This allows to investigate differences in expectation acquisition, maintenance, and modification between clinical vs. healthy samples.

  • Further, this paradigm enables research on interventions promoting expectation modification.

Recent developments in clinical psychology propose dysfunctional expectations (i.e. future-directed ‘if-X-then-Y’-predictions, Rief et al., 2015, p. 380) as an important factor in the development of mental disorders and as a promising target in clinical treatment (e.g. Greenberg, Constantino, & Bruce, 2006; Rief & Glombiewski, 2017; Rief et al., 2015).

Dysfunctional expectations have been shown to play a crucial role in mental health as they negatively impact future behaviour (e.g. excessive avoidance, Krypotos, 2015), aggravate subjective suffering (e.g. pain perception, Jepma, Koban, van Doorn, Jones, & Wager, 2018), and elicit potentially maladaptive anticipatory reactions (e.g. negative mood, Davidson, Marshall, Tomarken, & Henriques, 2000).

Further, dysfunctional expectations have been shown to impede important clinical outcomes (e.g. treatment success, Constantino, Vîslă, Coyne, & Boswell, 2018). As George A. Kelly put it early in his theory of personal constructs: ‘A person’s processes are psychologically channelised by the ways in which he anticipates events’ (Kelly, 1977, pp. 358-359). Thus, preventing acquisition and promoting modification of dysfunctional expectations through intervention might improve clinical treatment (Craske, Treanor, Conway, Zbozinek, & Vervliet, 2014; Rief & Glombiewski, 2016; Rief & Joormann, 2019).

However, acquisition, maintenance, and modification of dysfunctional expectations is still little understood (Rief & Joormann, 2019). While there are promising theoretical approaches (Kube, Rief, & Glombiewski, 2017; Kube, Schwarting, Rozenkrantz, Glombiewski, & Rief, 2020) and well established experimental procedures concerning this issue with regard to dysfunctional performance expectations in major depression (Kube, Rief, Gollwitzer, & Glombiewski, 2018), experimental paradigms are lacking when it comes to other types of dysfunctional expectations (see Liebke et al., 2018, for a laudable exception).

Since especially (dysfunctional) expectations of social rejection (e.g. ‘When I open myself to others, they will refuse me!”) have serious implications for mental health (e.g. Bianchi, Schonfeld, & Laurent, 2015; Gao, Assink, Cipriani, & Lin, 2017) and the course of various mental disorders (e.g. Bungert et al., 2015; De Panfilis, Riva, Preti, Cabrino, & Marchesi, 2015; Kimbrel, 2008; Slavich, O’Donovan, Epel, & Kemeny, 2010), ecologically valid experimental procedures are strongly needed for further investigation.

The aim of the current study was to develop an experimental social rejection expectation paradigm (No1LikesU!), which can be used to investigate the acquisition, maintenance and modification of social rejection expectations within a highly standardised and ecologically valid procedure. In contrast to existing paradigms on social exclusion (for an overview, see Riva & Eck, 2016), No1LikesU! was especially designed to mimic key processes proposed by a recently published theoretical model on expectation development, maintenance, and modification – the so called ‘ViolEx-Model’ by Rief and colleagues (2015).

This model proposes that when entering concrete situations, individuals form situation-specific predictions about these situations (drawn from more generalised expectations) which become either (a) confirmed or (b) disconfirmed by experience. While repeated expectation confirmations should stabilise or reinforce the original situation-specific prediction (or respectively, the underlying generalised expectation), repeated expectation ‘violations’ should entail its modification (Gollwitzer, Thorwart, & Meissner, 2018; Rief et al., 2015).

Following the predications of the model, we hypothesise that (1) repeatedly exposing healthy individuals to situation-specific experiences of social rejection will increase levels of social rejection expectations over time. Consistent with the ViolEx-Model, we further hypothesise that (2) repeatedly exposing healthy individuals with increased levels of social rejection expectations to situation-specific experiences of social rejection (‘Stabilisation’) vs. appreciation (‘Modification’) will lead to differential changes (i.e. to an increase vs. stabilisation) in social rejection expectation levels over time.

Method

No1LikesU! is an ecologically valid and highly standardised associative learning paradigm created to model the development, maintenance, and modification of social rejection expectations. Like the O-Cam paradigm (Godwin et al., 2014; Goodacre & Zadro, 2010), it relies on a cover story leading participants to believe that they are going to interact with real human beings via webcam. Participants in No1LikesU! are told that they are going to participate in a study investigating ‘how people socialise with and affect each other in virtual environments’. Participants pass multiple supposed ‘webcam-conferences’ (actually, realistic looking video stimuli) on a computer in which they answer personal questions to different ‘listeners’ (actually, pre-recorded and instructed confederates). Afterwards, they receive written social feedback on their self-presentation (actually, manipulated feedback that induces experiences of social rejection vs. social appreciation).

The local ethics committee (reference number 2018-36k) approved the study. All participants gave written informed consent before they started the experiment. This study was part of a parent study, which additionally investigates interventions for promoting the modification of dysfunctional expectations. In the present work, we focus on the effects of the paradigm on the development, maintenance, and modification of social rejection expectations in healthy participants.

Participants

We recruited participants via e-mail lists, flyers, and the research participation system of our university. Inclusion criteria were: (a) A minimum age of 18 years, (b) sufficient German language skills, (c) no severe visual impairment, (d) no serious physical illness, (e) no current psychological stress, (f) not in psychotherapeutic treatment, and (g) a sum score in Beck’s Depression Inventory II (BDI-II; Kühner, Bürger, Keller, & Hautzinger, 2007) ≤ 13, indicating no to minimal depressive symptoms.

Until now, a pilot sample of 31 healthy participants could be included in the study, which provides sufficient power to investigate our hypotheses (Huta, 2014). As mentioned above, recruitment based on a priori power analyses continues as we test No1likesU! within an ongoing study addressing further research questions we do not fully report here (preregistered at ‘Aspredicted’: https://aspredicted.org/g544c.pdf). Since recruitment is currently faltering for the parent study, we would like to publish our pilot results on the paradigm contrary to preregistration in order to make them accessible to the research community. Three participants had to be excluded due to technical problems with the experimental software. The final pilot dataset consisted of 28 healthy participants (82.10% female, Mage = 23.39 years, SD = 6.51, range of age = 19–51 years). Table 1 shows the demographic data of the sample.

Participants received credit points as compensation for their participation. Alternatively, they got the chance to win gift vouchers for different online shops.

Procedure

Testing sessions started with participants reading the study information and signing informed consent (see Figure 1 for an overview of the study design). Afterwards, they completed paper-pencil pre-questionnaires.

Click to enlarge
cpe.v2i2.2997-f1
Figure 1

Study Design

Research assistants checked age as well as BDI-II cut-off scores. Participants who failed the inclusion criteria received partial compensation and were fully debriefed. Participants who met the inclusion criteria received study information incorporating the cover story. To allay concerns about the authenticity of the webcam conference, participants were told that their listeners (who were announced as ‘students from an experimental internship at the university’) were instructed ‘not to talk’ during conferences for ‘methodological reasons’. Afterwards, research assistants started the paradigm on the computer and left the experimental room. The participants were fully randomised into two independent experimental conditions (group ‘Stabilisation’ vs. group ‘Modification’) and followed instructions presented on the computer screen, which guided through the paradigm.

To model key processes of the ‘ViolEx-Model’, No1LikesU! encompasses multiple trials (30) which are divided into three different experimental phases (acquisition phase, stabilisation vs. modification phase, test phase, see Figure 1).

These phases are structurally based on fear conditioning paradigms (Lissek et al., 2005; Lonsdorf et al., 2017). During the acquisition and stabilisation phase, participants repeatedly form associations between introducing themselves to strangers (conditioned stimulus, CS) and being socially rejected (unconditioned stimulus, US) resulting into situation-specific social rejection expectations (conditioned response, CR). During modification, opposing associations (CS-US’ [being socially appreciated]) are formed resulting into expectations of social appreciation. In order to enhance stability of expectations and ecological validity, No1LikesU! provides partial reinforcement (70%) within these phases. To explore the stability of the social expectations learned within the experimental paradigm, No1LikesU! ends with a test phase which did not provide written social feedback (retention test).

After completing the paradigm, research assistants entered the experimental room and provided paper-pencil post-questionnaires to check for suspiciousness about the cover story and emotional distress due to participation. Participants were then fully debriefed about the true purposes of the study and the deceptions within the experimental manipulation. Testing sessions lasted between 1.0 and 1.5 hours.

Measures

Note that we applied additional questionnaires to address further research questions in the parent study, which we do not describe here.

Situation-Specific Social Expectations

We assed situation-specific social expectations using a one-item 7-point bipolar Likert scale (social expectation rating: ‘Please indicate to what extent you expect your next listener to be interested or disinterested in you!’) ranging from -3 (maximal disinterest) to +3 (maximal interest) before each trial. Thus, lower values indicate higher social rejection expectations.

Situation-Specific Social Experience

To examine how participants actually perceived a passed webcam conference, we used a one-item 7-point bipolar Likert scale (social experience rating: ‘Please indicate to what extent you experienced interest or disinterest from your last listener!’) ranging from -3 (maximal disinterest) to +3 (maximal interest) after each trial. Thus, lower values indicate higher social rejection experiences.

Pre-Questionnaires

Depressive Symptoms

We assessed depressive symptoms using the Beck Depression Inventory II (BDI-II; Kühner et al., 2007 prior to running No1LikesU!). Participants responded to the 21 items on a 4-point scale ranging from 0 to 3. The sum score of the 21 items ranges between 0 and 63, whereby higher values indicate more depressive symptoms.

Socio-Demographics

We used a brief self-report questionnaire in order to assess demographic variables like sex, age, nationality, relationship status, educational level, employment status, and living situation.

Post-Questionnaires

Emotional Distress Due to Participation

We assessed emotional distress due to participation by asking whether participants felt impaired due to the experimental procedures (‘Do you feel impaired due to our investigation?’). Further, we applied a one-item 5-point bipolar Likert scale (‘Please indicate to what extent you feel positive or negative in this moment!’) ranging from -2 (very negative) to +2 (very positive) to assess emotional distress. Higher values indicate lower emotional distress due to participation.

Suspiciousness

In order to assess the credibility of the cover story, the video stimuli and the experimental manipulation, we asked participants whether 1) they knew any of their ‘webcam partners’, 2) what they believed was the aim and purpose of the study, and 3) how they experienced the experimental procedure. Responses were rated on a 3-point Likert scale ranging from 0 ("not suspicious at all") to 2 ("doubted the authenticity of the webcam conferences").

Apparatus and Stimuli

Participants were seated in front of a computer with an external microphone and a webcam connected to the computer. The paradigm, including instructions, video stimuli, and social feedback, was presented on the computer screen. Participants used a mouse to interact with the computer. Video stimuli were pre-recorded with 30 volunteers (15 male, 15 female, age: 25 – 35). Volunteers were instructed to express nonverbal cues of either social rejection or social appreciation (see Figure 2). We produced two sequences of each volunteer resulting into 30 sequences of social rejection and 30 sequences of social appreciation (50 seconds each). The nonverbal feedback during each trial was matched with the written feedback. The personal and self-related questions were adapted from various dating websites in order to promote positive self-disclosure (see Appendix A in the Supplementary Materials). The video stimuli as well as the personal questions were presented fully randomised during experimental procedure in accordance with the partial reinforcement. For each participant, video stimuli and personal questions were never repeated twice.

Click to enlarge
cpe.v2i2.2997-f2
Figure 2

Video Stimuli (Left: Social Appreciation, Right: Social Rejection)

Trial Sequence

Figure 3 gives an overview of the trial sequence. Each trial started with a situation-specific social expectation rating. Afterwards, participants received a personal, self-related question (e.g. ‘What are your hobbies?’) on the screen ostensibly asked by the ‘next listener’ in order to pre-set the content of the next conference. Following preparation time depicted by a countdown (20 seconds), participants received a short connection-signal on the screen (5 seconds) before the supposed ‘webcam conference’ started by showing a pre-recorded video stimulus. To ensure the authenticity of the conferences, participants were instructed to actively end conferences when they finished their self-presentation. After each conference, participants gave a situation-specific social experience rating before receiving written social feedback (e.g. ‘Your last listener found you rather uninteresting and would not like to get in touch with you again.’). This trial sequence was repeated (10 times) within each of the three experimental phases. However, written feedback was omitted in the last phase.

Click to enlarge
cpe.v2i2.2997-f3
Figure 3

Trial Sequence

Statistical Analyses

Before conducting the analyses, we checked for outliers to exclude influential data points. For each expectation rating, we calculated the Mahalanobis distance which we checked against a χ2-cut-off of α = .001. We found no influential data points.

All analyses were computed using R Studio (R Studio Team, 2015) for R (R Development Core Team, 2008). We used lme4 (Bates, Mächler, Bolker, & Walker, 2015), nlme (Kuznetsova, Brockhoff, & Christensen, 2017), blme (Chung, Rabe-Hesketh, Dorie, Gelman, & Liu, 2013), and lmerTest (Kuznetsova et al., 2017) to perform a hierarchical mixed effects analysis of the relationship between social expectations, measuring time and experimental condition. Since the times at which expectations were measured are separable into the three phases, we defined a contrast matrix for Time, which accounted for the nested data structure. We used the contrast matrix for Time as a Level-1-fixed effect, and group as a Level-3-fixed effect (including the interaction term). As random effect, we implemented intercepts for participants (Level 2). We checked homoscedasticity and normality via the residual plots, which always showed expected patterns. We obtained p-values by likelihood ratio tests, testing the model with the additional level effect against the model without the additional level effect.

Subsequently, we analysed the phases individually to estimate effect sizes for each phase effect. We used linear models to investigate the relationship between social expectations and group affiliation. We entered Group as fixed effect. We inspected the residual plot to check homoscedasticity and normality. Again, all plots showed patterns as expected. For all analyses, we applied sum contrasts to calculate intercepts and slopes.

Results

Sample Characteristics

Participants were predominantly young (Mage = 23.39, SD = 6.51), female (82.14%) and well-educated (100% general qualification for university entrance). The mean BDI-II sum score was 4.54 (SD = 3.26), indicating that no participant exceeded the clinical threshold of depressive symptoms (Kühner et al., 2007). Table 1 gives an overview of the sample characteristics. There were no significant differences between the experimental conditions in any of the assessed variables.

Table 1

Sample Characteristics

Variable Stabilisation
(n = 14)
Modification
(n = 14)
Difference between experimental conditions
Age in years, M (SD) 21.79 (3.02) 25.00 (8.57) t (26) = 1.32, p = .20
Sex, N (%) χ2 = 2.19, p = .14
Male 4 (28.57) 1 (7.14)
Female 10 (71.43) 13 (92.86)
Nationality, N (%) χ2 = 0.37, p = .54
German 13 (92.86) 12 (85.71)
Other 1 (7.14) 2 (14.29)
Romantic relationship, N (%) χ2 = 1.29, p = .26
Yes 5 (35.71) 8 (57.14)
No 9 (64.29) 6 (42.86)
Living situation, N (%)a χ2 = 0.01, p = .94
Living alone 2 (14.29) 2 (15.38)
Living with others 12 (85.71) 11 (84.62)
Educational level, N (%) χ2 = 1.71, p = .19
University degree 2 (14.29) 5 (35.71)
No university degree 12 (85.71) 9 (64.29)
Employment status, N (%) χ2 = 1.47, p = .23
Employed 6 (42.86) 3 (21.43)
Not employed 8 (57.14) 11 (78.57)
BDI-II sum-score, M (SD) 4.86 (3.44) 4.21 (3.17) t (26) = - 0.52, p = .61
MSER before first trial, M (SD) 3.86 (1.29) 4.21 (1.12 t (26) = 0.78, p = .44
Emotional distress after participation, M (SD) 3.21 (0.70) 3.57 (0.65) t (26) = 1.40, p = .17

Note. BDI-II = Beck Depression Inventory II; MSER = Mean social expectation rating.

aOne missing data point.

Manipulation Check for the Nonverbal Social Feedback

We investigated whether the nonverbal social feedback (rejection vs. appreciation) displayed in the videos affected the situation-specific social experience ratings of the supposed webcam conferences. Participants provided these ratings after each conference and before receiving written social feedback.

First, we performed a mixed ANOVA using a linear model of the mean social experience ratings as a function of Group (between factor) and Time (within factor) using Greenhouse-Geisser correction. We found a significant interaction of Group and Time (F(1, 33) = 5.09, p = .023) as well as a significant main effect for Group (F(1, 26) = 4.68, p = .040), and Time (F(1, 33) = 6.80, p = .009).

Next, we performed post-hoc analyses and pairwise comparisons to further analyse the significant interaction effect.

The Bonferroni adjusted p-values suggest that the main effect of Group was significant during modification vs. stabilisation phase (F(1, 26) = 11.33, p = .006) but not during acquisition phase (F(1, 26) = 2.46, p = .387), and test phase (F(1, 26) = 0.64, p = 1.000). Pairwise comparisons showed that the mean social experience rating between group ‘Stabilisation’ and group ‘Modification’ differed only during modification vs. stabilisation phase (p = .002) when differential nonverbal social feedback was applied (70% social rejection feedback in group ‘Stabilisation’ vs. 70% social appreciation feedback in group ‘Modification’). As expected, group ‘Modification’ (M = 3.53, SD = 0.64) showed higher social experience ratings than group ‘Stabilisation’ (M = 2.77, SD = 0.55), indicating more perceived social appreciation.

Regarding the main effect of Time, the Bonferroni adjusted p-values suggested significant differences for group ‘Modification’(F(1, 16) = 8.26, p = .014), but not for group ‘Stabilisation’ (F(1,16) = 4.56, p = .080). Pairwise comparisons revealed differences in mean social experience rating within group ‘Modification’ between Acquisition Phase (M = 3.07, SD = 0.72) and Modification vs. Stabilisation Phase (M = 3.53, SD = 0.64) as well as between modification vs. stabilisation phase and Test Phase (M = 3.27, SD = 0.58) with modification phase having the highest social experience ratings reflecting the highest nonverbal social appreciation feedback of 70%. We found no significant differences in social experience ratings between acquisition and test phase. These results indicate that the participants experienced the nonverbal social feedback as intended.

Main Analyses

First, we included all experimental phases in one statistical model and investigated changes in social expectation ratings across the course of the experiment. Therefore, we performed a multilevel mixed effect multinomial linear regression on the social expectation ratings as a function of Group and Time (i.e. the contrast matrix of individual social expectation ratings nested in each phase). Time therefore consists of three variables each representing an experimental phase (acquisition phase, modification vs. stabilisation phase, test phase). Unless otherwise stated, we used the standard bound optimisation by quadratic approximation (BOBYQA) optimisation for the models. We calculated the linear regression of the social expectation ratings as a function of Time (Level 1). We then subsequently added the next-level effects until arriving at the full model including Time (Level 1), random intercept for participant (Level 2), and Group with interaction term for Time (Level 3). We compared mixed-effects models using likelihood ratio tests. Here, we will describe the results of the Level-3-model, the results for the Level-1- and Level-2-models can be found in the Supplementary Material. Figure 4 shows the course of the mean social expectation ratings across all phases of the experiment.

Click to enlarge
cpe.v2i2.2997-f4
Figure 4

Mean Social Expectation Rating Across All Experimental Phases as a Function of Experimental Condition

Note. Error bars indicate ± 1 SE.

The Level-3-model revealed no significant Group x Acquisition Phase interaction (β = -.00, t = -0.05, p = .585) but a trend for the Group x Test Phase interaction (β = -.02, t = -1.96, p = .050) as well as a significant interaction for Group x Modification vs. Stabilisation Phase (β = .02, t = 2.12, p = .034) in accordance with our hypotheses. Also, we found a main effect for Group (β = .15, t = 2.00, p = .046), Acquisition Phase (β = -.06, t = -3.61, p < .001), and Test Phase (β = .04, t = 2.40, p = .016), but not for Modification vs. Stabilisation Phase (β = -.00, t = -0.5, p = .572). In other words, there were no significant group differences in social expectation ratings during acquisition phase but during stabilisation vs. modification phase and test phase (retention test), whereby participants in group ‘Stabilisation’ showed higher social rejection ratings than participants in group ‘Modification’. Also, social rejection ratings significantly increased during acquisition phase and slightly decreased during test phase for both groups. The non-significant main effect for Stabilisation vs. Modification Phase can be explained with the opposing effect of the groups on social expectation ratings due to the inverted reinforcement rates.

Table 2 shows the model comparisons for the hierarchical linear regression. The models were sequentially tested against the previous models.

Table 2

Analysis of Variance for the Hierarchical Linear Regression Models

Model AIC χ2 χdf p
Level 2 (random effect for participant) 2249.7
Level 3 (fixed effect for group) 2243.8 13.87 4 .007

Note. AIC = Akaike information criterion.

Individual Phases

Next, we used MANOVA tests to investigate the effect of Group on the social expectation ratings for each phase individually to investigate the effect sizes of the changes.

Hypothesis 1: Main Effect of Acquisition Phase

We constructed a linear model of the social expectation ratings (as outcome matrix for ratings 1 to 10) as a function of Group and Baseline Social Expectation Rating (with interaction term) to exclude differential learning for the groups and to account for inter-individual influences of baseline ratings on expectation rating during acquisition. We calculated a Type-II-MANOVA using Pillai’s test statistic for the linear model. As expected, we found no significant interaction between Group and Baseline Social Expectation Rating, F(1,15) = 1.41, p = .264, and no significant main effect for Group, F(1,15) = 0.85, p = .593, but a main effect of the Baseline Social Expectation Rating, F(1,15) = 3.53, p = .013. Overall, the linear model accounted for 21% of variance (R2 = .21), which constitutes a medium effect (Ellis, 2010).

Hypothesis 2: Main Effect of Group in Stabilisation vs. Modification Phase

Following the significant interaction of Group x Stabilisation vs. Modification Phase in the main analyses, we constructed a linear model of the social expectation ratings (as outcome matrix for ratings 11 to 20) predicted by experimental condition to further investigate the main effect of Group. The Type-II-MANOVA revealed a marginally significant main effect for Group (F(1,17) = 2.38, p = .055). The model explained 19% of the variance (R2 = .19) constituting a medium effect (Ellis, 2010).

Exploratory Analysis: Stability of the Social Expectation Ratings

To test whether the social expectation ratings would remain consistent during test phase, we analysed a linear model of the social expectation ratings (outcome matrix for ratings 21 to 30) as a function of Group. As expected, the Type-II-MANOVA did not reveal a significant main effect for Group, F(1,17) = 0.88, p = .568. For test phase, the linear model accounted for 7% of the variance (R2 = .07) which constitutes a small effect (Ellis, 2010).

Suspiciousness of the Cover Story

Additionally, we analysed suspiciousness of the cover story. Seven participants reported doubts about the authenticity of the webcam conferences, six reported that they felt something ‘was off’ while 15 participants found nothing wrong with the webcam conferences. Further, three participants knew some of their ‘webcam partners’. However, a sensitivity analysis excluding all suspicious participants did not reveal significant differences in the result patterns. Therefore, we based our results on the whole sample.

Discussion

While social rejection expectations play a crucial role in mental health, experimental research on the processes of how these expectations develop, maintain, and change is currently lacking. Our study addresses this gap by providing an ecologically valid and highly standardised experimental paradigm to investigate the acquisition, maintenance, and modification of situation-specific social rejection expectations in healthy samples. Results indicate, that this paradigm can be used to successfully induce (Hypothesis 1) as well as differentially change (Hypothesis 2) situation-specific social rejection expectations in healthy participants as a function of social feedback (social rejection vs. social appreciation). Altogether these results are consistent with the predictions drawn from the ‘ViolEx-Model’, which assumes modification of expectations after experiencing disconfirming results (e.g. positive social feedback after negative social feedback) as well as stabilisation of expectations after experiencing confirming results (e.g. Rief et al., 2015). Further, our results are in line with previous research on expectation development, maintenance, and modification in healthy participants. For example, Liebke et al. (2018) showed that healthy participants increase (respectively reduce) expectations of social acceptance as a function of social feedback (acceptance vs. rejection). Kube, Rief, Gollwitzer, and Glombiewski (2018) as well as Kube, Kirchner, Rief, Gärtner, and Glombiewski (2019) provided similar results concerning the modification of performance-related expectations as a function of performance-related feedback. Kube, Rief, Gollwitzer, and Glombiewski (2018) showed that healthy participants modify dysfunctional task-specific performance expectations in face of positive performance feedback. Consistently, Kube, Kirchner, Rief, Gärtner, and Glombiewski (2019) found that healthy as well as depressed participants update dysfunctional task-specific performance expectations in accordance to positive vs. negative feedback.

Moreover, our results resemble basic result patterns found in fear conditioning paradigms concerning the acquisition and modification of fear (Lissek et al., 2005): Repeatedly pairing self-presentation with social rejection led to higher social rejection expectation (i.e. higher ‘contingency awareness’, Lonsdorf et al., 2017, pp. 268-269) while social rejection expectations decreased in turn when social rejection feedback was omitted. However, comparability is limited here, since social expectations formed in the real world might interfere with social expectations formed within No1LikesU! (which is different from most typical fear conditioning procedures). Concerning our test phase, results indicate no ‘return’ or ‘renewal’ of social rejection expectations which is normally a common phenomenon in classical fear conditioning ('return of fear', Lonsdorf et al., 2017, p. 260). The stability of the associations learned within stabilisation vs. modification phase might be due to partial reinforcement during this phase as occasional reinforcement seem to attenuate return of fear in human fear conditioning (Craske et al., 2014; Culver, Stevens, Fanselow, & Craske, 2018).

Limitations

Despite incorporating naturalistic stimuli, No1LikesU! does not provide dynamic social interactions. While the pre-scripted video stimuli ensure standardised experimental manipulation, these stimuli do not adapt to individual expressions of participants, threatening its external validity. Moreover, the paradigm only focuses on one specific social situation, i.e. self-disclosure in front of a stranger. Thus, investigating the generalisation of social rejection expectations to other social situations might be difficult within this paradigm. Additionally, a substantial amount of our participants seemed to be suspicious about the ‘webcam conferences’ and the social feedback we provided within No1LikesU!. While this issue could be solved at the expense of standardisation (for example by using real time interactions with confederates), problems with suspiciousness should not be overestimated within the actual procedure. Firstly, post-hoc questionnaires about the ‘aims and purposes’ of a study demand for suspiciousness by construction and therefore potentially overestimate actual suspiciousness of individuals during participation. Secondly, research on social exclusion shows that experiences of social exclusion stay impactful even if participants know that social feedback is simulated (e.g. Zadro, Williams, & Richardson, 2004). Further, we measured situation-specific social expectation only via self-report on a one-item scale. While expectations are usually assessed via self-report, more advanced self-report measures as well as multimodal indicators of social rejection expectation (e.g. avoidance behaviour) would improve validity of social rejection expectation assessment.

Further, while we incorporated general suggestions on fear conditioning paradigms, there are no clear instructions on how to set certain parameters in associative learning procedures (e.g. reinforcement rate or trial number). Thus, changing these parameters might also influence the effects of the paradigm.

Also, while we focused on contingency learning of outcome expectations, we did not include valence ratings for social rejection and social appreciation. Meta-analyses clearly show negative valence for social rejection (Gao et al., 2017), however, individual valence ratings might influence contingency learning. Outcome valence and outcome expectations might be coded differently in human brains (von Borries et al., 2013). While many brain areas associated with contingency learning seem independent of valence, some brain areas are suggested to be more strongly activated when processing positively evaluated stimuli (Bischoff-Grethe et al., 2009).

Finally, while we incorporated the concept of ‘expectation violation’ (Rief et al., 2015) in our paradigm, it could be argued that we did not provide real extinction training in our study as typically applied in fear conditioning (Lonsdorf et al., 2017). Since social rejection feedback was not only omitted but replaced by social appreciation feedback, we rather provided a ‘counterconditioning’ (de Jong, Vorage, & van den Hout, 2000) approach in group ‘Modification’.

Future Directions

No1LikesU! provides options for broad applications to investigate the acquisition, maintenance, and modification of social rejection expectations within a highly standardised and ecologically valid experimental procedure. It is adaptable to various research attempts. Future research should use No1LikesU! to identify differences in the development, maintenance, and modification of social rejection expectations between healthy and clinical samples (with special regards to patients with borderline personality disorder, social anxiety or depression). To test whether clinical samples show to be differentially more sensitive to social rejection experiences during acquisition than healthy controls and show to be less responsive to social appreciation experiences during modification, has important implications for etiological considerations and clinical treatment. On the one hand, this could call for the development of expectation-focused etiological models (with special emphasise on dysfunctional social rejection expectations as connecting link) like Kube, Siebers, et al. (2018) as well as Rief and Joormann (2019) proposed for major depression. On the other hand, these results would stress the need for carefully designed expectation-focused psychological interventions specifically targeting dysfunctional social rejection expectations through contradictory experiences like Kube, Glombiewski, and Rief (2019) elaborated for people with depressive symptoms. Further, this would extend former findings on the ‘ViolEx-Model’ and clarify whether expectations of social rejection should be especially targeted in clinical practice. In order to develop proper interventions, researchers should apply No1LikesU! to investigate whether different interventions on informational processing (e.g. verbalisation, functional attention management) improve the modification of social rejection expectations in face of expectation violations. Here, it would also be of interest to investigate behavioural changes in participants (healthy participants as well as clinical samples) following social appreciation vs. social rejection feedback. This could provide further insight in behavioural expressions of social rejection expectations, which might also consolidate or even reinforce social rejection expectations.

From an ethical point of view, screening for and treatment of emotional distress produced by the paradigm should be enhanced when investigating clinical samples but also healthy controls. Researchers should provide extended debriefing and emotional aftercare by trained psychotherapists in order to prevent clinical subjects from transferring negative social experiences from the paradigm to their real life. Further, they should integrate phases of repeated positive social experiences at the end of their experiments by default in order to compensate for negative social experiences.

Conclusion

No1LikesU! is an ecologically valid and highly standardised experimental paradigm to investigate the development, maintenance, and modification of social rejection expectations. Participants pass multiple short ‘webcam-conferences’ (video stimuli) in which they answer personal questions to different ‘listeners’ (confederates). Afterwards, they receive manipulated social feedback on their self-presentation. Our results suggest that researcher can use No1LikesU! to induce and alter social rejection expectations in healthy participants. Future research should focus on differences in the acquisition, maintenance, and modification of social rejection expectations between healthy and clinical samples. Additionally, incorporating interventions on expectation violation processing might improve the modification of social rejection expectations with implications for clinical treatment.

Funding

The authors have no funding to report.

Competing Interests

Winfried Rief is Editor-in-Chief of Clinical Psychology in Europe but played no editorial role for this particular article. Apart from that, the authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Acknowledgments

We thank René Herbstreit for providing technical support with programming the paradigm.

Supplementary Materials

The supplementary material contains an overview of the 30 questions used in the No1LikesU! paradigm (Appendix A). Questions were adapted from various dating websites to promote positive self-disclosure. Appendix B provides the results of the Level-1- and Level-2-mixed effects models within the multilevel mixed effect multinomial linear regression (for access, see Index of Supplementary Materials below):

Index of Supplementary Materials

  • D’Astolfo, L., Kirchner, L., & Rief, W. (2020). Supplementary materials to "No1LikesU! – A pilot study on an ecologically valid and highly standardised experimental paradigm to investigate social rejection expectations and their modification". PsychOpen. https://doi.org/10.23668/psycharchives.3082

References

  • Bates, D., Mächler, M., Bolker, B., & Walker, S. (2015). Fitting linear mixed-effects models using lme4. Journal of Statistical Software, 67(1), 1-48. https://doi.org/10.18637/jss.v067.i01

  • Bianchi, R., Schonfeld, I. S., & Laurent, E. (2015). Interpersonal rejection sensitivity predicts burnout: A prospective study. Personality and Individual Differences, 75, 216-219. https://doi.org/10.1016/j.paid.2014.11.043

  • Bischoff-Grethe, A., Hazeltine, E., Bergren, L., Ivry, R. B., & Grafton, S. T. (2009). The influence of feedback valence in associative learning. NeuroImage, 44(1), 243-251. https://doi.org/10.1016/j.neuroimage.2008.08.038

  • Bungert, M., Liebke, L., Thome, J., Haeussler, K., Bohus, M., & Lis, S. (2015). Rejection sensitivity and symptom severity in patients with borderline personality disorder: Effects of childhood maltreatment and self-esteem. Borderline Personality Disorder and Emotion Dysregulation, 2(1), Article 4. https://doi.org/10.1186/s40479-015-0025-x

  • Chung, Y., Rabe-Hesketh, S., Dorie, V., Gelman, A., & Liu, J. (2013). A nondegenerate penalized likelihood estimator for variance parameters in multilevel models. Psychometrika, 78(4), 685-709. https://doi.org/10.1007/s11336-013-9328-2

  • Constantino, M. J., Vîslă, A., Coyne, A. E., & Boswell, J. F. (2018). A meta-analysis of the association between patients’ early treatment outcome expectation and their posttreatment outcomes. Psychotherapy, 55(4), 473-485. https://doi.org/10.1037/pst0000169

  • Craske, M. G., Treanor, M., Conway, C. C., Zbozinek, T., & Vervliet, B. (2014). Maximizing exposure therapy: An inhibitory learning approach. Behaviour Research and Therapy, 58, 10-23. https://doi.org/10.1016/j.brat.2014.04.006

  • Culver, N. C., Stevens, S., Fanselow, M. S., & Craske, M. G. (2018). Building physiological toughness: Some aversive events during extinction may attenuate return of fear. Journal of Behavior Therapy and Experimental Psychiatry, 58, 18-28. https://doi.org/10.1016/j.jbtep.2017.07.003

  • Davidson, R. J., Marshall, J. R., Tomarken, A. J., & Henriques, J. B. (2000). While a phobic waits: Regional brain electrical and autonomic activity in social phobics during anticipation of public speaking. Biological Psychiatry, 47(2), 85-95. https://doi.org/10.1016/S0006-3223(99)00222-X

  • de Jong, P. J., Vorage, I., & van den Hout, M. A. (2000). Counterconditioning in the treatment of spider phobia: Effects on disgust, fear and valence. Behaviour Research and Therapy, 38(11), 1055-1069. https://doi.org/10.1016/S0005-7967(99)00135-7

  • De Panfilis, C., Riva, P., Preti, E., Cabrino, C., & Marchesi, C. (2015). When social inclusion is not enough: Implicit expectations of extreme inclusion in borderline personality disorder. Personality Disorders, 6(4), 301-309. https://doi.org/10.1037/per0000132

  • Ellis, P. D. (2010). The essential guide to effect sizes: Statistical power, meta-analysis, and the interpretation of research results. Cambridge, United Kingdom: Cambridge University Press.

  • Gao, S., Assink, M., Cipriani, A., & Lin, K. (2017). Associations between rejection sensitivity and mental health outcomes: A meta-analytic review. Clinical Psychology Review, 57(August), 59-74. https://doi.org/10.1016/j.cpr.2017.08.007

  • Godwin, A., MacNevin, G., Zadro, L., Iannuzzelli, R., Weston, S., Gonsalkorale, K., & Devine, P. (2014). Are all ostracism experiences equal? A comparison of the autobiographical recall, Cyberball, and O-Cam paradigms. Behavior Research Methods, 46(3), 660-667. https://doi.org/10.3758/s13428-013-0408-0

  • Gollwitzer, M., Thorwart, A., & Meissner, K. (2018). Editorial: Psychological responses to violations of expectations. Frontiers in Psychology, 8, Article 2357. https://doi.org/10.3389/fpsyg.2017.02357

  • Goodacre, R., & Zadro, L. (2010). O-Cam: A new paradigm for investigating the effects of ostracism. Behavior Research Methods, 42(3), 768-774. https://doi.org/10.3758/BRM.42.3.768

  • Greenberg, R. P., Constantino, M. J., & Bruce, N. (2006). Are patient expectations still relevant for psychotherapy process and outcome? Clinical Psychology Review, 26(6), 657-678. https://doi.org/10.1016/j.cpr.2005.03.002

  • Huta, V. (2014). When to use hierarchical linear modeling. The Quantitative Methods for Psychology, 10(1), 13-28. https://doi.org/10.20982/tqmp.10.1.p013

  • Jepma, M., Koban, L., van Doorn, J., Jones, M., & Wager, T. D. (2018). Behavioural and neural evidence for self-reinforcing expectancy effects on pain. Nature Human Behaviour, 2(11), 838-855. https://doi.org/10.1038/s41562-018-0455-8

  • Kelly, G. A. (1977). Personal construct theory and the psychotherapeutic interview. Cognitive Therapy and Research, 1(4), 355-362. https://doi.org/10.1007/BF01663999

  • Kimbrel, N. A. (2008). A model of the development and maintenance of generalized social phobia. Clinical Psychology Review, 28(4), 592-612. https://doi.org/10.1016/j.cpr.2007.08.003

  • Krypotos, A.-M. (2015). Avoidance learning: A review of theoretical models and recent developments. Frontiers in Behavioral Neuroscience, 9, Article 189. https://doi.org/10.3389/fnbeh.2015.00189

  • Kube, T., Glombiewski, J. A., & Rief, W. (2019). Erwartungsfokussierte psychotherapeutische Interventionen bei Personen mit depressiver Symptomatik. Verhaltenstherapie, 29(4), 281-291. https://doi.org/10.1159/000496944

  • Kube, T., Kirchner, L., Rief, W., Gärtner, T., & Glombiewski, J. A. (2019). Belief updating in depression is not related to increased sensitivity to unexpectedly negative information. Behaviour Research and Therapy, 123, Article 103509. https://doi.org/10.1016/j.brat.2019.103509

  • Kube, T., Rief, W., & Glombiewski, J. A. (2017). On the maintenance of expectations in major depression – Investigating a neglected phenomenon. Frontiers in Psychology, 8, Article 9. https://doi.org/10.3389/fpsyg.2017.00009

  • Kube, T., Rief, W., Gollwitzer, M., Gärtner, T., & Glombiewski, J. A. (2019). Why dysfunctional expectations in depression persist – Results from two experimental studies investigating cognitive immunization. Psychological Medicine, 49, 1532-1544. https://doi.org/10.1017/S0033291718002106

  • Kube, T., Rief, W., Gollwitzer, M., & Glombiewski, J. A. (2018). Introducing an experimental paradigm to investigate expectation change (EXPEC). Journal of Behavior Therapy and Experimental Psychiatry, 59, 92-99. https://doi.org/10.1016/j.jbtep.2017.12.002

  • Kube, T., Schwarting, R., Rozenkrantz, L., Glombiewski, J. A., & Rief, W. (2020). Distorted cognitive processes in major depression: A predictive processing perspective. Biological Psychiatry, 87(5), 388-398. https://doi.org/10.1016/j.biopsych.2019.07.017

  • Kube, T., Siebers, V. H. A., Herzog, P., Glombiewski, J. A., Doering, B. K., & Rief, W. (2018). Integrating situation-specific dysfunctional expectations and dispositional optimism into the cognitive model of depression – A path-analytic approach. Journal of Affective Disorders, 229, 199-205. https://doi.org/10.1016/j.jad.2017.12.082

  • Kühner, C., Bürger, C., Keller, F., & Hautzinger, M. (2007). Reliabilität und Validität des revidierten Beck-Depressionsinventars (BDI-II). Der Nervenarzt, 78(6), 651-656. https://doi.org/10.1007/s00115-006-2098-7

  • Kuznetsova, A., Brockhoff, P. B., & Christensen, R. H. B. (2017). lmerTest package: Tests in linear mixed effects models. Journal of Statistical Software, 82(13), 1-26. https://doi.org/10.18637/jss.v082.i13

  • Liebke, L., Koppe, G., Bungert, M., Thome, J., Hauschild, S., Defiebre, N., . . . Lis, S., (2018). Difficulties with being socially accepted: An experimental study in borderline personality disorder. Journal of Abnormal Psychology, 127(7), 670-682. https://doi.org/10.1037/abn0000373

  • Lissek, S., Powers, A. S., McClure, E. B., Phelps, E. A., Woldehawariat, G., Grillon, C., & Pine, D. S. (2005). Classical fear conditioning in the anxiety disorders: A meta-analysis. Behaviour Research and Therapy, 43(11), 1391-1424. https://doi.org/10.1016/j.brat.2004.10.007

  • Lonsdorf, T. B., Menz, M. M., Andreatta, M., Fullana, M. A., Golkar, A., Haaker, J., . . . Merz, C. J., (2017). Don’t fear ‘fear conditioning’: Methodological considerations for the design and analysis of studies on human fear acquisition, extinction, and return of fear. Neuroscience and Biobehavioral Reviews, 77, 247-285. https://doi.org/10.1016/j.neubiorev.2017.02.026

  • R Development Core Team. (2008). R: A Language and Environment for Statistical Computing (Version 3.5.1) [En, Windows software]. R Foundations for Statistical Computing, Vienna, Austria. Retrieved from http://www.R-project.org

  • Rief, W., & Glombiewski, J. A. (2016). Expectation-focused psychological interventions (EFPI). Verhaltenstherapie, 26(1), 47-54. https://doi.org/10.1159/000442374

  • Rief, W., & Glombiewski, J. A. (2017). The role of expectations in mental disorders and their treatment. World Psychiatry, 16(2), 210-211. https://doi.org/10.1002/wps.20427

  • Rief, W., Glombiewski, J. A., Gollwitzer, M., Schubö, A., Schwarting, R., & Thorwart, A. (2015). Expectancies as core features of mental disorders. Current Opinion in Psychiatry, 28(5), 378-385. https://doi.org/10.1097/YCO.0000000000000184

  • Rief, W., & Joormann, J. (2019). Revisiting the cognitive model of depression: The role of expectations. Clinical Psychology in Europe, 1(1), Article e32605. https://doi.org/10.32872/cpe.v1i1.32605

  • Riva, P., & Eck, J. (Eds.). (2016). Social exclusion: Psychological approaches to understanding and reducing its impact. https://doi.org/10.1007/978-3-319-33033-4

  • R Studio Team. (2015). RSTudio: Integrated Development Environment for R (Version 1.1.456) [En; Computer software]. Retrieved from http://www.rstudio.com

  • Slavich, G. M., O’Donovan, A., Epel, E. S., & Kemeny, M. E. (2010). Black sheep get the blues: A psychobiological model of social rejection and depression. Neuroscience and Biobehavioral Reviews, 35(1), 39-45. https://doi.org/10.1016/j.neubiorev.2010.01.003

  • von Borries, A. K. L., Verkes, R. J., Bulten, B. H., Cools, R., & de Bruijn, E. R. A. (2013). Feedback-related negativity codes outcome valence, but not outcome expectancy, during reversal learning. Cognitive, Affective & Behavioral Neuroscience, 13(4), 737-746. https://doi.org/10.3758/s13415-013-0150-1

  • Zadro, L., Williams, K. D., & Richardson, R. (2004). How low can you go? Ostracism by a computer is sufficient to lower self-reported levels of belonging, control, self-esteem, and meaningful existence. Journal of Experimental Social Psychology, 40(4), 560-567. https://doi.org/10.1016/j.jesp.2003.11.006