Skip to main content Skip to bottom nav

Measuring the Care Alliance

User Profile: GlenM
GlenM June 10th

Hello Crew!


I shared a post called “Care is Electricity” a couple of weeks ago. The gist is that caring for another person is therapeutic - it brings healing to them.

In the clinical world, therapists use a tool called the Session Rating Scale to measure this connection. It turns out, this tool is the single best predictor of what helps a person get better. A researcher actually did a study (worth reading) looking at listener therapeutic alliance levels right here on 7 Cups and found they were on par with professional therapist levels! I write more about this in the Care is Electricity post.

Starting tomorrow, we will begin using the Session Rating Scales in member and listener (1:1) conversations. You can read more about how the scale works here.

How it Works:

At 30 messages from the member, and then again at 100 message intervals (if it has been at least 7 days since the 30-message mark), members will see a modal that looks like this:

listener-srs-modal_1781121900.png

After the rating is submitted, both the member and the listener will see the results in their chat.

If you get a low score, remember: it is just data. It is not a grade, and it does not mean you failed as a listener in that conversation. It is simply a way for the member to let you know, in a less direct way, that they don’t feel quite understood yet. Mistakes are how we grow, so there is nothing to be ashamed of (check out my post: “We Are Not Our Mistakes”). You also have to take these ratings with a grain of salt. External factors can influence a survey - sometimes a member is just having an incredibly overwhelming day, or they may not have the words to explain exactly what felt off. Not every member will be able to give clear, helpful feedback, and that is okay. The goal is to stay open to what you can learn without taking every score personally. 

What do you do if you get a low score? (Adapted from here)

  • Step 1: Reflect and Thank.

"I notice the score on [item] is lower today. I appreciate you being honest. Can you tell me more about that?"

Stay curious. Stay grounded. Do not defend, over-explain, or debate the number.

  • Step 2: Get One Concrete Example.

Ask for a specific moment that didn't land. If they can't name it, offer gentle options: "Was it the pace? The focus? The depth?" Clarify whether the issue was the content of the chat or the way you were relating to each other.

If the member cannot explain it, you can still respond with care:

Thank you for letting me know. I’m sorry it didn’t feel quite right today. I’ll keep this in mind and try to be more supportive moving forward.

  • Step 3: Collaborate on Adjustments.

Offer two small, testable changes moving forward. More structure? Slower pacing? A different focus? Confirm what success would look like for them, and let them know you'll check in on how they're feeling about it later.

  • Step 4: Reflect with Support.

If a low score feels confusing, discouraging, or hard to understand, consider bringing it to a mentor on 7 Cups. A mentor can help you reflect on the conversation, look for possible growth points, and decide what you might try differently next time. You do not have to process the feedback alone. 

The therapeutic alliance - or what I’m calling the “Care Alliance” outside of a therapist relationship - happens with friends, family members, educators, and especially right here on 7 Cups!

Measuring this will help us better understand how the Care Alliance unfolds so we can - as individuals and a community - help people grow and heal.

Any and all questions are welcome! Please share below.

Update:

All, update! We just ran the first batch of SRS scores. Drumroll please! 

Max score is a 40 (you add all the scores). 36-40 is considered therapeutic levels / therapist parity. Right now, our listeners are scoring a 34.76, which is remarkable! The results will get more solid as more results come in, but this initial sample is significant. 

Job well done!!!

Score Averages

CategoryAverage Score
RELATIONSHIP8.79
FOCUS8.67
APPROACH8.70
OVERALL8.56
56

@GlenM

Feedback can help us reflect, adjust, and keep improving the care we offer. Looking forward to seeing how this helps strengthen the Care Alliance on 7 Cups!

User Profile: amiablePeace77
amiablePeace77 June 10th

@GlenM

I believe this is a great idea and will help everyone! Thank you so much for sharing the study, this is amazing!

User Profile: TovaCares76
TovaCares76 June 10th

@GlenM

Thank you for the update! I love the Care Alliance concept, and I'm excited to see how this feedback can help all of us grow and support each other. 

User Profile: Remina
Remina June 10th

Interesting update :)

User Profile: AffyAvo
AffyAvo June 10th

Is this separate to ratings and reviews?

If these are combined somehow, can we get more information?

2 replies
User Profile: GlenM
GlenM OP June 10th

@AffyAvo yes this is separate and will be in the chat as the modal shows up top. They won't be combined or on a person's profile. It just exists within the chat with the member and listener.

1 reply
User Profile: AffyAvo
AffyAvo June 10th

@GlenM Sounds good! I know listeners sometimes want to know how a chat is going, so this gives a way for a member to share that numerically. 

I like that the (somewhat) anonymous ratings/reviews are still an option. 

load more
load more
User Profile: sereneMango2512
sereneMango2512 June 11th

@GlenM it's an important update, specially knowing the feedback can stop us from beating the bush and actually knowing where we need to improve, so it's better for both the members and the listeners 

User Profile: Amanda84
Amanda84 June 11th

@GlenM


thank-you-thanks.gif

@GlenM

Thank you for the update💚

User Profile: JudithA
JudithA June 11th

@GlenM Thank you for sharing, this will be really helpful to us. 

User Profile: CalmRosebud
CalmRosebud June 11th

Haha, I guess I got low ratings since I just had a long-ish chat and nothing popped up of which I was aware. LOL, I guess I take it all with a grain of salt.

AI I mean.

10 replies
User Profile: GlenM
GlenM OP June 11th

@CalmRosebud I'm confirming that it is now live. You will see the ratings themselves in the chat. I'll respond back here once I get confirmation. 

9 replies
User Profile: CalmRosebud
CalmRosebud June 11th

@GlenM

It’s ok, I don’t care much about AI. lol.


Human contact is the core of 7 cups and if it ever changes, respectfully, I will bid my farewell.

8 replies
User Profile: Remina
Remina June 11th

@CalmRosebud

I don't believe that this feature is AI. From what I read, it has questions that pop up for the member after a certain amount of messages and the member answers the prompt and the listener gets to see the response and discuss it with the member. There is a bunch of human interaction still.

3 replies

@Remina @CalmRosebud yes, this is correct. No AI is involved. The Session Rating Scale is a standard tool to measure alliance and care as Glen's post outlines. 

1 reply
User Profile: CalmRosebud
CalmRosebud June 11th

Thanks, Ayusha!

load more
User Profile: CalmRosebud
CalmRosebud June 11th

Thanks, Remina!

load more
User Profile: GlenM
GlenM OP June 11th

@CalmRosebud sorry I misread this - no AI is involved. And it is live.

3 replies
User Profile: CalmRosebud
CalmRosebud June 11th

@GlenM

Thanks for clarifying this. I probably had the chat before this feature went “live.” Probably it’s useful, kind of like a temperature check during a chat to make sure it’s going ok. I’m open to trying new things.

2 replies
User Profile: Clio9876
Clio9876 June 14th

@CalmRosebud

As a member who had this survey pop up in a chat, I skipped it. That might be why you got no score. In the middle of dealing wirh emotions, I didn't want the distraction.

1 reply
User Profile: CalmRosebud
CalmRosebud June 14th

Clio— that makes perfect sense to me. Surveys are an imperfect measurement tool since during a convo there is an inherent bias the person seeking help “wants” to be helped, and the person listening “wants” to listen— it’s a golden moment. And, I’m the same as you, if I sense something is being used by management to manage me or an interaction better, let them figure that out on their time. Totally valid for you to just skip the survey.

load more
load more
load more
load more
load more
load more