So, today is an awesome day because I finally submitted the final revisions on my doctoral dissertation in clinical psychology and uploaded the final document onto the academic interwebs. That means I AM DONE. No more research. No more school. YAYYYY!! The thing about academia is that it moves slow and it is this weird exclusive club where you need to pay money to journals to get the latest research to help guide your treatment. Pubmed and Google scholar have helped out a bit with giving mere mortals access to academic literature, but there is still quite a barrier. For that reason, I want to share with you, in normal person language, the results of my dissertation research. It’s actually pretty awesome and interesting.
I need to give a disclaimer up front. My research is an academic dissertation completed entirely by myself under the supervision of my dissertation committee. Therefore, it is has not undergone the peer review process that is the gold standard in academic journals. That said, I feel confident and enthusiastic about these results and I think that you might be too.
I have been interested in the idea of doing therapy over the Internet for a long time. In 2015, it is entirely possible to go to Google and find a service that will connect you a therapist to work with over video chat, email, or text-chat. There are also programs that will allow you access to self-help materials with support from professional clinicians. There is a ton of research out there already that indicates that treatment done over the Internet for psychological issues is just about as effective as treatment done in a traditional face-to-face setting. That’s all well and good, but the question that I wanted to answer is this: Who wants this sort of treatment?
I’ll give you the spoilers up front: people who prefer Internet-based approaches to face-to-face approaches are probably those who are more introverted, those who have negative attitudes toward receiving help from others, those who have had negative experiences with prior therapy, and those who are unable to make it to routine in-person appointments. Anxiety was another factor that differentiated the groups, but the effect was just small enough that I didn’t interpret it for the purposes of my study.
Okay, so here’s the skinny of how I did it.
Step 1: Sample
I sent out a big survey to anyone that would take it. Well, almost. I started off with my extended personal network through Facebook, Twitter, Youtube, email, word of mouth etc. Then I encouraged everyone who took the survey to share it with other people in their own networks for the chance to win an Amazon gift card. The initial group of people that responded (in one month!) was massive. In total, 3,388 people responded to the survey. Those numbers are pretty insane and I was super happy with the response.
From there, I had to do some cutting down. I only included people who were over 18 and people who lived in the United States in my analyses. This doesn’t meant that these results might not also apply to people who are under 18 or who live in different countries, I just can’t claim that they do. I also cut out people who stopped responding half way through the survey.
In the end, the sample consisted of 1404 people and was 60% female, 75% Caucasian, and the average age was about 28 years old.
Step 2: The Survey
The survey made up the entirety of my data collection, so it was pretty big. I used survey monkey to send out an online version of the survey to each participant. I first asked basic demographic information like age, gender, ethnicity, and stuff like that. I also asked about internet behavior and psychiatric history.
To measure personality factors, I used an instrument called the Big Five Inventory (BFI), which measures levels of Openness to experience, Conscientiousness, Extraversion, Agreeableness, and Neuroticism. The one that I was most interested in was extraversion. A low score on that scale would indicate that the individual is mainly introverted.
I also used an instrument called the Network Orientation Scale (NOS) to measure participants’ opinions toward receiving help from others. The NOS looks at a construct called “negative network orientation” which basically means you think that it is unwise or unsafe to get help from other people.
Levels of depression and anxiety were also looked at using some free short ratings called the Self-report Anxiety Scale (SAS) and the Self-report Depression Scale (SDS). I was mostly interested in anxiety here, but I included depression just for a better overall picture. I didn’t use these to diagnose people as being anxious or depressed, but rather to compare the levels between the different groups to see which one had higher symptom ratings.
Finally, the coolest part was that I had each person watch three short video vignettes that showed what face-to-face therapy, text-based online therapy, and online self-help looked like. After watching each video, they rated their order of preference for therapeutic approaches.
This gave me three different groups to compare: people who liked face-to-face the most, people who liked text-based online therapy the most, and those who liked online self-help the most.
Here’s an example of one of those vignettes:
Step 3: Hypotheses
Hypotheses just means my predictions about what I think is going to be shown after I complete my analyses. I thought that there were certain factors that would lend themselves to these non-traditional online approaches to mental health. For instance, I imagined that being very introverted or very anxious could potentially make the process of going out and seeking help in public difficult in and of itself. I also thought that people who have had therapy in the past, but had a negative experience with it would be more willing to give online treatment a shot. Same goes for people that feel like getting help from others is overall a bad idea. A no brainer for me was that people who can’t get to routine appointments would also see the appeal of Internet-based approaches. This doesn’t just mean people who can’t leave the house or who live in very remote areas, but also people who are traveling all the time and can’t ever be in one place consistently to make frequent appointments.
Step 4: Analyses
After cleansing the data, which basically means pull out all of the “extreme” responses and do some magic to fill in missing data points, I went ahead and statistically analyzed the data. I don’t need to bore you with the specifics here, but basically what we are looking for is differences between the three different groups that are large enough that we can’t chalk it up to chance. This is called statistical significance. So I did that process of comparing the groups and realized that there were basically no differences between the two Internet-based groups, but several areas where they were different from the face-to-face group.
Step 5: Results
The results were awesome. I had to do some very conservative statistics magic with them because with so many people in the sample, EVERYTHING looked significant. After finding some more conservative ways to look at the results, here’s what I found.
People who prefer either text-based Internet therapy or online guided self help (as compared to those who prefer traditional therapy):
- Are more introverted
- Have had negative experiences with prior therapy
- Have more negative opinions about receiving help from other people
- Are not able to routinely attend in-person meetings
Step 6: Implications
To me this is really cool and really interesting information. We have a better idea of who we should be picturing when we think of an ideal candidate for Internet-based approaches to psychological treatment. If you are someone who is described by those bullet points above and haven’t been able to give therapy a shot, consider trying out this non-traditional avenue! My argument in the paper is that this could help us professionals in the field target people who might not otherwise get help with psychological issues. I feel that it is our ethical duty as psychological professionals to help everyone get the help that they need. In this day and age, Facebook knows that so much about you that Target can put maternity advertisements on your page before you even know that you are pregnant. I say why not use those powers for good? Maybe we can dial in the analytics enough to direct advertisements and information about Internet-based treatment to people who might be willing to use it and who would otherwise get no help at all.
And that’s about it, folks! The culmination of my 5 years in graduate school summed up in one blog post. If you made it this far, thank you for reading.
One, I just had a serious grad school flash back lol AND that is an incredible sample size are you still seeing lines of data in SPSS when you close your eyes lol? Two, that is really really interesting stuff. I have had several people ask if I would be willing to do video chat with them on weeks they can’t make it to the office. I have always been willing but at this point there are confidentiality and insurance issues that have gotten in the way of that being a possibility. Hopefully that will become less so as time goes on. Thanks for sharing!!!
There’s some good stuff on the APA website about that. It shouldn’t be a problem if you are in the same state.
I’ll have to do some more checking on that. I do know there are a couple insurance companies at least here that get their undies in a bunch about providing services only the authorized site which is my office (annoying)
I suppose a different option would be to do a lower cost full fee session remotely every so often to circumvent insurance all together.
Someday my goals is to circumvent insurance all together in every situation lol. As I’m sure you know they are such a pain. Iowa just privatized their medicaid program so I have been dealing with contracts etc all day all so I can keep getting their lousy reimbursement rate. But that is a total disgression from anything relevant but may explain why I’m a little grumpy this evening :). I am sure things will progress in the near future around here. I have noticed that new trends tend to start on the coasts and slowly trickle their way to us in Iowa. In the mean time I’ll just be creative 😀
I’m interested in your outliers. I wonder if it would be just as interesting if, say, those who were extremely low on anxiety and depression (or vice versa) had any leanings towards online therapy? This may be a lack of n thing, though–just something I’ve been recently interested in (i.e., understanding the high of the highs and the low of the lows). Additionally, what about the other personality dimensions (particularly conscientiousness) in regards to online therapy? I imagine high conscientiousness was related to willingness to seek therapy in the first place?
Thanks for sharing, Robert!
Well there was a trend toward higher anxiety and higher depression having a preference for the online approaches, I just didn’t interpret it because the effect size was just a little below the cutoff that I used. Same went for some of the other personality dimensions. You can see what I mean in the picture below.
There were significant differences in agreeableness (higher in face-to-face than online self-help) and neuroticism (higher in text-based than both of the others) that were below the 0.4 effect size cut off that I imposed.
+100 cool points for effect sizes (my stats professor used to quote Rosnow/Rosenthal: “Surely, God loves the .06 nearly as much as the .05.” to get us to use effect sizes in conjunction with significance tests), and your APA formatting is on point.
I wonder what it would look like if you controlled for NOS. I mean, I get that your point was to show that there were differences, but I’m just spitballing here–if you controlled for whether or not they’d attend therapy, would there be any differences in personality? I’m guessing that extroversion is driving that effect due to the overlapping variance between the two, but I don’t know the therapy literature at all so I’m making things up.
[…] Also, remember my favorite self-help book, Hardcore Self-Help: F*ck Anxiety? Well, the author, Robert Duff, PhD just submitted the final revisions of his dissertation! He shares his findings on internet based therapy (in “normal person language) over at his blog. It’s really interesting! Go check it out! […]