Guest post: So you rationalize

Originally a comment by Bjarte Foshaug on Never mind Ukraine what about trans people?

It’s probably not helpful to make this about intelligence. I have been interested in cults for a while now*, and one particularly pernicious myth is that only weak or stupid people (or at the very least people who suffer from other major problems) join cults, when in fact cults are usually not interested in “damaged goods”: They are mainly interested in strong, healthy, intelligent, highly functional people who can go out there and recruit others (not a simple task!) and put down countless hours of voluntary work (including some highly specialized tasks that require great skill and competence) for the cults. In fact, I seem to remember former cult-member turned anti-cult activist and exit-counselor Steven Hassan once saying that when he was recruiting for the Moonies back in the 1970s, the ideal recruit was someone who thought they were too clever to be recruited by a cult. So, at the risk of sounding like a tinfoil-hat-wearing conspiracy nut, that’s what they (i.e. cult recruiters) want you to think. It’s a mindset that only works in the cults favor and to your disadvantage.

It’s not just that being that overconfident means your guard is down and you’re less vigilant. But, perhaps more importantly, if you’re that invested in your self-image as too clever to be recruited by a cult, then, if the cult can just get you to make some small concessions (perhaps in your sleep-deprived state at four o clock in the morning after hours of relentless guilt-tripping and peer-pressure), you are that much more prone to rationalize it. The idea that perhaps you weren’t too clever after all simply doesn’t compute (think “Syntax error”, think “This program has performed an illegal operation and is shutting down”, think the “Blue screen of death”), so if you did make those concessions it had to be the smart, rational, clever thing to do: “Only a weak-minded dolt could be persuaded to make such concessions because of peer pressure and simple sleazy sales-techniques. But I’m not a weak-minded dolt, and I did make those concessions. Therefore it had to be the smart, rational, clever thing to do!”

So you rationalize, i.e. you come up with some spurious, after the fact justification for why making those concessions were the smart, rational, clever thing to do. And of course, once made, those rationalizations don’t just exist in a vacuum: They now become part of the lens through which you view every other question. The same rationalizations used to justify concessions a,b,c make it very difficult to resist concessions d,e,f without looking inconsistent and hypocritical even to yourself (practically the definition of cognitive dissonance). And if the inconsistency and hypocrisy is not immediately obvious to you, you can be damned sure the cult leader (as well as every other person in the room) is going to point it out to you: “We didn’t force you to make these concessions! You have agreed that this is the right way to look at it! These are your own words! By your own logic, you should be making concessions d,e,f, and yet you won’t? I see… so that’s what your word is really worth etc.. etc…”

So you get caught in the logic of your own rationalizations (what some have called a “justification spiral”): Going back and admitting you shouldn’t have made concessions a,b,c leads to cognitive dissonance (i.e. “syntax error”/”illegal operation”/”Blue screen of death”), but staying where you are and going no further leads to charges of inconsistency and hypocrisy and hence more cognitive dissonance. The only way to go is forward, and so you make concessions d,e,f which, by the same logic, make it very hard to resist concessions g,h,i etc… etc… In the end, by the time you get to x,y,x, even forcing Kool-Aid mixed with cyanide down your children’s throats with syringes before drinking it yourself may appear less unacceptable than admitting to yourself “I have dedicated my life to an unworthy cause and a lie. And not only that, I have recruited others, and they are now in this same mess because of me. I have told malicious lies about others for telling the truth about the vicious cult I’m in. I have done inexcusable things and gotten my hands irredeemably dirty, all in the service of a lying megalomaniac, a psychopath, and a monster.” There is more too it, but ultimately I think this is how you get caught. This is when the cult owns you.

I think highly educated and intelligent people are often the easiest people to recruit, in part precisely because they think they’re too smart to be recruited, but also because their intelligence makes them even better at rationalization (according to Joachim Fest the one truly brilliant mind of the 3rd Reich was Josef Goebbels). Even back in my movement skeptic days I thought skeptics tended to over-emphasize logical fallacies and under-emphasize heuristics and biases, cognitive dissonance and rationalization, motivated reasoning and wishful thinking etc. It always seemed to be implicitly assumed that those things were limited to the “true believers” while skeptics were immune to that kind of thing. If you’re that surprised that people like Solnit and Myers could be persuaded to drink the Kool-Aid, it might mean it’s time to look closer at some of your own assumptions.

* I recently finished reading Tim Reiterman’s biography of Jim Jones The Raven. A real world horror-story if ever there was one!

** The cult Aum Shinrikyo, infamous for the 1995 sarin gas attack on the Tokyo subway system, disproportionally recruited scientists.

31 Responses to “Guest post: So you rationalize”