Posts Tagged ‘Pseudoscience’

Mike’s Rule of Expertise

Sunday, February 17th, 2013

Shortly after I graduated from college, I was on a kick to try to get healthy and lose weight. It still hasn’t worked, 19 years la- … holy crap, 19 years?! … let me see … 1994 .. good God, I’m old … anyway, it still hasn’t worked 19 year later.

At one point, I tried Herbalife. This was not something I came to of my own accord. A friend’s husband was into it on the lowest tier of their multi-level marketing. I was too young and stupid to know just how idiotic herbal supplements were, so I figured “what the hell” and jumped.

It was a big mistake. The compound contained ephedra and it caused my first incident of Premature Ventricular Contractions — a common harmless arrhythmia that nevertheless is scary as hell. Some time later I tried a prescription weight loss pill that also caused PVC’s. They went away after I stopped, mostly. I still get them occasionally, most notably right after my wedding and when I haven’t been getting enough sleep. I had a full cardio workup six years ago and everything looks fine. But I still wonder if the ephedra did any permanent damage.

The thing is that I’m not normally into that sort of thing. But it was sold to me because I wasn’t terribly familiar with high-pressure marketing techniques and certainly didn’t expect them from a friend’s husband. I’ve since … well not wised up, exactly. I’ve gotten confident enough to tell people to fuck off. In fact, high pressure sales pitches are the surest way to drive me away. When we bought our first home, I literally walked out on people who tried to get me to buy right then with “if you buy right now” incentives. The home we bought was sold in a low-pressure way. We felt — correctly as it happened — that this reflected the salesman’s confidence in his product.

I’m rambling. Let me get to the point. Part of the sales pitch I got for Herbalife went like this:

Mike, I’m telling you, I’ve investigated all kinds of supplements. I’ve looked into everything. And I’ve researched this product really thoroughly. I wouldn’t take anything I didn’t know everything about. So trust me: this is the real deal.

Standard stuff, right? But hidden within that is something I’ve come to recognize as the mark of a shyster. If someone spends an inordinate amount of time telling you, in a vague sense, how much experience they have and how much expertise they have and how they’ve really researched this and they’ve looked at everything out there, they are, to be blunt, full of shit.

This instinct has served me well. When Neal Boortz began flogging the Fair Tax, he talked about how much research had been done and how he’d looked at every plan out there (really? every plan?). That pinged my radar and I did some research and found out that the Fair Tax had giant gaping problems (documented here). When a contractor came by and gave me a pitch about how he’d tried everything and he was the best expert, I went with someone else.

And you see this constantly in the alternative medicine crowd. Sellers and promoters will constantly tell you how extensively they’ve surveyed things, how much research they’ve done, how much experience they have and, inevitably, it turns out not to be the case.

So, in my roundabout way, here is Mike’s Rule of Expertise: Experts don’t constantly reassure you of their expertise; they simply dole out facts and data.

Let cite some good examples from my blogroll: Radley Balko doesn’t talk about what an expert he is on criminal justice matters; he tells you specifically what he’s learned, seen and read. The Bad Astronomer doesn’t talk about how much experience he has in astrophysics; he points you at research and researchers who’ve done the work. Maggie McNeill doesn’t pontificate about her extensive background in the sex industry; she links every study and opinion piece she can find. Joe Posnanski doesn’t talk about how many athletes he’s interviewed or how much Bill James likes him; he crunches the numbers, gets the quotes and presents the facts.

I’ve been to hundreds of science talks. Not one has centered around the speaker’s credentials and how they’ve explored every alternate theory. They present hypothesis, data and conclusion. The best ones acknowledge their limitations and possible alternate theories. The kind of dead certainty you will encounter in, say, a homeopathy practitioner, is minimal in any good scientist and absent in the best ones.

This is how real experts do it. Experts want you to trust the facts; con men want you to trust them.

(In a related note, I, like most astronomers, rarely affix “Ph.D.” to the end of my name unless I’m applying for a grant where the credential is required. I also only refer to myself as “Dr. Siegel” when yelling at the cable company. And the only time I’m called that at work is either as part of a running gag or when being addressed formally (grant correspondence, for example; and I usually encourage them to call me Mike). This is partially because astronomers are an informal bunch. It is also related to my time at UVa, where everyone except Ed School professors and medical doctors takes the moniker of “Mr.” and “Ms.” as a sign of respect to Mr. Jefferson.

But I also I think this flows from the same skepticism of over-credentialing. A real scientist wants you to trust the data, not them. The only academics I know who use the Ph.D. suffix or the Doctor prefix are either a) pretentious; b) medical doctors, where I think it’s appropriate, and c) women or minorities in disciplines where they have trouble being taken seriously and it’s hard to begrudge them. And anyone who refers to themselves as “Dr. Smith, Ph.D.” is almost certainly full of it.)

What brought this to my frontal lobe was a re-eruption (a few months ago now) of controversy over Sex at Dawn. I find the premise of Sex at Dawn — that humans are naturally polyamorous — interesting if flawed. But what has long bothered me is the certainty with which this supposedly scientific premise is discussed. Every time I hear Christopher Ryan speak, I feel like he’s about to sell me herbal supplements. He’s not quite as bad as my friend’s now ex-husband. He actually does know some stuff. But he seems stunningly unaware of what he doesn’t know or of what facts are inconsistent with his thesis. Is he right? Dammit, if this comes down to me reading his book, I give up.

Anyway, there is some controversy over Christopher Ryan’s credentials. I took a look at his wikipedia page and this is what I found:

He received a BA in English and American literature in 1984 and an MA and Ph.D. in psychology from Saybrook University, in San Francisco, CA twenty years later. He spent the intervening decades traveling around the world, living in unexpected places working odd jobs (e.g., gutting salmon in Alaska, teaching English to prostitutes in Bangkok and self-defense to land-reform activists in Mexico, managing commercial real-estate in New York’s Diamond District, helping Spanish physicians publish their research). Drawing upon his multi-cultural experience, Ryan’s academic research focused on trying to distinguish the human from the cultural. His doctoral dissertation analyzes the prehistoric roots of human sexuality, and was guided by the psychologist, Stanley Krippner.

Ryan has guest lectured at the University of Barcelona Medical School, consulted at various hospitals, contributed to publications ranging from Behavioral and Brain Sciences (Cambridge University Press) to a textbook used in medical schools and teaching hospitals throughout Spain and Latin America and makes frequent mass media appearances. Ryan contributes to both Psychology Today and Huffington Post.[

I read that and I heard, “I’m telling you, I’ve been all over the world and met all kinds of people and read all the papers. And this polyamory thing; this is the real deal.” Maybe Ryan is right. I’ve got an 80-book backlog right now, but I’m hoping to get to his at some point. But a Wikipedia entry filled with such a wide array of credentials combined with his “I’m such an expert” public statements make me suspect the work has flaws. And what I’ve read indicates this perception is correct. If and when I get to his book, I’ll know for sure.

(I wrote the above a couple of months ago. When I went to it today, I was reminded of a recent post at Popehat that mocked a legal spammer for doing the same thing: talking himself up as some modern-day renaissance man. Ken has a lot more experience in dealing with shyster lawyers, obviously. His approach to this is different because he gets a lot of legal spamming. But the basic tenet is the same: a real hot shot lawyer doesn’t try to wow you with his credentials.)

Mathematical Malpractice Watch: Rape Statistics

Wednesday, August 22nd, 2012

The Akin controversy has brought a lot of ugliness to light. I’ll push aside the broader political issues, which I’ve discussed on the other blog. Instead, I want to focus on a particular piece of nonsense from one of the more influential pro-Life figures, who has tried to argue that rape pregnancies are very rare.

You would think this would be straight forward. You could, for example, find rape victims and ask them if they got pregnant. And indeed, a study estimated that about 5% of rapes end in pregnancy and 32,000 fetuses are conceived in rape every year. You could also ask women getting abortions if they were raped. And indeed, Guttmacher did this and produced a lower estimate of about 10,000 or so. There is no real incentive, at this point, for women to lie about how they got pregnant. Or there are just as many reasons for them lie either way since many women are tragically ashamed of having been raped. But there is no a priori reason to suspect that either number is greatly inflated.

(The Guttmacher number seems a little better since the numbers in the former study would indicate about 640,000 rapes a year or three times what the FBI and NCVS conclude, even including the under-reporting factor. The difference is likely that Guttmacher is recent and Holmes was published in 1996, shortly after crime rates peaked. Rape rates have plunged in the last 16 years and are down about 85% over the last 30.)

But plain facts aren’t enough for some people, so John Wilke, “M. D.” has come up with a bizarre rape equivalent of the Drake equation to try to figure out how many rape babies are conceived every year and come up with a vanishingly small number.

It’s fairly easy to tear apart.


More BS Research

Saturday, September 22nd, 2007

In a study that brings back memories of the one that “proved” that a four-minute mile was impossible, a professor is claiming that steroids can increase homerun production 50-100%.

The such a study could be taken seriously beggers belief. Among other things, if such a benefit from steroids were real, home run rate would have exploded across the league and this is clearly not the case. The people who have tested positive for steroid use, including many pitchers, have not had anywhere near the power explosion this guy is guessing at.

(Although it clearly would depend on the type of hitter. You could add 4% to the speed of the balls I hit and they might just reach the outfield. Adding 4% to Barry Bonds is a different story, clearly.)