Linkoramas are getting rarer these days mostly because I tweet most articles. But I will still be occasionally posting something more long-form.
To wit:
Linkoramas are getting rarer these days mostly because I tweet most articles. But I will still be occasionally posting something more long-form.
To wit:
I’m not going to call this mathematical malpractice because I don’t think it’s been reviewed or published yet. But the way the study is quoted in the press makes me highly dubious of its conclusions:
There are approximately 7,500 child hospitalizations and 500 in-hospital deaths each year due to injuries sustained from guns. In an abstract presented Oct. 27 at the American Academy of Pediatrics (AAP) National Conference and Exhibition in Orlando, researchers also identified a link between the percentage of homes with guns and the prevalence of child gunshot injuries.
In “United States Gunshot Violence—Disturbing Trends,” researchers reviewed statistics from the Kids’ Inpatient Database (KID) from 1997, 2000, 2003, 2006 and 2009 (for a total of 36 million pediatric hospital admissions), and estimated state household gun ownership using the most recent Behavioral Risk Factor Surveillance System data (2004).
The study found that approximately 7,500 children are admitted to the hospital for the treatment of injuries sustained from guns each year, and more than 500 children die during hospital admission from these injuries. Between 1997 and 2009, hospitalizations from gunshot wounds increased from 4,270 to 7,730, and in-hospital deaths from 317 to 503.
Several things that raise alarm bells:
I’m not here to slander anyone’s work. They may already have addressed the points I raise above. My read is that this is an abstract, not a refereed paper. So all I can do is point out the obvious pitfalls that might be causing this abstract to contradict everything else we know about violent crime. The gun control side, as I have documented on this blog, has a history of twisting the stats, sometimes unintentionally. And the media have a tendency to exaggerate the results of tentative early studies when it suits their narrative.
(The gun control side also has a history of outright fraud but I am very dubious that any fraud is occurring here because it would be too easy to check. They are using a public database, not proprietary data.)
There’s also the Scientific Peter Principle to consider here. If you hear of a study with startling results, it is most likely to be erroneous. That goes doubly so for unrefereed abstracts presented at conferences. The reason is that errors and biases almost always give you unexpected results. For veteran scientists, that’s often how you spot biases but even the best scientists can be fooled. That this study indicates a massive increase in violence at a time when every other study indicates that violence is falling (as is gun ownership) causes me to be concerned that something is wrong.
Two things I would place small bets on. Within a few months, this study will be shown to be flawed in some way and its conclusions toned down. And for the next ten years, the initial abstract will be quoted by gun control advocates as proof of their position (e.g., the selective quoting of Mother Jones).
Time to clear out a few things I don’t have time to write lengthy posts about.
You know, you could probably cut out a career in responding to Mother Jones twisting and distorting of data from gun deaths. Today has another wonderful example. Hopping on the rather hysterical claim that gun deaths are close to exceeding traffic deaths, they look at it at a state by state level and conclude that “It’s little surprise that many of these states—including Alaska, Arizona, Colorado, Indiana, Utah, and Virginia—are notorious for lax gun laws.”
Look at the map. Then look at this one which shows the Brady Campaign’s scorecard for state laws on guns. The states were gun deaths exceed traffic deaths are Alaska (Bradley score 0), Washington (48), Oregon (38), California (81!!), Nevada (5), Utah (0), Arizona (0), Colorado (15), Missouri (4), Illinois (35), Louisiana (2), Michigan (25), Ohio (7) and Virginia (12). Of the 14 states, half have Brady scores over 12 and California has the most restrictive gun laws in the nation.
Going by rate of gun ownership, the states are Alaska (3rd highest gun ownership rate in nation), Washington (33), Oregon (28), California (44), Nevada (38), Utah (16), Arizona (32), Colorado (36), Missouri (15), Illinois (43), Louisiana (13), Michigan (27), Ohio (37) and Virginia (35). In other words, the states where traffic deaths exceed gun death are just as likely to have a low gun ownership rate as a high one.
Oops.
Moreover, the entire “guns are killing more than cars” meme is garbage to begin with. Gun deaths, as I have said in every single post on this subject, have fallen over the last twenty years. The thing is that traffic deaths have fallen even faster. The gun grabbers might have had a point back in 1991, when we had a spike in gun deaths that caused them to almost exceed traffic deaths. But they don’t now because both rates are down, way down. Traffic fatalities, in particular, plunged dramatically in the mid-00’s.
A real analysis of the data would look at both factors to see if better drunk driving laws or seatbelt laws or whatever are also playing a factor here. But Mother Jones isn’t interested in that (for the moment). What they are interested in is stoking panic about guns.
(Notice also that MJ illustrates their graph with a picture of an assault rifle, even though these are responsibly for a tiny number of gun deaths.)
Mother Jones, not content with having running one of the more bogus studies on mass shootings (for which they boast about winning an award from Ithaca College), is crowing again about a new study out of Texas State. They claim that the study shows that mass shooting are rising, that available guns are the reason and that civilians never stop shootings.
It’s too bad they didn’t read the paper too carefully. Because it supports none of those conclusions.
So, yeah. They’re still playing with tiny numbers and tiny ranges of data to draw unsupportable conclusions. To be fair, the authors of the study are a bit more circumspect in their analysis, which is focused on training for law enforcement in dealing with active shooter situations. But Mother Jones never feels under any compulsion to question their conclusions.
(H/T: Christopher Mason)
Update: You might wonder why I’m on about this subject. The reason is that I think almost any analysis of mass shootings is deliberately misleading. Over the last twenty years, gun homicides have declined 40% (PDF) and gun violence by 70%. This is the real data. This is what we should be paying attention to. By diverting our attention to these horrific mass killings, Mother Jones and their ilk are focusing on about one one thousandth of the problem of gun violence because that’s the only way they can make it seem that we are in imminent danger.
The thing is, Mother Jones does acknowledge the decline in violence in other contexts, such as claiming that the crackdown on lead has been responsible for the decline in violence. So when it suits them, they’ll freely acknowledge that violent crime has plunged. But when it comes to gun control, they pick a tiny sliver of gun violence to try to pretend that it’s not. And the tell, as I noted before, is that in their gun-control articles, they do not acknowledge the overall decline of violence.
Using a fact when it suits your purposes and ignoring it when it doesn’t is pretty much the definition of hackery.
I just noticed I have about five Linkoramas lingering in my queue. So I’ll take out whole bunch here.
A few weeks ago Mother Jones, having not learned the lesson of their absurd article claiming mass shootings are on the rise, published a list of 10 Myths about guns and gun control from Dave Gilson. And I’m going to debunk their debunking again because the article represents what I believe is one of the worst sins in the field of Mathematical Malpractice: cherry-picking. As I went through this, it became obvious that MJ was not interested in the facts, really. What was motivating them was the argument. And so they picked any study — no matter how small, how biased or how old — to support their point. They frequently ignore obvious objections and biases. And they sometimes ignore larger more detailed studies in favor of the smaller ones if it will support their contention.
We see this a lot in the punditocracy, unfortunately. As Bill James said, most people use studies the way a drunk uses a lamppost — for support, not illumination. In any sufficiently advanced but difficult field of study, you will find multiple studies examining an issue. Let’s say it’s a supposed connection between watching Glee and having a heart attack. If there is, in reality, no connection between the two, you might find eight studies that show no connection, one that shows an anti-correlation and one that shows a correlation. This is fine. This is science. There are always outlier studies even if all the researchers are completely ethical and honest. The outliers fall away when your interest is the question and you look at all the evidence. But the outliers dominate the discussion from those who have an agenda.
This happens a lot in the gun debate. On both sides, really. But Mother Jones’ article is a particularly putrid example of this because that’s basically all it does: collect the cherry-picked nonsensical studies that support their anti-gun agenda. It’s quite remarkable actually; almost a clinic in how not to do research.
But here’s the one thing that really tips you off. There is one myth that Mother Jones does not debunk. It’s a myth that’s really independent of what you think of gun ownership … unless you’ve already staked part of your reputation and agenda on the myth that gun violence is increasing. In fact, all forms of violent crime have been falling for twenty years. This is, in my mind, the single most important fact in debates over crime and violence and the single most important myth to debunk.
MJ does not address this myth. They don’t even talk about it. That is a huge tell.
I think I’ve spent the entirety of this week either on the phone or having a meeting or curled up in bed with a migraine. Sigh. Some weeks are like that.
A few weeks ago, Mother Jones did a timeline of mass shootings in response to the spate of summer shootings. The defined their criteria, listed 61 incidents and pointed out, correctly, that most of them were committed with legal firearms.
The highlight is a map of mass shootings over the last thirty years. The map has some resemblance to Radley Balko’s famous map of botched law enforcement raids. But the use of a map and dots is where the resemblance ends. Balko was very clear that his list of incidents was not, in any way, definitive. And he did not try to parse his incomplete data to draw sketchy conclusions.
Mother Jones felt under no such compulsion.
This week, they’ve published an “analysis” of their data and drawn the conclusion that our society has more guns than ever and, perhaps related, more mass shootings. Below, I’ll detail why I think their “analysis” — and yes, I will keep using quotation marks for this — is useless, uninformative and flat-out wrong.