Over at Grist Tom Philpott has written a few posts about the dangers of diet soda, and I’ve been acting cranky about them on Twitter. To be honest, it’s not that the posts are that bad, or even that I disagree with their gist. I tend to think that soda isn’t very good for me in general, and I avoid artificial sweeteners because (in order of decreasing importance to me) I don’t like the taste, have mostly weaned myself off sweeteners, and put at least some stock in the health case against them. So I haven’t really got a dog in this fight, other than general reactionary impulses. I am also not anxious to get into a big huge debate with Tom, because frankly he knows much more about food science than I do. Besides, he seems like a nice guy.
Still, these posts got my goat. I think it’s because they’re emblematic of a number of rhetorical tics that people use when trying to write scary stories about chemicals. And I hate that shit. The audience for that kind of thing is useless at picking or prioritizing their battles; I tend to think it leads to more anxiety, fewer vaccinated kids, and absolutely no effect on policy or health outcomes (other than those related to communicable disease, of course).
Also, I’m confident that Tom’s a smart guy, so the posts struck me as deliberately engineered linkbait, which I also dislike.
Anyway, the Twitter can of worms has been opened, so let me explain here what bugged me about these posts and made me feel that they were representative of bad online coverage of environmental toxins in general.
Cherry-picking research
This one’s easy. Confirmation bias is real (look around and you’ll see it everywhere, the joke goes). I particularly winced when I read the phrase “Italian researchers”. Admittedly, I don’t know the state of Italian biomedical research. But I do follow some alternative energy stuff, and I can tell you with confidence that that country produces more cold fusion “breakthroughs” per capita than anywhere else on earth. Plus, people smarter than me seem to think the Italian academy is a joke. But hey, if the abstract says what we want it to say…
Succumbing to this temptation is understandable, and I’ve certainly been guilty of it myself. You need to be shut up in a doctoral program for a very long time to begin to possess any kind of immunity. Frankly, I doubt that any of us are equipped to truly resist it. But it’s still irritating to be on the other side of it.
Nomenclature as indictment
Particularly infuriating. Lots of chemicals sound scary, and health writers never resist the opportunity to deploy a 5,4-methylpropylbenzepene or whatever into a laboriously recited ingredient list. But it’s meaningless. The nomenclature got a lot scarier when chemists changed how they name compounds. There were good reasons for doing this (reasons that open data evangelists would find particularly appealing!), but the change does seem to have some unfortunately profound side effects on the human mind.
Similarly, pointing to constituent elements or the chemical class to which a compound belongs is rarely illuminating. At one point in the third post Tom discusses how caramel coloring is made by denaturing starches with heat and “ammonia-based” compounds. A shout-out to something you keep under your sink next to the drain cleaner can’t help but cause alarm. But of course fertilizer is also “ammonia-based”; and nobody seems to worry much when it gets turned into protein and eaten. If you are Derek Lowe or someone like him, you can start to develop rules of thumb about the biological effects of compounds based on their structure. If you aren’t, you can’t and shouldn’t.
Tom would probably object to this characterization, as his account goes on to discuss a byproduct of the denaturing process that’s carcinogenic. I’d say that that falls under “cherry-picking research”. In truth, lots of cooking processes produce carcinogenic compounds (the process he describes is not dissimilar to how pretzels are made). Remember the scare over acrylamides in french fries and other oil-cooked carbohydrates from a few years back (or the one over the char on your steak)? Suddenly it became apparent that we were all consuming boatloads of cancer-causing chemicals! But it turned out that the situation’s more complex than that, and a study suggesting that one component of a food has shown carcinogenic effects (often only in an animal model) isn’t nearly enough evidence to justify a freakout over the food in general.
As another example, consider coffee, a beverage that Tom points to approvingly at the end of the second post. The roasting process produces a huge array of chemicals, not nearly all of which have been characterized and studied, and many of which have demonstrated carcinogenic effects (here’s a Wikipedia link, though like me you’ve probably already heard this elsewhere). But that doesn’t matter, because coffee is categorized under our semi-arbitrary “good/natural” heuristic, albeit perhaps with various qualifying words attached to it in our laughable mental medical tag cloud (parkinsons/osteoporosis/miscarriage/anemia/whatever).
Ignoring scale
Less relevant to this series of posts, admittedly, but a habitual mistake of this kind of writing. Humans are awful at understanding differences of even several orders of magnitude, and authors are even worse at bothering to convey them. For our purposes, this is a problem on two fronts: both chemical concentrations and the scale of measured health effects. All you have to do is say “there’s uranium in your drinking water!” and people will start going nuts. You know what? There almost certainly is uranium in my drinking water, and yours too. There’s nasty stuff everywhere; you can’t avoid it. Things diffuse! Hell, cosmic rays transmute atoms! But until you quantify the scale and demonstrate the effect, these facts are meaningless. Bad things will get into your body, but usually in very small amounts, and your liver and kidneys will probably have no problem doing their usual kickass job of dealing with them (if the bad thing bioaccumulates, you should admittedly be less sanguine about this; but that’s not applicable to the compounds under discussion).
But this is not how the human mind works. You only have to invoke a substance and a sort of animistic power takes over. It’s homeopathy at an angle. It’s why we have airport security theater. Numbers mean so very little to our idiot monkey brains.
Pretending epidemiology hasn’t been invented
Perhaps I will be accused of a kind of libertarian placidity for this one. That would probably be fair. Still, I think that writers often lead with “we are all unwitting participants in a huge and unethical natural experiment!” and then decline to ask whether any data’s come in from this bit of mad science. And the fact is that it has. “It’s a mixed bag” is the answer that then invariably follows, but that’s sort of telling in itself, right? People have been consuming aspartame for a while now — some of them even doing so while participating in vast longitudinal studies — and it’s just not the case that it makes you start sprouting tumors or hemorrhaging spinal fluid or growing hermaphroditic genitalia. I’m all for getting BPA out of the lining of tins of baby food, but it’s pretty hard to make the case that any of the worrying maybes in Tom’s posts are actually manifesting themselves as health crises. Yes, someone needs to be manning the watchtower; yes, industry has incentives for bad behavior. But in this particular case I think the decades’ worth of rhetorical and scientific stalemate over sweeteners is enough to merit some shrugging and eye-rolling.
Diet sodas are not a serious health problem. They’re just not. It may be that avoiding them is a good idea at the margin — and like I said, I do exactly that, because hell, I don’t enjoy ‘em anyway. But it’s hard for me to take myself very seriously as I do so. Sure, I don’t like the idea of methanol in my body, but I dislike it in almost exactly the same way that Scientologists don’t like the idea of thetans in theirs. It’s just a neurotic tic; an echo of a sort of Jungian archetype about impurity; really, a hobby at best. I mean, I still drink alcohol, and exercise less than I should, and go out in the sun a lot when I’m on vacation. Despite this disregard for my health I am still probably among the healthiest people in history, thanks to having enough money and living in America in the era that I do.
But look, perhaps you are healthier still. That is definitely possible! If so, by all means, freak out about aspartame if you want. It just strikes me as unlikely to deliver a very good return on the worry you intend to invest in it.