Creative Destruction

July 22, 2006

Identifying error

Filed under: Debate,Philosophy,Science — Adam Gurri @ 6:11 pm

Daran does an effective job demolishing the Slate response to the Lancet survey.  Then states:

But the true drawdropping irony in all of this is that Adam, apparently with a straight face, should cite this claptrap in a post exhorting the rest of us to higher standards of evidence!

I happen to believe that what occurred supports the arguments I made in that post.


I stated that unless two parties entering a debate, or one party presenting a thesis, begin by setting a standard to judge their conclusions by, the information being spewed out would essentially be without meaning.

The link to the Slate article was a foolish idea I did without much thought–I merely wanted to demonstrate that reasonable disagreement could occur on one specific subject, that being the number of casualties in Iraq, and wanted to use the debate over the Lancet article as an example.  I remembered the Slate article from back when I first read it, and linked to it.   I had no intention of getting into a debate on that particular subject.

Well, if I was going to link to it, then I had to be prepared to defend it–and Ampersand began by setting the standard at the level of statistical theory.  Unless I could understand the statistical methodology behind the Lancet study as it was used under any circumstance, then I had little foundation to criticize it.

In response, I read a fair amount on the basic statistics surrounding the subject, as well as the article itself and some peer-reviewed criticism.  I admitted that the Slate criticism had, as far as I could tell, no basis in mathematical analysis.  Ampersand and I debated further, and I could see that I would need to learn a lot more before I could match his knowledge on the subject.

So I took down the Slate article from the original post, and used instead Amp and my debate as an example of disagreement on the subject.

This is precisely the kind of exchange that I was talking about in the post.  It isn’t about being right–science, and all knowledge, is about trial and error.  The important thing is setting methodological standards that help you judge when you are in error.

Ampersand didn’t just argue “you are wrong, Slate is politically motivated”, he pointed out to me that the Lancet survey used a fair amount of standard statistical procedures, and stated that I would need to demonstrate how the study had been in error within that framework if I wanted to refute their results.

Setting out to do this, it didn’t take long to see that I simply hadn’t the knowledge.  But I made an attempt to the best of my ability, and Ampersand’s criticism of that second attempt will help serve as the basis for further research.

I’m not entirely certain why it is that Daran and Brutus have reacted with such outrage to my call for sterner methodological scrutiny.  All I can say is that, once applied, I find it to make debates fulfilling in a way that they are not when standards are set low and things devolve into ad-hominem.

Advertisements

2 Comments »

  1. Adam, we seem to have crossposted. I set out my standards here, together with a couple of examples of propositions which didn’t meet them.

    Proposition I do regard as proven, by those standards, are that Iraqi society is in meltdown, that things have generally deteriorated for the Iraqi people since before the war, that men are particularly targeted for violence, especially homicidal violence, and that women’s freedom to participate in society is being curtailed. Such proof, of course, is necessarily provisional.

    Truce?

    Comment by Daran — July 22, 2006 @ 7:17 pm | Reply

  2. Well, Goddammit 🙂

    Of course truce–I didn’t intend this to become an arms race of posting. I just get a little overenthusiastic sometimes–but I do feel good about this on the whole.

    Thanks for the comments, as well as the post–I feel like I’ve got a great sense of what I need to be looking at.

    Good stuff.

    Comment by Adam Gurri — July 22, 2006 @ 8:05 pm | Reply


RSS feed for comments on this post. TrackBack URI

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

Blog at WordPress.com.

%d bloggers like this: