Excerpt:
1. The survey was conducted by mail, which is unusual. The only other mail-based poll that I'm aware of is that conducted by the Columbus Dispatch, which was associated with an average error of about 7 percentage points -- the highest of any pollster that we tested.
2. At least one of the questions is blatantly biased: "Do you believe the government can cover 47 million more people and it will cost less money and th quality of care will be better?". Holy run-on-sentence, Batman? A pollster who asks a question like this one is not intending to be objective.
3. As we learned during the Presidntial campaign -- when, among other things, they had John McCain winning the youth vote 74-22 -- the IBD/TIPP polling operation has literally no idea what they're doing. I mean, literally none. For example, I don't trust IBD/TIPP to have competently selected anything resembling a random panel, which is harder to do than you'd think.
4. They say, somewhat ambiguously: "Responses are still coming in." This is also highly unorthodox. Professional pollsters generally do not report results before the survey period is compete.
5. There is virtually no disclosure about methodology. For example, IBD doesn't bother to define the term "practicing physician", which could mean almost anything. Nor do they explain how their randomization procedure worked, provide the entire question battery, or anything like that.
2. At least one of the questions is blatantly biased: "Do you believe the government can cover 47 million more people and it will cost less money and th quality of care will be better?". Holy run-on-sentence, Batman? A pollster who asks a question like this one is not intending to be objective.
3. As we learned during the Presidntial campaign -- when, among other things, they had John McCain winning the youth vote 74-22 -- the IBD/TIPP polling operation has literally no idea what they're doing. I mean, literally none. For example, I don't trust IBD/TIPP to have competently selected anything resembling a random panel, which is harder to do than you'd think.
4. They say, somewhat ambiguously: "Responses are still coming in." This is also highly unorthodox. Professional pollsters generally do not report results before the survey period is compete.
5. There is virtually no disclosure about methodology. For example, IBD doesn't bother to define the term "practicing physician", which could mean almost anything. Nor do they explain how their randomization procedure worked, provide the entire question battery, or anything like that.
4 comments:
This is why all polls are suspect. There's no reason to believe this one.
Mike there are good polls and bad polls. This is a bad one, for the reason Nate Silver explains.
You remember who Nate Silver is, right?
He predicted the Obama win to 49 of 50 states, based on his custom composite model of all polls in the fields and his unique ability to rank and weigh their results.
Also if you ever want to bet on sports, ask Nate first.
http://en.wikipedia.org/wiki/Nate_Silver
After my beloved Wildcats from Kansas State lost to Louisiana Lafayette, I'm not bettin' on nothin' for a while!
Nice work, BF.
Remind me to bury all my deep dark secrets a little deeper and not to piss you off.
Post a Comment