Problems with Polling

Andrea Mitchell Reports © Timothy Greenfield-Sanders | msnbc.com

I was baffled yesterday when I saw on MSNBC’s “Andrea Mitchell Reports” a short question: “Is President Obama also to blame for US economy?” This question referred to an ongoing Gallup poll. And MSNBC presented the answer – 53% of asked people now blaming Obama for the state of US economy. This brief episode of my morning TV routine provides an opportunity for me to revisit the larger problem of the “Power to the Polls,” which I investigated through an article by Jürgen Habermas. I continue to wonder what do polls actually mean in public debate and opinion?

“Is President Obama also to blame for US economy?” This is a bad polling question on so many levels. I am not really an expert on polling, but even I learned in Germany in my “Empirie” class, during my political science studies, that there is a scientific method to polls and questionnaires. One of the first rules: Questions have to be unambiguous, meaning they should be clearly understood. What does “also” mean? Is Obama to be blamed also among other actors? Is Obama to be blamed for the economy also among other issues for which he is to blame?

I could not believe that a professional researcher from Gallup would come up with such a flawed question. So I actually looked at the Gallup poll to which MSNBC’s interpretation refers. The Gallup question is: “How much are George W. Bush and Barack Obama to be blamed for US Economy?” The answer choices are split between Bush and Obama and give the options: a great deal, moderate amount, not much, not at all. This poll is ongoing since 2009. The results published on September 21, 2011 show that 53% of the asked people say for Obama either “a great deal” or “moderate amount” (Bush 69 %). This is what MSNBC translates into 53% say “yes” to the question “Is president Obama also to blame for US economy?”

. . .

Read more: Problems with Polling