Welcome to DU! The truly grassroots left-of-center political community where regular people, not algorithms, drive the discussions and set the standards. Join the community: Create a free account Support DU (and get rid of ads!): Become a Star Member Latest Breaking News General Discussion The DU Lounge All Forums Issue Forums Culture Forums Alliance Forums Region Forums Support Forums Help & Search

Doctor Jack

(3,072 posts)
Wed Aug 31, 2016, 08:41 AM Aug 2016

538 on These New Fangled Online Panel Polls

FiveThirtyEight generally takes an inclusive attitude towards polls. Our forecast models include polls from pollsters who use traditional methods, i.e., live interviewers. And we include surveys conducted with less tested techniques, such as interactive voice response (or “robopolls”) and online panels. We don’t treat all polls equally — our models account for the methodological quality and past accuracy of each pollster — but we’ll take all the data we can get.

This split, however, between live-interview polls and everything else, is something we keep our eye on. When we launched our general election forecasts in late June, there wasn’t a big difference in the results we were getting from polls using traditional methodologies and polls using newer techniques. Now, it’s pretty clear that Hillary Clinton’s lead over Donald Trump is wider in live-telephone surveys than it is in nonlive surveys.

We don’t know exactly why live-interview polls are getting different results than other types of surveys; there are a lot of potential causes and it’s something we’ll be digging into. But it’s harder to measure this gap in the first place than you might think; pollsters make a lot of choices — whether to use a registered or likely voter sample, for example, or whether to poll Gary Johnson and Jill Stein — that could account for the differences between live and nonlive surveys. But one method to get at the difference is to use our forecast models, which account for these things.

As of Tuesday morning, Clinton led Trump by 6 percentage points and had a 79 percent chance of winning, according to our polls-only forecast. But running our polls-only model using only live-interview surveys, Clinton leads Trump by 7 points and has an 86 percent chance of winning. Running it with only nonlive-interview polls, Clinton leads Trump by 5 points and has a 71 percent chance of winning.



It would appear that one of the major reasons why Clinton has been "slipping" in the polls the last week or two is because of these largely untested online panel polls and real polls with tried and true methodology are showing a much different (i.e. better) race. Sounds like the folks at 538 are having some concerns about what these online panels are doing to their numbers and are planning on looking into this issue.

http://fivethirtyeight.com/features/live-polls-and-online-polls-tell-different-stories-about-the-election/
8 replies = new reply since forum marked as read
Highlight: NoneDon't highlight anything 5 newestHighlight 5 most recent replies
 

molova

(543 posts)
1. "untested" is the keyword here
Wed Aug 31, 2016, 09:17 AM
Aug 2016

The Hill loves these linkbait polls. They get tons of retweets and click from their shocking headlines about wild swings.

Doctor Jack

(3,072 posts)
2. Thats the problem, why are they experimenting so much?
Wed Aug 31, 2016, 10:52 AM
Aug 2016

Polls for the past 50 years have been pretty good including the last election just 4 years ago. There is no good reason why we should be throwing out the methodology and starting from scratch with these highly experimental techniques. My only guess is that these online polls are cheap to conduct, you can turn them out rapidly, and they have discovered they create that horse race feeling when one probably doesnt actually exist.

Im weary about trying to unskew polls but if 538 is raising the alarm about these and they have no established track record then maybe they should be ignored.

Cicada

(4,533 posts)
3. People aren't answering calls from pollsters so pollsters have to try plan B
Wed Aug 31, 2016, 11:09 AM
Aug 2016

Pollsters who use live human calls have to make a huge number of calls to get a thousand willing to be polled. Pollsters have to find other methods. That polls still work at all is very surprising given that nobody will answer their calls anymore.

Stellar

(5,644 posts)
6. LOL..you're probably right. I've been blocking calls for a month and it's finally quiet in my house.
Wed Aug 31, 2016, 12:06 PM
Aug 2016

apnu

(8,756 posts)
8. Because there is a class of people who come up with an idea then look in the field to reinforce it.
Wed Aug 31, 2016, 12:50 PM
Aug 2016

Its the opposite of science. And since the tried and true method of data collection isn't lining up with the pre-conceived story, they have to invent new methods of data collection in an attempt to make the data fit the story.

Online polling has never seriously tried to improve the old phone and interview methods.

Doctor Jack

(3,072 posts)
7. Could be, at least at this point
Wed Aug 31, 2016, 12:38 PM
Aug 2016

Maybe that wasnt the original intention but it seems that once they realized how unstable they are, they jumped all over them

Latest Discussions»Retired Forums»2016 Postmortem»538 on These New Fangled ...