Welcome to DU! The truly grassroots left-of-center political community where regular people, not algorithms, drive the discussions and set the standards. Join the community: Create a free account Support DU (and get rid of ads!): Become a Star Member Latest Breaking News General Discussion The DU Lounge All Forums Issue Forums Culture Forums Alliance Forums Region Forums Support Forums Help & Search

Godhumor

(6,437 posts)
Mon Nov 23, 2015, 02:16 AM Nov 2015

A Primer in framing. Hillary was +6 in the ABC poll not the -4 reported in the press release

Disclaimer: I'm a statistical analyst. I do support Hillary, but I do these for more of an educational purposes than a partisan one. Yadda, yadda, yadda.

So, just a little while ago I lost it with the superPAC sponsored PPP debate poll for being nothing more than advertising for Clinton. I hope that has earned me a little leeway with some here, as I am about to go negative on a reported piece of very good news for Bernie from the pollster responsible for the Washington Post/ABC poll. Simply put, the pollster pulled a pretty shady trick in the press release to sell the story that Clinton lost 13 points of spread since the October poll. You can see it here:

http://abcnews.go.com/Politics/sanders-gop-steady-terrorism-worries-back-poll/story?id=35337895

And the money quote is this:
At 60-34 percent, Hillary Clinton is 26 percentage points ahead of Sanders, down from 39 points in October. He has gained significantly among registered Democrats and Democrat leaners under age 50, runs closely with Clinton among liberals and has closed the margin, to some extent, among nonwhites and women -- results that may give Clinton pause, if not palpitations.
------

Funny thing, though, those numbers, as reported by the pollster itself, weren't the actual poll numbers in October. What is reported in the press release is that Clinton was ahead 64 to 25 in October. However, in the actual poll from October she was ahead 54 to 23.

http://abcnews.go.com/Politics/clinton-rebounds-democratic-race-gaining-sanders-biden-alike/story?id=34580456


Yes, the pollster flipped a 6 point bump from October to November for Clinton into a four point loss.

But how did the pollster manage to get his own numbers wrong? He went back and reallocated Biden's supporters to their second choices. He also did that without stating in his November press release that he was doing so. I had to go into the October press release to figure out what he did.

This is not the correct way to report trending, at all. Second choice application may be fun for discussion purposes, but it cannot be used as a valid step in if someone drops out. There are many issues with why you can't just ignore your actual reported poll results by retconning what you previously showed. Let's touch on just one. In polling, the expectation is that people put very little thought into their second choices. As a result, second choice can actually benefit tremendously from name recognition. In other words, second choice answers tend to be, well, meaningless.

So why would the pollster decide to issue the press release with this framing (the actual poll for November uses the 54 not the 64 to report October results, by the way)? That is easy, to create a story--in this case by turning a positive poll for both candidates into a surge by one in particular. It is, in effect, dishonest.

The actual poll results tell the real story. Sanders picked up 11 points in a month by moving from 23 to 34, which is great. Hillary crested 60 for the first time by moving up 6 points from 54, herself. That is also great. The net change in spread is +5 to Sanders, but it didn't come at any expense to Hillary, who actually gained, as well.

Very different story than Hillary falling 4 points back to 60 while Sanders gained 9 for a net change of 13.

The poll is fine. The press release carried an agenda, which was achieved by some pretty dubious means.


20 replies = new reply since forum marked as read
Highlight: NoneDon't highlight anything 5 newestHighlight 5 most recent replies
A Primer in framing. Hillary was +6 in the ABC poll not the -4 reported in the press release (Original Post) Godhumor Nov 2015 OP
Thats pretty much the way I read it, spot on! Iliyah Nov 2015 #1
Reread the second link -- they are right, the op is wrong -- the non Biden numbers are correct karynnj Nov 2015 #9
Thanks for revealing the real informatoin. Agnosticsherbet Nov 2015 #2
Except, ABC got it right - they aksed the question with and without Biden karynnj Nov 2015 #10
K & R SunSeeker Nov 2015 #3
I don't think that Hillary has bottomed out. delrem Nov 2015 #4
From what I've read around here, one might begin to believe NurseJackie Nov 2015 #5
Honestly, I just scratch my head at the press release Godhumor Nov 2015 #6
No - your analysis wrong - you didn't bother to read the full October link you posted karynnj Nov 2015 #11
I know what they did, as stated in my OP that they moved second choice Godhumor Nov 2015 #12
The better apples to apples comparison is exactly what he did karynnj Nov 2015 #13
But it isn't correct in polling to do it that way Godhumor Nov 2015 #14
Go to pollingreport.com and there are often polls with and without a specific person karynnj Nov 2015 #15
Right, understood, but even looking at those reports in the past Godhumor Nov 2015 #16
They don't know enough choices?? Did they know more in the original question? karynnj Nov 2015 #17
No, the idea is that you know your primary choice well but not the alternatives Godhumor Nov 2015 #18
And a bump Godhumor Nov 2015 #7
Funny or predicable? Nt Sheepshank Nov 2015 #19
Read your second link -- the numbers with Biden not included are as stated in the later article karynnj Nov 2015 #8
Thanks for the correct information. okasha Nov 2015 #20

karynnj

(59,504 posts)
9. Reread the second link -- they are right, the op is wrong -- the non Biden numbers are correct
Mon Nov 23, 2015, 07:46 PM
Nov 2015

and that would be the appropriate comparison.

Clinton’s support for the nomination is more than double Sanders’ and triple the unannounced Biden’s. Leaving Biden out of the equation, she has even more support, 64 percent, compared with 25 percent for Sanders, with others in the low single digits. That’s improved slightly for Clinton from a 56-28 percent race vs. Sanders in September.

They used the polls without Biden in their graph in the new link -- no error there.

karynnj

(59,504 posts)
10. Except, ABC got it right - they aksed the question with and without Biden
Mon Nov 23, 2015, 07:48 PM
Nov 2015

The numbers they took from October are the numbers without Biden.

Clinton’s support for the nomination is more than double Sanders’ and triple the unannounced Biden’s. Leaving Biden out of the equation, she has even more support, 64 percent, compared with 25 percent for Sanders, with others in the low single digits. That’s improved slightly for Clinton from a 56-28 percent race vs. Sanders in September.

They used the polls without Biden in their graph in the new link -- no error there.

NurseJackie

(42,862 posts)
5. From what I've read around here, one might begin to believe
Mon Nov 23, 2015, 09:36 AM
Nov 2015

that the "M, dollar-sign, M" is in Hillary's camp. Looks like that's just another urban legend.

karynnj

(59,504 posts)
11. No - your analysis wrong - you didn't bother to read the full October link you posted
Mon Nov 23, 2015, 07:49 PM
Nov 2015

Clinton’s support for the nomination is more than double Sanders’ and triple the unannounced Biden’s. Leaving Biden out of the equation, she has even more support, 64 percent, compared with 25 percent for Sanders, with others in the low single digits. That’s improved slightly for Clinton from a 56-28 percent race vs. Sanders in September.

They used the polls without Biden in their graph in the new link -- no error there.

Godhumor

(6,437 posts)
12. I know what they did, as stated in my OP that they moved second choice
Mon Nov 23, 2015, 08:05 PM
Nov 2015

To remove Biden. My point is that the poll itself includes Biden and that, due to inherent issues with moving second choice to the front, it creates an incorrect picture. My other point is that the pollster flipped from the full poll as reported in October, which had Hillary at 54 to the total where Biden's supporters second choice was included at 64 points.

I stand 100% by my OP.

karynnj

(59,504 posts)
13. The better apples to apples comparison is exactly what he did
Mon Nov 23, 2015, 08:34 PM
Nov 2015

There is no way that adjusting to remove Biden is a problem. Ignoring it actually just leads to a murky result. I worked for decades doing statistical analysis and operations research at Bell Labs -what ABC did was entirely reasonable. When Biden was no longer a choice, she immediately polled higher in other polls because more of the people preferring him went to HRC than to Bernie - just as the ABC without HRC poll indicated. It is a more accurate reflection of the relative strength of HRC and Bernie then ignoring the Biden numbers.

Godhumor

(6,437 posts)
14. But it isn't correct in polling to do it that way
Mon Nov 23, 2015, 08:40 PM
Nov 2015

Because, again, of the bias in second choices. It is exactly why all other pollsters didn't run away from including Biden in its polls and notated the increase in support due to him not entering the race in their October polling.

I understand why they did what they did, I just vehemently disagree with the rationale.

Nice to meet another statistical analyst, by the way.

karynnj

(59,504 posts)
15. Go to pollingreport.com and there are often polls with and without a specific person
Mon Nov 23, 2015, 08:48 PM
Nov 2015

There were many 2004 polls in 2003 that were with and without Al Gore. If the sample was constructed properly, there should be no bias based on this. (I do agree that if they created a strange hybrid that was who got more first plus second votes - it would be incredibly subject to game playing. Here, that is not what happened - they asked Biden people who they would vote for if Biden did not run.)

Godhumor

(6,437 posts)
16. Right, understood, but even looking at those reports in the past
Mon Nov 23, 2015, 09:13 PM
Nov 2015

They don't reallocated support on a trending basis as people drop out. Even in the ABC November poll results they refer to the 54 point support from October and not the 64 point support given when second choice is assumed as first choice.

And there is bias in simply putting the second choice forward as first choice due to the known bias that people don't know enough alternatives to really understand who they would vote for if their chosen candidate dropped out.

The press release did not explain what they did and why; that is why I'm bugged by it.

Godhumor

(6,437 posts)
18. No, the idea is that you know your primary choice well but not the alternatives
Mon Nov 23, 2015, 09:22 PM
Nov 2015

As in someone can say they'd support Hillary if Biden didn't run. When he doesn't announce the person follows the other candidates closer and actually decides to align with Bernie. Second choice answers have error associated with them if the first choice actually ends up being removed.

karynnj

(59,504 posts)
8. Read your second link -- the numbers with Biden not included are as stated in the later article
Mon Nov 23, 2015, 06:23 PM
Nov 2015

Clinton’s support for the nomination is more than double Sanders’ and triple the unannounced Biden’s. Leaving Biden out of the equation, she has even more support, 64 percent, compared with 25 percent for Sanders, with others in the low single digits. That’s improved slightly for Clinton from a 56-28 percent race vs. Sanders in September.

They used the polls without Biden in their graph in the new link -- no error there.

Latest Discussions»Retired Forums»2016 Postmortem»A Primer in framing. Hill...