“Allowing party ID to wildly fluctuate is as silly as thinking that party ID actually fluctuates that wildly. It doesn’t.”
Sample only by demographics
“This is all a ridiculous Republican talking point. I hope the Republican pollsters change their methodology to match their BS spin.”
“Except when you get outside a certain range that does not accord with everything else you know about your electorate and the national environment. Even then, you need to think hard about weighting anything in your favor.”
“I’m a pollster, and the true answer lies somewhat in the middle. But given the alternative, more emphasis ought to be put into demographics, and party ID should be adjusted only when it seems to have deviated too much from a previous norm.”
“An ideal poll weights by demographics, as party ID often changes based on enthusiasm. Sampling techniques are more sophisticated than simply weighting however, as they need to be concerned with cell phones, who is likely to be home on particular days, and screening bias.”
“Party ID has been a dying statistic for a generation or better. Swing voters don’t give a damn about party ID—that’s why they are a swing voter.”
Should pollsters weight their surveys by party ID, or should they measure only by adjusting their sample to race, gender, and other demographics and allow for changes in party-ID attitudes?
REPUBLICANS (91 VOTES)
Weight by party ID: 76%
Sample only by demographics: 24%
Weight by party ID
“I have been doing this for 20 years. You have to make certain assumptions based on historical and likely voters. If you make the right assumption, it’s far more accurate than just demographic sampling.”
“In an increasingly partisan world, party ID is just as key as other demographic information.”
“There should be some of both. But the party-ID weighting is a crucial reality check. A number of the polls have not been plausible.”
“With tracking polls or very frequent stand-alone polls, you must keep party ID within a reasonable range. The range can be adjusted if a consistent trend is observed. Party ID is an attitude that changes more slowly than many other attitudes and perceptions.”
“They should not weight by an unchanging party ID, because that can change over the course of a campaign. But they should definitely weight by an average of party ID over the two-year cycle to even out inevitable variations from sample to sample. Going from +10 [percentage points] Democrat (which has never happened in exit polling in 28 years) to +5 Republican (which has also never happened) in three weeks as Pew did makes the whole polling profession look bad.”
“Party ID accounts for more than two-thirds of votes cast. If you get that wrong, then you get the ballot wrong. Simple as that.”
“It’s like kicking a field goal. The party-ID numbers need to stay within the uprights.”
Sample only by demographics
“Party ID is a structural variable. It does certainly change over time but does not change in the short term. My bias is totally in favor of weighting data by race and by age within gender.”
“The sample should pick itself. Sometimes knowing who is turning out is as important as knowing who those who turn out actually vote for.”
“Party ID is a fluid measurement. Let the market speak, and be transparent about results.”
Democratic Political Insiders Jill Alper, John Anzalone, Brad Bannon, Dave Beattie, Andy Bechhoefer, Cornell Belcher, Matt Bennett, Mitchell W. Berger, Mike Berman, Stephanie Bosh, Paul Brathwaite, Donna Brazile, Mark Brewer, Ed Bruley, George Bruno, Bonnie Campbell, Bill Carrick, Guy Cecil, Martin J. Chavez, Tony Coelho, Larry Cohen, Jerry Crawford, Brendan Daly, Jeff Danielson, Peter Daou, Howard Dean, Scott DeFife, Jim Demers, Tad Devine, David Di Martino, Debbie Dingell, Monica Dixon, Patrick Dorton, Pat Dujakovich, Anita Dunn, Jeff Eller, Steve Elmendorf, Carter Eskew, Vic Fazio, Peter Fenn, Scott Ferson, Jim Fleischmann, Tina Flournoy, Don Foley, Jeffrey Forbes, Vincent Frillici, Gina Glantz, Niles Godes, John Michael Gonzalez, Joe Grandmaison, Anna Greenberg, Stan Greenberg, Pat Griffin, Larry Grisolano, Michael Gronstal, Lisa Grove, Marcia Hale, Jill Hanauer, Dick Harpootlian, Paul Harstad, Laura Hartigan, Doug Hattaway, Mike Henry, Karen Hicks, Leo Hindery Jr., Harold Ickes, Marcus Jadotte, John Jameson, Steve Jarding, Jonathon Jones, Jim Jordan, Gale Kaufman, Lisa Kountoupes, Celinda Lake, David Lang, Penny Lee, Chris Lehane, Jeff Link, Bob Maloney, Jim Manley, Steve Marchand, Jim Margolis, Paul Maslin, Keith Mason, Susan McCue, Gerald McEntee, Steve McMahon, Tom McMahon, Phil McNamara, David Medina, Michael Meehan, Mark Mellman, John Merrigan, Michael Monroe, Steve Murphy, Janet Napolitano, David Nassar, Marcia Nichols, John Norris, Tom Ochs, Tom O’Donnell, Jeffrey Peck, Debora Pignatelli, Tony Podesta, Jefrey Pollock, Jack Quinn, Larry Rasky, Mame Reiley, Ed Rendell, Steve Ricchetti, Will Robinson, Steve Rosenthal, David Rudd, Ryan Rudominer, John Ryan, Michael Sargeant, Stephanie Schriock, Terry Shumaker, Sean Sinclair, Phil Singer, Erik Smith, Doug Sosnik, Greg Speed, Darry Sragow, Ken Strasma, Doug Thornell, Jeffrey Trammell, Ed Turlington, Rick Wiener, James Williams, JoDee Winterhof, Brian Wolff, Jon Youngdahl, and Jim Zogby.
GOP Political Insiders Dan Allen, Stan Anderson, Gary Andres, Saulius (Saul) Anuzis, Rich Ashooh, Whit Ayres, Brett Bader, Mitch Bainwol, Brian Baker, Gary Bauer, David Beckwith, Paul Bennecke, Clark Benson, Wayne Berman, Brian Bieron, Charlie Black, Kirk Blalock, Carmine Boal, Jeff Boeyink, Ron Bonjean, Jeff Buley, Luke Byars, Nick Calio, Al Cardenas, Danny Carroll, Alex Castellanos, Ron Christie, Jim Cicconi, Jonathan Collegio, Rob Collins, Cesar Conda, Jake Corman, Scott Cottington, Jay Cranford, Greg Crist, Diane Crookham-Johnson, Fergus Cullen, Tom Davis, Mike Dennehy, Ken Duberstein, Debi Durham, Sara Fagen, Frank Fahrenkopf, John Feehery, Don Fierce, Mindy Finn, Carl Forti, Alex Gage, Bruce A. Gates, Sam Geduldig, Adam Geller, Benjamin Ginsberg, David Girard-diCarlo, Bill Greener, Jonathan Grella, Lanny Griffith, Janet Mullins Grissom, Doug Gross, Todd Harris, Steve Hart, Christopher Healy, Ralph Hellmann, Chris Henick, Terry Holt, David Iannelli, Ed Ingle, Jim Innocenzi, Clark Judge, David Keating, David Kensinger, Bob Kjellander, Ed Kutler, Chris LaCivita, Jim Lake, Steven Law, Steve Lombardo, Kevin Madden, Joel Maiola, Gary Maloney, David Marin, Mary Matalin, Dan Mattoon, Brian McCormack, Mark McKinnon, Kyle McSlarrow, Ken Mehlman, Jim Merrill, Lisa Camooso Miller, Tim Morrison, Mike Murphy, Phil Musser, Ron Nehring, Terry Nelson, Neil Newhouse, David Norcross, Ziad Ojakli, Jack Oliver, Todd Olsen, Kevin O’Neill, Connie Partoyan, Billy Piper, Van B. Poole, Tom Rath, Scott Reed, David Rehr, Tom Reynolds, Steve Roberts, Jason Roe, David Roederer, Dan Schnur, Russ Schriefer, Rich Schwarm, Brent Seaborn, Rick Shelby, Andrew Shore, Kevin Shuvalov, Don Sipple, Ken Spain, Fred Steeper, Bob Stevenson, Terry Sullivan, David Tamasi, Eric Tanenblatt, Richard Temple, Heath Thompson, Jay Timmons, Warren Tompkins, Ted Van Der Meid, Dirk van Dongen, Jan van Lohuizen, Stewart Verdery, Dick Wadhams, John Weaver, Lezlee Westine, Dave Winston, Ginny Wolfe, Fred Wszolek, and Matthew Zablud.
This story appeared in the print edition of National Journal under the headline "Political Insiders Poll."
This article appears in the Oct. 13, 2012, edition of National Journal.