Google Ads


Site Stats

So How'd We Do?

by: Crisitunity

Wed Jan 07, 2009 at 4:38 PM EST


During the election season, people seemed to assume that Swing State Project has long been in the business of handicapping congressional races. However, believe it or not, 2008 was the first time that SSP attempted to rate and predict every congressional race. It was an extremely fun project, as we argued back and forth, trying to sell each other on particular candidates' hidden strengths or districts' unique quirks, parsing the meaning of "Lean" and "Likely," or simply trash-talking each other. (In order to briefly return to those golden days, this is a fully collaborative post, and David and James have their say further down too.)

Now that every House race has finally been called and things have settled back down to business as usual here, we thought we'd do a little retrospective and see how our predictions matched up with the actual results. (Our final predictions are here.) Our table is broken into races where Team Blue was on the offense and on the defense, ordered in terms of the margin of victory (or loss). (An asterisk refers to a race that was once on the chart, but dropped off by the end.) Even if you aren't that interested in our slightly belated soul-searching about our predictive skills, this should be a very useful chart for our readers, as the decreasing margins give a pretty clear picture of who's vulnerable going into the next cycle.

DistrictOffense MarginRatingDistrictDefenseMarginRating
NY-13Open27.6Safe DFL-16Mahoney-20.2Likely R
IL-11Open23.9Lean DLA-06Cazayoux-7.8Tossup
AZ-01Open20.5Likely DTX-22Lampson-7.0Tossup
FL-24Feeney16.1Lean DKS-02Boyda-4.4Lean D
NY-25Open12.9Likely DLA-02Jefferson-2.7Safe D
CO-04Musgrave12.4Lean DPA-11Kanjorski3.2Tossup
NM-02Open12.0TossupAL-05Open3.6Lean D
VA-11Open11.7Lean DNY-24Arcuri4.0Safe D *
NM-01Open11.4Lean DNH-01Shea-Porter5.9Lean D
NC-08Hayes10.8Lean DTX-17Edwards7.5Safe D
OH-16Open10.8Lean DWI-08Kagen8.1Lean D
MI-09Knollenberg9.5Lean DFL-22Klein9.4Safe D
NV-03Porter5.1TossupAZ-05Mitchell9.6Lean D
OH-01Chabot4.9TossupME-01Open9.8Safe D
VA-02Drake4.9Lean RCA-11McNerney11.6Lean D
NJ-03Open4.2TossupMS-01Childers10.6Likely D
FL-08Keller4.0TossupPA-04Altmire11.8Likely D
CT-04Shays3.7TossupAZ-08Giffords11.9Likely D
PA-03English2.4TossupPA-10Carney12.6Lean D
MI-07Walberg2.3TossupTX-23Rodriguez13.9Likely D
NY-29Kuhl2.0Lean DIA-03Boswell14.3Safe D
ID-01Sali1.2TossupGA-08Marshall14.4Lean D
MD-01Open0.8TossupNH-02Hodes15.0Safe D *
OH-15Open0.7Lean DPA-08P. Murphy15.2Likely D
AL-02Open0.6Lean RIL-14Foster15.4Likely D
VA-05Goode0.2Lean RPA-12Murtha15.8Lean D
LA-04Open-0.4TossupOR-05Open16.0Likely D
CA-04Open-0.6TossupKS-03Moore16.8Likely D
CA-44Calvert-2.4Safe RNY-01Bishop16.8Safe D
MO-09Open-2.5TossupNY-19Hall17.4Safe D *
MN-06Bachmann-3.0TossupOH-10Kucinich17.9Safe D
NE-02Terry-3.8TossupIA-02Loebsack18.4Safe D
SC-01Brown-4.0Lean RKY-03Yarmuth18.8Likely D
PA-06Gerlach-4.2RTW *PA-07Sestak19.2Safe D
CA-50Bilbray-5.1Likely RIN-09Hill19.4Likely D
AK-ALYoung-5.2Lean DTX-27Ortiz19.5Safe D
IL-10Kirk-5.2TossupOH-18Space19.8Safe D *
KY-02Open-5.2Lean RCT-05C. Murphy20.2Likely D
CA-03Lungren-5.5RTWTN-04Davis21.0Safe D
WA-08Reichert-5.6TossupIL-08Bean21.4Safe D *
MI-11McCotter-6.0Safe RWI-07Obey21.7Safe D
FL-25M. Diaz-Balart-6.2TossupCO-03Salazar23.2Safe D
OH-02Schmidt-7.2Lean RFL-02Boyd23.8Safe D
SC-02Wilson-7.5RTWND-ALPomeroy24.0Safe D
MN-03Open-7.6TossupNY-20Gillibrand24.2Lean D
NJ-07Open-8.0TossupSC-05Spratt24.6Safe D
AL-03Rogers-8.2Likely RWA-02Larsen24.8Safe D
CA-46Rohrabacher-9.5Likely RNM-03Open26.2Safe D
WY-ALOpen-9.8Lean RNC-11Shuler26.2Safe D *
IL-13Biggert-9.9RTWNC-04Price26.6Safe D

As you can see, by the time you get up to 50, the Democratic defense list has started to get kind of uninteresting, while there are still some hotly contested offense seats left to discuss. It's a pretty good illustration of how lopsided the playing field for the two parties was this year. For instance, there's only one Democratic defense seat that we had left on our big board that fell off the list: Tim Walz in MN-01, who was Likely D but won by 29.6% (good for 67th place).

On the other hand, here's the continued list for offense seats!
51) NV-02, Heller, -10.4, Lean R
52) TX-10, McCaul, -10.8, Lean R
54) AZ-03, Shadegg, -11.1, Lean R
57) NJ-05, Garrett, -13.5, Lean R
58) TX-07, Culberson, -13.5, Likely R
59) WV-02, Capito, -14.2, Lean R
60) NY-26, Open, -14.5, Lean R
67) NC-10, McHenry, -15.2, Likely R
68) IN-03, Souder, -15.3, Tossup
72) FL-18, Ros-Lehtinen, -15.8, Likely R
73) FL-21, L. Diaz-Balart, -15.8, Tossup
77) OH-07, Open, -16.4, Likely R
80) NC-05, Foxx, -16.8, Likely R
81) PA-15, Dent, -17.2, Likely R
83) FL-13, Buchanan, -18.0, Likely R
89) VA-10, Wolf, -20.0, Likely R
95) IA-04, Latham, -21.2, Likely R
103) MO-06, Graves, -22.5, Likely R
128) LA-07, Boustany, -27.6, Likely R
142) LA-01, Scalise, -31.4, Likely R

The first thing I notice is that there are only six places where we got it "wrong," where wrong means we felt that, rather than leaving a race as "Tossup," we could move it to "Lean" or even "Likely..." only to see it go the wrong way. On the defense side, that means Bill Jefferson at Safe D, whose loss I think absolutely no one saw coming (the NRCC's four-digit campaign expenditures notwithstanding). It also means Nancy Boyda at Lean D. Although she seemed to have a comfortable edge in polls, her surprise loss provides a nice object lesson for incumbents defending tough districts: don't try to run a campaign that actually appeals to your constituents' logic and good judgment. Accept the DCCC's money, and use it to run negative TV spots, instead of trying to engage them intellectually with policy-specific newspaper ads.

On the offense side, the big screwup is Don Young at Lean D; again, this is one that basically no pundit saw coming, thanks to extremely consistent polling in favor of Ethan Berkowitz. The lesson here: never underestimate Alaskans' willingness to vote for more pork, even if it means supporting a felon (or soon-to-be felon) in the privacy of the voting booth.

We also had something of a crisis of faith in Bobby Bright in AL-02, in the face of tepid campaigning and a crimson district. Despite our dropping him late in the game to Lean R, his name rec and DCCC spending seemed to pull him over the line. Finally, we were caught off guard by the magnitude of the Obama coattails in Virginia, where we left Glenn Nye (VA-02) and Tom Perriello (VA-05) at Lean R. The polls just weren't there for them, in GOP-leaning turf, but the bluening of Virginia lifted them far enough. (If there's one candidate I'm personally shocked that won, it's Perriello; I was miffed to see the DCCC pouring money into a guy who seemed way too progressive for such a rural and downscale district. Here's one race where I'm super-happy to eat some crow.)

Where else did we whiff? IN-03 and FL-21 seemed like Tossups at the time, given the very close polling and baffled-seeming incumbents, but these ones are languishing up around #70. Apparently the constituents decided late in the game that, in IN-03, they had a challenger they just didn't know enough about (Mike Montagano), and in FL-21, probably a challenger that they just knew too much about (Raul Martinez).

We may also have been a little generous on the Louisiana challenges in LA-07 and LA-01 (both listed as Likely R). Jim Harlan, with a conservative profile and his own fat pocketbook, seemed like the best possible candidate for LA-01; however, given that this is one of the nation's most right-wing districts, I guess we have to take a 30-point loss (instead of the usual 50-point beatdown that we take in that district) as some sort of moral victory.

On the flipside, we missed a number of strong performances in California, especially the near upsets of Ken Calvert in CA-44 and Dan Lungren in CA-03. What's most interesting is that the rising blue tide in California seemed very evenly distributed throughout the state and probably tied to an Obama-driven boost in infrequent voters voting straight-ticket D, as higher-profile challenges to Dana Rohrabacher and David Dreier did only slightly better than completely under-the-radar challenges to guys like Buck McKeon, Wally Herger, and Elton Gallegly.

Where did we buck the odds? I'm pleased with how well we did at moving the right people to "Lean D" in the weeks before the election; at the time, it seemed a little audacious to call a win in advance for Gary Peters, Larry Kissell, Suzanne Kosmas, Betsy Markey, and Eric Massa in their fights against (lame) incumbents, but they all pulled it out... as did last-minute change Mary Jo Kilroy, who finally managed to pull it out in overtime and save us a lot of egg on our faces.

On the whole, we ran up a pretty good track record (while using the ass-covering category of "Tossup" a lot less than certain other prognosticators). The lesson here is that prognosticating is more art than science; your predictions are only as good as your polls and your scuttlebutt.

DavidNYC: This was indeed a very fun project and a tremendous learning experience, and I expect will continue to do race ratings in the future. It was also remarkably time-consuming, especially as we got toward the end - as Crisitunity suggests, there was a lot of back-and-forth as we pored over Google spreadsheets - plus the occasional bit of smack talk. But I think we'd all gladly take more cycles like the one just concluded!

I just have a few additional thoughts. I think our Senate ratings hit the mark, and I think we were in general pretty disciplined in not moving races until we had sufficient evidence to justify a change. Some examples I'm thinking of include OR-Sen and CT-04, where we insisted on seeing polling before concluding that popular, "moderate" Republican incumbents were truly in jeopardy.

On the flipside, I think sometimes you just have to acknowledge an open seat is gone, as we did early on by moving VA-Sen to Safe D in August, and later NY-13 in October. (Both of these were thirty-point races.)

One of our biggest flubs, though, was NY-24. We had the race as Likely D until a week before election day, when we moved it to Safe. A lack of polling, zero outside spending, and a seemingly unimpressive Republican who had been substantially outraised all convinced us that there was nothing to see here.

We couldn't have been more wrong. In the end, Mike Arcuri raised "just" $1.6 million (unimpressive compared to fellow freshmen like Chris Murphy, Patrick Murphy or even Paul Hodes), while Richard Hanna took in almost $1.1 mil. The final four-point margin was hair-raising, and suggests Arcuri still has a lot of work to do to establish himself. It also tells us that there will always be surprises - and that absence of evidence is not evidence of a Straniere.

James: Crisitunity and David touched on a lot of key points above, but I'll just add that I think that we all were a bit caught off guard by just how much of a focal point our race ratings exercise became in the day-to-day operations of this blog.

When I first drafted a preliminary set of race ratings at the tail end of 2007, David's response after I asked him for his thoughts was merely: "Nice work!" David later admitted to me that he felt as if he were a busy parent being handed a crappy piece of crayon art by a proud six year-old son. But once that crayon drawing was slapped on the fridge, if you will, we all realized that we would have to put in a great level of care into making sure we felt that each rating had a strong leg to stand on. In that sense, our race ratings project became the engine of SSP: we all had to step up our game to make sure that no major (or even minor) developments in the key House races would slip past us unnoticed -- especially after we achieved some early success by noticing MS-01 before anyone else did.

Our goal of making this ratings project as honest and credible as possible, I believe, had a great impact on our front page coverage, and I know we caught on to a lot of stories and developments that we may have otherwise missed had it not been for our relentless commitment to stay on top of things. There's no doubt in my mind that our ratings exercise, even if it provided no great revelations to anyone else, helped improve the work and quality of this blog immensely over my output in the summer and fall of 2006.

Crisitunity :: So How'd We Do?
Tags: , , , , (All Tags)
Print Friendly View Send As Email

So How'd We Do? | 27 comments
you did well
It's not easy to guess these things even in the districts you think you know well.

I wasn't following the races in other states nearly as closely, but I thought IA-04 should have been "lean R". Latham's 21-point win clearly indicates that you were right to call it likely R.  


We felt
in the weeks before the election that one was kind of on the cusp of being Lean R; it's a D+0 and there was that R2K poll a few weeks out that gave Latham only a 4-point edge. I think when we saw that the DCCC wasn't going to get involved we figured they didn't have much confidence in Greenwald, though.

[ Parent ]
seems like that R2K poll was an outlier
Greenwald never had an internal poll that looked that good (otherwise they would have released it). They tried to pump up her poll numbers with a stupid tv buy in September, to get the DCCC involved, but it didn't work.

[ Parent ]
Coattails
I for one assumed that this seat would be a prime example of a district where Obama's big win would at the very least keep our candidate close, if not win.  Didn't happen unfortunately.  Dang ballot-splitters.

[ Parent ]
Interesting comment from my 68 year old father
My father told me that years before he always worried about the weather on election day.  He told me that although statewide elections may not be as affected by the weather (in NC, you can have warm weather in the Piedmont, rain in the mountains, and heavy rains on the East Coast), but the local elections can be influenced more, especially if the elderly and the poor cannot get to the polls.

I imagine a lot of this is mitigated by early voting, but I thought I'd throw that out for everyone to consider.  It sounds like this argument has some logic to it.

I think you did a great job with your predictions!

40, male, Democrat, NC-04


What about "presidential ballots"?
I know they have them here in Connecticut--if you haven't registered on time, you can still vote, but only for president.

party: Democratic, ideology: moderate, district: CT-01

[ Parent ]
I don't know
I can't remember how it's addressed in NC.  

40, male, Democrat, NC-04

[ Parent ]
Great Job
I appreciate all the hard work you guys did in bringing us the race ratings.  It certainly made following the races more interesting and enjoyable.

Finally, a mea culpa.  I recall chastising James for not moving Berkowitz from toss up to lean D some few weeks before the election.  You never should've listened to me!


I'm from NJ
I really thought we would win NJ-07. We weren't even close. Disappointing.  

26, male, Dem, NJ-12

I can sympathize.
In my home state California I was hoping for an upset in CA-04 as well as a surprise upset somewhere in SoCal with Calvert, Rohrabacher, or Bilbray. We had a lot of ticket-splitters in those SoCal districts. I was also hoping for an upset of Dreier in my home district of CA-26 but I was less optimistic as Dreier badly outspent Warner. On the plus-side, Dreier has burned up most of his cash and has no House chairmanship to use to raise more cash.

My blog
Twitter
Scribd
28, New Democrat, Female, TX-03 (hometown CA-26)


[ Parent ]
that one surprised me too
If she almost beat an incumbent in 2006, you'd think Linda Stender would have been able to beat a non-incumbent in a presidential year. I feel bad about that one--she seems like a great person.

[ Parent ]
I dunno
In retrospect I think Leonard Lance turned out to be a better candidate than Ferguson ever was, despite the fact that he was an incumbent.  Stender was a good candidate.

[ Parent ]
I agree you did a great job.
I too did the best I could with my predictions, being as objective as I could. I was a bit surprised by Bobby Bright's win in AL-02 though I changed that race to a Dem win at the last minute. I was also surprised at how the Alaska results differed wildly from my predictions. I guess I may have to include a gut feeling factor in some of these races such as AK-AL. Fortunately, I may not have to do that for the Senate race with the King of Pork outta there!

My blog
Twitter
Scribd
28, New Democrat, Female, TX-03 (hometown CA-26)


You do awesome
And since we are reviewing rankings I just have to take the opportunity to gloat about Perriello. I don't think anyone else publicly predicted he would win. That was a pretty awesome highlight of election night.

Yup!
You deserve full credit for that one. I recall that you were at one point engaged in a rather spirited debate with another SSPer over whether Feder or Perriello had the better shot -- well, you definitely picked the right horse there!

[ Parent ]
Feder
Ran a terrible campaign, plain and simple.

I wish I had got that guy to bet something.  


[ Parent ]
WaPo Article on Perriello's First Day
Good start for Tom. He has local blogfather Waldo Jaquith literally hunting for crow to eat.

[ Parent ]
I may have predicted a Perriello win, but i don't count
I predicted a 30-35 seat net gain, as part of a wave tsunami.  Of course, that didn't materialize.  So I don't count, even if someone digs up my predictions and says that I did.

Then again, though, there was that 47-50 poll right before election day...

party: Democratic, ideology: moderate, district: CT-01


[ Parent ]
Great post guys
That was fun to read.  And thanks for putting so much work into this - it really was great over the course of '08 to have House rankings from people whose opinions I value - reality-based opinions from people who understand the changing dynamics of how campaigns work, as opposed to inside-the-beltway types who make their predictions on how that candidate did while interviewing them.

RTW?
I can't figure this one out.  The first thing to come to mind was Ready To Wear as in the fashion/designer sense.  Nope.  Right To Work as in the Republican phrase which means no Union Shops allowed.  Nope.  So what does the acronym stand for?

PS it doesn't show in a search on your site either.


Races to Watch
The category for races that could become competitive, but hadn't at that time.

[ Parent ]
It seemed like there were many fewer
House polls this year. Nobody thought the Republicans were going to take it back, so there was no point in doing much public polling by district. We were a bit spoiled by Majority Watch and SUSA last cycle.  

SUSA put out morep olls this year than 2006
Thanks in large part to Roll Call commissioning many polls in swing districts.  But ya, Majority Watch not polling stunk.  Even if they didn't have a great record I liked seeing their polls.

[ Parent ]
I also miss SUSA's
polling approval ratings for all 50 governors and 100 Senators. They were valuable tools I used in my 2006 predictions and I really missed them in 2008.

My blog
Twitter
Scribd
28, New Democrat, Female, TX-03 (hometown CA-26)


[ Parent ]
Same here
They were polling about 15 or 20 states around election time this year, but they stopped that after the October round and don't do any 50-state polling anymore.  Guess they lost a sponsor or something.

[ Parent ]
You did GREAT
Oh you didn't get 100% right, and I'm sure you'll regret that forever (sarcasm).

But I found the point to be the continuation of a conversation on politics, local politics, as to me the Senate and especially house acan reall get specific.  To that end, you succeeded tremendously.

As a country we have been polarized for a while and probably still are, but the results indicate a swing in one direction.  One thing I learn from paying attention to a lot of this blog and the race rating in particular is the "all politics is local" mantra.

Learning/reading about the specifics of a candidate or district is an enlightening process.  20 years ago it probably wasn't even done by anyone except a person's own district, now you can come here and read about almost every district.  

We learn that party affiliation means different things in different states, and even at different levels (Running statewide as a Dem in Arkansas is easy, a Dem on the pres ticket in Arkansas is much different).  I learned that people actually care about the congressperson where I grew up (upstate NY, Gillibrand).  And so on and so on.

I guess my one lone hope not yet fulfilled is that the partisanship decreases everywhere.  As a registered Dem like most posters on here (I assume), there is too much blaming in this world based on party or candidate.  And some of the arguments in blogs get so ridiculous there almost intolerable.  I think, though, its jsut representative of society.

So, keep up the good work, and everyone on ehre has to remember we are all actually on the same team.  Every American is for a better America, a better democracy.  I'm certain of it.


Similarly, I hope for a day when
Democrats and Republicans are both competitive by offering viable, sound, and ethical solutions to problems and are truly running against each other based on who can do a better job, rather than who won't do a worse job.

party: Democratic, ideology: moderate, district: CT-01

[ Parent ]
So How'd We Do? | 27 comments

Copyright 2003-2010 Swing State Project LLC

Primary Sponsor

You're not running for second place. Is your website? See why Campaign Engine is ranked #1 in software and support among Progressive-only Internet firms. http://www.mediamezcla.com/

Menu

Make a New Account

Username:

Password:



Forget your username or password?


About the Site

SSP Resources

Blogroll

Powered by: SoapBlox