Go to file
2024-04-14 21:42:38 -04:00
data tweak degree of injected uncertainty: reduce it overall & in non-battleground states 2024-04-14 21:33:42 -04:00
go.mod add hello world 2024-04-13 10:22:28 -04:00
main.go move glue code function to the end 2024-04-14 21:42:38 -04:00
makefile remove histogram from readme & continue 2024-04-14 16:01:34 -04:00
output tweak degree of injected uncertainty: reduce it overall & in non-battleground states 2024-04-14 21:33:42 -04:00
output.txt tweak degree of injected uncertainty: reduce it overall & in non-battleground states 2024-04-14 21:33:42 -04:00
README.md tweak degree of injected uncertainty: reduce it overall & in non-battleground states 2024-04-14 21:33:42 -04:00
scratchpad.txt add some data from gallup, reorg 2024-04-14 19:10:01 -04:00

Simple electoral college simulator

About

This is a simple model of the US electoral college. It aims to be conceptually simple and replicatable. Currently, it incorporates data from state specific polls, and otherwise defaults to the state's electoral history baserate.

Other projects, like 538, Nate Silver's substack or Gelman's model are to this project as a sportscar is to a walking stick. They are much more sophisticated, and probably more accurate. However, they are also more difficult to understand and to maintain.

Compare with: Nuño's simple node version manager, squiggle.c, Predict, Resolve & Tally

How to run

Prerequisites

This model is written in go, an elegant language developed by Rob Pike, Ken Thompson and Robert Griesemer at Google. You can find installation instructions for all major platforms here. In addition, it uses git for distribution. You can find installation instructions for git here.

You can thus get the model with:

git clone https://git.nunosempere.com/NunoSempere/2024-election-modelling
cd 2024-election-modelling
go install

And run the model with:

go run main.go

In addition, on Linux you can update the polls with make:

make polls

What stories does the model tell?

The naïve baserate story

Consider Ohio. Bush won the state in 2000 and 2004, Obama in 2008 and 2012, and Trump again in 2016 and 2020. The base rate, the historical frequency for republicans in Ohio is therefore 4/6.

A straightforward way of getting at a probability of an electoral college win is to just take the historical frequency for each state, and sample from it many times, and then build up the different electoral college results from those samples.

If we do so, however, Republicans end up with only a 25% chance of winning the 2024 election.

Why is this? Well, consider the number of electoral college votes in the last few elections:

Year Republican electoral college votes Democrat electoral college votes
2000 271 266
2004 286 251
2008 173 365
2012 206 332
2016 304 227
2020 232 232

Essentially, Obama won by much more than Bush, Trump or Biden. But our naïve model doesn't see that those results were correlated.

So the story here is that our model is not very sophisticated. But another might be that Obama was much more popular than Biden, and if Democrats can tap into that again, they will do better.

Still, for states in which there is no polling, the electoral history seems like a decent enough proxy: these are the states which are solid Republican or solid Democrat.

The unadjusted polls story

If we only look at polls (and use baserates when there are no polls—which happens for states like Alabama, which lean strongly towards one party already), this time the Republicans win by a mile: with 95% probability.

What's happening here is that:

  • There aren't that many polls yet
  • For the polls that do exist, Trump polling very well in Pennsylvania, Wisconsin, Arizona, Michigan, Florida, Nevada, Georgia, North Carolina
    • Trump is also polling decently in Minessota; Biden is polling well in Colorado
  • In part, this is because Biden is just unpopular, or at least more than Trump
  • In part though, polls currently also ask about the third party vote: for Robert F. Kennedy, Kayne West and Jill Stein (Green party).
    • In a normal democracy, like in Spain, a protest party could amass some electors, and use them as bargaining chips to govern together with one of the other major parties. For instance, this is what happened with Ciudadanos in Spain. Perhaps third parties performing strongly could conceivably, create pressure to reform the US electoral system.
    • In the US, with the system as currently exists, these votes seem to favour Trump.

However, this 95% really doesn't feel right. It is only accounting, and very naively, for the sample size of the poll. It not only assumes that the poll is a representative sample, it also assumes that opinions will not drift between now and election time. This later assumption is fatal.

The adjusted polls story

If we look at how Gallup presidential election polls did between 1936 and 2008, we get a sense that polls in mid April just aren't very informative as to the eventual result. Doing the tally, for republicans, polls have a standard error of 4-5 points: huge when races in battleground states tend to be close to 50/50 (49/51, 48/52, 47/53, etc.)

Moreover, these are national polls: polls in battleground states will have smaller samples and thus more uncertainty. And current pollsters are nor as good as gallup. And... there might be other sources of uncertainty that I'm missing. On the other hand, we have increased polarization, not all states are battleground states, and this variable seems like it requires a bit of finesse.

But incorporating reasonable estimates of uncertainty, the probability of a republican win the model gives is 50-60%. This does depend on how much uncertainty you inject. If you inject a lot of uncertainty, it moves closer to 50%. But on the other hand, one has to take care to not inject too much uncertainty, even for sure states, like, say, Alabama. This is now in line with prediction markets.

Notes on other models

FiveThirtyEight 2020, 2016

Notes on 2020 model:

  • Adjusted for COVID pandemic
    • Manually increased uncertainty
  • More fundamentals
    • Looking back until 1880
  • Adjustments for changed partisanship
  • Covariance between states based on similarity metrics
  • Changes on how easy it is to vote
  • Polling averages. Explained further here
    • Polls as capturing a snapshot. Uncertainty should increase. Things can happen between now and the election.
    • Weighted by pollster performance
    • Trend line of the polls
    • Likely voter adjustment
    • Polling house adjustment
    • "CANTOR" similarity scores
    • "swinginess" of a state
    • recency adjustments
  • Adjustements after major events. Debates, conventions, VP picks
  • Demographics, past voting patterns
  • Priors
    • Incumbency
    • Economic conditiosn
  • Partisan lean: in the last two elections
    • In our partisan lean index, 75 percent of the weight is assigned to 2016 and 25 percent to 2012. So note, for example, that Ohio (which turned much redder between 2012 and 2016) is not necessarily expected to continue to become redder
    • Home states of president and VP
  • Various complicated regressions
    • One simple one is: polling for Northeast, Midwest, south, west
  • Ensemble forecast + polling average
    • Weight depends on quantity of polling
    • 55% to polling average in August
    • 97% to well polled states towards the end of the campaign
  • Fundamentals based on economics
  • Index of economic conditions
    • nonfarm payrolls
    • spending
    • income
    • manufacturing
    • inflation
    • stock market
    • normalized, weighted for recency
  • other factors
    • incumbency
    • polarization
  • forecast of those economic variables
  • relatively little weight to fundamentals, declining to zero by election day
    • August: 77% to polling ensemble, 23% fundamentals
  • Accounting for uncertainty:
    • national drift. Constant x (Days Until Election)^⅓ x Uncertainty Index
    • national election day error. Errors in final polls since 1936.
      • this is key, and tractable. source
      • More difficult to do this state by state, but it's a start
      • Also doable in advance
    • correlated state error
      • also key
      • based on demographics
    • state-specific error
  • Uncertainty index. Its own involved thing.
  • 40,000 simulations each time the model is updated.
    • This is relatively little, compared to my 10M
  • Not account for probability of faithless electors, nor shenanigans

Gelman

Roadmap

It's not clear to me what I will do with this. After starting to program this, I realized that creating a model that was in the same ballpark as The Economist's or 538's would just be too much effort. After adding national drift + election day error + idiosyncratic error terms, this isn't quite at the 80/20 stage, but it feels like it's at a good point, and I may just leave it here.

To do

General:

  • Adjust polls only for states which are legitimately uncertain, not in general
  • Think about whether I want to monetize this
    • Maybe with Vox?
    • Otherwise: add MIT license & publish
  • Think about whether I want to add other collaborators
    • If so, add contribution sections, make available on github

Steps to make this more accurate:

  • Better prior by incorporating more past elections
  • Think about how to:
    • Inject error
    • Inject correlated error
  • Think about correlation between states.
    • How?
    • Consider conditional probabilities
    • See how other models account for the correlation
  • Add more years
  • Polling company errors
  • Economic fundamentals?

Done

Incorporate base rates:

  • Get past electoral college results since 2000
  • Get number of electors for each state with the new census
  • Combine the two to get an initial base rates analysis

Consider polls:

  • Download and format
  • Read
  • Add date of poll
  • Consider what the standards error should be
  • Consider how to aggregate polls?
    • One extreme: Just look at the most recent one
    • Another extreme: Aggregate very naïvely, add up all samples together?
  • Aggregate polls?
  • Exclude polls older than one month?
  • Inspect polling stderrs

Uncertainty

  • Implement key possible next steps:
    • Uncertainty due to drift between now and the election
    • Uncertainty due to difference between last election poll and final vote share

General

  • Work on README
  • Print states & polls separately
  • Histogram distributions of electoral college votes
  • Think about next steps
  • Get clarity on next steps
  • Make polling errors wider?
  • Print more data for polls
  • Share with Samotsvety

Discarded

  • Add uncertainty using Laplace's law of succession?
    • Maybe only do this for contested states? Alabama is not going to turn Democratic?
  • Exclude partisan polls => not that many of them