This post will compare the accuracy of my final projection with that of others that were freely available during the campaign. For a region-by-region analysis of how my projection fared, click here. Once again, the websites mentioned here are linked through the left bar.
Here are the eight final projections that were based on an average of polls (C-N-L-B-G-I):
148-100-44-14-1-1 (The Mace)
152- 94-46-15-0-1 (Canadian Election Watch)
142-114-39-12-0-1 (Riding by Riding)
151- 91-47-18-0-1 (Calgary Grit)
144- 98-51-15-0-0 (LISPOP)
155- 86-47-20-0-0 (democraticSPACE)
143- 93-58-14-0-0 (Too Close to Call)
143- 78-60-27-0-0 (ThreeHundredEight.com)
First, I would like to congratulate democraticSPACE for being the only model projecting a Conservative majority. On that front, I fared honourably by having the second highest Conservative seat count. Four websites estimated the probability of a Conservative majority. Obviously, democraticSPACE had the highest, right around 50%. Canadian Election Watch said it would occur with a 45% chance, while Calgary Grit had 28%, and The Mace, 13%.
Although the Conservative seat count was the most politically relevant figure to project, to get a sense of the overall quality of a projection, one needs to look at the other numbers as well. Below is half of the total deviation of each of the above eight projections. (This is the sum of the absolute value of the difference between the projected and the actual result for each of the parties and independents. It is divided by 2 because, by definition, it is always even.)
21 (The Mace)
24 (Canadian Election Watch)
26 (Riding by Riding)
28 (Calgary Grit)
28 (LISPOP)
29 (democraticSPACE)
34 (Too Close to Call)
49 (ThreeHundredEight.com)
Once again, Canadian Election Watch comes in a strong second, this time behind The Mace. democraticSPACE actually did not do too well, placing sixth. Interestingly, the two prognosticators with newspaper columns fared worst… (Of course, Éric and Bryan still have great websites with interesting content.)
If you average the above two measures of success (Conservative seat count and half total deviation), Canadian Election Watch comes in first! I’m not going to use this to declare victory, but I think there’s a strong case for saying that I gave at least as accurate a portrayal of the overall situation as any other projection.
I also note that EKOS, which projected 138-113-41-15-1, has a half total deviation of 29, slightly worse than most of the projections above based on multiple polls.
Now, it is true that seat projections based on polls did not do too well due to poll inaccuracy. Would relying on intuition and other information have been better? To look at that, I compiled the following relatively better publicized projections that were obtained via other methods:
151-86-45-24-1-1 (Andrew Coyne)
156-76-46-30-0-0 (Steven Britton)
146-83-55-22-1-1 (Dan Arnold, aka Calgary Grit)
152-71-52-31-0-2 (Bernard von Schulmann, aka BC Iconoclast, April 25)
146-65-63-33-0-1 (Election Prediction Project)
156-46-60-46-0-1 (Glen McGregor, April 29)
Two of these called for a bare Conservative majority, but in both cases, the NDP was very low, and the Bloc was absurdly high. The half deviations were as follows:
32 (Andrew Coyne)
38 (Steven Britton)
40 (Dan Arnold, aka Calgary Grit)
47 (Bernard von Schulmann, aka BC Iconoclast, April 25)
59 (Election Prediction Project)
69 (Glen McGregor)
The striking thing here is that everyone did worse than most projections based on polling averages. Thus, while relying on polls is far from perfect, it still gives us a better idea of what’s going on than letting “gut” and “instinct” cloud one’s judgment. Obviously, some prognosticators probably did predict 167 Tory seats (one of the commenters here was close, with 170). However, the above numbers suggest that in most cases, taking poll numbers seriously, even when they’re significantly off, is still helpful.
What about riding-by-riding predictions? As far as I know, 7 of the above projectors bothered making a call for each of the 308 races (democraticSPACE also did so for most of them, but did not call some close races). Here is the number correct for each:
260 (Canadian Election Watch)
256 (Riding by Riding)
250 (Steven Britton)
243 (Too Close to Call)
235 (ThreeHundredEight.com)
235 (Election Prediction Project)
217 (Glen McGregor)
Once again, Canadian Election Watch performs strongly, this time coming out on top. I’m particularly proud of my projections for BC, where I registered 34/36. The two predictions that relied the least on polls were the worst. In fact, the four most widely known ones came out at the bottom. So while everyone, myself included, did pretty poorly, we still did better than the media will give us credit for.
So where does this leave us? As I’ve emphasized above, while these results are far from satisfying for election projectors, they still point to the value of relying on the hard data provided by imperfect polls. None of the 7 “soft” (i.e. not based on a numerical model) projections had the Bloc below 22 seats, while 5 of the 8 projections using models had it at 15 or fewer.
As for myself, I’m obviously not thrilled about the absolute result, but very satisfied about how I fared compared to others. Moreover, I’m glad that some of the major issues emphasized on this blog and little discussed elsewhere, such as massive Conservative gains the GTA area, the efficiency of the NDP surge in Québec and the ballot box penalty for the Bloc, all came to pass.
It was my goal to provide you with the most accurate and up-to-date coverage of voter intentions and seat implications for the 41st General Election, and I believe that in many ways, I have succeeded. I hope that you agree, and that you will check back sporadically over the next few years for more political coverage and insights. In fact, please check back over the next few days: I will be analyzing the possible implications of these results as I digest them.