{"id":3020,"date":"2011-05-03T13:26:00","date_gmt":"2011-05-03T17:26:00","guid":{"rendered":"http:\/\/www.calgarygrit.ca\/?p=3020"},"modified":"2012-05-29T16:45:32","modified_gmt":"2012-05-29T20:45:32","slug":"predicting-the-unexpected","status":"publish","type":"post","link":"https:\/\/www.calgarygrit.ca\/?p=3020","title":{"rendered":"Predicting the Unexpected"},"content":{"rendered":"<p>I&#8217;ll announce the winners from my <a href=\"http:\/\/calgarygrit.blogspot.com\/2011\/03\/calgary-grit-election-pool-20-questions.html\">election pool<\/a> later this week. One of the questions there asked which polling company&#8217;s final poll numbers would hit closest to the mark.<\/p>\n<p>You can browse the numbers <a href=\"http:\/\/calgarygrit.blogspot.com\/2011\/05\/polls-projections-predictions.html\">here<\/a>. To pick a winner, I simply added up the difference between their numbers and the results, producing the following:<\/p>\n<p><strong><a href=\"http:\/\/www.angus-reid.com\/wp-content\/uploads\/2011\/04\/2011.04.30_FedPoli_CAN.pdf\">Angus Reid<\/a><\/strong>: 5.2%<br \/><strong><a href=\"http:\/\/www.nanosresearch.com\/election2011\/20110501-BallotE.pdf\">Nanos<\/a><\/strong>: 5.5%<br \/><strong><a href=\"http:\/\/www.ipsos-na.com\/news-polls\/pressrelease.aspx?id=5224\">Ipsos<\/a><\/strong>: 6.0%<br \/><strong><a href=\"http:\/\/www.harrisdecima.ca\/sites\/default\/files\/releases\/2011\/05\/01\/hd-2011-05-01-en1163.pdf\">Decima<\/a><\/strong>: 6.4%<br \/><strong><a href=\"http:\/\/www.legermarketing.com\/documents\/POL\/114301ENG.pdf\">Leger<\/a><\/strong>: 7.2%<br \/><strong><a href=\"http:\/\/abacusdata.ca\/wp-content\/uploads\/2011\/05\/Ballot-May-1-2011.pdf\">Abacus<\/a><\/strong>: 9.0%<br \/><strong><a href=\"http:\/\/www.thehilltimes.ca\/dailyupdate\/view\/ndp_tories_in_virtual_dead_heat_either_party_could_form_minority_government_says_forum_research_poll_05-01-2011\">Forum<\/a><\/strong>: approx 9% (<em>BQ and Green numbers extrapolated<\/em>)<br \/><strong><a href=\"http:\/\/www.ekospolitics.com\/wp-content\/uploads\/full_report_may_1_2011.pdf\">Ekos<\/a><\/strong>: 10.3%<br \/><strong><a href=\"http:\/\/compas.ca\/data\/110501-FedElectionPoll-EPCB.pdf\">Compass<\/a><\/strong>: 14.0%<\/p>\n<p>So congrats to those of you who picked Angus. The top 6 companies on that list were within the margin of error on their numbers, so they too deserve a round of applause.<\/p>\n<p>As for the <a href=\"http:\/\/calgarygrit.blogspot.com\/2011\/05\/polls-projections-predictions.html\">seat projections<\/a>, here&#8217;s the total seat miss:<\/p>\n<p><strong><a href=\"http:\/\/www.ridingbyriding.ca\/2011\/05\/01\/1055\">Riding by Riding<\/a><\/strong>: 52<br \/><strong><a href=\"http:\/\/www.wlu.ca\/lispop\/seatprojections.html\">LISPOP<\/a><\/strong>: 56<br \/><strong><a href=\"http:\/\/calgarygrit.blogspot.com\/2011\/05\/final-seat-projections.html\">Calgary Grit<\/a><\/strong>: 56<br \/><strong><a href=\"http:\/\/www.ekospolitics.com\/index.php\/2011\/05\/our-final-words-and-a-few-more-numbers-may-1-2011\/\">Ekos<\/a><\/strong>: 58<br \/><strong><a href=\"http:\/\/www.democraticspace.com\/canada2011\/\">Democratic Space<\/a><\/strong>: 58<br \/><strong><a href=\"http:\/\/www.trendlines.ca\/\">Trendlines<\/a><\/strong>: 59<br \/><strong><a href=\"http:\/\/threehundredeight.blogspot.com\/2011\/05\/final-projection-conservative-minority.html\">308.com<\/a><\/strong>: 98<br \/><strong><a href=\"http:\/\/www.electionprediction.org\/2009_fed\/index.php\">Election Prediction Project<\/a><\/strong>: 118<\/p>\n<p>So a similar performance by all the mathematical models, except for 308 who has already offered a brief <a href=\"http:\/\/threehundredeight.blogspot.com\/2011\/05\/projection-vs-results.html\">post mortem<\/a>. I will add that my <em>prediction<\/em> was further off the mark from my <em>projection<\/em> &#8211; I made the same faulty assumptions as the EPP did, assuming strong incumbents could hold their seats.<\/p>\n<p>The largest problem with my projection was the polls it fed off &#8211; specifically the low Conservative numbers (which I did <a href=\"http:\/\/calgarygrit.blogspot.com\/2011\/05\/final-seat-projections.html\">foresee as a potential problem<\/a>). If I plug the actual numbers in, my model projects: CPC 168.8, NDP 94.6, Lib 34.0, Bloc 10.1. The regional splits break down nicely too, except for Quebec where I&#8217;m a bit high on the Bloc and low on the NDP.<\/p>\n<p>But this model was supposed to handle pollsters missing the mark. A few of the results fell outside the 95% confidence interval so this is, as Jack Layton would say, a hash tag fail.<\/p>\n<p>I&#8217;ll put this one to bed for a bit and start tinkering again over the summer, but I think this speaks to the limitations of <em>any<\/em> seat projection model. They&#8217;re useful tools, but it&#8217;s incredibly naive to assume they can predict the total seat count, much less individual riding results.<\/p>\n<p>But that&#8217;s ok. If they worked, it would make election nights a bore.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>I&#8217;ll announce the winners from my election pool later this week. One of the questions there asked which polling company&#8217;s final poll numbers would hit closest to the mark. You can browse the numbers here. To pick a winner, I simply added up the difference between their numbers and the results, producing the following: Angus [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"footnotes":""},"categories":[1019,983,11,411],"tags":[],"class_list":["post-3020","post","type-post","status-publish","format-standard","hentry","category-2011-federal-election","category-federal-politics","category-polls","category-seat-projections"],"_links":{"self":[{"href":"https:\/\/www.calgarygrit.ca\/index.php?rest_route=\/wp\/v2\/posts\/3020","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.calgarygrit.ca\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.calgarygrit.ca\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.calgarygrit.ca\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.calgarygrit.ca\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=3020"}],"version-history":[{"count":1,"href":"https:\/\/www.calgarygrit.ca\/index.php?rest_route=\/wp\/v2\/posts\/3020\/revisions"}],"predecessor-version":[{"id":3561,"href":"https:\/\/www.calgarygrit.ca\/index.php?rest_route=\/wp\/v2\/posts\/3020\/revisions\/3561"}],"wp:attachment":[{"href":"https:\/\/www.calgarygrit.ca\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=3020"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.calgarygrit.ca\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=3020"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.calgarygrit.ca\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=3020"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}