Wednesday, February 4, 2015

The Best in Research Narratives: Let's Talk Football

I’ve written in the past about journalists who get data storytelling so, so wrong.  But every now and then, they get it so, so right. As we reflect back on the recent Super Bowl hoopla, from the Patriots’ Deflategate, to cries for Pete Carroll’s resignation, it seems a great time to  shed light on two sports pieces that caught my attention as brilliant pieces of data storytelling.

First up: that New England team with the deflated balls. Slate did a spectacular job of building a narrative that makes you think, “Dear lord, have they been doing this for 8 seasons? And is Tom Brady behind it, even if unwittingly so?”

You can click here to read the article. Here’s what works so nicely about it.
  • It starts with a hypothesis – that if the Patriots cheated, we might see a difference in their fumble performance before vs. after 2006 rule change on which team provides the game ball. Yes, it’s fundamental hypothesis testing! In a sports news article!
  • It builds the story around a clear metric – fumbles (turnovers) – and explains logically why this metric is the most valuable one to look at.
  • It offers compelling data driven evidence,  that controls for potential covariates – including overall changes in league trends, the impact of individual players, and the confound of indoor stadium settings. It’s like this guy actually took a stats class, or five.
  • It visualizes that data in a way that makes the pattern alarmingly obvious.
  • It offers comparisons - actually educating readers by explaining probability, and what distribution we’d expect to see if there weren’t something fishy taking place.
  • It explains the outlier data – in this case in a way that serves to support the thesis that, well, the Patriots may have cheated.
  • It uses classic storytelling tactics: much like a movie, we have a hero (in this case, a champion quarterback) who might be a potential martyr and catalyst for this conflict. Thank you Tom Brady.

I’m not saying the Patriots cheated, and frankly, I’m not enough of an NFL fan to care. But I will say that whether or not they did, this analysis of the situation provides a compelling argument that they did something different that they’re not admitting. And that’s something investigators would be negligent to ignore. Bravo, Slate.

Next up is Pete Carroll’s 1 yard line call, AKA: the call that every Monday Morning Quarterback protested. Except my pal Rob Pait (read his clever take here) and FiveThirtyEight.com.

If you like data storytelling, you should probably just go ahead and bookmark FiveThirtyEight.com right now. Lots of people found it necessary to pontificate about the risk of Carroll’s pass play, without actually providing any data to back up that risk assessment. Five Thirty Eight actually bothered to do some math.  [insert slow clap here.]

Here’s what I love about this analysis, which concludes that the perceived risk of the ultimately wayward call is far greater than the actual risk.
  1. It starts with a great, contentious, catchy headline. I know, clickbait, blah blah. But they actually come back to the headline and address it in the end. And even though questioning Belichick is really a secondary point, they do eventually make that point, while making an even better one along the way.
  2. The article starts off by painting a gripping picture of that last minute in the game, making you feel the urgency and pressure of the situation. It’s great writing. And can we, for just a moment, congratulate statisticians on being capable writers? Thank you, data analysts of Five Thirty Eight, for taking the time to learn communication skills. And thank you, journalists, for learning how to analyze and interpret data. May others follow in your footsteps.
  3. It provides a hilariously clever villain: Harvard. The article tees up two data tweets from Harvard Sports as darn compelling. And then slowly, meticulously, the author unravels how misguided the tweets really are when you don’t look at the entire context. I should confess that I went to Cornell, and thus embrace any chance to snort in the general direction of Harvard sports. But even if this had been my own alma mater, I would have been impressed by the way the writer set the stage and then tore it down.
  4. It addresses what most other analyses did not, namely the actual success stats of running vs. passing, and the objective of not only scoring, but running down the clock. Yes, there’s some estimating that needs to be done here, but the estimations are better than just blissfully ignoring these contextual confounds.
  5. It mixes qualitative and quantitative assessment, with a touch of game theory. In this world of data analytics, we sometimes forget that the most powerful research insights are often gleaned from combining methodological approaches.  What makes this article so powerful is that it doesn’t choose one type of method – it uses them all. It constructs an argument that thinks through the “if then” Boolean logic that a coach would utilize. It qualitatively assesses the pros and cons of those alternatives. And then it puts some data behind those arguments.

Back in college, my academic adviser talked me out of taking a media research class because it was “beneath me.” I thought it was terrible advice even at the time, so I took journalism instead, and then went on to roll my eyes as I started a company specializing precisely in the topic of media research . But that’s exactly why I love these examples of truly compelling data storytelling – it overcomes the “us vs. them” nonsense that many data-oriented academics will espouse to impressionable students who nobly want to learn to communicate.

So, thank you Slate and Five Thirty Eight. May thoughtful data storytelling and true research narratives become the way of the future.

24 comments:

  1. Ironically, FiveThirtyEigfht debunked the Slate's analysis here:

    http://fivethirtyeight.com/datalab/your-guide-to-deflate-gateballghazi-related-statistical-analyses/

    ReplyDelete
  2. Thanks for commenting, Chris. Ironic indeed, though I wouldn't say they debunked it. (Their counterpoint seems to be in response to the author's original post on his own website, not to the followup article in Slate - which doesn't reference some of the stats they call into question.) In the Slate article I referenced, the takeaway isn't that the team cheated, but rather that their performance appears to have changed notably, at a point in time that aligns with a rule change they advocated for. The debunking analyses don't seem to deny that, but more often question his method without coming to a markedly different conclusion.

    ReplyDelete
  3. Wonderful blog! I truly love how it’s easy on my eyes as well as the info are well written.

    Opher Brayer

    ReplyDelete
  4. This is one of the most wonderful blog, this is work is tremendous. Thanks
    xbox live 12 month code

    ReplyDelete
  5. Really!!! I am very impressed after reading this blog. thanks for providing deep information for
    challenging puzzle for web-developers

    ReplyDelete
  6. I was very pleased to find this site.I wanted to thank you for this great read!! I definitely enjoying every little bit of it and I have you bookmarked to check out new stuff you post.
    wii accessories canada

    ReplyDelete
  7. I wanted to thank you for this great blog! I really enjoying every little bit of it and I have you bookmarked to check out new stuff you post.
    destiny dlc

    ReplyDelete
  8. It was another joy to see your post. It is such an important topic and ignored by so many, even professionals. I thank you to help making people more aware of possible issues. Great stuff as usual...
    clash royale free gems

    ReplyDelete
  9. I think this post will be a fine read for my blog readers too, could you please allow me to post a link to my blog. I am sure my guests will find that very useful.
    excellent service

    ReplyDelete
  10. Good article.
    I think the potential profits come along with new technology and those people or companies who are able to implement it will win the market. For instance, virtual data room services (at virtual data rooms comparison) are known to replace old-fashioned ineffective physical data rooms.

    ReplyDelete
  11. yes it would be, once my friend gave me lecture about modesty it was amazing and heart touching.
    ice hockey

    ReplyDelete
  12. If you could message me with any hints & tips on how you made your blog look this cool, I would be appreciative!
    sci fi visual novel

    ReplyDelete
  13. This is one of the most incredible blogs Ive read in a very long time. The amount of information in here is stunning, like you practically wrote the book on the subject. Your blog is great for anyone who wants to understand this subject more. Great stuff; please keep it up!
    Esoterik

    ReplyDelete
  14. Really informative and cool blog.I truly appreciate your work.
    clash of clans bot

    ReplyDelete
  15. Valuable information! Looking forward to seeing your notes posted.
    wearabletech

    ReplyDelete
  16. I wanted to thank you for this great blog! I really enjoying every little bit of it and I have you bookmarked to check out new stuff you post.
    Clash of Clans Cheats

    ReplyDelete
  17. It was another joy to see your post. It is such an important topic and ignored by so many, even professionals. I thank you to help making people more aware of possible issues. Great stuff as usual...
    Scaredy Cat Compilation

    ReplyDelete
  18. Thanks for sharing your brilliant knowledge with us.I am really impressed.
    Call of Duty: Black OPS 3

    ReplyDelete
  19. Thank you so much for sharing this really amazing post,
    matching

    ReplyDelete
  20. Nice article and informative as well. for few of people like me this article is really helpful for play games.
    buy cheap gaming pc

    ReplyDelete
  21. Thanks for taking the time to discuss that, I really feel strongly about it and love learning more on that topic. If achievable, as you gain competence, would you mind updating your blog with more information? It is highly helpful for me.
    spiele

    ReplyDelete
  22. Hi guys,
    Thank you so much for this wonderful article really!
    If someone want to know more about the Find A CTO I think this is the right place for you!

    ReplyDelete