Earlier this week TSN announced the creation of an Analytics team consisting of long-time TSN contributor Scott Cullen along with new TSN additions of Globe and Mail’s James Mirtle and hockey blogger Travis Yost. I am all for main stream media jumping on board with hockey analytics but once you go from independent hockey blogger to a significant contributor to TSN I think it opens the door to higher expectations and higher standards. Scott Cullen has a long track record with TSN and I am confident James Mirtle will bring some intelligent insight as we are all familar with and respect his work. While I am fully aware of Yost and his blogging history I have to be honest in saying that I have not read a ton of his stuff so I was interested to see what he would offer. After reading his first two articles, I have to say I definitely think there is room for improvement.
Yost’s first article was a look at some trends as to how teams use players during 5 on 5 play. The point I think Yost was trying to make most is that teams are phasing out goons and other “specialists” and replacing them with guys that can play bigger minutes and at both ends of the rink. While this may very well be true I am not sure Yost’s evidence to support this is really valid. He produced a chart that showed that more players are getting more 5v5 ice time per game in 2013-14 than in 2007-08 and his conclusion was that this was evidence of teams moving away from goons and small ice time players.
The rightward shift here should seem apparent – a higher concentration of guys playing larger minutes now as opposed to seven years ago and fewer guys picking up scrap minutes in smaller roles. The number of forwards playing ten or less minutes a night has dropped from 109 in 2007, to 65 in 2014. And the number of forwards playing between 13 and 16 minutes a night has moved from 153 in 2007 to 231 in 2014. As a group, teams may still be leaning on their star players, but there’s also been a more balanced spread of total ice time than there was seven years ago.
First off, the rightward shift that Yost talks about is likely almost exclusively due to the fact that there were far fewer penalties and power plays in 2013-14 than there were in 2007-08 as Yost pointed out earlier. This lead to there being more even strength ice time to be doled out to the same number of players. This will almost certainly produce a right shift as observed. As for a more balanced spread in ice time, I don’t see that either. At least not to any significant extent. If one really wanted to look at this properly instead of looking at number of minutes of even strength ice time played one would want to look at percentage of a teams even strength minutes the player played. This would eliminate the difference in total even strength ice time and truly allow you to see whether teams are using a more balanced line up or not. At the very least one should adjust each players ES TOI by an appropriate amount for one of the seasons based on the ratio of league-wide ES TOI between the two seasons. I’d then be interested to see if a “right shift” occurs or whether there is a meaningful difference in the charts.
Yost’s second article for TSN.ca was about Marc-Edouard Vlasic and how he should probably be getting more recognition for how good he really is. Now that is a sentiment I can generally support but Yost’s supporting evidence for this is analytically unsound in my opinion. The first thing Yost does is identify a number of defensemen who are generally considered the leagues best that we should compare Vlasic too. This is a good start and Yost identified guys like Chara, Doughty, Karlsson, Pietrangelo, Subban, etc. What Yost did next is produce a bubble chart that plots even strength corsi% on the x-axis vs even strength goals % on the y-axis with bubble size representing scoring production. To be honest, I have no clue what the value of this chart is. Both corsi% and goal% are significantly team driven but there was no accounting for quality of team and goal% has a certain amount of luck and randomness associated with it which was not discussed and I really have no idea what statistic was used for scoring production. The conclusion Yost drew from this chart was that Vlasic was right in the mix with some of the best defensemen in the league. Problem is I am certain I could find a number of other defensemen we generally consider mediocre that would be right there with Vlasic.
There are proper ways to do this kind of analysis and there is no way one can do this without taking into consideration quality of teammates. On my stats site I have teammate statistics (denoted by TM) and one can easily do a comparison of how the players on-ice stats compare to their teammates when their teammates are not playing with them. Doing this we get the following:
|Player Name||CF60 RelTM|
If we use CF60 as a proxy for offensive production we find the best offensive defensemen are Karlsson, Keith and Pietrangelo while the least offensive are Suter, Chara and Doughty. Vlasic is right in the middle and looks pretty good. One might be surprised at Doughty but the rest kind of make sense.
Now, let’s do the same for CA60.
|Player Name||CA60 RelTM|
For CA60 it is better to have a negative number as this indicates you are giving up fewer shot attempts than your teammates when they aren’t playing with you. Here Vlasic is second and looking pretty good.
Now we can combine these two stats by looking at CF% RelTM.
|Player Name||CF% RelTM|
Out of this group, Vlasic is second best which is pretty good and is evidence that he probably deserves to be in the company of these guys. Now, with that said, this is just a cursory look and in no way a complete analysis. Not only are there limitations by just looking at corsi but there are a lot of other factors that need to be taken into consideration as well (for example, Giordano is probably not that good, only looks good because his Flames teammates are not very good relative to the teammates of the other players on this list). Overall though, this is how I think one should start an analysis of Vlasic and whether he deserves more credit for the player he is. To be fair to Yost, he gets into this a little bit by looking at a timeseries of Vlasic’s Relative Corsi% but in no way is this sufficient and he doesn’t compare it to any of the other defensemen he is comparing Vlasic to.
Overall I applaud TSN for wanting to jump on the analytics band wagon and I am certain Yost has the potential to provide a better analytical view than his first few posts which, to be honest, left me a little underwhelmed if not disappointed.
On the flip side, I saw some good stuff written recently by @MimicoHero that I think is worthy of mention. A recent blog post of his looked at Ryan Johansen’s value to the Blue Jackets and he, in my opinion, did a pretty good job of accounting for usage (i.e. QoT, QoC, zone starts) and comparing Johansen to his peers. I like the tables he produced and how he looked at offense and defense separately. Now I’d probably want to weight QoT far more heavily in the usage metric he came up with but overall a very good methodology for comparing players on different teams playing in different circumstances.