Rankings

RotoViz vs. the Machine: Pitting Staff against App Projections

RotoViz has a great new Screener App, that helps you do some sophisticated analysis and regression work in just a few clicks. Here’s an exercise I did, using the Screener to create a running back projection model, which I then compared to our composite staff projections. There are some interesting takeaways.

First, here’s how I set up the model.

filters

I’m looking only at RBs, and using data from 2010-2015. I’m also using per-game rather than per-season stats. I did that in part because fantasy is a weekly game, and weekly scoring is an important factor. But also that way players who were good on a per game basis, but missed games due to injury, get better consideration.

After some experimentation,1 I settled on these variables.

reg

My three inputs are Year N receiving yards, rushing yards, and weight; my response variable, or the thing I’m trying to project, is Year N+1 PPR points. I spent some time experimenting with different combinations of explanatory variables. These three yielded the best r-squared and p-values, without exposing the model to too much multicollinearity or overfitting.

As a brief aside, both draft position and rushing TDs were predictive if I extend the timeline back to 2000. But both lose their prediction power in more recent seasons. That seems to speak to the changing nature of the game, and suggests that NFL teams are less inclined to overvalue early-drafted RBs. It also suggests that TDs are less important for RB value, which makes sense, as I’m predicting PPR scoring. The final interesting tidbit is that the weight estimate is negative, which means that heavier is worse than lighter, when controlling for the other variables in the model.

The table below shows our staff composite rank for each RB, then the rank as predicted by the Screener App’s model. I also included the player’s per-game scoring from last season and predicted scoring for 2016. There is some regression toward the mean,2 but overall it’s useful for understanding a ballpark pecking order. Play around with the table yourself; I included a few comments of my own below.

STAFFSCREENERDIFFPLAYERPPR PREVPPR PREDPT DIFF
110Le'Veon Bell18.514.51-3.99
22119Lamar Miller14.610.9-3.7
330Devonta Freeman21.814.31-7.49
42-2Jamaal Charles2114.44-6.56
53833David Johnson13.29.12-4.08
770Todd Gurley16.213.14-3.06
84-4Adrian Peterson16.714.04-2.66
98-1Matt Forte16.512.98-3.52
10111Dion Lewis17.512.25-5.25
119-2Mark Ingram16.912.89-4.01
124230C.J. Anderson9.78.82-0.88
134128Eddie Lacy9.68.95-0.65
146-8Doug Martin15.113.6-1.5
155-10LeSean McCoy15.113.6-1.5
162711Carlos Hyde11.610.29-1.31
178467Jay Ajayi4.55.741.24
184325Duke Johnson10.38.69-1.61
19223Giovani Bernard11.310.84-0.46
205232Ryan Mathews108.19-1.81
2119-2Latavius Murray12.911.09-1.81
22308Danny Woodhead15.39.91-5.39
234825Jeremy Langford9.78.56-1.14
24328DeMarco Murray12.59.82-2.68
255631Jeremy Hill10.98.04-2.86
264014Melvin Gordon8.38.980.68
275427Ameer Abdullah7.68.130.53
2818-10Jonathan Stewart13.311.12-2.18
294718Matt Jones9.48.59-0.81
30333Rashad Jennings10.69.76-0.84
3123-8Frank Gore12.510.79-1.71
3224-8Thomas Rawls10.810.67-0.13
345925Shane Vereen9.97.75-2.15
3516-19T.J. Yeldon1311.31-1.69
365317Theo Riddick11.38.17-3.13
3734-3Charles Sims11.59.68-1.82
3814-24Chris Ivory13.811.63-2.17
3915-24Justin Forsett12.211.6-0.6
405515Javorius Allen9.38.07-1.23
42508Isaiah Crowell8.68.32-0.28
43441LeGarrette Blount10.28.67-1.53
4436-8Bilal Powell12.39.48-2.82
46515Karlos Williams11.58.21-3.29
475710Darren Sproles9.38-1.3
508535Jerick McKinnon5.25.730.53
518130C.J. Spiller6.25.92-0.28
5239-13James Starks11.19.04-2.06
537320Tevin Coleman46.612.61
556611Chris Thompson7.16.91-0.19
57625Shaun Draughn8.77.58-1.12
5912-47Darren McFadden12.512.19-0.31
6120-41DeAngelo Williams14.610.99-3.61
6213-49Chris Johnson10.111.911.81
63652Cameron Artis-Payne5.97.021.12
6431-33Charcandrick West10.49.85-0.55
6717-50Tim Hightower14.411.23-3.17
6864-4Spencer Ware9.27.25-1.95
6935-34Ronnie Hillman10.29.63-0.57
7067-3James White10.26.79-3.41
7510-65Arian Foster19.812.31-7.49

The model I built with the Screener App doesn’t know that players have switched teams or will have new roles in 2016, so a lot of the ranking differences can be taken with a grain of salt. But I think there’s still some utility in looking at some of the differences. For example:

  • Lamar Miller doesn’t fare very well in this exercise. Remember, the app doesn’t know he changed teams, but the app does predict that – all else being equal – he’d score around four points per game less this year than last because of the aforementioned regression to the mean. That doesn’t sway me from my bullish projection for Miller…but maybe it should give me pause. Miller has been really efficient with this touches, so some decline there could be expected. But I’m putting my faith in the Texans giving him a shitload of cash enough opportunity to make him one of the top RBs.
  • We’re also much higher on Eddie Lacy than the screener is. But unlike Miller, Lacy isn’t playing for a new team. All that’s changed is that he may – or may not – be in better shape. Brian Malone breaks down the risk inherent in his recent ADP.
  • David Johnson looks terrible in the Screener model, mainly because he played all 16 games, but most of them as a backup. He comes out with just the 38th-best projection, vs. the staff composite of No. 5. That type of disparity could drive you to question your assumptions, without knowledge of his situation. Mike Braude makes the pro-Johnson argument, while Josh Hermsmeyer gives the reasons to fade Johnson.
  • Thomas Rawls is another polarizing player. The Screener seems to be a fan of his per-game work last year, and projects him much higher than we do. Kevin Zatloukal has four reasons to like Rawls; Justin Winn would rather have C.J. Prosise.
  • There are a handful of backs about whom the Screener is waving a big caution flag: Jeremy Hill, Duke Johnson, Shane Vereen, C.J. Anderson, Melvin Gordon, and Ameer Abdullah. All come in much lower (15 to 30 spots) in the screener’s projection. And it’s hard to say that 2016 looks more favorable than 2015 for any of them. They’re all on the same teams, and Vereen, Anderson, and Abdullah have new competition for touches. I’m not saying they’ll be busts. Gordon has literally nowhere to go but up, and it makes sense to think that Johnson could build on a solid rookie year. But the Screener definitely has me re-thinking these guys.
  • It’s not all doom and gloom. Doug Martin, LeSean McCoyand Jonathan Stewart all look undervalued in the Screener’s model. Another player the Screener likes a lot is Frank Gore.
  • We’re projecting Justin Forsett as RB39, which exactly matches his current best ball ADP. But the screener sees him as RB15. Yes, I know the backfield situation in Baltimore is murky. But isn’t “Forsett is the lead back” one of the possible outcomes? That means he’s priced at his floor, with a lot of upside potential.

Conclusion

Fantasy Douche wrote a great article about the importance of aggregating ideas. I put a lot of stock in our staff projections: a lot of great guys put a lot of deep thought into them. But it’s also important to stay open to other ideas. This exercise will have me re-thinking a few players. Try out the Screener App (or, for a more casual approach, the Sim Apps) to build your own projection model.

Subscribe for a constant stream of league-beating articles available only with a Premium Pass.

  1. H/T Rotodoc, who gave me some good guidance.  (back)
  2. In other words, high performers project to score less than last year, and low performers project to score more than last year.  (back)
By Charles Kleinheksel | @ | Archive

Comments   Add comment