I tried to find out exactly how this mysterious 1st5R works. I was curious to see what is evaluated and how. This is what I found, as explained by the person who developed it:
1. "Hi everyone, Stephen Ryan here the formula's creator,
Glad to see you guys (mostly) like it, if you have any questions about 1st5R I'll be happy to answer them or you can find me on twitter @
1st5R.
My aim with this was to generate debate about who should wear the All Blacks number 10 Jersey at the rugby world cup considering Carter, Barrett, Slade and Cruden are all really good options, but it works well for keeping tabs on 10s from other teams that you might not get to see the games of."
2.
(A response to no 1, above) "it's a nice piece of analysis, but it is difficult to quantify performance, do you mind sharing a bit about how the marks are assigned?"
3.
(Reply to no 2, above). Its a scale from 1-100 where 50 is (approximately) the average score based on the average stats of the 252 40+ minute super rugby games played by 1st 5's in 2014. So if a player gets the average stats, he gets a score of 50, gets more than average its above 50, if he gets less its below. (Side note, in the early running of 2015, average stats across the board are down from 2014)
There are 11 categories a player can contribute to his overall rating, tries, running, line breaks, turnovers, tackling, goal kicking (not included obviously for players like Matt Toomua), territory kicking, possession kicking, kick errors, attacking work rate and defensive work rate.
Each category is broken down into different stats has a different weighting to match its overall impact on the game,
(My own note....This, IMO, is a big red light. The moment that you start playing around with weighted values, in stats, it starts becoming a bit scary. Who decides those weights and how are they decided?)e.g. tries/try assists are worth more than line breaks/assists.
Each category has a minimum and maximum amount of points, so a player who only does one thing, but does that one thing brilliantly he won't get a brilliant score. If someone scores 6 tries in 7 games, but misses 40% of his tackles and 50% of his kicks it's going to balance back down to average.
The stats it takes into account are minutes played, tries, try assists, total touches, number of runs, metres run, line breaks, line break assists, defenders beaten, turnovers, tackles made, tackles missed, kicks made, kicks missed, (territory kick metres, number of territory kicks, possession kick metres, possession kicks, number of penalty kicks to touch, and kick errors).
The bracketed stats require difficult and unique stat collection and so aren't included for super rugby, so you'll notice that an excellent out of hand kicking game, like the one Sias Ebersohn had in the forces win over the Waratahs in round one won't rate as highly as they should.
(See my notes above. He already acknowledges flaws in the formula. There is another flaw but more on that later.) That's purely financial decision and if it were up to me those stats would be included. If the public get out and support and it becomes financially viable, then it will get added back in later on.
4.
(A response to no 3, above). "that's brilliant thanks, makes perfect sense.
How do you code the games, i presume that's manually done on a visual watch through?
And how many watches does a game get?
Sorry, don't' mean to ask for all your secrets, just find this fascinating as find coding accurately the hardest part of analysis."
5.
(And this red light response to no 4, above) "It is done
by a manual watch, but not by me. Fairfax media (the ones that have the rights to it for Super Rugby) have the connections to the statisticians so its all run through them. So sorry but I can't be of much help to you on that one."
6. (And then, with this question and reply, we come back to my concern about the weighted values that I referred to in no 3, above.):
Question: "Thanks for the replies Stephen. Do you think you'll roll this out for other positions too eventually? I like that you have it rooted back to averages, would make someones score relatively comparable against another position e.g. this centre is 60 (i.e. 10 points better than average) compared to a lock at 45 (ie 5 points worse than average). Really interesting stuff.
I guess there is some subjectivity around how each stat is weighted, for example I don't think tries are that important for certain positions as you could just be catching the ball and falling over and that probably gives you a fair few points. Then again tries are what actually affect the game the most."
Reply: "I'd love to roll it out for other positions but 1st5R has to prove there's an audience for it first, if it can do that (share it with your rugby loving mates) then the next logical position would be full backs and then we'll go from there.
There is, my own and a couple of fairfax reporter's, subjectivity for the weighting and at the moment I would say its biased towards 1st 5s who get the ball in the red zone often, as opposed to 1st 5s who get their team to the red zone then let their forwards score tries or draw penalties. T
hough arguing which way is better to score a try would take a month of Sundays as it has so many different factors from the strength of the forwards, to the defence to the preference of the coach. (
My own notes. He is effectively saying that it is a scientifically designed thumbsuck.)
You're right different positions demand different weightings, e.g. Victor Matfield's lineout prowess destroyed the All Blacks in the late 2000's without scoring (if I recall correctly) any tries. It's reasonably easy to give a high score for a good try over a fall over the line, e.g. Julian Savea's effort against the Force this weekend just gone had him break two tackles and run 50 metres. He'd get points for the touch, try, beating defenders and a long run, compared to Cory Jane's try where he caught the ball and ran all of 2 metres, he'd only get points for the try, 2 metre run and a touch."
I have mentioned in my notes that, IMO, there is another flaw in the formula. I found that in one of the remarks to an article where "the formula" was mentioned for, from what I can gather, for the first time.
http://www.stuff.co.nz/sport/rugby/all-blacks/64479483/A-formula-to-help-Steve-Hansen-solve-the-All-Black-No-10-conundrum This was the remark/comment:
A load of codswallop! Where in this formula does it rate match management, decision making...or allow for carry vs kick, vision, work rate that goes unnoticed ( such as backing up), the quality of the opposition, injury, carrying to the line, restarts, ground conditions....you could go on all day mentioning things that go to make up a first five....or any player. Potential, player management.... Let's throw in good looks and commercial viability! Journos doodling. Can't see this system being of help to Hansen. I'd be questioning the credentials of a 'sports scientist's who took more than a few minutes to think this one up!I assume the above is the in addition to the other stuff that, on its own and according to the designer of the formula, would take "a month of Sundays......". A load of codswallop! Where in this formula does it rate match management, decision making...or allow for carry vs kick, vision, work rate that goes unnoticed ( such as backing up), the quality of the opposition, injury, carrying to the line, restarts, ground conditions....you could go on all day mentioning things that go to make up a first five....or any player. Potential, player management.... Let's throw in good looks and commercial viability! Journos doodling. Can't see this system being of help to Hansen. I'd be questioning the credentials of a 'sports scientist's who took more than a few minutes to think this one up!
