Torvik and KenPom are predictive in that they analyze team performance on both offense and defense, project the game result and then adjust the ratings based on that game's performance. The ratings then set an expected margin of victory for the upcoming games. Torvik uses KenPom's data and amps up the 10 most recent games. These are not perfect but they do their best to predict future outcomes. And they are fun to look at.
Addendum: Ken Pomeroy himself calls his system predictive.
"The first thing you should know about this system is that it is designed to be purely predictive. If you’re looking for a system that rates teams on how “good” their season has been, you’ve come to the wrong place. There are enough systems out there that rank teams based on what is “good” by just about any definition you can think of. So I’d encourage you to google
college basketball ratings or even try the opinion polls for something that is more your style.
The purpose of this system is to show how strong a team would be if it played tonight, independent of injuries or emotional factors. Since nobody can see every team play all (or even most) of their games, this system is designed to give you a snapshot of a team’s current level of play."
Thanks for posting something meaningful, helpful and sincere.
I looked it up and found the article from which you extracted the quote - its from 2006, originally, with modifications. I read through it and refreshed my memory on what Bill James used to do in the early early days of "sabermetrics." Hard to believe that Ken Pomeroy is a James disciple, of sorts.
Anyhow, it looks quite possible that Pomeroy has tweaked his approach over the years, but maybe you know with certainty what he is doing now, calculation-wise.
While his calcs are more involved than Sagarin's basic system it still seems to me that Ken Pom is doing the following...
1. calculating offensive efficiency (points scored per possession)
2. calculating defensive efficiency (points allowed per possession)
3. adjusting those for the quality (efficiencies) of the opponent
4. adjusting for home court advantage
5. weighting recent games more heavily.
So if every team has a known number of total points scored, total points allowed and total possessions, you can take the average and get a starting point for each team's Offensive and Defensive Efficiencies and essentially run thru all the games and tweak them or solve for them, given the quality of its opponents and the scores.
But it is still based entirely on the scores of the games that have already been played. The primary difference between Ken Pom and Sagarin is that Ken Pom rates both the offense and defense for each team, while Sagarin just rates the team. So Sagarin could "predict" that NU should beat Penn State by 4, whereas Ken Pom can "predict" that NU should beat PSU 66-62.
I have built systems like Sagarin and Ken Pom. I don't think of them as predictive. I think of them as methods to rate teams, based on their past performances. Sure, you can give a somewhat informed guess as to what the final score might be, but the resulting differences between actual and predicted scores have to be relatively large.
To me, "Predictive Systems" tell you the answers to complicated things like "what's the weather going to be like in a week?" or "at what price is NFLX going to be trading in an hour?"
I think KenPom might have written "I built this system to try to set point spreads, money lines and over/unders."