Skip to main content

Dissecting college hoops' most maligned metric, more thoughts

Last week, the NCAA conducted its annual mock selection seminar in Indianapolis for members of the media. The goal was to educate participants on the process, but what ensued was yet another round of criticism aimed at the committee's methods. Not surprisingly, since there is no bracket to slice and dice as of yet, the bulk of the ire is being directed at those three polarizing letters: R-P-I.

I don't know of another metric in sports that is more maligned or more misunderstood. Put simply, a team's RPI is calculated on three pieces of information: its record (25 percent), its opponents' record (50 percent), and its opponents' opponents' record (25 percent). Since homecourt advantage is so pronounced in college basketball, road games count a little more, win or lose.

Most of the discussion leading up to selection weekend centers on the overall RPI rankings. If you want to assess a team's position, that is a quick and easy way to do it. It's also the laziest. A team's overall RPI rank is a virtual non-factor to the people who actually have to make these decisions.

The RPI was never meant to be a hard-and-fast listing of how good teams are, though it essentially accomplishes that. Rather, its primary purpose is to serve as an organizing tool that allows the committee to compare teams with different schedules. We all know that all 25-4 records are not alike. When the committee looks at results -- i.e. the "team sheets," which are being made public this year for the first time -- the games are arranged so people can see how a team did against teams ranked in the top 25 of the RPI, the top 50, the top 100, etc.

The RPI is also used to calculate a team's strength of schedule, which is especially relevant in the nonconference. The committee favors teams that played other good teams outside the league, even if they lost to some of them. The NCAA wants to incentivize coaches to play good teams away from home in the nonconference. That's good for the game.

If people can tweak or improve upon this formula, I encourage them to have at it. But if we're going to crunch numbers, we need to make sure we're doing it for the right reasons. I would argue that the basic metric for evaluating teams for the tournament should incorporate three factors and three factors only:

1. How often did they win?

2. Whom did they beat?

3. Where did they play?

That's it.

For many RPI critics, this does not go far enough. They want to bring anything and everything into the formula, for all the wrong reasons. I'm not saying the RPI is without flaws, but I am saying it's the best metric that anyone has come up with so far. Here's why:

• It does not include scoring margin.

This seems to be the chief complaint of RPI critics. It is also the number one reason people cite for replacing the RPI with the ratings put together by Jeff Sagarin of USA Today.

Reasonable people can disagree, but I'm going to be honest. I find nothing reasonable about the idea to integrate scoring margin into the formula that the NCAA uses to bracket the tournament. The reason is simple: It would give coaches the incentive to run up scores. It's hard for me to believe that serious people would make this argument, yet I'm seeing it everywhere.

But wait: Isn't beating a good team by 20 points more impressive than beating a bad team by one? Of course. That's why the members of the committee are free to take that into account when they burrow into the details. In fact, the committee members are free to take any factor into account. And they do. But to replace the RPI with a formula that explicitly incorporates scoring margin? There are some pretty bad ideas about how to improve this process, but this one is by far the worst.

• It doesn't try to quantify missing or injured players.

This is the sexy wrinkle in ESPN's newly unveiled College Basketball Power Index (BPI). If a team is missing key players (as determined by their average minutes per game), the BPI de-weights its impact compared to games where both teams are at full strength.

This is a novel idea, but it's also a misguided one. In the first place, this dynamic is already an important part of the process. Members of the committee are assigned specific conferences that they monitor throughout the season. In addition, the committee and the NCAA's staff are bombarded with information provided by the teams and conferences themselves. Not only will everyone be fully aware that Pittsburgh played 11 games without Tray Woodall, that fact will be specifically brought into the discussion. This will be true for every team that comes under consideration.

Besides, who is to say that a team automatically gets worse because a starter is hurt? Two years ago, Notre Dame was floundering in mid-February when its leading scorer and rebounder, Luke Harangody, went out with a bone bruise in his knee. In his absence, the Irish came together and won six straight games. Those wins wouldn't count as much in the BPI as the RPI. Is that fair?

• It doesn't account for efficiency.

If you're a true, hardcore college basketball fan, you know all about efficiency rankings, also known as tempo-free stats. They sprang from the brilliant mind of Ken Pomeroy. His site, KenPom.com, is a bountiful source of useful information. I check it almost every day, and I use Ken's nuggets frequently in my columns and television analysis.

However, these numbers have no place in the bracketing process. None. They tell us a great deal about why a team wins, but that is far less important than knowing whether it wins. Believe it or not, sometimes the less efficient team still ends up with more points.

When I gave voice to this opinion on Twitter last week, it prompted an industrious RPI critic, Jason Lisk of The Big Lead, to write a blog countering my position. Lisk wrote that "Davis' statement would imply that the Pomeroy rankings feature a bunch of teams that lose a lot more games but look really good when they do, while the RPI rewards winners."

My statement implied no such thing. We all understand that the more efficient a team is, the more likely it is to win. By setting up this standard, Lisk undercuts his own position. If the efficiency ratings basically tell who is winning, then using them in the selection process is redundant. If they don't tell us who is winning, then they're irrelevant. The bottom line is, I would rather be inefficient and win than efficient and lose.

• It doesn't attempt to predict anything.

People who offer up alternatives to the RPI often rely on the argument that their method is a better indicator of success in the tournament. Pomeroy himself made this argument on Slate.com when he wrote that "a ranking system that doesn't account for margin of victory isn't particularly useful as a predictor of future results." Similarly, last year an engineering professor at Georgia Tech named Joel Sokol argued in The New York Times that the ranking system he devised was better at predicting NCAA tournament outcomes than any other, and was thus far superior to the RPI.

First of all, I am highly skeptical of these claims. If Sokol's formula is that good, he should head out to Vegas for those three weeks. But even if that were true, it would be irrelevant. Selecting and seeding should be about one thing: Rewarding or punishing teams for what they did during the regular season.

• It does not rely on the eye test.

We hear all the time that a team needs to pass the "eye test" to get a bid. Well, whose eye are we talking about? And what exactly is the test? A team with lots of speed and athleticism may be pleasing to the eye, but that doesn't mean its players know how to win. Again, I get back to basics: Would you rather pass the eye test and lose, or fail the eye test and win?

I'm not saying members of the committee shouldn't watch games. They actually watch a ton of them during the season. To the extent that it leavens their understanding of what's going on, that's a good thing. But I hope they watch these games with a good dose of humility. Just because they think a team "looks" better than another one under consideration doesn't mean it really is. I want to know whether a team won, whom it beat, and where it played. I'm a lot less interested in knowing how it looked.

• It doesn't require "basketball people" to tell us what happened.

This is the standard fallback position to critics of this process. If there were real "basketball people" on the committee -- e.g., former coaches -- they would make much better decisions.

This argument ignores the possibility that "basketball people" can be just as wrong as the rest of us. Ex-coaches are also just as prone to have personal agendas, if not more so. What happens if a coach on the committee is assessing a team coached by the son of his former assistant? What if that coach played nothing but man-to-man and believes a zone is a weak strategy? Or what if the coach believes that because he knows the game so well that all he has to do is watch the teams play, and therefore he doesn't have to waste time burrowing into all the other information. Anyone seen a coaches' poll lately?

I'm not saying the RPI can't be improved, tweaked or perfected, but can someone tell me exactly what is so broken about the NCAA tournament? The intensity of all this criticism reminds me of the reaction to the committee's decision last year to give an at-large bid to VCU. I was one of those critics. I said on the CBS Selection Show that I thought the committee made a mistake, and I still don't believe VCU's remarkable run to the Final Four validated its inclusion. Still, VCU's success was a stark reminder to all of us professional bloviators that just because we disagree with the committee doesn't mean we're right. We would all do well to remember how that humble pie tasted these next few weeks.

So let me conclude by issuing a challenge to all those folks who voice such righteous indignation toward the RPI, all those computer geeks and tempo-free adherents and "basketball people" who believe they know better: I want to see your brackets. Take your Sagarin ratings, your BPI, your KenPom numbers, your eye tests, and any other information your heart desires, and show us exactly how you would select and seed the 2012 NCAA tournament. Let's see how superior your brackets are to the official version that comes out of that conference room in Indianapolis.

My guess is, yours won't be that much different from theirs. Or mine. Maybe yours will be a little better, maybe it will be a little worse, but really, how will we know? Because in the final analysis, our opinions don't matter. Two days after the bracket gets revealed, the games will tip off, and all the mystery will be washed away. There is only one place in basketball where numbers reveal the ultimate truth, and the one thing we know for certain is that the scoreboard never lies.

• It's not quite North Carolina-Clemson, but you may not know (I certainly didn't) that Dayton has now lost 27 straight at Xavier. That's pretty remarkable considering Dayton, unlike Clemson, has actually been a consistently competitive program inside its league for a long time.

• I know that Southern Miss (at Houston) and Memphis (home vs. UTEP) suffered bad losses over the weekend, but one way or another Conference USA is going to get at least two teams into the tournament. You gotta get to 37 at-larges somehow.

• You think Colorado State has a big stretch coming up? Here are the Rams' next three games: vs. New Mexico, at San Diego State, vs. UNLV. Win one and they've substantially strengthened their bubble resume. Win two and they're in.

• William Buford is killing Ohio State right now. He shot a combined 5-for-24 in the Buckeyes' losses to Michigan State and Michigan. On the season, his three-point percentage has plummeted from 44.2 as a junior to 36.4. Hard to imagine Ohio State can win a title with him playing like this.

• When I visited Baylor for my preseason postcard last fall, Perry Jones told me that he only participated in one summer camp that involved top collegians. Not only did he skip the main events that were sponsored by Nike, Jones told me he didn't even know about them. (Probably just a coincidence that Baylor is an adidas school.) I have to believe that if Jones spent his summer going up against high-level competition instead of working out by himself in Waco that he would be a much better and tougher player.

• I don't know that I've ever seen a dumber, more egregious ejection than Karl Hess tossing Tom Gugliotta and Chris Corchiani from N.C. State's home game against Florida State on Saturday. I wouldn't argue that those two should get special privileges, but unless a fan is throwing things or using excessive profanity (which was apparently not the case here), there is never a justification for the official to have them removed. I'd love to see Hess suspended for a week, but that's not going to happen.

• UNLV and San Diego State learned last week what the rest of America is just beginning to realize: New Mexico plays some serious defense.

• Usually when a team has issues with turnovers, the problems center around the point guard. In Florida State's case, though, it's the other players who have been sloppy. Luke Loucks did not commit a turnover in the win at N.C. State, but as a team the Seminoles had 14.

• Sorry if this sounds harsh, but I really think Mississippi State's problem right now is its senior point guard, Dee Bost. He's a turnover machine and a volume shooter. That's a bad combination.

• I don't believe Saint Mary's or Gonzaga can win ugly against a good team. That spells trouble for the tournament.

• My all-time all-man crush team: Juan Dixon, Maryland (captain); Grant Hill, Duke; Tyler Hansbrough, North Carolina; Luc Richard Mbah a Moute, UCLA; Dee Brown, Illinois; Jimmer Fredette, BYU; Draymond Green, Michigan State. Could there be a higher honor?

• People are understandably fixated by Wichita State guard Joe Ragland's 30-point performance in the Shockers' win at Davidson, but how about the 6-foot shooting guard grabbing seven rebounds? That's what winners do.

• Here's what else you need to know about Wichita State: It can really shoot the ball. Over their last four games, the Shockers have made 36 of 63 (or 57.1 percent) from three-point range. Seven-foot senior center Garrett Stutz has made 6 of 8 from behind the arc during that span and is shooting 38.5 percent from three on the season. When you play the Shockers, a big part of your defensive strategy is hope.

• To think: The Big East could end up getting more bids than the Big Ten after all. Smh.

• Anyone else notice that Tennessee freshman forward Jarnell Stokes has cooled off since making his high-impact debut six weeks ago? Over the last six games, Stokes reached double-figure scoring just once (and double-figure rebounding zero times). He sat out one of those games with a wrist injury, but he wasn't much of a factor in the Vols' road loss to an Alabama team that had two of its starters out because of suspensions. The future is still pretty bright in Knoxville, but for all intents and purposes the Vols' season is over.

• Don't look now, but Butler has won five of its last six. The Bulldogs can't get an at-large bid, but if they go on to win the Horizon League tournament, you think anyone is going to want to play them in the first round? Neither do I.

• Washington's freshman point guard Tony Wroten is the best player in the Pac-12 and it's not even close. He had 22 points, nine rebounds and two assists in the Huskies' pivotal win over Arizona on Saturday. Wroten is second in the Pac-12 in steals (2.0 per game), he's fourth in both points (16.5) and field goal percentage (46.5), and he's eighth in assists (3.5).

• It's obvious that Bruce Weber is a dead coach walking, but Illinois fans might need to lower expectations about potential replacements. Most of the top names are head coaches with very expensive buyouts. If Illinois fires Weber, it will have to pay him $3.9 million for the balance of his contract, which runs through 2015. And that's before they hire the next guy. Keep in mind the school is already committed to paying Ron Zook $2.6 million for firing him. That might clear the path to hire an assistant like Chris Collins of Duke, who grew up in the Chicago suburbs and whose father, Doug, is the former coach of the Chicago Bulls.

• We're now at a glorious part of the season where every single night there are several games with major bubble implications. Can you imagine how much less interesting this would be if the tournament had expanded to 96 teams? We dodged a bullet there, folks.

• If Anthony Davis were a team, he would be ranked 31st in the country in blocks per game. Just making sure you knew.

• I've picked on Erving Walker a lot the last four years, so let me congratulate him on becoming Florida's alltime assists leader. Say this for Walker: The kid is a gamer, and he has gotten better every year.

• I'd love to see Marquette and Murray State play each other in the Sweet 16. There'd be a lot of skin under their fingernails, I can tell you that.

• It just looks to me like Virginia is running out of gas. It's hard to play that kind of grind-it-out basketball over the course of an entire season. It also doesn't help that the Cavaliers' best outside shooter, Joe Harris, is playing with a broken bone in his non-shooting hand.

• I gave Michigan State center Adreian Payne a lot of love last week for his inspired play in the win over Ohio State, but he has yet to prove he can play with that kind of energy every time out. Payne, a 6-10 sophomore, had just two points each against Wisconsin and Purdue. If the Spartans are going to make the Final Four, they're gonna need all hands on deck.

• It's pretty disappointing that Villanova junior forward Dominic Cheek has still not developed a reliable jump shot. I saw him quite a bit in high school and he seemed to have stardom written all over him.

• We've got a pretty good mix of teams from the Big Ten, Big 12 and ACC vying for No. 1 seeds. It comes down to this: If a team wins the regular season title in one of those leagues and then wins the conference tournament, it's a mortal lock to wind up on the top line.

THIS WEEK'S AP BALLOT

(Last week's rank on my ballot in parentheses)

1. Kentucky (1)

2. Syracuse (2)

3. Missouri (3)

4. Kansas (4)

5. Michigan State (5)

6. Duke (7)

7. North Carolina (8)

8. Ohio State (6)

9. Michigan (13)

10. Marquette (12)

11. Florida (15)

12. Murray State (16)

13. Georgetown (11)

14. Baylor (9)

15. Florida State (17)

16. Wisconsin (19)

17. Notre Dame (21)

18. Wichita State (22)

19. Temple (24)

20. New Mexico (NR)

21. UNLV (10)

22. San Diego State (14)

23. Louisville (NR)

24. Virginia (18)

25. Drexel (NR)

Dropped out: Indiana (20), Saint Mary's (23), VCU (25)

I don't think I have to explain this to most of you, but in case any Michigan fans are incensed that I ranked Ohio State ahead of the Wolverines despite Saturday's result, let me state the obvious: The game was played in Ann Arbor. Michigan won by five. When the two teams met in Columbus three weeks ago, the Buckeyes won by 15. Keeping Ohio State ahead of Michigan was a no brainer, but I did reward the Wolverines by moving them into my top 10. Four spots is a substantial jump at this point in the season.

You'll also notice I slid Georgetown down two spots even though it didn't lose. The Hoyas' record doesn't look quite as impressive upon closer inspection. They beat Louisville and Marquette at the start of their Big East schedule, but here are their wins since then: at St. John's, at DePaul, Rutgers, UConn, South Florida, St. John's, at Providence. Meanwhile, their losses were: at West Virginia, Cincinnati, at Pitt, at Syracuse.

You might think I should have dropped Baylor more than five spots for losing at home to Kansas State, but keep in mind that the team ranked right below them, Florida State, lost at Boston College two weeks ago and was extremely fortunate to get by Virginia Tech at home. New Mexico, meanwhile, clearly deserved to be ahead of San Diego State and UNLV. Those two teams actually lost both games last week (UNLV in overtime at TCU; San Diego State at Air Force), but they were ranked too high for me to drop them out altogether. Besides, the Aztecs played Air Force without their leading scorer and rebounder, Jamaal Franklin, who was sidelined by a sprained ankle.

Indiana, on the other hand, did get dropped for losing at Iowa Sunday night. The game was never close, and it left the Hoosiers with an 8-7 record in the Big Ten.

Finally, a hearty welcome to Drexel for making my ballot after drilling Cleveland State on the road. That was the Dragons' 15th straight win, and it makes them the team in the CAA that is most likely to earn an at-large bid if it needs one. I almost went with Iowa State at that spot, but the Cyclones lost by 15 points at Baylor last week before beating Oklahoma at home. The good news/bad news is the Cyclones end their regular season at Kansas State, at Missouri, and then at home against Baylor. A win in one of those three (especially if it's at Missouri) would substantially fortify their case.