2006-7 KRACH "Power Rankings"

Discussion of Minnesota Girls High School Hockey

Moderators: Mitch Hawker, east hockey, karl(east)

ghshockeyfan
Posts: 6132
Joined: Thu Jun 05, 2003 2:33 pm
Location: Inver Grove Heights, MN
Contact:

2006-7 KRACH "Power Rankings"

Post by ghshockeyfan »

Well - I ran it today now that I have the code fully automated for formatting, etc. Still working on the SOS page (so that is from last year, but the SOS on the Rankings page is correct)...

All this tells me is that it's WAY too early to look at this seriously. We need a TON more data to make it of any value...

http://www.bgoski.com/rank/Rankings.htm

More info. is available at:
http://www.esportsdesk.com/leagues/fron ... entID=1830

Or specifically in the "Newsletter" area:
http://www.esportsdesk.com/leagues/news ... entID=1830
ghshockeyfan wrote:I should add - here's some good info. on KRACH:<br><br><!--EZCODE AUTOLINK START--><a href="http://p100.ezboard.com/fmnhsfrm19.show ... <!--EZCODE AUTOLINK END--> or specifically (some of these links may be broken/outdated unfortunately):<br> <br>=============<br>ghshockeyfan<br>Registered Member<br>Posts: 2394<br>(12/27/04 12:55 am)<br>Reply KRACH <br>--------------------------------------------------------------------------------<br>This is the system I use. I get asked some questions about it sometimes, and so here are some links to info.<br><br>If you hate math, don't bother to read on. Also, please note that this all pertains to the basis of US College Hockey - meaning that all of this surrounds that as its purpose. I simply took the math that I understood from these sites and adapted it to a computer program (easier said than done - believe me & I have math degrees...):<br><br><br>USCHO (Claims that this system is best for SOS concerns):<br><!--EZCODE AUTOLINK START--><a href="http://www.uscho.com/rankings/?data=kra ... <!--EZCODE AUTOLINK END--><br><!--EZCODE AUTOLINK START--><a href="http://www.uscho.com/FAQs/?data=krach"> ... <!--EZCODE AUTOLINK END--><br><br>Ken Butler's original KRACH explanation page (with examples):<br><!--EZCODE AUTOLINK START--><a href="http://www.mscs.dal.ca/~butler/krachexp ... <!--EZCODE AUTOLINK END--><br>***This seems to be the best explanation...<br><br>John Whelan has a more detailed mathematical analysis of KRACH.:<br><!--EZCODE AUTOLINK START--><a href="http://slack.net/~whelan/tbrw/tbrw.cgi? ... <!--EZCODE AUTOLINK END--><br>System Comparison of College Hockey...<br><!--EZCODE AUTOLINK START--><a href="http://slack.net/~whelan/tbrw/tbrw.cgi? ... <!--EZCODE AUTOLINK END--><br>A Proposed Modification to the NCAA Selection Criteria:<br><!--EZCODE AUTOLINK START--><a href="http://slack.net/~whelan/tbrw/tbrw.cgi? ... <!--EZCODE AUTOLINK END--><br><br>SiouxSports.com's independently calculated KRACH ratings (normalized so North Dakota's KRACH rating is 100.):<br><!--EZCODE AUTOLINK START--><a href="http://www.siouxsports.com/hocke.../kra ... <!--EZCODE AUTOLINK END--><br><br><br>FROM USCHO:<br>FAQ: KRACH<br>USCHO has begun publishing KRACH, a sophisticated statistical model for determining the relative strength of one team to another. We advocate this as a replacement for the Ratings Percentage Index (RPI), and the system of comparisons (summarized by USCHO as the PairWise Rankings) that is used to select and seed the NCAA tournament.<br><br>The KRACH listings can be found here.<br><br>Why is KRACH better than RPI?<br>Q. What is RPI?<br><br>A: A method for factoring in strength of schedule to winning percentage. It's calculated by factoring your winning percentage 25 percent; your opponent's winning percentage 50 percent; your opponent's opponents winning percentage 25 percent (25-50-25). "Opponent's winning percentage" is the average winning percentage of each opponent -- not the total winning percentage based on the sum of all wins, losses and ties.<br><br>Q: Why is something like RPI or KRACH needed to begin with?<br><br>A: If the NCAA were an "ordinary" sports league, everyone would play everyone else the same number of times, and we could seed the playoffs by comparing teams' won-lost records (winning percentages). <br><br>Comparing the winning percentages of teams playing vastly different schedules is unfair, so the NCAA developed the RPI.<br><br>Q: What is the problem with RPI?<br><br>A: Unfortunately, RPI fails to work as designed sometimes. If a team plays a weak opponent and wins, their RPI can still go down because the reduced strength of schedule hurts more than the improved winning percentage helps. This should not happen.<br><br>The NCAA tried to address this by increasing the weight of winning percentage in the RPI formula for hockey to 35 percent, but this just brought out RPI's other flaw: teams which play very weak schedules can inflate their RPIs by racking up impressive winning percentages. Because the strength of schedule component to RPI is influenced by winning percentage (KRACH does it differently), if all of a team's weak opponents play each other a lot, they can maintain a respectable winning percentage and make that team's schedule look stronger than it is. (This was the problem with the MAAC and CHA). In response to this, the NCAA went back to the original formula for the hockey RPI, but now teams are once more dropping in the RPI when they beat weak opponents.<br><br>Q: So what's the real problem with RPI?<br><br>A: The problems of RPI may seem like too much or too little weight is being given to strength of schedule -- find the right weight, and all will be good. But the real problem is that the definition of strength of schedule is completely inadequate. Adding the strength of schedule components (50-25) to the winning percentage (25) is the wrong thing to do.<br><br>Q: How is KRACH better?<br><br>A: KRACH does what RPI is designed to do, combine a team's won-lost records with their strength of schedule, but it does a better job of it.<br><br>While RPI is winning percentage plus strength of schedule, KRACH is winning ratio times strength of schedule. (A more complete methodology is in the section below).<br><br>There are two aspects of this formula which are needed to avoid the problems of RPI, and two which are needed to make everything make sense:<br><br>KRACH multiplies record and strength of schedule instead of adding them. This is needed so that a really good or bad strength of schedule can't swamp the results of the games themselves. <br>The KRACH ratings themselves are used to define the strength of schedule. This is needed so that teams with isolated schedules can't trick the rating system into overvaluing them as opponents. <br>KRACH uses winning ratio instead of winning percentage. This is consistent with the whole idea of multiplying instead of adding. The possible records go from zero to infinity instead of zero to one, just like the possible ratings. <br>There is a weighting factor in the average. This is needed because the ratings go to infinity, so if you just averaged them normally, the higher ratings would dominate. <br>Q: What about all of the other PairWise components besides RPI? Are they still needed?<br><br>A: You could theoretically take each PairWise component -- record in Last 16 games, record vs. common opponents, head-to-head record, record vs. other Teams Under Consideration -- and "KRACH-ify" them. In other words, use KRACH's strength of schedule method to modify those criteria.<br><br>But straight KRACH is much simpler -- a simple list of all the teams, ranked in order. This has the effect of eliminating some ambiguities in the comparison system, which is not transitive. For example, if Team A beats Team B in a head-to-head comparison, and Team B beats Team C ... that does not necessarily mean Team A beats Team C. This kind of issue leads to complications.<br><br>As a result, straight KRACH is preferred.<br><br>Q: But some of those other PairWise components are nice to have, aren't they?<br><br>A: A straight KRACH does overlook such vague concepts as "being hot down the stretch" (record in Last X games), and "doing well against the better teams" (record vs. Teams Under Consideration). But those distinctions are dubious anyway.<br><br>Q: The committee recently added a new component to the selection process, intended to help compensate for teams forced to play a large amount of non-conference road games. How does KRACH help this?<br><br>A: KRACH, like the undoctored RPI, doesn't take home ice effects into account when assessing the strength of a team's schedule. However, the KRACH methodology can be used to factor in the home-ice advantage. As a result, you can then level the playing field in a much more sophisticated way than the highly arbitrary "good win" system used by the NCAA. <br><br><br>--------------------------------------------------------------------------------<br><br>Who, What, How?<br>Q. What is the simplest definition of a team's KRACH rating?<br><br>A. Winning ratio times strength of schedule. Winning ratio is a cousin of winning percentage; instead of wins divided by games played, it's wins divided by losses. Strength of schedule is a weighted average of your opponents' KRACH ratings.<br><br>Q. You talk about wins and losses. What about ties?<br><br>A. Ties count as half a win and half a loss, just like in winning percentage, RPI, or any other rating. Wherever you see "number of wins" you should think "number of wins plus one-half number of ties" and similarly for losses.<br><br>Q. A weighted average? What's that?<br><br>A. For each opponent, there is a weighting factor. Multiply the KRACH rating by the weighting factor. Add those up, and divide it by the sum of all the weighting factors.<br><br>Q. So what is the weighting factor?<br><br>A. It's the number of times you played that opponent, divided by the sum of your KRACH rating and that opponent's KRACH rating.<br><br>Q. Why did you choose that weighting factor? It seems like you're undercounting the opponents with high KRACH ratings.<br><br>A. Because what's important with KRACH ratings is the ratios between them (one divided by the other), not the differences (one minus the other). Suppose I play one game each against teams with KRACH ratings of 50 and 200, and split. I should have a KRACH rating of 100, which is twice as good as 50 but half as good as 200. My winning ratio is 1 (same number of wins and losses), so whatever my strength of schedule is, that should be my KRACH rating. If I just averaged 50 and 200, I would get 125, which is more than twice as good as 50 and less than half as good as 200. But the weighting factors are chosen in just the right way that the weighted average is indeed 100.<br><br>For those who want to see the math: The weighting factor is 1/(100+50)=1/150=2/300 for the first team and 1/(100+200)=1/300 for the second team. So the weighted sum is 50*(2/300)+200*(1/300)=(100+200)/300=300/300=1. We need to divide this by the sum of the weighting factors, which is 2/300+1/300=3/300=1/100. 1 divided by 1/100 is 100.<br><br>The other reason we chose this weighting factor has to do with interpreting the ratings. Pick any team, and the ratio of your KRACH rating to the other team's will be be the winning ratio you'd be expected to rack up if you played them a bunch of times. So if your KRACH is 200, and you played a team with a KRACH of 100, you'd be expected to win twice as many games as you lost. The definition of KRACH ensures that if you use this formula to see how many games you'd be expected to win, given your actual schedule, it will be exactly the number of games you actually won. Thinking about the team with a KRACH of 100 that played teams rated at 50 and 200, they'd be expected to win 2/3 of the games they played against the weaker team and 1/3 of the games they played against the stronger team. So if they played them each once, the expected number of wins would be 2/3+1/3=1, and sure enough we saw above that a .500 record against those teams corresponded to a 100 rating. (Of course, they won't actually have won 2/3 or 1/3 of a game; the total is what will match up.)<br><br>Q. It sounds like you need to know everyone's KRACH ratings before you can calculate anyone's. Isn't the definition circular? How can you calculate anything?<br><br>A. The technical term is called recursive, and we can solve most recursive equations by a technique called iteration. Start off with an educated guess for everyone's rating (like they're all 100, or all 100 times the team's winning ratio), then calculate the ratings that come out of the formula, plugging in your guesses. If you had guessed the right answer, all the ratings coming out of the formula would match those going in. (In the real world, they won't, but they'll be closer to what you're looking for.) Now take those output ratings, and use them as a new set of guesses; plug them into the formula and see what comes out. You repeat this process, using the ratings calculated from one set of guesses as the next set of guesses. Eventually, the numbers coming out will be very close to the numbers going in, differentiating only in, say the fifth decimal place. If you only want to quote the ratings to four decimal places, you can stop there, since you were going to round off what was in the fifth decimal place any way.<br><br>Q. Does this always work?<br><br>A. In practice, yes. You know that game you play where you say the last place team in the weakest conference once beat the fifth place team, who beat the first place team, who tied the third place team in another conference, and so on until you've "proven" that the weakest team in the country is better than the national champion? As long as you can make such a chain of wins (and/or ties) from any team to any other team, the iteration we described will give you an answer. In any reasonable college hockey season, that condition is satisfied by around December. (There's still a way to define KRACH, or at least RRWP, even in weird cases, but it's more complicated, and almost certainly irrelevant.)<br><br>Q. And will it give the same answer no matter what guesses we start with?<br><br>A. It will always give the same ranking (as long as the chain-of-wins condition from the last answer is satisfied). The only difference that can arise is that all of the rankings might be multiplied by the same number. So one guess might make everyone's KRACH be three times what another guess does. Since it's the ratios that are meaningful, this ambiguity doesn't matter, but we get rid of it anyway by requiring that a completely typical team, one which would be expected to go .500 if it played every other team the same number of times, has a KRACH of 100.<br><br>Q. What is RRWP? What is the difference between KRACH and RRWP?<br><br>A. The RRWP, or Round-Robin Winning Percentage, is the winning percentage a team would be expected to accumulate, if they played a completely balanced schedule, i.e., if the NCAA held a round-robin tournament with all the teams in one big group. It's calculated from the KRACH, using the interpretation that the winning ratio you'd be expected to run up against a team is given by your KRACH rating divided by theirs. If you calculated the KRACH ratings for a league playing a balanced schedule, each team's RRWP at the end of the season would equal their actual winning percentage.<br><br>Q. What does KRACH stand for?<br><br>A. Ken's Ratings for American College Hockey, named after statistician Kenneth Butler, who first used applied them to college hockey.<br><br>Q. Where does KRACH come from?<br><br>A. The rating method was first invented in 1929 by a German named Zermelo to evaluate the results of a chess tournament in which a full round-robin was not completed. In 1952 a pair of Americans, Bradley and Terry, unaware of Zermelo's work, rediscovered the method while trying to model the outcomes of taste tests, and this rating system came to be called the Bradley-Terry method. In the 1990s, an English statistician named Kenneth Butler, studying in Canada, decided to apply the Bradley-Terry method to US college hockey, and when prodded for a name chose Ken's Ratings for American College Hockey.<br><br>Q. Where can I read further explanations of KRACH?<br><br>A. Ken Butler's original KRACH explanation page (with examples) is still on the web. Note that the "fictitious games" he described are no longer part of the KRACH ratings and are not used in USCHO's calculations. John Whelan has a more detailed mathematical analysis of KRACH.<br><br>©2004 U.S. College Hockey Online. All rights reserved. <br> <p></p><i>Edited by: <A HREF=http://p100.ezboard.com/bmnhs.showUserP ... ckeyfan</A> at: 2/16/06 11:33 am<br></i>
xk1
Posts: 620
Joined: Fri Jul 29, 2005 12:24 pm

Post by xk1 »

I knew you couldn't resist, you held out longer than I thought. Let the fun begin...
ghshockeyfan
Posts: 6132
Joined: Thu Jun 05, 2003 2:33 pm
Location: Inver Grove Heights, MN
Contact:

http://www.bgoski.com/rank/Rankings.htm

Post by ghshockeyfan »

I reran these again with the Sibley/SLP game results - and it's interesting to see how little data makes such a difference this early. Just reaffirms my belief that all of this is worthless at this point with too little data (not enough games in)...

http://www.bgoski.com/rank/Rankings.htm
sghfan
Posts: 116
Joined: Tue Feb 17, 2004 8:10 am

Post by sghfan »

It is what it is. It will delight some and enrage others. Some already understand the limitations of running this with little data; others never will.

The fun will really start when you run it the next time and it CHANGES!
ghshockeyfan
Posts: 6132
Joined: Thu Jun 05, 2003 2:33 pm
Location: Inver Grove Heights, MN
Contact:

Post by ghshockeyfan »

Agreed 100%. I was trying to figure out how Faribault got so high at 2-0, but then I see they played two teams that have beat everyone else they played besides Faribault. That's the bottom line about this - beating teams that beat other teams results in a high ranking. Beating teams that don't beat anyone else is of little value. Playing a strong schedule helps too - even when you don't win. I believe all of this is pretty straightforward but the mathematics of few scores/data may be more complex as far as understanding the impact that has.

And, rankings really mean absolutely nothing. Also, it's not how you start, but how you finish...
ghshockeyfan
Posts: 6132
Joined: Thu Jun 05, 2003 2:33 pm
Location: Inver Grove Heights, MN
Contact:

As of 11/25 AM 217 games in...

Post by ghshockeyfan »

I ran these early this AM and am did so again now as I was missing a score or two and had an error on a score that xk1 pointed out...

Here's the latest & greatest -

http://www.bgoski.com/rank/Rankings.htm

Note that the previous rank & currnet rank are only updated for the above mentioned data updates and the score that I reversed was Hopkins/Maple Grove - and you can see those two teams were impacted greatly by this reversal/correction (relative ot the earlier incorrect data version that is)...

I still don't believe that this ranking is anywhere near accurate and needs a TON more data to be of any value. It may be until Jan 1 or later before we have enough data to say this ranking is of much value...
ghshockeyfan
Posts: 6132
Joined: Thu Jun 05, 2003 2:33 pm
Location: Inver Grove Heights, MN
Contact:

Updated 11/26A missing 4 games...

Post by ghshockeyfan »

http://www.bgoski.com/rank/Rankings.htm

Missing 4:

11/25/2006 Eveleth St. Paul United
11/25/2006 Long Prairie-Grey Eagle/Wadena-Deer Cr Windom Area Windom - Invite
11/25/2006 Mankato East Luverne
11/25/2006 Park Rapids Silver Bay/Two Harbors
ghshockeyfan
Posts: 6132
Joined: Thu Jun 05, 2003 2:33 pm
Location: Inver Grove Heights, MN
Contact:

Post by ghshockeyfan »

Updated this AM for the few missing game scores that are now in. Also - the Luv/Mank E game was resch.
northhockey
Posts: 48
Joined: Fri Nov 17, 2006 10:05 am

Slight corection

Post by northhockey »

You also have Proctor/Hermantown/Marshall listed at 3-0. The have one loss - to Forest Lake 7-3
northhockey
Posts: 48
Joined: Fri Nov 17, 2006 10:05 am

Post by northhockey »

You already fixed it! PHM is now listed at 3-1.
ghshockeyfan
Posts: 6132
Joined: Thu Jun 05, 2003 2:33 pm
Location: Inver Grove Heights, MN
Contact:

Updated 11/29A

Post by ghshockeyfan »

icedude44
Posts: 25
Joined: Tue Nov 14, 2006 1:57 pm

Post by icedude44 »

PHM is 4-1 but I think that is what I saw listed
ghshockeyfan
Posts: 6132
Joined: Thu Jun 05, 2003 2:33 pm
Location: Inver Grove Heights, MN
Contact:

Post by ghshockeyfan »

icedude44 wrote:PHM is 4-1 but I think that is what I saw listed
Let me know if anyone sees errors in scores/records as they can affect the rankings greatly at this point, etc.

Also - I'd like to have accurate goals for/goals against, etc. in the "stats" associated with the records, so if you see any issues let me know that too...
Last edited by ghshockeyfan on Fri Dec 01, 2006 11:56 am, edited 1 time in total.
ghshockeyfan
Posts: 6132
Joined: Thu Jun 05, 2003 2:33 pm
Location: Inver Grove Heights, MN
Contact:

Updated 12/01A

Post by ghshockeyfan »

Missing 2 -
11/30/2006 New Prague Hutchinson
11/30/2006 Thief River Falls Lake of the Woods

Updated 12/01A

http://www.bgoski.com/rank/Rankings.htm
xk1
Posts: 620
Joined: Fri Jul 29, 2005 12:24 pm

Another Power Rating source

Post by xk1 »

Here is another ranking system, I'm sure it suffer from the same lack of data issues, an explanation can be found here
http://www.minnesota-scores.com/qrf.php
Class AA
1 Roseville (4-1-0) 39.3
2 Holy Angels Academy (6-0-0) 36.7
3 Edina (5-0-2) 35.4
4 Benilde-St. Margaret's (3-2-0) 33.5
5 Bemidji (4-1-0) 31.5
6 Wayzata (2-0-3) 31.4
7 Eden Prairie (2-0-0) 30.8
8 Grand Rapids/Greenway (3-3-0) 30.6
T-9 Cloquet/Esko/Carlton (4-1-1) 30.5
T-9 Rochester Mayo (3-1-0) 30.5
11 Forest Lake (6-1-0) 30.2
12 Centennial (3-1-0) 28.6
13 Robbinsdale Armstrong (4-0-1) 28.2
14 Eagan (4-1-1) 27.5
15 Hopkins (3-3-1) 25.2
16 North Wright County (3-1-0) 23.9
17 Duluth East/Central/Denfeld (6-1-1) 23.7
T-18 St. Cloud Tech (2-2-0) 22.7
T-18 Cretin-Derham Hall (5-0-0) 22.7
20 Burnsville (3-3-0) 22.4


Class A
1 Shakopee (4-2-2) 34.1
2 Austin (6-0-0) 32.8
3 New Ulm (4-0-0) 31.3
4 Breck (7-0-0) 31.2
5 Richfield (5-0-0) 29.9
6 Luverne (1-0-0) 29.8
7 Crookston (7-0-0) 29.2
8 Faribault (4-0-0) 27.7
9 Alexandria (6-0-0) 27.1
10 Simley (5-0-0) 26.5
11 Roseau (5-0-0) 26.2
12 St. Paul Saints (2-1-0) 25.8
13 Blake (2-3-0) 25.5
14 Farmington (3-2-0) 24.6
15 Hibbing (3-4-0) 24.2
16 St. Paul United (3-3-0) 22.5
17 East Grand Forks (2-4-0) 19.3
18 Mound Westonka (2-4-0) 18.6
T-19 Mankato West (2-2-0) 17.6
ghshockeyfan
Posts: 6132
Joined: Thu Jun 05, 2003 2:33 pm
Location: Inver Grove Heights, MN
Contact:

Updated 12/02 - 12P

Post by ghshockeyfan »

ghshockeyfan
Posts: 6132
Joined: Thu Jun 05, 2003 2:33 pm
Location: Inver Grove Heights, MN
Contact:

Updated 12/03 - 1:30P

Post by ghshockeyfan »

Updated 12/03 - 1:30P

http://www.bgoski.com/rank/Rankings.htm

MISSING: ANYONE KNOW THESE???

12/2/2006 Minnetonka Silver Bay/Two Harbors
12/2/2006 Spring Lake Park/St. Anthony Chisago Lakes/Pine City
spr air 210
Posts: 60
Joined: Thu Aug 17, 2006 2:58 pm

Post by spr air 210 »

strib has chisago 3 spring lake park 2
ghshockeyfan
Posts: 6132
Joined: Thu Jun 05, 2003 2:33 pm
Location: Inver Grove Heights, MN
Contact:

Post by ghshockeyfan »

spr air 210 wrote:strib has chisago 3 spring lake park 2
THANKS!!! I'll wait to re-run until I get the Minnetonka/Silver Bay game in too...
ghshockeyfan
Posts: 6132
Joined: Thu Jun 05, 2003 2:33 pm
Location: Inver Grove Heights, MN
Contact:

Updated 12/06 - 10:30A

Post by ghshockeyfan »

Updated 12/06 - 10:30A

http://www.bgoski.com/rank/Rankings.htm

MISSING: ANYONE KNOW THIS???

12/5/2006 Thief River Falls Park Rapids
dumpandchase
Posts: 41
Joined: Thu Sep 28, 2006 2:51 pm

TRF @ Park Rapids

Post by dumpandchase »

I believe it was postponed, I'm assuming due to weather.
ghshockeyfan
Posts: 6132
Joined: Thu Jun 05, 2003 2:33 pm
Location: Inver Grove Heights, MN
Contact:

Post by ghshockeyfan »

THANKS!
ghshockeyfan
Posts: 6132
Joined: Thu Jun 05, 2003 2:33 pm
Location: Inver Grove Heights, MN
Contact:

Updated 12/07 - 11A

Post by ghshockeyfan »

ghshockeyfan
Posts: 6132
Joined: Thu Jun 05, 2003 2:33 pm
Location: Inver Grove Heights, MN
Contact:

Updated 12/08 - 1P

Post by ghshockeyfan »

Updated 12/08 - 1P

http://www.bgoski.com/rank/Rankings.htm


MISSING:

12/7/2006 Morris/Benson/Hancock Alexandria
12/7/2006 Silver Bay/Two Harbors Superior (WI)
PPD - 12/7/2006 Spring Lake Park/St. Anthony St. Francis/North Branch
Stinkin Rootbeer
Posts: 42
Joined: Thu Oct 26, 2006 11:56 am

Post by Stinkin Rootbeer »

Alex 13 Morris/benson 0
Post Reply