Fooled by Randomness: Goaltender Save Percentage

Here's a chart that you should always keep in mind when evaluating goaltenders:

Goalie_random_medium

The average even-strength save percentage across the league is approximately .919.  (It's actually slightly lower, but that includes sub-replacement goaltenders used for emergency purposes only.)  If you call up a goaltender and he plays 40 games, sees 1000 even-strength shots and posts a .925 even-strength save percentage, what are the odds that his true talent level is actually league average or worse?  Reading off the chart, it's almost 30%.  Would you sign that guy to a big contract given those odds?  Even-strength save percentage happens to be the most reliable measure we have - if you used overall save percentage or even - god forbid - goals-against-average, you'd be taking a much bigger risk.

I built this chart using a coin-tossing model, so it doesn't capture some of the deterministic drivers of save percentage.  Over a small number of games, it is entirely possible that a goaltender faced particularly strong competition or played behind a defense that was missing its star players, which would change our expectation.  But what are the odds that the GM signing a goaltender paid attention to subtleties like that?

This is what makes it very difficult to find a good goaltender - you need four years of data to figure out how good he is, but you can usually only get one or two.  Some people would say that lets GMs off the hook when they sign a guy to a big contract and he doesn't work out.  I would say that level of risk means you should bet a smaller percentage of your portfolio on goaltending.

SB Nation Featured Video
X
Log In Sign Up

forgot?
Log In Sign Up

Forgot password?

We'll email you a reset link.

If you signed up using a 3rd party account like Facebook or Twitter, please login with it instead.

Forgot password?

Try another email?

Almost done,

By becoming a registered user, you are also agreeing to our Terms and confirming that you have read our Privacy Policy.

Join Arctic Ice Hockey

You must be a member of Arctic Ice Hockey to participate.

We have our own Community Guidelines at Arctic Ice Hockey. You should read them.

Join Arctic Ice Hockey

You must be a member of Arctic Ice Hockey to participate.

We have our own Community Guidelines at Arctic Ice Hockey. You should read them.

Spinner.vc97ec6e

Authenticating

Great!

Choose an available username to complete sign up.

In order to provide our users with a better overall experience, we ask for more information from Facebook when using it to login so that we can learn more about our audience and provide you with the best possible experience. We do not store specific user data and the sharing of it is not required to login with Facebook.

tracking_pixel_9355_tracker