Talking Chop: An SB Nation Community

Navigation: Jump to content areas:


Sports blogs for fans, by fans.
New Blog: Sounder At Heart for Seattle Sounders Fans!

Consistency Factor

Hey everyone, I'm a regular poster at the Mets SB Nation site, Amazin Avenue.  I know i know, you don't like me and I don't like you.  But I put this little case study together and thought you guys might be interested since there's some pretty interesting NL Central info in here in addition to the Oliver Perez stuff.

                                                                                                   Star-divide

 

In honor of Oliver Perez week, I figured I would try to wrap up this case study on consistency.  For anybody who missed it, I took a shot at quantifying start to start consistency, or what I'm calling Consistency Factor (CONF), for pitchers a few weeks back in this post.  It was enlightening but the results just didn't seem quite right.  So I've made some tweaks, basically utilizing Bill James Gamescore to evaluate each game started instead of WPA.

 

A brief refresher for those who missed the original post or forgot how it worked:  Basically I evaluated a pitcher's starts individually (using Gamescore) and then took a Standard Deviation of those 30-something starts.  The higher that #, the higher the range a pitcher regularly pitches within thus the lower his consistency.  So lower = better.  However, this # does NOT relate to how effective a pitcher is.  A pitcher can have the worst CONF but still be very good, all it means is that he doesn't pitch consistently from start to start.

 

I compiled the CONF #'s from 2008 as well as the last 3 seasons totaled for every qualifying NL starter.  However, before we dive into all of those #'s, here's a nice visual breakdown of this idea using, who else, Oliver Perez:

 

3489168434_14ca7f0d65_medium3488452639_7e886d4458_m_medium

So as you can see, each point represents a start measured in Gamescore (high=good low=bad), the gray area represents 1 Standard Deviation away (in both directions) from Oliver's Mean (which happened to be a Gamescore of 51.65).  In english, the blue points are each start, the gray represents the average range where he usually pitches and the red baseline is the level of his average start in 2008.

 

Now let's take a look at another pitcher for some perspective.  How about Tim Lincecum:3488354863_a35bab4dcd_medium3489266308_427661e42c_m_medium

First of all, Lincecum's Mean or average start is obviously higher (Gamescore: 62.06), the guy did win the Cy Young.  (For reference, a Gamescore of about 50 represents Replacement Level)  More importantly for us, Lincecum's starts are packed much more densely within his average range than Oliver's.  Only a handful of starts fall outside of the gray area whereas Perez has many more fall outside.  As a result, Lincecum's Average Range is smaller, which represents less variation and higher consistency.

As far as the most important figure that we can draw from these graphs, its that Standard Deviation I mentioned that makes up the gray Average Range.  This is the figure that represents Consistency Factor.  For Lincecum it's 13.18.  For Perez, it's 17.08.  The league average is around 16.

 

                                                                                                   Star-divide

 

So now that we can kind of visualize where these #'s come from, lets look at the results.  I grouped all NL starters (who pitched at least half a season in '08) by team and I've got all the teams here so lets look at them by division, East first of course:

3486856907_6e4587f0db_medium  3486857025_c63a14eee8_medium 3487673772_047251fb6e_medium  3486857075_7dd06ee0e8_medium

                                                         3487673710_5f188d841a_medium 

Well theres a few interesting things we can see here:

  • We already knew that Johan was awesome, now we know hes consistently awesome
  • Apparently Maine & Redding are very consistent as well, although Perez, Livan & Pelfrey are not
  • However, Oliver Perez: not that inconsistent...at least not as much as many of us would think
  • Brett Myers on the other hand...ugh
  • However, Cole's about average and guy's like Moyer & Blanton are really only valuable because of their consistency
  • And damn, we all know Josh Johnson is going to be great but hes already pretty damn good (though to be fair this was based on only half a season of starts)
  • Another surprise, Daniel Cabrera wasn't bad at all in '08

 

Onto the NL Central:

3487673552_1b7a5cc8e0_medium3487673802_de340d02ee_medium

3486856959_507451394d_medium3487673538_b07f301cd9_medium

 

3486856835_0042d12604_medium3486857141_3657cb1703_medium

 

  • The Cubs have a remarkably consistent staff...
  • ...except for Carlos Zambrano who is officially THE least consistent starter in the NL
  • Surprisingly consistent seasons from the 2 young Reds rookies especially Volquez, not so much from their 2 vets though
  • As usual Paul Maholm is quietly very good
  • And a shockingly consistent season by Todd Wellemeyer and that came in only his first season in the rotation

 

And finally the NL West:

3486857201_e99335ac43_medium  3487673614_c9c6c20f4c_medium 3487673756_a4d87dbaef_medium3486856983_d1e825a973_medium

                                                      3489207694_8c8337c4f0_medium

  • 2 more young guys with surprisingly consistent seasons in LA, not so much for Hiroki Kuroda
  • What's the only difference between the Giants rotation and a roulette wheel? Tim Lincecum
  • SI product Jason Marquis, very nice
  • Surprisingly high from Webb, even more from Garland who is known for his consistency
  • And a perfect example of what I said earlier about consistency not always equaling performance, Kevin Correia the NL's most consistent crappy pitcher (Gamescore Mean: 43.63...ugh); looking at these #'s, it's amazing he is still in a Major League rotation today

And last but not least, here are the rankings of the best and worst performers of 2008:

3489207734_c2617d3847_medium3487673504_57f0838950_medium  3487224987_9215d124a1_medium 3488041060_ed4b280245_medium

  • Redding on the Top 5 (3 Year) list, I didn't expect that
  • And John Garland on the Bottom 5 (3 Year) list, I bet people would have had him pegged as super consistent not the other way around...
  • Another supposed "Mr. Consistency", Derek Lowe finds himself on the Bottom 5 (3 Year) list
  • And yes, Oliver would have been on that list too but I gave him a little home-cooking if you will by excluding that bizarre stretch in '06; basically I'm just evaluating him in his time with the Mets
                                                                                                        Star-divide

So I hope this has been enlightening.  At the very least I figured it would break up the interminable dross that we've witnessed in the FanPosts recently.  Just as last time, I apologize for the high level mathematics and such but thats the breaks.

 

I set out to disprove the myth of Oliver Perez as "Mr. Inconsistency" and I think I've done that.  That title definitely goes to Carlos Zambrano.  Perez is definitely on the higher end but even if I included all of the #'s, he's not as bad as the media portrays.  I think a lot of that mindset derives from how he can be so inconsistent in-game or inning to inning rather than game to game, which definitely is no myth.  That would be another interesting case study but thats another story for another day.  As far as what this means to his overall performance, not too much because he's obviously been terrible this year anyway.  But at least he's been consistently terrible...

2 recs  |  Comment 12 comments

Story-email Email Printer Print

More from Talking Chop

Game 95 Recap: Giants 1, Braves 4

Jul 2009 by gondeee - 54 comments

Game 45 Recap - Giants 4, Braves 0

May 2009 by bigjoe - 23 comments

Comments

Display:

More power to you guys who get into this kind of thing but I just can’t stomach it.

by KC Ryan on May 3, 2009 5:29 PM EDT reply actions   0 recs

same here.

"Ohhhh Shit."-Bobby Cox, 3/28/09

by 10-4 on May 3, 2009 7:58 PM EDT up reply actions   0 recs

The thing about this…it doesn’t distinguish whether or not a pitcher is consistently good (Santana) or consistently bad (Redding). Interesting nonetheless, thanks for sharing

4/24/09 NEVER FORGET THE SWAGGA IS BACK BABY
President, CEO, and chairman of the Brandon Jones fan club

by bigjoe on May 3, 2009 5:35 PM EDT reply actions   0 recs

Interesting Story

Good data and thanks for adding to civil dialogue between competing fan bases.

You spend a good piece of your life gripping a baseball and in the end it turns out that it was the other way around all the time.

Jim Bouton

by Mike de La Hoz on May 3, 2009 7:46 PM EDT reply actions   0 recs

Very thorough, interesting study. The only problem I have with it is that if a guy throws an unbelievable game it adds to his inconsistency. I think that your consistency factor could be improved if you lumped all gamescores above a certain number into one category and gave them all the same number. So then only the poor starts add to inconsistency. Just nit-picking though; very interesting.

To Hell With Georgia!

by tgriffith3 on May 3, 2009 9:11 PM EDT reply actions   0 recs

"Wow. Graphs and charts...

…somebody’s really been doing their homework. Looks like USA Today."

Oh, Bobby.

by sdp on May 3, 2009 10:02 PM EDT reply actions   0 recs

Two nations at war...

and this sharing of information??? It must be misleading, I willn’t accept it…JK, jk, nice post…for a fa…Mets Fan.

...catsports...

by bwellnjonesco on May 4, 2009 8:51 AM EDT reply actions   0 recs

"I know i know, you don't like me and I don't like you."

I like you.

If Dunn walks 30 fewer times, he'll drive in 15 more runs. This is thanks to the scientifically proven formula: RBI = (this is nonsense) (I made it all up).

Here's a stat: Wins as manager: Dusty Baker, 1,162; Bill James, 0.

by TradeAndruw on May 4, 2009 10:02 AM EDT reply actions   0 recs

+1 for Super Troopers reference

"Ohhhh Shit."-Bobby Cox, 3/28/09

by 10-4 on May 4, 2009 10:23 AM EDT up reply actions   0 recs

Oliver Perez trained by Glavine

I saw Glavine giveing OP instruction during his rookie year in Atlanta by your account G mans number are slightly better.

by bravestatoo on May 4, 2009 10:05 AM EDT reply actions   0 recs

Comments For This Post Are Closed


User Tools

Welcome to the SB Nation blog about Atlanta Braves.
Start posting about the Braves »

Join SB Nation and dive into communities focused on all your favorite teams.

FanPosts

Community blog posts and discussion.

Recommended FanPosts

Dalemurphy_small
Late October/Early November Rosterbation
Dsc01731_small
A 2009 Season, Up Close and Personal

Recent FanPosts

Avatar_small
Minor
527368058_l_small
Brian McCann Pictures
527368058_l_small
Chipper Jones Pictures
527368058_l_small
Mike Gonzalez Pictures
527368058_l_small
Jair Jurrjens Pictures
527368058_l_small
Tim Hudson Pictures
Small
Best part about the '09 WS...
527368058_l_small
Martin Prado Pictures
Images_small
Good Old Baseball Question
527368058_l_small
Yunel Escobar Pictures

+ New FanPost All FanPosts >


Managers

Gondeee_small gondeee

Authors

My_hair_is_a_bird-257x300_small yondaime4

Dsc01731_small royhobbs

Dalemurphy_small cbwilk