Here is an article from the New York Times that illustrates that going from a middle-of-the-packer, recreational athlete, to someone with seriously good times, requires a serious training program, and probably a coach and personal training time.
Want to Go Faster? You Need a Trainer
(Note: the article requires registration. April 23, 2009)
Some very nice stories of individual cases of people with serious time improvements.