Well, the 12 colonies were a stationary target they attacked with complete surprise, and whose ships they were able to disable.
The fleet, for the most part, just jumps away, and barring instances where the cylons have something specific to track (the Olympic Carrier in 33, and the refinery...