The Book of Exalted Deeds has various feats and prestige classes based on those feats. Those feats (and prestige class abilities) go away if the player does something non-good, non-heroic, similar to how paladins can lose their class abilities. Maybe have the characters forced to use those...