Who says it only applies to adventuring classes? One doesn't read often of dwarven shepherds or cranberry farmers, does one?
Why should I accept, for example, that dwarves are well-adapted to living underground? Maybe that's just "flavor," too (after all, it does affect game mechanics). All...