Assuming a substantial part of the population could cast the spell:
Magic Missile would change the nature of hunters somewhat: no more need to physically overpower your prey. I suppose you'd still need to catch it, but imagine a society that just hunts by ambush: spend your days napping in the brush until some animal comes by that you magic missile.
Even in war, the warriors wouldn't need to be all that physical. I would envision the society tending towards higher CON scores, but less STR. Not by genetic difference, but by how they're rasied: hearty diet, but not much need for excessive strength.
Basically, for me, this brings to mind a hunting group of overweight guys that sit around till something to kill comes nearby. Something more akin to modern hunting then historical hunting.