I guess we are talking about ecologic impact of hunter-gatherer wild tribes and economic and demographic crysis of populations suffering raid attacks. They are farmer and shepers, but ready to hunt monster predators, or to train war beasts as "cannon fodder". With some tricks bulls and dogs could be trained to defend the towns. The enemy can kill one of two animals, but not the complete pack in a stampede. Even simple illusory cantrips could cause enoug noise to scare horses and other mounts what aren't used. Or illusory can hide mortal traps activated when the magic bell of the temple is playing the warning.
The raiders can attack, but the nobility can spend money to build harder walls and towers to defend those populations. The corsairs can attack the coast villages to catch slaves, but the authority can send fleets to destroy those pirate ships, but if these work for a enemy nation.
How to explain it better with an example? If you know people from the Mediterranean Sea with a nice wealth, we love eating, drinking, music, enjoying the life, but also we can be brave warriors if it is necessary.
I guess most of wild tribes really live in the faywild, dangerous but with enough hunt and food to be gathered. Even the deities of the evil humanoids would rather this because the menaces from this plane help their worshipers to become stronger when survive.